Disclosure of Invention
The invention aims to overcome the defects of the prior art and provides a vehicle panoramic display method, device and system.
In view of this, the present invention provides a vehicle panorama display method, which adopts the following technical scheme:
a vehicle panorama display method, the method comprising,
constructing a control time sequence of the panoramic system;
based on the control time sequence, the panoramic system controls the vehicle to enter the shed, the vehicle interior panoramic photography and the vehicle appearance photography in real time.
Further, the control time sequence comprises a vehicle in-shed time sequence, a vehicle interior panoramic photographing time sequence and a vehicle appearance photographing time sequence.
Further, the vehicle entering time sequence comprises turntable resetting and vehicle position correction.
Further, the resetting of the turntable comprises,
when the vehicle enters the shed, the sensing device is triggered to send out an entering signal,
and according to the entering signal, the panoramic system controls the rotary table to reset to the initial position.
Further, the vehicle position correction includes,
the vehicle enters the rotary table and triggers the correction device to work;
the correction device captures a real-time image of the vehicle and uploads the real-time image to the panoramic system;
the panoramic system extracts and positions the position contour of the vehicle in the real-time image through the foreground;
marking a real-time location of the vehicle based on a location profile;
and correcting the real-time position of the vehicle so that the real-time position of the vehicle coincides with the central position of the rotary table.
Further, the vehicle interior panorama photographing time sequence comprises,
the panoramic system listens for a wireless signal of a first camera,
if the first shooting device has a wireless signal, the panoramic system is automatically connected with the first shooting device;
the panoramic system acquires a real-time image of the first shooting device;
adjusting the position of the first shooting device based on the real-time image;
the panoramic system controls the first shooting device to shoot the vehicle interior panorama;
the panoramic system acquires a vehicle interior panoramic picture and displays the vehicle interior panoramic picture.
Further, the displaying the vehicle interior panorama picture comprises,
selecting an observation origin of a 3D modeling scene;
and based on the observation origin, the vehicle interior panoramic picture is fully paved with a spherical surface of a sphere with the observation origin as the center of a circle.
Further, the appearance photographing time sequence comprises,
the panoramic system is connected with a second shooting device;
the panoramic system controls the rotary table to rotate and controls the second shooting device to shoot the multi-view appearance of the vehicle;
the panoramic system acquires a vehicle appearance picture and displays the vehicle appearance picture.
Further, the picture for showing the appearance of the vehicle comprises,
the panoramic system displays the appearance picture in an initial state corresponding to the initial view angle;
and the user controls the appearance photo display page to rotate through the panoramic system, and the vehicle is displayed in multiple visual angles.
Further, the displaying the vehicle appearance picture comprises performing twice slicing processing on the appearance picture.
Further, the method may further comprise,
equally dividing a circle of the vehicle into a plurality of viewing angles;
and setting the rotation angle of the rotary table and the appearance photo display page based on the plurality of visual angles.
Another object of the present invention is to provide a vehicle panorama showing apparatus, the apparatus comprising,
the construction module is used for constructing a control time sequence of the panoramic system;
and the control module is used for controlling the panoramic system to control the vehicle to enter the shed, the vehicle interior panoramic photography and the vehicle appearance photography in real time based on the control time sequence.
It is another object of the present invention to provide a vehicle panorama display system comprising at least one processor and at least one memory, wherein,
the memory stores a computer program for executing the method, and the processor calls the computer program in the memory to execute the method.
According to the invention, the automatic control of the panoramic shooting of the interior and the appearance of the vehicle is achieved by constructing the control time sequence of the panoramic system, so that the panoramic photo of the vehicle can be acquired more conveniently, and further, according to the characteristics of the interior and the appearance of the vehicle, the panoramic display of the interior and the appearance of the vehicle is realized by adopting different observation points, so that the automatic display of the panoramic photo of the vehicle is realized, the time of a user is saved, and the interactivity is enhanced.
Additional features and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
As shown in fig. 1, a vehicle panorama display method is introduced in an embodiment of the present invention, where the method includes, first, constructing a control timing sequence of a panorama system, and then, based on the control timing sequence, the panorama system controls, in real time, vehicle boarding, vehicle interior panorama photographing, and vehicle appearance photographing. Further, the panoramic system collects an interior panoramic picture and an exterior panoramic picture of the vehicle by photographing, and displays the interior panoramic picture and the exterior panoramic picture of the vehicle. Through the control time sequence of setting up the panoramic system to reach the automatic control to vehicle interior trim and outward appearance panorama shooting, thereby can be more convenient acquire the panorama photo of vehicle, realize the show of vehicle panorama photo.
In the embodiment of the present invention, the second-hand vehicle is taken as an example for illustration, but the second-hand vehicle is not limited to the second-hand vehicle, and other vehicles are also applicable to the method in the embodiment of the present invention.
In the second-hand vehicle transaction process, the vehicle needs to be subjected to panoramic display, so that panoramic pictures of the vehicle need to be shot, wherein the panoramic pictures comprise a vehicle interior panoramic picture and an appearance picture.
The panoramic system is constructed based on a client program of a PC (personal computer) end, and the correction device, the first shooting device, the second shooting device or the rotary table are comprehensively controlled through the PC end. Wherein the calibration device, the first photographing device and the second photographing device may be (but are not limited to) a calibration camera, a panoramic camera and an appearance camera, respectively. Specifically, the vehicle entering stage comprises turntable resetting and vehicle position correction, firstly, the vehicle triggers an induction device at an entrance of the shooting shed, the induction device sends a vehicle entering signal to a PC (personal computer) end, the PC end controls the turntable to reset after receiving the vehicle entering signal, and the turntable rotates to an initial position. After the turntable is rotated to the initial position, the vehicle enters the platform. Preferably, the sensing device is a ground sensor arranged at the entrance of the shooting shed. Further, after the vehicle enters the turntable, the panoramic system executes vehicle position correction, firstly, the vehicle enters the turntable to trigger the correction camera to work, the correction camera acquires a real-time image of the vehicle and sends the real-time image to the PC terminal, and the PC terminal extracts the real-time image through a foreground, positions a position outline of the vehicle and marks the real-time position of the vehicle; as shown in fig. 2, the rectangular outline of the outer side of the vehicle in the figure is a position outline of the vehicle for which camera positioning is corrected. And finally, correcting the real-time position of the vehicle based on the central position of the rotary table, and enabling the real-time position of the vehicle to be coincident with the central position of the rotary table. When the appearance photos of the vehicle are collected, if the real-time position of the vehicle deviates from the central position of the rotary table, the outline of the vehicle at the view angle close to the camera in the displayed panoramic appearance is larger, the outline of the vehicle at the view angle far away from the camera is smaller, and the position of the vehicle is corrected to enable the display of the panoramic appearance photos of the vehicle to be more accurate. Preferably, the panoramic system further includes a mobile phone end, the mobile phone end is provided with a designated page to display real-time data information of the vehicle position, specifically, as shown in fig. 3, the great circle represents the turntable, wherein "+" in the great circle represents mark information of the real-time position of the vehicle, and when the "+" coincides with the center of the great circle, the vehicle is parked accurately, and the position correction of the vehicle is completed.
The vehicle interior panoramic photographing stage comprises automatic detection connection of a panoramic camera, machine position adjustment of the panoramic camera, and panoramic photographing and displaying of the vehicle interior; specifically, the panoramic system and the panoramic camera are in http long connection through http protocol communication, the panoramic camera is provided with a wireless communication device, and the panoramic system and the panoramic camera are in wireless communication connection to achieve data transmission. Preferably, the wireless communication device is wifi. Further, as shown in fig. 4, a flowchart of a panoramic system for panoramic photographing of the interior trim of the vehicle is shown, wherein when the panoramic system is in operation, the panoramic system monitors wifi signals of the panoramic camera, and if the panoramic camera has wifi signals, the panoramic system is automatically connected to the panoramic camera; preferably, the panoramic system is provided with a wifi signal monitoring clock, and the monitoring clock monitors the wifi signal of the panoramic camera. And when the panoramic system is connected with the panoramic camera, the panoramic system displays the wifi connection state. Because the panoramic camera is a charging device and cannot be kept in a long-term starting state, after the panoramic system is started, even if the panoramic camera is restarted after being charged, the panoramic system can be automatically connected with the panoramic camera and can feed back the connection state of the panoramic camera in real time, so that the panoramic camera can be controlled more intelligently and visually by the panoramic system.
Before performing vehicle interior panorama shooting, the panorama system further needs to adjust the position of a panorama camera, specifically, as shown in fig. 4, the panorama system requests a real-time image of the panorama camera; the panoramic camera sends the real-time image to the panoramic system; and adjusting the position of the panoramic camera based on the real-time image to ensure that the best effect of shooting the panoramic view of the interior of the vehicle is achieved.
The panoramic camera is controlled by the panoramic system to perform vehicle interior panoramic photographing and displaying, specifically, the panoramic camera photographs vehicle interior panoramas, and then the photographed vehicle interior panoramic pictures are processed into video streams and fed back to the panoramic system; the video stream is in a MotionJPGE format, which is only for providing a visual image real-time preview function, and in the MotionJPGE format, a video frame in the video stream is appointed to start with a 0xFF 0xD8 mark value and end with a 0xFF 0xD9 mark value. When the panoramic system receives the video stream and previews the real-time image of the vehicle interior panorama, the video frame image is read from the Http response data stream (response. response stream) with 0xFF 0xD8 as the head marker and 0xFF 0xD9 as the end marker. Further, since the video frames read from the video stream by the panoramic system are planar image data of the vehicle interior panoramic picture, the panoramic system displays the vehicle interior panoramic picture through 3D restoration. Preferably, the real-time image preview can be at a local client, and the 3D reduction presentation adopts a 3D scene model in Viewport3D.
Specifically, 3D modeling is carried out on the vehicle interior panoramic picture, firstly, an observation origin of a 3D modeling scene is selected, and then, based on the observation origin, the vehicle interior panoramic picture is fully paved with a spherical sphere with the observation origin as a circle center. The 3D scene of the whole vehicle interior is equivalent to that a user stands in the center of a ball, the 3D picture of the vehicle interior is fully paved on the spherical surface of the ball, and each visual field on the spherical surface is observed to be a three-dimensional scene restored by the vehicle interior panoramic picture, so that the vehicle interior panoramic picture is displayed more three-dimensionally. Further specifically, it is preferable that, in the Viewport3D, the Viewport3D camera is first set as a perspective camera, that is, a perspective mode camera is adopted, wherein the perspective camera provides a viewing angle at which we view a 3D scene in a 2D plane, then the Position is adjusted to "0,0,0", and then the vehicle interior panorama is overlaid with the model visual 3D. Fig. 5 shows a schematic diagram of a vehicle interior panorama picture display, where COP is a vertex of a panoramic Camera, i.e., an actual observation origin, a Camera Space (Camera Space) is first created to represent an observation point (i.e., an observation origin) of a person when drawing, and objects in a Camera view all belong to the Camera Space. The View Frustum is a scene conical surface and corresponds to a region of the spherical surface of the 3D model, wherein an imaging region for observing the View Frustum through a COP point is a rectangular region in the upper image, the region is a visual field for observing the 3D scene, and only part of the visual field is shown in fig. 5. Therefore, a plane image generated by shooting by the panoramic camera is paved on the spherical surface of the Modelvisual3D, and the restoration from the plane image to the 3D image is realized.
The appearance photographing stage comprises appearance camera connection, vehicle appearance photographing and displaying, and specifically, the appearance panoramic display is equivalent to that the appearance panoramic display is located on the outer side of a three-dimensional model. From the perspective of an observer, if a complete model needs to be observed, a scene needs to be rotated or an observation angle of view of the observer needs to be rotated, so that the appearance picture is displayed as a page, the angle of view of the observer is fixed, and a scene rotation mode is needed, therefore, a vehicle is fixedly equally divided into a plurality of angles of view, the vehicle appearance picture is shot and displayed based on the plurality of angles of view, and the vehicle is exemplarily illustrated by taking the example that the vehicle is fixedly equally divided into 16 angles of view, but the invention is not limited to 16 angles of view, and other equally divided angles of view meet the requirements. The vehicle is fixedly divided into 16 viewing angles in a circle, each viewing angle range is 22.5 degrees, further, in the appearance photographing stage, as shown in fig. 6, the panoramic system controls the rotating table to rotate, the rotating angle is 22.5 degrees each time, and after the rotating table rotates each time, the appearance camera photographs the current viewing angle. Further, when the appearance photos are displayed, the minimum visual angle of the display page can be rotated to 22.5 degrees by the user every time, namely, the display page is rotated to a minimum visual angle every time, and the appearance photos under the corresponding visual angles are loaded as the current scene.
The appearance photographing stage comprises the steps of photographing appearance photos of closing the car door window and the car cover and appearance photos of opening the car door window and the car cover, and the appearance photographing time sequence specifically comprises the following steps,
firstly, the panoramic system is connected with an appearance camera;
secondly, sequentially shooting the vehicle appearance photos of closing the vehicle door window and the vehicle cover and the vehicle appearance photos of opening the vehicle door window and the vehicle cover by the appearance camera;
then, the panoramic system processes the appearance photos and displays the appearance photos.
Specifically, as shown in fig. 7, the panoramic system is connected with an appearance camera, and then when a picture of the appearance of the vehicle with a door window and a door cover closed or a picture of the appearance of the vehicle with the door window and the door cover opened is taken, the specific shooting step includes,
the panoramic system controls an appearance camera to shoot an initial visual angle appearance picture;
the panoramic system controls the rotation of the turntable for 22.5 degrees;
when the rotation is finished, the panoramic system controls the appearance camera to take a second visual angle;
sequentially circulating, and continuously controlling the rotation of the rotary table and the shooting of the appearance camera by the panoramic system until the shooting of 16 visual angle appearance pictures is completed;
due to the fact that the size of the appearance photo is too large, when an appearance display page is browsed, the problems of slow picture downloading, poor user experience and the like occur, the panorama system conducts twice slicing processing on the appearance photo, as shown in fig. 8, the twice slicing processing is respectively an initial slice and a fine slice, the initial slice divides the original appearance photo into 4 equal parts, each slice image is highly compressed, the slice images are fuzzy, the initial slice ensures small enough quality, and preferably, the total quality of all the initial slices is ensured to be below 150 k. Further, the initial slice is pre-loaded at the beginning of loading of the panoramic system, the initial slice is loaded, the panoramic system can download fine slices of the images, the fine slices can equally divide the original appearance photos by 16, and each fine slice can be compressed, but the definition of the images can be firstly ensured. And the fine slices are downloaded by adopting multiple threads, so that the minimum downloading time of the control is ensured. And after the fine slice is downloaded, the control reloads the fine slice to replace the initial slice. When the user initially opens the page, a blurred large image is initially seen, and a clear image can be previewed after a short wait. Therefore, slicing processing is performed twice, the user can effectively and conveniently browse the appearance display page, and user experience is improved.
The invention also provides a vehicle panoramic display device on the basis of the method, as shown in fig. 9, the device comprises a construction module and a control module; the construction module is used for constructing a control time sequence of the panoramic system; and the control module is used for controlling the panoramic system to control the vehicle to enter a shed, take panoramic pictures of vehicle interior decorations and take pictures of vehicle appearance in real time based on the control time sequence.
Further, the construction module is also used for constructing a vehicle in-shed time sequence, a vehicle interior panoramic photographing time sequence and a vehicle appearance photographing time sequence, wherein the vehicle in-shed time sequence comprises turntable resetting and vehicle position correction. The construction module is also used for equally dividing the circle of the vehicle into a plurality of visual angles; and setting the rotation angle of the rotary table and the appearance photo display page based on the plurality of visual angles.
Further, the control module is also used for collecting and displaying the interior panoramic picture and the exterior picture of the vehicle. Specifically, the control module is used for resetting the rotary table based on the time sequence of the vehicle entering the shed, when the vehicle enters the shed, the sensing device is triggered to send an entering signal, and the panoramic system controls the rotary table to reset to the initial position according to the entering signal.
The control module is also used for correcting the position of the vehicle in the time sequence of the vehicle entering the shed, and when the vehicle enters the rotary table, firstly, the correction device is triggered to work; then, the correcting device captures a real-time image of the vehicle and uploads the real-time image to the panoramic system; then, the panoramic system extracts and positions the position contour of the vehicle in the real-time image through the foreground; then, based on the position profile, marking a real-time position of the vehicle; and finally, correcting the real-time position of the vehicle to enable the real-time position of the vehicle to coincide with the central position of the rotary table.
The control module is also used for controlling the panoramic system to monitor a wireless signal of a first shooting device based on a vehicle interior panoramic shooting time sequence, and if the first shooting device has the wireless signal, the panoramic system is automatically connected with the first shooting device; then, the panoramic system acquires a real-time image of the first shooting device; adjusting the position of the first shooting device based on the real-time image; the panoramic system controls the first shooting device to shoot the vehicle interior panorama; the panoramic system acquires a vehicle interior panoramic picture and displays the vehicle interior panoramic picture.
The control module is further used for displaying the vehicle interior panoramic picture, and comprises an observation origin of the selected 3D modeling scene; and based on the observation origin, the vehicle interior panoramic picture is fully paved with a spherical surface of a sphere with the observation origin as the center of a circle.
The control module is also used for controlling the panoramic system to be connected with a second shooting device based on the appearance shooting time sequence; the panoramic system controls the rotary table to rotate and controls the second shooting device to shoot the multi-view appearance of the vehicle; the panoramic system acquires a vehicle appearance picture and displays the vehicle appearance picture.
The control module is further used for displaying the vehicle appearance pictures, wherein the initial state of the appearance picture displayed by the panoramic system is the appearance picture corresponding to the initial view angle; and the user controls the appearance photo display page to rotate through the panoramic system, and the vehicle is displayed in multiple visual angles. And displaying the vehicle appearance picture comprises slicing the appearance picture twice. The appearance picture display further comprises the step that the minimum visual angle of the display page can be rotated by a user to be 22.5 degrees each time, namely, the display page is rotated by one minimum visual angle each time, and appearance photos under the corresponding visual angle are loaded to serve as the current scene.
More specifically, in this embodiment, as shown in fig. 10, the control of the turntable by the panoramic system is controlled by a PLC controller, the panoramic system is externally connected with a USB switching value converter, the USB switching value converter can call 4 switching value signals and output the switching value signals to a wireless transmitter, and the PLC controller respectively controls the turntable to perform resetting, continuous rotation, rotation at a unit angle, and stopping based on the switching value signals received by different signal channels; specifically, the PLC drives the motor controller to control the rotating speed of the motor so as to drive the rotary table to work. In an embodiment of the invention, the unit angle rotation is 22.5 ° rotation.
The present invention also provides a vehicle panorama display system based on the above method, as shown in fig. 11, the vehicle panorama display system includes: at least one processor and at least one memory; wherein the memory stores a computer program for performing the method described above, and the processor calls the computer program in the memory to perform the method described above.
Although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.