WO2017197971A1 - Système d'acquisition d'images 3d d'une automobile ou d'un dispositif mobile et d'affichage tête haute 3d à l'œil nu, et procédé de traitement d'images 3d - Google Patents

Système d'acquisition d'images 3d d'une automobile ou d'un dispositif mobile et d'affichage tête haute 3d à l'œil nu, et procédé de traitement d'images 3d Download PDF

Info

Publication number
WO2017197971A1
WO2017197971A1 PCT/CN2017/077220 CN2017077220W WO2017197971A1 WO 2017197971 A1 WO2017197971 A1 WO 2017197971A1 CN 2017077220 W CN2017077220 W CN 2017077220W WO 2017197971 A1 WO2017197971 A1 WO 2017197971A1
Authority
WO
WIPO (PCT)
Prior art keywords
car
bionic
eye
naked
mirror
Prior art date
Application number
PCT/CN2017/077220
Other languages
English (en)
Chinese (zh)
Inventor
彭波
Original Assignee
彭波
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from CN201610333077.XA external-priority patent/CN105929539B/zh
Application filed by 彭波 filed Critical 彭波
Publication of WO2017197971A1 publication Critical patent/WO2017197971A1/fr

Links

Images

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/20—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/31—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles providing stereoscopic vision
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/20—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/22—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle
    • B60R1/23—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view
    • B60R1/27—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view providing all-round vision, e.g. using omnidirectional cameras
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/20—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/22—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle
    • B60R1/28—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with an adjustable field of view
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays

Definitions

  • the invention relates to a 3D image acquisition suitable for a car or a mobile device, a naked eye 3D head-up display system, a bionic 3D image reconstruction technology, a bionic 3D navigation map making method and a 3D navigation mode.
  • the head-up display has made people realize that if they can get the driver to get the car driving status, traffic conditions, navigation maps, communication and social information without having to bow their heads or take their eyes away from the road ahead, it will greatly improve.
  • the information provided by the heads-up display is limited, and the driver still needs to bow down to get more information and services from the car center console.
  • Streaming media has entered the automotive industry. It has become a trend. Digital cameras can be seen everywhere in the car, but drivers can't judge the cars they drive and the adjacent lanes through the 2D images provided by traditional rearview mirrors and car cameras. The relative distance between other cars or objects or pedestrians that appear in the rear lane.
  • 3D navigation is the direction of future car navigation development.
  • the present invention proposes a vehicle bionic 3D viewpoint and a bionic 3D image reconstruction technique.
  • the Internet of Vehicles technology displays the application, navigation, communication, social, entertainment and service information of the mobile phone directly on the car screen, and controls and manages it through the touch screen.
  • the hardware parameters of the car screen including the resolution and response speed, are far less than the smooth and easy to use of the smartphone, and can not meet the requirements for display and operation of various 3D protocols and streaming media information.
  • the present invention proposes an automobile 3D intelligent center.
  • the biggest challenge facing automotive 3D navigation is not only the way of collecting and acquiring 3D navigation map data, lower cost and less time, but also the problem of resolving the stereoscopic depth relationship between objects in the original scene and obtaining A car naked eye 3D playback platform.
  • the invention not only provides a driver with a naked eye 3D playing platform, but also proposes a method for making a bionic 3D navigation map and three different 3D navigation modes.
  • the present invention proposes a left-side and right-side bionic 3D viewing mirror and an in-vehicle naked-eye 3D rearview mirror.
  • the invention provides a 3D image capturing and naked-eye 3D head-up display system and a 3D image processing method for a car or a mobile device, which not only solves the problem that the driver does not need to take his binocular line of sight away from the traffic ahead of the road when driving the car or the mobile device.
  • the 3D image processed by the image reconstruction technology determines the relative distance between the car that it drives and other cars or objects or pedestrians appearing in the adjacent lane and the rear lane, and the bionic 3D navigation map and other third-party production proposed by the present invention.
  • the 3D navigation map provides a car naked eye 3D playback platform.
  • 3D image capture for car or mobile devices and a naked-eye 3D head-up display system including a heads-up display, a set of naked-eye 3D screens, a set of bionic 3D viewpoints, a 3D smart center, left and right bionic 3D viewing glasses and a car Inside the naked eye 3D rearview mirror.
  • a heads-up display consists of a transparent plexiglass in the shape of a flat or curved surface and a flexible or non-flexible transparent screen with a flat or curved shape attached to its inner surface.
  • the transparent screen can be a traditional 2D screen or a naked eye 3D. screen.
  • Transparent plexiglass materials are selected to have good transparency, sturdy, lightweight and temperature resistant materials.
  • a layer of polarizing film can be added between the screen and the transparent plexiglass or on the outer surface of the transparent plexiglass to reduce the intensity of sunlight and the effect of various reflections on the image in the screen.
  • the heads-up display is connected to a base, and the angle between the head-up display and the base is adjustable. The base is fixed on the dashboard of the car or on the center console.
  • the motherboard of the screen can be placed in the 3D smart center.
  • the image and the font are deformed in the vertical direction because the tilt angle of the screen relative to the driver's eyes changes, and the driver can pass through the 3D smart center.
  • the image processing software and the hand touch screen correct the images and fonts on the heads up display screen.
  • the corrected images, fonts and symbols will be stored in the memory unit of the 3D Smart Center.
  • the content and screen displayed on the heads-up display are designed with simple, clear and required information, including but not limited to car speed, speed limit, safe distance for drivers, speeding or too close to other vehicles, instant messaging and social information. , short version of 3D navigation guidelines, recommended routes, etc.
  • the content convergence point in the head-up display is set in the car through the image processing software built in the 3D smart center and the hand touch screen.
  • different displays can be placed at different positions from the front of the front windshield of the car if needed.
  • the principle of setting the content convergence point is not to bring the content to the front car.
  • setting the content convergence point at the forefront of the car is a location that is more reasonable and acceptable to most drivers, considering all possible situations.
  • the driver gets important and necessary information through the heads-up display, and gets more and detailed content through a set of naked-eye 3D screens, including but not limited to 3D navigation and 3D navigation maps, 3D panoramic images, 3D entertainment, communication, SMS, WeChat, Other content and services.
  • a set of naked-eye 3D screens employ one of two different design patterns described below.
  • the first design mode is the naked-eye 3D workbench mode.
  • the naked-eye 3D table is a flexible or non-flexible naked eye 3D consisting of a flat or curved shaped back plate or a bent flat plate-shaped back plate and one or more flat or curved shapes fixed on the inner surface of the back plate.
  • the screen is composed.
  • the back plate can be directly fixed to the base or connected to the base by a bracket that is fixed on the center console of the front of the car.
  • the driver can adjust the position of the back and the screen up and down, the left and right rotation and the up and down elevation through the bracket to obtain a position for better and convenient viewing of the screen content.
  • a transparent plexiglass back panel and a transparent naked-eye 3D screen can be used.
  • the front and rear passengers can move and rotate the screen to a position that is appropriate for them to view.
  • the screen stand and base are designed with an ultimate blocking mechanism to ensure that the screen does not move with the front passengers when it is moved and rotated to the extreme position. The full airbags collided during the outbreak.
  • the second design mode is the naked-eye 3D console mode.
  • This mode is suitable for an in-vehicle 3D display device designed by an automobile manufacturer for a car.
  • the naked-eye 3D console is composed of a plurality of flat or curved shaped flexible or non-flexible naked-eye 3D screens; multiple screens can be stitched together into one continuous set of screens or differently placed in the car according to different display contents or purposes. Location. Each screen can play different content, or you can splicing together to play an image with an extra wide picture. Each screen can vary in size and shape. The number, arrangement, location, and arrangement of screens used in the naked-eye 3D console mode is different for each different make and model of car or mobile device.
  • the range of human eyes can be up to 160 degrees from horizontal and 80 degrees from vertical.
  • the central region of the human eye can clearly distinguish images when it is within about 15 degrees of view.
  • the horizontal viewing angle is between 15 degrees and 35 degrees, the human eye can see the existence and motion of the object, and it is possible to discern the degree of clarity without turning the head, but the resolution has been reduced.
  • the horizontal angle of view is between 35–60 degrees, the eyes of the person can distinguish the color, but the object and the motion details cannot be determined. If you need to distinguish the object clearly, you need to turn the eyeball or the head to let the object or motion details fall into the eye.
  • the horizontal viewing angle is within 35 degrees.
  • the human eye can only distinguish the color and the blurred object and the direction of motion. At this time, the head must be turned to distinguish the object and the motion details. In fact, the human eye can clearly see that the object is in an elliptical cone with a horizontal viewing angle of about 35 degrees and a vertical viewing angle of about 20 degrees. The human eyes will have a very good visual presence in this elliptical cone area and will not cause fatigue due to frequent eyeball rotation.
  • the driver can look at the information displayed in the head-up display by looking down or down from the road ahead for about 5–10 degrees, and the car dashboard data can be seen at about 20–25 degrees.
  • the position of the equipment in the center console of the car is lower than the position of the car dashboard and is located in the lower right direction of the instrument panel.
  • searching for the music channel and adjusting the air conditioning knob requires both eyes and head to be offset 20-20 degrees to the right and 25 to 45 degrees below the head.
  • the driver has completely left the eyes of the eyes away from the road ahead. If the car speed is faster at this time, the seconds left by the eyes leaving the road ahead will cause the car to travel tens of meters to hundreds of meters, posing a great risk to the life of the driver and the passengers in the car.
  • the screen of the car naked eye 3D table is designed to be close to or higher than the height of the car dashboard in the horizontal direction.
  • a vertical line at the midpoint of the driver's eyes is the intersection of two vertical planes.
  • the horizontal tangent on one vertical plane faces the front of the car, and the other vertical plane passes.
  • the center point of the backplane of the naked eye 3D workbench the angle between the two planes does not exceed 75 degrees.
  • the most frequently used 3D shooting methods are convergence and parallel.
  • the convergence method is a 3D shooting method that imitates the way people focus on the scene.
  • the left and right images with different viewing angles obtained when shooting using the convergence method will have a trapezoidal distortion phenomenon, and the closer to the attention of the subject, the larger the distortion.
  • the trapezoidal distortion causes the edges of the two images to be unable to perform perfect 3D fusion in the vertical direction, which is one of the main causes of eye fatigue and physical discomfort when the viewer feels the 3D image.
  • the parallel method is a method of 3D shooting of two cameras placed in parallel against the subject. The parallel method does not conform to the way and habits of people's eyes to pay attention to the scene.
  • the 3D image merged in the 3D playback space appears in front of the screen, and is not an ideal 3D playback effect.
  • the two images with different viewing angles obtained by the parallel method have no keystone distortion, and the parameters set at the time of shooting can be corrected by manual intervention after the shooting is completed, so that the reconstructed two have different viewing angles.
  • the image is converged on the only corresponding point in the 3D playback space. This method not only conforms to the human eye viewing habits but also minimizes image distortion.
  • two images with different viewing angles obtained using the parallel method have a natural, comfortable and healthy 3D feel and effect after being processed by 3D image reconstruction technology.
  • a bionic 3D viewpoint is a device that has a camera or two cameras that can capture 3D images.
  • the centerlines of the two cameras are on the same horizontal plane and parallel to each other, with a parallel spacing of 5–80 mm between the two centerlines.
  • Manufacturer of two cameras The brand, model and parameters should be identical, ensuring that the two images with different viewing angles are close in color, white balance, depth of field, expressiveness and quality.
  • the cover plate facing the camera lens in the bionic 3D viewpoint is a transparent glass coated with a transparent coating on the inner and outer surfaces, and the transparent glass surface coated with a transparent coating has a self-cleaning function of repelling water, mist and foreign matter.
  • the human eye is an optical structure that is suitable for optical theory.
  • the results of the study show that the human eye has a focal length of approximately 16.65 mm and a corresponding viewing angle of 120 degrees.
  • a wide-angle lens can cause barrel distortion in an image. Two images with barrel distortion cannot achieve perfect 3D image fusion in the vertical direction, so each camera lens in the bionic 3D viewpoint has a viewing angle of less than 120 degrees.
  • the car 3D image acquisition system collects 3D images around the car and in a specific direction by setting a bionic 3D viewpoint at a plurality of different positions of the car.
  • Each bionic 3D viewpoint is labeled with a different number or name depending on the location of the car.
  • the bionic 3D viewpoint 1 is placed below or above the center of the inner surface of the front windshield of the car or at the center or near the center of the front of the car, and the camera lens is directed toward the front of the car.
  • the bionic 3D viewpoint 2 is placed below or above the center of the inner surface of the rear window of the automobile or at the center of the rear cover or near the center, and the camera lens is directed toward the front of the vehicle.
  • Bionic 3D viewpoints 3 and 4 and bionic 3D viewpoints 5 and 6 are respectively placed in the left and right side of the car in a conventional mirror rearview mirror or under the mirror mirror housing or on the left and right side of the bionic 3D viewing mirror bracket On the left and right side of the car.
  • the camera lenses in the bionic 3D viewpoints 3 and 4 are respectively oriented toward the left front direction and the left rear direction of the car.
  • the camera lenses in the bionic 3D viewpoints 5 and 6 are respectively oriented toward the right front and rear directions and the right rear direction of the car.
  • the bionic 3D viewpoints 7 and 8 are respectively placed on the left and right side of the car or on the roof of the car, and the camera lenses are respectively directed to the left or right direction of the car.
  • the number and location of bionic 3D viewpoints installed in the automotive 3D image acquisition system determine the range of viewing angles of the images obtained around the car and the possible blind spots. For example, for a car equipped with bionic 3D viewpoints 1, 2, 3, 4, 5 and 6, there are two symmetrical blind zones on the left and right sides of the car.
  • the blind area on the left side of the car is the area between the left edge of the view of the bionic 3D view 3 on the left side of the car and the right edge of the view of the bionic 3D view 4.
  • the blind area on the right side of the car is the area between the right edge of the view of the bionic 3D view 5 on the right side of the car and the left edge of the view of the bionic 3D view 6.
  • the car is surrounded by a 360-degree 3D image without a blind spot.
  • the panoramic image of the car is a 3D image of a continuous and complete ultra-wide image by editing and splicing the images from multiple bionic 3D viewpoints through the built-in image processing software of the 3D intelligent center.
  • the panoramic image of the front of the car comes from the bionic 3D viewpoints 1, 3 and 5.
  • the rear panoramic image of the car comes from the bionic 3D viewpoints 2, 4 and 6.
  • the panoramic image of the left rear of the car comes from the bionic 3D viewpoints 2, 4 and 7.
  • the panoramic image of the rear right of the car comes from the bionic 3D viewpoints 2, 6 and 8.
  • At least one of the bionic 3D viewpoint images in each of the whole images includes one or a part of a car or a mobile device as a reference object, for example, in the front panoramic image.
  • the image obtained by the camera in the bionic 3D viewpoint 1 includes a logo on the front of the car or a front edge portion of the front cover of the automobile engine.
  • the driver can determine the relative distance between the car he is driving and other cars or objects or pedestrians appearing in the adjacent lane or in the rear lane based on the reference in the 3D image played in a set of naked-eye 3D screens.
  • Cars with bionic 3D viewpoints 1, 2, 3, 4, 5 and 6 During normal driving, a set of naked-eye 3D screens plays a panoramic image of the front of the car.
  • the 3D smart center automatically switches a set of naked-eye 3D screen playback content from the front panoramic image of the car to the car. Rear panoramic image.
  • the 3D smart center After the driver completes the lane change, turns, reverses or stops, and after the turning lever rebounds or switches the car gear to the forward gear position, the 3D smart center automatically plays the contents of a set of naked-eye 3D screens from the rear panoramic image of the car. Switch back to the panoramic image in front of the car.
  • a set of naked-eye 3D screens plays a panoramic image of the front of the car.
  • the 3D smart center automatically switches the content played in a set of naked-eye 3D screens from the front panoramic image of the car.
  • the 3D smart center automatically switches the content played in a set of naked-eye 3D screens from the left rear or right rear panoramic image of the car back to the front panoramic image of the car. .
  • the driver can switch the content played in a set of naked-eye 3D screens by voice control at any time during driving.
  • the real-time distance measurement is performed, and the range finder is installed at a corresponding position on the vehicle.
  • the range finder can be used in any way of sensor ranging technology and equipment in laser, ultrasonic, radar or microwave radar.
  • the distance measurement information obtained by the range finder will directly enter the 3D intelligent center, and the distance measurement data obtained by the 3D intelligent center will be analyzed in real time through software, and the completed data will be corrected and calculated together with the pre-designed and added information.
  • an augmented reality display method is used, such as an arrow pointing to a car or pedestrian near an ongoing distance measurement, and the information box of the connection arrow is displayed.
  • the 3D Intelligent Center reconstructs each of the two images with different viewing angles obtained from the bionic 3D viewpoint through bionic 3D image reconstruction technology, so that the reconstructed two images are less distorted after being merged by the human brain.
  • the second is to set the convergence point of the two images with different perspectives in the 3D playback space on the 3D playback screen by appropriately selecting the value of h and adjusting the position of the scene in front of the car.
  • the parallax on the 3D playback screen is zero.
  • the original scene space and the 3D play space become two ideal spaces corresponding to each other.
  • the ideal imaging is any point in the original scene space. A straight line and a surface reproduce at corresponding points in the corresponding ideal space to a point with a similar stereoscopic depth relationship, without distortion and distortion, a straight line and a surface.
  • the maximum amount of screen is a parameter that needs to be controlled, because the fused 3D image is located between the viewer and the 3D screen. It is not an ideal expression for 3D images. Long-term viewing will cause fatigue in the eyes of the audience. Physiologically feeling unwell.
  • the relationship is reproduced in a 3D play space in a similar stereoscopic depth relationship with minimal changes.
  • the current 3D playback technology is called planar 3D display technology, in which two images with different viewing angles are simultaneously projected onto a flat screen, and the horizontal distance of the two images on the screen is parallax.
  • the position of the merged 3D image convergence point is usually controlled by adjusting the parallax of the two images.
  • the left and right eyes of the audience can only see and focus on one of the images that are independent of each other.
  • the images obtained by the left and right eyes are merged by the brain to form a 3D image.
  • flat 3D display technology is different from the way people use to watch the world.
  • the maximum viewing angle difference often used in empirical formulas is 0.02, which is equivalent to 1.17 degrees or 0.07 radians.
  • the bionic 3D image reconstruction technology theoretically derives the maximum parallax angle and believes that as the viewer's viewing angle difference in viewing 3D images is closer to the theoretical maximum parallax angle of the bionic 3D image reconstruction technology, the closer the 3D image and effect seen by the viewer is Stereo depth and feel in the original scene space.
  • increasing the maximum viewing angle difference also increases the impact of the focus-convergence conflict. So how to find the best balance point is the key. For different applications and requirements, the choice and focus of the balance point are also different.
  • the fourth is to include at least one or part of the components on the car or mobile device as a reference in the image captured by the partial bionic 3D viewpoint.
  • the driver can determine the car that he is driving and the other cars or objects or pedestrians appearing in the adjacent lane and the rear lane according to the reference object in the 3D image reconstructed by the bionic 3D image played in a set of naked-eye 3D screens in the car. The relative distance between them.
  • 3D navigation maps and data can be obtained by the following four production methods that are more efficient, lower cost, and require less time.
  • the first method is the urban model method. Many cities have a scaled urban model with detailed urban roads, three-dimensional transportation hubs, overpasses, architectural models with the same architectural style and details as physical buildings, parking lots, tree planting on both sides of the road, and more. detail. The model is constantly being updated as the city develops and changes.
  • the camera is 3D shot from a number of different directions and angles to the city model, using a miniature camera or two miniature cameras that can capture 3D images along each street in the urban model by simulating the driving of real people. , squares, intersections, parking lots, tunnels, overpasses and transportation hubs, etc. and 3D shooting in different directions.
  • the two images with different viewing angles were reconstructed and processed by bionic 3D image reconstruction technology.
  • the second method is user sharing. This approach encourages every driver who owns the patented product of the invention to participate in the shared data plan, making each driver a renderer of the 3D navigation map and also making them a user of the 3D navigation map.
  • the driver photographs the real street scene in the car's driving route through the bionic 3D viewpoints 1, 3 and 5 while driving the car and records it in the car smart 3D center.
  • GPS and related 3D navigation map drawing software are set in the 3D smart center, each car will record the relevant data of the current road conditions, road signs, road signs, signal lights and traffic signs while driving.
  • the car 3D smart center will automatically search for the wireless hotspot, and automatically collect and process all the collected data and images through the software and upload it to the cloud.
  • the third method is the 2D to 3D method. When cars are driving on city roads, off-city roads and highways, buildings and streetscapes on both sides of the road are not important signs.
  • the 2D to 3D technology is to divide and separate some urban roads in the current 2D navigation map, different roads and highways according to different road numbers, different road colors or different road directions with different three-dimensional depths.
  • a driver passes a route with different stereo depths, he or she knows very clearly where the road or lane he is driving.
  • different directions and intersecting routes are layered and separated by roads or lanes with different depths according to the true proportion between the overpasses, making it easier for the driver to distinguish the correct road.
  • the 3D image realized by this technology is often referred to as pseudo 3D, and is one of the main reasons why 2D to 3D technology cannot be popularized.
  • the flat panel effect means that the entire original scene space seems to be artificially divided into a plurality of subspaces, and the scenes and contents in each word space are forcibly compressed onto a drawing board, and each scene on the drawing board has the same three-dimensional shape. depth.
  • 3D navigation maps with flat panel effects can not only be accepted, but also become one of the most practical tools for three-dimensional navigation maps.
  • the city model navigation map produced by the above method will appear in a set of naked-eye 3D screens when the car is driving on urban roads, the roads outside the city and the highway passing the closest city edge. At this time, the driver knows very clearly the relative position and direction of the car he is driving from the nearest city.
  • the fourth method is to make a short version of the 3D navigation guide.
  • the short 3D navigation guide is a new navigation guide with perspective and 3D visuals.
  • the short 3D navigation guide has an infinity convergence point with a perspective effect that is lower than the driver's eyes.
  • the road guidance with arrows in the simplified 3D navigation guide can extend directly along the road and point forward. Road guidance with arrows and height between roads You can adjust.
  • the driver uses the 3D smart center hand touch screen to adjust the position of the infinity convergence point of the simplified 3D navigation guide and the height between the road guide with the arrow and the real road.
  • the infinity convergence point of the short version of the 3D navigation guide becomes a road guide with arrows that approach or intersect at the end of the infinity direction.
  • the short version of the 3D navigation guide is designed with simple, clear and straightforward expressions in mind so that the driver can quickly identify, understand and react accordingly without any hesitation.
  • the 3D navigation map data obtained by the above three production methods are subjected to image post-production, the data obtained by different methods are shared with each other, and after being labeled and summarized, the final 3D navigation map and the simplified 3D navigation guide are obtained. If the final 3D navigation map obtained by the above method is reconstructed by the biomimetic 3D image reconstruction technology, the 3D navigation map is called a bionic 3D navigation map.
  • the bionic 3D navigation map intersects the 3D navigation map as a 3D navigation map that restores the original scene more accurately, less deformed, and represents a more precise similar stereo depth relationship.
  • the 3D Smart Center provides drivers with three different navigation modes; the first mode is the simplified 3D navigation guidance mode, which is used directly in the heads-up display.
  • the second mode is an augmented reality mode of real 3D street view navigation combined with a simplified 3D navigation guide. This is a navigation mode of an augmented reality representation that overlays a simplified 3D navigation guide on a front panoramic image played in a set of naked-eye 3D screens.
  • the third mode is the 3D navigation map mode.
  • the 3D navigation map may be derived from the 3D navigation map obtained by the first three production methods or other production methods in [0022] above. In addition to the first navigation mode being played in the heads-up display, the other two navigation modes are played in a set of naked-eye 3D screens.
  • the driver can switch between the second and third 3D navigation modes by voice control at any time.
  • the above second and third navigation modes not only provide the driver with a clearer and more accurate navigation service, but also provide the driver with a clear and accurate point of interest (POI) positioning value-added service, becoming a brand new, Effective and commercially viable business service model.
  • POI point of interest
  • Each of the different points of interest can be directly marked in the 3D navigation map at the exact location and location, whether the point of interest is in the same building, on a different floor or next to the ground floor.
  • the driver can easily find the location and direction of the point of interest based on the real 3D street view navigation or the 3D navigation map in accordance with the real target shape or architectural features of the point of interest. It will not happen because the same place has appeared at the same time.
  • an arrow points directly to the point of interest, and a box containing simple explanatory text and numbers is attached to the back of the arrow.
  • the driver directly speaks the number in the box, the 3D Smart Center will take you directly to the point of interest and get a more detailed introduction and description of the 3D image with the naked eye 3D screen.
  • the traditional mirror rearview mirror technology not only has a small viewing angle, but also has a large wind resistance and wind noise coefficient, and the driver cannot judge from the rearview mirror the other car or object or pedestrian appearing in the car in the adjacent lane or in the rear lane.
  • the relative distance between them The left and right bionic 3D viewfinder combined with the rangefinder and augmented reality display technology and method not only solve all the problems of the above-mentioned traditional mirror rearview mirror, but also let the driver do not need to turn the head and leave the eyes away from the front.
  • the left and right bionic 3D viewing mirrors of the car use one of four different designs.
  • the first solution is to place the bionic 3D viewpoints 3 and 4 and the bionic 3D viewpoints 5 and 6 in the left and right side of the conventional mirror mirrors of the car, respectively.
  • This design is suitable for the front and rear bionic 3D viewing mirrors of the front or rear mounted car. This design not only has mutual support and backup of the two rear view technologies, but also better protects the 3D camera.
  • the bionic 3D viewpoints 3 and 5 are respectively fixed on the left side and the right side of the left side and the right side of the conventional mirror mirror rear view housing and a support inside the rear view mirror, and the intersection of the two camera center lines and the outer surface of the camera objective lens The midpoint recombination with the outer surface of the objective lens is located on the same tangent plane.
  • the bionic 3D viewpoints 4 and 6 are respectively fixed to a support inside the conventional mirror mirrors on the left and right sides of the car. There is a large enough space between the two camera objectives and the inner surface of the mirror lens. When the driver adjusts the working angle of the mirror lens in the left and right side of the traditional mirror mirror, the camera objective There is no contact with the inner surface of the mirror lens.
  • the lens portion of the lens lens facing the bionic 3D viewpoints 4 and 6 has a horizontally rectangular portion that is completely transparent, and the mirror lens has no mirror coating on the back side of the horizontal rectangular region.
  • the inner and outer surfaces of the transparent glass in the horizontally-shaped rectangular region are plated with a clear coating, and the glass surface coated with the transparent coating has a self-cleaning function of repelling water, mist and foreign matter.
  • the camera lens in the bionic 3D viewpoints 4 and 6 captures the outside image through this horizontally-shaped rectangular transparent glass.
  • the second option is to fix the bionic 3D viewpoints 3 and 4 and the bionic 3D viewpoints 5 and 6 respectively under the left side and right side of the conventional mirror mirror housing.
  • the bionic 3D viewpoints 3 and 4 and the bionic 3D viewpoints 5 and 6 are designed to have a streamlined shape and are integrated with the conventional conventional mirror mirrors on the left and right sides of the car, respectively.
  • the third option is to design a retractable left and right mirror bracket for the car. One end of the mirror bracket is attached to the car body or a base fixed to the car body, and the other end is suspended. When the car is started, the left and right mirror brackets of the car will automatically move or rotate to the normal working position. When the car is stopped, it will be automatically retracted into the car body or the mirror bracket base to hide.
  • the bionic 3D viewpoints 3 and 4 and the bionic 3D viewpoints 5 and 6 are respectively disposed on the left side and right side mirror brackets of the automobile.
  • the two camera centers in each of the 3D viewpoints in the mirror bracket are in the same horizontal plane when the two left and right mirror brackets of the car are in the normal working position.
  • the mirror bracket can be placed at different positions in the car, such as the position of a conventional mirror mirror, on the front door or on the body in front of the front door. How the positional setting and shape design of the mirror bracket can be perfectly integrated with the shape and design style of the car body will become a challenge for the car designer.
  • the fourth option is to mount 3D viewpoints 3 and 4, 5, 6, 7, and 8 at different positions on the left and right side of the car or on the roof of the car.
  • the centerlines of the two cameras in the bionic 3D viewfinder are at the same level. on flat surface.
  • the driver observes the traffic conditions on the rear road through the rear view mirror of the car.
  • the angle of view of the traditional interior mirrors is limited by the C-pillars and D-pillars behind the car and the rear passengers and cargo.
  • the rear road traffic condition information provided by the 2D camera image does not allow the driver to determine the relative distance between the car he is driving and other cars or objects or pedestrians appearing in the back road.
  • the driver sees the rear panoramic image from the bionic 3D viewpoints 2, 4 and 6 from the naked eye 3D rearview mirror in the car, with a larger viewing angle and no interference and dead ends.
  • a naked-eye 3D rearview mirror in a vehicle is a flexible or non-flexible naked-eye 3D screen consisting of a flat or curved shape backing plate and one or more flat or curved shapes fixed on the inner surface of the backing plate and a set outside the screen. It is composed of coated anti-glare glass. The coating only allows light to penetrate from one direction to the outside.
  • the screen motherboard of the naked eye 3D rearview mirror in the vehicle can be placed in the car 3D intelligent center. There is a switch on the naked eye 3D rearview mirror. When the driver turns off the switch, the naked eye 3D rearview mirror becomes a traditional interior mirror rearview mirror.
  • the 3D Smart Center is a computer with a head-up display connected to the motherboard of the computer, a set of naked-eye 3D screens and a motherboard with a naked-eye 3D rearview mirror screen, multiple ISP image processors, a central control unit, a codec and a decoder.
  • a wireless communication module with a communication chip Sim card slot and a hand touch screen.
  • the 3D Smart Center has a separate operating system, built-in 3D image reconstruction technology, image editing and stitching, 3D format conversion, image encoding and decoding, and various signal processing software packages.
  • the 3D Smart Center uses an operating system and built-in image processing software, through an array connected to the motherboard with an image processing chip, a screen and display motherboard and a central control unit, encoding and decoder for each of the two from each bionic 3D viewpoint Image processing from different perspectives, including: bionic 3D image reconstruction, editing, stitching, panning, 3D format conversion, algorithm, optimization, color grading, white balance, encoding, decoding, output and archiving; with a communication chip
  • the APP software pre-installed in the wireless communication module or in the mobile phone connects and processes various functions and contents from the mobile phone application, navigation map, telephone, WeChat, short message, voice control, etc.; through the built-in signal analysis and processing software pair
  • the information of the car OBD and the range finder are processed and processed; and the processed images and information are respectively output to the head-up display according to a preset program by the central control unit, a set of naked-eye 3D screens and a naked-eye 3D rearview mirror in the
  • the central control unit controls and manages the above two or four different panoramic images, and outputs them to a set of naked-eye 3D screens and a screen main board of the naked-eye 3D rearview mirror in time according to the setting requirements of the program.
  • the 3D intelligent center After being decoded by the decoder, it is played in a set of naked-eye 3D screens and in-car naked-eye 3D rearview mirrors.
  • the 3D intelligent center is provided with a wireless communication module with a SIM card slot.
  • the module is equipped with the main mobile phone operating system and the required APP software in the market, and can directly download and receive 3D navigation maps in different operating system mobile phones. Short-term 3D navigation guides, music and video applications and services, not only will not interrupt the service due to various interferences caused by mobile communication or the outside world during use, and save the flow and cost of the mobile phone.
  • the 3D intelligent center will directly output the bionic 3D navigation map to a set of naked-eye 3D screens and the naked-eye 3D rearview mirror through the central control unit. If the 3D navigation map downloaded or connected by the mobile phone comes from a 3D navigation map of a third party, and the 3D image reconstruction technology is not reconstructed and the 3D playback format is not satisfied, the driver can touch the screen through the hand. Whether to perform bionic 3D image reconstruction on such a 3D navigation map or directly output to a set of naked-eye 3D screens and in-car naked-eye 3D rearview mirrors.
  • the 3D Smart Center overlays pre-designed and produced possible or relevant point-of-interest descriptions and profile content information on 3D navigation map images, such as pointing an arrow directly to a point of interest, followed by an arrow containing a simple explanatory text and number. frame.
  • 3D navigation map images such as pointing an arrow directly to a point of interest, followed by an arrow containing a simple explanatory text and number. frame.
  • the 3D Smart Center will take you directly to the point of interest and get a more detailed description and introduction of 3D image effects through a set of naked-eye 3D screens.
  • the 3D Smart Center supports voice-activated interactive control, with multiple general-purpose external interfaces reserved on the backplane and open to third-party applications and services.
  • the 3D Smart Center will be designed and built into a rugged device that will not be easily damaged in traffic accidents and retain data and images from the time of the accident and before.
  • the 3D Smart Center will perform bionic 3D image reconstruction, image editing and splicing processing on all images with different viewing angles from the bionic 3D viewpoint, and the processed two images will be in the left-right format (Side-by-Side).
  • the 3D playback format is output to the heads-up display, a set of naked-eye 3D screens and a naked-eye 3D rearview mirror in the car.
  • the technology and device proposed by the invention have the characteristics of easy installation, simple operation, low cost, easy promotion and popularization.
  • Figure 1 Schematic diagram of a car plane shape head-up display
  • FIG. 2 Schematic diagram of the car surface shape back plate and the naked eye 3D screen and the fixed base workbench
  • FIG. 3 Schematic diagram of the car surface shape back plate and the naked eye 3D screen and the connection bracket type workbench
  • Fig. 4 Schematic diagram of a flat-shaped back plate and a naked-eye 3D screen and a connection bracket type work table in which the automobile is bent twice
  • FIG. 6 Schematic diagram of automobile bionic 3D viewpoint
  • Figure 7 Schematic diagram of car bionic 3D viewpoint and bionic 3D viewpoint viewing angle distribution
  • Figure 10 Schematic diagram of the design of the left and right bionic 3D viewing point mirrors of the car
  • FIG. 11 Schematic diagram of the design of the left and right bionic 3D viewing point mirrors of the car
  • Figure 12 Schematic diagram of the design of the left and right bionic 3D viewing mirror brackets of the car
  • Figure 13 Schematic diagram of the naked eye 3D rear view mirror in the car
  • FIG. 14 Schematic diagram of the car 3D intelligent center and car networking system
  • FIG. 15 Schematic diagram of the car 3D intelligent center
  • a head-up display 9 has two circular connecting ears on its bottom side and a semi-cylindrical projection on the back of the base 10.
  • the connecting ears of the head-up display 9 and the semicircular projections of the base 10 are connected by two bolts 11.
  • the angle between the head-up display 9 and the base 10 is adjusted and fixed by the two bolts 11.
  • Behind the semi-cylindrical shape of the base 10 is a wiring socket 12 dedicated to the head-up display 9 and a power supply port 13.
  • the base 10 is attached to the dashboard or center console of the car via an plexiglass of an attachment 15.
  • the upper surface of the attachment 15 is a flat surface with a curved surface and adhesive.
  • the attachment 15 is secured to the dashboard or center console of the vehicle by glue on the underside, and the base 10 is secured to the planar surface of the attachment 15 by a suction cup 14.
  • the shape of the bottom surface of the accessory 15 varies depending on the brand and model of the car.
  • Figure 2 shows a perverted 3D table 16 consisting of a curved shape back plate and a curved shape flexible or non-flexible open-hole 3D screen pasted on its inner surface.
  • the naked-eye 3D table 16 is fixed to a base 18 and is fixed to the upper center of the car together with the base 18.
  • Figure 3 shows a naked-eye 3D table 16 consisting of a curved-shaped back panel and a curved-shaped flexible or non-flexible open-hole 3D screen pasted on its inner surface.
  • the naked-eye 3D table 16 is connected by a bracket 17 to a base 18 that is fixed to the upper console of the car. The driver can adjust the position and orientation of the naked-eye 3D table 16 through the bracket 17.
  • Figure 4 is a plan view of a flat-plate back sheet 19 that has been bent twice and a naked-eye 3D stitching screen 20 having three planar shapes fixed on its inner surface.
  • the back plate 19 is connected by a bracket 17 to a base 18 that is fixed to the upper console of the car. The driver can adjust the position and orientation of the back panel 19 and the three stitching screens 20 through the bracket 17.
  • the car naked eye 3D console is composed of a plurality of flat or curved shape flexible or non-flexible naked eye 3D screen 21; a plurality of screens 21 can be stitched together to form a continuous screen group or according to different display content or purpose Set at different locations.
  • the naked-eye 3D screen 21 used at each different location may be different, such as the shape, size, or transparency of the screen.
  • the number, arrangement, location and arrangement of screens 21 used by different brands of car consoles are different.
  • FIG. 6 shows a car bionic 3D viewpoint with two cameras 22 arranged in parallel.
  • Each bionic 3D viewpoint is composed of a casing 23, two cameras 22 and a transparent glass cover 25 in the forward direction of the camera.
  • the shape of the bionic 3D viewpoint housing 23 is different depending on the setting position on the car. In the normal working position, the centerlines of the two cameras 22 in the bionic 3D viewpoint are on the same horizontal plane and parallel to each other, and the parallel between the giants is 5-80 mm.
  • the wires 24 of the two cameras 22 are respectively passed through the bionic 3D view housing 23 and connected to the car 3D smart center 34.
  • the front cover of the bionic 3D view housing 23 is a transparent glass 25 coated on both the inner and outer surfaces, and the two cameras 22 in the bionic 3D view capture the outer image through the transparent glass 25 in the forward direction.
  • Figure 7 shows a set of bionic 3D viewpoints set on a car and the viewing angle distribution of these viewpoints.
  • the two largest shaded areas on the left and right sides of the car represent the areas of the set of bionic 3D viewpoints that are still not covered and become blind spots.
  • the smaller area shaded portions of the four corners of the car represent the areas of the four dead corners of the set of bionic 3D viewpoints that are still uncovered.
  • the bionic 3D viewpoint 1 is disposed at a position below the center of the inner surface of the front windshield of the automobile, and the lenses of the two cameras 22 in the viewpoint face the front direction of the car.
  • the bionic 3D viewpoint 2 is disposed at a position above the center of the inner surface of the window glass of the automobile, and the lenses of the two cameras 22 in the viewpoint face the front and rear directions of the car.
  • the bionic 3D viewpoints 3 and 4 and the bionic 3D viewpoints 5 and 6 are respectively disposed in the left and right side of the car in the conventional mirror rear view mirror, and the lenses of the camera 22 in the bionic 3D viewpoints 3 and 4 are respectively directed to the left front direction and the left side of the car.
  • the lenses of the cameras 22 in the bionic 3D viewpoints 5 and 6 are respectively directed to the right front direction and the right rear direction of the automobile.
  • the bionic 3D viewpoints 7 and 8 are respectively disposed on the left and right edges of the roof of the automobile.
  • the range of viewing angles of the bionic 3D viewpoints 7 and 8 is not indicated in FIG. As long as the lenses of the cameras 22 in the bionic 3D viewpoints 7 and 8 are directed toward the left front direction and the right front direction of the car, respectively, it is possible to completely cover the blind areas indicated by the two shaded portions on the left and right sides of the car.
  • Figure 8a shows a typical scene design for 3D image capture in the original scene space.
  • the two cameras 26 and 27 are at a distance t from each other.
  • the two cameras 26 and 27 are simultaneously turned inward until the center lines of the two cameras 26 and 27 converge on the attention scene 30.
  • This is a typical example of a 3D shot using a convergence method.
  • the scene in front of the scene 30 is referred to as the foreground object 31, and the scene in the rear is referred to as the scene object 32.
  • Concerning the scene, the distances of foreground and foreground objects to cameras 26 and 27 are z conv , z near and z far , respectively .
  • Figure 8b in a 3D playback space, a flat screen 33 of width W.
  • the horizontal distance between the left and right images projected onto the screen 33 is the parallax P.
  • the 3D images of the left and right images merged in the brain appear behind the screen, called the screen space.
  • the 3D images of the left and right images in the brain appear between the viewer and the screen, called the audience space.
  • Figure 9a shows that when capturing 3D images in an original scene space, the two cameras 26 and 27 are simultaneously turned inward until the centerlines of the two cameras 26 and 27 converge onto the subject of interest 30.
  • the centerlines of the two cameras 26 and 27 are imaged directly at the center point of the imaging chips 28 and 29 of the two cameras 26 and 27 at the point of convergence on the subject of interest 30.
  • Figure 9b shows the two cameras 26 and 27 being rotated outwardly from the convergence mode shown in Figure 9a until the centerlines of the two cameras 26 and 27 are parallel to each other.
  • the 3D shooting method is changed from the convergence method to an example of the parallel method.
  • Push: t [(Z D /Axf)x(1/Z cnear –1/Z cfar )/(1/z near –1/z far )]xT (5)
  • Equation (5) shows that the distance between the center lines of the two cameras in 3D shooting is different from the distance between the eyes of the human eye.
  • Equation (6) shows that there is no linear relationship between Z c and z.
  • the ideal image is any point in the original scene space.
  • a line and a face correspond to the only point in the 3D image reconstruction space, a line and a face.
  • the only condition is to make the mathematical relationship between the corresponding points in the two spaces. Become a linear relationship.
  • the condition that the linear relationship between Z c and z holds is that
  • Equation (7) shows that two images with different viewing angles obtained at any point in the original scene space have a unique corresponding point in the 3D playing space, and two images with different viewing angles achieve convergence at the corresponding points.
  • the bionic 3D image reconstruction technology requires that the imaging chips 28 and 29 of the camera be moved horizontally in opposite directions to each other before shooting or after the normal shooting is completed.
  • the left and right images are horizontally translated by a distance h from each other in opposite directions.
  • the parallel method can also obtain a more ideal effect than the convergence method for 3D shooting when shooting a 3D image, which not only conforms to the manner and habit of the person's eyes, but also has no distortion.
  • Equation (9) yields the theoretical limit of the maximum parallax angle a max .
  • the widely used empirical formula a max of 0.02 is a relatively conservative empirical safety value. When the safety value of the maximum viewing angle difference is increased, the 3D effect seen and perceived by the human eyes will be closer to the true stereoscopic depth relationship in the original scene, but at the same time the focus of the human eye is increased. influences.
  • Equation (7) shows that there is a mathematical relationship between the two spaces, and the geometry of an object in each original scene space can be correctly restored in a certain scale in the 3D play space without distortion.
  • Equation (8) shows that the value of h is properly selected and the position of the focus of the scene in the 3D play space is set on the 3D screen. At this time, the following relationship holds in the ideal space (the following relationship is passed) Equation (7) can also be proved)
  • Equation (11) shows that the maximum amount of screen is related to the position of the close-up object in the original scene, in addition to the camera parameters.
  • the excessive amount of screen output in the audience space will not only make the audience feel unreal, but also cause one of the reasons for the viewer's eye fatigue and physical discomfort.
  • the most effective way to control the maximum amount of screen shot is to control the position of the close-up object with a certain amount of playback screen.
  • Figure 10 shows the first design of the left and right bionic 3D viewing mirrors of the car.
  • the bionic 3D viewpoints 3 and 4 and the bionic 3D viewpoints 5 and 6 are respectively disposed in the left and right side of the car in the conventional mirror mirrors.
  • Fig. 10 only the structure and implementation method of the bionic 3D viewfinder lens on the left side of the car are shown.
  • the bionic view mirror on the right side of the car is a mirror image on the left side, and the structure and implementation method of the two are completely the same.
  • the bionic 3D viewpoint 3 is fixed to the surface of the rear view mirror front housing 34 and a support structure 38 inside the rear view mirror, the intersection of the center line of the two cameras 22 with the outer surface of the objective lens of the camera 22 and the outer surface of the objective lens.
  • the midpoint recombination is located on the same tangent plane.
  • the bionic 3D viewpoint 4 is mounted on the support structure 38 in the rear view mirror, wherein the objective lens of the camera 22 needs to be sufficiently far from the mirror lens 35 that the inner surface of the camera objective lens and the mirror lens 35 in the bionic 3D viewpoint 4 are not adjacent to each other. Any contact will occur.
  • the rotating mechanism 37 rotates the mirror lens 35 in the up and down and left and right directions.
  • the bottom of the mirror lens 35 has a horizontally-shaped rectangular transparent portion 36 having a mirror coating on the back side.
  • the inner and outer surfaces of the transparent portion 36 are plated with a clear coating, and the transparent glass surface coated with the transparent coating has a self-cleaning function of repelling water, mist and foreign matter.
  • the two cameras 22 in the bionic 3D viewpoint 4 capture the outside image through the transparent portion 36 at the bottom of the mirror lens 35.
  • Figure 11 shows a second design of the left and right bionic 3D viewing mirrors of the car.
  • the bionic 3D viewpoints 3 and 4 and the bionic 3D viewpoints 5 and 6 are mounted under the outer casing 34 of the left and right side of the conventional mirror rear view mirror, respectively.
  • the mirror lens of the mirror mirror is 35.
  • Figure 11 shows only the structure and implementation method of the bionic 3D viewfinder on the left side of the car.
  • the bionic 3D viewfinder on the right side of the car is a mirror image on the left side.
  • the structure and implementation of the two are identical.
  • Figure 12 shows a third design for the left and right bionic 3D viewing mirrors of the car.
  • the automotive bionic 3D viewing mirror bracket 39 is a brand new automotive mirror technology and device.
  • the bionic 3D viewpoints 3 and 4 and the bionic 3D viewpoints 5 and 6 are mounted on the left and right bionic 3D viewing mirror holders 39 of the automobile, respectively.
  • Fig. 12 only shows the structure and implementation method of the bionic 3D viewfinder and the mirror support on the left side of the car.
  • the bionic 3D view mirror support on the right side of the car is a mirror image on the left side, and the structure and implementation method of the two are completely the same. As shown in Fig.
  • FIG. 12a the mirror bracket 39 is hidden in the mirror holder base 40 before the vehicle is started, and the mirror bracket is fixed to the vehicle body 41.
  • Figure 12b shows the mirror mount 39 rotated from the mirror mount base 40 to the working position when the vehicle is activated. In the working position, the centerlines of the two cameras 22 of the bionic 3D viewpoints 3 and 4 mounted on the mirror bracket are located on the same horizontal plane.
  • Figure 12c when the car engine is turned off, the mirror mount 39 will automatically rotate and return to the mirror mount base 40. At this time, the four bionic 3D viewpoints 3, 4, 5 and 6 on the mirror holder 39 and a total of eight cameras 22 and lenses therein are all hidden in the automobile body or the mirror holder base 40.
  • Figure 13 shows a naked eye 3D rearview mirror in an automobile.
  • the in-vehicle naked-eye 3D rearview mirror is composed of a planar backing plate 42, one or more planar naked-eye 3D screens 43, and a coated anti-glare glass 44.
  • the back panel 42 of the naked eye 3D rear view mirror is coupled to a rear view mirror bracket 45.
  • the anti-glare glass 44 is disposed on the outside of the naked-eye 3D screen 43, and the back surface is coated with a coating. The coating only allows light to penetrate from one direction to the outside. The driver can see the content played in the naked eye 3D screen 43 through the anti-glare glass.
  • a switch 46 is provided on the rearview mirror. When the driver turns off the switch 46, the naked eye 3D rearview mirror becomes a conventional interior mirror rearview mirror.
  • FIG 14 shows the design and operation of a car 3D smart center 47.
  • the 3D smart center 47 is a computer mainly comprising: a main board 48, an operating system 49, a storage unit 50, a wireless communication module 51 with a SIM card slot, a central control unit 52, a touch screen 67 and all located in a black dotted frame.
  • the car bionic 3D viewpoint is divided into three groups, namely, bionic 3D viewpoints 1, 3 and 5, bionic 3D viewpoints 2, 4 and 6, and bionic 3D viewpoints 7 and 8.
  • the images obtained by the bionic 3D viewpoints in the three groups are respectively entered into the bionic 3D image reconstruction technology unit 53 according to the respective groups, and the parameters are adjusted by the built-in bionic 3D image reconstruction and processing software, and then the image clip is entered.
  • Splicing and 3D format conversion unit 54 The images in the three groups are edited in 54 respectively, the process of splicing and 3D illustrations, and finally become a single image with four super wide images, the front full image, the rear full The image of the territory, the entire left image of the left rear and the whole image of the right rear.
  • the ISP image processing chip 55 disposed on the image processing main board 57 processes each image mainly including: algorithm, optimization, brightness, hue and white balance, and directly enters the encoder 56 for compression and encoding.
  • the logic processor in the central control unit 52 will deliver the four images in time to a set of naked-eye 3D screens 16, 20 and 21 and the screen main board 58 of the in-vehicle naked-eye 3D rearview mirror 43 according to a pre-designed program. After being decoded by the decoder 60, it is played in a set of naked-eye 3D screens 16, 20 and 21 and an in-vehicle naked-eye 3D rearview mirror 43.
  • the main board 59 of the heads up display is connected to the main board of the 3D smart center 47.
  • the 3D navigation map from the built-in wireless communication module 51 or the driver's mobile phone 61 directly enters the bionic 3D image reconstruction technology unit 53, and the driver can set whether or not to perform the mapping from the 3D navigation map through the built-in wireless communication module or the mobile phone.
  • the correction if not required, proceeds directly through unit 53 to a set of naked-eye 3D screens 16, 20 and 21.
  • the simplified 3D navigation guides from the built-in wireless communication module 51 or the mobile phone 61, telephone, WeChat, SMS, video, music, entertainment and other content directly enter the 3D smart center motherboard 48 and enter the head-up display 9 and one The group is played in the naked eye 3D screen 16, 20 or 21.
  • the sound signal from the stereo two-channel microphone 62 in the car is converted and processed by a software package.
  • Information from the car OBD63 plug is transferred to a software package via a dedicated data line, and the data is read by software.
  • the data detected by the range finder 64 directly enters the data processor 65 attached to the range finder. All of the above-mentioned processed microphone 62 sound signals, the OBD63 data and the rangefinder 64 data are directly transferred to the 3D smart center main board 48 and then delivered to the car speaker, the head up display 9 and a set of naked-eye 3D screens 16, 20 and Played in 21.
  • the 3D smart center power supply 66 is responsible for providing all of the power to all of the above devices.
  • Figure 15 shows the design and operational flow chart of an automotive 3D smart center 47. Compared with Figure 14 above, there is no car networking part in Figure 15.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Mechanical Engineering (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Fittings On The Vehicle Exterior For Carrying Loads, And Devices For Holding Or Mounting Articles (AREA)

Abstract

La présente invention se rapporte à un système d'acquisition d'images 3D d'une automobile ou d'un dispositif mobile et d'affichage tête haute 3D à l'œil nu, ainsi qu'à un procédé de traitement d'images 3D. Le système d'acquisition d'images 3D d'une automobile ou d'un dispositif mobile et d'affichage tête haute 3D à l'œil nu comprend un dispositif d'affichage tête haute (9), un ensemble d'écrans 3D à l'œil nu, un ensemble de points de vue 3D biomimétiques (1, 2, 3, 4, 5, 6, 7, 8), un centre intelligent 3D (47), des miroirs de points de vue 3D biomimétiques côté gauche et côté droit d'automobile, et un miroir rétroviseur 3D à l'œil nu dans l'automobile. Lorsqu'un conducteur conduit une automobile ou utilise un dispositif mobile, il n'a pas besoin de quitter des yeux la route devant lui pour acquérir des informations, et il peut déterminer une distance relative entre l'automobile de l'utilisateur et une autre automobile sur une voie adjacente ou une voie située derrière, ou un piéton, en fonction d'images 3D provenant de l'ensemble de points de vue 3D biomimétiques et traitées par une technologie de reconstruction d'images 3D biomimétique, et affichées sur l'ensemble d'écrans 3D à l'œil nu dans l'automobile. De plus, une plateforme d'affichage 3D à l'œil nu d'automobile est prévue pour une carte de navigation 3D biomimétique et d'autres cartes de navigation 3D de tiers.
PCT/CN2017/077220 2016-05-18 2017-03-20 Système d'acquisition d'images 3d d'une automobile ou d'un dispositif mobile et d'affichage tête haute 3d à l'œil nu, et procédé de traitement d'images 3d WO2017197971A1 (fr)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
CN201610329826.1 2016-05-18
CN201610329826 2016-05-18
CN201610333077.XA CN105929539B (zh) 2016-05-19 2016-05-19 汽车3d影像采集和裸眼3d平视显示系统
CN201610333077.X 2016-05-19

Publications (1)

Publication Number Publication Date
WO2017197971A1 true WO2017197971A1 (fr) 2017-11-23

Family

ID=60324788

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/077220 WO2017197971A1 (fr) 2016-05-18 2017-03-20 Système d'acquisition d'images 3d d'une automobile ou d'un dispositif mobile et d'affichage tête haute 3d à l'œil nu, et procédé de traitement d'images 3d

Country Status (1)

Country Link
WO (1) WO2017197971A1 (fr)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107820858A (zh) * 2017-12-05 2018-03-23 星光农机股份有限公司 一种小型收割机
CN111137236A (zh) * 2019-12-29 2020-05-12 的卢技术有限公司 一种基于汽车前挡风非透明液晶显示方法及系统
CN111483540A (zh) * 2020-04-07 2020-08-04 合肥工业大学 一种电动驱动式敞篷代步装置
CN112969060A (zh) * 2021-02-23 2021-06-15 毛新 一种移轴立体摄像机
CN112995640A (zh) * 2021-02-23 2021-06-18 毛新 一种同屏立体摄像机
CN113947942A (zh) * 2021-10-15 2022-01-18 广州小鹏自动驾驶科技有限公司 泊车地图分享处理方法、装置、设备及系统
CN114609782A (zh) * 2022-02-14 2022-06-10 广东未来科技有限公司 裸眼3d抬头显示装置及裸眼3d抬头显示方法
CN115257562A (zh) * 2022-08-13 2022-11-01 珠海骏驰科技有限公司 一种结合人脸识别警示和数据通信技术的车载安全驾驶系统
CN117008723A (zh) * 2023-07-14 2023-11-07 广东火种源智能科技有限公司 一种增强现实显示及交互技术赋能自主移动机器人

Citations (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101685022A (zh) * 2008-09-22 2010-03-31 纬创资通股份有限公司 可即时生成立体地图影像的方法及其相关导航系统
CN101986101A (zh) * 2010-09-14 2011-03-16 浙江天鸿汽车用品有限公司 Gps实时导航系统
CN102121831A (zh) * 2010-12-01 2011-07-13 北京腾瑞万里科技有限公司 实时街景导航方法及设备
CN102937718A (zh) * 2012-11-19 2013-02-20 潘琳 带裸眼3d显示屏的gps装置
CN103373284A (zh) * 2012-04-18 2013-10-30 捷达世软件（深圳）有限公司 车用信息显示方法及系统
CN103499352A (zh) * 2013-10-12 2014-01-08 广州都市圈网络科技有限公司 基于街景技术的移动gps实景导航系统
CN103533313A (zh) * 2013-10-31 2014-01-22 广东威创视讯科技股份有限公司 基于地理位置的电子地图全景视频合成显示方法和系统
CN103587479A (zh) * 2012-08-14 2014-02-19 辉达公司 一种用于倒车的裸眼三维视频系统和包括该系统的车辆
CN203811900U (zh) * 2013-12-13 2014-09-03 惠州市华阳多媒体电子有限公司 抬头显示器及车辆
CN104554010A (zh) * 2015-01-07 2015-04-29 苏州科技学院 倒车可视系统及其信号处理和显示方法
CN104574567A (zh) * 2015-01-07 2015-04-29 苏州科技学院 一种车载立体影像记录装置及其信号处理方法
CN104786933A (zh) * 2015-03-04 2015-07-22 江苏大学 一种全景影像驾驶辅助装置及方法
CN105313789A (zh) * 2015-11-17 2016-02-10 东莞市胜大光电科技有限公司 Hud抬头显示导航系统
CN205185987U (zh) * 2015-12-14 2016-04-27 宁波裕兰信息科技有限公司 一种3d环视泊车辅助系统
CN105929539A (zh) * 2016-05-19 2016-09-07 彭波 汽车或移动设备3d影像采集和裸眼3d平视显示系统及3d影像处理方法

Patent Citations (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101685022A (zh) * 2008-09-22 2010-03-31 纬创资通股份有限公司 可即时生成立体地图影像的方法及其相关导航系统
CN101986101A (zh) * 2010-09-14 2011-03-16 浙江天鸿汽车用品有限公司 Gps实时导航系统
CN102121831A (zh) * 2010-12-01 2011-07-13 北京腾瑞万里科技有限公司 实时街景导航方法及设备
CN103373284A (zh) * 2012-04-18 2013-10-30 捷达世软件（深圳）有限公司 车用信息显示方法及系统
CN103587479A (zh) * 2012-08-14 2014-02-19 辉达公司 一种用于倒车的裸眼三维视频系统和包括该系统的车辆
CN102937718A (zh) * 2012-11-19 2013-02-20 潘琳 带裸眼3d显示屏的gps装置
CN103499352A (zh) * 2013-10-12 2014-01-08 广州都市圈网络科技有限公司 基于街景技术的移动gps实景导航系统
CN103533313A (zh) * 2013-10-31 2014-01-22 广东威创视讯科技股份有限公司 基于地理位置的电子地图全景视频合成显示方法和系统
CN203811900U (zh) * 2013-12-13 2014-09-03 惠州市华阳多媒体电子有限公司 抬头显示器及车辆
CN104554010A (zh) * 2015-01-07 2015-04-29 苏州科技学院 倒车可视系统及其信号处理和显示方法
CN104574567A (zh) * 2015-01-07 2015-04-29 苏州科技学院 一种车载立体影像记录装置及其信号处理方法
CN104786933A (zh) * 2015-03-04 2015-07-22 江苏大学 一种全景影像驾驶辅助装置及方法
CN105313789A (zh) * 2015-11-17 2016-02-10 东莞市胜大光电科技有限公司 Hud抬头显示导航系统
CN205185987U (zh) * 2015-12-14 2016-04-27 宁波裕兰信息科技有限公司 一种3d环视泊车辅助系统
CN105929539A (zh) * 2016-05-19 2016-09-07 彭波 汽车或移动设备3d影像采集和裸眼3d平视显示系统及3d影像处理方法

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107820858A (zh) * 2017-12-05 2018-03-23 星光农机股份有限公司 一种小型收割机
CN111137236A (zh) * 2019-12-29 2020-05-12 的卢技术有限公司 一种基于汽车前挡风非透明液晶显示方法及系统
CN111483540A (zh) * 2020-04-07 2020-08-04 合肥工业大学 一种电动驱动式敞篷代步装置
CN112969060A (zh) * 2021-02-23 2021-06-15 毛新 一种移轴立体摄像机
CN112995640A (zh) * 2021-02-23 2021-06-18 毛新 一种同屏立体摄像机
CN113947942A (zh) * 2021-10-15 2022-01-18 广州小鹏自动驾驶科技有限公司 泊车地图分享处理方法、装置、设备及系统
WO2023060837A1 (fr) * 2021-10-15 2023-04-20 广州小鹏自动驾驶科技有限公司 Procédé, appareil et système de traitement de partage de carte de stationnement, et dispositif et support de stockage
CN114609782A (zh) * 2022-02-14 2022-06-10 广东未来科技有限公司 裸眼3d抬头显示装置及裸眼3d抬头显示方法
CN115257562A (zh) * 2022-08-13 2022-11-01 珠海骏驰科技有限公司 一种结合人脸识别警示和数据通信技术的车载安全驾驶系统
CN117008723A (zh) * 2023-07-14 2023-11-07 广东火种源智能科技有限公司 一种增强现实显示及交互技术赋能自主移动机器人

Similar Documents

Publication Publication Date Title
WO2017197971A1 (fr) Système d'acquisition d'images 3d d'une automobile ou d'un dispositif mobile et d'affichage tête haute 3d à l'œil nu, et procédé de traitement d'images 3d
CN105929539B (zh) 汽车3d影像采集和裸眼3d平视显示系统
CN105283794B (zh) 平视显示装置
US10247941B2 (en) Vehicle vision system with light field monitor
CN105283795B (zh) 平视显示装置
CN104935905B (zh) 自动3d照相亭
WO2009144994A1 (fr) Processeur d'image de véhicule et système de traitement d'image de véhicule
JP2023159121A (ja) 情報処理装置、情報処理方法、プログラム、および移動体
CN112639581B (zh) 抬头显示器和抬头显示方法
JP6204793B2 (ja) ヘッドアップディスプレイ装置
CN102149574A (zh) 图像照射系统及图像照射方法
CN101241233A (zh) 全息信息显示
WO2022241638A1 (fr) Procédé et appareil de projection, et véhicule et ar-hud
JP6337721B2 (ja) 虚像表示装置
CN106846410A (zh) 基于三维的行车环境成像方法及装置
CN109462750A (zh) 一种抬头显示系统、信息显示方法、装置及介质
WO2019097762A1 (fr) Dispositif d'affichage d'image superposée et programme informatique
CN110458953A (zh) 一种三维图像重构系统及方法
CN111016787B (zh) 驾驶中防止视觉疲劳的方法、装置、存储介质及电子设备
KR102235951B1 (ko) 차량용 영상 생성 장치 및 방법
JP6318772B2 (ja) 虚像表示装置
JP6094437B2 (ja) ヘッドアップディスプレイ装置
CN108983963A (zh) 一种车辆虚拟现实系统模型建立方法及系统
CN109151273B (zh) 一种光扇立体摄像机及立体测量方法
CN111824019B (zh) 一种车载3d全景环视系统

Legal Events

Date Code Title Description
NENP Non-entry into the national phase

Ref country code: DE

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17798536

Country of ref document: EP

Kind code of ref document: A1

122 Ep: pct application non-entry in european phase

Ref document number: 17798536

Country of ref document: EP

Kind code of ref document: A1