CN111923835A - Vehicle-based rearview display method - Google Patents
Vehicle-based rearview display method Download PDFInfo
- Publication number
- CN111923835A CN111923835A CN202010814144.6A CN202010814144A CN111923835A CN 111923835 A CN111923835 A CN 111923835A CN 202010814144 A CN202010814144 A CN 202010814144A CN 111923835 A CN111923835 A CN 111923835A
- Authority
- CN
- China
- Prior art keywords
- image
- vehicle
- information
- laser
- acquisition system
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
- B60R2300/20—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of display used
- B60R2300/205—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of display used using a head-up display
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
- B60R2300/80—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement
- B60R2300/8066—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement for monitoring rearward traffic
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Multimedia (AREA)
- Mechanical Engineering (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Traffic Control Systems (AREA)
Abstract
The invention discloses a vehicle-based rearview display method, which comprises the following steps: judging whether a driver needs to display an image or not through an eyeball infrared tracking system; starting an image acquisition system and acquiring information of a rear vehicle; and processing the rear vehicle information obtained by the image acquisition system through a laser imaging system and displaying the rear vehicle information to a front windshield of the vehicle. The potential safety hazard that the driver need control to see outside rear-view mirror when changing lane and overtaking has been solved in this application, do not show image information under the normal driving condition, open indicator or eyes by a short margin and see that the fixed area just can be located the virtual image in field of vision the place ahead about the preceding windscreen, the attention of the transfer driver that can be as few as possible like this, strengthen image information simultaneously, improve the perception ability of driver to the real world, driving safety has been ensured, the driving experience of motorcycle type has been promoted.
Description
Technical Field
The invention relates to the field of automobile driving, in particular to a vehicle-based rearview display method.
Background
At present, when a driver changes lane and overtakes, the driver needs to look at the external rearview mirror from left to right, so that great influence is brought to driving operation, the electronic rearview mirror is developed in the intelligent automobile, but the driver still needs to look at the image in a head-down mode, and the driving operation is also influenced to a certain degree.
To address similar issues, such as reducing the driver's heads-down to see the instruments, a heads-up display system (HUD) was developed, which was first applied to military aircraft and functions to reduce the frequency with which the pilot needs to look down at the instruments, thereby avoiding interruptions in attention and loss of awareness of the state. HUD technology was later applied to automobiles for the same purpose, and it was desired to avoid traffic accidents caused by reducing heads down on center console displays. At present, the display content of the vehicle-mounted HUD mainly comprises navigation, vehicle speed, rotating speed and other relevant information, effective driving reference can be provided for a driver through the information, and driving safety is improved.
At present, a HUD (head Up display) does not display a rear view image, and the display effect is poor. The rear-view image is displayed in a HUD mode, namely the next-generation optimal display mode of the electronic rearview mirror, the image is collected through the rear-view camera and the radar, the rear-view image is thrown onto the front windshield in a laser projection mode, so that a driver can clearly see the rear-view image without making too large action, and can also perceive a rear vehicle under the condition of low visibility.
Disclosure of Invention
The invention aims to overcome the defects of the prior art and provides a back view image head-up display system based on eyeball identification laser imaging.
The invention aims to be realized by the following technical scheme: a vehicle-based rearview display method comprises the following steps:
s1, judging whether the driver needs to display the image or not through an eyeball infrared tracking system;
s2, starting an image acquisition system and acquiring information of a rear vehicle;
s3, processing the rear vehicle information obtained by the image acquisition system through the laser imaging system and displaying the rear vehicle information to the front windshield of the vehicle;
wherein, the step S3 specifically includes the following substeps:
s301, supplementing light and improving definition processing are carried out on the image information through an image controller;
s302, forming a laser image by the processed image information through a laser generator;
and S303, transmitting the laser image through the folding mirror, and displaying the laser image to the front windshield of the vehicle through the holographic optical element.
The step S1 specifically includes the following sub-steps:
s101, receiving an automobile starting instruction by an eyeball infrared tracking system, and starting equipment;
s102, the eyeball infrared tracking system acquires the position of a human face, judges the eye gaze point of the human eye when the human face is at the identification position, executes the step S3 when the eye gaze point of the human eye is in the set range, and executes the step S104 if the eye gaze point of the human eye is out of the set range;
s103, sending a starting instruction to the image acquisition system;
and S104, sending a closing instruction to the image acquisition system.
The step S102 specifically includes the following sub-steps:
s1021, acquiring the position of the human face through a light sensation and proximity sensor;
and S1022, when the human face is at the identification position, identifying the movement of human eyes by the eyeball tracking infrared sensor, shooting an image of the eyeballs by the camera, and judging the light spots of the human eyes.
The step S2 acquires rear vehicle information including rear vehicle position information, speed information and image information.
The invention has the beneficial effects that: the potential safety hazard that the driver need control to see outside rear-view mirror when changing lane and overtaking has been solved in this application, do not show image information under the normal driving condition, open indicator or eyes by a short margin and see that the fixed area just can be located the virtual image in field of vision the place ahead about the preceding windscreen, the attention of the transfer driver that can be as few as possible like this, strengthen image information simultaneously, improve the perception ability of driver to the real world, driving safety has been ensured, the driving experience of motorcycle type has been promoted.
Drawings
FIG. 1 is a flow chart of the method of the present invention;
FIG. 2 is a block diagram of a system architecture of an embodiment of the present invention;
in the figure, 1-a first controller, 2-a laser generator, 3-a beam expanding collimator, 4-a reflector, 5-a refractor, 6-a holographic optical element, 7-a second controller, 8-a sensing camera shooting device, 9-an eyeball tracking infrared sensor, 10-a light sensation and proximity sensor, 11-a camera and 12-a laser radar.
Detailed Description
In order to more clearly understand the technical features, objects and effects of the present invention, the embodiments of the present invention will be described with reference to the accompanying drawings, but the scope of the present invention is not limited to the following.
In order to more clearly understand the technical features, objects and effects of the present invention, the embodiments of the present invention will be described with reference to the accompanying drawings, but the scope of the present invention is not limited to the following.
A vehicle-based rearview display method comprises the following steps:
s1, judging whether the driver needs to display the image or not through an eyeball infrared tracking system;
s2, starting an image acquisition system and acquiring information of a rear vehicle;
s3, processing the rear vehicle information obtained by the image acquisition system through the laser imaging system and displaying the rear vehicle information to the front windshield of the vehicle;
wherein, the step S3 specifically includes the following substeps:
s301, the image information is subjected to light supplementing and definition improving processing through the first controller 1;
s302, the processed image information forms a laser image through a laser generator 2;
and S303, transmitting the laser image through the refractor 4 and the reflector 5, and displaying the laser image to the front windshield of the vehicle through the holographic optical element 6.
The step S1 specifically includes the following sub-steps:
s101, receiving an automobile starting instruction by an eyeball infrared tracking system, and starting equipment;
s102, the eyeball infrared tracking system acquires the position of a human face, judges the eye gaze point of the human eye when the human face is at the identification position, executes the step S3 when the eye gaze point of the human eye is in the set range, and executes the step S104 if the eye gaze point of the human eye is out of the set range;
s103, sending a starting instruction to the image acquisition system;
and S104, sending a closing instruction to the image acquisition system.
The step S102 specifically includes the following sub-steps:
s1021, acquiring the position of the human face through the light sensation and proximity sensor 10;
and S1022, when the human face is at the identification position, the eyeball tracking infrared sensor 9 is used for identifying the movement of the human eyes, the image of the eyeballs is shot through the sensing camera device 8, and the light points of the human eyes are judged.
The step S2 acquires rear vehicle information including rear vehicle position information, speed information and image information.
The specific system structure of this embodiment is as shown in fig. 2:
a back view image head-up display system based on eyeball identification laser imaging comprises: the laser imaging system comprises: the method comprises the steps of carrying out laser imaging on an image by receiving information transmitted by an image acquisition system, and displaying the image by receiving a control instruction transmitted by an eyeball identification system;
an image acquisition system: the system comprises a laser imaging system, a camera and a camera, wherein the laser imaging system is used for acquiring image information, external environment information, vehicle position information and vehicle speed information and sending the information to the laser imaging system;
eyeball identification system: the eyeball image is shot, the position of the eyes and the eye points are identified, whether the image needs to be displayed or not is judged, and the laser imaging system is controlled to display the image.
The laser imaging system comprises a first controller 1, a laser processing module, a laser generating module, an image generating module and a catadioptric module; the first controller 1 receives image information sent by an image acquisition system, analyzes and processes the image information, adjusts the brightness and definition of an image, and sends the processed image information to a laser generation module; the laser generation module is a laser generator 2, and generates laser by receiving the image information processed by the first controller 1; the image generation module is a beam expanding collimator 3 and is used for receiving the laser sent by the laser generation module, processing the laser into image laser and sending the image laser to the catadioptric module; the refraction and reflection module comprises a refraction mirror 5 and a reflection mirror 4, and is used for projecting the image laser sent by the image generation module to the holographic optical element 6 through refraction and reflection to display an image.
The first controller 1 is further connected with an image processor, and the image processor is used for carrying out brightness improvement and contrast improvement on received image information.
The image acquisition system comprises a second controller 7, an image acquisition module, a vehicle position acquisition module and a vehicle speed acquisition module; the second controller 7 receives the image information sent by the image acquisition module, the vehicle position information sent by the vehicle position acquisition module and the vehicle speed information sent by the vehicle speed acquisition module, and sends the received information to the first controller 1; the image acquisition module comprises a camera 11 and a laser radar 12.
The eyeball identification system comprises a third controller and a sensing module; the induction module identifies human eyes through the plurality of sensing camera devices 8 and sends identification information to the third controller; and the third controller receives the identification information sent by the induction module, judges whether an image needs to be displayed or not, and sends a control instruction to the laser imaging system for image display if the image needs to be displayed.
The sensing module comprises a light sensing and proximity sensor 10, an eyeball tracking infrared sensor 9 and camera equipment; the light sensation and proximity sensor 10 acquires the position of the human face; the camera shooting equipment shoots eyeball images and identifies the positions of human eyes and eye light spots; the eye tracking infrared sensor 9 recognizes the movement of the human eye.
The foregoing is illustrative of the preferred embodiments of this invention, and it is to be understood that the invention is not limited to the precise form disclosed herein and that various other combinations, modifications, and environments may be resorted to, falling within the scope of the concept as disclosed herein, either as described above or as apparent to those skilled in the relevant art. And that modifications and variations may be effected by those skilled in the art without departing from the spirit and scope of the invention as defined by the appended claims.
Claims (4)
1. A vehicle-based rearview display method is characterized by comprising the following steps:
s1, judging whether the driver needs to display the image or not through an eyeball infrared tracking system;
s2, starting an image acquisition system and acquiring information of a rear vehicle;
s3, processing the rear vehicle information obtained by the image acquisition system through the laser imaging system and displaying the rear vehicle information to the front windshield of the vehicle;
wherein, the step S3 specifically includes the following substeps:
s301, supplementing light and improving definition processing are carried out on the image information through an image controller;
s302, forming a laser image by the processed image information through a laser generator (2);
and S303, transmitting the laser image through the folding mirror and the reflecting mirror, and displaying the laser image to the front windshield of the vehicle through the holographic optical element.
2. The vehicle-based rear-view display method according to claim 1, wherein the step S1 specifically comprises the following sub-steps:
s101, receiving an automobile starting instruction by an eyeball infrared tracking system, and starting equipment;
s102, the eyeball infrared tracking system acquires the position of a human face, judges the eye gaze point of the human eye when the human face is at the identification position, executes the step S3 when the eye gaze point of the human eye is in the set range, and executes the step S104 if the eye gaze point of the human eye is out of the set range;
s103, sending a starting instruction to the image acquisition system;
and S104, sending a closing instruction to the image acquisition system.
3. The vehicle-based rear-view display method according to claim 2, wherein the step S102 specifically comprises the following sub-steps:
s1021, acquiring the position of the human face through a light sensation and proximity sensor (10);
and S1022, when the human face is at the identification position, the eyeball tracks the movement of the human eyes through the infrared sensor, and the image of the eyeballs is shot through the sensing camera equipment (8) to judge the light points of the human eyes.
4. The vehicle-based rear-view display method of claim 1, wherein said step S2 collects rear vehicle information including rear vehicle position information, speed information and image information.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010814144.6A CN111923835A (en) | 2020-08-13 | 2020-08-13 | Vehicle-based rearview display method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010814144.6A CN111923835A (en) | 2020-08-13 | 2020-08-13 | Vehicle-based rearview display method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111923835A true CN111923835A (en) | 2020-11-13 |
Family
ID=73311810
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010814144.6A Pending CN111923835A (en) | 2020-08-13 | 2020-08-13 | Vehicle-based rearview display method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111923835A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112572296A (en) * | 2020-12-17 | 2021-03-30 | 的卢技术有限公司 | Auxiliary system of AR-HUD intelligent rearview system and use method thereof |
| CN113665485A (en) * | 2021-08-30 | 2021-11-19 | 东风汽车集团股份有限公司 | Anti-glare system for front windshield of automobile and control method |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101585347A (en) * | 2008-05-21 | 2009-11-25 | 鸿富锦精密工业（深圳）有限公司 | Rear view system for automobile and automobile therewith |
| CN105301774A (en) * | 2015-10-10 | 2016-02-03 | 青岛歌尔声学科技有限公司 | On-vehicle head-up terminal and method for controlling display brightness of the same |
| CN206520543U (en) * | 2017-03-10 | 2017-09-26 | 北京汽车集团有限公司 | Controller and rear-view image system for automobile for vehicle rearview image documentation equipment |
| CN107323345A (en) * | 2017-06-29 | 2017-11-07 | 吉利汽车研究院（宁波）有限公司 | A kind of back-sight visual system and method based on holographic imaging |
| CN206920709U (en) * | 2017-04-21 | 2018-01-23 | 苏州车萝卜汽车电子科技有限公司 | A kind of head-up display device of split installation |
| CN108501809A (en) * | 2018-03-26 | 2018-09-07 | 京东方科技集团股份有限公司 | Vehicular display control device, display system based on Eye-controlling focus and display methods |
| CN108515909A (en) * | 2018-04-04 | 2018-09-11 | 京东方科技集团股份有限公司 | A kind of automobile head-up-display system and its barrier prompt method |
| US20180297522A1 (en) * | 2017-04-14 | 2018-10-18 | Panasonic Automotive Systems Company Of America, Division Of Panasonic Corporation Of North America | Rearview head up display |
| CN109353279A (en) * | 2018-12-06 | 2019-02-19 | 延锋伟世通电子科技（上海）有限公司 | A kind of vehicle-mounted head-up-display system of augmented reality |
| CN110244458A (en) * | 2018-03-07 | 2019-09-17 | 和硕联合科技股份有限公司 | Head-up-display system and its control method |
-
2020
- 2020-08-13 CN CN202010814144.6A patent/CN111923835A/en active Pending
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101585347A (en) * | 2008-05-21 | 2009-11-25 | 鸿富锦精密工业（深圳）有限公司 | Rear view system for automobile and automobile therewith |
| CN105301774A (en) * | 2015-10-10 | 2016-02-03 | 青岛歌尔声学科技有限公司 | On-vehicle head-up terminal and method for controlling display brightness of the same |
| CN206520543U (en) * | 2017-03-10 | 2017-09-26 | 北京汽车集团有限公司 | Controller and rear-view image system for automobile for vehicle rearview image documentation equipment |
| US20180297522A1 (en) * | 2017-04-14 | 2018-10-18 | Panasonic Automotive Systems Company Of America, Division Of Panasonic Corporation Of North America | Rearview head up display |
| CN206920709U (en) * | 2017-04-21 | 2018-01-23 | 苏州车萝卜汽车电子科技有限公司 | A kind of head-up display device of split installation |
| CN107323345A (en) * | 2017-06-29 | 2017-11-07 | 吉利汽车研究院（宁波）有限公司 | A kind of back-sight visual system and method based on holographic imaging |
| CN110244458A (en) * | 2018-03-07 | 2019-09-17 | 和硕联合科技股份有限公司 | Head-up-display system and its control method |
| CN108501809A (en) * | 2018-03-26 | 2018-09-07 | 京东方科技集团股份有限公司 | Vehicular display control device, display system based on Eye-controlling focus and display methods |
| CN108515909A (en) * | 2018-04-04 | 2018-09-11 | 京东方科技集团股份有限公司 | A kind of automobile head-up-display system and its barrier prompt method |
| CN109353279A (en) * | 2018-12-06 | 2019-02-19 | 延锋伟世通电子科技（上海）有限公司 | A kind of vehicle-mounted head-up-display system of augmented reality |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112572296A (en) * | 2020-12-17 | 2021-03-30 | 的卢技术有限公司 | Auxiliary system of AR-HUD intelligent rearview system and use method thereof |
| CN113665485A (en) * | 2021-08-30 | 2021-11-19 | 东风汽车集团股份有限公司 | Anti-glare system for front windshield of automobile and control method |
| CN113665485B (en) * | 2021-08-30 | 2023-12-26 | 东风汽车集团股份有限公司 | Anti-glare system for automobile front windshield and control method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11351918B2 (en) | Driver-assistance device, driver-assistance system, method of assisting driver, and computer readable recording medium | |
| CN102910130B (en) | Forewarn system is assisted in a kind of driving of real enhancement mode | |
| CN112026652A (en) | Back-view image head-up display system based on eyeball recognition laser imaging | |
| US20230249618A1 (en) | Display system and display method | |
| CN118119523A (en) | Vehicle and mobile device interface for vehicle occupant assistance | |
| EP2911117B1 (en) | Controlling display of information for alerting a driver | |
| JP4970379B2 (en) | Vehicle display device | |
| CN118103798A (en) | Vehicle and mobile device interface for vehicle occupant assistance | |
| CN210348060U (en) | Augmented reality new line display device and system | |
| JP7300112B2 (en) | Control device, image display method and program | |
| CN111923835A (en) | Vehicle-based rearview display method | |
| JP2016109645A (en) | Information providing device, information providing method, and control program for providing information | |
| CN109074685B (en) | Method, apparatus, system, and computer-readable storage medium for adjusting image | |
| CN111923834A (en) | Eyeball identification-based vehicle rear view image display system and method | |
| CN107472140B (en) | Eye-control vehicle-mounted HUD system | |
| CN113165510A (en) | Display control apparatus, method and computer program | |
| CN113064279B (en) | Virtual image position adjusting method, device and storage medium of AR-HUD system | |
| JP5223289B2 (en) | Visual information presentation device and visual information presentation method | |
| CN113212312B (en) | AR rearview mirror assembly and control method thereof | |
| CN116400507A (en) | Display method, display device, vehicle and storage medium | |
| CN212604825U (en) | Vehicle rear view image display system based on eyeball identification | |
| CN115018942A (en) | Method and apparatus for image display of vehicle | |
| JP2018087852A (en) | Virtual image display device | |
| JP2021051764A (en) | Information recording apparatus | |
| CN212604824U (en) | Laser imaging system for vehicle |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |