CN112572296A - Auxiliary system of AR-HUD intelligent rearview system and use method thereof - Google Patents
Auxiliary system of AR-HUD intelligent rearview system and use method thereof Download PDFInfo
- Publication number
- CN112572296A CN112572296A CN202011493876.6A CN202011493876A CN112572296A CN 112572296 A CN112572296 A CN 112572296A CN 202011493876 A CN202011493876 A CN 202011493876A CN 112572296 A CN112572296 A CN 112572296A
- Authority
- CN
- China
- Prior art keywords
- acquisition module
- hud
- eyeball
- image acquisition
- intelligent rearview
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
- B60R1/12—Mirror assemblies combined with other articles, e.g. clocks
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
- B60R1/12—Mirror assemblies combined with other articles, e.g. clocks
- B60R2001/1223—Mirror assemblies combined with other articles, e.g. clocks with sensors or transducers
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
- B60R1/12—Mirror assemblies combined with other articles, e.g. clocks
- B60R2001/1253—Mirror assemblies combined with other articles, e.g. clocks with cameras, video cameras or video screens
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Mechanical Engineering (AREA)
- Navigation (AREA)
- Fittings On The Vehicle Exterior For Carrying Loads, And Devices For Holding Or Mounting Articles (AREA)
Abstract
The invention provides an auxiliary system of an AR-HUD intelligent rear-view system and a using method thereof, wherein the auxiliary system comprises: the image acquisition module is arranged on the central rearview mirror and is used for acquiring image information of a driver; the position acquisition module is arranged on the central rearview mirror and used for acquiring the position information of the image acquisition module; and the control module is respectively connected with the image acquisition module and the position acquisition module and is used for identifying the position of the eyeball of the driver in the image information and converting the position of the eyeball of the driver according to the position information to obtain the position of the eyeball in the whole vehicle. According to the auxiliary system of the AR-HUD intelligent rearview system and the using method thereof, the image information acquired by the image acquisition module and the position information acquired by the position acquisition module are processed by the control module, and then the data acquired by processing are output to the AR-HUD intelligent rearview system through the CAN bus, so that the utilization rate of a rearview mirror is improved, and the computing resources of the AR-HUD intelligent rearview system are saved.
Description
Technical Field
The invention relates to the technical field of AR imaging, in particular to an auxiliary system of an AR-HUD intelligent rearview system and a using method thereof.
Background
Hud (headup display) is designed to help pilots perceive the surrounding environment. With the popularization of the technical field, the HUD (Headopp display) has certain application in automobiles at present. The development of HUD in the automobile industry is subject to C-HUD and W-HUD, and the development of HUD to AR-HUD is currently carried out.
The AR-HUD (augmented Reality HUD) is called as an augmented Reality HUD, and the display content is mainly projected to the front of the vehicle through an AR technology, so that a driver can observe the actual road condition more intuitively.
Rearview mirrors are common accessories in automobiles and are mounted at the front of the automobile so that drivers can observe the conditions of the rear seats of the automobile conveniently. With the advent of the intelligent era, intelligent rearview mirrors replacing original rearview mirrors gradually appear on the market. The intelligent rearview mirror is gradually gaining market favor due to having multiple functions.
At present, AR-HUD is applied to the field of automobile intelligent backsight, and specific eyeball positions need to be tracked to conduct corresponding image adjustment, but eyeball tracking calculation consumes corresponding calculation resources.
Disclosure of Invention
In order to solve the problems, the invention provides an auxiliary system of an AR-HUD intelligent rear-view system and a using method thereof.
In order to achieve the above purpose, the invention adopts a technical scheme that:
an auxiliary system of an AR-HUD intelligent rearview system, comprising: the image acquisition module is arranged on the central rearview mirror and is used for acquiring image information of a driver; the position acquisition module is arranged on the central rearview mirror and used for acquiring the position information of the image acquisition module; and the control module is respectively connected with the image acquisition module and the position acquisition module and used for identifying the position of the eyeball of the driver in the image information, converting the position of the eyeball of the driver according to the position information to obtain the position of the eyeball in the whole automobile and outputting the position to the AR-HUD intelligent rearview system through the CAN bus.
Furthermore, the image acquisition module is an infrared camera, and the infrared camera is electrically connected with the control module.
Furthermore, the position acquisition module is a gyroscope, and the gyroscope is electrically connected with the control module.
The invention also provides a use method of the auxiliary system of the AR-HUD intelligent rearview system, which comprises the following steps: s10, acquiring image information of the driver through an image acquisition module; s20, acquiring the position information of the image acquisition module through a position acquisition module; and the S30 control module identifies the position of the eyeball of the driver according to the image information, converts the position of the eyeball of the driver according to the position information to obtain the position of the eyeball in the whole automobile, and outputs the position to the AR-HUD intelligent rearview system through the CAN bus.
Furthermore, the image acquisition module is an infrared camera, and the infrared camera is electrically connected with the control module.
Furthermore, the position acquisition module is a gyroscope, and the gyroscope is electrically connected with the control module.
Compared with the prior art, the technical scheme of the invention has the following advantages:
according to the auxiliary system of the AR-HUD intelligent rearview system and the using method thereof, the image information acquired by the image acquisition module and the position information acquired by the position acquisition module are processed by the control module, and then the data acquired by processing are output to the AR-HUD intelligent rearview system through the CAN bus, so that the utilization rate of a rearview mirror is improved, and the computing resources of the AR-HUD intelligent rearview system are saved.
Drawings
The technical solution and the advantages of the present invention will be apparent from the following detailed description of the embodiments of the present invention with reference to the accompanying drawings.
FIG. 1 is a diagram illustrating an auxiliary system structure of an AR-HUD intelligent rearview system according to an embodiment of the present invention;
fig. 2 is a flowchart illustrating an auxiliary system using method of the AR-HUD intelligent rear-view system according to an embodiment of the present invention.
Reference numbers in the figures:
the system comprises an image acquisition module 1, a position acquisition module 2, a control module 3 and a 4-AR-HUD intelligent rearview system.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
This embodiment provides an AR-HUD intelligence rear view system's auxiliary system, as shown in FIG. 1, including image acquisition module 1, position acquisition module 2 and control module 3, control module 3 respectively with image acquisition module 1 and position acquisition module 2 links to each other.
The image acquisition module 1 is arranged on the central rearview mirror and used for acquiring image information of a driver. The image acquisition module is an infrared camera, and the infrared camera is electrically connected with the control module 3.
The position acquisition module 2 is arranged on the central rearview mirror and is used for acquiring the position information of the image acquisition module 1. The position acquisition module 2 is a gyroscope, and the gyroscope is electrically connected with the control module 3.
The control module 3 is used for identifying the position of the eyeball of the driver in the image information, converting the position of the eyeball of the driver according to the position information to obtain the position of the eyeball in the whole automobile, and outputting the position to the AR-HUD intelligent rearview system 4 through the CAN bus.
The invention also provides a use method of the auxiliary system of the AR-HUD intelligent rearview system 4, which comprises the following steps: s10 collects the image information of the driver through the image collecting module 1. S20 collects the position information of the image collection module 1 through the position collection module 2. And the S30 control module 3 identifies the position of the eyeball of the driver according to the image information, converts the position of the eyeball of the driver according to the position information to obtain the position of the eyeball in the whole vehicle, and outputs the position to the AR-HUD intelligent rearview system 4 through the CAN bus.
The image acquisition module 1 is an infrared camera, and the infrared camera is electrically connected with the control module 3. The position acquisition module 2 is a gyroscope, and the gyroscope is electrically connected with the control module 3.
The eye position at the present stage is usually fixed at a certain position. Although the intelligent rearview mirror is fixed at a certain position, the angle of the rearview mirror can be adjusted by a driver in the using process.
The realization and calculation of eyeball tracking are placed on the intelligent rearview mirror, the actual possibility is combined, the angle and the position of the camera tracked by the eyeball are calculated through the gyroscope arranged in the intelligent rearview mirror, the eyeball position of a driver is calculated, and the calculation resource of the AR-HUD intelligent rearview system 4 is saved.
The above description is only an exemplary embodiment of the present invention, and not intended to limit the scope of the present invention, and all equivalent structures or equivalent processes that are transformed by the content of the present specification and the attached drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.
Claims (6)
1. An auxiliary system of an AR-HUD intelligent rearview system, comprising:
the image acquisition module is arranged on the central rearview mirror and is used for acquiring image information of a driver;
the position acquisition module is arranged on the central rearview mirror and used for acquiring the position information of the image acquisition module;
and the control module is respectively connected with the image acquisition module and the position acquisition module and used for identifying the position of the eyeball of the driver in the image information, converting the position of the eyeball of the driver according to the position information to obtain the position of the eyeball in the whole automobile and outputting the position to the AR-HUD intelligent rearview system through the CAN bus.
2. The auxiliary system of the AR-HUD intelligent rearview system of claim 1, wherein the image acquisition module is an infrared camera, and the infrared camera is electrically connected with the control module.
3. The auxiliary system of the AR-HUD intelligent rearview system of claim 1, wherein the position acquisition module is a gyroscope, and the gyroscope is electrically connected to the control module.
4. A use method of an auxiliary system of an AR-HUD intelligent rearview system is characterized by comprising the following steps:
s10, acquiring image information of the driver through an image acquisition module;
s20, acquiring the position information of the image acquisition module through a position acquisition module; and
and the S30 control module identifies the position of the eyeball of the driver according to the image information, converts the position of the eyeball of the driver according to the position information to obtain the position of the eyeball in the whole automobile, and outputs the position to the AR-HUD intelligent rearview system through the CAN bus.
5. The auxiliary system of the AR-HUD intelligent rearview system of claim 4, wherein the image acquisition module is an infrared camera, and the infrared camera is electrically connected with the control module.
6. The auxiliary system of the AR-HUD intelligent rearview system of claim 4, wherein the position acquisition module is a gyroscope, and the gyroscope is electrically connected with the control module.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011493876.6A CN112572296A (en) | 2020-12-17 | 2020-12-17 | Auxiliary system of AR-HUD intelligent rearview system and use method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011493876.6A CN112572296A (en) | 2020-12-17 | 2020-12-17 | Auxiliary system of AR-HUD intelligent rearview system and use method thereof |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112572296A true CN112572296A (en) | 2021-03-30 |
Family
ID=75135791
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011493876.6A Pending CN112572296A (en) | 2020-12-17 | 2020-12-17 | Auxiliary system of AR-HUD intelligent rearview system and use method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112572296A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112918337A (en) * | 2021-04-02 | 2021-06-08 | 东风汽车集团股份有限公司 | Intelligent cabin adjusting system and method for identifying eye position |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108162859A (en) * | 2018-01-05 | 2018-06-15 | 京东方科技集团股份有限公司 | Vehicle mirrors and method for displaying image, vehicle and storage medium |
| DE102018003158A1 (en) * | 2018-04-18 | 2018-09-27 | Daimler Ag | Driver assistance system for augmenting a rearview mirror image |
| CN108621947A (en) * | 2018-05-04 | 2018-10-09 | 福建省汽车工业集团云度新能源汽车股份有限公司 | A kind of vehicle-mounted head-up-display system of automatic adjusument |
| CN110738952A (en) * | 2019-10-31 | 2020-01-31 | 的卢技术有限公司 | HUD display method and system combining human eye recognition, tracking and ray recognition |
| CN111222444A (en) * | 2019-12-31 | 2020-06-02 | 的卢技术有限公司 | Augmented reality head-up display method and system considering emotion of driver |
| CN111405263A (en) * | 2019-12-26 | 2020-07-10 | 的卢技术有限公司 | Method and system for enhancing head-up display by combining two cameras |
| CN111923835A (en) * | 2020-08-13 | 2020-11-13 | 启明信息技术股份有限公司 | Vehicle-based rearview display method |
| CN111923834A (en) * | 2020-08-13 | 2020-11-13 | 启明信息技术股份有限公司 | Eyeball identification-based vehicle rear view image display system and method |
| CN112026652A (en) * | 2020-08-13 | 2020-12-04 | 启明信息技术股份有限公司 | Back-view image head-up display system based on eyeball recognition laser imaging |
-
2020
- 2020-12-17 CN CN202011493876.6A patent/CN112572296A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108162859A (en) * | 2018-01-05 | 2018-06-15 | 京东方科技集团股份有限公司 | Vehicle mirrors and method for displaying image, vehicle and storage medium |
| DE102018003158A1 (en) * | 2018-04-18 | 2018-09-27 | Daimler Ag | Driver assistance system for augmenting a rearview mirror image |
| CN108621947A (en) * | 2018-05-04 | 2018-10-09 | 福建省汽车工业集团云度新能源汽车股份有限公司 | A kind of vehicle-mounted head-up-display system of automatic adjusument |
| CN110738952A (en) * | 2019-10-31 | 2020-01-31 | 的卢技术有限公司 | HUD display method and system combining human eye recognition, tracking and ray recognition |
| CN111405263A (en) * | 2019-12-26 | 2020-07-10 | 的卢技术有限公司 | Method and system for enhancing head-up display by combining two cameras |
| CN111222444A (en) * | 2019-12-31 | 2020-06-02 | 的卢技术有限公司 | Augmented reality head-up display method and system considering emotion of driver |
| CN111923835A (en) * | 2020-08-13 | 2020-11-13 | 启明信息技术股份有限公司 | Vehicle-based rearview display method |
| CN111923834A (en) * | 2020-08-13 | 2020-11-13 | 启明信息技术股份有限公司 | Eyeball identification-based vehicle rear view image display system and method |
| CN112026652A (en) * | 2020-08-13 | 2020-12-04 | 启明信息技术股份有限公司 | Back-view image head-up display system based on eyeball recognition laser imaging |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112918337A (en) * | 2021-04-02 | 2021-06-08 | 东风汽车集团股份有限公司 | Intelligent cabin adjusting system and method for identifying eye position |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10032429B2 (en) | Device control utilizing optical flow | |
| JP6711295B2 (en) | Vehicle display control device | |
| CN113276774B (en) | Method, device and equipment for processing video picture in unmanned vehicle remote driving process | |
| CN112714720B (en) | Rearview mirror control method and related equipment | |
| CN110949260B (en) | Method, system, equipment and storage medium for adjusting steering of exterior rearview mirror | |
| CN113370901A (en) | Rearview mirror adjusting method, device, equipment and storage medium | |
| CN112572296A (en) | Auxiliary system of AR-HUD intelligent rearview system and use method thereof | |
| CN111428646B (en) | Driver take-over guarantee method and system based on edge cloud computing | |
| CN112026652A (en) | Back-view image head-up display system based on eyeball recognition laser imaging | |
| CN113895357B (en) | Rearview mirror adjustment method, device, equipment and storage medium | |
| CN112129313A (en) | AR navigation compensation system based on inertial measurement unit | |
| CN111923834A (en) | Eyeball identification-based vehicle rear view image display system and method | |
| CN112298041A (en) | Transparent A-column display system of automobile | |
| CN111923835A (en) | Vehicle-based rearview display method | |
| CN116883977A (en) | Passenger state monitoring method and device, terminal equipment and vehicle | |
| CN215264808U (en) | Automatic adjusting system for vehicle-mounted HUD virtual image height | |
| CN115027363A (en) | Automobile intelligent cabin display system and method | |
| CN109801355A (en) | A kind of method and device expanding vision field of driver | |
| CN212604825U (en) | Vehicle rear view image display system based on eyeball identification | |
| CN217532705U (en) | Three camera splicing apparatus of back vision | |
| CN113377202B (en) | Head-up display method and system based on ARHUD | |
| CN115578283B (en) | Distortion correction method and device for HUD imaging, terminal equipment and storage medium | |
| US20230234442A1 (en) | Method For Displaying Augmented Reality Information In Vehicles | |
| EP4316912A1 (en) | Vehicle camera, camera system, video processing method, software, and vehicle incorporating the same | |
| CN218601845U (en) | Driving assistance system and vehicle |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210330 |
|
| RJ01 | Rejection of invention patent application after publication |