CN110979350A - AR navigation based on automobile data recorder - Google Patents
AR navigation based on automobile data recorder Download PDFInfo
- Publication number
- CN110979350A CN110979350A CN201911310042.4A CN201911310042A CN110979350A CN 110979350 A CN110979350 A CN 110979350A CN 201911310042 A CN201911310042 A CN 201911310042A CN 110979350 A CN110979350 A CN 110979350A
- Authority
- CN
- China
- Prior art keywords
- vehicle
- domain controller
- data recorder
- navigation
- navigation system
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 239000004973 liquid crystal related substance Substances 0.000 claims description 6
- 238000005516 engineering process Methods 0.000 abstract description 7
- 238000000034 method Methods 0.000 description 5
- 230000000694 effects Effects 0.000 description 3
- 230000007547 defect Effects 0.000 description 2
- 230000006698 induction Effects 0.000 description 2
- 230000003190 augmentative effect Effects 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000014509 gene expression Effects 0.000 description 1
- 238000007654 immersion Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W50/08—Interaction between the driver and the control system
- B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R16/00—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for
- B60R16/02—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements
- B60R16/023—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements for transmission of signals between vehicle parts or subsystems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W50/08—Interaction between the driver and the control system
- B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
- B60W2050/146—Display means
Landscapes
- Engineering & Computer Science (AREA)
- Mechanical Engineering (AREA)
- Multimedia (AREA)
- Automation & Control Theory (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- Transportation (AREA)
- Traffic Control Systems (AREA)
Abstract
The invention discloses an AR navigation system based on a vehicle event data recorder, which comprises the vehicle event data recorder, a domain controller DMC, a vehicle navigation system and a display module, wherein the vehicle event data recorder transmits acquired image data in front of a vehicle to the domain controller DMC, the domain controller DMC identifies lane lines, front vehicles, pedestrians and traffic signs in the image data, and fills guide information in the identified lane lines according to the guide information of the vehicle navigation system; the output end of the domain controller DMC is connected with a display module and used for outputting the image filled with the guide information to the display module to be displayed. The automobile data recorder is adopted to realize the acquisition of image data, the realization cost is low, and the increase of AR navigation cost is reduced; navigation guide information is added to a video based on the AR technology and is displayed on display screens of a central control unit, an instrument and the like in an image mode, so that AR navigation is realized, navigation experience is improved, and navigation is clearer and more definite.
Description
Technical Field
The invention relates to the field of automobile navigation, in particular to an AR navigation system based on a vehicle event data recorder.
Background
Along with the development of economy, the construction of a road network is more and more perfect and more complex, and the dependence of a vehicle driver on navigation is more and more strong, but the traditional navigation can only provide simple prompt information such as steering and intersection enlarged images, and under the condition of a complex road network, particularly under the condition that a plurality of intersections are close in distance and a plurality of intersections are arranged in a roundabout, the driver is easy to walk by mistake, so that great trouble is caused for the driver.
Disclosure of Invention
The invention aims to overcome the defects of the prior art and provides an AR navigation system and method based on a vehicle event data recorder, which are used for realizing AR navigation by utilizing an AR technology of a set of image data shot by the vehicle event data recorder.
In order to achieve the purpose, the invention adopts the technical scheme that: an AR navigation system based on a vehicle event data recorder comprises the vehicle event data recorder, a domain controller DMC, a vehicle navigation system and a display module, wherein the vehicle event data recorder transmits collected image data in front of a vehicle to the domain controller DMC, the domain controller DMC identifies lane lines, front vehicles, pedestrians and traffic signs in the image data, and fills guiding information in the identified lane lines according to the guiding information of the vehicle navigation system; the output end of the domain controller DMC is connected with a display module and used for outputting the image filled with the guide information to the display module to be displayed.
The display module comprises a liquid crystal instrument display screen, a vehicle-mounted HUD or a central control screen.
The guiding information comprises turn reminding, next intersection name, distance from the next exit, time from the destination and electronic eye information.
And the domain controller judges whether the image is in a line pressing driving state or not according to the identified lane line in the image, and if so, the domain controller controls the corresponding lane line in the image displayed by the display module to be marked red.
The domain controller identifies the distance between the front vehicle and the front pedestrian and the vehicle, marks the vehicles and the pedestrians with the distance smaller than a set threshold value as dangerous vehicles and pedestrians, and gives image reminding through the display module.
And the domain controller acquires the speed of the whole vehicle through a CAN network, judges the collision risk by combining the identified distance with the front vehicle and displays the risk data through an instrument.
And the domain controller displays the speed limit sign in the traffic signs identified from the video images on a meter or a HUD.
The invention has the advantages that: the automobile data recorder is adopted to realize the acquisition of image data, the realization cost is low, and the increase of AR navigation cost is reduced; navigation guide information is added to a video based on the AR technology and is displayed on display screens of a central control unit, an instrument and the like in an image mode, so that AR navigation is realized, navigation experience is improved, and navigation is clearer and more definite.
Drawings
The contents of the expressions in the various figures of the present specification and the labels in the figures are briefly described as follows:
FIG. 1 is a schematic diagram of the structure of an AR navigation system based on a car data recorder according to the present invention.
Detailed Description
The following description of preferred embodiments of the invention will be made in further detail with reference to the accompanying drawings.
Aiming at the defects of the prior art, more excellent navigation experience is realized by utilizing AR navigation, and the AR navigation is realized by utilizing the AR technology for the video shot by utilizing the camera of the vehicle-mounted automobile data recorder, so that the navigation experience of a user is improved on the one hand, the hardware of the whole automobile is utilized on the other hand, the increase of the cost is reduced as far as possible, and the realization can be realized only by setting related software control.
The method and the device rely on the development of the vehicle-scale chip technology, the computing capacity and the image processing capacity of the vehicle-mounted processor are stronger and stronger, and AR navigation display can be realized by utilizing the advantage and combining with the AR technology. The guiding information of navigation is superimposed after the road surface image is processed by the DMC, the road surface image and the guiding information are output to a full liquid crystal instrument screen or a central control display screen, a driver can acquire the navigation information by observing the full liquid crystal instrument screen or the central control display screen, and the navigation information is superimposed on an actual road surface, so that the navigation guiding is more accurate, clear and rich in technological sense. The technical terms related to the invention include: and (3) AR navigation: augmented reality navigation; DMC: a domain controller; LVDS: a low voltage differential signal; TBT: navigation turning prompt; HUD: and (5) head-up display.
According to the AR navigation method and the system, the induction information with the AR effect is superposed on the real road surface, so that a strong immersion feeling is brought to the user, the induction effect is more clear and clearer than the traditional navigation effect, the phenomenon of wrong judgment can not occur to the user, and more visual and interesting navigation experience is provided for the user.
(1) The camera of the automobile data recorder is used as an AR navigation camera to obtain the road image in front of the vehicle, so that one camera can be saved, and the system cost is reduced; (2) transmitting the image to a domain controller DMC through an LVDS wire harness; (3) the domain controller DMC processes the image, and identifies lane lines, front vehicles, pedestrians, traffic signs and the like through an image identification algorithm; (4) filling the identified lane with guide information according to the guide information of the navigation system; (5) outputting an image superimposed with navigation information such as TBT (tunnel boring machine) guide information, a next intersection name, a distance from the next intersection, destination time, electronic eye information and the like to a display screen of a liquid crystal instrument, a HUD (head Up display) or a central control screen, and providing navigation service for a driver; the domain controller is used as a main control chip, combines video data with relevant navigation information of vehicle navigation through an AR technology, adds the navigation information into a video image, and displays the video image, so as to provide navigation in an AR mode. (6) Judging whether the current running state of the vehicle is line pressing running or not according to the identified lane line, and marking the lane line on the image red to remind a driver if the current running state of the vehicle is line pressing running; because the position of the camera for shooting the picture is fixed, the position of the vehicle in the video can be known through calibration, if the position of the vehicle in the image in which the vehicle is to be positioned is provided with a lane line, the vehicle presses the lane line, at the moment, the reminding is given, and the guidance of the vehicle is displayed in a red mode, so that the reminding is carried out. (7) The recognized front vehicles and pedestrians are marked with red frames on the images aiming at the dangerous vehicles and pedestrians which are close to each other, and the driver is reminded of paying attention to the front vehicles and pedestrians; the distance CAN be acquired by an image recognition algorithm or directly through a CAN network by a front distance measuring sensor and the like arranged on the vehicle. (8) Through image processing, the distance between the vehicle and the front vehicle is identified, and when the distance reaches a dangerous distance threshold value in combination with vehicle speed data, alarm information is displayed on an instrument to prompt a driver to pay attention; (9) the traffic sign recognition is realized, the speed limit sign board is recognized, and the recognized speed limit sign is displayed on the liquid crystal instrument or the HUD.
The hardware system comprises: the AR navigation camera takes a road image in front of the vehicle as a camera for obtaining an AR navigation image by using a camera of the automobile data recorder;
the LVDS wire harness is responsible for stably transmitting the image acquired by the AR navigation camera to a domain controller (DMC) through a differential signal;
the domain controller (DMC), the module is regarded as the system core, mainly responsible for processing the acquired picture, through the recognition algorithm of the picture, discern lane line, vehicle, pedestrian, traffic label in front, superimpose the navigation information on the picture, and through discerning and calculating, provide some warning information such as warning of pressing the line, vehicle and pedestrian in front remind, vehicle distance detection and warning;
well accuse, instrument, new line display HUD: and displaying the image information, navigation guide information, alarm information and prompt information processed by the DMC to a driver.
It is clear that the specific implementation of the invention is not restricted to the above-described embodiments, but that various insubstantial modifications of the inventive process concept and technical solutions are within the scope of protection of the invention.
Claims (7)
1. The utility model provides a AR navigation based on vehicle event data recorder which characterized in that: the vehicle-mounted navigation system comprises a vehicle event data recorder, a domain controller DMC, a vehicle-mounted navigation system and a display module, wherein the vehicle event data recorder transmits acquired image data in front of a vehicle to the domain controller DMC, the domain controller DMC identifies lane lines, front vehicles, pedestrians and traffic signs in the image data, and fills guiding information in the identified lane lines according to the guiding information of the vehicle-mounted navigation system; the output end of the domain controller DMC is connected with a display module and used for outputting the image filled with the guide information to the display module to be displayed.
2. The automobile data recorder based AR navigation system of claim 1, wherein: the display module comprises a liquid crystal instrument display screen, a vehicle-mounted HUD or a central control screen.
3. The automobile data recorder based AR navigation system of claim 1, wherein: the guiding information comprises turn reminding, next intersection name, distance from the next exit, time from the destination and electronic eye information.
4. The automobile data recorder based AR navigation system of claim 1, wherein: and the domain controller judges whether the image is in a line pressing driving state or not according to the identified lane line in the image, and if so, the domain controller controls the corresponding lane line in the image displayed by the display module to be marked red.
5. The automobile data recorder based AR navigation system of claim 1, wherein: the domain controller identifies the distance between the front vehicle and the front pedestrian and the vehicle, marks the vehicles and the pedestrians with the distance smaller than a set threshold value as dangerous vehicles and pedestrians, and gives image reminding through the display module.
6. The automobile data recorder based AR navigation system of claim 1, wherein: and the domain controller acquires the speed of the whole vehicle through a CAN network, judges the collision risk by combining the identified distance with the front vehicle and displays the risk data through an instrument.
7. The automobile data recorder based AR navigation system of claim 1, wherein: and the domain controller displays the speed limit sign in the traffic signs identified from the video images on a meter or a HUD.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911310042.4A CN110979350A (en) | 2019-12-18 | 2019-12-18 | AR navigation based on automobile data recorder |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911310042.4A CN110979350A (en) | 2019-12-18 | 2019-12-18 | AR navigation based on automobile data recorder |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110979350A true CN110979350A (en) | 2020-04-10 |
Family
ID=70095279
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911310042.4A Pending CN110979350A (en) | 2019-12-18 | 2019-12-18 | AR navigation based on automobile data recorder |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110979350A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112584346A (en) * | 2020-12-16 | 2021-03-30 | 福州凌云数据科技有限公司 | New generation of car networking communication architecture based on block chain technology |
| CN112735126A (en) * | 2020-12-24 | 2021-04-30 | 成都格林希尔德交通科技有限公司 | Mixed traffic flow cooperative optimization control method based on model predictive control |
| CN113147781A (en) * | 2021-05-31 | 2021-07-23 | 重庆工程职业技术学院 | Intelligent driving information display system for automobile |
| CN113256989A (en) * | 2021-07-07 | 2021-08-13 | 智道网联科技(北京)有限公司 | Driving warning method and device, vehicle-mounted terminal and storage medium |
| CN114199265A (en) * | 2021-11-22 | 2022-03-18 | 南京邮电大学 | Auxiliary navigation system and navigation method based on target detection algorithm |
| CN114758427A (en) * | 2021-01-08 | 2022-07-15 | 一汽-大众汽车有限公司 | Automobile data recorder and method for realizing augmented reality navigation |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106092114A (en) * | 2016-06-22 | 2016-11-09 | 江苏大学 | The automobile real scene navigation apparatus of a kind of image recognition and method |
| CN108204822A (en) * | 2017-12-19 | 2018-06-26 | 武汉极目智能技术有限公司 | A kind of vehicle AR navigation system and method based on ADAS |
| CN109000671A (en) * | 2018-06-14 | 2018-12-14 | 苏州市职业大学 | A kind of Intelligent navigator based on AR technology |
| US20190049724A1 (en) * | 2017-08-08 | 2019-02-14 | Alpine Electronics, Inc. | Head-up display device, navigation device, and display method |
| CN109540161A (en) * | 2018-11-08 | 2019-03-29 | 东软睿驰汽车技术（沈阳）有限公司 | A kind of air navigation aid and device of vehicle |
| CN110285826A (en) * | 2019-07-24 | 2019-09-27 | 武汉永安亿商科技有限公司 | A kind of real scene navigation method based on vehicle |
-
2019
- 2019-12-18 CN CN201911310042.4A patent/CN110979350A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106092114A (en) * | 2016-06-22 | 2016-11-09 | 江苏大学 | The automobile real scene navigation apparatus of a kind of image recognition and method |
| US20190049724A1 (en) * | 2017-08-08 | 2019-02-14 | Alpine Electronics, Inc. | Head-up display device, navigation device, and display method |
| CN108204822A (en) * | 2017-12-19 | 2018-06-26 | 武汉极目智能技术有限公司 | A kind of vehicle AR navigation system and method based on ADAS |
| CN109000671A (en) * | 2018-06-14 | 2018-12-14 | 苏州市职业大学 | A kind of Intelligent navigator based on AR technology |
| CN109540161A (en) * | 2018-11-08 | 2019-03-29 | 东软睿驰汽车技术（沈阳）有限公司 | A kind of air navigation aid and device of vehicle |
| CN110285826A (en) * | 2019-07-24 | 2019-09-27 | 武汉永安亿商科技有限公司 | A kind of real scene navigation method based on vehicle |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112584346A (en) * | 2020-12-16 | 2021-03-30 | 福州凌云数据科技有限公司 | New generation of car networking communication architecture based on block chain technology |
| CN112735126A (en) * | 2020-12-24 | 2021-04-30 | 成都格林希尔德交通科技有限公司 | Mixed traffic flow cooperative optimization control method based on model predictive control |
| CN114758427A (en) * | 2021-01-08 | 2022-07-15 | 一汽-大众汽车有限公司 | Automobile data recorder and method for realizing augmented reality navigation |
| CN113147781A (en) * | 2021-05-31 | 2021-07-23 | 重庆工程职业技术学院 | Intelligent driving information display system for automobile |
| CN113256989A (en) * | 2021-07-07 | 2021-08-13 | 智道网联科技(北京)有限公司 | Driving warning method and device, vehicle-mounted terminal and storage medium |
| CN114199265A (en) * | 2021-11-22 | 2022-03-18 | 南京邮电大学 | Auxiliary navigation system and navigation method based on target detection algorithm |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110979350A (en) | AR navigation based on automobile data recorder | |
| WO2018066711A1 (en) | Travel assistance device and computer program | |
| US9434384B2 (en) | Vehicle cruise control apparatus and method | |
| CN101889299B (en) | Vehicle information display device | |
| CN106997677B (en) | Vehicle logo display device and method | |
| WO2018025624A1 (en) | Head-up display device, display control method, and control program | |
| US20110288766A1 (en) | Navigation device, navigation method, navigation program, and recording medium | |
| US20120046855A1 (en) | Arrangement and method for recognizing road signs | |
| CN107757479A (en) | A kind of drive assist system and method based on augmented reality Display Technique | |
| US12013254B2 (en) | Control device | |
| CN110497921A (en) | The method and system of automation function is provided for vehicle | |
| CN105723432A (en) | Driving-support-image generation device, driving-support-image display device, driving-support-image display system, and driving-support-image generation program | |
| CN114373335B (en) | Collision early warning method and device for vehicle, electronic equipment and storage medium | |
| WO2018172886A1 (en) | Device and method for augmented reality driving assistance | |
| CN111707283A (en) | Navigation method, device, system and equipment based on augmented reality technology | |
| CN105438066A (en) | Device for simultaneously displaying navigation information and traffic safety prompting information | |
| CN107351685A (en) | A kind of speed limit display system | |
| JP2008262388A (en) | Safety confirmation advice device | |
| CN113183758A (en) | Auxiliary driving method and system based on augmented reality | |
| JP5917456B2 (en) | Sign information output device | |
| JP2010228472A (en) | Display device for vehicle | |
| JP2017062706A (en) | Travel support system, travel support method, and computer program | |
| JP2008262481A (en) | Vehicle control device | |
| KR20140059809A (en) | Method and device for presenting traffic sign information | |
| KR20190125012A (en) | Traffic sign recognition system and method reflecting conditional speed limit |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200410 |