CN107757479A - A kind of drive assist system and method based on augmented reality Display Technique - Google Patents
A kind of drive assist system and method based on augmented reality Display Technique Download PDFInfo
- Publication number
- CN107757479A CN107757479A CN201610704119.6A CN201610704119A CN107757479A CN 107757479 A CN107757479 A CN 107757479A CN 201610704119 A CN201610704119 A CN 201610704119A CN 107757479 A CN107757479 A CN 107757479A
- Authority
- CN
- China
- Prior art keywords
- driver
- target vehicle
- augmented reality
- image
- reality display
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
- B60R2300/10—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used
- B60R2300/105—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used using multiple cameras
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
- B60R2300/20—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of display used
- B60R2300/205—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of display used using a head-up display
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
- B60R2300/80—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement
- B60R2300/804—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement for lane monitoring
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Multimedia (AREA)
- Mechanical Engineering (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Instrument Panels (AREA)
- Traffic Control Systems (AREA)
Abstract
The invention discloses a kind of drive assist system and method based on augmented reality Display Technique, this programme passes through Real time identification target vehicle, and its with from workshop relation, simultaneously according to driver's multi-view image, form the driving assistance information being modified according to driver visual angle, render the driving assistant images to be formed by amendment accordingly again, included revised driving assistant images in driver visual angle by augmented reality display system.The driving subplan formed accordingly, auxiliary information is corrected based on driver visual angle in real time, be associated auxiliary information and true driving environment by new line Display Technique, effectively solve existing drive assist system the problems of in terms of information alert.
Description
Technical field
The present invention relates to a kind of vehicle drive safe practice, and in particular to car steering subplan.
Background technology
Driver's perception is limited, if judging incorrect decision in startup procedure, tends to cause traffic accident, to subtract
It is few because driver's carelessness, error and caused by traffic accident, forward direction collision warning systems (FCW), Lane Departure Warning System
Etc. (LDW) drive assist system arises at the historic moment.These drive assist systems are carried by forms such as acousto-optic, vibrations when dangerous
Show that driver takes care, so as to avoid driver from judging that incorrect decision causes traffic accident.
But existing drive assist system only just sends early warning when dangerous, often because unexpected alarm and
Cause driver psychology nervous, and the moment of alarming can not also meet the driving experience of all drivers, when driver thinks to report
When police's moment is unreasonable, driver can usually close system.
In addition, the warning message of the existing drive assist system of the overwhelming majority shows that can only often rely on vehicle entertainment system shows
Display screen, and the position of vehicle entertainment system display screen and driver's normal driving sight gap are larger, driver can not see simultaneously
Front road conditions and warning message are examined, if driver watches warning message, exists and ignores front road conditions and cause traffic accident
Risk.Small part drive assist system using head-up-display system (HUD) carry out warning message display, but show content
Simple target information and warning message still are limited to, the help to driver's driver behavior is limited, even if it is existing to propose enhancing
Real concept, also fails to solve the problems, such as pilot's line of vision change well, what existing augmented reality drive assist system proposed
Identify that the scheme at driver visual angle does not obtain broad practice because algorithm effect is bad by camera in car.
The content of the invention
The problems of for existing drive assist system in terms of information alert, an object of the present invention is to carry
For a kind of drive assist system based on augmented reality Display Technique.
The second object of the present invention is to provide a kind of driving assistance method based on augmented reality Display Technique.
To achieve the above object, the present invention takes following technical scheme：
On the one hand, there is provided a kind of drive assist system based on augmented reality Display Technique, the drive assist system bag
Include：
Context aware systems, the context aware systems Real time identification relative to from the most dangerous target vehicle information of car,
And its with from car relation；
The other image unit of eye, eye side image unit gather driver's multi-view image in real time；
Integrated treatment unit, the integrated treatment unit letter that image unit provides by context aware systems and eye
Breath, form the driving assistant images being modified according to driver visual angle；
Augmented reality display system, the augmented reality display system display drive assistant images.
Preferably, the context aware systems gather the information of vehicles in front in real time, and identify front vehicles with from car
Distance and relative velocity.
Preferably, the context aware systems include photographing module and image processing module, and the photographing module is adopted in real time
Collect from front side image；Target vehicle is identified in the image that described image processing module gathers from photographing module, and according to first
The demarcation information that begins calculates the distance and relative velocity of target vehicle.
Preferably, Inertial Measurement Unit is integrated with described image processing module, the car measured according to Inertial Measurement Unit
The distance and relative velocity of body attitude rectification target vehicle.
Preferably, shooting is single by the target vehicle information and eye that the integrated treatment unit obtains according to context aware systems
Driver's multi-view image that member obtains, at least calculate in driver visual angle in head-up-display system viewing area target vehicle with
From the spacing in workshop and the position in minimum safe following distance region, and render and drive assistant images and be sent to augmented reality and show
System.
Preferably, the target vehicle distance of the integrated treatment unit foundation context aware systems acquisition, relative velocity letter
Breath calculates minimum safe spacing；Driver's multi-view image that image unit obtains by eye is gathered simultaneously, and combining environmental perceives system
The target vehicle original image and in-car inherent feature that system obtains analyze and process to the driver's multi-view image collected, count
Calculation obtains head-up-display system viewing area, target vehicle position, target vehicle distance and the minimum safe in driver visual angle
Spacing, and render accordingly according to the revised driving assistant images in visual angle are driven, the driving assistant images are sent to enhancing
Real display system.
Preferably, driver's multi-view image that image unit obtains by the integrated treatment unit collection eye, according to in-car
Inherent feature, augmented reality display system driving assistance information in driver visual angle is analyzed from driver's multi-view image and is shown
Region, and the target vehicle original image transmitted according to context aware systems identifies that driver regards from driver's multi-view image
Target vehicle position in angle；Integrated treatment unit is based on the driving assistance information viewing area in driver visual angle and target carriage
Position, calculate in driver visual angle in augmented reality display system driving assistance information viewing area target vehicle with from car
Between spacing and minimum safe following distance region position.
Preferably, the driving assistant images mark target vehicle and from the distance between car region and minimum safe car
Away from representative region.
On the other hand, there is provided a kind of driving assistance method based on augmented reality Display Technique, methods described Real time identification
Target vehicle, and its with being modified from workshop relation, while according to driver's multi-view image, formation according to driver visual angle
Assistant images are driven, are included revised driving assistant images in driver visual angle by augmented reality display system.
Preferably, the information of vehicles in front is gathered in methods described in real time, is therefrom identified relative to most dangerous from car
Target vehicle information, and calculate target vehicle and the distance and relative velocity from workshop.
Preferably, methods described calculates minimum safe following distance according to the distance and relative velocity of target vehicle；
Driver's multi-view image is gathered simultaneously, and combining target vehicle original image and in-car inherent feature regard to the driver collected
Angle image is analyzed and processed, and augmented reality display system viewing area, target vehicle position in driver visual angle is calculated
Put, target vehicle distance and minimum safe spacing, and render accordingly according to the revised driving assistant images in visual angle are driven, lead to
Augmented reality display system is crossed to show.
Preferably, in methods described after driver's multi-view image is collected, regarded according to in-car inherent feature from driver
The driving assistance information viewing area of strong real display system in driver visual angle is analyzed in the image of angle, and according to target vehicle
Original image identifies the position of target vehicle in driver visual angle from driver's multi-view image；
Then, based on driving assistance information viewing area in driver visual angle and target vehicle position, it is existing to calculate reinforcement
Target vehicle and the pixel region and minimum safe following distance that are covered from the spacing between car in real display system projected image
The pixel region covered, driving assistant images are rendered to based on this two pieces of area informations.
The driving subplan formed accordingly, auxiliary information is corrected based on driver visual angle in real time, skill is shown by coming back
Auxiliary information and true driving environment are associated by art, greatly improve the real-time of auxiliary information, accuracy, convenience,
Reliability etc., effectively solves existing drive assist system the problems of in terms of information alert.
Furthermore this driving subplan, it has further the advantage that：
1st, the present invention is led to due to being provided with context aware systems in automotive front windshield the top centre position
Cross and the angles and positions of camera installation are demarcated, and measure body gesture in real time using Inertial Measurement Unit, can be with
The distance and velocity information of road ahead vehicle are identified exactly, so as to calculate the safe vehicle headway with front truck in real time.
2nd, the present invention will can drive due to being provided with a head-up-display system in front of steering wheel, below windshield
Auxiliary information project in front of driver's normal driving sight, can avoid driver observe driving assistance information during regard
Angle switches.
3rd, the present invention in driver head due to that, with other image unit at a glance, can gather driver visual angle in real time
Image, the driving assistance information viewing area in pilot's line of vision and the observation visual angle of driver are obtained, with What You See Is What You Get
Mode corrects the display location of driving assistance information in head-up-display system in real time, to solve between projected image and real goal
Matching problem.
4th, the present invention due in the car top be provided with an integrated treatment unit, can according to single camera vision system obtain
Driver's multi-view image that camera obtains by front vehicles and car's location, length velocity relation and driver's eye calculates new line
The region that leading vehicle distance and safe following distance mark should cover in display system.
It is also replaceable or additionally increase other rings in addition, context aware systems can be single camera vision system in the present invention
Border sensory perceptual system, so as to greatly increase the scalability of the present invention, context aware systems identification is also not limited to front vehicles
Information, the information such as pavement strip, pedestrian, signal lamp, sign board are may also comprise, so as to the content of abundant driving assistance information.
Brief description of the drawings
The present invention is further illustrated below in conjunction with the drawings and specific embodiments.
Fig. 1 is the structure principle chart of drive assist system in present example；
Fig. 2 is drive assist system message processing flow figure in present example；
Fig. 3 is augmented reality display renderings in present example.
Label declaration in figure：
In Fig. 1,1 is the single camera vision system for shooting road ahead situation, and 11 be preceding to ccd video camera, and 12 be at image
Unit (being internally integrated Inertial Measurement Unit) is managed, 2 be integrated treatment unit, and 21 be Data Input Interface, and 22 be data operation
Unit, 23 be image output interface, and 3 be camera by driver head's eye, and 4 be head-up-display system.
In Fig. 3, front truck and from the region marked between car bonnet be two following distances and safe distance between vehicles, windshield upper left
The Spd of side is from car current vehicle speed, and Spd be target vehicle speed above front vehicles, Dis for target vehicle and from car away from
From.
Embodiment
In order that the technical means, the inventive features, the objects and the advantages of the present invention are easy to understand, tie below
Conjunction is specifically illustrating, and the present invention is expanded on further.
It is provided by the invention driving subplan by Real time identification target vehicle, and its with from workshop relation, while according to
According to driver's multi-view image, form the driving assistance information being modified according to driver visual angle, then render accordingly to be formed by
The driving assistant images of amendment, revised driving assistant images are included at driver visual angle by augmented reality display system
It is interior.
Based on the principle, the present invention program provides a kind of drive assist system, and the drive assist system is mainly by environment sense
Know that system, eye side image unit, integrated treatment unit and augmented reality display system coordinate to form.
Wherein, the context aware systems in the system are arranged on vehicle, for Real time identification relative to most dangerous from car
Target vehicle information, and its with from car relation.
Here the preferred single camera vision system of context aware systems, it gathers the information of vehicles of road ahead in real time, identification
Relative to from the most dangerous target vehicle information of car, and target vehicle distance and relative velocity are calculated, and by the mesh of collection
Mark vehicle original color image and target range, relative velocity are sent in integrated treatment unit.
Furthermore context aware systems are in addition to single camera vision system, also replaceable or additionally increase other environment sensing systems
System, so as to greatly increase the scalability of the present invention, single camera vision system identification is also not limited to front vehicles information, also may be used
Including information such as pavement strip, pedestrian, signal lamp, sign boards, so as to the content of abundant driving assistance information.
Image unit is worn on driver head by eye in the system, for gathering driver's multi-view image in real time.
Here camera by the preferred eye of image unit, when it is worn on driver head, is placed exactly in driver by eye
Beside eyes.The coloured image collected is sent to integrated treatment unit and carries out driver visual angle figure by camera by driver's eye
Picture analysis drives the position of assistant images to correct.
Integrated treatment unit in the system according to objects ahead information of vehicles (such as target vehicle image, target vehicle away from
From, relative velocity etc.) and driver's eye by camera image information, calculate augmented reality display system in driver visual angle
System viewing area in the position in following distance region and minimum safe following distance region and render driving assistant images be sent to
Augmented reality display system.
Here integrated treatment unit is placed in vehicle, and it is calculated according to target vehicle distance, relative velocity
Minimum safe spacing；Driver's multi-view image that camera is got by driver's eye is gathered simultaneously, and combining target vehicle is original
Coloured image and in-car inherent feature are analyzed and processed to the image, and the augmented reality being calculated in driver visual angle is shown
System viewing area and target vehicle position；Head-up-display system viewing area in comprehensive driver visual angle, target vehicle position,
The information such as target vehicle distance and minimum safe spacing, render according to the revised driving assistant images in visual angle are driven, by this
Image is sent to augmented reality display system Projection Display.
Augmented reality display system in the system is preferably arranged in front of steering wheel, the new line below windshield shows
Show system, driving assistance information will be projected to driver's normal driving sight, and can kept away by way of Projection Display
Exempt from the view angle switch during driver's observation driving assistance information.
For above-mentioned driving subplan, carry out further instruction below by way of a concrete application example.
Referring to Fig. 1, it show the schematic diagram of the drive assist system in this example.As seen from the figure, the system is mainly wrapped
The single camera vision system 1 for being arranged on centre position above automotive front windshield is included, the synthesis at top in the car is set
Processing unit 2, camera 3 and it is arranged in front of vehicle steering, the head-up-display system 4 below windshield by eye.
In the present embodiment, single camera vision system 1 is particularly located at centre position above automotive front windshield, internal
Comprising a ccd video camera 11 and a graphics processing unit 12, ccd video camera resolution ratio is 1280x960, graphics processing unit 12
Vehicle in the image that the methods of passing through machine learning identification ccd video camera 11 obtains, and find out most dangerous vehicle and calculate it
With the distance and relative velocity from car.Graphics processing unit 12 has been internally integrated Inertial Measurement Unit, can calculate vehicle body in real time
For posture so as to correct target vehicle distance and relative velocity, processing result image and target vehicle original image are defeated by network interface
Go out.Single camera vision system needs to carry out initialization demarcation to its position in vehicle when mounted.
In the present embodiment, camera 3 is fixed on driver head, camera by way of glasses by driver head's eye
Collection image resolution ratio is 1280x960, by USB interface from the power taking of integrated treatment unit 2 and by image transmitting to integrated treatment
Unit.It can also be coordinated as needed using other manner with integrated treatment unit 2.
In the present embodiment, integrated treatment unit 2 is installed on above driver head inside roof, passes through vehicle OBD interfaces
Or cigar lighter power supply, Data Input Interface 21 is network interface, and data output interface 23 is HDMI.
In the present embodiment, head-up-display system 4 is particularly located in front of steering wheel, below windshield, is driven receiving
After assistant images, projected to driver's front windshield.
Referring to Fig. 2, operationally, single camera vision system 1 gathers road ahead to the drive assist system formed accordingly in real time
Information of vehicles simultaneously identifies front vehicles and distance and relative velocity from car, the target vehicle original image that finally will identify that and
Its distance, relative velocity are sent to by data wire to be set in the integrated treatment unit 2 at top in the car.
Integrated treatment unit 2 calculates minimum safe following distance according to the distance and relative velocity of target vehicle, with
This simultaneously, integrated treatment unit 2 receives the coloured image that camera 3 gathers by driver head eye by data wire and (driven
Member's multi-view image), according to some in-car inherent features (such as steering wheel, instrument board, windshield lower boundary) from the cromogram
Vehicle steering front, the lift below windshield are arranged in driver visual angle as analyzing in (i.e. driver's multi-view image)
Head display system 4 driving assistance information viewing area, and according to the target vehicle original image that single camera vision system is transmitted from driving
The position of target vehicle in driver visual angle is identified by the person's of sailing eye in the original image of camera 3.
On this basis, integrated treatment unit 2 is based on driving assistance information viewing area and target carriage in driver visual angle
Position, calculates target vehicle and the pixel region covered from the spacing between car in the projected image of head-up-display system 4
And the pixel region that minimum safe following distance is covered.
Finally, integrated treatment unit 2 by this two pieces of area informations and other additional informations (inessential) be rendered to drive it is auxiliary
Image is helped to be sent to head-up-display system 4 by data wire, head-up-display system 4 will receive driving assistant images and project to vehicle
Shown on windshield and be presented to driver, so as to aid in driver to carry out safe driving.
Referring to Fig. 3, the head-up-display system 4 in this example carries out image amplification by the optical system of inside and light path prolongs
It is long, can in front of the driver at a certain distance from form a virtual image vertical with vehicle heading, that is, drive assistant images.Should
Target vehicle can be marked and from the region representated by the distance between car region and minimum safe spacing by driving assistant images, with
Auxiliary driver's moment keeps safety with following distance.
The present embodiment is in the specific implementation, assume that the target vehicle original image that single camera vision system 1 exports is histogram
As img0, the image of camera collection is img1 by driver's eye, using img0 as template, can be found in img1 with img0 most
For the region of matching, matching area four angle point A, B, C, D pixel coordinates in img1 are (xA, yA)、(xB, yB)、(xC, yC) and
(xD, yD)。
On this basis, integrated treatment unit identifies at least four inherent feature point M, N, P, Q (M, N, P, Q from img1
Known to coordinate under vehicle coordinate system), its pixel coordinate in img1 is respectively (xM, yM)、(xN, yN)、(xP, yP) and (xQ,
yQ), then the coordinate system transformation relation of camera coordinate system and vehicle coordinate system by eye can be calculated accordingly, shown so as to calculate to come back
Show system driving assistance information viewing area four angle points E, F, G, H in img1 pixel coordinate, be set to (xE, yE)、(xF,
yF)、(xG, yG) and (xH, yH)。
Assuming that coordinate of tetra- angle points of A, B, C, D in head-up-display system projected image img2 is for a, b, c, d, img2
Pixel wide be w, pixels tall h, then the relation that the pixel coordinate of a points meets is：
B, the mode of the available similar above formula of 3 points of c, d coordinate is tried to achieve.
Target vehicle and the pixel region covered from the spacing between car and minimum peace can be confirmed according to above-mentioned formula
The pixel region that full following distance is covered.
From examples detailed above, scheme provided by the invention can be widely applied to the auxiliary information of all kinds of drive assist systems
Enhancing display display.
General principle, principal character and the advantages of the present invention of the present invention has been shown and described above.The technology of the industry
Personnel are it should be appreciated that the present invention is not limited to the above embodiments, and the simply explanation described in above-described embodiment and specification is originally
The principle of invention, without departing from the spirit and scope of the present invention, various changes and modifications of the present invention are possible, these changes
Change and improvement all fall within the protetion scope of the claimed invention.The claimed scope of the invention by appended claims and its
Equivalent thereof.
Claims (12)
1. a kind of drive assist system based on augmented reality Display Technique, it is characterised in that the drive assist system includes：
Context aware systems, the context aware systems Real time identification relative to from the most dangerous target vehicle information of car, and
Its with from car relation；
The other image unit of eye, eye side image unit gather driver's multi-view image in real time；
Integrated treatment unit, the integrated treatment unit information that image unit provides by context aware systems and eye,
Form the driving assistant images being modified according to driver visual angle；
Augmented reality display system, the augmented reality display system display drive assistant images.
A kind of 2. drive assist system based on augmented reality Display Technique according to claim 1, it is characterised in that institute
State context aware systems and gather the information of vehicles in front in real time, and identify that front vehicles are believed with the distance from car and relative velocity
Breath.
3. a kind of drive assist system based on augmented reality Display Technique according to claim 1 or 2, its feature exist
In the context aware systems include photographing module and image processing module, and the photographing module gathers from front side figure in real time
Picture；Target vehicle is identified in the image that described image processing module gathers from photographing module, and according to initial alignment information meter
Calculate the distance and relative velocity of target vehicle.
A kind of 4. drive assist system based on augmented reality Display Technique according to claim 3, it is characterised in that institute
State and Inertial Measurement Unit is integrated with image processing module, the body gesture amendment target vehicle measured according to Inertial Measurement Unit
Distance and relative velocity.
A kind of 5. drive assist system based on augmented reality Display Technique according to claim 1, it is characterised in that institute
Integrated treatment unit is stated to regard according to the driver that image unit by the target vehicle information and eye of context aware systems acquisition obtains
Angle image, at least calculate in driver visual angle in head-up-display system viewing area target vehicle and the spacing from workshop and most
The position of small accident-free vehicle pitch area, and render driving assistant images and be sent to augmented reality display system.
A kind of 6. drive assist system based on augmented reality Display Technique according to claim 5, it is characterised in that institute
State the target vehicle distance of integrated treatment unit foundation context aware systems acquisition, relative velocity calculates minimum safe car
Away from；Driver's multi-view image that image unit obtains by eye is gathered simultaneously, and the target vehicle that combining environmental sensory perceptual system obtains is former
Beginning image and in-car inherent feature analyze and process to the driver's multi-view image collected, are calculated in driver visual angle
Head-up-display system viewing area, target vehicle position, target vehicle distance and minimum safe spacing, and render accordingly according to
According to the revised driving assistant images in visual angle are driven, the driving assistant images are sent to augmented reality display system.
7. a kind of drive assist system based on augmented reality Display Technique according to claim 5 or 6, its feature exist
In, driver's multi-view image that image unit obtains by integrated treatment unit collection eye, according to in-car inherent feature, from driving
Augmented reality display system driving assistance information viewing area in driver visual angle is analyzed in the person's of sailing multi-view image, and according to ring
The target vehicle original image of border sensory perceptual system transmission identifies the target carriage in driver visual angle from driver's multi-view image
Position；Integrated treatment unit is calculated based on the driving assistance information viewing area and target vehicle position in driver visual angle
Go out in driver visual angle in augmented reality display system driving assistance information viewing area target vehicle and the spacing from workshop and
The position in minimum safe following distance region.
A kind of 8. drive assist system based on augmented reality Display Technique according to claim 1, it is characterised in that institute
State and drive assistant images and mark target vehicle and from the region representated by the distance between car region and minimum safe spacing.
A kind of 9. driving assistance method based on augmented reality Display Technique, it is characterised in that methods described Real time identification target
Vehicle, and its with from workshop relation, while according to driver's multi-view image, forming the driving being modified according to driver visual angle
Assistant images, revised driving assistant images are included in driver visual angle by augmented reality display system.
A kind of 10. driving assistance method based on augmented reality Display Technique according to claim 9, it is characterised in that
The information of vehicles in front is gathered in methods described in real time, is therefrom identified relative to from the most dangerous target vehicle information of car, and
Calculate target vehicle and the distance and relative velocity from workshop.
A kind of 11. driving assistance method based on augmented reality Display Technique according to claim 9, it is characterised in that
Methods described calculates minimum safe following distance according to the distance and relative velocity of target vehicle；Simultaneously driver is gathered to regard
Angle image, and combining target vehicle original image and in-car inherent feature are carried out at analysis to the driver's multi-view image collected
Reason, be calculated augmented reality display system viewing area in driver visual angle, target vehicle position, target vehicle distance and
Minimum safe spacing, and render accordingly according to the revised driving assistant images in visual angle are driven, system is shown by augmented reality
System display.
A kind of 12. driving assistance method based on augmented reality Display Technique according to claim 11, it is characterised in that
In methods described after driver's multi-view image is collected, analyzed and driven from driver's multi-view image according to in-car inherent feature
The driving assistance information viewing area of strong real display system in the person of sailing visual angle, and according to target vehicle original image from driver
The position of target vehicle in driver visual angle is identified in multi-view image；
Then, based on driving assistance information viewing area in driver visual angle and target vehicle position, it is aobvious to calculate reinforcement reality
Show that target vehicle and the pixel region covered from the spacing between car and minimum safe following distance are covered in Systems Projection image
The pixel region of lid, driving assistant images are rendered to based on this two pieces of area informations.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610704119.6A CN107757479A (en) | 2016-08-22 | 2016-08-22 | A kind of drive assist system and method based on augmented reality Display Technique |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610704119.6A CN107757479A (en) | 2016-08-22 | 2016-08-22 | A kind of drive assist system and method based on augmented reality Display Technique |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107757479A true CN107757479A (en) | 2018-03-06 |
Family
ID=61264636
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610704119.6A Pending CN107757479A (en) | 2016-08-22 | 2016-08-22 | A kind of drive assist system and method based on augmented reality Display Technique |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107757479A (en) |
Cited By (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108482247A (en) * | 2018-03-27 | 2018-09-04 | 京东方科技集团股份有限公司 | A kind of vehicle and its DAS (Driver Assistant System) and auxiliary driving method |
| CN108648488A (en) * | 2018-05-04 | 2018-10-12 | 姜鹏飞 | A kind of method and system expanding vision field of driver |
| CN108765490A (en) * | 2018-04-04 | 2018-11-06 | 科大讯飞股份有限公司 | The visual field method of adjustment and device of panorama sketch, storage medium, electronic equipment |
| CN109353279A (en) * | 2018-12-06 | 2019-02-19 | 延锋伟世通电子科技（上海）有限公司 | A kind of vehicle-mounted head-up-display system of augmented reality |
| CN109649275A (en) * | 2018-11-29 | 2019-04-19 | 福瑞泰克智能系统有限公司 | A kind of driving assistance system and method based on augmented reality |
| CN109668575A (en) * | 2019-01-29 | 2019-04-23 | 苏州车萝卜汽车电子科技有限公司 | For the method for processing navigation information and device of augmented reality head-up display device, equipment, system |
| CN110293977A (en) * | 2019-07-03 | 2019-10-01 | 北京百度网讯科技有限公司 | Method and apparatus for showing augmented reality information warning |
| CN110316065A (en) * | 2018-03-30 | 2019-10-11 | 深圳市掌网科技股份有限公司 | A kind of automobile-used auxiliary display system and method |
| CN110316067A (en) * | 2018-03-30 | 2019-10-11 | 深圳市掌网科技股份有限公司 | A kind of vehicle DAS (Driver Assistant System) and method |
| CN110674733A (en) * | 2019-09-23 | 2020-01-10 | 厦门金龙联合汽车工业有限公司 | Multi-target detection and identification method and driving assistance method and system |
| CN110895417A (en) * | 2018-09-12 | 2020-03-20 | 本田技研工业株式会社 | Vehicle control device, vehicle control method, and storage medium |
| CN111717028A (en) * | 2020-06-29 | 2020-09-29 | 深圳市元征科技股份有限公司 | AR system control method and related device |
| CN112433619A (en) * | 2021-01-27 | 2021-03-02 | 国汽智控(北京)科技有限公司 | Human-computer interaction method and system for automobile, electronic equipment and computer storage medium |
| US11037382B2 (en) * | 2018-11-20 | 2021-06-15 | Ford Global Technologies, Llc | System and method for evaluating operation of environmental sensing systems of vehicles |
| CN113815534A (en) * | 2021-11-05 | 2021-12-21 | 吉林大学重庆研究院 | Method for dynamically processing graphics based on response to changes in the position of human eyes |
| CN113928224A (en) * | 2021-11-26 | 2022-01-14 | 北京经纬恒润科技股份有限公司 | Auxiliary driving system based on HUD and pixel headlamp |
| CN114503008A (en) * | 2019-09-27 | 2022-05-13 | 米兰综合工科大学 | Method and system for vehicle driving assistance |
| CN117162777A (en) * | 2023-11-03 | 2023-12-05 | 西安信飞特信息科技有限公司 | Content presentation method, device, equipment and storage medium |
-
2016
- 2016-08-22 CN CN201610704119.6A patent/CN107757479A/en active Pending
Cited By (24)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108482247A (en) * | 2018-03-27 | 2018-09-04 | 京东方科技集团股份有限公司 | A kind of vehicle and its DAS (Driver Assistant System) and auxiliary driving method |
| US10906465B2 (en) | 2018-03-27 | 2021-02-02 | Boe Technology Group Co., Ltd. | Vehicle, driving assistance system, and driving assistance method thereof |
| CN110316065A (en) * | 2018-03-30 | 2019-10-11 | 深圳市掌网科技股份有限公司 | A kind of automobile-used auxiliary display system and method |
| CN110316067A (en) * | 2018-03-30 | 2019-10-11 | 深圳市掌网科技股份有限公司 | A kind of vehicle DAS (Driver Assistant System) and method |
| CN110316065B (en) * | 2018-03-30 | 2022-12-27 | 深圳市掌网科技股份有限公司 | Auxiliary display system and method for vehicle |
| CN108765490A (en) * | 2018-04-04 | 2018-11-06 | 科大讯飞股份有限公司 | The visual field method of adjustment and device of panorama sketch, storage medium, electronic equipment |
| WO2019192145A1 (en) * | 2018-04-04 | 2019-10-10 | 科大讯飞股份有限公司 | Method and apparatus for adjusting field of view of panoramic image, storage medium, and electronic device |
| CN108648488A (en) * | 2018-05-04 | 2018-10-12 | 姜鹏飞 | A kind of method and system expanding vision field of driver |
| CN110895417A (en) * | 2018-09-12 | 2020-03-20 | 本田技研工业株式会社 | Vehicle control device, vehicle control method, and storage medium |
| US11037382B2 (en) * | 2018-11-20 | 2021-06-15 | Ford Global Technologies, Llc | System and method for evaluating operation of environmental sensing systems of vehicles |
| CN109649275A (en) * | 2018-11-29 | 2019-04-19 | 福瑞泰克智能系统有限公司 | A kind of driving assistance system and method based on augmented reality |
| CN109353279A (en) * | 2018-12-06 | 2019-02-19 | 延锋伟世通电子科技（上海）有限公司 | A kind of vehicle-mounted head-up-display system of augmented reality |
| CN109668575A (en) * | 2019-01-29 | 2019-04-23 | 苏州车萝卜汽车电子科技有限公司 | For the method for processing navigation information and device of augmented reality head-up display device, equipment, system |
| CN110293977A (en) * | 2019-07-03 | 2019-10-01 | 北京百度网讯科技有限公司 | Method and apparatus for showing augmented reality information warning |
| CN113386785A (en) * | 2019-07-03 | 2021-09-14 | 北京百度网讯科技有限公司 | Method and apparatus for displaying augmented reality alert information |
| CN110674733A (en) * | 2019-09-23 | 2020-01-10 | 厦门金龙联合汽车工业有限公司 | Multi-target detection and identification method and driving assistance method and system |
| CN114503008A (en) * | 2019-09-27 | 2022-05-13 | 米兰综合工科大学 | Method and system for vehicle driving assistance |
| CN111717028A (en) * | 2020-06-29 | 2020-09-29 | 深圳市元征科技股份有限公司 | AR system control method and related device |
| CN112433619A (en) * | 2021-01-27 | 2021-03-02 | 国汽智控(北京)科技有限公司 | Human-computer interaction method and system for automobile, electronic equipment and computer storage medium |
| CN113815534A (en) * | 2021-11-05 | 2021-12-21 | 吉林大学重庆研究院 | Method for dynamically processing graphics based on response to changes in the position of human eyes |
| CN113928224A (en) * | 2021-11-26 | 2022-01-14 | 北京经纬恒润科技股份有限公司 | Auxiliary driving system based on HUD and pixel headlamp |
| CN113928224B (en) * | 2021-11-26 | 2024-01-30 | 北京经纬恒润科技股份有限公司 | Auxiliary driving system based on HUD and pixel headlight |
| CN117162777A (en) * | 2023-11-03 | 2023-12-05 | 西安信飞特信息科技有限公司 | Content presentation method, device, equipment and storage medium |
| CN117162777B (en) * | 2023-11-03 | 2024-02-20 | 西安信飞特信息科技有限公司 | Content presentation method, device, equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107757479A (en) | A kind of drive assist system and method based on augmented reality Display Technique | |
| US9723243B2 (en) | User interface method for terminal for vehicle and apparatus thereof | |
| DE102013110332B4 (en) | VISUAL GUIDANCE SYSTEM | |
| JP5316713B2 (en) | Lane departure prevention support apparatus, lane departure prevention method, and storage medium | |
| US8536995B2 (en) | Information display apparatus and information display method | |
| US9505346B1 (en) | System and method for warning a driver of pedestrians and other obstacles | |
| JP6307895B2 (en) | Vehicle periphery monitoring device | |
| JP6379779B2 (en) | Vehicle display device | |
| US10488658B2 (en) | Dynamic information system capable of providing reference information according to driving scenarios in real time | |
| WO2011108198A1 (en) | Surrounding area monitoring device for vehicle | |
| WO2015163205A1 (en) | Vehicle display system | |
| CN109050405A (en) | A kind of multi-functional augmented reality head-up-display system and method | |
| KR101976106B1 (en) | Integrated head-up display device for vehicles for providing information | |
| US10866416B2 (en) | Display control device and display control method | |
| JP2008222153A (en) | Merging support device | |
| JP2006338594A (en) | Pedestrian recognition system | |
| CN107206941A (en) | For the method for the driver assistance system for operating motor vehicles, driver assistance system and motor vehicles | |
| JP2009226978A (en) | Vehicular circumference monitoring device | |
| JP2012247847A (en) | Information transmission control device for vehicle and information transmission control device | |
| JP2008285105A (en) | Information display device | |
| JP4986070B2 (en) | Ambient monitoring device for vehicles | |
| JP5723561B2 (en) | Driving assistance device | |
| JP5251673B2 (en) | Vehicle display device | |
| JP4715604B2 (en) | Peripheral image display device | |
| JP5622819B2 (en) | Gaze guidance system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20180306 |