CN214607303U

CN214607303U - Vehicle driving assistance system

Info

Publication number: CN214607303U
Application number: CN202022909813.6U
Authority: CN
Inventors: 张卓鹏; 游立锦; 潘东; 李海峰
Original assignee: Hangzhou Guangli Technology Co ltd
Current assignee: Hangzhou Guangli Technology Co ltd
Priority date: 2020-12-07
Filing date: 2020-12-07
Publication date: 2021-11-05
Anticipated expiration: 2030-12-07

Abstract

The utility model provides a vehicle driving auxiliary system can improve the security of driving. A vehicle driving assist system comprising: vehicle-mounted distance measurement identification equipment and AR glasses; the on-board ranging identification device is mountable to a first vehicle for acquiring a first image of a second vehicle located in front of the first vehicle and determining a distance between the second vehicle and the first vehicle; the AR glasses include at least a processor and a display lens; the processor is used for obtaining the first image and the distance and superposing the distance to the first image to obtain a second image; the display lens is used for displaying the second image.

Description

Vehicle driving assistance system

Technical Field

The utility model relates to an intelligent driving technical field especially relates to a vehicle driving auxiliary system.

Background

In the existing driving assistance system, only a picture of a road real-time situation is usually given, quantitative feedback on a real-time road condition is not provided, and judgment is mainly made by observation of human eyes, driving experience and the like in the driving process, but many drivers are difficult to judge the distance to a front vehicle due to inexperience and insufficient experience of driving technology, and are not clear when braking should be adopted, and rear-end accidents are easily caused when the time is missed. According to statistics, the rear-end collision accidents of the motor vehicles account for about 50 percent of all traffic accidents. Therefore, how to improve the effect of the driving assistance system in terms of driving safety is an urgent technical problem to be solved.

Disclosure of Invention

The utility model provides a vehicle driving auxiliary system can improve the security of driving.

A first aspect of the present invention provides a vehicle driving assistance system, including: vehicle-mounted distance measurement identification equipment and AR glasses;

the on-board ranging identification device is mountable to a first vehicle for acquiring a first image of a second vehicle located in front of the first vehicle and determining a distance between the second vehicle and the first vehicle;

the AR glasses include at least a processor and a display lens; the processor is used for obtaining the first image and the distance and superposing the distance to the first image to obtain a second image; the display lens is used for displaying the second image.

According to an embodiment of the utility model, the vehicle-mounted distance measuring and identifying equipment comprises a camera and a distance measuring device;

the camera is used for acquiring the first image;

the distance measuring device is used for measuring the distance.

According to the utility model discloses an embodiment, range unit is laser radar.

According to an embodiment of the present invention, the vehicle-mounted ranging recognition apparatus includes a first information transmission unit;

the AR glasses further comprise a second information transmission unit, and the second information transmission unit is connected with the first information transmission unit;

the first information transmission unit is used for sending the first image and the distance to the second information transmission unit;

the second information transmission unit is used for receiving the first image and the distance sent by the first information transmission unit and sending the first image and the distance to the processor.

According to an embodiment of the present invention, the vehicle-mounted ranging recognition device is further configured to determine position information of the second vehicle in the first image;

the distance is superimposed on a specified position of the first image, the specified position being determined in accordance with the position information.

According to an embodiment of the invention, the designated location is a rear of the vehicle.

According to the utility model discloses an embodiment, AR glasses still include suggestion device, it is right that suggestion device is used for the scope of distance place is indicateed.

According to the utility model discloses an embodiment, suggestion device includes:

the image prompting device is used for setting a mark in the image for prompting when the distance is in a first range and a second range; the first range and the second range are different;

and/or the presence of a gas in the gas,

the voice prompt device is used for carrying out voice prompt when the distance is in the second range;

and/or the presence of a gas in the gas,

and the vibration prompting device is used for performing vibration prompting when the distance is in the second range.

According to one embodiment of the present invention,

the first range is smaller than or equal to a first set distance and larger than a second set distance, and the second set distance is smaller than the first set distance;

the second range is smaller than or equal to the second set distance.

According to one embodiment of the present invention,

the display lens is a transparent waveguide lens.

The utility model discloses following beneficial effect has:

the embodiment of the utility model provides an in, can gather first image through the on-vehicle range finding identification equipment of installing on first vehicle, and determine the distance between second vehicle and the first vehicle, the second vehicle is located the place ahead of first vehicle, be the front truck of first vehicle, the AR glasses can obtain the first image that on-vehicle range finding identification equipment gathered and the distance of confirming, can superpose the distance in the first image and show by the display lens, the distance is as the quantitative feedback of real-time road conditions, superpose ground with first image and show in the display lens of AR glasses, can make the driver realize the ration understanding to real-time road conditions through AR glasses, so that and keep safe distance between the front truck, can improve the security of driving, avoid the emergence of rear-end collision accident.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without inventive exercise.

Fig. 1 is a block diagram showing a configuration of a vehicle driving assistance system according to an embodiment of the present invention;

fig. 2 is a block diagram showing a vehicle driving assistance system according to another embodiment of the present invention;

fig. 3 is a block diagram showing a configuration of a vehicle driving assistance system according to still another embodiment of the present invention;

fig. 4 is a schematic diagram of displaying a second image on the display lens according to an embodiment of the present invention;

fig. 5 is a schematic structural diagram of the vehicle-mounted distance measuring and identifying device according to an embodiment of the present invention mounted on a first vehicle;

fig. 6 is a block diagram showing a configuration of a vehicle driving assistance system according to still another embodiment of the present invention;

fig. 7 is a schematic structural diagram of AR glasses according to an embodiment of the present invention.

Description of reference numerals:

the vehicle-mounted ranging recognition apparatus 100; a camera 101; a distance measuring device 102; a first information transmission unit 103; AR glasses 200; a processor 201; display optics 202; a second information transmission unit 203; a prompting device 204; a frame 205; a second vehicle 300; a first vehicle 400.

Detailed Description

The technical solutions in the embodiments of the present invention will be described clearly and completely with reference to the accompanying drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only some embodiments of the present invention, not all embodiments. Based on the embodiments in the present invention, all other embodiments obtained by a person skilled in the art without creative work belong to the protection scope of the present invention.

The terms "first," "second," "third," "fourth," and the like in the description and in the claims, as well as in the drawings, if any, are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the invention described herein are capable of operation in sequences other than those illustrated or otherwise described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.

Some technical terms appearing in the present invention are explained below:

AR (Augmented Reality, abbreviation for Augmented Reality): the augmented reality technology is also called augmented reality, and is technical content for promoting integration of real world information and virtual world information content, wherein the method implements analog simulation processing on entity information which is difficult to experience in a space range of the real world originally on the basis of scientific technology such as computers, and effectively applies the virtual information content in the real world in an overlapping manner, and can be perceived by human senses in the process, so that the sensory experience beyond reality is realized. After the real environment and the virtual object are overlapped, the real environment and the virtual object can exist in the same picture and space at the same time. As a powerful representative of the field of augmented reality, AR glasses are receiving more and more attention, and the application field is gradually expanded.

Laser radar: the radar system is used for detecting the position, speed and other characteristic quantities of a target by emitting laser beams, and has the working principle that a detection signal (laser beam) is emitted to the target, then a received signal (target echo) reflected from the target is compared with the emission signal, and after appropriate processing is carried out, relevant information of the target, such as parameters of target distance, direction, height, speed, attitude, even shape and the like, can be obtained, so that the vehicle can be detected, tracked and identified. The laser radar has very accurate range finding ability, has the characteristics of high resolution, strong anti-interference ability, good low-altitude detection performance, small volume and light weight, and can be widely applied to automobiles to assist drivers to drive safely.

The technical solution of the present invention will be described in detail with specific examples. The following several specific embodiments may be combined with each other, and details of the same or similar concepts or processes may not be repeated in some embodiments.

The vehicle driving assist system according to the embodiment of the present invention can be understood with reference to fig. 1 to 7. In one embodiment, referring to fig. 1, the vehicle driving assistance system may include an in-vehicle ranging recognition apparatus 100 and AR glasses 200.

The in-vehicle ranging recognition apparatus 100 may be mounted to the first vehicle 400. When the in-vehicle distance measurement recognition apparatus 100 is mounted to the first vehicle 400, the first vehicle 400 is a vehicle to which the vehicle driving assistance system is applied. The on-board ranging identification device 100 may be powered by the first vehicle 400.

The in-vehicle ranging recognition apparatus 100 is used to acquire a first image of the second vehicle 300 located in front of the first vehicle 400 and to determine a distance between the second vehicle 300 and the first vehicle 400. For the first vehicle 400, the second vehicle 300 is the leading vehicle.

Preferably, referring to fig. 2, the in-vehicle ranging recognition apparatus 100 may include a camera 101 and a ranging device 102, the camera 101 being used to acquire a first image, and the ranging device 102 being used to measure a distance. In other words, the image capturing function and the distance determining function of the on-vehicle ranging recognition apparatus 100 are implemented by the camera 101 and the ranging device 102, respectively, the camera 101 being responsible for capturing a first image of the second vehicle 300 located in front of the first vehicle 400, and the ranging device 102 being responsible for determining the distance between the second vehicle 300 and the first vehicle 400. The distance is also the distance between the distance measuring device 102 and the second vehicle 300.

Optionally, the distance measuring device 102 is a laser radar. The laser radar may emit a laser beam toward the front of the first vehicle 400, compare the laser beam reflected from the front vehicle with the emitted laser beam, calculate the distance to the front vehicle (i.e., the second vehicle 300), and obtain the direction of the front vehicle at the same time. Of course, this is merely an example of the distance measuring device 102, and is not a limitation, and other devices that can achieve distance measurement are applicable.

During the driving of the first vehicle 400, the camera 101 may periodically capture the first image, and the distance measuring device 102 may periodically measure the distance, and the periods of the two may be the same or different, preferably the same, so that the first image and the distance may be updated synchronously. The period of the first image and the distance update can be short, and the real-time performance of the first image and the distance update is guaranteed.

After the camera 101 acquires the first image, the camera may further identify the second vehicle 300 in the first image by using a preset vehicle identification algorithm to obtain vehicle information of the second vehicle 300, where the vehicle information includes, for example, location information of the second vehicle 300, and the location information may specifically be location information of a license plate of the second vehicle 300 in the first image. The vehicle identification algorithm may be an existing algorithm, for example, an existing license plate identification algorithm, and a license plate is an object existing at the tail of all vehicles and is a common feature point, so that the calculation efficiency can be improved, and the method is not limited specifically.

It is understood that the above-mentioned implementation of the image acquisition function and the distance determination function of the vehicle-mounted distance measurement identification apparatus 100 by the camera 101 and the distance measurement device 102, respectively, is only a preferred way, and is not a limitation, and other ways are certainly possible.

For example, the in-vehicle ranging recognition apparatus 100 may include a binocular camera, which is implemented by the binocular camera. Specifically, the left eye camera and the right eye camera of the binocular camera may respectively perform image acquisition on the second vehicle 300 ahead to obtain a left eye image and a right eye image, and may use any one of the left eye image and the right eye image as the first image, and determine the distance between the second vehicle 300 and the first vehicle 400 through a preset binocular vision algorithm based on the left eye image and the right eye image, where the binocular vision algorithm may be an existing algorithm.

Referring to fig. 1 and 2, AR glasses 200 include at least a processor 201 and a display lens 202. The processor 201 is configured to obtain a first image and a distance and superimpose the distance onto the first image to obtain a second image. The display optics 202 are used to display a second image.

Optionally, referring to fig. 3, the vehicle-mounted ranging recognition apparatus 100 further includes a first information transmission unit 103; the AR glasses 200 further include a second information transmission unit 203, and the second information transmission unit 203 is connected to the first information transmission unit 103, and the connection may be a wired connection or a wireless connection. The first information transmission unit 103 is configured to send the first image and the distance to the second information transmission unit 203. The second information transmission unit 203 is configured to receive the first image and the distance sent by the first information transmission unit 103, and send the first image and the distance to the processor 201.

The first information transmission unit 103 and the second transmission unit may be connected by a data line or an internet of things, if the first information transmission unit 103 and the second transmission unit are connected by a data line, a type-c (a hardware interface form of a universal serial bus) universal interface may be used for the data line, and if the first information transmission unit 103 and the second transmission unit are connected by an internet of things, a WiFi (wireless local area network technology established in IEEE 802.11 standard) module may be used for wireless connection. Of course, this is by way of example only and not by way of limitation.

Referring to fig. 4, the camera 101 and the ranging device 102 in the in-vehicle ranging recognition apparatus 100 may be disposed at a head portion of the first vehicle 400, and the first information transmission unit 103 may be disposed at a window portion of the first vehicle 400 to be close to a driver's seat for facilitating communication with the second information transmission unit 203.

The processor 201 may superimpose the distance into the first image using augmented reality techniques, or the processor 201 may superimpose the distance into the first image using image superimposition techniques. Of course, the distance may be presented in the first image in the form of an image or text, or other forms, and is not limited in particular.

The second image is displayed on the display lens 202 of the AR glasses 200, so that the driver wearing the AR glasses 200 can see the second vehicle 300 ahead and the distance between the first vehicle 400 and the second vehicle 300 currently located, and thus the driver can conveniently judge whether the safe distance between the first vehicle 400 and the second vehicle 300 currently exists, which is beneficial to ensuring safe driving of the driver.

Preferably, the display optic 202 is a transparent waveguide optic. The display lens 202 is made of transparent material, and does not affect the observation of the driving environment. Of course, the method is not particularly limited.

In the above embodiment, the first image may be acquired by the vehicle-mounted distance measurement recognition device 100 mounted on the first vehicle 400, and the distance between the second vehicle 300 and the first vehicle 400 is determined, the second vehicle 300 is located in front of the first vehicle 400 and is in front of the first vehicle 400, the AR glasses 200 may obtain the first image acquired by the vehicle-mounted distance measurement recognition device 100 and the determined distance, the distance may be superimposed on the first image and displayed by the display lens 202, and the distance is displayed in the display lens 202 of the AR glasses 200 as a quantitative feedback of the real-time road condition, and is displayed in a manner of being superimposed on the first image, so that the driver can realize quantitative understanding of the real-time road condition through the AR glasses 200, so as to keep a safe distance with the front vehicle, thereby improving driving safety and avoiding the occurrence of rear-end collision accidents.

In addition, compared with the method that the second image is projected onto the front windshield of the vehicle through the vehicle-mounted head-up display device, the second image is displayed through the display lens 202 of the AR glasses 200, the windshield does not need to be changed greatly, meanwhile, the second image can follow the movement of the head of the driver, and the display is more visual and sufficient.

In one embodiment, the in-vehicle ranging recognition device 100 is further used to determine the location information of the second vehicle 300 in the first image. The vehicle identification function of the camera 101 may be used to determine, specifically, the position information of the license plate of the second vehicle 300 in the first image,

the distance is superimposed on a specified position of the first image, the specified position being determined in accordance with the position information. Optionally, the designated location is the rear of the second vehicle 300. For example, referring to fig. 5, the second image displayed on the display lens 202 shows the second vehicle 300 and the distance D1, where the distance D1 is 50m and the distance is superimposed on the rear end position of the second vehicle 300. Of course, this is preferred and not limiting.

In one embodiment, referring to fig. 6, the AR glasses 200 further comprise a prompting device 204, the prompting device 204 being used to prompt the range in which the distance is located. The prompting device 204 may prompt when the distance is within a specified range, or the prompting device 204 may prompt differently when the distance is within a different range. For example, when the distance is 0 to 50 meters (specified range), the presentation device 204 presents the information, and when the distance is 50 meters or more, the presentation device 204 does not present the information.

In this embodiment, the prompting device 204 prompts the range of the distance, so that the driver can notice the real condition of the distance in time, and adjust the driving speed in time when the distance is short.

Optionally, the prompting device 204 may include:

and/or the presence of a gas in the gas,

Optionally, the first range is smaller than or equal to a first set distance and larger than a second set distance, and the second set distance is smaller than the first set distance; the second range is less than or equal to a second set distance.

For example, the second set distance may be a minimum safe distance corresponding to the current vehicle speed of the first vehicle 400, and may be determined according to the current vehicle speed, such as: the vehicle speed of 40 km is maintained at least 40 m, and the vehicle speed of 60 km is maintained at least 60 m. The first set distance may be a value greater than the second set distance, for example, when the second set distance is 40 meters, the first set distance may be 60 meters. Of course, the specific distance is not limited and can be determined according to actual situations.

In a preferred mode, the prompting device 204 may include an image prompting device, a sound prompting device, and a vibration prompting device, which may cooperate to implement the prompting, and the specific prompting mode may be as follows (1):

watch (1)

In the above table (1), when the distance between the second vehicle 300 and the first vehicle 400 is greater than the first set distance, no prompt is required, and the distance between the vehicles is safe at this time; when the distance between the second vehicle 300 and the first vehicle 400 is smaller than or equal to the first set distance and larger than the second set distance, only the image prompting device gives a prompt, which indicates that the distance between the vehicles approaches the minimum safe distance and gives a smaller prompt; when the distance between the second vehicle 300 and the first vehicle 400 is smaller than the second set distance, the image prompt device, the sound prompt device and the vibration prompt device prompt together, at the moment, the distance between the vehicles is less than the minimum safe distance, and a violent prompt is made to prompt the driver to brake urgently or avoid or decelerate.

Optionally, when the image prompting device sets a mark in the image for prompting, the distance text in the second image may be changed in color, for example, changed to red, or the size of the distance text may be adjusted. In the case where the distance is less than or equal to the first set distance, the closer the distance, the larger the distance characters may be controlled to be displayed.

Alternatively, the audible prompting device may be a speaker, for example, which may emit a "drip" sound. In the case where the distance is less than or equal to the second set distance, the closer the distance is, the greater the sound of "dripping" emitted by the control horn is.

Alternatively, the vibration prompting device may be a vibration motor. Under the condition that the distance is smaller than or equal to the second set distance, the closer the distance is, the stronger the vibration of the vibration prompting device is controlled, and the vibration strength of the vibration motor can be adjusted by controlling the current.

The image presentation device, the sound presentation device, and the vibration presentation device described above may be controlled by the processor 201 of the AR glasses 200 to perform presentation.

It is understood that the prompting device 204/manner is not limited to the above-mentioned ones, and other prompting devices 204/manners are also possible.

Fig. 7 shows an AR glasses 200 according to an embodiment of the present invention, which mainly comprises a frame 205 and a display lens 202, wherein the display lens 202 is installed in the frame 205, and the additional processor 201, the second information transmission unit 203 and the prompting device 204 can also be installed on the frame 205.

Finally, it should be noted that: the above embodiments are only used to illustrate the technical solution of the present invention, and not to limit the same; although the present invention has been described in detail with reference to the foregoing embodiments, it should be understood by those skilled in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; such modifications and substitutions do not depart from the spirit and scope of the present invention.

Claims

1. A vehicle driving assist system characterized by comprising: vehicle-mounted distance measurement identification equipment and AR glasses;

the AR glasses include at least a processor and a display lens; the processor is used for obtaining the first image and the distance and superposing the distance to the first image to obtain a second image; the display lens is used for displaying the second image;

the AR glasses further comprise a prompting device, and the prompting device is used for prompting the range of the distance.

2. The vehicular drive assist system according to claim 1, characterized in that the vehicular range finding identifying apparatus includes a camera and a range finding device;

the camera is used for acquiring the first image;

the distance measuring device is used for measuring the distance.

3. The vehicle driving assist system recited in claim 2, wherein the distance measuring device is a laser radar.

4. The vehicular drive assist system according to claim 1, characterized in that the vehicular ranging identifying apparatus includes a first information transmitting unit;

5. The vehicle driving assist system recited in claim 1, wherein the in-vehicle range finding recognition device is further configured to determine location information of the second vehicle in the first image;

6. The vehicle driving assist system recited in claim 5, wherein the designated location is a tail of the second vehicle.

7. The vehicular drive assist system according to claim 1, characterized in that the prompt means includes:

and/or the presence of a gas in the gas,

8. The vehicular drive assist system according to claim 7,

the second range is smaller than or equal to the second set distance.

9. The vehicular drive assist system according to claim 1,

the display lens is a transparent waveguide lens.