CN113247015A - Vehicle driving auxiliary system based on somatosensory operation integrated glasses and method thereof - Google Patents
Vehicle driving auxiliary system based on somatosensory operation integrated glasses and method thereof Download PDFInfo
- Publication number
- CN113247015A CN113247015A CN202110742469.2A CN202110742469A CN113247015A CN 113247015 A CN113247015 A CN 113247015A CN 202110742469 A CN202110742469 A CN 202110742469A CN 113247015 A CN113247015 A CN 113247015A
- Authority
- CN
- China
- Prior art keywords
- vehicle
- distance
- glasses
- module
- road surface
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 239000011521 glass Substances 0.000 title claims abstract description 59
- 238000000034 method Methods 0.000 title claims abstract description 19
- 230000003238 somatosensory effect Effects 0.000 title claims abstract description 12
- 238000004458 analytical method Methods 0.000 claims abstract description 39
- 230000000007 visual effect Effects 0.000 claims abstract description 30
- 238000004891 communication Methods 0.000 claims abstract description 23
- 238000001514 detection method Methods 0.000 claims description 28
- 238000012634 optical imaging Methods 0.000 claims description 13
- 238000004364 calculation method Methods 0.000 claims description 9
- 238000011179 visual inspection Methods 0.000 claims description 8
- 238000005259 measurement Methods 0.000 claims description 5
- 239000000284 extract Substances 0.000 claims description 4
- 230000014509 gene expression Effects 0.000 claims description 3
- 230000008447 perception Effects 0.000 abstract description 4
- 210000003128 head Anatomy 0.000 description 6
- 230000009286 beneficial effect Effects 0.000 description 3
- 239000004984 smart glass Substances 0.000 description 3
- 206010011469 Crying Diseases 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 238000010205 computational analysis Methods 0.000 description 2
- 238000010276 construction Methods 0.000 description 2
- 230000004044 response Effects 0.000 description 2
- 206010039203 Road traffic accident Diseases 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W50/08—Interaction between the driver and the control system
- B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
- B60W40/10—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to vehicle motion
- B60W40/105—Speed
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W50/08—Interaction between the driver and the control system
- B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
- B60W2050/146—Display means
Landscapes
- Engineering & Computer Science (AREA)
- Automation & Control Theory (AREA)
- Transportation (AREA)
- Mechanical Engineering (AREA)
- Physics & Mathematics (AREA)
- Mathematical Physics (AREA)
- Human Computer Interaction (AREA)
- Traffic Control Systems (AREA)
Abstract
The invention discloses a vehicle driving auxiliary system based on somatosensory operation integrated glasses and a method thereof, belonging to the technical field of intelligent wearing; the basic concept of the invention is to use eyes as a display terminal, build a vehicle surrounding environment perception and analysis module and a vehicle, transmit a vehicle-mounted analysis result to glasses through wireless communication, and realize an auxiliary mode of 'light AR prompt' by using the display module of the glasses; the traditional auxiliary driving mainly utilizes a vehicle central control display screen, and the mode has certain disadvantages of dispersing the attention of a driver, easily causing the phenomena that the driver does not respond to the dangerous situation, or is in a 'surprise' state and has no way to see the hands or feet, or has time lost due to judgment error and the like; the invention integrates the driving auxiliary prompt into the glasses, and the light AR prompt can not disperse the attention of the driver and can not shield the visual field of the driver during driving, thereby effectively assisting the driver in driving safely.
Description
Technical Field
The invention belongs to the technical field of intelligent wearing, and particularly relates to a vehicle driving assisting system and method based on somatosensory operation integrated glasses.
Background
The driving auxiliary system of the automobile is a system for assisting the driving of the automobile and comprises a lane keeping auxiliary system, an automatic parking auxiliary system, a brake auxiliary system, a backing auxiliary system and a driving auxiliary system. And the auxiliary driving mode is started, so that the passing performance of the automobile can be improved. The auxiliary driving system is one of automobile driving systems which are started in recent years, and can combine a plurality of systems to work together, thereby improving the safety and stability of automobile driving, improving the accuracy of automatic automobile backing and the like, reducing the phenomenon of automobile accidents, improving the driving pleasure of automobile drivers, and reducing the complexity and fatigue of driving. However, the traditional auxiliary driving mainly utilizes a vehicle central control display screen, and the mode has certain disadvantages that the attention of a driver is dispersed, so that the driver is easy to have no response to the dangerous situation, or the driver is in a 'surprise' state and has no way to feel something, or the phenomena of time losing due to judgment errors and the like are easily caused;
the smart glasses, also called smart glasses, are "provided with an independent operating system like a smart phone, and the smart glasses can be installed with programs provided by software service providers such as software, games and the like by users. The intelligent glasses can complete functions of adding schedules, map navigation, interacting with friends, taking photos and videos, performing video calls with friends and the like through voice or action control, and can realize the general name of the glasses with wireless network access through a mobile communication network. The intelligent glasses are used for providing driving assistance for the driver, and the driver is effectively assisted in safe driving by using the light AR prompt, so that the attention of the driver is not dispersed, and the visual field of the driver during driving is not shielded; therefore, there is a need to develop a vehicle driving assistance system and method based on motion sensing operation integrated glasses.
Disclosure of Invention
Technical problem to be solved
(1) Driving assistance is provided for a driver by using intelligent glasses;
(2) the problem that the attention of a driver is easily dispersed in the traditional auxiliary driving is solved.
(II) technical scheme
The invention is realized by the following technical scheme: a vehicle driving auxiliary system and method based on somatosensory operation integrated glasses comprises a vision module, a mobile wireless communication module, an auxiliary analysis module and a display module;
the vision module: the system is used for acquiring vehicle characteristics and road surface indication mark characteristics of the front side, the left side and the right side;
the mobile wireless communication module: the communication between the glasses and the vehicle is constructed;
the auxiliary analysis module: the vehicle characteristic analysis module is used for analyzing the vehicle characteristics acquired by the vision module;
the glasses display module: for displaying the characteristic analyzed vehicle data.
As a further explanation of the above solution, the analyzing the vehicle information collected by the vision module by the auxiliary analysis module includes: vehicle distance, vehicle speed, road sign distance.
As a further explanation of the above scheme, the information analyzed by the auxiliary analysis module is transmitted to the glasses display module through the mobile wireless communication module.
As a further explanation of the above scheme, the vision module is mounted around the vehicle chassis, and specifically includes a laser radar sensor, an infrared sensor, and an optical imaging sensor.
The invention also provides a vehicle driving auxiliary method based on the somatosensory operation integrated glasses, which comprises the following steps:
visual inspection: the visual detection module extracts and collects vehicle characteristics of the front side, the left side and the right side and road surface indication mark characteristics;
calculating, analyzing and judging: the auxiliary analysis module calculates the distance and the speed of the front vehicle according to the license plate characteristics of the front vehicle;
calculating the distance from the left and right vehicles to the current vehicle and the vehicle speed according to the characteristics of the wheels on the left and right sides;
calculating the distance from the current vehicle to the road surface indication mark according to the road surface indication mark characteristics;
and (3) feedback: and transmitting the vehicle distance and the vehicle speed which are analyzed in real time to a glasses display module through a mobile wireless communication module and carrying out corresponding prompt.
As a further explanation of the above scheme, the plate feature of the front vehicle is extracted in the visual detection, specifically, a laser radar sensor is used for capturing a front vehicle target, and the front vehicle target and the optical imaging sensor are fused to construct a first identification feature; when the first identification feature cannot be identified, the infrared sensor is used for shooting the distance between the front vehicle and the vehicle, and the distance and the information of the optical imaging sensor are fused to construct a second identification feature.
As a further explanation of the above scheme, the vehicle features on the left and right sides are extracted in the visual detection, and specifically, the infrared sensor or the laser radar is used for extracting and constructing the parallel recognition features; and extracting road surface indication mark characteristics in the visual detection, extracting road surface identification point cloud information through a laser radar sensor, and specifically taking the color edge of one side of the road surface indication mark, which is close to the current vehicle, as a measurement and calculation starting point.
As a further explanation of the above solution, the calculating, analyzing and judging specifically calculates the vehicle speed and the distance between the vehicles in front when the first identification feature or the second identification feature is identified in the visual inspection; when the parallel recognition features in the visual detection are recognized, analyzing and calculating the distance between the vehicles on two sides and the current vehicle and the vehicle speed; and when the point cloud information of the road surface mark in the visual detection is identified, analyzing and calculating the distance from the road surface mark to the current vehicle.
As a further explanation of the above scheme, the feedback prompt specifically presents three expressions in the display module:
1) vehicle: highlighting or constructing an outer frame according to the shape of the vehicle;
2) speed, distance and prompt: displaying on the glasses display module: S/D/indicator symbol; wherein S represents vehicle speed; d represents the vehicle distance; the indicator symbol represents whether the current vehicle speed or the current vehicle distance is safe.
As a further explanation of the above scheme, in the feedback, when the head turns to the left or right side, only the left or right side prompt message is displayed, and the front side prompt message is not displayed; when the head is forward, only the front information is displayed, and the left and right information is not displayed.
(III) advantageous effects
Compared with the prior art, the invention has the following beneficial effects: the basic concept of the invention is to use eyes as a display terminal, build a vehicle surrounding environment perception and analysis module and a vehicle, transmit a vehicle-mounted analysis result to glasses through wireless communication, and realize an auxiliary mode of 'light AR prompt' by using the display module of the glasses; the traditional auxiliary driving mainly utilizes a vehicle central control display screen, and the mode has certain disadvantages of dispersing the attention of a driver, easily causing the phenomena that the driver does not respond to the dangerous situation, or is in a 'surprise' state and has no way to see the hands or feet, or has time lost due to judgment error and the like; the invention integrates the driving auxiliary prompt into the glasses, and the light AR prompt can not disperse the attention of the driver and can not shield the visual field of the driver during driving, thereby effectively assisting the driver in driving safely.
Drawings
Other features, objects and advantages of the invention will become more apparent upon reading of the detailed description of non-limiting embodiments with reference to the following drawings:
FIG. 1 is a diagram illustrating the detection of angles by the vision module in the system of the present invention;
FIG. 2 is a left side view of a driver in an embodiment of the present invention;
FIG. 3 is a left side view feedback image when a driver wears glasses according to an embodiment of the present disclosure;
FIG. 4 is a front side view of a driver in an embodiment of the present invention;
FIG. 5 is a front side view feedback image of a driver wearing glasses according to an embodiment of the present invention;
FIG. 6 is a front side view of a driver in an embodiment of the present invention;
FIG. 7 is a front side view feedback image of a driver wearing glasses according to an embodiment of the present invention;
FIG. 8 is a first view of the steps of visual inspection and computational analysis determination in accordance with an embodiment of the present invention;
FIG. 9 is a first view of the steps of visual inspection and computational analysis determination in accordance with an embodiment of the present invention;
in the figure: the vehicle identification system comprises a vehicle identification system, a road surface indicating mark and a road surface indicating mark, wherein the vehicle identification system comprises a current vehicle, a vehicle identification system, a vehicle distance identification system and a vehicle distance identification system, the vehicle distance identification system comprises a vehicle distance identification system, a vehicle speed identification system and a road surface indicating mark, the vehicle distance identification system comprises a vehicle distance identification system, a vehicle distance identification system and a vehicle speed identification system, the vehicle distance identification system comprises a vehicle distance identification system, a vehicle distance identification system and a vehicle distance identification system, the vehicle distance identification system comprises a vehicle distance identification system, a vehicle distance identification system and a road surface indicating mark.
Detailed Description
A vehicle driving auxiliary system and method based on somatosensory operation integrated glasses comprises a vision module, a mobile wireless communication module, an auxiliary analysis module and a display module;
the vision module: the system is used for acquiring vehicle characteristics and road surface indication mark characteristics of the front side, the left side and the right side;
the mobile wireless communication module: the communication between the glasses and the vehicle is constructed;
the auxiliary analysis module: the vehicle characteristic analysis module is used for analyzing the vehicle characteristics acquired by the vision module;
the glasses display module: for displaying the characteristic analyzed vehicle data.
Wherein, the auxiliary analysis module analyzes the vehicle information collected by the vision module and comprises: vehicle distance, vehicle speed, road sign distance.
The information analyzed by the auxiliary analysis module is transmitted to the glasses display module through the mobile wireless communication module.
The vision module is mounted on the periphery of a vehicle chassis and specifically comprises a laser radar sensor, an infrared sensor and an optical imaging sensor.
The invention also provides a vehicle driving auxiliary method based on the somatosensory operation integrated glasses, which comprises the following steps:
visual inspection: the visual detection module extracts and collects vehicle characteristics of the front side, the left side and the right side and road surface indication mark characteristics;
calculating, analyzing and judging: the auxiliary analysis module calculates the distance and the speed of the front vehicle according to the license plate characteristics of the front vehicle;
calculating the distance from the left and right vehicles to the current vehicle and the vehicle speed according to the characteristics of the wheels on the left and right sides;
calculating the distance from the current vehicle to the road surface indication mark according to the road surface indication mark characteristics;
and (3) feedback: and transmitting the vehicle distance and the vehicle speed which are analyzed in real time to a glasses display module through a mobile wireless communication module and carrying out corresponding prompt.
The method comprises the steps that a vehicle license plate feature of a front vehicle is extracted in the visual detection, a front vehicle target is shot by a laser radar sensor, and the front vehicle target and an optical imaging sensor are fused to construct a first identification feature; when the first identification feature cannot be identified, the infrared sensor is used for shooting the distance between the front vehicle and the vehicle, and the distance and the information of the optical imaging sensor are fused to construct a second identification feature.
Specifically, the vehicle features on the left side and the right side are extracted in the visual detection, and the parallel recognition features are extracted and constructed by using an infrared sensor or a laser radar; and extracting road surface indication mark characteristics in the visual detection, extracting road surface identification point cloud information through a laser radar sensor, and specifically taking the color edge of one side of the road surface indication mark, which is close to the current vehicle, as a measurement and calculation starting point.
Wherein, the calculation, analysis and judgment specifically analyze and calculate the automobile speed and the front automobile distance when the first identification feature or the second identification feature is identified in the visual detection; when the parallel recognition features in the visual detection are recognized, analyzing and calculating the distance between the vehicles on two sides and the current vehicle and the vehicle speed; and when the point cloud information of the road surface mark in the visual detection is identified, analyzing and calculating the distance from the road surface mark to the current vehicle.
Wherein the feedback prompt specifically presents three expression forms in the display module:
1) vehicle: highlighting or constructing an outer frame according to the shape of the vehicle;
2) speed, distance and prompt: displaying on the glasses display module: S/D/indicator symbol; wherein S represents vehicle speed; d represents the vehicle distance; the indicator symbol represents whether the current vehicle speed or the current vehicle distance is safe.
When the head turns to the left side or the right side during feedback, only left side or right side prompt information is displayed, and front side prompt information is not displayed; when the head is forward, only the front information is displayed, and the left and right information is not displayed.
The working principle is as follows:
examples
The vehicle driving auxiliary system for the somatosensory operation integrated glasses comprises a vision module, a mobile wireless communication module, an auxiliary analysis module and a display module; the basic concept is that eyes are used as a display terminal, a vehicle surrounding environment perception and analysis module is built in a vehicle, a vehicle-mounted analysis result is transmitted to glasses through wireless communication, and a display module of the glasses is used for realizing an auxiliary mode of 'light AR prompt'; as shown in fig. 1, the vision module in the system: the system is used for acquiring vehicle characteristics and road surface indication mark characteristics of the front side, the left side and the right side; the mobile wireless communication module: the communication between the glasses and the vehicle is constructed; the auxiliary analysis module: the vehicle characteristic analysis module is used for analyzing the vehicle characteristics acquired by the vision module; the glasses display module: for displaying the characteristic analyzed vehicle data. The vision module is arranged around a vehicle chassis in a carrying way and specifically comprises a laser radar sensor, an infrared sensor and an optical imaging sensor; the construction of the vision module requires that the vision equipment has image extraction capability, space distance measurement and calculation capability and point cloud calculation and analysis capability; the auxiliary analysis module for analyzing the vehicle information collected by the vision module comprises: vehicle distance, vehicle speed, road sign distance.
The vehicle driving assistance method based on the assistance system is realized by adopting the following steps:
1) visual inspection: the visual detection module extracts and collects vehicle characteristics of the front side, the left side and the right side and road surface indication mark characteristics; extracting the license plate characteristics of the front vehicle in the visual detection, specifically, shooting a front vehicle target by using a laser radar sensor, and fusing the front vehicle target with the information of an optical imaging sensor to construct a first identification characteristic; when the first identification feature cannot be identified, the infrared sensor is used for shooting the distance between the front vehicle and the vehicle, and the distance and the information of the optical imaging sensor are fused to construct a second identification feature; the license plate is the only identification mark code of the vehicle, and is used as the identification feature, which is beneficial to rapid construction and analysis, and the information fusion by using the laser radar sensor and the optical imaging sensor is beneficial to the establishment of the prompting part for transmitting the information to the rear display module of the glasses; extracting vehicle characteristics on the left side and the right side in the visual detection, specifically extracting and constructing parallel identification characteristics by using an infrared sensor or a laser radar; extracting road surface indication mark characteristics in the visual detection, extracting road surface identification point cloud information through a laser radar sensor, and particularly taking the color edge of one side, close to the current vehicle, of the road surface indication mark as a measurement and calculation starting point; the left and right side areas calculate and analyze the speed and the distance, the distance between the left and right sides is extracted as an analysis result, the distance between the vehicle and the left and right sides of the vehicle or the object is emphasized to be kept at a certain distance, and the feedback of the response is given to a user;
2) as shown in fig. 2, 4, and 6, the calculation analysis determines: the auxiliary analysis module calculates the distance and the speed of the front vehicle according to the license plate characteristics of the front vehicle; calculating the distance from the left and right vehicles to the current vehicle and the vehicle speed according to the characteristics of the wheels on the left and right sides; calculating the distance from the current vehicle to the road surface indication mark according to the road surface indication mark characteristics; feedback is carried out after analysis and judgment;
3) as shown in fig. 3, 5, and 7, feedback: and transmitting the vehicle distance and the vehicle speed which are analyzed in real time to a glasses display module through a mobile wireless communication module and carrying out corresponding prompt. FIG. 3 shows that vehicle information is detected from a left side view angle of a driver, FIG. 5 shows that vehicle information is detected from a front side view angle of the driver, FIG. 7 shows that a road surface indication mark characteristic is detected from the front side view angle of the driver, a detection result is obtained according to different information analysis, and vehicle speed, a vehicle outer frame and indication information are displayed through a glasses display module; the specific feedback prompts present three kinds of prompt information in the display module:
1) vehicle: highlighting or constructing an outer frame according to the shape of the vehicle;
2) speed, distance and prompt: displaying on the glasses display module: S/D/indicator symbol;
wherein S represents vehicle speed; d represents the vehicle distance; the indication symbol represents whether the current vehicle speed or the current vehicle distance is safe or not; wherein the indication information adopted in the embodiment is prompted by two symbols of 'smiling face' and 'crying face', and when the vehicle speed or the vehicle distance is in a safe range, the 'smiling face' is displayed; when the vehicle speed or the vehicle distance is not in a safe range, displaying a crying face; when the head turns to the left side or the right side during feedback, only the left side or the right side prompt information is displayed, and the front side prompt information is not displayed; when the head is forward, only the front information is displayed, and the left and right information is not displayed. The influence on the driving of a driver caused by the disordered display of the side information and the front information is avoided;
as shown in fig. 8 and 9, specifically, when the first identification feature or the second identification feature is identified in the visual inspection, the vehicle speed S and the front vehicle distance D are analyzed and calculated; when the parallel recognition features in the visual detection are recognized, analyzing and calculating the distance D between the vehicles on two sides and the current vehicle and the vehicle speed S; when the point cloud information of the road surface mark in the visual detection is identified, analyzing and calculating the distance D from the road surface mark to the current vehicle; meanwhile, when the first identification feature and the parallel identification feature or the second identification feature and the parallel identification feature are identified, the lane change of the front vehicle is represented, and the lane change vehicle speed S and the shortest distance D between the first identification feature and the parallel identification feature or between the second identification feature and the parallel identification feature identified by the vehicle are analyzed and calculated; and when the road surface indicating identification characteristics are detected, calculating the distance D by using the point cloud information.
The invention is characterized in that: the basic concept of the invention is to use eyes as a display terminal, build a vehicle surrounding environment perception and analysis module and a vehicle, transmit a vehicle-mounted analysis result to glasses through wireless communication, and realize an auxiliary mode of 'light AR prompt' by using the display module of the glasses; the traditional auxiliary driving mainly utilizes a vehicle central control display screen, and the mode has certain disadvantages of dispersing the attention of a driver, easily causing the phenomena that the driver does not respond to the dangerous situation, or is in a 'surprise' state and has no way to see the hands or feet, or has time lost due to judgment error and the like; the invention integrates the driving auxiliary prompt into the glasses, and the light AR prompt can not disperse the attention of the driver and can not shield the visual field of the driver during driving, thereby effectively assisting the driver in driving safely.
While there have been shown and described what are at present considered the fundamental principles and essential features of the invention and its advantages, it will be apparent to those skilled in the art that the invention is not limited to the details of the foregoing exemplary embodiments, but is capable of other specific forms without departing from the spirit or essential characteristics thereof. The present embodiments are therefore to be considered in all respects as illustrative and not restrictive, the scope of the invention being indicated by the appended claims rather than by the foregoing description, and all changes which come within the meaning and range of equivalency of the claims are therefore intended to be embraced therein.
Furthermore, it should be understood that although the present description refers to embodiments, not every embodiment may contain only a single embodiment, and such description is for clarity only, and those skilled in the art should integrate the description, and the embodiments may be combined as appropriate to form other embodiments understood by those skilled in the art.
Claims (10)
1. A vehicle driving auxiliary system based on somatosensory operation integrated glasses comprises a vision module, a mobile wireless communication module, an auxiliary analysis module and a display module; the method is characterized in that:
the vision module: the system is used for acquiring vehicle characteristics and road surface indication mark characteristics of the front side, the left side and the right side;
the mobile wireless communication module: the communication between the glasses and the vehicle is constructed;
the auxiliary analysis module: the vehicle characteristic analysis module is used for analyzing the vehicle characteristics acquired by the vision module;
the glasses display module: for displaying the characteristic analyzed vehicle data.
2. The vehicle driving assistance system of the motion-sensing-operation-based integrated glasses according to claim 1, characterized in that: the auxiliary analysis module analyzing the vehicle information collected by the vision module comprises: vehicle distance, vehicle speed, road sign distance.
3. The vehicle driving assistance system of the motion-sensing-operation-based integrated glasses according to claim 1, characterized in that: and the information analyzed by the auxiliary analysis module is transmitted to the glasses display module through the mobile wireless communication module.
4. The vehicle driving assistance system of the motion-sensing-operation-based integrated glasses according to claim 1, characterized in that: the vision module is mounted on the periphery of the vehicle chassis and specifically comprises a laser radar sensor, an infrared sensor and an optical imaging sensor.
5. A vehicle driving assistance method based on somatosensory operation integrated glasses is characterized in that: the method comprises the following steps:
visual inspection: the visual detection module extracts and collects vehicle characteristics of the front side, the left side and the right side and road surface indication mark characteristics;
calculating, analyzing and judging: the auxiliary analysis module calculates the distance and the speed of the front vehicle according to the license plate characteristics of the front vehicle;
calculating the distance from the left and right vehicles to the current vehicle and the vehicle speed according to the characteristics of the wheels on the left and right sides;
calculating the distance from the current vehicle to the road surface indication mark according to the road surface indication mark characteristics;
and (3) feedback: and transmitting the vehicle distance and the vehicle speed which are analyzed in real time to a glasses display module through a mobile wireless communication module and carrying out corresponding prompt.
6. The vehicle driving assistance method of the motion-sensing-operation-based integrated glasses according to claim 5, characterized in that: extracting the license plate characteristics of the front vehicle in the visual detection, specifically, shooting a front vehicle target by using a laser radar sensor, and fusing the front vehicle target with the information of an optical imaging sensor to construct a first identification characteristic; when the first identification feature cannot be identified, the infrared sensor is used for shooting the distance between the front vehicle and the vehicle, and the distance and the information of the optical imaging sensor are fused to construct a second identification feature.
7. The vehicle driving assistance method of the motion-sensing-operation-based integrated glasses according to claim 5, characterized in that: extracting vehicle characteristics on the left side and the right side in the visual detection, specifically extracting and constructing parallel identification characteristics by using an infrared sensor or a laser radar; and extracting road surface indication mark characteristics in the visual detection, extracting road surface identification point cloud information through a laser radar sensor, and specifically taking the color edge of one side of the road surface indication mark, which is close to the current vehicle, as a measurement and calculation starting point.
8. The vehicle driving support method of operating the integrated glasses based on the somatosensory operation according to any one of claims 5 to 7, characterized in that: the calculation, analysis and judgment specifically analyzes and calculates the automobile speed and the front automobile distance when the first identification feature or the second identification feature is identified in the visual detection; when the parallel recognition features in the visual detection are recognized, analyzing and calculating the distance between the vehicles on two sides and the current vehicle and the vehicle speed; and when the point cloud information of the road surface mark in the visual detection is identified, analyzing and calculating the distance from the road surface mark to the current vehicle.
9. The vehicle driving assistance method of the motion-sensing-operation-based integrated glasses according to claim 5, characterized in that: the feedback prompt specifically presents three expression forms in the display module:
1) vehicle: highlighting or constructing an outer frame according to the shape of the vehicle;
2) speed, distance and prompt: displaying on the glasses display module: S/D/indicator symbol; wherein S represents vehicle speed; d represents the vehicle distance; the indicator symbol represents whether the current vehicle speed or the current vehicle distance is safe.
10. The vehicle driving assistance method of the motion-sensing-operation-based integrated glasses according to claim 5, characterized in that: specifically, during feedback, when the head turns to the left side or the right side, only the left side or the right side prompt information is displayed, and the front side prompt information is not displayed; when the head is forward, only the front information is displayed, and the left and right information is not displayed.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110742469.2A CN113247015A (en) | 2021-06-30 | 2021-06-30 | Vehicle driving auxiliary system based on somatosensory operation integrated glasses and method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110742469.2A CN113247015A (en) | 2021-06-30 | 2021-06-30 | Vehicle driving auxiliary system based on somatosensory operation integrated glasses and method thereof |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113247015A true CN113247015A (en) | 2021-08-13 |
Family
ID=77190289
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110742469.2A Pending CN113247015A (en) | 2021-06-30 | 2021-06-30 | Vehicle driving auxiliary system based on somatosensory operation integrated glasses and method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113247015A (en) |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN203228734U (en) * | 2013-04-17 | 2013-10-09 | 山东科技大学 | Intelligent active safety forewarning system of automobile |
| CN104485008A (en) * | 2014-12-04 | 2015-04-01 | 上海交通大学 | Head-wearing type auxiliary driving system aiming at achromate |
| CN107449440A (en) * | 2016-06-01 | 2017-12-08 | 北京三星通信技术研究有限公司 | The display methods and display device for prompt message of driving a vehicle |
| CN207523550U (en) * | 2017-10-09 | 2018-06-22 | 周永业 | Front truck driving information head-up-display system |
| CN109087485A (en) * | 2018-08-30 | 2018-12-25 | Oppo广东移动通信有限公司 | Assisting automobile driver method, apparatus, intelligent glasses and storage medium |
| CN109427199A (en) * | 2017-08-24 | 2019-03-05 | 北京三星通信技术研究有限公司 | For assisting the method and device of the augmented reality driven |
| CN110007752A (en) * | 2018-01-04 | 2019-07-12 | 优特诺股份有限公司 | The connection of augmented reality vehicle interfaces |
| CN110316067A (en) * | 2018-03-30 | 2019-10-11 | 深圳市掌网科技股份有限公司 | A kind of vehicle DAS (Driver Assistant System) and method |
| US20200324787A1 (en) * | 2018-10-25 | 2020-10-15 | Samsung Electronics Co., Ltd. | Augmented reality method and apparatus for driving assistance |
| CN112180605A (en) * | 2020-10-20 | 2021-01-05 | 江苏濠汉信息技术有限公司 | Auxiliary driving system based on augmented reality |
-
2021
- 2021-06-30 CN CN202110742469.2A patent/CN113247015A/en active Pending
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN203228734U (en) * | 2013-04-17 | 2013-10-09 | 山东科技大学 | Intelligent active safety forewarning system of automobile |
| CN104485008A (en) * | 2014-12-04 | 2015-04-01 | 上海交通大学 | Head-wearing type auxiliary driving system aiming at achromate |
| CN107449440A (en) * | 2016-06-01 | 2017-12-08 | 北京三星通信技术研究有限公司 | The display methods and display device for prompt message of driving a vehicle |
| CN109427199A (en) * | 2017-08-24 | 2019-03-05 | 北京三星通信技术研究有限公司 | For assisting the method and device of the augmented reality driven |
| CN207523550U (en) * | 2017-10-09 | 2018-06-22 | 周永业 | Front truck driving information head-up-display system |
| CN110007752A (en) * | 2018-01-04 | 2019-07-12 | 优特诺股份有限公司 | The connection of augmented reality vehicle interfaces |
| CN110316067A (en) * | 2018-03-30 | 2019-10-11 | 深圳市掌网科技股份有限公司 | A kind of vehicle DAS (Driver Assistant System) and method |
| CN109087485A (en) * | 2018-08-30 | 2018-12-25 | Oppo广东移动通信有限公司 | Assisting automobile driver method, apparatus, intelligent glasses and storage medium |
| US20200324787A1 (en) * | 2018-10-25 | 2020-10-15 | Samsung Electronics Co., Ltd. | Augmented reality method and apparatus for driving assistance |
| CN112180605A (en) * | 2020-10-20 | 2021-01-05 | 江苏濠汉信息技术有限公司 | Auxiliary driving system based on augmented reality |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20210357670A1 (en) | Driver Attention Detection Method | |
| CN112965504B (en) | Remote confirmation method, device and equipment based on automatic driving and storage medium | |
| US9723243B2 (en) | User interface method for terminal for vehicle and apparatus thereof | |
| CN103732480B (en) | Method and device for assisting a driver in performing lateral guidance of a vehicle on a carriageway | |
| EP1961622B1 (en) | Safety-travel assistance device | |
| JP2022520544A (en) | Vehicle intelligent driving control methods and devices, electronic devices and storage media | |
| JP2006350617A (en) | Vehicle driving support apparatus | |
| CN109151204B (en) | Navigation method and device based on mobile terminal and mobile terminal | |
| CN108545019A (en) | A kind of safety driving assist system and method based on image recognition technology | |
| US10996070B2 (en) | Route guidance apparatus and method | |
| CN113597617A (en) | Display method, display device, display equipment and vehicle | |
| CN114022565A (en) | Alignment method and alignment device for display equipment and vehicle-mounted display system | |
| US11260856B2 (en) | Information display device, information display method, and recording medium | |
| US20200064912A1 (en) | Eye gaze tracking of a vehicle passenger | |
| CN112896159A (en) | Driving safety early warning method and system | |
| CN111294564A (en) | Information display method and wearable device | |
| CN110348281A (en) | Alarm device | |
| JP2012247847A (en) | Information transmission control device for vehicle and information transmission control device | |
| CN114298908A (en) | Obstacle display method and device, electronic equipment and storage medium | |
| CN113247015A (en) | Vehicle driving auxiliary system based on somatosensory operation integrated glasses and method thereof | |
| JP2009122808A (en) | Drive support device for vehicle | |
| CN113492864A (en) | Driving support device and data collection system | |
| KR20130031713A (en) | Device for guiding safty distance for vehicle and method therefor | |
| CN112885127B (en) | Route prompting method and related device | |
| JP7294483B2 (en) | Driving support device, driving support method and program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210813 |
|
| RJ01 | Rejection of invention patent application after publication |