CN116834662A - Implementation method and system of transparent A/C column, electronic equipment and storage medium - Google Patents
Implementation method and system of transparent A/C column, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN116834662A CN116834662A CN202310842335.7A CN202310842335A CN116834662A CN 116834662 A CN116834662 A CN 116834662A CN 202310842335 A CN202310842335 A CN 202310842335A CN 116834662 A CN116834662 A CN 116834662A
- Authority
- CN
- China
- Prior art keywords
- target object
- column
- driver
- blind area
- vehicle
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 55
- 238000012544 monitoring process Methods 0.000 claims abstract description 21
- 238000001514 detection method Methods 0.000 claims description 36
- 230000008569 process Effects 0.000 claims description 23
- 238000005286 illumination Methods 0.000 claims description 16
- 230000007613 environmental effect Effects 0.000 claims description 9
- 239000011521 glass Substances 0.000 claims description 6
- 230000008447 perception Effects 0.000 claims description 6
- 238000005265 energy consumption Methods 0.000 abstract description 8
- 230000001960 triggered effect Effects 0.000 abstract description 4
- 238000004590 computer program Methods 0.000 description 11
- 238000010586 diagram Methods 0.000 description 10
- 230000000007 visual effect Effects 0.000 description 10
- 206010039203 Road traffic accident Diseases 0.000 description 5
- 239000005357 flat glass Substances 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 238000012986 modification Methods 0.000 description 4
- 230000004048 modification Effects 0.000 description 4
- 238000012545 processing Methods 0.000 description 4
- 230000004075 alteration Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 2
- 230000000903 blocking effect Effects 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 239000003086 colorant Substances 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 208000002173 dizziness Diseases 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000002159 abnormal effect Effects 0.000 description 1
- 230000003190 augmentative effect Effects 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 239000012141 concentrate Substances 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- B60Q9/00—Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00, e.g. haptic signalling
- B60Q9/008—Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00, e.g. haptic signalling for anti-collision purposes
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
- B60R2300/20—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of display used
- B60R2300/205—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of display used using a head-up display
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
- B60R2300/80—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement
- B60R2300/802—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement for monitoring and displaying vehicle exterior blind spot views
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
- B60R2300/80—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement
- B60R2300/8093—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement for obstacle warning
Landscapes
- Engineering & Computer Science (AREA)
- Mechanical Engineering (AREA)
- Physics & Mathematics (AREA)
- Multimedia (AREA)
- Chemical & Material Sciences (AREA)
- Combustion & Propulsion (AREA)
- Transportation (AREA)
- Human Computer Interaction (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Traffic Control Systems (AREA)
Abstract
The invention relates to a method, a system, electronic equipment and a storage medium for realizing a transparent A/C column, wherein the method comprises the following steps: monitoring whether the sight line of a driver looks at the blind area of the A/C column in real time, if so, displaying a target object in a preset distance range of the blind area of the driver at a set position of the vehicle body; otherwise, displaying a target object with collision time with the own vehicle smaller than a first set threshold value in the dead zone of the A/C column at the set position of the vehicle body; when the collision time of the target object in the blind area and the self-vehicle is smaller than a second set threshold value, the atmosphere lamp or the warning lamp and the instrument are used for carrying out acousto-optic reminding, whether the blind area is triggered or not is judged to be free of collision risk target display by judging whether the target object exists in the sight position of the driver and the sight blind area, the influence on normal observation of the driver is reduced, the energy consumption of a transparent A/C column system is also reduced, and the problems that the A column blind area influences the sight of the driver when the driver observes from the side and the C column blind area influences the sight of the driver when the driver observes the back window are solved.
Description
Technical Field
The invention relates to the field of automobile driving, in particular to a method, a system, electronic equipment and a storage medium for realizing a transparent A/C column.
Background
In the running process of the vehicle, the A/C column can shield the sight of a driver, so that the blind area of the A/C column appears, and the driver cannot observe pedestrians, vehicles and obstacles in the blind area of the A/C column. Especially when the automobile turns, passes through the intersection or backs, in order to observe and judge the condition outside the automobile, the driver usually needs to adjust the gesture at all times in the driving process to obtain the view in the A/C column blind area, which is very easy to cause tension and fatigue of the driver, greatly increases the potential safety hazard when the automobile runs while influencing the driving experience of the driver, and causes traffic accidents. Therefore, the blind area of the A/C column is eliminated or the influence of the blind area of the A/C column on a driver is reduced to the greatest extent, the potential safety hazard can be effectively reduced, the occurrence of traffic accidents is avoided, and the comfort and the safety in the driving process are obviously improved.
Some current solutions adopt methods of thinning the A column, adding a triangular window below the A column or designing the A column into a hollowed-out structure and the like so as to improve the driving vision. However, the method only partially solves the problem of the dead zone of the A column, and can possibly cause the reduction of the structural strength of the A column, thereby reducing the passive safety performance of the automobile; some solutions utilize sensors to detect obstacles in the blind area of the vehicle and alert the driver through a blind area warning system, thereby reminding the driver of the abnormal situation occurring in the blind area. However, the blind zone warning system can only prompt the driver to drive carefully by lighting the warning lamp and giving out warning sounds, and the driver cannot judge the specific position of the target and the movement trend of the target. Still other solutions adopt a transparent a-pillar, i.e. a display screen is additionally arranged on the side facing the cockpit in the a-pillar, and an external camera is used to collect images of blind areas, and the images are displayed on the display screen arranged on the a-pillar, so that information of the blind areas outside the vehicle is provided for a driver, and the problem of the blind areas of the a-pillar is solved. The solution strategy has a plurality of unreasonable places, the blind area image displayed by the display screen has visual errors, the driver cannot intuitively judge the driving environment, in addition, in the normal driving process, the driver does not need to continuously concentrate attention on the blind area, the display screen arranged in the cockpit can disperse the attention of the driver, the driver inputs excessive energy into the A column display screen, traffic accidents are easily caused, the solution is complex and complicated, the cost of the device is high, and the energy consumption of the automobile is greatly increased.
Disclosure of Invention
Aiming at the technical problems in the prior art, the invention provides a method, a system, electronic equipment and a storage medium for realizing a transparent A/C column, which are used for judging whether to trigger the display of a blind area target or not according to whether a target object exists in a preset detection distance of a sight line position and a sight line blind area of a driver and whether collision risk exists between the target object and a vehicle, so that the influence on normal observation of the driver is reduced, the energy consumption of the transparent A/C column system is reduced, and the problems that the sight line of the driver is influenced by the A column blind area when the driver observes from the side head and the sight line of the driver is influenced by the C column blind area when the driver observes the vehicle window backwards are solved.
According to a first aspect of the present invention, there is provided a method for implementing a transparent a/C column, including:
step 1, monitoring whether the sight line of a driver looks at an A/C column blind area in real time, if so, executing step 2, otherwise, executing step 3;
step 2, displaying a target object appearing in a preset detection distance of a blind zone of a driver at a set position of the vehicle body;
and step 3, displaying a target object which appears in the A/C column blind area and has collision time with the vehicle less than a first set threshold value at a vehicle body set position.
On the basis of the technical scheme, the invention can also make the following improvements.
Optionally, the step 2 includes:
step 201, confirming the current sight blind area range of a driver;
step 202, judging whether a target object exists in the preset detection distance of the current blind area of the driver, if so, projecting the target object appearing in the preset detection distance of the blind area of the driver to a vehicle body set position through an AR-HUD for display.
Optionally, the position of the vehicle body set for displaying the target object appearing in the preset detection distance of the blind area of the driver in the step 2 is on a front windshield or a rear glass window on the corresponding side of the a/C pillar.
Optionally, the step 3 includes:
step 301, judging whether a target object exists in the A/C column blind area range, if so, executing step 302;
and 302, judging that the collision time between the target object existing in the A/C column blind area range and the own vehicle is smaller than a first set threshold value, and if the collision time is smaller than the first set threshold value, displaying the target object with collision risk in the A/C column blind area at the set position of the vehicle body.
Optionally, after the step 302 of determining that the target object has a collision risk with the own vehicle, the process of displaying the target object having a collision risk in the a/C pillar blind area at the vehicle body set position further includes:
judging whether the illumination intensity in the A/C column blind area range of the collision risk side reaches a set threshold value, if so, projecting the target object information in the A/C column blind area range onto a front windshield through an AR-HUD, otherwise, displaying the target object information in the A/C column blind area range on an automobile instrument.
Optionally, the displaying the target object at the vehicle body set position in the step 2 and the step 3 further includes:
classifying the types of the target objects, setting identification patterns of the target objects of all types, and dynamically displaying the various target objects and environmental information thereof through AR-HUD projection or instruments;
the environmental information of the target object includes: distance between the target object and the vehicle, moving speed of the target object, and collision risk level of the target object and the vehicle.
Optionally, the kinds of the target objects include: pedestrians, bicycles, and other vehicles; the process of displaying the target object further comprises: and different display strategies are adopted for the identification patterns according to the collision risk level of the target object and the vehicle so as to early warn the driver.
Optionally, the steps 2 and 3 further include: when judging that the collision time between the target object and the vehicle in the blind area of the driver or the blind area of the A/C column is smaller than a second set threshold value, carrying out acousto-optic reminding;
the second set threshold is smaller than the first set threshold, and the process of performing the acousto-optic reminding comprises the following steps:
according to the collision time, each collision risk level is determined, and the atmosphere lamp or the A/C column blind zone warning lamp arranged at the corresponding A column/C column reminds the driver through different brightness, flashing frequency and color according to different collision risk levels, and meanwhile, the instrument adopts different frequencies, loudness and tone alarm to send out different alarm sounds according to different collision risk levels to remind.
According to a second aspect of the present invention, there is provided a system for implementing a transparent a/C column, comprising: the system comprises a driver state monitoring module, a vehicle information detection module, a sensor perception module and a transparent A/C column generation module;
the driver state monitoring module is used for monitoring whether the sight line of a driver looks at the A/C column blind area or not in real time;
the vehicle information detection module is used for detecting the state of the vehicle in real time;
the sensor sensing module is used for detecting the surrounding environment of the vehicle and a target object in the environment in real time;
the transparent A/C column generating module is used for judging whether a target object exists in a preset detection distance of the blind zone of the driver or not based on detection results of the vehicle information detecting module and the sensor sensing module when judging whether the sight of the monitored driver looks at the blind zone of the A/C column, and displaying the target object in the preset detection distance of the blind zone of the driver at a set position of the vehicle body; and when the sight line of the monitored driver is not seen to the A/C column blind area, judging whether a target object with collision time smaller than a first set threshold value with the own vehicle exists in the A/C column blind area or not based on detection results of the vehicle information detection module and the sensor perception module, and displaying the target object with collision risk in the A/C column blind area at a vehicle body set position.
According to a third aspect of the present invention, there is provided an electronic device comprising a memory, a processor for implementing the steps of the method for implementing transparent a/C pillars when executing a computer management class program stored in the memory.
According to a fourth aspect of the present invention, there is provided a computer-readable storage medium having stored thereon a computer management class program which, when executed by a processor, implements the steps of a method of implementing transparent a/C pillars.
The embodiment of the invention provides a method, a system, electronic equipment and a storage medium for realizing a transparent A/C column, which have the beneficial effects that:
the low-cost solution for observing and judging the safety precaution for the left front, right front, left rear and right rear dead zones and the surrounding situation of the automobile in the running process is provided, the target object information of the A/C column dead zone can be displayed in the normal driving sight, so that a driver can grasp the situation of the dead zone of the automobile without excessively adjusting the gesture, and the driver is assisted in avoiding traffic accidents;
the problem that the blind area of the column A influences the sight of a driver when the driver looks at the side head is solved;
the problem that the blind area of the C column influences the sight of a driver when the driver looks back at the rear window is solved;
the problems that in the existing scheme, a camera and a display screen are used for displaying a blind area image, a perspective image is deformed, deviation is generated from the actual perspective image, and a driver is easy to dizziness due to the fact that the screen is observed at a high speed, so that the driver is difficult to judge a target are solved;
the problems that the display screen is arranged in the vehicle in the existing transparent A/C column scheme, the display screen can reflect ambient light to easily cause interference to the driving of a driver, and the vehicle collides with the display screen and cracks to easily generate danger are solved;
the problems that the prior proposal needs to change the structure of the A/C column and carry out special modeling design and has potential safety hazard are solved;
whether the blind area collision risk-free target display is triggered or not is judged by the sight position of the driver and whether targets exist in the sight blind area, so that the influence on normal observation of the driver is reduced, and the energy consumption of the transparent A/C column system is also reduced;
the blind area target of the A/C column is detected through the existing side view camera and the angle radar, and the target object information is displayed through the AR-HUD projection equipment and the instrument, so that the problem of high cost caused by the fact that the camera and the display screen are required to be added in the existing transparent A/C column system is solved;
when collision risk exists between a target object in a blind area and a vehicle, a side-view camera is utilized to detect illumination intensity in the blind area, and according to the illumination intensity, whether information of the target object in the blind area is displayed on an instrument or projected onto a vehicle window through an AR-HUD projection device is determined, so that the problem that stable and clear highlight images are difficult to provide under a strong light environment or brightness of light projected through the AR-HUD is required to be improved to ensure image quality and visual effect when the environment is strong is solved, and under the condition that the environment light is strong, a driver is guided to see the strong light environment by the information of the target object through the AR-HUD projection display, so that visual interference is easily caused to the strong light environment is still solved;
the problem that a vehicle cannot display the specific position and movement trend of an A/C column blind area target is solved;
the technology sense of the vehicle is enhanced, and the driving experience and the safety are improved.
Drawings
FIG. 1 is a flow chart of an embodiment of a method for implementing a transparent A/C column provided by the present invention;
FIG. 2 is a block diagram of an embodiment of a system for implementing transparent A/C columns provided by the present invention;
fig. 3 is a schematic hardware structure of one possible electronic device according to the present invention;
fig. 4 is a schematic hardware structure of a possible computer readable storage medium according to the present invention.
Detailed Description
The principles and features of the present invention are described below with reference to the drawings, the examples are illustrated for the purpose of illustrating the invention and are not to be construed as limiting the scope of the invention.
Fig. 1 is a flowchart of an embodiment of a method for implementing a transparent a/C column according to the present invention, as shown in fig. 1, where the implementing method includes:
and step 1, monitoring whether the sight line of a driver looks at the dead zone of the A/C column in real time, if so, executing the step 2, otherwise, executing the step 3.
In particular implementations, driver gaze may be detected in real-time based on a driver state monitoring system that is capable of accurately identifying driver behavior states.
And 2, displaying the target object appearing in the preset detection distance of the blind zone of the driver at the set position of the vehicle body.
And step 3, displaying a target object which appears in the preset detection distance of the A/C column blind area and has collision time with the own vehicle smaller than a first set threshold value at the set position of the vehicle body.
According to the implementation method of the transparent A/C column, whether the blind area target display is triggered is judged according to the sight position of the driver and whether the target exists in the sight blind area, so that the influence on normal observation of the driver is reduced, the energy consumption of the transparent A/C column system is reduced, and the problems that the A column blind area influences the sight of the driver when the driver observes at the side head and the C column blind area influences the sight of the driver when the vehicle window is observed at the back are solved.
Example 1
Embodiment 1 provided by the present invention is an embodiment of a method for implementing a transparent a/C column provided by the present invention, and as can be known from fig. 1, the embodiment of the implementing method includes:
and step 1, monitoring whether the sight line of a driver looks at the dead zone of the A/C column in real time, if so, executing the step 2, otherwise, executing the step 3.
And 2, displaying the target object appearing in the preset detection distance in the blind zone of the driver at the set position of the vehicle body.
In one possible embodiment, step 2 includes:
step 201, the current sight blind area range of the driver is confirmed.
Step 202, judging whether a target object exists in a preset detection distance of the current blind area of the sight of the driver, if yes, projecting the target object appearing in the blind area of the driver to a set position of the vehicle body for display through an AR-HUD (Augmented Reality ), otherwise, not displaying target object information.
In one possible embodiment, the vehicle body setting position showing the target object appearing in the driver's blind area in step 2 is on the front windshield or rear glass window on the side corresponding to the a/C pillar.
And step 3, displaying a target object which appears in the A/C column blind area and has collision time with the vehicle less than a first set threshold value at a vehicle body set position.
In one possible embodiment, step 3 includes:
step 301, judging whether a target object exists in the A/C column blind area range, if yes, executing step 302, otherwise, not displaying target object information.
And 302, judging that the collision time between the target object existing in the A/C column blind area range and the own vehicle is smaller than a first set threshold value, if so, displaying the target object with collision risk in the A/C column blind area at the set position of the vehicle body, otherwise, not displaying the information of the target object.
In specific implementation, the sensing data of the angle radar and the side view camera can be fused to judge the object information of the surrounding environment of the vehicle, specifically, the front angle radar, the rear angle radar, the side front view camera and the side rear view camera which are arranged around the vehicle sense and detect the object (pedestrians, two-wheelers and other vehicles) in the surrounding environment of the vehicle, and the sensing data are processed to obtain the information of the specific position, the moving speed and the like of the object and judge whether collision risk exists between the object and the vehicle.
Under the strong light condition, the information of the target object is displayed through the AR-HUD projection to guide the driver to see the driver with the problem that visual interference is easily caused to the strong light environment. In a possible embodiment, after determining that the target object has a collision risk with the own vehicle in step 302, the process of displaying, at the vehicle body set position, the target object having a collision risk that appears in the a/C pillar blind area further includes:
judging whether the illumination intensity in the A/C column blind area range at the collision risk side reaches a set threshold value, if so, projecting the target object information in the A/C column blind area range onto a front windshield through an AR-HUD, otherwise, displaying the target object information in the A/C column blind area range on an automobile instrument.
The front windshield, the glass window or the instrument panel are used for displaying, so that a screen is not required to be installed, energy consumption is not increased, driving of a driver is not disturbed, driving safety is affected, and potential safety hazards exist.
In a possible embodiment, the displaying the target object at the vehicle body set position in step 2 and step 3 further includes:
classifying the types of the target objects, setting identification patterns of the target objects of all types, and dynamically displaying the various target objects and the environmental information thereof through AR-HUD projection or meters.
The environmental information of the target object includes: distance between the target object and the vehicle, moving speed of the target object, and collision risk level of the target object and the vehicle.
In one possible embodiment, the kinds of target objects include: pedestrians, two-wheelers and other vehicles, and three identification patterns are displayed according to three target object classifications; the process of displaying the target object further includes: different display strategies are adopted for the identification patterns according to collision risk levels of the target objects and the self-vehicle so as to better early warn a driver, and for example, different collision risk levels of the target objects and the self-vehicle can be distinguished by colors.
In a possible embodiment, step 2 and step 3 further comprise: and when judging that the collision time of the target object appearing in the blind area of the driver or the blind area of the A/C column and the own vehicle is smaller than a second set threshold value, carrying out acousto-optic reminding. The second set threshold is smaller than the first set threshold, and correspondingly indicates that the detected collision risk level is higher.
The process for carrying out the acousto-optic reminding comprises the following steps:
according to collision time confirms each collision risk level, the atmosphere lamp or the A/C post blind area warning lamp that have the warning effect that set up corresponding A post/C post reminds the driver through different luminance, scintillation frequency and colour to give out light according to different collision risk levels, and the instrument adopts different frequency, loudness, tone alert to send different warning sound according to different collision risk levels simultaneously and reminds, alerts the driver and notices the target in the blind area.
According to the embodiment of the implementation method of the transparent A/C column, the information of the target object in the blind area of the A/C column in the driving process of the detection vehicle is perceived based on the sensor and displayed through the AR-HUD projection or the instrument, so that a driver is assisted in judging the specific position and the movement trend of the target object in the blind area, and the information such as the specific position and the movement speed of the target object is displayed through the AR-HUD projection equipment or the instrument, so that the driver is helped in grasping the environmental information of the blind area, the driving experience is improved, and the driving safety is ensured;
when collision risk exists between a target object in the dead zone of the A/C column and the vehicle, triggering alarm display to prompt and early warn, actively displaying information such as the position and the moving speed of the target object through AR-HUD projection or an instrument, sensing the illumination intensity in the dead zone of the A/C column by combining a front side view camera and a rear side view camera of the vehicle body, determining a display mode when collision risk exists between the vehicle and the target object in the dead zone of the A/C column according to the illumination intensity, displaying the information of the target object on the instrument when the side view camera senses that the illumination intensity is higher in the dead zone range where the target object with the collision risk exists currently, and displaying the information of the target object on window glass through AR-HUD projection when the side view camera senses that the illumination intensity is not high in the dead zone range where the collision risk exists currently with the vehicle.
When collision risk exists between a target object in the blind area of the A/C column and a vehicle temporarily, the target object in the blind area is not actively displayed through AR-HUD projection and an instrument, meanwhile, whether the target object is in the real-time vehicle A/C blind area range is judged by combining a driver monitoring system, specifically, the position and the head angle of the head of the driver are detected by using a camera of the driver monitoring system in a cabin, the visual blind area range formed by blocking the current driver sight by the A column and the C column is calculated in real time through the positions of the A column and the C column on the two sides of the vehicle, whether the current driver sight is in the preset distance of the current A/C column visual blind area of the driver or not is judged, and if the preset distance of the current driver sight blind area is provided with the target object, the position and the movement state of the target object in the blind area are displayed on window glass corresponding to the driver through AR-HUD projection, namely, the front windshield near the A column or the rear windshield near the C column.
Example 2
Embodiment 2 provided by the present invention is an embodiment of a system for implementing a transparent a/C column provided by the present invention, and fig. 2 is a block diagram of an embodiment of a system for implementing a transparent a/C column provided by an embodiment of the present invention, as can be seen with reference to fig. 1 and 2, the embodiment of the system for implementing a transparent a/C column includes: the system comprises a driver state monitoring module, a vehicle information detection module, a sensor perception module and a transparent A/C column generation module.
And the driver state monitoring module is used for monitoring whether the sight line of the driver looks at the A/C column blind area in real time.
The vehicle information detection module is used for detecting the state of the vehicle in real time.
The sensor sensing module is used for detecting the surrounding environment of the vehicle and target objects in the environment in real time.
The transparent A/C column generating module is used for judging whether a target object exists in the blind area of the driver or not based on the detection results of the vehicle information detecting module and the sensor sensing module when judging whether the sight of the monitored driver looks at the blind area of the A/C column or not, and displaying the target object in the blind area of the driver at a set position of the vehicle body; when it is determined that the sight line of the monitored driver does not look at the A/C column blind area, whether a target object which has collision time with the own vehicle and is less than a first set threshold exists in the A/C column blind area is judged based on detection results of the vehicle information detection module and the sensor sensing module, and the target object which has collision risk and appears in the A/C column blind area is displayed at a vehicle body set position.
In one possible embodiment, the process of the transparent a/C pillar generating module displaying the target object appearing in the driver's blind zone at the vehicle body set position includes:
step 201, the current sight blind area range of the driver is confirmed.
Step 202, judging whether a target object exists in a preset detection range of the current blind area of the driver, if so, projecting the target object appearing in the preset detection range of the blind area of the driver to a set position of the vehicle body through an AR-HUD for display, otherwise, not displaying target object information.
In one possible embodiment, the target object appears in the blind area of the driver is displayed on the front windshield or the rear glass window on the corresponding side of the a/C pillar at the vehicle body set position.
In one possible embodiment, the process of displaying, by the transparent a/C pillar generating module, a target object having a collision risk that appears in the a/C pillar blind area at the vehicle body set position includes:
step 301, judging whether a target object exists in the A/C column blind area range, if yes, executing step 302, otherwise, not displaying target object information.
And 302, judging whether the collision time between the target object existing in the A/C column blind area range and the own vehicle is larger than a first set threshold value, if so, displaying the target object with collision risk existing in the A/C column blind area at the set position of the vehicle body, otherwise, not displaying the information of the target object.
In specific implementation, the sensing data of the angle radar and the side view camera can be fused to judge the object information of the surrounding environment of the vehicle, specifically, the front angle radar, the rear angle radar, the side front view camera and the side rear view camera which are arranged around the vehicle sense and detect the object (pedestrians, two-wheelers and other vehicles) in the surrounding environment of the vehicle, and the sensing data are processed to obtain the information of the specific position, the moving speed and the like of the object and judge whether collision risk exists between the object and the vehicle.
Consider the problem of visual interference caused by the fact that under strong light, the target object information is displayed through AR-HUD projection to guide a driver to see the strong light environment.
In a possible embodiment, after determining that the target object has a collision risk with the own vehicle in step 302, the process of displaying, at the vehicle body set position, the target object having a collision risk that appears in the a/C pillar blind area further includes:
judging whether the illumination intensity in the A/C column blind area range at the collision risk side reaches a set threshold value, if so, projecting the target object information in the A/C column blind area range onto the front windshield, otherwise, displaying the target object information in the A/C column blind area range on an automobile instrument.
The front windshield, the glass window or the instrument panel are used for displaying, so that a screen is not required to be installed, energy consumption is increased, driving of a driver is disturbed, driving safety is affected, and potential safety hazards exist.
In one possible embodiment, the process of displaying the target object at the vehicle body set position by the transparent a/C pillar generating module further includes:
classifying the types of the target objects, setting identification patterns of the target objects of all types, and dynamically displaying the various target objects and the environmental information thereof through projection or meters.
The environmental information of the target object includes: distance between the target object and the vehicle, moving speed of the target object, and collision risk level of the target object and the vehicle.
In one possible embodiment, the kinds of target objects include: pedestrians, two-wheelers and other vehicles, and three identification patterns are displayed according to three target object classifications; the process of displaying the target object further includes: different display strategies are adopted for the identification patterns according to collision risk levels of the target objects and the self-vehicle so as to better early warn a driver, and for example, different collision risk levels of the target objects and the self-vehicle can be distinguished by colors.
According to the embodiment of the implementation method of the transparent A/C column, the information of the target object in the blind area of the A/C column in the running process of the detection vehicle is perceived based on the sensor and displayed through the projection or the instrument, so that a driver is assisted in judging the specific position and the movement trend of the target object in the blind area, and the information such as the specific position and the movement speed of the target object is displayed through the projection equipment or the instrument, so that the driver is helped to grasp the blind area environment information, the driving experience is improved, and the running safety is ensured;
when collision risk exists between a target object in the dead zone of the A/C column and the vehicle, triggering alarm display to prompt and early warn, actively displaying information such as the position and the moving speed of the target object through a projection or an instrument, sensing the illumination intensity in the dead zone of the A/C column by combining a front side view camera and a rear side view camera of the vehicle body, determining a display mode when the collision risk exists between the vehicle and the target object in the dead zone of the A/C column according to the illumination intensity, displaying information of the target object on the instrument when the side view camera senses that the illumination intensity is higher in the dead zone range where the target object with the collision risk exists currently, and displaying information of the target object on window glass through projection when the side view camera senses that the illumination intensity is not high in the dead zone range where the collision risk exists currently with the vehicle.
When collision risk exists between a target object in the blind area of the A/C column and the vehicle temporarily, the target object in the blind area is not actively displayed through projection and an instrument, meanwhile, whether the target object is in the real-time vehicle A/C blind area range is judged by combining a driver monitoring system, specifically, the position and the head angle of the head of the driver are detected by using a camera of the driver monitoring system in a cabin, the visual blind area range formed by blocking the current sight of the driver by the A column and the C column is calculated in real time through the positions of the A column and the C column on the two sides of the vehicle, whether the vehicle and the pedestrian are in the preset detection distance of the current sight of the A/C column of the driver is judged, and if the target object exists in the preset distance of the current sight of the driver, the position and the movement state of the target object in the blind area are displayed on window glass corresponding to the sight of the driver through projection, namely, the inner side of the A column or the rear window near the C column.
Referring to fig. 3, fig. 3 is a schematic diagram of an embodiment of an electronic device according to an embodiment of the invention. As shown in fig. 3, an embodiment of the present invention provides an electronic device, including a memory 1310, a processor 1320, and a computer program 1311 stored in the memory 1310 and executable on the processor 1320, wherein the processor 1320 executes the computer program 1311 to implement the following steps: monitoring whether the sight of a driver looks at the dead zone of the A/C column in real time, if so, executing the step 2, otherwise, executing the step 3; step 2, displaying a target object appearing in a blind zone of a driver at a set position of the vehicle body; and 3, displaying the target object with collision risk in the A/C column blind area at the set position of the vehicle body.
Referring to fig. 4, fig. 4 is a schematic diagram of an embodiment of a computer readable storage medium according to the present invention. As shown in fig. 4, the present embodiment provides a computer-readable storage medium 1400 having stored thereon a computer program 1411, which computer program 1411, when executed by a processor, performs the steps of: monitoring whether the sight of a driver looks at the dead zone of the A/C column in real time, if so, executing the step 2, otherwise, executing the step 3; step 2, displaying a target object appearing in a blind zone of a driver at a set position of the vehicle body; and 3, displaying the target object with collision risk in the A/C column blind area at the set position of the vehicle body.
The embodiment of the invention provides a method, a system, electronic equipment and a storage medium for realizing a transparent A/C column, which have the beneficial effects that:
the low-cost solution for observing and judging the safety precaution for the left front, right front, left rear and right rear dead zones and the surrounding situation of the automobile in the running process is provided, the target object information of the A/C column dead zone can be displayed in the normal driving sight, so that a driver can grasp the situation of the dead zone of the automobile without excessively adjusting the gesture, and the driver is assisted in avoiding traffic accidents;
the problem that the blind area of the column A influences the sight of a driver when the driver looks at the side head is solved;
the problem that the blind area of the C column influences the sight of a driver when the driver looks back at the rear window is solved;
the problems that in the existing scheme, a camera and a display screen are used for displaying a blind area image, a perspective image is deformed, deviation is generated from the actual perspective image, and a driver is easy to dizziness due to the fact that the screen is observed at a high speed, so that the driver is difficult to judge a target are solved;
the problems that the display screen is arranged in the vehicle in the existing transparent A/C column scheme, the display screen can reversely emit ambient light to easily cause interference to the driving of a driver, and the vehicle collides with the display screen and cracks to easily generate danger are solved;
the problems that the prior proposal needs to change the structure of the A/C column and carry out special modeling design and has potential safety hazard are solved;
whether the blind area target display is triggered is judged by the sight position of the driver and whether a target object exists in the sight blind area, so that the influence on normal observation of the driver is reduced, and the energy consumption of the transparent A/C column system is also reduced;
the blind area target of the A/C column is detected through the existing side view camera and the angle radar, and the information of a target object is displayed by using projection equipment and an instrument, so that the problem of high cost caused by the fact that the camera and a display screen are required to be added in the existing transparent A/C column system is solved;
when collision risk exists between a target object in a blind area and a vehicle, a side-view camera is utilized to detect illumination intensity in the blind area, and whether information of the target object in the blind area is displayed on an instrument or projected onto a vehicle window through projection equipment is determined according to the illumination intensity, so that the problem that stable and clear highlight pictures are difficult to provide under a strong light environment or brightness of HUD projection light is required to be improved in order to ensure image quality and visual effect when the environment is strong is solved, and a driver is guided to see the strong light environment by the HUD projection display target object information so as to easily cause visual interference;
the problem that a vehicle cannot display the specific position and movement trend of an A/C column blind area target is solved;
the technology sense of the vehicle is enhanced, and the driving experience and the safety are improved.
In the foregoing embodiments, the descriptions of the embodiments are focused on, and for those portions of one embodiment that are not described in detail, reference may be made to the related descriptions of other embodiments.
It will be appreciated by those skilled in the art that embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
While preferred embodiments of the present invention have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. It is therefore intended that the following claims be interpreted as including the preferred embodiments and all such alterations and modifications as fall within the scope of the invention.
It will be apparent to those skilled in the art that various modifications and variations can be made to the present invention without departing from the spirit or scope of the invention. Thus, it is intended that the present invention also include such modifications and alterations insofar as they come within the scope of the appended claims or the equivalents thereof.
Claims (10)
1. The implementation method of the transparent A/C column is characterized by comprising the following steps:
step 1, monitoring whether the sight line of a driver looks at an A/C column blind area in real time, if so, executing step 2, otherwise, executing step 3;
step 2, displaying a target object appearing in a preset detection distance of a blind zone of a driver at a set position of the vehicle body;
and step 3, displaying a target object which appears in the A/C column blind area and has collision time with the vehicle less than a first set threshold value at a vehicle body set position.
2. The implementation method according to claim 1, wherein the step 2 includes:
step 201, confirming the current sight blind area range of a driver;
step 202, judging whether a target object exists in a preset detection distance in the current sight-line blind area range of the driver, if so, projecting the target object appearing in the driver blind area to a vehicle body set position through an AR-HUD for display.
3. The implementation method according to claim 1, wherein the vehicle body setting position of the target object appearing within the preset detection distance in the driver blind area in the step 2 is displayed on a front windshield or a rear glass window on the corresponding side of the a/C pillar.
4. The implementation method according to claim 1, wherein the step 3 includes:
step 301, judging whether a target object exists in the A/C column blind area range, if so, executing step 302;
and 302, judging whether the collision time between the target object and the vehicle in the A/C column blind area range is smaller than a first set threshold value, and if so, displaying the target object with collision risk in the A/C column blind area at the set position of the vehicle body.
5. The implementation method according to claim 4, wherein the process of displaying the target object with collision risk occurring in the a/C pillar blind area at the vehicle body set position after the target object is judged to have collision risk with the own vehicle in step 302 further includes:
judging whether the illumination intensity in the A/C column blind area range of the collision risk side reaches a set threshold value, if so, projecting the target object information in the A/C column blind area range onto a front windshield through an AR-HUD, otherwise, displaying the target object information in the A/C column blind area range on an automobile instrument.
6. The implementation method according to claim 1, wherein the displaying the target object at the vehicle body set position in the steps 2 and 3 further includes:
classifying the types of the target objects, setting identification patterns of the target objects of all types, and dynamically displaying the various target objects and environmental information thereof through AR-HUD projection or instruments;
the environmental information of the target object includes: distance between the target object and the vehicle, moving speed of the target object and collision risk level of the target object and the vehicle;
the kinds of the target object include: pedestrians, bicycles, and other vehicles; the process of displaying the target object further comprises: and different display strategies are adopted for the identification patterns according to the collision risk level of the target object and the vehicle so as to early warn the driver.
7. The implementation method according to claim 1, wherein the steps 2 and 3 further include: when judging that the collision time between the target object and the vehicle in the blind area of the driver or the blind area of the A/C column is smaller than a second set threshold value, carrying out acousto-optic reminding;
the second set threshold is smaller than the first set threshold, and the process of performing the acousto-optic reminding comprises the following steps:
according to the collision time, each collision risk level is determined, and the atmosphere lamp or the A/C column blind zone warning lamp arranged at the corresponding A column/C column reminds the driver through different brightness, flashing frequency and color according to different collision risk levels, and meanwhile, the instrument adopts different frequencies, loudness and tone alarm to send out different alarm sounds according to different collision risk levels to remind.
8. A system for implementing a transparent a/C column, comprising: the implementation system comprises: the system comprises a driver state monitoring module, a vehicle information detection module, a sensor perception module and a transparent A/C column generation module;
the driver state monitoring module is used for monitoring whether the sight line of a driver looks at the A/C column blind area or not in real time;
the vehicle information detection module is used for detecting the state of the vehicle in real time;
the sensor sensing module is used for detecting the surrounding environment of the vehicle and a target object in the environment in real time;
the transparent A/C column generation module is used for judging whether a target object exists in a preset detection distance of a blind zone of a driver or not based on detection results of the vehicle information detection module and the sensor perception module when judging that the sight of a monitored driver looks at the blind zone of the A/C column, and displaying the target object in the blind zone of the driver at a set position of a vehicle body; and when the sight line of the monitored driver is not seen to the A/C column blind area, judging whether a target object with collision time smaller than a first set threshold value with the own vehicle exists in the A/C column blind area or not based on detection results of the vehicle information detection module and the sensor perception module, and displaying the target object with collision risk in the A/C column blind area at a vehicle body set position.
9. An electronic device comprising a memory, a processor for implementing the steps of the method for implementing a transparent a/C pillar according to any one of claims 1-7 when executing a computer management class program stored in the memory.
10. A computer readable storage medium, having stored thereon a computer management class program which, when executed by a processor, implements the steps of the method of implementing a transparent a/C column according to any of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310842335.7A CN116834662A (en) | 2023-07-10 | 2023-07-10 | Implementation method and system of transparent A/C column, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310842335.7A CN116834662A (en) | 2023-07-10 | 2023-07-10 | Implementation method and system of transparent A/C column, electronic equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116834662A true CN116834662A (en) | 2023-10-03 |
Family
ID=88166851
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310842335.7A Pending CN116834662A (en) | 2023-07-10 | 2023-07-10 | Implementation method and system of transparent A/C column, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116834662A (en) |
-
2023
- 2023-07-10 CN CN202310842335.7A patent/CN116834662A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9542848B2 (en) | Adjustment of vehicle alerts based on response time learning | |
| JP5718942B2 (en) | Apparatus and method for assisting safe operation of transportation means | |
| EP3576973B1 (en) | Method and system for alerting a truck driver | |
| JP5568345B2 (en) | Safety confirmation support device and program | |
| US9262920B2 (en) | Methods and devices for outputting information in a motor vehicle | |
| US20150002285A1 (en) | Vehicle information transmitting device | |
| US20210155159A1 (en) | Vehicle display apparatus | |
| CN109204305A (en) | Equipment and motor vehicle used in abundant visual field method, observer's vehicle and object | |
| US20110301846A1 (en) | Vehicle perimeter monitor | |
| JP2004102889A (en) | Vehicle detection device | |
| JP2006338594A (en) | Pedestrian recognition system | |
| KR101605660B1 (en) | Device and method of displaying blind spot information for large vehicle | |
| JP2009265842A (en) | Warning device for vehicle and warning method | |
| JP2020093766A (en) | Vehicle control device, control system and control program | |
| CN110758286A (en) | AR-HUD (augmented reality) -based automobile side and rear blind spot detection system and method based on head-up display | |
| US20230226911A1 (en) | Information provision system | |
| CN218287576U (en) | Door opening early warning system of vehicle and vehicle with same | |
| WO2013187829A1 (en) | Warning system | |
| JP2009154775A (en) | Attention awakening device | |
| JP2009244986A (en) | Warning notification device | |
| JP4857891B2 (en) | Driving support device and program | |
| KR101491177B1 (en) | Night view system and control method thereof | |
| JP2021039554A (en) | Gazing guidance device for vehicle | |
| CN116834662A (en) | Implementation method and system of transparent A/C column, electronic equipment and storage medium | |
| JP6956473B2 (en) | Sideways state judgment device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |