CN109606260B - Method and device for prompting sound outside vehicle - Google Patents
Method and device for prompting sound outside vehicle Download PDFInfo
- Publication number
- CN109606260B CN109606260B CN201811603594.XA CN201811603594A CN109606260B CN 109606260 B CN109606260 B CN 109606260B CN 201811603594 A CN201811603594 A CN 201811603594A CN 109606260 B CN109606260 B CN 109606260B
- Authority
- CN
- China
- Prior art keywords
- vehicle
- sound source
- sound
- driver
- condition
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- B60Q9/00—Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00, e.g. haptic signalling
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R16/00—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for
- B60R16/02—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements
- B60R16/023—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements for transmission of signals between vehicle parts or subsystems
Landscapes
- Engineering & Computer Science (AREA)
- Mechanical Engineering (AREA)
- Human Computer Interaction (AREA)
- Traffic Control Systems (AREA)
Abstract
The embodiment of the invention provides a method for prompting a sound outside a vehicle, which comprises the following steps: step 104, collecting sound in an environment outside the vehicle; step 106, identifying whether the collected sound contains a preset sound signal, and further determining the type of the sound source if the collected sound contains the preset sound signal; the preset sound signal is a sound signal influencing the running of the vehicle; and 108, when the recognized sound contains a preset sound signal, positioning a sound source emitting the preset sound signal, and determining the position and the driving direction of the sound source relative to the vehicle. Step 110 presents the identified sound source type and the location of the sound source relative to the vehicle to the driver. The method can improve the driving assisting effect of the function on the driver, so that the driver can be more accurately served, the requirements of the user can be flexibly matched, the driving assisting applicability can achieve more diversified effects, the driving safety can be enhanced, and the user experience degree can be improved.
Description
Technical Field
The embodiment of the invention relates to the field of vehicle information monitoring, in particular to a method and a device for sound prompt outside a vehicle.
Background
Along with the development of technology, the travelling comfort of vehicle constantly promotes, and the driver assistance function is also increasing step by step, and in order to assist the driver to drive, some vehicles have outer sound prompt facility now, and this function obtains the outer sound of vehicle, such as the car whistling, fixes a position this vehicle that whistles, reminds to the driver, and this function has promoted driving safety to a certain extent, has helped the driver.
The above-described functions have some drawbacks: if the sound source is not judged when the sound of other vehicles is detected, namely the driver is reminded, if other vehicles do not make a whistle to the driver but aim at other vehicles, frequent invalid reminding to the driver does not have the warning function, and the driver can relax the warning to the reminding and lose the driving assisting effect. The above functions are turned on in any case, and the prompt to the driver in unnecessary time may not be effective and may cause the driver to be confused.
Disclosure of Invention
Aiming at the problems in the prior art, the invention provides the vehicle exterior sound prompting method and device, which can improve the driving assisting effect and flexibly match the requirements of users.
The embodiment of the invention provides a method for prompting a sound outside a vehicle, which comprises the following steps:
step 104, collecting sound in an environment outside the vehicle;
step 106, identifying whether the collected sound contains a preset sound signal, and further determining the type of the sound source if the collected sound contains the preset sound signal; the preset sound signal is a sound signal influencing the running of the vehicle;
and 108, when the recognized sound contains a preset sound signal, positioning a sound source emitting the preset sound signal, and determining the position and the driving direction of the sound source relative to the vehicle.
Step 110 presents the identified sound source type and the location of the sound source relative to the vehicle to the driver.
Preferably, before step 104, step 102 is further included, in which it is determined whether a condition for activating the vehicle exterior sound prompt function is satisfied, and if the condition is satisfied, the vehicle exterior sound prompt function is activated, and step 104 is executed.
Preferably, before step 102, step 101 is further included, whether the adaptive activation vehicle exterior sound prompting function is started or not is judged, if the function is started, step 102 is executed, otherwise step 104 is executed.
Preferably, step 109 is further included before step 110 and after step 108, and the method determines whether or not to present to the driver, and executes step 110 when the driver needs to be presented.
Preferably, when steps 101 and 102 are not included, before step 104, the method further includes step 100 of determining whether the user turns on the out-of-vehicle voice prompt function, and when the user turns on the function, step 104 is executed.
Preferably, when the method does not include step 101 and includes step 102, before step 102, the method further includes step 100 of determining whether the user turns on the out-of-vehicle sound prompt function, and when the user turns on the function, executing step 102.
Preferably, when the method includes step 101, before step 101, the method further includes step 100 of determining whether the user turns on the out-of-vehicle sound prompt function, and when the user turns on the function, executing step 101.
Preferably, step 110 specifically includes: and/or displaying the type of the recognized sound source and the position of the sound source relative to the vehicle in real time to the driver, and stopping displaying when the sound source is far away from the vehicle or does not have a potential safety hazard to the vehicle in running.
Preferably, in step 102, the determining whether the condition for activating the out-vehicle sound prompt function is satisfied includes:
judging whether the vehicle is driven at night, if so, meeting the condition;
and/or judging whether the vehicle runs on the expressway, if so, meeting the condition;
and/or judging whether the driving time of the driver exceeds the preset driving time or not, if so, meeting the condition;
and/or, judging whether the vehicle is about to pass through the intersection, and meeting the condition when the vehicle is about to pass through the intersection;
and/or judging whether the running speed of the vehicle exceeds a preset speed or not, and meeting the condition when the running speed exceeds the preset speed;
and/or judging whether the vehicle drives on the congested road section, if so, not meeting the condition;
and/or judging whether other people except the driver are included in the vehicle or not, and if so, meeting the condition.
Preferably, the step 109 of determining whether to prompt the driver includes determining whether the sound source satisfies a condition for warning the vehicle, wherein the warning condition includes
When the preset sound signal is used for a police car, an ambulance, a fire truck and an engineering rescue vehicle, the warning condition is met;
alternatively, the first and second electrodes may be,
when the sound source is positioned right behind the vehicle and is adjacent to the vehicle, or the sound source is positioned right in front of the vehicle, the warning condition is met;
alternatively, the first and second electrodes may be,
when the sound source is positioned behind the vehicle in a lane adjacent to the vehicle and the driving direction of the sound source is opposite to that of the vehicle, the warning condition is not met;
alternatively, the first and second electrodes may be,
when the sound source is positioned behind the vehicle in a lane adjacent to the vehicle and the driving directions are the same, judging whether the distance between the sound source and the vehicle is increased or decreased, and when the distance is decreased, meeting the warning condition, and when the distance is increased, not meeting the warning condition;
alternatively, the first and second electrodes may be,
when the sound source is in a lane adjacent to the vehicle and is parallel to the vehicle, the warning condition is met;
alternatively, the first and second electrodes may be,
when the sound source is positioned in front of the side of the vehicle and the driving direction of the vehicle is the same, judging whether the sound source is ready to be merged into a lane where the vehicle is positioned, if so, meeting the warning condition;
alternatively, the first and second electrodes may be,
when the vehicle runs at the intersection, the sound source is adjacent to the vehicle, and then the warning condition is met.
The embodiment of the invention also provides an outside-vehicle sound prompt device, which comprises a sound acquisition module, a sound identification module, a sound source positioning module and a prompt module, wherein,
a sound collection module for collecting sound in an environment outside the vehicle;
the voice recognition module is used for recognizing whether the voice collected by the voice collection module contains a preset voice signal or not, and further determining the type of the sound source if the voice contains the preset voice signal; the preset sound signal is a sound signal influencing the running of the vehicle;
the sound source positioning module is used for positioning a sound source emitting a preset sound signal when the sound identification module identifies that the sound collected by the sound collection module contains the preset sound signal, and determining the position and the driving direction of the sound source relative to the vehicle;
and the prompting module is used for prompting the identified sound source type and the position of the sound source relative to the vehicle to the driver.
Preferably, the device further comprises a triggering module, configured to determine whether a condition for activating the sound prompt device outside the vehicle is satisfied, and if the condition is satisfied, activate the sound prompt device outside the vehicle, and trigger the sound collection module to collect sounds in an environment outside the vehicle.
Preferably, the apparatus further comprises an adaptive activation module for turning on or off the triggering module.
Preferably, the device further comprises a judging module for judging whether to prompt the driver after the sound source positioning module positions the sound source, and when prompting to the driver is needed, triggering the prompting module to prompt the driver with the identified sound source type and the position of the sound source relative to the vehicle,
the prompting module is further used for prompting the identified sound source type and the position of the sound source relative to the vehicle to the driver according to the trigger signal of the judging module.
Preferably, the device further comprises a switch module for switching the device on or off.
Preferably, the prompting module comprises: the voice prompt module is used for prompting the type of the sound source and the position of the sound source relative to the vehicle to the driver in a voice mode, and/or the prompt module comprises a display module which is used for displaying the position of the sound source relative to the vehicle to the driver in real time, and when the sound source is far away from the vehicle or does not have potential safety hazard to the vehicle in running, the display is stopped.
Preferably, the judging whether the condition for activating the out-vehicle sound prompt function is satisfied includes:
judging whether the vehicle is driven at night, if so, meeting the condition;
and/or judging whether the vehicle runs on the expressway, if so, meeting the condition;
and/or judging whether the driving time of the driver exceeds the preset driving time or not, if so, meeting the condition;
and/or, judging whether the vehicle is about to pass through the intersection, and meeting the condition when the vehicle is about to pass through the intersection;
and/or judging whether the running speed of the vehicle exceeds a preset speed or not, and meeting the condition when the running speed exceeds the preset speed;
and/or judging whether the vehicle drives on the congested road section, if so, not meeting the condition;
and/or judging whether other people except the driver are included in the vehicle or not, and if so, meeting the condition.
Preferably, determining whether to alert the driver includes determining whether the sound source satisfies a condition for alerting the vehicle, the alert condition including
When the preset sound signal is used for a police car, an ambulance, a fire truck and an engineering rescue vehicle, the warning condition is met;
alternatively, the first and second electrodes may be,
when the sound source is positioned right behind the vehicle and is adjacent to the vehicle, or the sound source is positioned right in front of the vehicle, the warning condition is met;
alternatively, the first and second electrodes may be,
when the sound source is positioned behind the vehicle in a lane adjacent to the vehicle and the driving direction of the sound source is opposite to that of the vehicle, the warning condition is not met;
alternatively, the first and second electrodes may be,
when the sound source is positioned behind the vehicle in a lane adjacent to the vehicle and the driving directions are the same, judging whether the distance between the sound source and the vehicle is increased or decreased, and when the distance is decreased, meeting the warning condition, and when the distance is increased, not meeting the warning condition;
alternatively, the first and second electrodes may be,
when the sound source is in a lane adjacent to the vehicle and is parallel to the vehicle, the warning condition is met;
alternatively, the first and second electrodes may be,
when the sound source is positioned in front of the side of the vehicle and the driving direction of the vehicle is the same, judging whether the sound source is ready to be merged into a lane where the vehicle is positioned, if so, meeting the warning condition;
alternatively, the first and second electrodes may be,
when the vehicle runs at the intersection, the sound source is adjacent to the vehicle, and then the warning condition is met.
An embodiment of the invention provides a vehicle comprising the device.
An embodiment of the present invention provides a computer device, which includes a processor and a memory, where the memory stores computer instructions executable by the processor, and when the processor executes the computer instructions, the method as described above is implemented.
An embodiment of the present invention provides a computer-readable storage medium, which is characterized by storing computer instructions for implementing the method described above.
By the method and the device for prompting the sound outside the vehicle, the effect of the function on assisting the driving of the driver can be improved, the driver can be more accurately served, the requirements of users can be flexibly matched, the driving assisting applicability can achieve more diversified effect, the driving safety can be enhanced, and the user experience degree can be improved.
Drawings
FIG. 1 is a method for out-of-vehicle audible prompting in one embodiment of the present invention.
Fig. 2 is a device for sound prompt outside the vehicle in an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, embodiments of the present invention will be described in detail with reference to the accompanying drawings.
Fig. 1 is a vehicle exterior sound prompt method according to an embodiment of the present invention, including the following steps:
step 104, collecting sounds in an environment outside the vehicle. The microphone array is arranged outside the vehicle, such as the microphone array is arranged in the front, the rear, the left and the right of the vehicle, or more microphone arrays are arranged and distributed at different positions outside the vehicle.
Step 106, identifying whether the collected sound contains a preset sound signal, and if so, further determining the type of the sound source, such as a motor vehicle, a bicycle, and the like. The preset sound signal is a sound signal affecting the running of the vehicle, such as a whistle sound of other vehicles.
There are multiple sound in the environment outside the vehicle, like wind sound, the sound that the vehicle wen, the sound that the pedestrian spoken etc. after sound collection module gathered sound, sound identification module analyzed the judgement to sound, judged whether the sound of gathering contains predetermined sound signal, carried out follow-up operation again when containing predetermined sound, can effectively reduce like this and indicate to driver's unnecessary.
And 108, when the recognized sound contains a preset sound signal, positioning a sound source emitting the preset sound signal, and determining the position and the driving direction of the sound source relative to the vehicle. The sound source can be positioned by adopting a method in the prior art, for example, a microphone array sound source positioning technology is adopted to position the sound source, and a camera is utilized to determine the driving direction of the sound source.
Step 110 presents the identified sound source type and the location of the sound source relative to the vehicle to the driver.
Preferably, the method includes prompting the driver in a voice mode, and/or displaying the type of the sound source and the position of the sound source relative to the vehicle in real time to the driver, and stopping displaying when the sound source is far away from the vehicle or does not have a potential safety hazard when the vehicle runs.
Preferably, before step 104, step 102 is further included, in which it is determined whether a condition for activating the vehicle exterior sound prompt function is satisfied, if the condition is satisfied, the vehicle exterior sound prompt function is activated, and step 104 is executed, otherwise, the vehicle exterior sound prompt function is not activated. The determining step 102 may be executed in real time or periodically, and the step 102 is executed when a preset time period is met, where the preset time period may be set by a user or set by the user when the user leaves a factory. By executing the step 102 in real time or periodically executing the step 102, whether the function needs to be activated can be known in time, and the driving assistance effect is improved.
Judging whether the conditions for activating the sound prompt function outside the vehicle are met comprises the following steps:
and judging whether the vehicle is driven at night, if so, meeting the condition.
When a driver drives at night, a visual blind area is easy to generate, the accuracy of judging the sound direction is also reduced, and when the driver drives at night, the sound prompting device outside the vehicle is activated, so that the driving safety can be improved.
And/or judging whether the vehicle runs on the expressway, and if so, meeting the condition.
When a vehicle is traveling on a highway, the speed of the vehicle is usually very fast, and special attention is required when other vehicles approach the vehicle to prevent traffic accidents.
And/or judging whether the driving time of the driver exceeds the preset driving time or not, and if so, meeting the condition. The preset driving time can be set by the user or set when the user leaves the factory. If the driver continues driving for a long time, the response sensitivity to the external sound may be lowered, and in this case, the driver may be assisted by activating the external sound presentation device.
And/or judging whether the vehicle is about to pass through the intersection or not, and meeting the conditions when the vehicle is about to pass through the intersection. When the vehicle runs and passes through the intersection, other vehicles can be in parallel connection, overtaking and turning, or roadside vehicles can be converged into a lane, pedestrians, non-motor vehicles and the like can cross roads, and the like, so that the device is activated to help the driver to drive and quickly react to the external environment.
And/or judging whether the running speed of the vehicle exceeds a preset speed or not, and meeting the condition when the running speed exceeds the preset speed. The preset speed can be set by the user or set when the user leaves the factory. When the vehicle runs fast, the driver needs to react to various conditions quickly, and the device is activated, so that the driver can be effectively assisted to drive the vehicle.
And/or judging whether the vehicle drives on the congested road section, if so, not meeting the condition. To the highway section that blocks up, the vehicle speed of traveling is slow, and the driver is usually paid attention to comparatively concentrating, can be special attention to the peripheral condition of vehicle, need not the device and carry out extra warning this moment, excessively reminds under this kind of condition moreover and can make the driver mood more fidgety, is unfavorable for driving safety.
And/or judging whether other people except the driver are included in the vehicle or not, and if so, meeting the condition. When other people are included in the vehicle, the attention of the driver is easily distracted, and the device can be activated to assist the driver in driving.
When a plurality of persons are included in the vehicle, it is further determined whether the driver is in a chat state with other persons for a continuous period of time, and when the period of time exceeds a predetermined length of time, the condition is satisfied.
By executing step 102, the effect of providing the driver with the driving assistance function only when necessary can be achieved, so that the attention of the driver to the prompt is higher, and the driving safety is better facilitated.
Preferably, before step 102, step 101 is further included, whether the adaptive activation vehicle exterior sound prompting function is started or not is judged, if the function is started, step 102 is executed, otherwise step 104 is executed.
Because different drivers have different requirements, such as novice drivers, the driver hopes to obtain more help when driving, the sound prompt function outside the vehicle is always in an activated state, and for the driver skilled in driving, the function is only needed to assist driving under specific conditions, in order to meet the requirements of different drivers, a user can turn on or turn off the self-adaptive activated sound prompt function outside the vehicle according to the self-requirements, so that the function can better meet the requirements of the driver.
Preferably, before step 110, after step 108, step 109 is further included, which determines whether to prompt the driver, and when the driver needs to be prompted, step 110 is executed, otherwise, when the method includes step 102, step 102 is executed, and when step 102 is not included, step 104 is executed.
The method comprises the steps that whistling of other vehicles around the vehicle, for example, some vehicles have warning effect on the vehicle, and some vehicles have no warning effect, after a sound source is positioned, whether the driver is prompted is determined by judging whether the sound source meets the condition for warning the vehicle, when the warning condition is met, the driver is prompted, otherwise, the driver is not prompted.
Wherein judging whether the sound source satisfies a condition for warning the vehicle includes
When the preset sound signal is used for a police car, an ambulance, a fire truck, an engineering rescue vehicle and a sanitation vehicle, the alarm condition is met;
when the vehicle runs into a police car, an ambulance, a fire truck, an engineering rescue vehicle and a sanitation vehicle, the police car, the ambulance, the fire truck, the engineering rescue vehicle and the sanitation vehicle execute public affairs, and when the sound source is the vehicle, the police car, the ambulance, the engineering rescue vehicle and the sanitation vehicle remind a driver in time, so that the driver can reasonably avoid the vehicle.
Alternatively, the first and second electrodes may be,
when the sound source is positioned right behind the vehicle and is adjacent to the vehicle, or the sound source is positioned right in front of the vehicle, the warning condition is met;
when the sound source is in above-mentioned position, when it makes sound, if whistle, the probability that causes the influence to driver's driving is higher, therefore in time reminds the driver, is favorable to safe driving.
Alternatively, the first and second electrodes may be,
when the sound source is positioned behind the vehicle in a lane adjacent to the vehicle and the driving direction of the sound source is opposite to that of the vehicle, the warning condition is not met;
for the sound source of the type, the sound source is usually used for warning other vehicles when emitting sound, and cannot cause certain influence on the driving of the vehicle, so that the sound source with the characteristics is ignored and is not prompted.
Alternatively, the first and second electrodes may be,
when the sound source is positioned behind the vehicle in a lane adjacent to the vehicle and the driving directions are the same, judging whether the distance between the sound source and the vehicle is increased or decreased, and when the distance is decreased, meeting the warning condition, and when the distance is increased, not meeting the warning condition;
since the sound source is traveling in the same direction as the host vehicle, when the host vehicle approaches the host vehicle, for example, if the host vehicle prepares to merge into a lane where the sound source is located, a traffic accident is likely to occur, and therefore, it is necessary to give a prompt to the driver.
Alternatively, the first and second electrodes may be,
when the sound source is in a lane adjacent to the vehicle and is parallel to the vehicle, the warning condition is met;
for the sound source of the type, the sound source is close to the vehicle, so that the prompt for the driver is favorable for driving safety.
Alternatively, the first and second electrodes may be,
when the sound source is positioned in front of the side of the vehicle and the driving direction of the vehicle is the same, whether the sound source is ready to be merged into a lane where the vehicle is positioned is judged, and if yes, the warning condition is met.
Wherein judge whether the sound source is ready to merge into the lane that the vehicle is located, can judge through following at least one mode: and judging whether the driving direction of the sound source is close to the lane where the vehicle is located, judging whether the sound source turns on a steering lamp, and indicating that the sound source is merged into the lane where the vehicle is located by the steering lamp.
For the sound source of the type, a driver needs to pay special attention to the sound source in the driving process of a vehicle, and traffic accidents such as scratch and the like caused by the sound source are prevented. The driver is reminded to prevent the occurrence of traffic accidents.
Alternatively, the first and second electrodes may be,
when the vehicle runs at the intersection, the sound source is adjacent to the vehicle, and then the warning condition is met.
As pedestrians, motor vehicles, non-motor vehicles and the like can appear when the vehicle runs at the intersection, the running conditions are changeable, and the driver can be effectively assisted by prompting the driver to ensure the driving safety.
The sound sources are further screened in the judging step, relevant prompt information is provided for the driver, the effect of the auxiliary driving function is enhanced, and the user experience is improved.
In another embodiment, when steps 101 and 102 are not included, before step 104, the method further includes step 100 of determining whether the user turns on the out-of-vehicle voice prompt function, and when the user turns on the function, executing step 104.
Different users have different requirements on the external sound prompting device, in some cases, the driver can close the function without opening the function, in some cases, the driver needs to assist in driving, the function is opened, and the user can control the opening or closing of the function according to own requirements; before the method is executed, whether the function is started by a user needs to be judged.
In another embodiment, when the method does not include step 101, includes step 102, then step 100 is performed before step 102, and step 102 is performed when the user turns on the off-board voice prompt function.
When the method includes step 101, then before step 101, step 100 is performed, and when the user turns on the function, step 101 is performed.
The vehicle exterior sound prompt method of the invention is described in detail above. By the method, the effect of assisting the driving of the driver is improved, the driver is more accurately served, and the driving assisting applicability achieves more diversified effects.
Fig. 2 is a vehicle exterior sound prompt device according to an embodiment of the present invention. The device is used for executing the method, and comprises a sound acquisition module, a sound identification module, a sound source positioning module and a prompt module.
And the sound collection module is used for collecting the sound in the environment outside the vehicle. The sound collection module can be a microphone array and is arranged outside the vehicle, such as in front, back, left and right of the vehicle, or more microphone arrays are arranged and distributed at different positions outside the vehicle.
The voice recognition module is used for recognizing whether the voice collected by the voice collection module contains a preset voice signal or not, and if the voice collected by the voice collection module contains the preset voice signal, the type of the voice source, such as a motor vehicle, a bicycle and the like, is further determined. The preset sound signal is a sound signal affecting the running of the vehicle, such as a whistle sound of other vehicles.
There are multiple sound in the environment outside the vehicle, like wind sound, the sound that the vehicle wen, the sound that the pedestrian spoken etc. after sound collection module gathered sound, sound identification module analyzed the judgement to sound, judged whether the sound of gathering contains predetermined sound signal, carried out follow-up operation again when containing predetermined sound, can effectively reduce like this and indicate to driver's unnecessary.
And the sound source positioning module is used for positioning the sound source emitting the preset sound signal and determining the position and the driving direction of the sound source relative to the vehicle when the sound identification module identifies that the sound collected by the sound collection module contains the preset sound signal.
And the prompting module is used for prompting the identified sound source type and the position of the sound source relative to the vehicle to the driver. In this embodiment, the preferred prompt module includes: the voice prompt module is used for prompting the type of the sound source and the position of the sound source relative to the vehicle to the driver in a voice mode, and/or the prompt module comprises a display module which is used for displaying the position of the sound source relative to the vehicle to the driver in real time, and when the sound source is far away from the vehicle or does not have potential safety hazard to the vehicle in running, the display is stopped.
Preferably, the device further comprises a triggering module, configured to determine whether a condition for activating the sound prompt device outside the vehicle is satisfied, if the condition is satisfied, activate the sound prompt device outside the vehicle, and trigger the sound collection module to collect sound in an environment outside the vehicle, otherwise, not activate the sound prompt device outside the vehicle. The triggering module may determine whether the activation condition is satisfied in real time, or periodically determine whether the activation condition is satisfied, and execute the determining step when a preset time period is satisfied, where the preset time period may be set by a user or set by the user when the user leaves a factory.
The judging whether the condition for activating the sound prompting device outside the vehicle is met comprises the following steps:
and judging whether the vehicle is driven at night, if so, meeting the condition.
When a driver drives at night, a visual blind area is easy to generate, the accuracy of judging the sound direction is also reduced, and when the driver drives at night, the sound prompting device outside the vehicle is activated, so that the driving safety can be improved.
And/or judging whether the vehicle runs on the expressway, and if so, meeting the condition.
When a vehicle is traveling on a highway, the speed of the vehicle is usually very fast, and special attention is required when other vehicles approach the vehicle to prevent traffic accidents.
And/or judging whether the driving time of the driver exceeds the preset driving time or not, and if so, meeting the condition. If the driver continues driving for a long time, the response sensitivity to the external sound may be lowered, and in this case, the driver may be assisted by activating the external sound presentation device.
And/or judging whether the vehicle is about to pass through the intersection or not, and meeting the conditions when the vehicle is about to pass through the intersection. When the vehicle runs and passes through the intersection, other vehicles can be in parallel connection, overtaking and turning, or roadside vehicles can be converged into a lane, pedestrians, non-motor vehicles and the like can cross roads, and the like, so that the device is activated to help the driver to drive and quickly react to the external environment.
And/or judging whether the running speed of the vehicle exceeds a preset speed or not, and meeting the condition when the running speed exceeds the preset speed. The preset speed can be set by the user or set when the user leaves the factory. When the vehicle runs fast, the driver needs to react to various conditions quickly, and the device is activated to effectively assist the driver in driving the vehicle.
And/or judging whether the vehicle drives on the congested road section, if so, not meeting the condition. To the highway section that blocks up, the vehicle speed of traveling is slow, and the driver is usually more concentrated attention, can be especially careful about the condition of vehicle periphery vehicle, need not the device and carry out extra warning this moment, excessively reminds under this kind of condition moreover and can make the driver mood more fidgety, is unfavorable for driving safety.
And/or judging whether other people except the driver are included in the vehicle or not, and if so, meeting the condition. When other people are included in the vehicle, the attention of the driver is easily distracted, and the device can be activated to assist the driver in driving.
When a plurality of persons are included in the vehicle, it is further determined whether the driver is in a chat state with other persons for a continuous period of time, and when the period of time exceeds a predetermined length of time, the condition is satisfied.
Preferably, the device further includes a judging module, configured to judge whether to prompt the driver after the sound source positioning module positions the sound source, and when the driver needs to be prompted, trigger the prompting module to prompt the driver of the identified sound source type and the position of the sound source relative to the vehicle, where the prompting module is further configured to prompt the driver of the identified sound source type and the position of the sound source relative to the vehicle according to a trigger signal of the judging module.
The method comprises the steps that whistling of other vehicles around the vehicle, for example, some vehicles have warning effect on the vehicle, and some vehicles have no warning effect, after a sound source is positioned, whether the driver is prompted is determined by judging whether the sound source meets the condition for warning the vehicle, when the warning condition is met, the driver is prompted, otherwise, the driver is not prompted.
The condition for judging whether the vehicle is warned is determined to be met or not
When the preset sound signal is used for a police car, an ambulance, a fire truck, an engineering rescue vehicle and a sanitation vehicle, the alarm condition is met;
alternatively, the first and second electrodes may be,
when the sound source is positioned right behind the vehicle and is adjacent to the vehicle, or the sound source is positioned right in front of the vehicle, the warning condition is met;
alternatively, the first and second electrodes may be,
when the sound source is positioned behind the vehicle in a lane adjacent to the vehicle and the driving direction of the sound source is opposite to that of the vehicle, the warning condition is not met;
alternatively, the first and second electrodes may be,
when the sound source is positioned behind the vehicle in a lane adjacent to the vehicle and the driving directions are the same, judging whether the distance between the sound source and the vehicle is increased or decreased, and when the distance is decreased, meeting the warning condition, and when the distance is increased, not meeting the warning condition;
alternatively, the first and second electrodes may be,
when the sound source is in a lane adjacent to the vehicle and is parallel to the vehicle, the warning condition is met;
alternatively, the first and second electrodes may be,
when the sound source is positioned in front of the side of the vehicle and the driving direction of the vehicle is the same, whether the sound source is ready to be merged into a lane where the vehicle is positioned is judged, and if yes, the warning condition is met.
Wherein judge whether the sound source is ready to merge into the lane that the vehicle is located, can judge through following at least one mode: and judging whether the driving direction of the sound source is close to the lane where the vehicle is located, judging whether the sound source turns on a steering lamp, and indicating that the sound source is merged into the lane where the vehicle is located by the steering lamp.
Alternatively, the first and second electrodes may be,
when the vehicle runs at the intersection, the sound source is adjacent to the vehicle, and then the warning condition is met.
Preferably, the apparatus further comprises an adaptive activation module for turning on or off the triggering module. Through the function, the user can select the function started by the device according to the self requirement, and the effect of meeting the requirements of different drivers is achieved.
Preferably, the device further comprises a switch module for switching the device on or off. Different users are different to the demand of car outer sound prompt device, and under some circumstances, the driver need not open this function, through switch module, and the driver can open or close the device according to the demand control of oneself.
The invention also provides a vehicle, which comprises the vehicle exterior sound prompt device.
The invention also provides a computer device comprising a processor and a memory storing computer instructions executable by the processor, which when executed by the processor, implement a method as described above.
The present invention also provides a computer readable storage medium storing computer instructions for implementing the method as described above.
Any combination of one or more computer-readable media may be employed. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. The computer-readable storage medium may include: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), a flash memory, an erasable programmable read-only memory (EPROM), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
Computer program code for carrying out operations of the present invention may be written in one or more programming languages, or a combination thereof.
The above description is only an example for the convenience of understanding the present invention, and is not intended to limit the scope of the present invention. In the specific implementation, a person skilled in the art may change, add, or reduce the components of the apparatus according to the actual situation, and may change, add, reduce, or change the order of the steps of the method according to the actual situation without affecting the functions implemented by the method.
While embodiments of the invention have been shown and described, it will be understood by those skilled in the art that: various changes, modifications, substitutions and alterations can be made to the embodiments without departing from the principles and spirit of the invention, the scope of which is defined by the claims and their equivalents, and all changes that come within the meaning and range of equivalency of the claims are to be embraced within their scope.
Claims (14)
1. A method for vehicle exterior voice prompt is characterized by comprising the following steps:
step 102, judging whether the vehicle comprises other people except the driver in real time, if so, judging whether the driver is in a chatting state with other people in a continuous time period, and starting to collect the sound in the environment outside the vehicle when the time period exceeds a preset time length;
determining the driving direction of a sound source which emits a preset sound signal relative to a vehicle;
when a sound source emitting a preset sound signal is positioned behind a vehicle in a lane adjacent to the vehicle and the driving directions are the same, judging whether the distance between the sound source and the vehicle is increased or decreased, and when the distance is decreased, meeting a warning condition and prompting the type of the recognized sound source and the position of the sound source relative to the vehicle to a driver; when the sound source emitting the preset sound signal is positioned behind the vehicle and the driving direction is opposite to the vehicle, the condition for warning the vehicle is not met, and the identified sound source type and the position of the sound source relative to the vehicle are not prompted to a driver.
2. The method of claim 1,
before step 102, step 101 is further included, whether the self-adaptive activated vehicle exterior sound prompt function is started or not is judged, and if the function is started, step 102 is executed.
3. The method of claim 1,
the manner of presenting the identified sound source type and the position of the sound source relative to the vehicle to the driver includes: and/or displaying the type of the recognized sound source and the position of the sound source relative to the vehicle in real time to the driver, and stopping displaying when the sound source is far away from the vehicle or does not have a potential safety hazard to the vehicle in running.
4. The method of claim 1,
in step 102, the conditions for initiating collection of sounds in the environment outside the vehicle further comprise:
judging whether the vehicle is driven at night, if so, meeting the condition;
and/or judging whether the vehicle runs on the expressway, if so, meeting the condition;
and/or judging whether the driving time of the driver exceeds the preset driving time or not, if so, meeting the condition;
and/or, judging whether the vehicle is about to pass through the intersection, and meeting the condition when the vehicle is about to pass through the intersection;
and/or judging whether the running speed of the vehicle exceeds a preset speed or not, and meeting the condition when the running speed exceeds the preset speed;
and/or judging whether the vehicle drives on the congested road section, if so, not meeting the condition.
5. The method of claim 1,
the condition for warning the vehicle further comprises
When the preset sound signal is used for a police car, an ambulance, a fire truck and an engineering rescue vehicle, the warning condition is met;
alternatively, the first and second electrodes may be,
when the sound source is positioned right behind the vehicle and is adjacent to the vehicle, or the sound source is positioned right in front of the vehicle, the warning condition is met;
alternatively, the first and second electrodes may be,
when the sound source is positioned behind the vehicle in a lane adjacent to the vehicle and the driving directions are the same, judging whether the distance between the sound source and the vehicle is increased or decreased, and when the distance is increased, not meeting the warning condition;
alternatively, the first and second electrodes may be,
when the sound source is in a lane adjacent to the vehicle and is parallel to the vehicle, the warning condition is met;
alternatively, the first and second electrodes may be,
when the sound source is positioned in front of the side of the vehicle and the driving direction of the vehicle is the same, judging whether the sound source is ready to be merged into a lane where the vehicle is positioned, if so, meeting the warning condition;
alternatively, the first and second electrodes may be,
when the vehicle runs at the intersection, the sound source is adjacent to the vehicle, and the warning condition is met;
when the warning condition is satisfied, the recognized sound source type and the position of the sound source relative to the vehicle are prompted to the driver.
6. A sound prompt device outside a vehicle comprises a trigger module, a sound acquisition module, a sound source positioning module and a prompt module, wherein,
the triggering module is used for judging whether the driver in the vehicle comprises other personnel in real time, if so, judging whether the driver is in a chatting state with other personnel in a continuous time period, and when the time period exceeds a preset time length, meeting the condition of activating the sound prompting device outside the vehicle, and triggering the sound acquisition module to acquire the sound in the environment outside the vehicle;
the sound source positioning module is used for determining the driving direction of a sound source which emits a preset sound signal relative to the vehicle;
the judging module is used for judging whether the distance between a sound source and the vehicle is increased or decreased when the sound source emitting the preset sound signal is positioned behind the vehicle in a lane adjacent to the vehicle and the driving directions are the same, meeting the warning condition when the distance is decreased, and prompting the identified sound source type and the position of the sound source relative to the vehicle to a driver; when the driving direction of the sound source sending the preset sound signal is opposite to that of the vehicle, the condition for warning the vehicle is not met, and the prompting module is not triggered to prompt the driver of the type of the identified sound source and the position of the sound source relative to the vehicle.
7. The apparatus of claim 6,
the device also comprises an adaptive activation module for turning on or off the trigger module.
8. The apparatus of claim 6,
the device also includes a switch module for turning the device on or off.
9. The apparatus of claim 6,
the prompt module comprises: the voice prompt module is used for prompting the type of the sound source and the position of the sound source relative to the vehicle to the driver in a voice mode, and/or the prompt module comprises a display module which is used for displaying the position of the sound source relative to the vehicle to the driver in real time, and when the sound source is far away from the vehicle or does not have potential safety hazard to the vehicle in running, the display is stopped.
10. The apparatus according to one of claims 6 to 9,
the conditions for activating the off-board audible prompting device further include:
judging whether the vehicle is driven at night, if so, meeting the activation condition;
and/or judging whether the vehicle runs on the expressway, if so, meeting the activation condition;
and/or judging whether the driving time of the driver exceeds the preset driving time or not, if so, meeting the activation condition;
and/or, judging whether the vehicle is about to pass through the intersection, and meeting the activation condition when the vehicle is about to pass through the intersection;
and/or judging whether the running speed of the vehicle exceeds a preset speed or not, and meeting an activation condition when the running speed exceeds the preset speed;
and/or judging whether the vehicle drives on the congested road section, if so, not meeting the activation condition.
11. The apparatus according to one of claims 6 to 9,
the condition for warning the vehicle further comprises
When the preset sound signal is used for a police car, an ambulance, a fire truck and an engineering rescue vehicle, the warning condition is met;
alternatively, the first and second electrodes may be,
when the sound source is positioned right behind the vehicle and is adjacent to the vehicle, or the sound source is positioned right in front of the vehicle, the warning condition is met;
alternatively, the first and second electrodes may be,
when the sound source is positioned behind the vehicle in a lane adjacent to the vehicle and the driving directions are the same, judging whether the distance between the sound source and the vehicle is increased or decreased, and when the distance is increased, not meeting the warning condition;
alternatively, the first and second electrodes may be,
when the sound source is in a lane adjacent to the vehicle and is parallel to the vehicle, the warning condition is met;
alternatively, the first and second electrodes may be,
when the sound source is positioned in front of the side of the vehicle and the driving direction of the vehicle is the same, judging whether the sound source is ready to be merged into a lane where the vehicle is positioned, if so, meeting the warning condition;
alternatively, the first and second electrodes may be,
when the vehicle runs at the intersection, the sound source is adjacent to the vehicle, and the warning condition is met;
when the warning condition is met, the judging module triggers the prompting module to prompt the driver of the recognized sound source type and the position of the sound source relative to the vehicle;
the prompting module is further used for prompting the identified sound source type and the position of the sound source relative to the vehicle to the driver according to the trigger signal of the judging module.
12. A vehicle, characterized in that it comprises a device according to any one of claims 6-11.
13. A computer device comprising a processor and a memory, the memory storing computer instructions executable by the processor, the computer instructions when executed by the processor performing the method of any one of claims 1 to 5.
14. A computer-readable storage medium storing computer instructions for implementing the method of any one of claims 1-5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811603594.XA CN109606260B (en) | 2018-12-26 | 2018-12-26 | Method and device for prompting sound outside vehicle |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811603594.XA CN109606260B (en) | 2018-12-26 | 2018-12-26 | Method and device for prompting sound outside vehicle |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109606260A CN109606260A (en) | 2019-04-12 |
| CN109606260B true CN109606260B (en) | 2020-12-11 |
Family
ID=66012482
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811603594.XA Active CN109606260B (en) | 2018-12-26 | 2018-12-26 | Method and device for prompting sound outside vehicle |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109606260B (en) |
Families Citing this family (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113829994B (en) * | 2020-06-08 | 2023-11-21 | 广州汽车集团股份有限公司 | Early warning method and device based on car external whistling, car and medium |
| CN111785057A (en) * | 2020-06-23 | 2020-10-16 | 大众问问(北京)信息科技有限公司 | Method and device for prompting emergency and vehicle |
| CN113997946B (en) * | 2020-07-28 | 2024-03-01 | 博泰车联网科技(上海)股份有限公司 | Intelligent control method for auxiliary driving, vehicle-mounted terminal and storage medium |
| CN112706692B (en) * | 2020-11-12 | 2022-12-23 | 东风汽车集团有限公司 | Car blind area pedestrian warning system of saving oneself and vehicle |
| CN112706691B (en) * | 2020-12-25 | 2022-11-29 | 奇瑞汽车股份有限公司 | Vehicle reminding method and device |
| CN112874534A (en) * | 2021-01-29 | 2021-06-01 | 朝阳聚声泰（信丰）科技有限公司 | Method for improving driving safety |
| CN112995844A (en) * | 2021-02-26 | 2021-06-18 | 歌尔科技有限公司 | Sound playing method and sound playing device |
| CN114056249A (en) * | 2021-11-15 | 2022-02-18 | 合众新能源汽车有限公司 | Sound delivery system and method |
| CN116161051A (en) * | 2022-12-27 | 2023-05-26 | 小米汽车科技有限公司 | Warning method, device, equipment, medium and vehicle for vehicle driver |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1253044A2 (en) * | 2001-04-25 | 2002-10-30 | Sumitomo Wiring Systems, Ltd. | Buzzer driving apparatus |
| CN102303563A (en) * | 2011-06-16 | 2012-01-04 | 广东铁将军防盗设备有限公司 | System and method for prewarning front vehicle collision |
| CN204990724U (en) * | 2015-09-30 | 2016-01-20 | 广州国业电子科技有限公司 | Monitoring system of behavioural habits is driven in improvement |
| CN108275156A (en) * | 2018-03-27 | 2018-07-13 | 斑马网络技术有限公司 | Driving behavior detection method, storage medium, equipment and vehicle |
Family Cites Families (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| AU2003225228A1 (en) * | 2002-05-03 | 2003-11-17 | Donnelly Corporation | Object detection system for vehicle |
| US7720580B2 (en) * | 2004-12-23 | 2010-05-18 | Donnelly Corporation | Object detection system for vehicle |
| CN101140704A (en) * | 2006-09-08 | 2008-03-12 | 松下电器产业株式会社 | Direction testing apparatus |
| JP2011232293A (en) * | 2010-04-30 | 2011-11-17 | Toyota Motor Corp | Vehicle exterior sound detection device |
| JP5298155B2 (en) * | 2011-04-15 | 2013-09-25 | トヨタ自動車株式会社 | Approaching vehicle detection device and approaching vehicle detection method |
| JPWO2014102938A1 (en) * | 2012-12-26 | 2017-01-12 | トヨタ自動車株式会社 | Sound detection device and sound detection method |
| CN104908645A (en) * | 2015-06-08 | 2015-09-16 | 上海斐讯数据通信技术有限公司 | Auxiliary vehicle driving system and working method thereof |
| CN105150932A (en) * | 2015-09-11 | 2015-12-16 | 北汽福田汽车股份有限公司 | Automobile and reminding system and method for sounds outside automobile |
| CN106023617A (en) * | 2016-06-01 | 2016-10-12 | 乐视控股（北京）有限公司 | Vehicle driving safety detection method and vehicle driving safety detection device |
| US10276187B2 (en) * | 2016-10-19 | 2019-04-30 | Ford Global Technologies, Llc | Vehicle ambient audio classification via neural network machine learning |
| US11244564B2 (en) * | 2017-01-26 | 2022-02-08 | Magna Electronics Inc. | Vehicle acoustic-based emergency vehicle detection |
| CN107089184A (en) * | 2017-03-24 | 2017-08-25 | 北京长城华冠汽车科技股份有限公司 | The outer alarming device of car and method |
| CN108597524B (en) * | 2018-05-02 | 2021-03-19 | 福建省汽车工业集团云度新能源汽车股份有限公司 | Automobile voice recognition prompting device and method |
| CN108986806A (en) * | 2018-06-30 | 2018-12-11 | 上海爱优威软件开发有限公司 | Sound control method and system based on Sounnd source direction |
-
2018
- 2018-12-26 CN CN201811603594.XA patent/CN109606260B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1253044A2 (en) * | 2001-04-25 | 2002-10-30 | Sumitomo Wiring Systems, Ltd. | Buzzer driving apparatus |
| CN102303563A (en) * | 2011-06-16 | 2012-01-04 | 广东铁将军防盗设备有限公司 | System and method for prewarning front vehicle collision |
| CN204990724U (en) * | 2015-09-30 | 2016-01-20 | 广州国业电子科技有限公司 | Monitoring system of behavioural habits is driven in improvement |
| CN108275156A (en) * | 2018-03-27 | 2018-07-13 | 斑马网络技术有限公司 | Driving behavior detection method, storage medium, equipment and vehicle |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109606260A (en) | 2019-04-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109606260B (en) | Method and device for prompting sound outside vehicle | |
| US11027750B2 (en) | Method and system for assisting drivers to drive with precaution | |
| CN107787282B (en) | Cognitive driver assistance with variable assistance for automated vehicles | |
| CN109334566B (en) | Method, device, equipment and storage medium for providing feedback outside vehicle | |
| WO2020024743A1 (en) | Smart driving control method and device, vehicle, electronic apparatus, medium, and product | |
| RU2018116570A (en) | SYSTEM AND METHOD FOR AUTOMATIC ENTRY IN ACTION OF A SIGN OF ASSISTANCE TO DRIVER | |
| JP5429180B2 (en) | Driving support apparatus and method | |
| US10068472B2 (en) | Automotive lane discipline system, method, and apparatus | |
| WO2016049812A1 (en) | Automatic parking warning system | |
| JP6772428B2 (en) | Programs for self-driving cars and self-driving cars | |
| WO2018211583A1 (en) | Vehicle and vehicle program | |
| US20190367016A1 (en) | Method and system for assisting drivers to drive with precaution | |
| JP2020042778A (en) | Method, apparatus, device and storage medium for passing unmanned vehicle at intersection | |
| US20090005988A1 (en) | Vehicle pursuit caution light | |
| JP2006163828A (en) | Alarm device for vehicle, and method of alarming ambient condition of vehicle | |
| WO2018168121A1 (en) | Driving state determination device, driving state determination method, and program for determination of driving state | |
| CN112298024B (en) | Avoidance reminding system and method, vehicle and computer storage medium | |
| CN109987095A (en) | Driving assistance system and method | |
| WO2018076850A1 (en) | Method and device for automatic prompting of overtaking action of vehicle | |
| WO2018168097A1 (en) | Driving state determination device, driving state determination method, and program for determining driving state | |
| CN115593308A (en) | Vehicle prompt tone control method, system and storage medium | |
| JP2019117624A (en) | On-vehicle device, communication system, and motivation system | |
| CN114572232A (en) | Attention assistance for dynamic blind zones accompanying the state of the driver during driving | |
| JP5862461B2 (en) | Vehicle notification sound control device | |
| JP2020203681A (en) | Automatic driving vehicle and program for automatic driving vehicle |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |