US20180208113A1 - Acoustic warning signal detection for motor vehicles - Google Patents
Acoustic warning signal detection for motor vehicles Download PDFInfo
- Publication number
- US20180208113A1 US20180208113A1 US15/876,864 US201815876864A US2018208113A1 US 20180208113 A1 US20180208113 A1 US 20180208113A1 US 201815876864 A US201815876864 A US 201815876864A US 2018208113 A1 US2018208113 A1 US 2018208113A1
- Authority
- US
- United States
- Prior art keywords
- vehicle
- sound
- amplitude
- motor vehicle
- threshold
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000001514 detection method Methods 0.000 title description 5
- 238000000034 method Methods 0.000 claims abstract description 49
- 230000009471 action Effects 0.000 claims abstract description 17
- 230000004044 response Effects 0.000 claims abstract description 6
- 230000003213 activating effect Effects 0.000 claims 1
- 230000008901 benefit Effects 0.000 description 4
- 239000002184 metal Substances 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 206010011469 Crying Diseases 0.000 description 1
- 206010016275 Fear Diseases 0.000 description 1
- 206010039203 Road traffic accident Diseases 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000002996 emotional effect Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/16—Anti-collision systems
- G08G1/166—Anti-collision systems for active traffic, e.g. moving vehicles, pedestrians, bikes
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- B60Q9/00—Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00, e.g. haptic signalling
- B60Q9/008—Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00, e.g. haptic signalling for anti-collision purposes
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- B60Q9/00—Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00, e.g. haptic signalling
- B60Q9/002—Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00, e.g. haptic signalling for parking purposes, e.g. for warning the driver that his vehicle has contacted or is about to contact an obstacle
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W10/00—Conjoint control of vehicle sub-units of different type or different function
- B60W10/18—Conjoint control of vehicle sub-units of different type or different function including control of braking systems
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W10/00—Conjoint control of vehicle sub-units of different type or different function
- B60W10/20—Conjoint control of vehicle sub-units of different type or different function including control of steering systems
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W30/00—Purposes of road vehicle drive control systems not related to the control of a particular sub-unit, e.g. of systems using conjoint control of vehicle sub-units
- B60W30/08—Active safety systems predicting or avoiding probable or impending collision or attempting to minimise its consequences
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W50/08—Interaction between the driver and the control system
- B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01H—MEASUREMENT OF MECHANICAL VIBRATIONS OR ULTRASONIC, SONIC OR INFRASONIC WAVES
- G01H17/00—Measuring mechanical vibrations or ultrasonic, sonic or infrasonic waves, not provided for in the preceding groups
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/16—Anti-collision systems
- G08G1/167—Driving aids for lane monitoring, lane changing, e.g. blind spot detection
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W30/00—Purposes of road vehicle drive control systems not related to the control of a particular sub-unit, e.g. of systems using conjoint control of vehicle sub-units
- B60W30/08—Active safety systems predicting or avoiding probable or impending collision or attempting to minimise its consequences
- B60W2030/082—Vehicle operation after collision
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W50/08—Interaction between the driver and the control system
- B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
- B60W2050/143—Alarm means
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2420/00—Indexing codes relating to the type of sensors based on the principle of their operation
- B60W2420/54—Audio sensitive means, e.g. ultrasound
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2520/00—Input parameters relating to overall vehicle dynamics
- B60W2520/06—Direction of travel
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2520/00—Input parameters relating to overall vehicle dynamics
- B60W2520/10—Longitudinal speed
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2540/00—Input parameters relating to occupants
- B60W2540/18—Steering angle
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S15/00—Systems using the reflection or reradiation of acoustic waves, e.g. sonar systems
- G01S15/88—Sonar systems specially adapted for specific applications
- G01S15/93—Sonar systems specially adapted for specific applications for anti-collision purposes
- G01S15/931—Sonar systems specially adapted for specific applications for anti-collision purposes of land vehicles
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S15/00—Systems using the reflection or reradiation of acoustic waves, e.g. sonar systems
- G01S15/88—Sonar systems specially adapted for specific applications
- G01S15/93—Sonar systems specially adapted for specific applications for anti-collision purposes
- G01S15/931—Sonar systems specially adapted for specific applications for anti-collision purposes of land vehicles
- G01S2015/932—Sonar systems specially adapted for specific applications for anti-collision purposes of land vehicles for parking operations
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/16—Anti-collision systems
- G08G1/168—Driving aids for parking, e.g. acoustic or visual feedback on parking space
Definitions
- the present invention relates to the detection of acoustic warning signals, for example warning vocalizations by a road user or knocking signals caused by a road user knocking on the vehicle body.
- the warning signals may be triggered by road users who are outside the vehicle and are attempting to alert the driver of the vehicle to their presence.
- the vehicle comprises an apparatus for detecting the presence of another road user in the immediate vicinity of the side of the vehicle with the aid of distance sensors which are fitted to the side of the vehicle.
- acoustic sensors for example microphones, which are fastened to a side of a trailer in order to make warning cries from other road users, for example, audible to the driver.
- the document U.S. Pat. No. 7,876,645 B2 discloses a system and a method for detecting obstacles for vehicles.
- the document U.S. Pat. No. 6,100,796 likewise relates to an obstacle detection system in a motor vehicle.
- the document U.S. Pat. No. 7,868,748 B2 discloses a collision detection sensor for a vehicle.
- the object of the present invention is to provide an advantageous method for operating a motor vehicle, which method improves the safety of cyclists and pedestrians or other road users with respect to a collision with the motor vehicle.
- a disclosed embodiment of a method for operating a motor vehicle relates to a motor vehicle which comprises at least one sensor for detecting acoustic signals generated outside the vehicle.
- the method comprises the following steps: an acoustic signal, preferably an acoustic signal generated outside the vehicle, is detected by means of the sensor.
- the detected acoustic signal(s) may have been generated, for example, by a road user outside the vehicle.
- the detected acoustic signal is classified as a warning signal if the detected signal has defined features.
- the speed of the vehicle is determined.
- the steering angle of the vehicle is determined.
- An action to be carried out by means of the motor vehicle in response to the detected warning signal is defined or determined.
- the defined action of the motor vehicle in response to the detected warning signal is carried out if the speed of the vehicle undershoots a defined threshold value and the steering angle of the vehicle exceeds a defined threshold value.
- the stated order of the method steps is not compulsory.
- the speed and the steering angle can be determined at the same time or in any desired order.
- the disclosed embodiments include equipping the vehicle with one or more sensors, which make it possible to detect, for example, warning cries (vocalizations) or cries for help from cyclists or pedestrians or to detect signs of an impact on the vehicle body caused by a cyclist or pedestrian knocking on the body of the vehicle, and of then causing a quick and adequate reaction of the vehicle or of the driver causing said reaction after the driver has been accordingly notified.
- warning cries vocalizations
- cries for help from cyclists or pedestrians or to detect signs of an impact on the vehicle body caused by a cyclist or pedestrian knocking on the body of the vehicle
- the action to be carried out as part of the method preferably comprises outputting a warning message to the driver of the vehicle. Additionally or alternatively, the action to be carried out may comprise braking and/or stopping the vehicle. Furthermore, the action to be carried out may additionally or alternatively comprise steering the vehicle, preferably steering the vehicle in a direction which leads away from the direction from which the warning signal was emitted. This keeps the vehicle away from imminent danger, for example a collision with a cyclist or pedestrian. In the case of an autonomous vehicle, the actions mentioned can be carried out automatically.
- the amplitude or the sound pressure level and/or the frequency of the detected signal is/are determined.
- An amplitude threshold value is also defined, and a detected acoustic signal is qualified or considered or classified as a warning signal if the amplitude of the detected signal exceeds the amplitude threshold value.
- a frequency threshold value is defined, and a detected acoustic signal is qualified or classified as a warning signal if the frequency of the detected signal exceeds the frequency threshold value.
- the amplitude, preferably the average amplitude, of the ambient noises, that is to say of the traffic noise for example can be determined.
- the amplitude threshold value can be defined on the basis of the amplitude of the ambient noises or traffic noise.
- the vehicle may comprise a body and the acoustic signal may be detected with the aid of a sensor which is fitted to the body.
- the vehicle may comprise a structure-borne sound sensor and the acoustic signal may be detected with the aid of the latter.
- the structure-borne sound sensor may be in the form of a knocking or impact sensor.
- the structure-borne sound sensor may preferably be fitted to an underside of the trunk lid or else on or below the sheet metal of the body at another location of the vehicle.
- the vehicle may comprise an antenna and the acoustic signal may be detected with the aid of a sensor which is fitted to the antenna or is integrated in the antenna.
- the antenna may be arranged on the roof of the motor vehicle, for example.
- the vehicle comprises parking assistance sensors or position sensors or parking aid sensors, in particular for determining the distance between an object and the vehicle.
- the parking assistance sensors or alternatively mentioned sensors can be used to define the actions to be carried out, for example to determine the position of the warning signal source or the position of a road user with respect to the vehicle and/or to determine the distance between the warning signal source or a road user generating the warning signal and the vehicle.
- the frequency pattern of the detected signal is determined.
- the frequency pattern is compared with reference frequency patterns.
- a signal is characterized or classified as a warning signal if it corresponds to a reference pattern within a defined deviation.
- the detected acoustic signal can be recorded for a particular period. This makes it possible to distinguish human warning cries from other ambient noises, for example. In particular, it is also possible to distinguish between “normal” cries which occur during conventional road traffic and cries which indicate a dangerous situation.
- a first criterion for detecting a cry in road traffic may be the amplitude or the volume of the acoustic signal (decibels).
- An amplitude or volume peak threshold value of the traffic noise can be measured a short period of time after detecting a warning signal.
- the measured amplitude peak threshold value or the maximum ambient volume can be stored and updated.
- the amplitude peak threshold value can be updated at regular intervals.
- the amplitude or volume need not be the main criterion for reliably detecting a warning cry from a road user.
- the special characteristic of a voice is likewise a suitable criterion.
- the characteristic of the voice of a road user contains information relating to his emotional state. In particular, the intonation of the voice changes if the road user fears something. The voice then becomes shaky and changes to a higher pitch. For example, voice stress analysis is able to detect the typical shaking of the frequency of the voice. This can be represented with the aid of a graph.
- the partial increase in the frequency can be used as a second criterion for detecting a warning cry. If both criteria are preferably satisfied, the method can separate out normal cries and possible misuse.
- the motor vehicle according to the invention is characterized in that it is designed to carry out the method according to the invention described above. It therefore has the same advantages and features as the method already described.
- the vehicle comprises at least one sensor for detecting acoustic signals generated outside the vehicle. These may be, for example, sensors which are designed to detect knocking signals (impacts) and/or cries for help from road users.
- the vehicle may also comprise a body and at least one sensor may be arranged on the body.
- vehicle may comprise a trunk lid or a roof and at least one sensor may be arranged on an underside of the trunk lid or underside of the roof of the vehicle.
- vehicle may comprise an antenna and at least one sensor may be arranged on the antenna or may be integrated in the antenna. At least one sensor may be in the form of a structure-borne sound sensor.
- the motor vehicle may preferably comprise a signal analysis module for determining the amplitude and/or the frequency of the detected signal.
- the motor vehicle used within the scope of the method according to the invention and the motor vehicle according to the invention may be a passenger vehicle or an autonomous vehicle.
- FIG. 1 schematically shows a plan view of a motor vehicle according to the invention when using the method according to the invention to protect a cyclist.
- FIG. 2 schematically shows a plan view of a further embodiment variant of a motor vehicle according to the invention when carrying out the method according to the invention in order to protect a pedestrian.
- FIG. 3 schematically shows a variant of the method according to the invention in the form of a flowchart.
- FIG. 4 schematically shows a further embodiment variant of a method according to the invention in the form of a flowchart.
- FIG. 1 schematically shows a plan view of a motor vehicle 1 .
- the motor vehicle is a passenger vehicle or an autonomous motor vehicle.
- the motor vehicle 1 moves along on a road 8 in a direction of travel.
- the road is bounded by a sidewalk 2 .
- a road user 3 on a bicycle 7 likewise moves along on the road in the direction of travel of the motor vehicle 1 .
- the bicycle 7 with the road user 7 is between the motor vehicle 1 and the sidewalk 2 .
- the road user 3 perceives he is in danger of being pushed against the sidewalk 2 by the vehicle 1 . He therefore knocks against the body of the vehicle 1 .
- the motor vehicle 1 is equipped with an acoustic sensor in the form of a structure-borne sound sensor or knocking/impact sensor 4 .
- the acoustic sensor 4 is preferably fastened under the trunk lid or else on or under the sheet metal of the body at a different location.
- the vehicle also comprises a number of parking assistance sensors 5 .
- the parking assistance sensors 5 are configured in such a manner that they detect an object, the bicycle 7 and the cyclist 3 in the present example, in the immediate environment of the vehicle 1 .
- the parking assistance sensors 5 are configured in such a manner that they can determine the position and the distance of the detected object, the cyclist 3 and the bicycle 7 in the example below, from the motor vehicle 1 .
- the motor vehicle 1 is further equipped with a signal analysis module 9 and a driver assistance system 30 .
- Signal analysis module 9 receives signals from the sensor 4 and (in a manner well known to persons of skill in the art) determines relevant characteristics (amplitude and/or frequency, for example) of the sound detected by the sensor 4 .
- Driver assistance system 30 is of the general type that is well known in the art and generates vehicle control interventions (steering and braking, for example) based upon inputs it receives from numerous sensors and systems throughout the vehicle. Most pertinent to the present disclosed invention, included in these sensors/systems are the parking assistance sensors 5 , signal analysis module 9 , steering angle sensor, and speedometer.
- FIG. 2 shows a further traffic situation with a motor vehicle 1 according to the invention, in which the method according to the invention can be used.
- the motor vehicle 1 according to the invention turns right into a side road.
- a pedestrian 3 is in the process of leaving the sidewalk 2 and crossing the road into which the motor vehicle 1 has just turned. The pedestrian 3 feels threatened by the vehicle 1 and therefore utters a warning cry.
- the vehicle 1 comprises an acoustic sensor 6 .
- the acoustic sensor 6 is preferably designed to detect ambient noises and, in particular, loud cries from road users.
- the motor vehicle 1 also comprises an antenna which is arranged on the motor vehicle 1 in the example shown.
- the acoustic sensor 6 also called a warning cry sensor, is integrated in the antenna of the vehicle 1 or is fitted to said antenna.
- the vehicle 1 shown in FIG. 2 also has the parking assistance sensors 5 already described in connection with FIG. 1 .
- a vehicle 1 according to the invention has one or more on-board sensors.
- one of the sensors may be an acoustic sensor for detecting warning cries which have been uttered, in particular, by cyclists or pedestrians.
- FIG. 2 One example of this is shown in FIG. 2 .
- the vehicle can react to a detected warning cry, for example by means of braking or steering in a direction which is safer for the affected road user 3 .
- the vehicle 1 could be steered somewhat to the left.
- the turning operation could be stopped and/or the vehicle 1 could be steered slightly more to the left.
- the parking assistance sensors 5 which are present on the vehicle and are arranged around the vehicle, for example, can be advantageously used to detect a road user 3 , for example a pedestrian or cyclist, behind or beside the vehicle and to control the action to be carried out, for example a steering maneuver into a position which is less dangerous for the road user.
- the second sensor mentioned may be an acoustic sensor for detecting signs of an impact (knocking or strikes) on a piece of metal of the vehicle, for example the body, or against the windows of the vehicle. If a pedestrian or a cyclist or other road user is able to knock against the vehicle body, this indicates that he is very close to the vehicle. He is possibly in danger and draws attention to himself in this manner, that is to say by knocking or striking the vehicle with hand/arms and/or feet/legs. As already described in connection with the first sensor (warning cry sensor), the vehicle can react to the detected knocking/impact signal, for example by means of braking or by means of a steering maneuver in a direction which is safer for the road user.
- the vehicle according to the invention may comprise both an acoustic sensor 4 , as described in connection with FIG. 1 , and an acoustic sensor 6 , as described in connection with FIG. 2 , for example.
- step 10 a check is carried out in order to determine whether the vehicle is being operated autonomously. As already mentioned, this step is optional. In the example shown in FIG. 3 , the process returns to the starting block 10 if no autonomous driving has been activated. If autonomous driving has been activated, a check is then carried out in step 12 in order to determine whether the vehicle speed is less than a defined threshold speed. If this is not the case, the method returns to the start 10 . If the vehicle speed is less than the threshold speed, a check is then carried out in step 13 in order to determine whether the steering angle or steering wheel angle is greater than a defined threshold angle or the vehicle is reversing. If this is not the case, the method returns to the start 10 .
- the acoustic sensors 4 and/or 6 on the vehicle 1 are read in step 14 . If a signal is detected in step 15 , a warning message is output to the driver or the vehicle is stopped in step 16 . If a signal has not been detected in step 15 , the method returns to the start 10 .
- a steering maneuver or another suitable measure may also be initiated.
- a further embodiment variant for a method according to the invention, in particular in connection with the detection of warning cries, is described below on the basis of FIG. 4 .
- the method can be used both for autonomous driving and for driving controlled by a driver.
- step 24 the recorded signal is then compared with “warning cries” which are recorded in advance and are typical of situations of fear and dangerous situations.
- a check is carried out in step 25 in order to determine whether the recorded signal corresponds to the reference signals, that is to say the reference warning cries recorded in advance, or corresponds taking into account a previously defined permissible deviation. If this is not the case, the recording is deleted in step 27 . If there is correspondence, the driver of the vehicle 1 is warned and/or interaction with the autonomous vehicle is carried out in step 26 .
- steps 12 and 13 can be swapped with one another in the example shown in FIG. 3 . If necessary, step 14 can also be carried out before or between steps 12 and 13 .
- step 21 can also be carried out before step 20 and step 22 can be carried out before or between steps 20 and 21 .
Landscapes
- Engineering & Computer Science (AREA)
- Mechanical Engineering (AREA)
- Transportation (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Automation & Control Theory (AREA)
- General Physics & Mathematics (AREA)
- Chemical & Material Sciences (AREA)
- Combustion & Propulsion (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computational Linguistics (AREA)
- Traffic Control Systems (AREA)
- Emergency Alarm Devices (AREA)
Abstract
Description
- This application claims foreign priority benefits under 35 U.S.C. § 119(a)-(d) to
DE Application 10 2017 200 961.6 filed Jan. 20, 2017, which is hereby incorporated by reference in its entirety. - The present invention relates to the detection of acoustic warning signals, for example warning vocalizations by a road user or knocking signals caused by a road user knocking on the vehicle body. The warning signals may be triggered by road users who are outside the vehicle and are attempting to alert the driver of the vehicle to their presence.
- Passenger vehicles are nowadays typically moved by drivers who attempt to take into account and coordinate all influences on the road and influences from other vehicles by acting and reacting. This process requires the full attention of the driver. This is a great challenge, as proved by the number of accidents. In the meantime, autonomously driving vehicles and driver assistance systems which support driving safety have been developed. Examples of these are lane keeping assistance systems (lane keeping assistant), a lane change assistant, a blind spot assistant (blind spot support), a braking assistant (active city stop) and further systems.
- Hitherto, there has been no assistance system which reacts to pedestrians or cyclists who are in danger of being put at risk by the vehicle. The document US 2007/0067081 A1 discloses a device for avoiding traffic accidents in which at least one motorized vehicle is involved. In this case, the vehicle comprises an apparatus for detecting the presence of another road user in the immediate vicinity of the side of the vehicle with the aid of distance sensors which are fitted to the side of the vehicle. Provision is also made of acoustic sensors, for example microphones, which are fastened to a side of a trailer in order to make warning cries from other road users, for example, audible to the driver.
- The document U.S. Pat. No. 7,876,645 B2 discloses a system and a method for detecting obstacles for vehicles. The document U.S. Pat. No. 6,100,796 likewise relates to an obstacle detection system in a motor vehicle. The document U.S. Pat. No. 7,868,748 B2 discloses a collision detection sensor for a vehicle.
- Against this background, the object of the present invention is to provide an advantageous method for operating a motor vehicle, which method improves the safety of cyclists and pedestrians or other road users with respect to a collision with the motor vehicle.
- A disclosed embodiment of a method for operating a motor vehicle relates to a motor vehicle which comprises at least one sensor for detecting acoustic signals generated outside the vehicle. The method comprises the following steps: an acoustic signal, preferably an acoustic signal generated outside the vehicle, is detected by means of the sensor. The detected acoustic signal(s) may have been generated, for example, by a road user outside the vehicle. The detected acoustic signal is classified as a warning signal if the detected signal has defined features. The speed of the vehicle is determined. The steering angle of the vehicle is determined. An action to be carried out by means of the motor vehicle in response to the detected warning signal is defined or determined. The defined action of the motor vehicle in response to the detected warning signal is carried out if the speed of the vehicle undershoots a defined threshold value and the steering angle of the vehicle exceeds a defined threshold value.
- In principle, the stated order of the method steps is not compulsory. For example, the speed and the steering angle can be determined at the same time or in any desired order.
- The disclosed embodiments include equipping the vehicle with one or more sensors, which make it possible to detect, for example, warning cries (vocalizations) or cries for help from cyclists or pedestrians or to detect signs of an impact on the vehicle body caused by a cyclist or pedestrian knocking on the body of the vehicle, and of then causing a quick and adequate reaction of the vehicle or of the driver causing said reaction after the driver has been accordingly notified.
- The action to be carried out as part of the method preferably comprises outputting a warning message to the driver of the vehicle. Additionally or alternatively, the action to be carried out may comprise braking and/or stopping the vehicle. Furthermore, the action to be carried out may additionally or alternatively comprise steering the vehicle, preferably steering the vehicle in a direction which leads away from the direction from which the warning signal was emitted. This keeps the vehicle away from imminent danger, for example a collision with a cyclist or pedestrian. In the case of an autonomous vehicle, the actions mentioned can be carried out automatically.
- In one advantageous disclosed embodiment of a method, the amplitude or the sound pressure level and/or the frequency of the detected signal is/are determined. An amplitude threshold value is also defined, and a detected acoustic signal is qualified or considered or classified as a warning signal if the amplitude of the detected signal exceeds the amplitude threshold value. Additionally or alternatively, a frequency threshold value is defined, and a detected acoustic signal is qualified or classified as a warning signal if the frequency of the detected signal exceeds the frequency threshold value. For example, the amplitude, preferably the average amplitude, of the ambient noises, that is to say of the traffic noise for example, can be determined. In this case, the amplitude threshold value can be defined on the basis of the amplitude of the ambient noises or traffic noise.
- In principle, the vehicle may comprise a body and the acoustic signal may be detected with the aid of a sensor which is fitted to the body. In particular, the vehicle may comprise a structure-borne sound sensor and the acoustic signal may be detected with the aid of the latter. In this case, the structure-borne sound sensor may be in the form of a knocking or impact sensor. The structure-borne sound sensor may preferably be fitted to an underside of the trunk lid or else on or below the sheet metal of the body at another location of the vehicle. Additionally or alternatively, the vehicle may comprise an antenna and the acoustic signal may be detected with the aid of a sensor which is fitted to the antenna or is integrated in the antenna. The antenna may be arranged on the roof of the motor vehicle, for example.
- In one advantageous variant, the vehicle comprises parking assistance sensors or position sensors or parking aid sensors, in particular for determining the distance between an object and the vehicle. The parking assistance sensors or alternatively mentioned sensors can be used to define the actions to be carried out, for example to determine the position of the warning signal source or the position of a road user with respect to the vehicle and/or to determine the distance between the warning signal source or a road user generating the warning signal and the vehicle. This has the advantage that sensors which are already present in the vehicle are also used to carry out the present method and no additional costs for sensors which possibly need to be retrofitted therefore become necessary.
- In one variant which is preferred, for example, for detecting warning cries from road users, the frequency pattern of the detected signal is determined. The frequency pattern is compared with reference frequency patterns. A signal is characterized or classified as a warning signal if it corresponds to a reference pattern within a defined deviation.
- The detected acoustic signal can be recorded for a particular period. This makes it possible to distinguish human warning cries from other ambient noises, for example. In particular, it is also possible to distinguish between “normal” cries which occur during conventional road traffic and cries which indicate a dangerous situation.
- A first criterion for detecting a cry in road traffic may be the amplitude or the volume of the acoustic signal (decibels). An amplitude or volume peak threshold value of the traffic noise can be measured a short period of time after detecting a warning signal. The measured amplitude peak threshold value or the maximum ambient volume can be stored and updated. In principle, the amplitude peak threshold value can be updated at regular intervals.
- It is also possible to distinguish between “normal” traffic noise from vehicles and human voices. The characteristic of a human voice makes this possible. The frequency of a voice is unique and can be compared with other traffic noise frequencies. If a cry from a road user has a higher amplitude or volume than the defined amplitude threshold value, this can be identified as part of the method.
- The amplitude or volume need not be the main criterion for reliably detecting a warning cry from a road user. The special characteristic of a voice is likewise a suitable criterion. The characteristic of the voice of a road user contains information relating to his emotional state. In particular, the intonation of the voice changes if the road user fears something. The voice then becomes shaky and changes to a higher pitch. For example, voice stress analysis is able to detect the typical shaking of the frequency of the voice. This can be represented with the aid of a graph. The partial increase in the frequency can be used as a second criterion for detecting a warning cry. If both criteria are preferably satisfied, the method can separate out normal cries and possible misuse.
- The motor vehicle according to the invention is characterized in that it is designed to carry out the method according to the invention described above. It therefore has the same advantages and features as the method already described. The vehicle comprises at least one sensor for detecting acoustic signals generated outside the vehicle. These may be, for example, sensors which are designed to detect knocking signals (impacts) and/or cries for help from road users.
- The vehicle may also comprise a body and at least one sensor may be arranged on the body. In particular, vehicle may comprise a trunk lid or a roof and at least one sensor may be arranged on an underside of the trunk lid or underside of the roof of the vehicle. Additionally or alternatively, the vehicle may comprise an antenna and at least one sensor may be arranged on the antenna or may be integrated in the antenna. At least one sensor may be in the form of a structure-borne sound sensor.
- The motor vehicle may preferably comprise a signal analysis module for determining the amplitude and/or the frequency of the detected signal.
- In principle, the motor vehicle used within the scope of the method according to the invention and the motor vehicle according to the invention may be a passenger vehicle or an autonomous vehicle.
- Further features, properties and advantages of the present invention are described in more detail below on the basis of exemplary embodiments with reference to the accompanying figures. Elements which correspond to one another in the figures are denoted using the same reference numerals. All features described previously and below are advantageous both individually and in any desired combination with one another. The exemplary embodiments described below are only examples which do not, however, restrict the subject matter of the invention.
-
FIG. 1 schematically shows a plan view of a motor vehicle according to the invention when using the method according to the invention to protect a cyclist. -
FIG. 2 schematically shows a plan view of a further embodiment variant of a motor vehicle according to the invention when carrying out the method according to the invention in order to protect a pedestrian. -
FIG. 3 schematically shows a variant of the method according to the invention in the form of a flowchart. -
FIG. 4 schematically shows a further embodiment variant of a method according to the invention in the form of a flowchart. - As required, detailed embodiments of the present invention are disclosed herein; however, it is to be understood that the disclosed embodiments are merely exemplary of the invention that may be embodied in various and alternative forms. The figures are not necessarily to scale; some features may be exaggerated or minimized to show details of particular components. Therefore, specific structural and functional details disclosed herein are not to be interpreted as limiting, but merely as a representative basis for teaching one skilled in the art to variously employ the present invention.
-
FIG. 1 schematically shows a plan view of amotor vehicle 1. The motor vehicle is a passenger vehicle or an autonomous motor vehicle. Themotor vehicle 1 moves along on a road 8 in a direction of travel. The road is bounded by asidewalk 2. - Furthermore, a road user 3 on a bicycle 7 likewise moves along on the road in the direction of travel of the
motor vehicle 1. In this case, the bicycle 7 with the road user 7 is between themotor vehicle 1 and thesidewalk 2. The road user 3 perceives he is in danger of being pushed against thesidewalk 2 by thevehicle 1. He therefore knocks against the body of thevehicle 1. - The
motor vehicle 1 is equipped with an acoustic sensor in the form of a structure-borne sound sensor or knocking/impact sensor 4. The acoustic sensor 4 is preferably fastened under the trunk lid or else on or under the sheet metal of the body at a different location. The vehicle also comprises a number ofparking assistance sensors 5. Theparking assistance sensors 5 are configured in such a manner that they detect an object, the bicycle 7 and the cyclist 3 in the present example, in the immediate environment of thevehicle 1. In an advantageous configuration variant, theparking assistance sensors 5 are configured in such a manner that they can determine the position and the distance of the detected object, the cyclist 3 and the bicycle 7 in the example below, from themotor vehicle 1. - The
motor vehicle 1 is further equipped with asignal analysis module 9 and adriver assistance system 30.Signal analysis module 9 receives signals from the sensor 4 and (in a manner well known to persons of skill in the art) determines relevant characteristics (amplitude and/or frequency, for example) of the sound detected by the sensor 4.Driver assistance system 30 is of the general type that is well known in the art and generates vehicle control interventions (steering and braking, for example) based upon inputs it receives from numerous sensors and systems throughout the vehicle. Most pertinent to the present disclosed invention, included in these sensors/systems are theparking assistance sensors 5,signal analysis module 9, steering angle sensor, and speedometer. -
FIG. 2 shows a further traffic situation with amotor vehicle 1 according to the invention, in which the method according to the invention can be used. In the variant illustrated, themotor vehicle 1 according to the invention turns right into a side road. A pedestrian 3 is in the process of leaving thesidewalk 2 and crossing the road into which themotor vehicle 1 has just turned. The pedestrian 3 feels threatened by thevehicle 1 and therefore utters a warning cry. - The
vehicle 1 comprises an acoustic sensor 6. The acoustic sensor 6 is preferably designed to detect ambient noises and, in particular, loud cries from road users. Themotor vehicle 1 also comprises an antenna which is arranged on themotor vehicle 1 in the example shown. In the present embodiment variant, the acoustic sensor 6, also called a warning cry sensor, is integrated in the antenna of thevehicle 1 or is fitted to said antenna. Furthermore, thevehicle 1 shown inFIG. 2 also has theparking assistance sensors 5 already described in connection withFIG. 1 . - In principle, a
vehicle 1 according to the invention has one or more on-board sensors. In this case, one of the sensors may be an acoustic sensor for detecting warning cries which have been uttered, in particular, by cyclists or pedestrians. One example of this is shown inFIG. 2 . When carrying out the method according to the invention, the vehicle can react to a detected warning cry, for example by means of braking or steering in a direction which is safer for the affected road user 3. In the example shown inFIG. 1 , thevehicle 1 could be steered somewhat to the left. In the example shown inFIG. 2 , the turning operation could be stopped and/or thevehicle 1 could be steered slightly more to the left. - In connection with detected warning cries, a distinction is made between “normal” cries which regularly occur in road traffic and warning cries which indicate a dangerous situation within the scope of the method according to the invention. The
parking assistance sensors 5 which are present on the vehicle and are arranged around the vehicle, for example, can be advantageously used to detect a road user 3, for example a pedestrian or cyclist, behind or beside the vehicle and to control the action to be carried out, for example a steering maneuver into a position which is less dangerous for the road user. - The second sensor mentioned may be an acoustic sensor for detecting signs of an impact (knocking or strikes) on a piece of metal of the vehicle, for example the body, or against the windows of the vehicle. If a pedestrian or a cyclist or other road user is able to knock against the vehicle body, this indicates that he is very close to the vehicle. He is possibly in danger and draws attention to himself in this manner, that is to say by knocking or striking the vehicle with hand/arms and/or feet/legs. As already described in connection with the first sensor (warning cry sensor), the vehicle can react to the detected knocking/impact signal, for example by means of braking or by means of a steering maneuver in a direction which is safer for the road user.
- In principle, the vehicle according to the invention may comprise both an acoustic sensor 4, as described in connection with
FIG. 1 , and an acoustic sensor 6, as described in connection withFIG. 2 , for example. - An example of the method according to the invention is described below on the basis of
FIG. 3 . Although the method is described by way of example for an autonomous driving mode, it can similarly also be used for non-autonomous driving. - The method begins in
step 10. In step 11, a check is carried out in order to determine whether the vehicle is being operated autonomously. As already mentioned, this step is optional. In the example shown inFIG. 3 , the process returns to the startingblock 10 if no autonomous driving has been activated. If autonomous driving has been activated, a check is then carried out instep 12 in order to determine whether the vehicle speed is less than a defined threshold speed. If this is not the case, the method returns to thestart 10. If the vehicle speed is less than the threshold speed, a check is then carried out instep 13 in order to determine whether the steering angle or steering wheel angle is greater than a defined threshold angle or the vehicle is reversing. If this is not the case, the method returns to thestart 10. If the steering angle is greater than the defined threshold angle, the acoustic sensors 4 and/or 6 on thevehicle 1 are read instep 14. If a signal is detected instep 15, a warning message is output to the driver or the vehicle is stopped instep 16. If a signal has not been detected instep 15, the method returns to thestart 10. As an alternative to the reaction measures mentioned, that is to say the warning of the driver or the stopping of the vehicle, a steering maneuver or another suitable measure may also be initiated. - A further embodiment variant for a method according to the invention, in particular in connection with the detection of warning cries, is described below on the basis of
FIG. 4 . In this variant too, the method can be used both for autonomous driving and for driving controlled by a driver. - A check is first of all carried out in
step 20 in order to determine whether the vehicle speed is less than a defined threshold value. If this is not the case, the method is reset. If this is the case, a check is carried out instep 21 in order to determine whether the steering wheel angle is greater than a defined threshold value or the vehicle is reversing. If this is not the case, the method is reset to the start. If this is the case, a check is carried out instep 22 in order to determine whether a detected acoustic signal, for example a crying noise, has a higher amplitude or volume (for example in decibels) than a defined threshold value. This threshold value can be determined and defined, in particular, on the basis of the current traffic noise surrounding the vehicle. If this condition is not met, the method is reset to the start. If this is the case, the detected signal is recorded for a defined period, for example for several milliseconds, in step 23. - In
step 24, the recorded signal is then compared with “warning cries” which are recorded in advance and are typical of situations of fear and dangerous situations. A check is carried out instep 25 in order to determine whether the recorded signal corresponds to the reference signals, that is to say the reference warning cries recorded in advance, or corresponds taking into account a previously defined permissible deviation. If this is not the case, the recording is deleted instep 27. If there is correspondence, the driver of thevehicle 1 is warned and/or interaction with the autonomous vehicle is carried out instep 26. - In principle, individual steps of the method can also be carried out in a different order. For example, steps 12 and 13 can be swapped with one another in the example shown in
FIG. 3 . If necessary, step 14 can also be carried out before or betweensteps FIG. 4 , step 21 can also be carried out beforestep 20 and step 22 can be carried out before or betweensteps - While exemplary embodiments are described above, it is not intended that these embodiments describe all possible forms of the invention. Rather, the words used in the specification are words of description rather than limitation, and it is understood that various changes may be made without departing from the spirit and scope of the invention. Additionally, the features of various implementing embodiments may be combined to form further embodiments of the invention.
Claims (16)
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
DE102017200961 | 2017-01-20 | ||
DE102017200961.6A DE102017200961A1 (en) | 2017-01-20 | 2017-01-20 | Acoustic warning signal detection for motor vehicles |
DE102017200961.6 | 2017-01-20 |
Publications (2)
Publication Number | Publication Date |
---|---|
US20180208113A1 true US20180208113A1 (en) | 2018-07-26 |
US10343604B2 US10343604B2 (en) | 2019-07-09 |
Family
ID=62812878
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/876,864 Active US10343604B2 (en) | 2017-01-20 | 2018-01-22 | Acoustic warning signal detection for motor vehicles |
Country Status (3)
Country | Link |
---|---|
US (1) | US10343604B2 (en) |
CN (1) | CN108327626B (en) |
DE (1) | DE102017200961A1 (en) |
Cited By (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2020048807A1 (en) * | 2018-09-03 | 2020-03-12 | Robert Bosch Gmbh | Sensor apparatus for detecting acoustic signals in the surroundings of a vehicle |
US20200339068A1 (en) * | 2019-04-23 | 2020-10-29 | Volvo Car Corporation | Microphone-based vehicle passenger locator and identifier |
CN112092728A (en) * | 2020-09-10 | 2020-12-18 | 重庆长安汽车股份有限公司 | Reversing prompting system and method |
US20210232152A1 (en) * | 2018-08-22 | 2021-07-29 | Waymo Llc | Detecting and responding to sounds for autonomous vehicles |
CN113602262A (en) * | 2021-08-09 | 2021-11-05 | 郑州睿行汽车科技有限公司 | Vehicle collision protection system and method |
US20230074274A1 (en) * | 2020-01-29 | 2023-03-09 | Young Eon Kim | System and method for notifying of abnormality signal around vehicle |
US11610408B2 (en) | 2020-02-06 | 2023-03-21 | Toyota Jidosha Kabushiki Kaisha | Blind spot information acquisition device, blind spot information acquisition method, vehicle, and non-transitory storage medium |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20230107306A (en) | 2020-11-18 | 2023-07-14 | 구글 엘엘씨 | Detect and process driving event sounds during a navigation session |
DE102022003327A1 (en) * | 2022-09-09 | 2024-03-14 | Mercedes-Benz Group AG | Method and device for operating a collision avoidance device of a vehicle and vehicle |
Family Cites Families (33)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20020063008A1 (en) * | 1997-10-14 | 2002-05-30 | Hans Spies | Accident sensor |
DE19805515A1 (en) | 1998-02-11 | 1999-08-12 | Bayerische Motoren Werke Ag | Obstacle detection system in a motor vehicle |
DE10128792B4 (en) * | 2001-05-08 | 2005-06-09 | Daimlerchrysler Ag | Collision protection for vehicles |
DE10136981A1 (en) | 2001-07-30 | 2003-02-27 | Daimler Chrysler Ag | Method and device for determining a stationary and / or moving object |
CA2424708A1 (en) * | 2003-04-08 | 2004-10-08 | Lee A. Danisch | A method and apparatus for sensing impact between a vehicle and an object |
GB2400353A (en) * | 2003-04-09 | 2004-10-13 | Autoliv Dev | Pedestrian detecting system provided on a motor vehicle |
US7158051B2 (en) * | 2003-06-06 | 2007-01-02 | Ford Global Technologies, Llc | Lane changing assist system for an automotive vehicle |
WO2005036108A1 (en) * | 2003-10-09 | 2005-04-21 | Conti Temic Microelectronic Gmbh | Vehicle sensor for detecting acceleration and impact sound |
NL1024632C2 (en) | 2003-10-27 | 2005-04-28 | Intertruck Benelux B V | Device for avoiding traffic accidents involving at least one car. |
DE102004045690A1 (en) | 2003-10-29 | 2005-06-02 | Volkswagen Ag | Sound source detection device, especially for use in a motor vehicle driver assistance system, detects phase displacements or signal time of flight differences from sound sources that are detected using multiple microphones |
DE102004031557B4 (en) * | 2004-06-29 | 2016-12-22 | Conti Temic Microelectronic Gmbh | Method and crash sensor for a device for occupant-relevant activation of occupant protection devices in a motor vehicle in crash cases |
US7348895B2 (en) * | 2004-11-03 | 2008-03-25 | Lagassey Paul J | Advanced automobile accident detection, data recordation and reporting system |
ITMO20050199A1 (en) | 2005-07-29 | 2007-01-30 | Meta System Spa | SYSTEM AND METHOD OF DETECTION OF OBSTACLES FOR VEHICLES |
US7714719B2 (en) * | 2006-06-27 | 2010-05-11 | Qualcomm Incorporated | Field disturbance sensor utilizing leaky or radiating coaxial cable for a conformable antenna pattern |
DE102006032171A1 (en) | 2006-07-12 | 2008-01-24 | Bayerische Motoren Werke Ag | Motor vehicle with an automatically activated distance warning system comprises a logic unit designed so that a registration device is activated when a pre-determined steering angle is exceeded below a pre-determined vehicle speed |
DE102006040653B4 (en) * | 2006-08-30 | 2017-02-16 | Robert Bosch Gmbh | Device and method for detecting a pedestrian impact |
US8538672B2 (en) * | 2006-09-21 | 2013-09-17 | Ford Global Technologies | 2D-coil collision sensor system |
DE102007028400B3 (en) | 2007-06-15 | 2009-01-29 | Navigon Ag | Method for signalizing approach of right of vehicle to vehicle driver, involves issuing characteristics reference with warning reference, that is assigned indirectly or directly to warning reference or reference sample |
JP4403518B2 (en) | 2007-07-13 | 2010-01-27 | 株式会社デンソー | Vehicle collision detection device |
SE535225C2 (en) * | 2010-10-07 | 2012-05-29 | Scania Cv Ab | Procedure and warning system for objects in connection with a motor vehicle |
DE102011107279B4 (en) * | 2011-07-15 | 2013-10-31 | Brose Fahrzeugteile Gmbh & Co. Kommanditgesellschaft, Hallstadt | Error prevention in the gesture-controlled opening of a motor vehicle control element |
DE102011116822B4 (en) | 2011-10-25 | 2023-12-07 | Man Truck & Bus Se | Monitoring system for monitoring the surroundings of vehicles, in particular motor and/or commercial vehicles |
DE102012017532A1 (en) * | 2012-09-05 | 2014-05-15 | Wabco Gmbh | Method of operating a trailer or a truck with the system |
US9235937B1 (en) * | 2013-06-05 | 2016-01-12 | Analog Devices, Inc. | Mounting method for satellite crash sensors |
SE537621C2 (en) * | 2013-09-10 | 2015-08-11 | Scania Cv Ab | Detection of objects using a 3D camera and a radar |
DE102013226040A1 (en) | 2013-12-16 | 2015-06-18 | Continental Teves Ag & Co. Ohg | Warning device and method for warning a motor vehicle driver |
DE102014200661A1 (en) * | 2014-01-16 | 2015-07-16 | Ford Global Technologies, Llc | Detection of a parking operation of a motor vehicle |
US10293816B2 (en) * | 2014-09-10 | 2019-05-21 | Ford Global Technologies, Llc | Automatic park and reminder system and method of use |
US20160217689A1 (en) | 2015-01-26 | 2016-07-28 | Autoliv Asp, Inc. | Supplemental automotive safety method and system |
EP3936394A1 (en) * | 2015-07-02 | 2022-01-12 | Sony Group Corporation | Vehicle control device, vehicle control method, and program |
US20170210285A1 (en) * | 2016-01-26 | 2017-07-27 | Panasonic Automotive Systems Company Of America, Division Of Panasonic Corporation Of North America | Flexible led display for adas application |
US9896096B2 (en) * | 2016-04-11 | 2018-02-20 | David E. Newman | Systems and methods for hazard mitigation |
DE102016006802A1 (en) | 2016-06-03 | 2016-12-08 | Daimler Ag | Method and device for detecting at least one special signal emanating from an emergency vehicle |
-
2017
- 2017-01-20 DE DE102017200961.6A patent/DE102017200961A1/en active Pending
-
2018
- 2018-01-15 CN CN201810034964.6A patent/CN108327626B/en active Active
- 2018-01-22 US US15/876,864 patent/US10343604B2/en active Active
Cited By (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20210232152A1 (en) * | 2018-08-22 | 2021-07-29 | Waymo Llc | Detecting and responding to sounds for autonomous vehicles |
WO2020048807A1 (en) * | 2018-09-03 | 2020-03-12 | Robert Bosch Gmbh | Sensor apparatus for detecting acoustic signals in the surroundings of a vehicle |
CN112585992A (en) * | 2018-09-03 | 2021-03-30 | 罗伯特·博世有限公司 | Sensor device for detecting acoustic signals in the surroundings of a vehicle |
US20200339068A1 (en) * | 2019-04-23 | 2020-10-29 | Volvo Car Corporation | Microphone-based vehicle passenger locator and identifier |
US11608029B2 (en) * | 2019-04-23 | 2023-03-21 | Volvo Car Corporation | Microphone-based vehicle passenger locator and identifier |
US20230074274A1 (en) * | 2020-01-29 | 2023-03-09 | Young Eon Kim | System and method for notifying of abnormality signal around vehicle |
US11975733B2 (en) * | 2020-01-29 | 2024-05-07 | Young Eon Kim | System and method for notifying of abnormality signal around vehicle |
US11610408B2 (en) | 2020-02-06 | 2023-03-21 | Toyota Jidosha Kabushiki Kaisha | Blind spot information acquisition device, blind spot information acquisition method, vehicle, and non-transitory storage medium |
CN112092728A (en) * | 2020-09-10 | 2020-12-18 | 重庆长安汽车股份有限公司 | Reversing prompting system and method |
CN113602262A (en) * | 2021-08-09 | 2021-11-05 | 郑州睿行汽车科技有限公司 | Vehicle collision protection system and method |
Also Published As
Publication number | Publication date |
---|---|
US10343604B2 (en) | 2019-07-09 |
CN108327626A (en) | 2018-07-27 |
CN108327626B (en) | 2023-04-28 |
DE102017200961A1 (en) | 2018-07-26 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10343604B2 (en) | Acoustic warning signal detection for motor vehicles | |
JP5987906B2 (en) | Driving assistance device | |
US6014595A (en) | Determination of vehicle assistance from vehicle vibration that results when the vehicle contacts vibration generating structures on the road | |
US20150329043A1 (en) | Warning to a Pedestrian in Dangerous Situation | |
EP2484567B1 (en) | An onboard perception system | |
US20130110342A1 (en) | Method for pulling a vehicle into or out of a parking space and corresponding assistance system and vehicle | |
KR101478068B1 (en) | Apparatus for preventing collision in vehicle and method thereof | |
KR101963481B1 (en) | Method and device for determining an adaptive response time of vehicle driver | |
EP3150436A2 (en) | Hazard indicating system and method | |
CN112292718B (en) | Information, warning and braking request generation for steering assist functions | |
US20140172239A1 (en) | Turning guide assistant for trailer towing | |
JP6416288B2 (en) | Operation control device | |
JPWO2012147166A1 (en) | Driving assistance device | |
JP6948790B2 (en) | Methods and equipment to assist the driver | |
US7061374B2 (en) | Computer assisted danger alarm with emergency braking system | |
JP2006163828A (en) | Alarm device for vehicle, and method of alarming ambient condition of vehicle | |
JP2006301842A (en) | Driving support device of vehicle | |
JP5146288B2 (en) | Vehicle control device | |
KR102267097B1 (en) | Apparatus for detecting driving stability of vehicle and control method thereof | |
JP5469473B2 (en) | Confirmation action support device | |
KR101017010B1 (en) | Apparatus and method for alerting collision of automobile | |
JP2019111857A (en) | vehicle | |
JP2009101808A (en) | Vehicular driving support device | |
KR20230106207A (en) | Vehicle and method for performing according to at least one mode | |
KR20240031680A (en) | Apparatus and method for providing blind spot alarm |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
FEPP | Fee payment procedure |
Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
AS | Assignment |
Owner name: FORD GLOBAL TECHNOLOGIES, LLC, MICHIGAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:HAUPTS, VOLKER;HECKE, RALF;SIGNING DATES FROM 20180117 TO 20180122;REEL/FRAME:044695/0370 |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT VERIFIED |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 4 |