WO2014024247A1 - Vehicle approach alerting apparatus - Google Patents

Vehicle approach alerting apparatus Download PDF

Info

Publication number
WO2014024247A1
WO2014024247A1 PCT/JP2012/069996 JP2012069996W WO2014024247A1 WO 2014024247 A1 WO2014024247 A1 WO 2014024247A1 JP 2012069996 W JP2012069996 W JP 2012069996W WO 2014024247 A1 WO2014024247 A1 WO 2014024247A1
Authority
WO
WIPO (PCT)
Prior art keywords
notification
vehicle
unit
information
output
Prior art date
Application number
PCT/JP2012/069996
Other languages
French (fr)
Japanese (ja)
Inventor
和也 小原
Original Assignee
三菱電機株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 三菱電機株式会社 filed Critical 三菱電機株式会社
Priority to PCT/JP2012/069996 priority Critical patent/WO2014024247A1/en
Publication of WO2014024247A1 publication Critical patent/WO2014024247A1/en

Links

Images

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60QARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
    • B60Q5/00Arrangement or adaptation of acoustic signal devices
    • B60Q5/005Arrangement or adaptation of acoustic signal devices automatically actuated
    • B60Q5/008Arrangement or adaptation of acoustic signal devices automatically actuated for signaling silent vehicles, e.g. for warning that a hybrid or electric vehicle is approaching

Definitions

  • the present invention relates to a vehicle approach notification device that notifies the approach of a vehicle.
  • Electric vehicles and hybrid vehicles use an electric motor that is quieter than engine vehicles as a driving source, so noise during driving is greatly reduced and driving noise is quiet. Therefore, a pedestrian or a passenger of a light vehicle or a motorcycle may not be aware of the approach of the vehicle and may cause an accident.
  • a method for solving this problem a method is disclosed in which a notification sound for notifying the approach of a vehicle is generated by an approach notification device and the presence of the vehicle is notified to a pedestrian or a passenger of a light vehicle or a two-wheeled vehicle.
  • Patent Document 1 discloses a sound output device for an electric vehicle that controls the volume or output direction of sound generated by sound generation means based on acquired vehicle state information or surrounding information and outputs the sound to the outside of the vehicle. Yes.
  • this technique by generating sounds that are generated based on vehicle state information or surrounding information, it is possible to generate sounds that are easy for pedestrians, light vehicles, and two-wheeled vehicles to hear.
  • Patent Document 2 discloses a vehicle sounding device that controls parameters such as the type, volume, and generation timing of sound generated by the sounding means in accordance with the noise level detected by the detecting means.
  • the pedestrian when the traffic volume is high and the noise level is high, the pedestrian can be made aware of the approach of the car by sounding at a high volume, while when the traffic volume is low and the noise level is low, the volume is low. By generating a sound, it is possible to make the pedestrian recognize the approach of the car and to realize control that does not cause noise to neighboring people.
  • Patent Document 3 discloses a traveling simulated sound generating device that increases the volume of traveling simulated sound generated from traveling simulated sound generating means when a person existing around the vehicle is detected. This technology realizes the generation of simulated driving sound with a volume suitable for the environment.
  • the sound volume is controlled based on the vehicle state or the surrounding information, so that the sound level is low and the sound volume is low at the vehicle position.
  • the sound level may not be recognized at the position of a pedestrian, a light vehicle, or a two-wheeled vehicle occupant.
  • the sound is pronounced with a loud volume set depending on the surrounding noise, it is appropriate that there is a difference in recognition depending on the type of notification target, for example, a pedestrian, a light vehicle, or a two-wheeled vehicle occupant, so There was a problem that it might not be recognized.
  • the present invention has been made to solve the above-described problems.
  • the content of the notification information is switched according to the type of the notification target such as a pedestrian, a light vehicle, or a two-wheeled vehicle occupant, and the approach of the vehicle is appropriately adjusted
  • An object of the present invention is to provide a vehicle approach notification device capable of notification.
  • a vehicle approach notification device includes a moving body detection unit that detects a moving body from an image captured by a camera mounted on the vehicle, and a type determination unit that determines the type of the moving body based on a detection result of the moving body detection unit.
  • a memory unit that stores notification information determined according to the type of the mobile object, a notification information setting unit that acquires notification information corresponding to the type of the mobile object determined by the type determination unit from the memory unit, and notification information
  • an output control unit that controls output of the notification information acquired by the setting unit.
  • FIG. 1 is a schematic configuration diagram of a vehicle approach notification device according to Embodiment 1.
  • FIG. It is a block diagram which shows the structure of the vehicle approach alerting
  • FIG. It is a figure which shows the storage information of the memory part of the vehicle approach alerting
  • FIG. 3 is a flowchart showing the operation of the vehicle approach notification device according to the first embodiment. It is explanatory drawing which shows the prediction process of the behavior prediction part of the vehicle approach alerting
  • FIG. 1 is a schematic configuration diagram of a vehicle equipped with a vehicle approach notification device according to Embodiment 1 of the present invention.
  • the own vehicle 101 shown in FIG. 1 detects the distance between the camera 20 that captures the front of the vehicle, the own vehicle 101 and a pedestrian, a passenger of a light vehicle or a two-wheeled vehicle (moving body; hereinafter referred to as a notification object).
  • a distance sensor 30 such as an ultrasonic sensor or a millimeter wave radar is mounted.
  • a left speaker 40a and a right speaker 40b that generate a notification sound, a left headlight 50a and a right headlight 50b that generate visual effects, are provided at both front ends of the host vehicle 101.
  • the camera 20, the distance sensor 30, the speaker 40, and the headlight 50 are connected to the vehicle approach notification device 10 mounted on the host vehicle 101.
  • the vehicle approach notification device 10 includes a host vehicle information acquisition unit 60 that acquires host vehicle information of the host vehicle 101, and a peripheral information acquisition unit 70 that acquires current position information of the host vehicle 101 and peripheral information of the host vehicle 101 by GPS. And connected.
  • FIG. 2 is a block diagram showing the configuration of the vehicle approach notification device according to Embodiment 1 of the present invention.
  • the vehicle approach notification device 10 includes an object detection unit (moving body detection unit) 1, a memory unit 2, a control unit 3, and an output control unit 4.
  • the vehicle approach notification device 10 is connected to the camera 20, the distance sensor 30, the speaker 40, and the headlight 50 described above.
  • the own vehicle information acquisition unit 60 connected to the vehicle approach notification device 10 acquires vehicle speed information of the own vehicle, lighting information indicating whether or not the headlight is turned on, and the like, and the surrounding information acquisition unit 70 includes a navigation system 71 and the like.
  • the map information around the vehicle acquired from the above, the brightness information acquired by the illuminance sensor 72, and the noise information acquired by the sound collecting microphone 73 are acquired.
  • the object detection unit 1 performs image analysis of the captured video input from the camera 20 and determines the presence or absence of a notification object.
  • image analysis of the captured video input from the camera 20 is continuously performed, and the subsequent behavior of the detected notification object is observed.
  • the memory unit 2 stores announcement information, notification sound, volume level information indicating the output volume, and the like.
  • notification sounds pseudo engine sounds (pseudo running sounds), melodies, warning sounds, and the like are stored.
  • pseudo engine sounds paseudo running sounds
  • melodies warning sounds, and the like are stored.
  • an environmental sound a natural and comfortable sound, or a sound according to the user's preference may be stored.
  • the announcement information, the notification sound, and the volume level information are stored in association with the type of the notification object that notifies the approach of the vehicle. An example is shown in FIG.
  • FIG. 3 is a diagram showing information stored in the memory unit of the vehicle approach notification device according to Embodiment 1 of the present invention.
  • the types of notification objects are classified into “child”, “old man”, “adult”, “bicycle occupant”, “bike occupant”, and “animal”.
  • the notification object is “child”, for example, an easy-to-understand announcement for children, such as “Please drive, please be careful.” Is stored as announcement information, and a melody is stored as a notification sound.
  • volume level information indicating volume levels “2: normal” and “3: high” is stored.
  • the notification target is “old man”, the announcement that is slowly and clearly pronounced as the announcement information, for example, “A car passes, please be careful.” Is stored, and the pseudo engine sound and A warning sound is stored, and volume level information indicating volume levels “3: high” and “4: higher” is stored.
  • the notification target is “motorcycle occupant”, it is assumed that the running sound of the motorcycle is loud, so the announcement information is not stored, the pseudo engine sound and warning sound are stored as the notification sound, and the volume level Volume level information indicating “3: large” and “4: larger” is stored.
  • the information shown in FIG. 3 is appropriately combined and output according to the relationship between the notification object and the vehicle when reporting the approach of the vehicle.
  • the melody is combined so as to be output at the volume “2: normal”.
  • the announcement information is output at the volume “3: high” in addition to the melody. Combine with.
  • the notification target is “adult” or “bicycle occupant” and the image analysis accuracy of the target detection unit 1 is good, it can be determined whether the target is male or female. In this case, the announcement may be made by switching between an announcement made by a male voice and an announcement made by a female voice.
  • the control unit 3 includes an object determination unit (type determination unit) 5, a behavior prediction unit 6, a behavior detection unit 7, and a notification information setting unit 8.
  • the object determination unit 5 is detected by the object detection unit 1 based on the image analysis result input from the object detection unit 1 and the separation distance information between the host vehicle and the notification object input from the distance sensor 30.
  • the notified objects are classified according to a preset type.
  • the types to be classified are adults, children, elderly people, men, women, bicycles, motorcycles, animals, etc. as shown in FIG. This classification type can be changed and added as appropriate, and can be configured to perform finer classification when the image analysis accuracy of the object detection unit 1 is good.
  • the following method can be given as a specific method for classifying notification objects.
  • the walking stick is used based on the walking speed of the notification target or the image analysis result, it is recognized and classified as an elderly person.
  • Bicycle occupants and motorcycle occupants are classified based on the contour shape of the bicycle or motorcycle. Animals are similarly classified from contour shapes.
  • the behavior prediction unit 6 determines the traveling direction of the notification target from the image analysis result of the notification target observed by the target detection unit 1, and notifies from the determined traveling direction and the shape of the road that can be acquired from the image analysis result.
  • a walking line or a traveling line of an object (hereinafter, a walking line will be described as an example) is predicted.
  • the behavior detection unit 7 refers to the image analysis result of the notification object continuously observed by the object detection unit 1 for a predetermined period, and notifies the vehicle of the approach through the speaker 40 and the headlight 50. To detect the expected course. In addition, it is determined whether the detected course deviates from the walking line predicted by the behavior prediction unit 6. As an example of deviating from the walking line, for example, after notifying the approach of the vehicle, the notification object approaches the roadway side. Or, if the object to be notified is about to cross the road, take a path that seems to be unnoticeable to approach the vehicle, or take a path where the gait of the object to be noticed may jump out in the direction of travel of the vehicle Take it.
  • the behavior detection unit 7 determines that the detected course deviates from the predicted walking line, the behavior detection unit 7 instructs the subsequent notification information setting unit 8 to continue the notification of the approach of the vehicle. Or you may output instructions, such as raising a sound volume level or changing the combination of announcement information, a notification sound, and sound volume level information, notifying the approach of vehicles more strongly and notifying danger. On the other hand, when the danger such as contact between the notification object and the vehicle is avoided, the notification information setting unit 8 is instructed to switch to the output of the pseudo engine sound.
  • the notification information setting unit 8 acquires announcement information, notification sound, and sound volume level information associated with a corresponding type of notification target, based on the classification result of the notification target input from the target determination unit 5. . Further, the vehicle information and the light lighting information input from the own vehicle information acquisition unit 60, the map information, the brightness information, and the noise information input from the surrounding information acquisition unit 70 are referred to, and the speaker 40 is connected via the output control unit 4. The output control unit 4 sets whether to make a notification by sound output from the head ride 50, to make a notification by light emission output from the head ride 50, or to make a notification by sound output and light emission output using both the speaker 40 and the headlight 50.
  • the notification information setting unit 8 sets the output control unit 4 to continue the notification, enhance the notification, or switch to the pseudo engine sound based on the instruction input from the behavior detection unit 7.
  • the output control unit 4 performs control to switch the output destination of the notification information between the speaker 40 and the headlight 50 based on the notification method set by the notification information setting unit 8, that is, the setting of the audio output or the light emission output. Specifically, when at least one of announcement information, notification sound, and pseudo engine sound is output, control for switching to output from the speaker 40 is performed to output a sound signal and light emission such as passing a headlight. In the case of output, control to switch to the output from the headlight 50 is performed and a light emission signal is output.
  • the speaker 40 outputs the announcement information, notification sound, or pseudo engine sound set by the notification information setting unit 8 at a set volume according to the control of the output control unit 4.
  • the vehicle includes the left speaker 40a and the right speaker 40b, which information is output from the left or right speaker 40 based on the behavior input from the behavior prediction unit 6 or the behavior detection unit 7 by the notification information setting unit 8 May be configured to be output to the output control unit 4 and controlled to be output from the left speaker 40a or the right speaker 40b to which the output control unit 4 is set.
  • the headlight 50 performs a passing operation or the like according to the control of the output control unit 4.
  • the notification information setting unit 8 sets announcement information and notification sound with reference to information stored in the memory unit 2, but there are a plurality of notification objects in the image analysis result of the object detection unit 1, and the object
  • the determination unit 5 determines a plurality of types of notification objects, the degree of risk with respect to the behavior of each type of notification object (for example, a child may jump out suddenly, hereinafter referred to as behavior risk)
  • the notification information is set in accordance with the notification object having the highest behavioral risk.
  • the behavior risk level for each type of notification object is stored in advance by the object discrimination unit 5 and is ranked in the order of, for example, child> old man>adult>animal> bicycle occupant> bike occupant.
  • the notification information setting unit 8 has the highest behavioral risk. Is set to output the announcement information, notification sound and volume level information set for.
  • the notification information setting unit 8 determines that the vehicle is traveling in a residential area from the map information acquired by the surrounding information acquisition unit 70, or from the brightness information at night If it is determined that the vehicle is traveling, it is set to notify the approach of the vehicle only by the passing operation of the headlight 50, and control in consideration of noise to the surroundings can be performed. Furthermore, the setting of only the passing operation of the headlight 50 described above is performed only for a notification target (for example, an adult, an animal, etc.) having a low behavioral risk level, and a function for appropriately notifying the approach of the vehicle is provided. Maintained control can also be performed.
  • a notification target for example, an adult, an animal, etc.
  • the notification information setting unit 8 performs setting so that the announcement information and the notification sound are output at a volume that allows the notification target object to be recognized in consideration of the noise information input from the sound collection microphone 73.
  • the volume level stored in the memory unit 2 is increased by a predetermined level and output.
  • the volume level stored in the memory unit 2 is decreased by a predetermined level and output. Perform the settings to be performed.
  • the notification information setting unit 8 refers to the vehicle speed information acquired by the own vehicle information acquisition unit 60, and when the host vehicle is traveling at a predetermined vehicle speed or higher, for example, 70 km / h or higher, or from the map information If it is determined that the vehicle is traveling on a dedicated road, it may be set not to notify the approach of the vehicle. As described above, the notification information setting unit 8 provides the notification information according to the vehicle speed information and light lighting information acquired by the own vehicle information acquisition unit 60, the map information, brightness information, and noise information acquired by the surrounding information acquisition unit 70. It can be set appropriately. In addition, the setting of alerting
  • FIG. 4 is a flowchart showing the operation of the vehicle approach notification device according to Embodiment 1 of the present invention.
  • the target object detection unit 1 performs image analysis of the captured image of the camera 20 and detects the presence or absence of a notification target object (step ST1). If there is no notification target in the captured video (step ST1; NO), the determination process of step ST1 is continued.
  • step ST1 when a notification target exists in the captured image (step ST1; YES), the target determination unit 5 classifies the notification target for each preset type (step ST2). Furthermore, the object discriminating unit 5 determines whether or not there are a plurality of classified notification object types (step ST3). When there are not a plurality of types of notification objects (step ST3; NO), the process proceeds to step ST5. On the other hand, when there are a plurality of types of notification objects (step ST3; YES), the object determination unit 5 refers to the behavior risk for each type of notification object stored in advance, and ranks the notification objects. Is performed (step ST4).
  • the behavior prediction unit 6 determines the traveling direction of the notification object and predicts the walking line of the notification object (step ST5).
  • the notification information setting unit 8 acquires and sets announcement information, notification sound, and volume level corresponding to the type of notification object from the memory unit 2 (step ST6). It should be noted that there are a plurality of types of notification objects, and for the notification objects that have been ranked in step ST4, announcement information, notification sound, and volume corresponding to the type of notification object having the highest behavioral risk level Set the level.
  • the notification information setting unit 8 determines whether or not to perform light emission output based on the own vehicle information acquired by the own vehicle information acquisition unit 60 and the surrounding information of the own vehicle acquired by the surrounding information acquisition unit 70 (step) ST7) and whether or not to output sound is determined (step ST8).
  • the notification information setting unit 8 is based on the announcement information, notification sound, and volume level selected in step ST6.
  • the sound output is set, the light emission output is set, and the output control unit 4 outputs the announcement information and the notification sound at a predetermined volume via the speaker 40, and performs the passing operation of the headlight 50 (step ST9).
  • step ST7; NO when it is determined that the light emission output is not performed (step ST7; NO), the notification information setting unit 8 sets the sound output based on the announcement information, the notification sound, and the volume level selected in step ST6, and the output control unit 4 outputs the announcement information and the notification sound at a predetermined volume via the speaker 40 (step ST10).
  • step ST7; YES when it is determined that the light emission output is performed (step ST7; YES) and the sound output is not performed
  • step ST8; NO the notification information setting unit 8 sets the light emission output, and the output control unit 4 sets the headlight 50.
  • the passing operation is performed (step ST11).
  • step ST9 when the operation of notifying the approach of the vehicle is performed, the behavior detection unit 7 displays the detection result of the notification target object that the target object detection unit 1 continues after the determination process of step ST1.
  • the predicted course of the notification object is detected with reference to (step ST12).
  • the behavior detection unit 7 compares the detected course with the walking line predicted in step ST5, and determines whether or not the course deviates from the predicted walking line (step ST13).
  • step ST13 When it is determined that the course of the notification object deviates from the predicted walking line (step ST13; YES), the notification information setting unit 8 continues to notify the approach of the vehicle (step ST15), and the process of step ST12 is performed. The process described above is repeated. It should be noted that in the continuation of the notification in step ST15, the notification may be strengthened by increasing the volume level of the warning sound.
  • the notification information setting unit 8 sets the output of the pseudo engine sound stored in the memory unit 2 and outputs it.
  • the control unit 4 controls switching to the pseudo engine sound via the speaker 40 (step ST14), and returns to the determination process of step ST1.
  • FIG. 5 is an explanatory diagram showing processing of the vehicle approach notification device according to Embodiment 1 of the present invention.
  • FIG. 5A shows that when the host vehicle 101 is located at the position A, the object detection unit 1 detects the notification object 201, and the object determination unit 5 classifies the type of the notification object 201.
  • the notification information setting unit 8 performs setting to output the notification sound 202a corresponding to the type of the notification object 201 from the left speaker 40a.
  • the notification sound 202a for example, a melody is set when the notification target is a child, and a pseudo engine sound is set when the notification target is an adult.
  • the behavior prediction unit 6 determines the traveling direction 203 of the notification target object 201 using the image analysis result of the target object detection unit 1, and the traveling direction 102 of the host vehicle 101 (in the example of FIG. 5, the straight traveling direction). ) Is recognized, and a walking line 204 along the road white line or road shape is predicted.
  • the behavior detection unit 7 detects the predicted course 205 of the notification target object 201 after the notification sound 202a is output while the own vehicle 101 moves to the position B. To do. Since the detected route 205 does not deviate from the walking line 204 created by the behavior predicting unit 6, it is determined that there is no danger between the host vehicle 101 and the notification object 201. Thereby, in the position B, the notification information setting unit 8 performs setting to output the pseudo engine sound 202b from the left speaker 40a.
  • the object detection unit 1 detects the notification object 201, and the object determination unit 5 determines the type of the notification object 201.
  • the notification information setting unit 8 performs classification so that the notification sound 202a corresponding to the type of the notification object 201 is output from the left speaker 40a.
  • the behavior prediction unit 6 determines the traveling direction 206 of the notification target object 201 using the image analysis result of the target object detection unit 1, and the white line of the road in the captured image obtained by capturing the traveling direction 102 of the host vehicle 101 or The shape of the road is recognized, and the white line of the road or the walking line 207 along the road shape is predicted.
  • the behavior detection unit 7 detects the predicted course 208 of the notification target object 201 after the notification sound 202a is output while the own vehicle 101 moves to the position B. To do.
  • the detected course 208 is determined to deviate from the walking line 207 created by the behavior prediction unit 6.
  • the notification information setting unit 8 performs the setting to continue the notification from the left speaker 40a or to strengthen the notification and notify the danger.
  • a setting is made to output an announcement 209 that informs the danger that “the car passes.
  • the notification information setting unit 8 may be configured not to perform the sound output and light emission output of the announcement information and the notification sound, or to set the output volume of the sound output to be low.
  • notification information You may comprise so that the setting part 8 may be set so that sound information of announcement information and a notification sound, and light emission output may not be performed. However, in places such as intersections where there is no separation between the roadway and the sidewalk due to guardrails or trees, announcement information or notification sound is output or light emission is output as usual.
  • the behavior prediction unit 6 refers to the image analysis result of the object detection unit 1 and the detection result of the distance sensor 30, based on the distance from the current position of the own vehicle 101 to the attention object 201 and the current position of the own vehicle 101.
  • the distance to the detected path (the paths 205 and 208 in FIG. 5) is calculated, and when the calculated distance is more than the threshold, the notification information is not output so that the announcement information, the sound output of the notification sound, and the light emission output are not performed.
  • the notification information setting unit 8 performs sound output and light emission output of announcement information and notification sound. You may comprise so that it may set to.
  • the threshold of the separation distance between the host vehicle 101 and the notification target 201 may be set for each type of notification target shown in FIG.
  • the notification information setting unit 8 refers to the host vehicle information acquired by the host vehicle information acquisition unit 60, and the host vehicle is It is determined whether it is stopped or idling stop, and when it is stopped or idling stop, the announcement information and sound output of the notification sound, the light emission output is stopped and switched to the pseudo engine sound. Alternatively, it may be configured to refrain from outputting pseudo engine sound in consideration of noise.
  • the above-described object discriminating unit 5 is configured to discriminate whether the notification object applies to a child, an adult, an elderly person, an animal, a bicycle occupant, or a motorcycle occupant.
  • the accuracy is further improved to determine whether the notification target is non-Japanese, and the Japanese announcement information is switched to English announcement information for the non-Japanese notification target. It may be configured. Furthermore, it may be configured to identify visually impaired persons based on more detailed image analysis and switch to announcement information or notification sound output instead of light emission output for visually impaired persons.
  • the object discriminating unit 5 that discriminates the type of the notification object, and the announcement information or the notification sound output according to the type discriminated by the object discriminating unit 5 are set. Since it is configured to include the notification information setting unit 8 that performs notification, it is possible to output announcement information and notification sound according to the type of the notification target, and appropriately notify the approach of the vehicle.
  • the advancing direction of a notification target object is determined, the behavior prediction part 6 which predicts a walking line, and the predicted course of the notification target object after alert
  • a behavior detecting unit 7 for determining whether the detected course departs from the walking line and outputting an instruction to continuously notify the approach of the vehicle when deviating from the walking line.
  • the approach of the vehicle can be notified again.
  • the headlight 50 that emits light is provided, and the output control unit 4 that switches the output between the speaker 40 and the headlight 50. Therefore, it is possible to let the notification object know the approach of the vehicle only by passing using the headlight in consideration of the traveling time zone and noise in traveling in a residential area, and to the surrounding environment It is possible to make a notification in consideration of consideration.
  • FIG. 2 In the block diagram of the vehicle approach notification device illustrated in FIG. 2, an example in which the own vehicle information acquisition unit 60 and the surrounding information acquisition unit 70 are external configurations of the vehicle approach notification device 10 is illustrated.
  • the vehicle information acquisition unit 60 and the surrounding information acquisition unit 70 may be provided.
  • any component of the embodiment can be modified or any component of the embodiment can be omitted within the scope of the invention.
  • the vehicle approach notification device can be used for a vehicle control device that realizes an appropriate vehicle approach notification function in accordance with the type of the mobile body located around the vehicle.

Landscapes

  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Engineering & Computer Science (AREA)
  • Mechanical Engineering (AREA)
  • Traffic Control Systems (AREA)

Abstract

The purpose of the present invention is to switch the content of alerting information in a vehicle approach alerting apparatus, depending on the type of the object to be alerted, so that the object can be appropriately alerted of an approaching vehicle. A vehicle approach alerting apparatus according to the present invention is provided with: an object detection unit (1) that detects a moving body from a picture acquired by a camera (20) mounted on a vehicle (101); an object determination unit (5) that determines the type of the moving body on the basis of the result of detection by the object detection unit (1); a memory unit (2) in which alerting information determined in accordance with the type of the moving body is stored; an alerting information setting unit (8) that acquires the alerting information corresponding to the type of the moving body determined by the object determination unit (5) from the memory unit (2); and an output control unit (4) that controls the output of the alerting information acquired by the alerting information setting unit (8).

Description

車両接近報知装置Vehicle approach notification device
 この発明は、車両の接近を報知する車両接近報知装置に関するものである。 The present invention relates to a vehicle approach notification device that notifies the approach of a vehicle.
 電気自動車やハイブリッド車は、エンジン車に比べて音が静かな電動機を走行駆動源として使用しているため、走行時の騒音が大幅に低減され、走行音が静かである。そのため、歩行者、あるいは軽車両や二輪車の乗員が車両の接近に気づかず事故の要因になることがある。この問題を解決する方法として、接近報知装置により車両の接近を報知する報知音を発生させ、歩行者、あるいは軽車両や二輪車の乗員に車両の存在を報知する方法が開示されている。 Electric vehicles and hybrid vehicles use an electric motor that is quieter than engine vehicles as a driving source, so noise during driving is greatly reduced and driving noise is quiet. Therefore, a pedestrian or a passenger of a light vehicle or a motorcycle may not be aware of the approach of the vehicle and may cause an accident. As a method for solving this problem, a method is disclosed in which a notification sound for notifying the approach of a vehicle is generated by an approach notification device and the presence of the vehicle is notified to a pedestrian or a passenger of a light vehicle or a two-wheeled vehicle.
 例えば特許文献1には、取得した車両の状態情報または周辺情報に基づいて音響発生手段が発生させる音の音量または出力方向を制御し、車両外部に出力する電気自動車用音響出力装置が開示されている。この技術では、車両の状態情報または周辺情報に基づいて発生させる音を制御することにより、歩行者や、軽車両、二輪車の乗員が聞き取り易い音の発生を実現している。 For example, Patent Document 1 discloses a sound output device for an electric vehicle that controls the volume or output direction of sound generated by sound generation means based on acquired vehicle state information or surrounding information and outputs the sound to the outside of the vehicle. Yes. In this technique, by generating sounds that are generated based on vehicle state information or surrounding information, it is possible to generate sounds that are easy for pedestrians, light vehicles, and two-wheeled vehicles to hear.
 また、特許文献2には、検出手段が検出した騒音レベルに応じて、発音手段が発生する音の種類、音量、発生タイミングなどのパラメータを制御する車両用発音装置が開示されている。この技術では、交通量が多く騒音レベルが高い場合、大音量で発音することにより歩行者に自動車の接近を認識させることができ、一方交通量が少なく騒音レベルが低い場合には、小音量で発音することにより歩行者に自動車の接近を認識させ、且つ近隣の人に騒音とならない制御を実現することができる。 Patent Document 2 discloses a vehicle sounding device that controls parameters such as the type, volume, and generation timing of sound generated by the sounding means in accordance with the noise level detected by the detecting means. In this technology, when the traffic volume is high and the noise level is high, the pedestrian can be made aware of the approach of the car by sounding at a high volume, while when the traffic volume is low and the noise level is low, the volume is low. By generating a sound, it is possible to make the pedestrian recognize the approach of the car and to realize control that does not cause noise to neighboring people.
 また、特許文献3には、車両の周囲に存在する人物を検出した場合に、走行擬似音発生手段から発生する走行擬似音の音量を増加させる走行擬似音発生装置が開示されている。この技術では、環境に適した音量の走行擬似音の発生を実現している。 Further, Patent Document 3 discloses a traveling simulated sound generating device that increases the volume of traveling simulated sound generated from traveling simulated sound generating means when a person existing around the vehicle is detected. This technology realizes the generation of simulated driving sound with a volume suitable for the environment.
国際公開第2011/070630号International Publication No. 2011/070630 特開2002-196765号公報JP 2002-196765 A 特開2006-21667号公報JP 2006-21667 A
 しかしながら、上述した特許文献1から特許文献3に開示された技術では、車両状態または周辺情報に基づいて発音する音量を制御するため、車両位置では騒音レベルが低く音量が小さい発音を行ったが、歩行者や、軽車両、二輪車の乗員の位置では騒音レベルが高く発音が認識されない場合があるという課題があった。また、周囲の騒音によっては音量を大きく設定して発音したとしても、報知対象の種別、例えば歩行者や軽車両、二輪車の乗員によって認識の差が生じ、車両が接近していることが適切に認識されない場合があるという課題があった。 However, in the technique disclosed in Patent Document 1 to Patent Document 3 described above, the sound volume is controlled based on the vehicle state or the surrounding information, so that the sound level is low and the sound volume is low at the vehicle position. There is a problem that the sound level may not be recognized at the position of a pedestrian, a light vehicle, or a two-wheeled vehicle occupant. Also, even if the sound is pronounced with a loud volume set depending on the surrounding noise, it is appropriate that there is a difference in recognition depending on the type of notification target, for example, a pedestrian, a light vehicle, or a two-wheeled vehicle occupant, so There was a problem that it might not be recognized.
 この発明は上記のような課題を解決するためになされたもので、歩行者や、軽車両、二輪車の乗員などの報知対象の種別に応じて報知情報の内容を切り替え、車両の接近を適切に通知可能な車両接近報知装置を提供することを目的とする。 The present invention has been made to solve the above-described problems. The content of the notification information is switched according to the type of the notification target such as a pedestrian, a light vehicle, or a two-wheeled vehicle occupant, and the approach of the vehicle is appropriately adjusted An object of the present invention is to provide a vehicle approach notification device capable of notification.
 この発明に係る車両接近報知装置は、車両に搭載したカメラの撮像映像から移動体を検出する移動体検出部と、移動体検出部の検出結果に基づいて移動体の種別を判別する種別判別部と、移動体の種別に応じて定められた報知情報を格納するメモリ部と、種別判別部が判別した移動体の種別に対応した報知情報をメモリ部から取得する報知情報設定部と、報知情報設定部が取得した報知情報の出力を制御する出力制御部とを備えるものである。 A vehicle approach notification device according to the present invention includes a moving body detection unit that detects a moving body from an image captured by a camera mounted on the vehicle, and a type determination unit that determines the type of the moving body based on a detection result of the moving body detection unit. A memory unit that stores notification information determined according to the type of the mobile object, a notification information setting unit that acquires notification information corresponding to the type of the mobile object determined by the type determination unit from the memory unit, and notification information And an output control unit that controls output of the notification information acquired by the setting unit.
 この発明によれば、移動体の種別に応じて車両の接近を適切に通知することができる。 According to this invention, it is possible to appropriately notify the approach of the vehicle according to the type of the moving body.
実施の形態1による車両接近報知装置の概略構成図である。1 is a schematic configuration diagram of a vehicle approach notification device according to Embodiment 1. FIG. 実施の形態1による車両接近報知装置の構成を示すブロック図である。It is a block diagram which shows the structure of the vehicle approach alerting | reporting apparatus by Embodiment 1. FIG. 実施の形態1による車両接近報知装置のメモリ部の格納情報を示す図である。It is a figure which shows the storage information of the memory part of the vehicle approach alerting | reporting apparatus by Embodiment 1. FIG. 実施の形態1による車両接近報知装置の動作を示すフローチャートである。3 is a flowchart showing the operation of the vehicle approach notification device according to the first embodiment. 実施の形態1による車両接近報知装置の挙動予測部の予測処理を示す説明図である。It is explanatory drawing which shows the prediction process of the behavior prediction part of the vehicle approach alerting | reporting apparatus by Embodiment 1. FIG.
 以下、この発明をより詳細に説明するために、この発明を実施するための形態について、添付の図面に従って説明する。
実施の形態1.
 図1は、この発明の実施の形態1による車両接近報知装置を搭載した車両の概略構成図を示す。
 図1に示した自車両101は、車両前方を撮影するカメラ20、自車両101と歩行者、軽車両や二輪車の乗員など(移動体;以下、報知対象物と称する)との距離を検知する超音波センサやミリ波レーダなどの距離センサ30を搭載している。また、自車両101の前方両端には報知音を発生する左スピーカ40a、右スピーカ40b、視覚的効果を発生する左ヘッドライト50a、右ヘッドライト50bが設けられている。カメラ20、距離センサ30、スピーカ40およびヘッドライト50は自車両101に搭載された車両接近報知装置10と接続されている。さらに車両接近報知装置10は、自車両101の自車情報を取得する自車情報取得部60や、GPSにより自車両101の現在位置情報および自車両101の周辺情報を取得する周辺情報取得部70と接続されている。
Hereinafter, in order to explain the present invention in more detail, modes for carrying out the present invention will be described with reference to the accompanying drawings.
Embodiment 1 FIG.
1 is a schematic configuration diagram of a vehicle equipped with a vehicle approach notification device according to Embodiment 1 of the present invention.
The own vehicle 101 shown in FIG. 1 detects the distance between the camera 20 that captures the front of the vehicle, the own vehicle 101 and a pedestrian, a passenger of a light vehicle or a two-wheeled vehicle (moving body; hereinafter referred to as a notification object). A distance sensor 30 such as an ultrasonic sensor or a millimeter wave radar is mounted. In addition, a left speaker 40a and a right speaker 40b that generate a notification sound, a left headlight 50a and a right headlight 50b that generate visual effects, are provided at both front ends of the host vehicle 101. The camera 20, the distance sensor 30, the speaker 40, and the headlight 50 are connected to the vehicle approach notification device 10 mounted on the host vehicle 101. Further, the vehicle approach notification device 10 includes a host vehicle information acquisition unit 60 that acquires host vehicle information of the host vehicle 101, and a peripheral information acquisition unit 70 that acquires current position information of the host vehicle 101 and peripheral information of the host vehicle 101 by GPS. And connected.
 図2は、この発明の実施の形態1による車両接近報知装置の構成を示すブロック図である。車両接近報知装置10は、対象物検出部(移動体検出部)1、メモリ部2、制御部3および出力制御部4で構成されている。また車両接近報知装置10には、上述したカメラ20、距離センサ30、スピーカ40およびヘッドライト50が接続されている。また、車両接近報知装置10に接続された自車情報取得部60は、自車両の車速情報やヘッドライト点灯の有無を示す点灯情報などを取得し、周辺情報取得部70は、ナビゲーションシステム71などから取得した自車両周辺の地図情報や、照度センサ72が取得した明るさ情報、集音マイク73が取得した騒音情報を取得する。 FIG. 2 is a block diagram showing the configuration of the vehicle approach notification device according to Embodiment 1 of the present invention. The vehicle approach notification device 10 includes an object detection unit (moving body detection unit) 1, a memory unit 2, a control unit 3, and an output control unit 4. The vehicle approach notification device 10 is connected to the camera 20, the distance sensor 30, the speaker 40, and the headlight 50 described above. The own vehicle information acquisition unit 60 connected to the vehicle approach notification device 10 acquires vehicle speed information of the own vehicle, lighting information indicating whether or not the headlight is turned on, and the like, and the surrounding information acquisition unit 70 includes a navigation system 71 and the like. The map information around the vehicle acquired from the above, the brightness information acquired by the illuminance sensor 72, and the noise information acquired by the sound collecting microphone 73 are acquired.
 車両接近報知装置10の各構成について説明する。
 対象物検出部1は、カメラ20から入力される撮像映像の画像解析を行い、報知対象物の有無を判別する。報知対象物を検出した場合には、カメラ20から入力される撮像映像の画像解析を継続して行い、検出した報知対象物のその後の挙動を観測する。
Each configuration of the vehicle approach notification device 10 will be described.
The object detection unit 1 performs image analysis of the captured video input from the camera 20 and determines the presence or absence of a notification object. When the notification object is detected, image analysis of the captured video input from the camera 20 is continuously performed, and the subsequent behavior of the detected notification object is observed.
 メモリ部2は、アナウンス情報、報知音および出力音量を示す音量レベル情報などを格納する。報知音として、擬似エンジン音(擬似走行音)、メロディー、警告音などを格納する。なお、擬似エンジン音以外にも、環境音や自然で快適な音やユーザの嗜好に合わせた音を格納してもよい。アナウンス情報、報知音および音量レベル情報は、車両の接近を報知する報知対象物の種別に対応付けて格納する。その一例を図3に示す。 The memory unit 2 stores announcement information, notification sound, volume level information indicating the output volume, and the like. As notification sounds, pseudo engine sounds (pseudo running sounds), melodies, warning sounds, and the like are stored. In addition to the pseudo engine sound, an environmental sound, a natural and comfortable sound, or a sound according to the user's preference may be stored. The announcement information, the notification sound, and the volume level information are stored in association with the type of the notification object that notifies the approach of the vehicle. An example is shown in FIG.
 図3は、この発明の実施の形態1による車両接近報知装置のメモリ部の格納情報を示す図である。
 図3の例では、報知対象物の種別を「子供」、「老人」、「大人」、「自転車の乗員」、「バイクの乗員」、「動物」に分類している。
 報知対象物が「子供」の場合、アナウンス情報として例えば「車が通りますよ、注意して下さいね。」などやさしく、分かりやすい子供向けのアナウンスを格納し、報知音としてメロディーを格納する。また、音量レベル「2:普通」および「3:大きい」を示す音量レベル情報が格納される。また、報知対象物が「老人」の場合、アナウンス情報として例えば「車が通ります、ご注意ください。」という通常のアナウンスをゆっくり、はっきりと発音したアナウンスを格納し、報知音として擬似エンジン音および警告音を格納し、音量レベル「3:大きい」および「4:より大きい」を示す音量レベル情報が格納される。さらに、報知対象物が「バイクの乗員」の場合、バイクの走行音が大きいと想定されることから、アナウンス情報は格納せずに、報知音として擬似エンジン音および警告音を格納し、音量レベル「3:大きい」および「4:より大きい」を示す音量レベル情報が格納される。
FIG. 3 is a diagram showing information stored in the memory unit of the vehicle approach notification device according to Embodiment 1 of the present invention.
In the example of FIG. 3, the types of notification objects are classified into “child”, “old man”, “adult”, “bicycle occupant”, “bike occupant”, and “animal”.
When the notification object is “child”, for example, an easy-to-understand announcement for children, such as “Please drive, please be careful.” Is stored as announcement information, and a melody is stored as a notification sound. In addition, volume level information indicating volume levels “2: normal” and “3: high” is stored. In addition, when the notification target is “old man”, the announcement that is slowly and clearly pronounced as the announcement information, for example, “A car passes, please be careful.” Is stored, and the pseudo engine sound and A warning sound is stored, and volume level information indicating volume levels “3: high” and “4: higher” is stored. In addition, when the notification target is “motorcycle occupant”, it is assumed that the running sound of the motorcycle is loud, so the announcement information is not stored, the pseudo engine sound and warning sound are stored as the notification sound, and the volume level Volume level information indicating “3: large” and “4: larger” is stored.
 車両の接近を報知する際の報知対象物と車両の関係に応じて、図3で示す情報を適宜組み合わせて出力する。例えば、報知対象物が子供の場合であって、車両の接近を報知するのみの場合には、メロディーを音量「2:普通」で出力するように組み合わせる。一方、報知対象物が子供の場合であって、車両の接近をより強く報知し、危険を報知させる必要がある場合には、メロディーに加えてアナウンス情報を音量「3:大きい」で出力するように組み合わせる。
 また、報知対象物が「大人」や「自転車の乗員」の場合であって、対象物検出部1の画像解析精度が良好な場合であって、男性であるか女性であるかを判別可能な場合には、男性の声によるアナウンスと女性の声によるアナウンスとを切り替えて出力するように構成してもよい。
The information shown in FIG. 3 is appropriately combined and output according to the relationship between the notification object and the vehicle when reporting the approach of the vehicle. For example, when the notification target is a child and only the approach of the vehicle is notified, the melody is combined so as to be output at the volume “2: normal”. On the other hand, when the notification object is a child and it is necessary to notify the vehicle approach more strongly and to notify the danger, the announcement information is output at the volume “3: high” in addition to the melody. Combine with.
In addition, when the notification target is “adult” or “bicycle occupant” and the image analysis accuracy of the target detection unit 1 is good, it can be determined whether the target is male or female. In this case, the announcement may be made by switching between an announcement made by a male voice and an announcement made by a female voice.
 次に制御部3は、対象物判別部(種別判別部)5、挙動予測部6、挙動検出部7および報知情報設定部8で構成されている。
 対象物判別部5は、対象物検出部1から入力される画像解析結果と、距離センサ30から入力される自車両と報知対象物との離間距離情報に基づいて、対象物検出部1が検出した報知対象物をあらかじめ設定された種別に応じて分類する。分類する種別は、図3に示したように大人、子供、老人、男性、女性、自転車、バイク、動物などである。なお、この分類種別は適宜変更追加可能であり、対象物検出部1の画像解析精度が良好な場合には、より細かい分類を行うように構成可能である。
Next, the control unit 3 includes an object determination unit (type determination unit) 5, a behavior prediction unit 6, a behavior detection unit 7, and a notification information setting unit 8.
The object determination unit 5 is detected by the object detection unit 1 based on the image analysis result input from the object detection unit 1 and the separation distance information between the host vehicle and the notification object input from the distance sensor 30. The notified objects are classified according to a preset type. The types to be classified are adults, children, elderly people, men, women, bicycles, motorcycles, animals, etc. as shown in FIG. This classification type can be changed and added as appropriate, and can be configured to perform finer classification when the image analysis accuracy of the object detection unit 1 is good.
 報知対象物の具体的な分類方法として、例えば以下のような方法が挙げられる。対象物検出部1から入力された画像解析結果と、距離センサ30から入力された距離情報を参照して、報知対象物の頭の位置や身体のサイズを比較することにより大人と子供の分類を行う。また、報知対象物の歩行速度や、画像解析結果により杖の使用の有無が判断可能な場合には、老人であるか認識して分類する。自転車の乗員やバイクの乗員は、自転車やバイクの輪郭形状から分類する。動物も同様に、輪郭形状から分類する。 For example, the following method can be given as a specific method for classifying notification objects. Refer to the image analysis result input from the object detection unit 1 and the distance information input from the distance sensor 30 to compare the position of the head of the notification object and the size of the body, thereby classifying adults and children. Do. In addition, when it is possible to determine whether or not the walking stick is used based on the walking speed of the notification target or the image analysis result, it is recognized and classified as an elderly person. Bicycle occupants and motorcycle occupants are classified based on the contour shape of the bicycle or motorcycle. Animals are similarly classified from contour shapes.
 挙動予測部6は、対象物検出部1が観測した報知対象物の画像解析結果から報知対象物の進行方向を決定し、決定した進行方向と画像解析結果から取得可能な道路の形状などから報知対象物の歩行ラインや走行ライン(以下では、歩行ラインを例に説明する)を予測する。 The behavior prediction unit 6 determines the traveling direction of the notification target from the image analysis result of the notification target observed by the target detection unit 1, and notifies from the determined traveling direction and the shape of the road that can be acquired from the image analysis result. A walking line or a traveling line of an object (hereinafter, a walking line will be described as an example) is predicted.
 挙動検出部7は、対象物検出部1が所定期間継続して観測した報知対象物の画像解析結果を参照し、スピーカ40やヘッドライト50を介して車両の接近を報知した後の報知対象物の挙動を検出し、予測される進路を検出する。また検出した進路が、挙動予測部6が予測した歩行ラインから逸脱するかの判定を行う。歩行ラインから逸脱する例として、例えば、車両の接近を報知した後に報知対象物が車道側に近づいてくる。あるいは、報知対象物が道路を横断しようとする、自車両の接近に気付いていないと思われる進路を取る、注意対象物の足取りが、おぼつかず自車両の進行方向に飛び出すおそれがある進路を取るなどが挙げられる。 The behavior detection unit 7 refers to the image analysis result of the notification object continuously observed by the object detection unit 1 for a predetermined period, and notifies the vehicle of the approach through the speaker 40 and the headlight 50. To detect the expected course. In addition, it is determined whether the detected course deviates from the walking line predicted by the behavior prediction unit 6. As an example of deviating from the walking line, for example, after notifying the approach of the vehicle, the notification object approaches the roadway side. Or, if the object to be notified is about to cross the road, take a path that seems to be unnoticeable to approach the vehicle, or take a path where the gait of the object to be noticed may jump out in the direction of travel of the vehicle Take it.
 挙動検出部7は、検出した進路が予測した歩行ラインから逸脱すると判定した場合には、後段の報知情報設定部8に対して車両の接近の報知を継続するように指示する。あるいは、音量レベルを上げる、またはアナウンス情報、報知音および音量レベル情報の組み合わせを変更するなど、車両の接近をより強く報知し、危険を報知するなどの指示を出力してもよい。一方、報知対象物と車両が接触するなどの危険が回避された場合には、報知情報設定部8に対して擬似エンジン音の出力に切り替えるように指示する。 When the behavior detection unit 7 determines that the detected course deviates from the predicted walking line, the behavior detection unit 7 instructs the subsequent notification information setting unit 8 to continue the notification of the approach of the vehicle. Or you may output instructions, such as raising a sound volume level or changing the combination of announcement information, a notification sound, and sound volume level information, notifying the approach of vehicles more strongly and notifying danger. On the other hand, when the danger such as contact between the notification object and the vehicle is avoided, the notification information setting unit 8 is instructed to switch to the output of the pseudo engine sound.
 報知情報設定部8は、対象物判別部5から入力された報知対象物の分類結果に基づいて、該当する種別の報知対象物に対応付けられたアナウンス情報、報知音および音量レベル情報を取得する。さらに、自車情報取得部60から入力される車両情報やライト点灯情報、周辺情報取得部70から入力される地図情報や明るさ情報、騒音情報を参照し、出力制御部4を介してスピーカ40から音声出力により報知するのか、ヘッドライド50から発光出力により報知するのか、あるいは、スピーカ40およびヘッドライト50双方を用いた音声出力および発光出力により報知するのか出力制御部4に設定する。スピーカ40を用いた音声出力を設定する場合には、取得したアナウンス情報、報知音および音量レベル情報も併せて設定する。また、報知情報設定部8は、挙動検出部7から入力される指示に基づいて、報知の継続、報知の強化、あるいは擬似エンジン音への切り替えを出力制御部4に設定する。 The notification information setting unit 8 acquires announcement information, notification sound, and sound volume level information associated with a corresponding type of notification target, based on the classification result of the notification target input from the target determination unit 5. . Further, the vehicle information and the light lighting information input from the own vehicle information acquisition unit 60, the map information, the brightness information, and the noise information input from the surrounding information acquisition unit 70 are referred to, and the speaker 40 is connected via the output control unit 4. The output control unit 4 sets whether to make a notification by sound output from the head ride 50, to make a notification by light emission output from the head ride 50, or to make a notification by sound output and light emission output using both the speaker 40 and the headlight 50. When the sound output using the speaker 40 is set, the acquired announcement information, notification sound, and volume level information are also set. Further, the notification information setting unit 8 sets the output control unit 4 to continue the notification, enhance the notification, or switch to the pseudo engine sound based on the instruction input from the behavior detection unit 7.
 出力制御部4は、報知情報設定部8が設定した報知方法、すなわち音声出力あるいは発光出力の設定に基づいて、報知情報の出力先をスピーカ40とヘッドライト50との間で切り替える制御を行う。具体的には、アナウンス情報、報知音、あるいは擬似エンジン音の少なくともいずれかを出力する場合にはスピーカ40からの出力に切り替える制御を行って音声信号を出力し、ヘッドライトをパッシングさせるなどの発光出力を行う場合には、ヘッドライト50からの出力に切り替える制御を行って発光信号を出力する。 The output control unit 4 performs control to switch the output destination of the notification information between the speaker 40 and the headlight 50 based on the notification method set by the notification information setting unit 8, that is, the setting of the audio output or the light emission output. Specifically, when at least one of announcement information, notification sound, and pseudo engine sound is output, control for switching to output from the speaker 40 is performed to output a sound signal and light emission such as passing a headlight. In the case of output, control to switch to the output from the headlight 50 is performed and a light emission signal is output.
 スピーカ40は、出力制御部4の制御に応じて、報知情報設定部8が設定したアナウンス情報、報知音、あるいは擬似エンジン音のいずれかを設定された音量で出力する。車両が左スピーカ40aおよび右スピーカ40bを備えている場合には、報知情報設定部8が挙動予測部6または挙動検出部7から入力される挙動に基づいて、左右どちらのスピーカ40から出力するかを示した情報を出力制御部4に出力し、出力制御部4が設定された左スピーカ40aまたは右スピーカ40bから出力させる制御を行うように構成してもよい。
 ヘッドライト50は、出力制御部4の制御に応じて、パッシング動作などを行う。
The speaker 40 outputs the announcement information, notification sound, or pseudo engine sound set by the notification information setting unit 8 at a set volume according to the control of the output control unit 4. When the vehicle includes the left speaker 40a and the right speaker 40b, which information is output from the left or right speaker 40 based on the behavior input from the behavior prediction unit 6 or the behavior detection unit 7 by the notification information setting unit 8 May be configured to be output to the output control unit 4 and controlled to be output from the left speaker 40a or the right speaker 40b to which the output control unit 4 is set.
The headlight 50 performs a passing operation or the like according to the control of the output control unit 4.
 次に、上述した報知情報設定部8の動作を、より詳細に説明する。
 報知情報設定部8は、メモリ部2の格納情報を参照してアナウンス情報や報知音の設定を行うが、対象物検出部1の画像解析結果内に複数の報知対象物が存在し、対象物判別部5が複数の種別の報知対象物を判別した場合には、報知対象物の種別毎の挙動に対する危険度(例えば、子供は突然飛び出す可能性があるなど、以下、挙動危険度と称する)を考慮し、挙動危険度が最も高い報知対象物に合わせた報知情報の設定を行う。報知対象物の種別毎の挙動危険度は、対象物判別部5あらかじめが記憶しており、例えば、子供>老人>大人>動物>自転車の乗員>バイクの乗員のように順位付されている。対象物判別部5が画像解析結果内に子供、老人および動物が存在すると判別して子供、老人、動物の順に順位付けを行った場合に、報知情報設定部8は挙動危険度が最も高い子供に対して設定されたアナウンス情報、報知音および音量レベル情報を組わせて出力する設定を行う。
Next, operation | movement of the alerting | reporting information setting part 8 mentioned above is demonstrated in detail.
The notification information setting unit 8 sets announcement information and notification sound with reference to information stored in the memory unit 2, but there are a plurality of notification objects in the image analysis result of the object detection unit 1, and the object When the determination unit 5 determines a plurality of types of notification objects, the degree of risk with respect to the behavior of each type of notification object (for example, a child may jump out suddenly, hereinafter referred to as behavior risk) The notification information is set in accordance with the notification object having the highest behavioral risk. The behavior risk level for each type of notification object is stored in advance by the object discrimination unit 5 and is ranked in the order of, for example, child> old man>adult>animal> bicycle occupant> bike occupant. When the object discriminating unit 5 discriminates that there are children, elderly people, and animals in the image analysis result and ranks them in the order of children, elderly people, and animals, the notification information setting unit 8 has the highest behavioral risk. Is set to output the announcement information, notification sound and volume level information set for.
 また、画像解析結果内に報知対象物が存在し、報知情報設定部8が、周辺情報取得部70が取得する地図情報から住宅街を走行していると判断した場合や、明るさ情報から夜間の走行であると判断した場合には、ヘッドライト50のパッシング動作のみにより車両の接近を報知するように設定し、周囲への騒音を配慮した制御を行うことができる。さらに、上述したヘッドライト50のパッシング動作のみの設定は、挙動危険度のレベルが低い報知対象物(例えば、大人、動物など)に対してのみ行うなど、適切に車両の接近を報知する機能を維持した制御を行うこともできる。 Further, when there is a notification target in the image analysis result and the notification information setting unit 8 determines that the vehicle is traveling in a residential area from the map information acquired by the surrounding information acquisition unit 70, or from the brightness information at night If it is determined that the vehicle is traveling, it is set to notify the approach of the vehicle only by the passing operation of the headlight 50, and control in consideration of noise to the surroundings can be performed. Furthermore, the setting of only the passing operation of the headlight 50 described above is performed only for a notification target (for example, an adult, an animal, etc.) having a low behavioral risk level, and a function for appropriately notifying the approach of the vehicle is provided. Maintained control can also be performed.
 さらに、報知情報設定部8は、集音マイク73から入力される騒音情報を考慮して、報知対象物が認識可能な音量でアナウンス情報および報知音を出力するように設定を行う。騒音が大きい場合には、メモリ部2に格納された音量レベルを所定段階増加させて出力し、一方、騒音が小さい場合には、メモリ部2に格納された音量レベルを所定段階減少させて出力する設定を行う。
 また、報知情報設定部8は、自車情報取得部60が取得した車速情報を参照し、自車両が所定の車速以上、例えば70km/h以上で走行している場合や、地図情報などから車両専用道路を走行していると判断した場合には、車両の接近を報知しないように設定してもよい。
 このように、報知情報設定部8は、自車情報取得部60が取得した車速情報やライト点灯情報、周辺情報取得部70が取得した地図情報や明るさ情報、騒音情報に応じて報知情報を適宜設定することができる。なお、報知情報の設定は上述したものに限定されることなく、自由に構成可能である。
Further, the notification information setting unit 8 performs setting so that the announcement information and the notification sound are output at a volume that allows the notification target object to be recognized in consideration of the noise information input from the sound collection microphone 73. When the noise is loud, the volume level stored in the memory unit 2 is increased by a predetermined level and output. On the other hand, when the noise is low, the volume level stored in the memory unit 2 is decreased by a predetermined level and output. Perform the settings to be performed.
In addition, the notification information setting unit 8 refers to the vehicle speed information acquired by the own vehicle information acquisition unit 60, and when the host vehicle is traveling at a predetermined vehicle speed or higher, for example, 70 km / h or higher, or from the map information If it is determined that the vehicle is traveling on a dedicated road, it may be set not to notify the approach of the vehicle.
As described above, the notification information setting unit 8 provides the notification information according to the vehicle speed information and light lighting information acquired by the own vehicle information acquisition unit 60, the map information, brightness information, and noise information acquired by the surrounding information acquisition unit 70. It can be set appropriately. In addition, the setting of alerting | reporting information is not limited to what was mentioned above, It can comprise freely.
 続いて、車両接近報知装置10の動作を説明する。図4は、この発明の実施の形態1による車両接近報知装置の動作を示すフローチャートである。なお、図4のフローチャートでは、自車両が走行中である場合を前提に説明を行う。
 対象物検出部1は、カメラ20の撮像映像の画像解析を行い、報知対象物の有無を検出する(ステップST1)。撮像映像内に報知対象物が存在しない場合には(ステップST1;NO)、ステップST1の判定処理を継続する。
Then, operation | movement of the vehicle approach alerting | reporting apparatus 10 is demonstrated. FIG. 4 is a flowchart showing the operation of the vehicle approach notification device according to Embodiment 1 of the present invention. In the flowchart of FIG. 4, the description is given on the assumption that the host vehicle is traveling.
The target object detection unit 1 performs image analysis of the captured image of the camera 20 and detects the presence or absence of a notification target object (step ST1). If there is no notification target in the captured video (step ST1; NO), the determination process of step ST1 is continued.
 一方、撮像映像内に報知対象物が存在する場合には(ステップST1;YES)、対象物判別部5が報知対象物をあらかじめ設定された種別毎に分類する(ステップST2)。さらに、対象物判別部5は、分類した報知対象物の種別が複数存在するか否か判定を行う(ステップST3)。報知対象物の種別が複数存在しない場合(ステップST3;NO)、ステップST5の処理に進む。一方、報知対象物の種別が複数存在する場合(ステップST3;YES)、対象物判別部5はあらかじめ記憶している報知対象物の種別毎の挙動危険度を参照し、報知対象物の順位付けを行う(ステップST4)。 On the other hand, when a notification target exists in the captured image (step ST1; YES), the target determination unit 5 classifies the notification target for each preset type (step ST2). Furthermore, the object discriminating unit 5 determines whether or not there are a plurality of classified notification object types (step ST3). When there are not a plurality of types of notification objects (step ST3; NO), the process proceeds to step ST5. On the other hand, when there are a plurality of types of notification objects (step ST3; YES), the object determination unit 5 refers to the behavior risk for each type of notification object stored in advance, and ranks the notification objects. Is performed (step ST4).
 挙動予測部6は、報知対象物の進行方向を決定し、報知対象物の歩行ラインを予測する(ステップST5)。一方、報知情報設定部8は報知対象物の種別に対応したアナウンス情報、報知音および音量レベルをメモリ部2から取得して設定する(ステップST6)。なお、報知対象物の種別が複数存在し、ステップST4で順位付けが行われた報知対象物に対しては、挙動危険度が最も高い報知対象物の種別に対応したアナウンス情報、報知音および音量レベルを設定する。 The behavior prediction unit 6 determines the traveling direction of the notification object and predicts the walking line of the notification object (step ST5). On the other hand, the notification information setting unit 8 acquires and sets announcement information, notification sound, and volume level corresponding to the type of notification object from the memory unit 2 (step ST6). It should be noted that there are a plurality of types of notification objects, and for the notification objects that have been ranked in step ST4, announcement information, notification sound, and volume corresponding to the type of notification object having the highest behavioral risk level Set the level.
 次に報知情報設定部8は、自車情報取得部60が取得した自車両情報および周辺情報取得部70が取得した自車両の周辺情報に基づいて、発光出力を行うか否かの判定(ステップST7)、および音出力を行うか否かの判定を行う(ステップST8)。発光出力を行い(ステップST7;YES)、音出力を行う(ステップST8;YES)と判定された場合、報知情報設定部8はステップST6で選択したアナウンス情報、報知音、および音量レベルに基づいた音出力を設定すると共に、発光出力を設定し、出力制御部4がスピーカ40を介して所定音量でアナウンス情報および報知音を出力させると共に、ヘッドライト50のパッシング動作を行う(ステップST9)。 Next, the notification information setting unit 8 determines whether or not to perform light emission output based on the own vehicle information acquired by the own vehicle information acquisition unit 60 and the surrounding information of the own vehicle acquired by the surrounding information acquisition unit 70 (step) ST7) and whether or not to output sound is determined (step ST8). When it is determined that light emission output is performed (step ST7; YES) and sound output is performed (step ST8; YES), the notification information setting unit 8 is based on the announcement information, notification sound, and volume level selected in step ST6. The sound output is set, the light emission output is set, and the output control unit 4 outputs the announcement information and the notification sound at a predetermined volume via the speaker 40, and performs the passing operation of the headlight 50 (step ST9).
 一方、発光出力を行わないと判定された場合(ステップST7;NO)、報知情報設定部8はステップST6で選択したアナウンス情報、報知音および音量レベルに基づいた音出力を設定し、出力制御部4がスピーカ40を介して所定音量でアナウンス情報および報知音を出力させる(ステップST10)。また、発光出力を行い(ステップST7;YES)、音出力は行わない(ステップST8;NO)と判定された場合、報知情報設定部8は発光出力を設定し、出力制御部4がヘッドライト50のパッシング動作を行う(ステップST11)。 On the other hand, when it is determined that the light emission output is not performed (step ST7; NO), the notification information setting unit 8 sets the sound output based on the announcement information, the notification sound, and the volume level selected in step ST6, and the output control unit 4 outputs the announcement information and the notification sound at a predetermined volume via the speaker 40 (step ST10). When it is determined that the light emission output is performed (step ST7; YES) and the sound output is not performed (step ST8; NO), the notification information setting unit 8 sets the light emission output, and the output control unit 4 sets the headlight 50. The passing operation is performed (step ST11).
 ステップST9、ステップST10またはステップST11において、車両の接近を報知する動作が行われると、挙動検出部7は対象物検出部1がステップST1の判定処理以降継続している報知対象物の検出結果を参照し、報知対象物の予測される進路を検出する(ステップST12)。さらに挙動検出部7は検出した進路と、ステップST5で予測した歩行ラインとを比較し、進路が予測した歩行ラインから逸脱するか否か判定を行う(ステップST13)。 In step ST9, step ST10, or step ST11, when the operation of notifying the approach of the vehicle is performed, the behavior detection unit 7 displays the detection result of the notification target object that the target object detection unit 1 continues after the determination process of step ST1. The predicted course of the notification object is detected with reference to (step ST12). Furthermore, the behavior detection unit 7 compares the detected course with the walking line predicted in step ST5, and determines whether or not the course deviates from the predicted walking line (step ST13).
 報知対象物の進路が予測した歩行ラインから逸脱すると判定された場合(ステップST13;YES)、報知情報設定部8は車両の接近の報知を継続して行い(ステップST15)、ステップST12の処理に戻り上述した処理を繰り返す。なお、ステップST15の報知の継続では、警告音の音量レベルを上げるなど報知を強化する構成としてもよい。 When it is determined that the course of the notification object deviates from the predicted walking line (step ST13; YES), the notification information setting unit 8 continues to notify the approach of the vehicle (step ST15), and the process of step ST12 is performed. The process described above is repeated. It should be noted that in the continuation of the notification in step ST15, the notification may be strengthened by increasing the volume level of the warning sound.
 一方、報知対象物の進路が予測した歩行ラインから逸脱しないと判定された場合(ステップST13;NO)、報知情報設定部8はメモリ部2に格納された擬似エンジン音の出力を設定し、出力制御部4はスピーカ40を介した擬似エンジン音への切り替えを制御し(ステップST14)、ステップST1の判定処理に戻る。なお、上述したステップST14において擬似エンジン音の出力に切り替えた後、ステップST1で報知対象物が存在しないと判定された場合に、擬似エンジン音を停止させる処理を設けてもよい。 On the other hand, when it is determined that the course of the notification object does not deviate from the predicted walking line (step ST13; NO), the notification information setting unit 8 sets the output of the pseudo engine sound stored in the memory unit 2 and outputs it. The control unit 4 controls switching to the pseudo engine sound via the speaker 40 (step ST14), and returns to the determination process of step ST1. In addition, after switching to the output of a pseudo engine sound in step ST14 mentioned above, you may provide the process which stops a pseudo engine sound, when it determines with the notification target object not existing in step ST1.
 図5は、この発明の実施の形態1による車両接近報知装置の処理を示す説明図である。
 図5(a)は、自車両101が位置Aに位置している場合に、対象物検知部1が報知対象物201を検出し、対象物判別部5が報知対象物201の種別を分類し、報知情報設定部8が報知対象物201の種別に応じた報知音202aを左スピーカ40aから出力する設定を行う。報知音202aは、例えば報知対象物が子供の場合にはメロディーが設定され、大人の場合には擬似エンジン音が設定される。
FIG. 5 is an explanatory diagram showing processing of the vehicle approach notification device according to Embodiment 1 of the present invention.
FIG. 5A shows that when the host vehicle 101 is located at the position A, the object detection unit 1 detects the notification object 201, and the object determination unit 5 classifies the type of the notification object 201. The notification information setting unit 8 performs setting to output the notification sound 202a corresponding to the type of the notification object 201 from the left speaker 40a. As the notification sound 202a, for example, a melody is set when the notification target is a child, and a pseudo engine sound is set when the notification target is an adult.
 また挙動予測部6は、対象物検出部1の画像解析結果を用いて、報知対象物201の進行方向203を決定し、自車両101の進行方向102(図5の例では、直進の進行方向)を撮影した撮像映像内の道路の白線あるいは道路の形状を認識し、道路の白線あるいは道路の形状に沿った歩行ライン204を予測する。 Further, the behavior prediction unit 6 determines the traveling direction 203 of the notification target object 201 using the image analysis result of the target object detection unit 1, and the traveling direction 102 of the host vehicle 101 (in the example of FIG. 5, the straight traveling direction). ) Is recognized, and a walking line 204 along the road white line or road shape is predicted.
 自車両101が位置Aにおいて報知音202aを出力した後、自車両101が位置Bに移動する間に、挙動検出部7が報知音202a出力後の報知対象物201の予測される進路205を検出する。検出した進路205は、挙動予測部6が作成した歩行ライン204から逸脱しないため、自車両101と報知対象物201との間に危険は生じないと判断される。これにより、位置Bにおいて報知情報設定部8が擬似エンジン音202bを左スピーカ40aから出力する設定を行う。 After the own vehicle 101 outputs the notification sound 202a at the position A, the behavior detection unit 7 detects the predicted course 205 of the notification target object 201 after the notification sound 202a is output while the own vehicle 101 moves to the position B. To do. Since the detected route 205 does not deviate from the walking line 204 created by the behavior predicting unit 6, it is determined that there is no danger between the host vehicle 101 and the notification object 201. Thereby, in the position B, the notification information setting unit 8 performs setting to output the pseudo engine sound 202b from the left speaker 40a.
 一方、図5(b)では、自車両101が位置Aに位置している場合に、対象物検知部1が報知対象物201を検出し、対象物判別部5が報知対象物201の種別を分類し、報知情報設定部8が報知対象物201の種別に応じた報知音202aを左スピーカ40aから出力する設定を行う。 On the other hand, in FIG. 5B, when the host vehicle 101 is located at the position A, the object detection unit 1 detects the notification object 201, and the object determination unit 5 determines the type of the notification object 201. The notification information setting unit 8 performs classification so that the notification sound 202a corresponding to the type of the notification object 201 is output from the left speaker 40a.
 また挙動予測部6は、対象物検出部1の画像解析結果を用いて、報知対象物201の進行方向206を決定し、自車両101の進行方向102を撮影した撮像映像内の道路の白線あるいは道路の形状を認識し、道路の白線あるいは道路の形状に沿った歩行ライン207を予測する。 Further, the behavior prediction unit 6 determines the traveling direction 206 of the notification target object 201 using the image analysis result of the target object detection unit 1, and the white line of the road in the captured image obtained by capturing the traveling direction 102 of the host vehicle 101 or The shape of the road is recognized, and the white line of the road or the walking line 207 along the road shape is predicted.
 自車両101が位置Aにおいて報知音202aを出力した後、自車両101が位置Bに移動する間に、挙動検出部7が報知音202a出力後の報知対象物201の予測される進路208を検出する。検出した進路208は、挙動予測部6が作成した歩行ライン207から逸脱すると判定される。このため、位置Bにおいて報知情報設定部8が左スピーカ40aから報知を継続する、あるいは報知を強化して危険を報知する設定を行う。図5(b)の例では「車が通ります。ご注意ください。」と危険を報知するアナウンス209を出力する設定が行われる。 After the own vehicle 101 outputs the notification sound 202a at the position A, the behavior detection unit 7 detects the predicted course 208 of the notification target object 201 after the notification sound 202a is output while the own vehicle 101 moves to the position B. To do. The detected course 208 is determined to deviate from the walking line 207 created by the behavior prediction unit 6. For this reason, at the position B, the notification information setting unit 8 performs the setting to continue the notification from the left speaker 40a or to strengthen the notification and notify the danger. In the example of FIG. 5B, a setting is made to output an announcement 209 that informs the danger that “the car passes.
 挙動予測部6および挙動検出部7は報知対象物201の進行方向203,206を予測することができるため、自車両101の進行方向102と報知対象物201の進行方向203,206が同一であるか、逆であるか判別することができる。そのため、報知対象物201と、自車両101の進行方向が逆である場合、すなわち報知対象物201が自車両101に向かって移動してすれ違う場合には、報知対象物201が自車両101の存在を認識していると判断し、報知情報設定部8がアナウンス情報および報知音の音出力、発光出力を行わない、あるいは音出力の出力音量を低くする設定を行うように構成してもよい。 Since the behavior predicting unit 6 and the behavior detecting unit 7 can predict the traveling directions 203 and 206 of the notification target 201, the traveling direction 102 of the own vehicle 101 and the traveling directions 203 and 206 of the notification target 201 are the same. Or vice versa. Therefore, when the notification object 201 and the traveling direction of the own vehicle 101 are opposite, that is, when the notification object 201 moves toward the own vehicle 101 and passes each other, the notification object 201 exists in the presence of the own vehicle 101. The notification information setting unit 8 may be configured not to perform the sound output and light emission output of the announcement information and the notification sound, or to set the output volume of the sound output to be low.
 さらに、挙動予測部6は、対象物検出部1の画像解析結果から、報知対象物201がガードレールや植木などで車道と分離された歩道を移動していると判断可能な場合には、報知情報設定部8がアナウンス情報および報知音の音出力、発光出力を行わないように設定するように構成してもよい。ただし、交差点などのように、ガードレールや植木などにより車道と歩道を分離する仕切りがなくなる場所では、通常の処理通りアナウンス情報または報知音の出力、あるいは発光出力を行う。 Furthermore, when the behavior prediction unit 6 can determine from the image analysis result of the object detection unit 1 that the notification object 201 is moving on a sidewalk separated from the roadway by a guardrail, a plant, or the like, notification information You may comprise so that the setting part 8 may be set so that sound information of announcement information and a notification sound, and light emission output may not be performed. However, in places such as intersections where there is no separation between the roadway and the sidewalk due to guardrails or trees, announcement information or notification sound is output or light emission is output as usual.
 さらに挙動予測部6は、対象物検出部1の画像解析結果および距離センサ30の検知結果を参照して、自車両101の現在位置から注意対象物201までの距離や自車両101の現在位置から検出した進路(図5における進路205,208)までの距離を算出し、算出した距離が閾値以上離れている場合には、アナウンス情報および報知音の音出力、発光出力を行わないように報知情報設定部8に設定を行い、算出した距離が閾値未満となり自車両101と注意対象物201が接近した場合には、アナウンス情報および報知音の音出力、発光出力を行うように報知情報設定部8に設定するように構成してもよい。なお、自車両101と報知対象物201との離間距離の閾値は、図3で示した報知対象物の種別毎に設定してもよい。 Further, the behavior prediction unit 6 refers to the image analysis result of the object detection unit 1 and the detection result of the distance sensor 30, based on the distance from the current position of the own vehicle 101 to the attention object 201 and the current position of the own vehicle 101. The distance to the detected path (the paths 205 and 208 in FIG. 5) is calculated, and when the calculated distance is more than the threshold, the notification information is not output so that the announcement information, the sound output of the notification sound, and the light emission output are not performed. When setting is performed in the setting unit 8 and the calculated distance is less than the threshold value and the own vehicle 101 and the attention object 201 approach, the notification information setting unit 8 performs sound output and light emission output of announcement information and notification sound. You may comprise so that it may set to. Note that the threshold of the separation distance between the host vehicle 101 and the notification target 201 may be set for each type of notification target shown in FIG.
 なお、上述した説明では、自車両が走行中である場合を例に説明を行ったが、報知情報設定部8が、自車情報取得部60が取得した自車情報を参照し、自車両が停止中であるか、あるいはアイドリングストップ中であるかを判定し、停止中あるいはアイドリングストップ中である場合には、アナウンス情報および報知音の音出力、発光出力を停止し、擬似エンジン音に切り替える、もしくは騒音に配慮して擬似エンジン音の出力も控えるように構成してもよい。 In the above description, the case where the host vehicle is running has been described as an example. However, the notification information setting unit 8 refers to the host vehicle information acquired by the host vehicle information acquisition unit 60, and the host vehicle is It is determined whether it is stopped or idling stop, and when it is stopped or idling stop, the announcement information and sound output of the notification sound, the light emission output is stopped and switched to the pseudo engine sound. Alternatively, it may be configured to refrain from outputting pseudo engine sound in consideration of noise.
 上述した対象物判別部5は、報知対象物が、子供、大人、老人、動物、自転車の乗員、バイクの乗員のいずれに当てはまるか判別する構成を示したが、対象物検出部1の画像解析精度をより向上させて報知対象物が日本人以外であるか否か判別し、日本人以外の報知対象物に対して日本語のアナウンス情報の出力を英語のアナウンス情報に切り替えて出力するように構成してもよい。さらに、より詳細な画像解析に基づいて、視覚障害者の識別を行い、視覚障害者には発光出力ではなく、アナウンス情報または報知音の出力に切り替えるように構成してもよい。 The above-described object discriminating unit 5 is configured to discriminate whether the notification object applies to a child, an adult, an elderly person, an animal, a bicycle occupant, or a motorcycle occupant. The accuracy is further improved to determine whether the notification target is non-Japanese, and the Japanese announcement information is switched to English announcement information for the non-Japanese notification target. It may be configured. Furthermore, it may be configured to identify visually impaired persons based on more detailed image analysis and switch to announcement information or notification sound output instead of light emission output for visually impaired persons.
 以上のように、この実施の形態1によれば、報知対象物の種別を判別する対象物判別部5と、対象物判別部5が判別した種別に応じたアナウンス情報または報知音の出力を設定する報知情報設定部8とを備えるように構成したので、報知対象物の種別に合わせたアナウンス情報や報知音を出力することが可能となり、車両の接近を適切に報知することができる。 As described above, according to the first embodiment, the object discriminating unit 5 that discriminates the type of the notification object, and the announcement information or the notification sound output according to the type discriminated by the object discriminating unit 5 are set. Since it is configured to include the notification information setting unit 8 that performs notification, it is possible to output announcement information and notification sound according to the type of the notification target, and appropriately notify the approach of the vehicle.
 また、この実施の形態1によれば、報知対象物の進行方向を決定し、歩行ラインを予測する挙動予測部6と、車両の接近を報知した後の報知対象物の予測される進路を検出し、検出した進路が歩行ラインから逸脱するか判定し、逸脱する場合に車両の接近を継続して報知する指示を出力する挙動検出部7とを備えるように構成したので、車両の接近を報知したが報知対象物が自車両に接触あるいは衝突する危険が存在する場合に、再度車両の接近を報知することができる。 Moreover, according to this Embodiment 1, the advancing direction of a notification target object is determined, the behavior prediction part 6 which predicts a walking line, and the predicted course of the notification target object after alert | reporting the approach of a vehicle are detected. And a behavior detecting unit 7 for determining whether the detected course departs from the walking line and outputting an instruction to continuously notify the approach of the vehicle when deviating from the walking line. However, when there is a risk that the notification object contacts or collides with the host vehicle, the approach of the vehicle can be notified again.
 また、この実施の形態1によれば、アナウンス情報または報知音を出力するスピーカ40に加え、発光出力するヘッドライト50を設け、スピーカ40とヘッドライト50との間の出力を切り替える出力制御部4を備えるように構成したので、走行時間帯や、住宅街での走行における騒音を考慮してヘッドライトを用いたパッシングのみで報知対象物に車両の接近を報知させることができ、周辺環境への配慮を考慮した報知を行うことができる。 Further, according to the first embodiment, in addition to the speaker 40 that outputs announcement information or notification sound, the headlight 50 that emits light is provided, and the output control unit 4 that switches the output between the speaker 40 and the headlight 50. Therefore, it is possible to let the notification object know the approach of the vehicle only by passing using the headlight in consideration of the traveling time zone and noise in traveling in a residential area, and to the surrounding environment It is possible to make a notification in consideration of consideration.
 なお、図2で示した車両接近報知装置のブロック図では、自車情報取得部60および周辺情報取得部70を車両接近報知装置10の外部構成とする例を示したが、車両接近報知装置10が自車情報取得部60および周辺情報取得部70を備えるように構成してもよい。 In the block diagram of the vehicle approach notification device illustrated in FIG. 2, an example in which the own vehicle information acquisition unit 60 and the surrounding information acquisition unit 70 are external configurations of the vehicle approach notification device 10 is illustrated. The vehicle information acquisition unit 60 and the surrounding information acquisition unit 70 may be provided.
 なお、本願発明は、その発明の範囲内において、実施の形態の任意の構成要素の変形、もしくは実施の形態の任意の構成要素の省略が可能である。 In the invention of the present application, any component of the embodiment can be modified or any component of the embodiment can be omitted within the scope of the invention.
 以上のように、この発明に係る車両接近報知装置は、車両の周辺に位置する移動体の種別に応じて適切な車両接近報知機能を実現する車両制御装置などに利用することができる。 As described above, the vehicle approach notification device according to the present invention can be used for a vehicle control device that realizes an appropriate vehicle approach notification function in accordance with the type of the mobile body located around the vehicle.
 1 対象物検出部、2 メモリ部、3 制御部、4 出力制御部、5 対象物判別部、6 挙動予測部、7 挙動検出部、8 報知情報設定部、10 車両接近報知装置、20 カメラ、30 距離センサ、40 スピーカ、40a 左スピーカ、40b 右スピーカ、50 ヘッドライト、50a 左ヘッドライト、50b 右ヘッドライト、60 自車情報取得部、70 周辺情報取得部、71 ナビゲーションシステム、72 照度センサ、73 集音マイク、101 自車両、102,203,206 進行方向、201 報知対象物、202a 報知音、202b 報知音(擬似エンジン音)、204,207 歩行ライン、205,208 進路、209 アナウンス。 1 object detection unit, 2 memory unit, 3 control unit, 4 output control unit, 5 object discrimination unit, 6 behavior prediction unit, 7 behavior detection unit, 8 notification information setting unit, 10 vehicle approach notification device, 20 camera, 30 distance sensor, 40 speaker, 40a left speaker, 40b right speaker, 50 headlight, 50a left headlight, 50b right headlight, 60 vehicle information acquisition unit, 70 surrounding information acquisition unit, 71 navigation system, 72 illumination sensor, 73 sound collection microphone, 101 own vehicle, 102, 203, 206 traveling direction, 201 notification object, 202a notification sound, 202b notification sound (pseudo engine sound), 204, 207 walking line, 205, 208 course, 209 announcement.

Claims (6)

  1.  車両に搭載され、当該車両の周囲を移動する移動体に対して報知情報を出力して注意喚起を行う車両接近報知装置において、
     前記車両に搭載したカメラの撮像映像から前記移動体を検出する移動体検出部と、
     前記移動体検出部の検出結果に基づいて前記移動体の種別を判別する種別判別部と、
     前記移動体の種別に応じて定められた前記報知情報を格納するメモリ部と、
     前記種別判別部が判別した前記移動体の種別に対応した報知情報を前記メモリ部から取得する報知情報設定部と、
     前記報知情報設定部が取得した報知情報の出力を制御する出力制御部とを備えたことを特徴とする車両接近報知装置。
    In a vehicle approach notification device that is mounted on a vehicle and outputs alert information to a moving body that moves around the vehicle and alerts it,
    A moving body detection unit that detects the moving body from an image captured by a camera mounted on the vehicle;
    A type discriminating unit for discriminating the type of the mobile unit based on the detection result of the mobile unit detection unit;
    A memory unit for storing the notification information determined according to the type of the mobile body;
    A notification information setting unit for acquiring notification information corresponding to the type of the moving object determined by the type determination unit from the memory unit;
    A vehicle approach notification device comprising: an output control unit that controls output of notification information acquired by the notification information setting unit.
  2.  前記カメラの撮影映像および前記移動体検出部の検出結果から、前記移動体の挙動を予測する挙動予測部と、
     前記移動体検出部の検出結果から、前記報知情報出力後の前記移動体の挙動を検出する挙動検出部とを備え、
     前記報知情報設定部は、前記挙動検出部が検出した挙動が、前記挙動予測部が予測した挙動から逸脱した場合に、前記報知情報の出力を継続する設定を行うことを特徴とする請求項1記載の車両接近報知装置。
    A behavior prediction unit that predicts the behavior of the moving body from the captured image of the camera and the detection result of the moving body detection unit;
    From the detection result of the mobile body detection unit, comprising a behavior detection unit for detecting the behavior of the mobile body after the notification information output,
    The notification information setting unit performs setting to continue outputting the notification information when the behavior detected by the behavior detection unit deviates from the behavior predicted by the behavior prediction unit. The vehicle approach notification device as described.
  3.  前記メモリ部は、前記報知情報として、前記移動体の種別に応じて定められたアナウンス情報、報知音および出力音量情報を格納することを特徴とする請求項1記載の車両接近報知装置。 The vehicle approach notification device according to claim 1, wherein the memory unit stores announcement information, notification sound and output volume information determined according to the type of the moving body as the notification information.
  4.  前記種別判別部は、判別した移動体の種別が複数存在した場合に、移動体の各種別に対してあらかじめ設定された危険度に基づいて、各移動体に対して順位付けを行い、
     前記報知情報設定部は、前記種別判別部が付した順位を参照して最も危険度が高い種別に対応した報知情報を前記メモリ部から取得することを特徴とする請求項1記載の車両接近報知装置。
    The type determination unit ranks each moving body based on the risk set in advance for each type of moving body when there are a plurality of types of the determined moving body,
    2. The vehicle approach notification according to claim 1, wherein the notification information setting unit obtains notification information corresponding to a type having the highest degree of risk from the memory unit with reference to the ranking given by the type determination unit. apparatus.
  5.  前記報知情報設定部は、前記車両の車両情報および前記車両の周辺情報に基づいて、前記報知情報を音声出力するか、あるいは発光出力するかを設定し、
     前記出力制御部は、前記報知情報設定部の設定に応じて、前記報知情報の出力信号を音声信号または発光信号として切り替えることを特徴とする請求項1記載の車両接近報知装置。
    The notification information setting unit sets whether to output the notification information by voice or to emit light based on vehicle information of the vehicle and surrounding information of the vehicle,
    2. The vehicle approach notification device according to claim 1, wherein the output control unit switches an output signal of the notification information as an audio signal or a light emission signal in accordance with the setting of the notification information setting unit.
  6.  前記種別判定部は、移動体の種別として、大人か子供かの別を含む歩行者、乗員が外部に露出する軽車両、動物を判別することを特徴とする請求項1記載の車両接近報知装置。 The vehicle approach notification device according to claim 1, wherein the type determination unit discriminates a pedestrian including an adult or a child, a light vehicle with an occupant exposed to the outside, and an animal as a type of the moving body. .
PCT/JP2012/069996 2012-08-06 2012-08-06 Vehicle approach alerting apparatus WO2014024247A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/JP2012/069996 WO2014024247A1 (en) 2012-08-06 2012-08-06 Vehicle approach alerting apparatus

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2012/069996 WO2014024247A1 (en) 2012-08-06 2012-08-06 Vehicle approach alerting apparatus

Publications (1)

Publication Number Publication Date
WO2014024247A1 true WO2014024247A1 (en) 2014-02-13

Family

ID=50067533

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2012/069996 WO2014024247A1 (en) 2012-08-06 2012-08-06 Vehicle approach alerting apparatus

Country Status (1)

Country Link
WO (1) WO2014024247A1 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2016182892A (en) * 2015-03-26 2016-10-20 株式会社デンソー On-vehicle display device
CN108248504A (en) * 2016-12-28 2018-07-06 现代自动车株式会社 For controlling the device and method of the virtual engine sound of vehicle
EP3605499A4 (en) * 2017-03-29 2020-04-22 Sony Corporation Information processing device, information processing method, program, and moving body

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060115119A1 (en) * 2004-11-30 2006-06-01 Honda Motor Co., Ltd. Vehicle surroundings monitoring apparatus
JP2008114649A (en) * 2006-11-01 2008-05-22 Aisin Aw Co Ltd Horn controller
WO2008075407A1 (en) * 2006-12-19 2008-06-26 Pioneer Corporation Information processing device and its control method, control program, and recording medium
JP2008273251A (en) * 2007-04-25 2008-11-13 Toyota Motor Corp Vehicular alarm device
JP2009295184A (en) * 2009-09-16 2009-12-17 Mitsubishi Electric Corp Pedestrian warning device
JP2010111275A (en) * 2008-11-06 2010-05-20 Alpine Electronics Inc On-vehicle alarm device, alarm method and alarm program
KR20100074413A (en) * 2008-12-24 2010-07-02 주식회사 현대오토넷 Pedestrian recognizing system using mono camera and control method thereof
JP2011189916A (en) * 2010-03-17 2011-09-29 Hitachi Automotive Systems Ltd Alarm device for vehicle, and the vehicle using the same

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060115119A1 (en) * 2004-11-30 2006-06-01 Honda Motor Co., Ltd. Vehicle surroundings monitoring apparatus
JP2008114649A (en) * 2006-11-01 2008-05-22 Aisin Aw Co Ltd Horn controller
WO2008075407A1 (en) * 2006-12-19 2008-06-26 Pioneer Corporation Information processing device and its control method, control program, and recording medium
JP2008273251A (en) * 2007-04-25 2008-11-13 Toyota Motor Corp Vehicular alarm device
JP2010111275A (en) * 2008-11-06 2010-05-20 Alpine Electronics Inc On-vehicle alarm device, alarm method and alarm program
KR20100074413A (en) * 2008-12-24 2010-07-02 주식회사 현대오토넷 Pedestrian recognizing system using mono camera and control method thereof
JP2009295184A (en) * 2009-09-16 2009-12-17 Mitsubishi Electric Corp Pedestrian warning device
JP2011189916A (en) * 2010-03-17 2011-09-29 Hitachi Automotive Systems Ltd Alarm device for vehicle, and the vehicle using the same

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2016182892A (en) * 2015-03-26 2016-10-20 株式会社デンソー On-vehicle display device
CN108248504A (en) * 2016-12-28 2018-07-06 现代自动车株式会社 For controlling the device and method of the virtual engine sound of vehicle
EP3605499A4 (en) * 2017-03-29 2020-04-22 Sony Corporation Information processing device, information processing method, program, and moving body
US11317205B2 (en) 2017-03-29 2022-04-26 Sony Corporation Information processing apparatus, information processing method, program, and mobile object

Similar Documents

Publication Publication Date Title
JP6814153B2 (en) Vehicle lighting, vehicle systems and vehicles
JP6914843B2 (en) Vehicle lighting equipment, vehicle systems and vehicles
JP4688981B1 (en) Sound generator outside the car
JP5218458B2 (en) Vehicle approach notification system
JP2011248855A (en) Vehicle collision warning apparatus
JP2010113601A (en) Vehicle warning apparatus
KR101748804B1 (en) Active safety system for protecting bicycle accidents
JP4063142B2 (en) Obstacle notification device at night
JP2006209325A (en) Vehicle alarm device and method for producing alarm from vehicle
JP2011189916A (en) Alarm device for vehicle, and the vehicle using the same
JP2009217495A (en) Hazard warning device
WO2014024247A1 (en) Vehicle approach alerting apparatus
US20200307638A1 (en) Vehicle control system
JP4889822B1 (en) Sound generator outside the car
KR20110057837A (en) Night view system and control method thereof
JP4889812B2 (en) Sound generator outside the car
JP4889823B1 (en) Sound generator outside the car
JP4889824B1 (en) Sound generator outside the car
US20230326344A1 (en) Traffic safety support system
JP7372382B2 (en) Traffic safety support system
JP4889826B1 (en) Sound generator outside the car
CN113771869B (en) Vehicle control method and method for controlling vehicle based on wearable device
US20230351895A1 (en) Traffic safety support system
JP7405542B2 (en) Notification device and notification method in self-driving vehicles
JP7469358B2 (en) Traffic Safety Support System

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12882762

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 12882762

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: JP