JPWO2014208090A1 - Information providing apparatus, information providing method, program, server, and information providing system - Google Patents

Abstract

Provided are an information providing apparatus, an information providing method, and an information providing system capable of obtaining a sufficient warning effect and performing appropriate driving support. The outside of the traveling direction of the vehicle is photographed, and the lane departure of the vehicle is determined based on the video information obtained by photographing, and when it deviates, the number of lane departure detections Y1 for the past X1 seconds is calculated and calculated. If the number of lane departure detections Y1 is less than a predetermined threshold, a warning about lane departure is issued, and if the calculated number of lane departure detections Y1 is greater than or equal to a predetermined threshold, a warning for prompting a break is performed. As a result, a sufficient warning effect can be obtained, and appropriate driving assistance that cannot be realized by repeated warnings with a simple beep sound or the like can be realized.

Description

  The present invention relates to an information providing apparatus and an information providing method for supporting driving of a driver, and an information providing system including the information providing apparatus.

  In recent years, an Advanced Driver Assistance System (ADAS) that supports driver driving has been developed. This advanced driver assistance system detects the situation in front, rear, left and right with sensor devices (camera, laser radar, infrared rays, etc.) attached to the car, and warns the driver when it is judged that there is a danger, or automatically This is a safety system that activates an emergency brake.

  As one of the advanced driving support systems, for example, there is an information providing system described in Patent Document 1. The information providing system described in Patent Document 1 includes an in-vehicle device mounted on a vehicle and a road device that transmits information to the in-vehicle device. The road device has means for transmitting service intersection information for identifying whether or not a predetermined target intersection is a service intersection where a traffic signal capable of providing signal information is installed to the in-vehicle device. The in-vehicle device has creation means for creating notification information to the passenger of the vehicle on which the in-vehicle device is mounted based on the service intersection information transmitted from the road device.

JP 2011-238293 A

  However, in the information providing system described in Patent Document 1 described above, for example, when a lane departure repeatedly occurs while the vehicle is running, only a warning by a beep sound is repeated, and the driver gets used to the warning. The effect was not enough. In addition, the lane departure was resolved with each warning, but it was not a fundamental solution. In other words, appropriate driving support has not been achieved.

  An object of the present invention is made in view of such circumstances, and provides an information providing apparatus, an information providing method, and an information providing system capable of obtaining a sufficient warning effect and performing appropriate driving support. It is.

  An information providing apparatus according to an aspect of the present invention can be mounted on a vehicle and can acquire an outside situation that is at least an outside situation of the vehicle, and an output unit capable of notifying at least the inside of the vehicle When the outside situation satisfies a predetermined condition, the output unit performs a first notification, and when the outside situation subsequently satisfies the predetermined condition, the output unit Performs the second notification.

  According to the above configuration, the first notification is performed when the outside situation of the vehicle satisfies the predetermined condition, and the second notification is subsequently performed when the outside situation satisfies the predetermined condition. Thus, it is possible to provide appropriate driving assistance that could not be realized simply by repeating a warning with a beep sound or the like.

  In the above configuration, when the outer situation satisfies a predetermined condition, the output unit performs a first notification, and subsequently, when the outer situation satisfies the predetermined condition at a predetermined number of times in a predetermined time, The output unit performs second notification.

  According to the above configuration, when the outside situation satisfies a predetermined condition more than a predetermined number of times in a predetermined time, the first notification is switched to the second notification, so the surrounding state where the vehicle is traveling or the driver A warning corresponding to the state of sleepiness or the like can be notified, and a sufficient warning effect can be obtained.

  In the above configuration, when the outside situation satisfies a predetermined condition, the output unit performs a first notification, and subsequently, the outside situation is not less than a predetermined number of times while the vehicle moves a predetermined distance. When the above condition is satisfied, the output unit performs the second notification.

  According to the above configuration, if the outside situation satisfies a predetermined condition more than a predetermined number of times while the vehicle moves a predetermined distance, the first notification is switched to the second notification, so that a sufficient warning effect can be obtained. it can.

  In the above configuration, the second notification is a notification related to the first notification.

  In the above configuration, the content of the second notification is more complicated than the content of the first notification.

  According to the above configuration, the first notification and the second notification can be easily distinguished.

  In the above configuration, the content of the second notification includes more specific action than the content of the first notification.

  According to the above configuration, the first notification and the second notification can be easily distinguished. The specific action is a person's action such as a break.

  In the above configuration, the input unit includes an imaging unit capable of photographing at least the outside of the vehicle.

  According to the above configuration, the outside situation of the vehicle can be acquired from the video information obtained from the imaging unit.

  In the above configuration, the output unit includes at least a sound emitting unit and / or a display unit.

  In the above configuration, the communication unit has a communication unit, and the communication unit can output information corresponding to the outside situation to the outside, and can input information corresponding to the notification, and at least continues to the outside. If the situation satisfies the predetermined condition, the output unit makes a determination to perform the second notification externally.

  According to the above configuration, since the determination for performing the second notification is performed externally, the means for performing the determination can be omitted, thereby reducing the cost of the information providing apparatus.

  The said structure WHEREIN: When the said outer condition satisfy | fills the said predetermined condition, the determination which the said output part performs 1st alerting | reporting is performed outside.

  According to the above configuration, since the determination for performing the first notification is performed externally, the means for performing the determination can be omitted, thereby reducing the cost.

  In the above configuration, when the lane departure of the vehicle is detected based on the outside situation, the output unit notifies a beep sound, and subsequently the output of the vehicle lane departure is detected based on the outside situation. Notification that the department encourages a break.

  According to the above configuration, when the vehicle departs from the lane, a beep sound is notified, and when the vehicle continuously deviates from the lane, a notification is given to prompt a break, so that a sufficient warning effect can be obtained. .

  In the above configuration, when a pedestrian is detected based on the outside situation, the output unit notifies a beep sound, and when the pedestrian is subsequently detected based on the outside situation, the output unit prompts slowing down. Is notified.

  According to the above configuration, when a pedestrian is detected, a beep sound is notified, and when a pedestrian is detected continuously thereafter, a notification that prompts slowing down is performed, so that a sufficient warning effect can be obtained. .

  In the above configuration, the input unit is a first input unit, and a second input unit capable of acquiring the speed of the vehicle is provided. When a pedestrian is detected based on the outside situation, the output unit reports a beep sound. Then, when a pedestrian is detected based on the outside situation and when the speed of the vehicle is equal to or higher than a predetermined value, the output unit notifies that the vehicle is going slowly.

  According to the above configuration, when a pedestrian is detected, a beep sound is notified, and after that, when a pedestrian is detected continuously, and the vehicle speed is equal to or higher than a predetermined value, a notification that prompts slow driving is provided. Therefore, a sufficient warning effect can be obtained.

  In the above configuration, the vehicle is integrated with a vehicle having wheels.

  An information providing method of the present invention includes an input unit that can be mounted on a vehicle and can acquire an outside situation that is at least an outside situation of the vehicle, and an output unit that can notify at least the inside of the vehicle. In the information providing method that can be used in the information providing apparatus, when the outside situation satisfies a predetermined condition, the output unit performs a first notification, and subsequently, when the outside situation satisfies the predetermined condition, The output unit performs second notification.

  According to the above method, when the situation outside the vehicle satisfies the predetermined condition, the first notification is performed, and when the outside condition satisfies the predetermined condition subsequently, the second notification is performed. Thus, it is possible to provide appropriate driving assistance that could not be realized by repeating a warning with a simple beep sound or the like.

  An information providing system according to the present invention can be mounted on a vehicle and can acquire an outside situation that is a situation outside at least the vehicle, an output unit capable of notifying at least the inside of the vehicle, and the outside A communication unit capable of outputting information corresponding to the situation to the outside and capable of inputting information corresponding to the notification, and the outer situation based on the information corresponding to the outer situation. Outputs information corresponding to the first notification when the predetermined condition is satisfied, and subsequently outputs information corresponding to the second notification when the outer condition satisfies the predetermined condition. The output unit performs the first notification and the second notification based on information corresponding to the first notification and information corresponding to the second notification.

  According to the above configuration, a sufficient warning effect can be obtained, and appropriate driving support that cannot be realized by repeated warnings with a simple beep sound or the like can be achieved.

  According to the present invention, it is possible to obtain a sufficient warning effect, and it is possible to provide appropriate driving support that could not be realized by repeating warnings with a simple beep sound or the like.

The block diagram which shows schematic structure of the information provision apparatus which concerns on Embodiment 1 of this invention. The flowchart which shows the lane departure warning process of the information provision apparatus of FIG. The figure which showed typically the lane departure warning process of FIG. The flowchart which shows the pedestrian warning process of the information provision apparatus of FIG. The figure which showed typically the pedestrian warning process of FIG. The block diagram which shows schematic structure of the information provision system containing the information provision apparatus which is an application example of the information provision apparatus of FIG. The block diagram which shows schematic structure of the information provision apparatus which concerns on Embodiment 2 of this invention. The flowchart which shows the pedestrian warning process of the information provision apparatus of FIG. The block diagram which shows schematic structure of the information provision apparatus which concerns on Embodiment 3 of this invention. The flowchart which shows the lane departure warning process of the information provision apparatus of FIG. The flowchart which shows the pedestrian warning process of the information provision apparatus of FIG. The block diagram which shows schematic structure of the information provision apparatus which concerns on Embodiment 4 of this invention. The flowchart which shows the pedestrian warning process of the information provision apparatus of FIG. A table with examples and relationships of the first notification and the second notification as a table The block diagram which shows the other schematic structure of the information provision apparatus which concerns on Embodiment 1 of this invention. The block diagram which shows the other schematic structure of the information provision apparatus which concerns on Embodiment 1 of this invention.

  DESCRIPTION OF EXEMPLARY EMBODIMENTS Hereinafter, preferred embodiments for carrying out the invention will be described in detail with reference to the drawings.

(Embodiment 1)
FIG. 1 is a block diagram showing a schematic configuration of an information providing apparatus according to Embodiment 1 of the present invention. In the figure, an information providing apparatus 1 according to the present embodiment is used by being mounted on a vehicle, and includes an input unit 10, a control unit 11, and an output unit 12. The input unit 10 includes an imaging unit 101, images the outside in the traveling direction of a vehicle (not shown) on which the information providing device 1 is mounted, and outputs video information. The imaging unit 101 is, for example, the above-described ADAS camera. The control unit 11 includes a CPU (Central Processing Unit) (not shown), a ROM (Read Only Memory) storing a program for controlling the CPU, and a RAM (Random Access Memory) used in the operation of the CPU.

  Based on the video information output from the input unit 10, the control unit 11 determines whether or not the vehicle on which the information providing device 1 is mounted has deviated from the lane. The lane departure detection frequency Y1 is calculated. If the calculated lane departure detection count Y1 is less than a predetermined threshold, the control unit 11 outputs notification information for issuing a warning for lane departure (that is, performs the first notification), and calculates the calculated lane. If the deviation detection count Y1 is equal to or greater than a predetermined threshold, notification information for issuing a warning prompting a break is output (that is, second notification is performed). Moreover, the control part 11 determines the presence or absence of a pedestrian based on the video information output from the input part 10, and when it is judged that there is a pedestrian, it calculates the pedestrian detection count Y2 for the past X2 seconds. If the calculated number of detected pedestrians Y2 is less than a predetermined threshold, the control unit 11 outputs notification information for issuing a warning that the pedestrian is approaching (that is, the first notification is sent). If the calculated number of detected pedestrians Y2 is equal to or greater than a predetermined threshold value, notification information for issuing a warning prompting slowing down is output (that is, second notification is performed).

  The output unit 12 includes a speaker 121 and a monitor 122, outputs a voice message from the speaker 121 based on the notification information output from the control unit 11, and displays the notification content on the monitor 122. Note that the speaker 121 corresponds to a sound emitting unit, and the monitor 122 corresponds to a display unit.

  Next, operation | movement of the information provision apparatus 1 which concerns on this Embodiment is demonstrated.

  FIG. 2 is a flowchart showing the lane departure warning process of the information providing apparatus 1 according to the present embodiment. In the figure, the control unit 11 first detects a lane departure based on the video information output from the input unit 10 (step S1). And the control part 11 determines whether there exists any lane departure (step S2). If the control unit 11 determines that the vehicle has not deviated from the lane in this determination (that is, determines “NO”), the control unit 11 ends this process. On the other hand, when the control unit 11 determines that the vehicle has deviated from the lane (that is, when “YES” is determined), the control unit 11 calculates the lane departure detection count Y1 for the past X1 seconds (step S3).

  After calculating the lane departure detection count Y1, the control unit 11 determines whether the detection count Y1 is equal to or greater than a predetermined threshold (step S4). Here, the predetermined threshold is a value related to the degree of fatigue of the driver, and is a value that indicates fatigue when exceeding this value. When it is determined that the number of lane departure detections Y1 is less than a predetermined threshold (that is, when the driver determines that the driver is not tired and determines “NO”), the control unit 11 issues a warning for lane departure (step S5). That is, the control unit 11 outputs notification information for issuing a warning about lane departure to the output unit 12 and outputs a voice message (for example, “I am out of the lane”) to notify the lane departure from the speaker 121 of the output unit 12. In addition to outputting, a message (for example, “lane attention”) informing the lane departure is displayed on the monitor 122. The control part 11 finishes this process, after issuing the warning with respect to lane departure.

  On the other hand, when it is determined in step S4 that the lane departure detection count Y1 is equal to or greater than a predetermined threshold (that is, when “YES” is determined), the control unit 11 issues a warning prompting a break (step S6). That is, the control unit 11 outputs notification information for issuing a warning prompting a break to the output unit 12, and a voice message prompting a break from the speaker 121 of the output unit 12 (for example, “Please take a break as you are tired. ") And a message prompting a break (for example," Let's take a break ") is displayed on the monitor 122. The control part 11 complete | finishes this process, after issuing the warning which prompts a break. The control unit 11 repeats the lane departure warning process (steps S1 to S6) described above, for example, every second.

  FIG. 3 is a diagram schematically showing the above-described lane departure warning process. In the figure, when the vehicle 50 equipped with the information providing device 1 deviates from the lane 60, a voice message (“I am out of the lane”) is output from the speaker 121 of the output unit 12 and the monitor of the output unit 12. A “lane caution” is displayed at 122. This warning process is performed every time the vehicle 50 departs from the lane 60.

  If the driver is wobbling, such as when the driver is sleepy, and the lane departure detection count Y1 for the past X1 seconds exceeds a predetermined threshold, a voice message (“O "Please rest as if you are tired") is output, and a message prompting the user to take a break "Let's take a break" is displayed on the monitor 122 of the output unit 12.

  FIG. 4 is a flowchart showing a pedestrian warning process of the information providing apparatus 1 according to the present embodiment. In the figure, the control unit 11 first detects a pedestrian based on the video information output from the input unit 10 (step S10). And the control part 11 determines whether there exists a pedestrian (step S11). When it is determined that there is no pedestrian in this determination (that is, when it is determined “NO”), the control unit 11 ends this process. On the other hand, when it is determined that there is a pedestrian (that is, when “YES” is determined), the control unit 11 calculates the pedestrian detection count Y2 for the past X2 seconds (step S12).

  After calculating the pedestrian detection count Y2, the control unit 11 determines whether or not the detection count Y2 is equal to or greater than a predetermined threshold (step S13). Here, the predetermined threshold is a value assuming a pedestrian dense zone such as a shopping street. When the control unit 11 determines that the pedestrian detection count Y2 is less than a predetermined threshold (that is, when the determination is “NO” because it is not a pedestrian dense zone), the control unit 11 issues a warning that the pedestrian is approaching. Output (step S14). That is, the control unit 11 outputs notification information for issuing a warning about approaching a pedestrian to the output unit 12, and a voice message (for example, notifying the approach of the pedestrian from the speaker 121 of the output unit 12). "Please pay attention to pedestrians") and a message (for example, "cautions for pedestrians") informing the approach to the pedestrian is displayed on the monitor 122. The control part 11 complete | finishes this process, after giving the warning with respect to approaching with a pedestrian.

  On the other hand, when determining in step S13 that the pedestrian detection count Y2 is equal to or greater than a predetermined threshold (that is, when “YES” is determined), the control unit 11 issues a warning prompting slow driving (step S15). In other words, the control unit 11 outputs notification information for issuing a warning prompting slowing down to the output unit 12, and a voice message prompting slowing down from the speaker 121 of the output unit 12 (for example, “Please walk slowly with a pedestrian”). ) And a message prompting slowing down (for example, “Let's slow down”) is displayed on the monitor 122. The control unit 11 finishes the process after issuing a warning for urging the vehicle slowly. The control part 11 repeats the pedestrian warning process (step S10-step S15) mentioned above, for example for every second.

  FIG. 5 is a diagram schematically showing the pedestrian warning process described above. In the figure, when the vehicle 50 equipped with the information providing apparatus 1 approaches the pedestrian 70, a voice message ("Please pay attention to the pedestrian") is output from the speaker 121 of the output unit 12, and the output unit “Pedestrian attention” is displayed on the twelve monitors 122. This warning is issued every time the vehicle 50 approaches the pedestrian 70.

  When approaching the pedestrian dense zone 80 and the pedestrian detection count Y2 for the past X2 seconds exceeds a predetermined threshold value, a voice message prompting slowing down from the speaker 121 of the output unit 12 ("please slow down there are pedestrians" ) Is output, and a message for urging “slow down” is displayed on the monitor 122 of the output unit 12.

  The operation of the information providing apparatus 1 described above can be realized by executing a program with the CPU of the control unit 11. Further, this program may be stored in a server (not shown) on the Internet, for example, and downloaded from the server to the information providing apparatus 1. It is to be noted that the operation of these information providing apparatuses can be realized by a program, and that the program can be downloaded from the server, similarly in the information providing apparatuses 2, 3, 901, 1201 described below.

  As described above, the information providing apparatus 1 according to the present embodiment photographs the outside in the traveling direction of the vehicle, determines the lane departure of the vehicle based on the video information obtained by photographing, and deviates from the lane. The lane departure detection count Y1 for the past X1 seconds is calculated, and if the calculated lane departure detection count Y1 is less than a predetermined threshold, a warning about lane departure is issued, and the calculated lane departure detection count Y1 is greater than or equal to the predetermined threshold. If so, issue a warning prompting you to take a break. In this way, a sufficient warning effect can be obtained, and appropriate driving assistance that cannot be realized by repeating warnings with simple beeps or the like becomes possible.

  Furthermore, the information providing apparatus 1 according to the present embodiment provides a predetermined threshold for the number of lane departure detections, switches notifications according to less than the threshold and more than the threshold, and continues by repeating the above lane departure warning process. When a lane departure is repeated, the first notification (eg, “I am out of the lane”, “Caution of lane”) is made first, and then the second notification (eg, “O” I feel tired. Take a break "" Let's take a break "). Thereby, the familiarity by one kind of information can be suppressed and sufficient warning effect can be obtained.

  In addition, the information providing apparatus 1 according to the present embodiment photographs the outside in the traveling direction of the vehicle, determines the presence / absence of a pedestrian based on video information obtained by photographing, and if there is a pedestrian, The pedestrian detection count Y2 for X2 seconds is calculated. If the calculated pedestrian detection count Y2 is less than a predetermined threshold, a warning is given that the pedestrian is approaching and the calculated pedestrian detection count Y2 is predetermined. If it is equal to or greater than the threshold value, a warning for slowing down is issued. In this way, a sufficient warning effect can be obtained, and appropriate driving assistance that cannot be realized by repeating warnings with simple beeps or the like becomes possible.

  Furthermore, the information providing apparatus 1 according to the present embodiment provides a predetermined threshold for the number of times pedestrians are detected, switches notifications according to less than the threshold and greater than or equal to the threshold, and continues by repeating the above pedestrian warning process. When the pedestrian detection is repeated, the first notification is made that is less than the threshold and the first notification (e.g. "Please pay attention to pedestrians" or "Pedestrian attention"). (Example: “Please walk slowly there are pedestrians” “Let's slow down”). Thereby, the familiarity by one kind of information can be suppressed and sufficient warning effect can be obtained.

  In the information providing apparatus 1 according to the present embodiment, only the situation outside the traveling direction of the vehicle is acquired, but the situation outside the traveling direction opposite to the traveling direction (that is, the rear) and the vehicle You may make it also acquire the condition of the outer side of the left-right both directions, and can obtain the further warning effect by doing in that way.

  Further, in the information providing apparatus 1 according to the present embodiment, a warning is issued with a voice message when a lane departure or a pedestrian is detected, but the voice message may be a beep sound. For example, when the information providing apparatus 1 deviates from the lane, the information providing apparatus 1 outputs a beep sound instead of the voice message “I am out of the lane”. Further, when the information providing apparatus 1 detects a pedestrian, the information providing apparatus 1 outputs a beep sound instead of the voice message “Please pay attention to the pedestrian”. When prompting a break or slowing down, it is difficult to understand with a beep, so use a voice message.

  Furthermore, in the information providing apparatus 1 according to the present embodiment, the first notification is described as a beep sound, but is not limited thereto, and may be a voice message or a display.

  Moreover, although the information provision apparatus 1 which concerns on this Embodiment was mounted and used for a vehicle, you may make it integrate with a vehicle.

  Moreover, although the information provision apparatus 1 which concerns on this Embodiment was mounted and used for the vehicle with a wheel, use of the vehicle (for example, hovercraft) without a wheel or a ship is also possible naturally.

  Moreover, although the information provision apparatus 1 which concerns on this Embodiment made notification two steps (1st notification, 2nd notification), it is not limited to two steps, What is necessary if it is two steps or more? It doesn't matter at the stage.

  Further, in the information providing device 1 according to the present embodiment, the determination on the first notification and the determination on the second notification are performed by the device side, that is, the control unit 11. At least one of them may be performed by an external device, and the determination result may be received by the apparatus and a warning may be issued.

  FIG. 6 is a block diagram illustrating a schematic configuration of the information providing system 30 in which an external device performs the determination to perform the first notification and the determination to perform the second notification. In the figure, the same reference numerals are given to the portions common to FIG. 1 described above. The information providing system 30 performs the determination to perform the first notification and the determination to perform the second notification by the external device, the information providing apparatus 2 having a function of performing the first notification, and the determination to perform the first notification and the second notification. A server 311 in the cloud 31 that performs the determination, and an access point 32 that relays wireless communication between the information providing apparatus 2 and the server 311 in the cloud 31 are provided.

  The information providing device 2 is used by being mounted on a vehicle, and includes an input unit 10 having an imaging unit 101, a control unit 11A, an output unit 12 having a speaker 121 and a monitor 122, a communication unit 13, and an antenna. 14. The input unit 10 captures the outside in the traveling direction of a vehicle (not shown) on which the information providing device 2 is mounted, and outputs video information. The control unit 11A includes a CPU (not shown), a ROM that stores a program for controlling the CPU, and a RAM that is used in the operation of the CPU. 11 A of control parts output the video information (information corresponding to an outer condition) output from the input part 10 to the communication part 13, and acquire the judgment result (information corresponding to alerting | reporting) output from the communication part 13 . 11 A of control parts will perform 1st alert | report, if the judgment result which issues the warning with respect to lane departure from the communication part 13 is acquired, and will perform 2nd alerting | reporting if the judgment result which issues the warning which prompts a break is acquired. In this case, the first notification is a voice message informing the lane departure (for example, “I am out of the lane”) and a display informing the lane departure (for example, “lane attention”), and the second notification is for taking a break. A voice message prompting the user (for example, “Thank you for taking a break”) and a display prompting you to take a break (for example, “Let's take a break”).

  Moreover, if the control part 11A acquires the judgment result which issues the warning with respect to approaching with a pedestrian from the communication part 13 and will perform 1st alerting | reporting and will issue the warning which accelerates, it will be 2nd Is notified. In this case, the first notification is a voice message (for example, “please pay attention to the pedestrian”) that informs that the person is approaching the pedestrian, and a display that indicates the approach to the pedestrian (for example, “attention to pedestrian”). And the second notification is a voice message that prompts slowing down (for example, “Please walk slowly there is a pedestrian”) and a display that prompts slowing down (for example, “Let's slow down”).

  The communication unit 13 transmits the video information output from the control unit 11 </ b> A from the antenna 14. The video information transmitted from the antenna 14 is sent to the server 311 in the cloud 31 via the access point 32. Further, the communication unit 13 outputs the determination result from the server 311 in the cloud 31 received by the antenna 14 to the control unit 11A. When the server 311 in the cloud 31 determines whether the vehicle on which the information providing device 2 is mounted deviates from the lane based on the video information (information corresponding to the outside situation), The lane departure detection count Y1 for the past X1 seconds is calculated. Then, the server 311 outputs information corresponding to the first notification if the calculated lane departure detection count Y1 is less than a predetermined threshold, and if the calculated lane departure detection count Y1 is equal to or greater than the predetermined threshold, Information corresponding to the second notification is output. The information corresponding to the output first notification or the information corresponding to the second notification is transmitted to the information providing apparatus 2 via the access point 32.

  As described above, since the determination for performing the first notification regarding the lane departure and the determination for performing the second notification are performed externally, the means for performing the determination can be omitted, thereby reducing the cost.

  Also, the server 311 in the cloud 31 determines the presence or absence of a pedestrian based on video information (information corresponding to the outside situation), and if it is determined that there is a pedestrian, calculates the pedestrian detection count Y2 for the past X2 seconds. To do. If the calculated number of detected pedestrians Y2 is less than a predetermined threshold, the server 311 outputs information corresponding to the first notification. If the calculated number of detected pedestrians Y2 is equal to or greater than the predetermined threshold, Information corresponding to the second notification is output. The information corresponding to the output first notification or the information corresponding to the second notification is transmitted to the information providing apparatus 2 via the access point 32.

  Thus, since the judgment which performs the 1st information about a pedestrian and the judgment which performs the 2nd information are performed outside, the means which performs the said judgment can be omitted, and cost reduction can be attained by this.

(Embodiment 2)
FIG. 7 is a block diagram showing a schematic configuration of the information providing apparatus according to Embodiment 2 of the present invention. In the figure, the same reference numerals are given to the portions common to FIG. 1 described above.

  In FIG. 7, the information providing apparatus 3 according to the present embodiment is used by being mounted on a vehicle, and includes an input unit 15, a control unit 16, and an output unit 12. The input unit 15 includes an imaging unit 1501 and a vehicle information acquisition unit 1502, and captures the outside in the traveling direction of a vehicle (not shown) on which the information providing device 3 according to the present embodiment is mounted, and outputs video information. At the same time, vehicle information is output.

  The vehicle information acquisition unit 1502 is connected to a control unit of a vehicle (not shown) via an OBD2 adapter (not shown) and an OBD2 connector (not shown) in a wired manner, and receives vehicle information including vehicle speed information etc. Input). The exchange of information between the vehicle information acquisition unit 1502 and the OBD2 adapter conforms to the USB method. The vehicle information acquisition unit 1502 and the vehicle control unit are not limited to the OBD2 connector, and may be wired via a CAN or J1939. Further, the vehicle information acquisition unit 1502 and the vehicle control unit are not limited to wired connection but may be wireless connection. Further, the vehicle speed information may be a numerical value indicating the vehicle speed, may be a simple pulse or the like, and may be information corresponding to the vehicle speed.

  The imaging unit 1501 corresponds to the first input unit, and the vehicle information acquisition unit 1502 corresponds to the second input unit.

  The control unit 16 includes a pedestrian detection unit 1601, a vehicle speed detection unit 1602, a state estimation unit 1603, and a notification information generation unit 1604. The control unit 16 is composed of a CPU (not shown), a ROM storing a program for controlling the CPU, and a RAM used in the operation of the CPU, like the control unit 11 (see FIG. 1) described above. .

  The pedestrian detection unit 1601 detects a pedestrian based on video information output from the imaging unit 1501 of the input unit 15 and outputs pedestrian information. The vehicle speed detection unit 1602 detects the vehicle speed based on the vehicle information output from the vehicle information acquisition unit 1502 of the input unit 15 and outputs the vehicle speed information. The state estimation unit 1603 estimates the state of the vehicle based on the pedestrian information output from the pedestrian detection unit 1601 and the vehicle speed information output from the vehicle speed detection unit 1602, and outputs a state estimation result. The notification information generation unit 1604 generates notification information based on the situation estimation result output from the state estimation unit 1603.

  The state estimation unit 1603 determines the presence / absence of a pedestrian based on the pedestrian information. If the state estimation unit 1603 determines that there is a pedestrian, the state estimation unit 1603 calculates a pedestrian detection count Y2 for the past X2 seconds. Then, if the calculated number of detected pedestrians Y2 is less than a predetermined threshold, the state estimating unit 1603 estimates that the person is approaching the pedestrian and outputs the situation estimation result. If the calculated number of detected pedestrians Y2 is equal to or greater than a predetermined threshold, the state estimating unit 1603 estimates that the vehicle is traveling in a dense pedestrian zone, and outputs the situation estimation result.

  When the status estimation result in the state estimation unit 1603 is “approaching a pedestrian”, the notification information generating unit 1604 provides notification information for giving a warning to the driver that the pedestrian is approaching. Output (that is, perform the first notification). In addition, when the state estimation result in the state estimation unit 1603 is “close to a pedestrian dense zone”, the notification information generation unit 1604 outputs notification information for giving a warning to the driver to drive slowly. (That is, the second notification is performed).

  The output unit 12 outputs a voice message from the speaker 121 based on the notification information output from the notification information generation unit 1604 and displays the notification content on the monitor 122. In this case, a voice message or display for warning the approach to a pedestrian is performed. That is, the output unit 12 outputs a voice message (e.g., “walking” for notifying the approach to the pedestrian when the notification information generating unit 1604 outputs notification information for the driver to warn of approaching the pedestrian. ”) And a message notifying the approach to the pedestrian (for example,“ pedestrian caution ”) is displayed, and the notification information generating unit 1604 responds to the approach to the pedestrian crowded area. When notification information for warning to the driver is output, a voice message prompting slowing down (for example, “Please walk slowly there is a pedestrian”) and a message prompting slowing down (for example, “Let's slow down”) Is displayed.

  Next, the operation of the information providing apparatus 3 according to this embodiment will be described.

  FIG. 8 is a flowchart showing a pedestrian warning process of the information providing apparatus 3 according to this embodiment. In the figure, the control unit 16 first detects a pedestrian based on video information output from the input unit 15 (step S20). And the control part 16 determines whether there is a pedestrian (step S21). When it is determined that there is no pedestrian in this determination (that is, when it is determined “NO”), the control unit 16 ends this process. On the other hand, when it is determined that there is a pedestrian (that is, when “YES” is determined), the control unit 16 calculates the pedestrian detection count Y2 for the past X2 seconds (step S22).

  After calculating the pedestrian detection count Y2, the control unit 16 determines whether the detection count Y2 is greater than or equal to a predetermined threshold (step S23). Here, the predetermined threshold is a value assuming a pedestrian dense zone. When it is determined that the pedestrian detection count Y2 is less than a predetermined threshold (that is, when it is determined as “NO” because it is not a pedestrian dense zone), a warning is given to the fact that the pedestrian is approaching (step S24). . That is, the control unit 16 outputs notification information for giving a warning that the pedestrian is approaching to the output unit 12, and a voice message (for example, informing the approach of the pedestrian from the speaker 121 of the output unit 12). "Please pay attention to pedestrians") and a message (for example, "cautions for pedestrians") informing the approach to the pedestrian is displayed on the monitor 122. The control part 16 complete | finishes this process, after giving the warning with respect to approaching a pedestrian.

  On the other hand, when determining in step S23 that the pedestrian detection count Y2 is equal to or greater than a predetermined threshold (that is, when “YES” is determined), the control unit 16 is based on the vehicle information output from the input unit 15. The vehicle speed is detected (step S25). And the control part 16 determines whether the detected vehicle speed is more than a predetermined threshold value (step S26). Here, the predetermined threshold value is a value assuming a vehicle speed during slow driving. When it is determined that the detected vehicle speed is less than the predetermined threshold (that is, when it is determined that the vehicle is slowing down and “NO”), the control unit 16 ends this process. On the other hand, when it is determined that the detected vehicle speed is equal to or higher than the predetermined threshold (that is, when “YES” is determined), the control unit 16 issues a warning for prompting slowing down (step S27). That is, the control unit 16 outputs notification information for performing a warning to prompt slowing to the output unit 12, and a voice message for prompting slow driving from the speaker 121 of the output unit 12 (for example, “Please walk slowly with a pedestrian”). ) And a message prompting slowing down (for example, “Let's slow down”) is displayed on the monitor 122. The control unit 16 finishes this process after giving a warning for gradual driving. The control part 16 repeats the pedestrian warning process (step S20-step S27) mentioned above, for example for every second. In addition, the figure which shows typically the pedestrian warning process of the information provision apparatus 3 which concerns on this Embodiment is the same as that of FIG. 5 mentioned above.

  As described above, the information providing apparatus 3 according to the present embodiment photographs the outside in the traveling direction of the vehicle, determines the presence or absence of a pedestrian based on video information obtained by photographing, and when there is a pedestrian, The pedestrian detection count Y2 for the past X2 seconds is calculated. If the calculated pedestrian detection count Y2 is less than a predetermined threshold, a warning is given that the pedestrian is approaching, and the calculated pedestrian detection count Y2 is If the vehicle speed is greater than or equal to a predetermined threshold, the vehicle speed is detected based on the vehicle speed information, and if the detected vehicle speed is greater than or equal to the predetermined threshold, a warning for urging is issued. In this way, a sufficient warning effect can be obtained, and appropriate driving assistance that cannot be realized by repeating warnings with simple beeps or the like becomes possible.

  Furthermore, the information providing apparatus 3 according to the present embodiment provides a predetermined threshold for the number of pedestrian detections, switches notifications according to less than the threshold and greater than or equal to the threshold, and continues by repeating the above pedestrian warning process. When the pedestrian detection is repeated, the first notification is made that is less than the threshold and the first notification (e.g. "Please pay attention to pedestrians" or "Pedestrian attention"). (Example: “Please walk slowly there are pedestrians” “Let's slow down”). Thereby, the familiarity by one kind of information can be suppressed and sufficient warning effect can be obtained.

  In addition, even when the information providing device 3 is slowing down below a certain threshold value as described above and the vehicle speed is slowing below a certain value, the information providing device 3 makes a second notification (e.g. Please do "or" Let's go slowly "). Therefore, as a result, the second notification can be appropriately performed, and a sufficient warning effect can be obtained when the driver trusts the second notification.

(Embodiment 3)
FIG. 9 is a block diagram showing a schematic configuration of the information providing apparatus according to Embodiment 3 of the present invention. In the figure, the same reference numerals are given to the portions common to FIGS. 1, 6, and 7 described above, and a part of the description is saved.

  In FIG. 9, an information providing apparatus 901 according to the present embodiment is used by being mounted on a vehicle, and includes a pad terminal 912, a wireless speaker 904, and an ADAS 906. The Pad terminal 912 includes a communication unit 13, an antenna 14 connected to the communication unit 13, a monitor 122, a wireless connection unit 903, an antenna 909 connected to the wireless connection unit 903, and a control unit 902. The pad terminal 912 is not limited to such an article as long as the pad terminal 912 has a function and effect intended by the present invention, such as a smartphone terminal, a navigation terminal, and other terminals.

  Similar to the control unit 11 of FIG. 1, the control unit 902 includes a CPU (Central Processing Unit) (not shown), a ROM (Read Only Memory) storing a program for controlling the CPU, and a RAM ( Random Access Memory).

  The wireless speaker 904 includes a speaker 121, an antenna 910, and a speaker control unit 905 that outputs an audio signal to the speaker 121 based on a radio signal received by the antenna 910. The ADAS 906 includes an imaging unit 101, an antenna 911, a speaker 908, and an ADAS control unit 907 that sounds the speaker 908 based on an image captured by the imaging unit and outputs a predetermined wireless signal to the antenna 911. .

  The wireless speaker 904 is inside the vehicle (not shown) and is attached to the sun visor. The speaker 121 of the wireless speaker 904 is installed so that sound can be emitted toward the driver of the vehicle.

  The ADAS 906 is mounted inside a vehicle (not shown) and attached to a windshield. The imaging unit 101 of the ADAS 906 captures the outside in the traveling direction of the vehicle through the windshield and outputs the image to the ADAS control unit 907. Note that ADAS 906 is not limited to a mounting method that is mounted on a windshield and may be mounted on a dashboard, for example.

  The Pad terminal 912, the wireless speaker 904, and the ADAS 906 are separate bodies, and the wireless connection unit 903 and the speaker control unit 905 communicate with each other by a Bluetooth (registered trademark) wireless communication system via the antenna 909 and the antenna 910. Is possible. Similarly, the wireless connection unit 903 and the ADAS control unit 907 can communicate with each other using the Bluetooth (registered trademark) wireless communication system via the antenna 909 and the antenna 911.

  The speaker control unit 905 emits notification sound from the speaker 121 based on notification information input via the antenna 910.

  The ADAS control unit 907 determines whether or not the vehicle deviates from the lane based on the image captured by the imaging unit 101. If the ADAS control unit 907 determines that the vehicle has deviated, the ADAS control unit 907 indicates that the vehicle has deviated from the lane. The control unit 902 is notified at any time via the wireless connection unit 903. In addition, when the ADAS control unit 907 determines that the vehicle has deviated from the lane, the ADAS control unit 907 may notify the control unit 902 that the vehicle has deviated from the lane and emit a beep sound or the like at the speaker 908. .

  Further, the ADAS control unit 907 determines the presence / absence of a pedestrian based on the image captured by the imaging unit 101, and if it is determined that there is a pedestrian, an antenna 911, an antenna 909, a wireless connection unit The control unit 902 is notified at any time via 903. In addition, when the ADAS control unit 907 determines that there is a pedestrian, the ADAS control unit 907 may notify the control unit 902 that there is a pedestrian and may emit a beep sound or the like at the speaker 908.

  The monitor 122 displays the notification content based on the notification information input from the control unit 902.

  The control unit 902 calculates the lane departure detection frequency Y1 for the past X1 seconds based on the notification that the lane departure is input from the wireless connection unit 903. If the calculated lane departure detection count Y1 is less than a predetermined threshold, the control unit 902 provides notification information (corresponding to the first notification) for issuing a warning for lane departure, the monitor 122, and the wireless connection unit. 903, the antenna 909, and the speaker control unit 905 via the antenna 910. On the other hand, if the calculated number of lane departure detections Y1 is equal to or greater than a predetermined threshold, the control unit 902 similarly provides notification information (corresponding to the second notification) for issuing a warning prompting a break with the monitor 122. Notify the speaker control unit 905.

  Further, the control unit 902 calculates the pedestrian detection count Y2 for the past X2 seconds based on the notification that there is a pedestrian input from the wireless connection unit 903. Then, if the calculated number of detected pedestrians Y2 is less than a predetermined threshold, the control unit 902 monitors notification information (corresponding to the first notification) for issuing a warning that the pedestrian is approaching. 122, and the speaker control unit 905 via the wireless connection unit 903, the antenna 909, and the antenna 910. On the other hand, if the calculated number of detected pedestrians Y2 is equal to or greater than a predetermined threshold, the control unit 902 provides notification information (corresponding to the second notification) for issuing a warning prompting slowing down similarly to the monitor 122. Notify the speaker control unit 905.

  Next, the operation of the information providing apparatus 901 according to this embodiment will be described.

  FIG. 10 is a flowchart showing lane departure warning processing of the information providing apparatus 901 according to the present embodiment. In the figure, first, the ADAS control unit 907 detects a lane departure based on an image output from the imaging unit 101 (step S1001). Then, the ADAS control unit 907 determines whether or not there is a lane departure (step S1002). If the ADAS control unit 907 determines in this determination that the vehicle does not deviate from the lane (that is, determines “NO”), the ADAS control unit 907 ends this processing. In contrast, when the ADAS control unit 907 determines that the vehicle has deviated from the lane (that is, when “YES” is determined), the ADAS control unit 907 notifies the control unit 902 that the vehicle has deviated from the lane, and the speaker 908 emits a beep sound or the like. Is emitted (step S1007).

  Receiving the notification that the vehicle has deviated from the lane, the control unit 902 calculates the lane departure detection count Y1 for the past X1 seconds (step S1003). After calculating the lane departure detection count Y1, the control unit 902 determines whether the detection count Y1 is greater than or equal to a predetermined threshold (step S1004). When it is determined that the number of lane departure detections Y1 is less than a predetermined threshold (that is, when the driver determines that the driver is not tired and determines “NO”), the control unit 902 issues a warning for lane departure (step S1005). That is, the control unit 902 outputs notification information for issuing a warning about lane departure to the speaker control unit 905 and displays a message (for example, “lane attention”) informing the lane departure on the monitor 122. After the notification information for issuing a warning for lane departure is input, the speaker control unit 905 causes the speaker 121 to output a voice message (for example, “I am out of the lane”) informing the lane departure. The control unit 902 ends this process after issuing a warning for lane departure.

  On the other hand, when the control unit 902 determines that the lane departure detection count Y1 is equal to or greater than a predetermined threshold (that is, if the driver determines that the driver is tired and determines “YES”), the control unit 902 issues a warning prompting for a break ( Step S1006). That is, the control unit 902 outputs notification information for issuing a warning prompting a break to the speaker control unit 905 and causes the monitor 122 to display a message prompting a break (for example, “Let's take a break”). After the notification information for issuing a warning prompting a break is input, the speaker control unit 905 outputs a voice message (for example, “Thank you for taking a break”) that prompts the break from the speaker 121. The control unit 902 terminates the process after issuing a warning prompting for a break. The information providing apparatus 901 repeats the lane departure warning process (steps S1001 to S1007) described above, for example, every second.

  FIG. 3 is a diagram schematically showing the lane departure warning process of the information providing apparatus 1 according to the previous embodiment, but the lane departure warning process of the information providing apparatus 901 according to the present embodiment is schematically shown. It is also the figure shown.

  FIG. 11 is a flowchart showing a pedestrian warning process of the information providing apparatus 901 according to the present embodiment. In the figure, first, the ADAS control unit 907 detects a pedestrian based on the image output from the imaging unit 101 (step S1110). Then, the ADAS control unit 907 determines whether there is a pedestrian (step S1111). When the ADAS control unit 907 determines that there is no pedestrian in this determination (that is, determines “NO”), the ADAS control unit 907 ends the present process. On the other hand, when the ADAS control unit 907 determines that there is a pedestrian (that is, when “YES” is determined), the ADAS control unit 907 notifies the control unit 902 that there is a pedestrian (step S1116).

  Receiving the notification that there is a pedestrian, the control unit 902 calculates the pedestrian detection count Y2 for the past X2 seconds (step S1112). After calculating the pedestrian detection count Y2, the control unit 902 determines whether the detection count Y2 is equal to or greater than a predetermined threshold (step S1113). When the control unit 902 determines that the pedestrian detection count Y2 is less than a predetermined threshold (that is, if the determination is “NO” because it is not a pedestrian dense zone), the control unit 902 issues a warning that the pedestrian is approaching. Output (step S1114). That is, the control unit 902 outputs notification information for issuing a warning about approaching a pedestrian to the speaker control unit 905 and also notifies the monitor 122 of the approach to the pedestrian (for example, “pedestrian attention” ”) Is displayed. After the notification information for issuing a warning about approaching the pedestrian is input, the speaker control unit 905 sends a voice message to notify the pedestrian from the speaker 121 (for example, “Please pay attention to the pedestrian. )) Is output. The control unit 902 issues a warning for approaching the pedestrian and then ends the process.

  On the other hand, when it is determined that the pedestrian detection count Y2 is equal to or greater than a predetermined threshold (that is, when “YES” is determined), the control unit 902 issues a warning prompting slowing down (step S1115). That is, the control unit 902 outputs notification information for issuing a warning prompting slowing down to the speaker control unit 905 and causes the monitor 122 to display a message prompting slowing down (for example, “Let's slow down”). After the notification information for issuing a warning prompting slowing down is input, the speaker control unit 905 outputs a voice message that prompts slowing down from the speaker 121 (for example, “Please walk slowly there is a pedestrian”). The control unit 902 terminates the process after issuing a warning prompting slowing down. The information providing apparatus 901 repeats the pedestrian warning process (steps S1110 to S1116) described above, for example, every second.

  FIG. 5 is a diagram schematically showing the pedestrian warning process of the information providing apparatus 1 according to the previous embodiment, but the pedestrian warning process of the information providing apparatus 901 according to the present embodiment is schematically shown. It is also the figure shown.

  As described above, the information providing apparatus 901 according to the present embodiment photographs the outside in the traveling direction of the vehicle, determines the lane departure of the vehicle based on the video information obtained by photographing, and deviates from the lane. The lane departure detection count Y1 for the past X1 seconds is calculated, and if the calculated lane departure detection count Y1 is less than a predetermined threshold, a warning about lane departure is issued, and the calculated lane departure detection count Y1 is greater than or equal to the predetermined threshold. If so, issue a warning prompting you to take a break. In this way, a sufficient warning effect can be obtained, and appropriate driving assistance that cannot be realized by repeating warnings with simple beeps or the like becomes possible.

  Here, regarding the lane departure, it is considered that the situation of the driver is different between a case where the lane departure occurs and a case where the lane departure occurs continuously. A single occurrence is just a careless situation, and a continuous occurrence is considered a fatigue situation. The information providing apparatus 901 according to the present embodiment provides a predetermined threshold for the number of lane departure detections, and switches the notification according to less than the threshold and greater than or equal to the threshold, so that if the information is less than the threshold (single occurrence), the first When reporting (eg “I am out of the lane” or “Care in the lane”) and above the threshold (continuous occurrence), the second notification (eg “Take a break as you are tired” “Let ’s rest” )I do. In this way, notification corresponding to the driver's situation can be made. In particular, during continuous occurrence, rather than simply calling attention to lane departures, the driver will be notified specifically of solutions to fatigue that is the root cause of continuous occurrence (breaks, etc.), so drivers can easily recognize the solution, It is easier to implement a solution that suits the situation.

  Furthermore, the information providing apparatus 901 according to the present embodiment provides a predetermined threshold for the number of lane departure detections, switches the notification according to less than the threshold and greater than or equal to the threshold, and continues by repeating the above lane departure warning process. When a lane departure is repeated, the first notification (eg, “I am out of the lane”, “Caution of lane”) is made first, and then the second notification (eg, “O” I feel tired. Take a break "" Let's take a break "). Thereby, the familiarity by one kind of information can be suppressed and sufficient warning effect can be obtained.

  In addition, the information providing apparatus 901 according to the present embodiment photographs the outside in the traveling direction of the vehicle, determines the presence / absence of a pedestrian based on video information obtained by photographing, and if there is a pedestrian, The pedestrian detection count Y2 for X2 seconds is calculated. If the calculated pedestrian detection count Y2 is less than a predetermined threshold, a warning is given that the pedestrian is approaching and the calculated pedestrian detection count Y2 is predetermined. If it is equal to or greater than the threshold value, a warning for slowing down is issued. In this way, a sufficient warning effect can be obtained, and appropriate driving assistance that cannot be realized by repeating warnings with simple beeps or the like becomes possible.

  Furthermore, the information providing apparatus 901 according to the present embodiment provides a predetermined threshold for the number of pedestrian detections, switches notifications according to less than the threshold and greater than or equal to the threshold, and continues by repeating the above pedestrian warning process. When the pedestrian detection is repeated, the first notification is made that is less than the threshold and the first notification (e.g. "Please pay attention to pedestrians" or "Pedestrian attention"). (Example: “Please walk slowly there are pedestrians” “Let's slow down”). Thereby, the familiarity by one kind of information can be suppressed and sufficient warning effect can be obtained.

  In the information providing apparatus 901 according to the present embodiment, only the situation outside the traveling direction of the vehicle is acquired, but the situation outside the direction opposite to the traveling direction (that is, rearward) or the vehicle You may make it also acquire the condition of the outer side of the left-right both directions, and can obtain the further warning effect by doing in that way.

  Further, in the information providing apparatus 901 according to the present embodiment, when a lane departs or when a pedestrian is detected, a voice message (eg “out of the lane” “ Please give me a warning.) However, instead of this, a beep sound emitted from the above-described ADAS 906 speaker 908 may be used. Alternatively, a beep sound emitted by the speaker 908 in parallel with the first notification voice message may be used.

  Moreover, although the information providing apparatus 901 according to the present embodiment is used by being mounted on a vehicle, it may be integrated with the vehicle.

  Moreover, although the information provision apparatus 901 which concerns on this Embodiment was mounted and used for the vehicle with a wheel, of course, the use with a vehicle (for example, hovercraft) without a wheel or a ship is also possible.

  In addition, the information providing apparatus 901 according to the present embodiment uses two levels of notification (first notification and second notification), but is not limited to two levels, and what is required is two levels or more. It doesn't matter at the stage.

  Further, in the information providing apparatus 901 according to the present embodiment, the apparatus side, that is, the control unit 902 performs the determination to perform the first notification and the determination to perform the second notification. However, as in the information providing apparatus 2 according to the previous embodiment, at least one of these determinations may be performed by an external device, and the determination result may be received by the present apparatus to issue a warning. .

  Note that the information providing apparatus 901 according to the present embodiment includes the pad terminal 912, the wireless speaker 904, and the ADAS 906 as the information providing apparatus 901. However, the pad terminal 912 alone may be regarded as an information providing apparatus. In this case, the input unit corresponds to the antenna 909 and the wireless connection unit 903 that receive the notification that the vehicle has deviated from the lane and / or the notification that there is a pedestrian, and the output unit is notification information for issuing a warning about the departure from the lane, Wireless connection unit 903 and antenna 909 for outputting notification information for issuing a warning prompting a break, notification information for issuing a warning for approaching a pedestrian, notification information for issuing a warning prompting slowing down, etc. And / or the monitor 122 corresponds.

  In the information providing apparatus 901 according to the present embodiment, the pad terminal 912 and the wireless speaker 904 and the pad terminal 912 and the ADAS 906 communicate with each other by a wireless system. You may make it communicate.

  In the information providing apparatus 901 according to the present embodiment, the pad terminal 912, the wireless speaker 904, and the ADAS 906 are separated from each other. However, the pad terminal 912 and the wireless speaker 904 may be integrated. The pad terminal 912 and the ADAS 906 may be integrated.

(Embodiment 4)
FIG. 12 is a block diagram showing a schematic configuration of an information providing apparatus according to Embodiment 4 of the present invention. In the figure, the same reference numerals are given to the portions common to FIGS. 1, 6, 7, and 9 described above, and a part of the description is omitted.

  In FIG. 12, an information providing apparatus 1201 according to the present embodiment is used by being mounted on a vehicle, and includes a pad terminal 1212, a wireless speaker 904, and an ADAS 906. The Pad terminal 1212 includes a communication unit 13, an antenna 14 connected to the communication unit 13, a monitor 122, a wireless connection unit 903, an antenna 909 connected to the wireless connection unit 903, a vehicle information acquisition unit 1502, A control unit 1202 is provided.

  The control unit 1202 includes a CPU (Central Processing Unit) (not shown), a ROM (Read Only Memory) that stores a program for controlling the CPU, and a RAM ( Random Access Memory).

  The vehicle information acquisition unit 1502 is connected to a control unit of a vehicle (not shown) via an OBD2 adapter (not shown) and an OBD2 connector (not shown) in a wired manner, and receives vehicle information including vehicle speed information etc. The vehicle speed information is output to the control unit 1202. The exchange of information between the vehicle information acquisition unit 1502 and the OBD2 adapter conforms to the USB method. The vehicle information acquisition unit 1502 and the vehicle control unit are not limited to the OBD2 connector, and may be wired via a CAN or J1939. Further, the vehicle information acquisition unit 1502 and the vehicle control unit are not limited to wired connection but may be wireless connection. Further, the vehicle speed information may be a numerical value indicating the vehicle speed, may be a simple pulse or the like, and may be information corresponding to the vehicle speed. Further, the vehicle speed information may be acquired from ADAS 906.

  The imaging unit 101 corresponds to the first input unit, and the vehicle information acquisition unit 1502 corresponds to the second input unit.

  The control unit 1202 calculates the pedestrian detection count Y2 for the past X2 seconds based on the notification that there is a pedestrian input from the wireless connection unit 903. If the calculated number of detected pedestrians Y2 is less than a predetermined threshold, the control unit 1202 monitors notification information (corresponding to the first notification) for issuing a warning that the pedestrian is approaching. 122, and the speaker control unit 905 via the wireless connection unit 903, the antenna 909, and the antenna 910. On the other hand, if the calculated number of detected pedestrians Y2 is equal to or greater than a predetermined threshold and the vehicle speed is equal to or greater than the predetermined threshold, the control unit 1202 provides notification information for issuing a warning prompting slow travel (second Similarly, the monitor 122 and the speaker control unit 905 are notified.

  Next, the operation of the information providing apparatus 1201 according to this embodiment will be described.

  FIG. 13 is a flowchart showing a pedestrian warning process of information providing apparatus 1201 according to the present embodiment. In the figure, first, the ADAS control unit 907 detects a pedestrian based on the image output from the imaging unit 101 (step S1320). Then, the ADAS control unit 907 determines whether there is a pedestrian (step S1321). When it is determined that there is no pedestrian in this determination (that is, when “NO” is determined), the present process is terminated. In contrast, when the ADAS control unit 907 determines that there is a pedestrian (that is, when “YES” is determined), the ADAS control unit 907 notifies the control unit 1202 that there is a pedestrian (step S1328).

  Receiving the notification that there is a pedestrian, the control unit 1202 calculates the pedestrian detection count Y2 for the past X2 seconds (step S1322). After calculating the pedestrian detection count Y2, the control unit 1202 determines whether the detection count Y2 is greater than or equal to a predetermined threshold (step S1323). If the control unit 1202 determines that the pedestrian detection count Y2 is less than a predetermined threshold (that is, if the determination is “NO” because it is not a pedestrian dense zone), the control unit 1202 warns that the pedestrian is approaching. Output (step S1324). That is, the control unit 1202 outputs notification information for issuing a warning to the speaker control unit 905 that the pedestrian is approaching, and also notifies the monitor 122 of the approach to the pedestrian (for example, “pedestrian attention” ”) Is displayed. After the notification information for issuing a warning about approaching the pedestrian is input, the speaker control unit 905 sends a voice message to notify the pedestrian from the speaker 121 (for example, “Please pay attention to the pedestrian. )) Is output. The control unit 1202 terminates the process after issuing a warning for approaching the pedestrian.

  On the other hand, when it is determined that the pedestrian detection count Y2 is equal to or greater than a predetermined threshold (that is, when “YES” is determined), the control unit 1202 determines the vehicle speed based on the vehicle speed information output from the vehicle information acquisition unit 1502. Is detected (step S1325). Then, the control unit 1202 determines whether or not the detected vehicle speed is equal to or higher than a predetermined threshold (step S1326). Here, the predetermined threshold value is a value assuming a vehicle speed during slow driving. When it is determined that the detected vehicle speed is less than the predetermined threshold (that is, when it is determined that the vehicle is slowing down and “NO”), the control unit 1202 ends this process. On the other hand, when it is determined that the detected vehicle speed is equal to or higher than the predetermined threshold (that is, when “YES” is determined), the control unit 1202 issues a warning for prompting slowing down (step S1327). That is, the control unit 1202 outputs notification information for issuing a warning prompting slowing down to the speaker control unit 905 and causes the monitor 122 to display a message prompting slowing down (for example, “Let's slow down”). After the notification information for issuing a warning prompting slowing down is input, the speaker control unit 905 outputs a voice message that prompts slowing down from the speaker 121 (for example, “Please walk slowly there is a pedestrian”). The control unit 1202 finishes this process after issuing a warning to prompt slowing down. The information providing apparatus 1201 repeats the above pedestrian warning process (steps S1320 to S1328), for example, every second.

  FIG. 5 is a diagram schematically illustrating the pedestrian warning process of the information providing apparatus 1 according to the previous embodiment, but schematically illustrates the pedestrian warning process of the information providing apparatus 1201 according to the present embodiment. It is also the figure shown.

  The information providing apparatus 1201 according to the present embodiment photographs the outside in the traveling direction of the vehicle, determines the presence / absence of a pedestrian based on video information obtained by photographing, and if there is a pedestrian, the past X2 seconds If the calculated number of detected pedestrians Y2 is less than a predetermined threshold, a warning is given that the person is approaching the pedestrian, and the calculated number of detected pedestrians Y2 is equal to the predetermined threshold. If this is the case, a warning for slowing down is issued. In this way, a sufficient warning effect can be obtained, and appropriate driving assistance that cannot be realized by repeating warnings with simple beeps or the like becomes possible.

  Furthermore, the information providing apparatus 1201 according to the present embodiment provides a predetermined threshold for the number of pedestrian detections, switches notifications according to less than the threshold and greater than or equal to the threshold, and continues by repeating the above pedestrian warning process. When the pedestrian detection is repeated, the first notification is made that is less than the threshold and the first notification (e.g. "Please pay attention to pedestrians" or "Pedestrian attention"). (Example: “Please walk slowly there are pedestrians” “Let's slow down”). Thereby, the familiarity by one kind of information can be suppressed and sufficient warning effect can be obtained.

  In addition, even when the information providing device 1201 is less than the threshold value or more than the threshold value as described above, if the vehicle speed is slowing below a certain value, the second notification (e.g. Please do "or" Let's go slowly "). Therefore, as a result, the second notification can be appropriately performed, and a sufficient warning effect can be obtained when the driver trusts the second notification.

  Note that in the information providing apparatus 1201 according to the present embodiment, only the situation outside the traveling direction of the vehicle is acquired, but the situation outside the traveling direction opposite to the traveling direction (that is, the rear) and the vehicle You may make it also acquire the condition of the outer side of the left-right both directions, and can obtain the further warning effect by doing in that way.

  Further, in the information providing apparatus 1201 according to the present embodiment, when a pedestrian is detected, a warning is issued with a voice message (eg, “please pay attention to the pedestrian”) as the first notification. However, instead of this, a beep sound emitted from the above-described ADAS 906 speaker 908 may be used. Alternatively, a beep sound emitted by the speaker 908 in parallel with the first notification voice message may be used.

  In addition, information providing apparatus 1201 according to the present embodiment is used by being mounted on a vehicle, but may be integrated with the vehicle.

  Moreover, although the information provision apparatus 1201 which concerns on this Embodiment was mounted and used for the vehicle with a wheel, of course, the use with a vehicle (for example, hovercraft) without a wheel or a ship is also possible.

  In addition, information providing apparatus 1201 according to the present embodiment has two notifications (first notification and second notification), but is not limited to two steps, and what is required is two or more steps. It doesn't matter at the stage.

  Further, in the information providing apparatus 1201 according to the present embodiment, the determination on the first notification and the determination on the second notification are performed by the apparatus side, that is, the control unit 1202. Similarly to the information providing apparatus 2 according to the embodiment, at least one of these determinations may be performed by an external device, and the determination result may be received by the apparatus side to issue a warning.

  Note that the information providing apparatus 1201 according to the present embodiment includes the pad terminal 1212, the wireless speaker 904, and the ADAS 906 as the information providing apparatus 1201, but the pad terminal 1212 alone can also be regarded as an information providing apparatus.

  In this case, the first input unit corresponds to the antenna 909 that receives the notification that there is a pedestrian and the wireless connection unit 903, and the second input unit corresponds to the vehicle information acquisition unit 1502. The output unit includes a wireless connection unit 903, an antenna 909, and / or a monitor 122 that outputs notification information for issuing a warning about approaching a pedestrian, notification information for issuing a warning for gradual acceleration, and the like. Correspond.

  In the information providing apparatus 1201 according to the present embodiment, the wireless communication is performed between the pad terminal 1212 and the wireless speaker 904 and between the pad terminal 1212 and the ADAS 906. However, the present invention is not limited to this. You may make it use the speaker which communicates, and ADAS which communicates by a wired system.

  In the information providing apparatus 1201 according to the present embodiment, the pad terminal 1212, the wireless speaker 904, and the ADAS 906 are separated from each other. However, the present invention is not limited to this, and the pad terminal 1212 and the wireless speaker 904 may be integrated. The pad terminal 1212 and ADAS 906 may be integrated.

  FIG. 14 illustrates the relationship between the first notification and the second notification with examples of the first notification and the second notification.

  Nos. 1 to 4 are examples when a lane departure is detected. In the example of item No. 1, the first notification is emitted from the speaker as “I am out of the lane” in Japanese, and “Lane attention” is displayed on the monitor in Japanese, and the second notification is issued from the speaker. It sounds like “Thank you for taking a break” in Japanese and displays “Let ’s break” in Japanese on the monitor. In general, when the driver is tired, the driver tends to repeat lane departure, and the notification content that calls attention to the lane departure in the first notification is related to the notification content that prompts a break in the second notification. It can be said. A circle in the relevance column of item number 1 indicates that there is a relationship between the first notification and the second notification.

  In item No. 1, the columns of complexity and concreteness are blank, but this does not indicate that there is no complexity or no concreteness (complexity and concreteness will be described later). To do.) In item No. 1, only a circle is written in the relevance column as a characteristic relationship. The same applies to FIG. 14 below.

  Moreover, in the example of item number 1, the example which alert | reports with a speaker and a monitor as 1st alert | report, and the alert with the speaker and monitor was shown as 2nd alert | report. However, the present invention is not limited to this, a speaker as a first notification, a combination of speakers as a second notification, a speaker as a first notification, a combination of a speaker and a monitor as a second notification, a monitor as a first notification, and a combination of speakers as a second notification The first notification may be a monitor, and the second notification may be a combination of a speaker and a monitor, that is, all combinations. The same applies to FIG. 14 below. The example of item number 2 is the example of item number 1 in English.

  In the example of item number 3, the first notification emits a beep sound from the speaker and does not display at least a character string on the monitor. In the second notification, “Slow down the pedestrians” is emitted from the speaker in Japanese and “Slow down” is displayed on the monitor in Japanese. In the example of item number 3, the first notification is a simple beep sound, and the second notification is a verbal notification, so the second notification is more complicated than the first notification. Therefore, in the example of item No. 3, a circle is marked in the complexity column.

  In the example of item No. 3, the first notification is a simple beep and merely calls attention, but the second notification specifically indicates the action to be performed by the driver by words. Therefore, the second notification is more specific than the first notification. Accordingly, in the example of item number 3, “◯” is marked in the column of concreteness. The example of item number 4 is the example of item number 3 in English.

  Nos. 5 to 8 are examples when a pedestrian is detected. In the example of item No. 5, the first notification is sounded in Japanese, “Please pay attention to pedestrians” from the speaker, and “Walker attention” is displayed in Japanese on the monitor. , “Slow down when there are pedestrians” from the speaker and sound in Japanese, and “Slow down” is displayed on the monitor in Japanese. In general, when there are pedestrians in the vicinity of the vehicle including the front, the vehicle should slow down, and the notification content for prompting the pedestrian in the first notification and the notification content for prompting the slowdown in the second notification Can be said to be related. Therefore, a circle is marked in the relevance column of item number 5. The example of item number 6 is the example of item number 5 in English.

  In the example of item No. 7, the first notification emits a beep sound from the speaker, and the monitor does not display at least a character string. In the second notification, “Slow down the pedestrians” is emitted from the speaker in Japanese and “Slow down” is displayed on the monitor in Japanese. In the example of item number 7, the description of complexity and concreteness is the same as the example of item number 3. Finally, for the example of item number 8, the example of item number 7 is in English.

Although various methods have been described as the notification method, the notification method is not limited to the above, and the following notification method may be used.
・ Send voice messages to the driver using bone conduction technology.
・ Use dedicated glasses for monitor display.
• Glass projection is used as the monitor display.
・ Warning light ・ Vibration, irritation ・ Wind ・ Water (such as spraying fog water)

  In the above-described embodiment, the configuration including the input unit, the control unit, and the output unit is mainly described as the information providing device. However, the configuration of the information providing device is not limited to this. For example, as in the information providing apparatus 1a illustrated in FIG. 15, a configuration including the control unit 11 and the output unit 12 without including the input unit may be used. That is, the information providing device 1a may acquire video information indicating the outside situation from an external device (such as a camera). Or the structure provided with only the control part 11 may be sufficient, without providing an input part and an output part like the information provision apparatus 1b shown in FIG. That is, the information providing apparatus 1b acquires video information indicating the outside situation from the external apparatus, and displays information corresponding to the determined notification as an external apparatus (for example, an information display apparatus such as a speaker, a monitor, or a smartphone and a tablet). To send.

  Further, the configuration of the information providing apparatus described in FIGS. 6, 7, 9, and 12 is an example of the information providing apparatus illustrated in FIG. 1, and is described in FIGS. The configuration of the information providing apparatus is similarly applied to FIG. 6, FIG. 7, FIG. 9, and FIG.

  The disclosures of the specification, drawings, and abstract included in the Japanese application of Japanese Patent Application No. 2013-135831 filed on June 28, 2013 are incorporated herein by reference.

  The present invention has an effect that a sufficient warning effect can be obtained and appropriate driving support can be performed. In addition to a vehicle such as an automobile having wheels, a vehicle such as a hovercraft without wheels, or a ship Applicable.

1, 1a, 1b, 2, 3, 901, 1201 Information providing device 10, 15 Input unit 11, 11A, 16, 902, 1202 Control unit 12 Output unit 13 Communication unit 14, 909, 910, 911 Antenna 30, 930, DESCRIPTION OF SYMBOLS 1230 Information provision system 31 Cloud 32 Access point 50 Vehicle 60 Lane 70 Pedestrian 80 Pedestrian crowded area 101,1501 Imaging part 121,908 Speaker 122 Monitor 311 Server 903 Wireless connection part 904 Wireless speaker 905 Speaker control part 906 ADAS
907 ADAS control unit 912, 1212 Pad terminal 1502 Vehicle information acquisition unit 1601 Pedestrian detection unit 1602 Vehicle speed detection unit 1603 State estimation unit 1604 Notification information generation unit

Claims (15)

Can be mounted on a vehicle,
An information providing apparatus comprising: a control unit that acquires information corresponding to an outer situation that is at least an outer situation of the vehicle, and notifies at least an inner side of the vehicle based on the outer situation;
The controller is
When the outside situation satisfies a predetermined condition, a first notification is performed,
Subsequently, when the outside situation satisfies the predetermined condition, a second notification is performed.
Information providing device. The information providing device according to claim 1,
The controller is
When the outside situation satisfies the predetermined condition, the first notification is performed,
Subsequently, when the outside condition satisfies the predetermined condition for a predetermined number of times in a predetermined time, the second notification is performed.
Information providing device. The information providing device according to claim 1,
The controller is
When the outside situation satisfies the predetermined condition, the first notification is performed,
Subsequently, when the outside condition satisfies the predetermined condition more than a predetermined number of times while the vehicle moves a predetermined distance, the second notification is performed.
Information providing device. The information providing device according to claim 1,
An input unit including an imaging unit capable of photographing at least the outside of the vehicle;
The input unit obtains information corresponding to the outside situation;
Information providing device. The information providing device according to claim 1,
An output unit including at least a sound emitting unit and / or a display unit,
The output unit outputs information corresponding to the first notification or information corresponding to the second notification;
Information providing device. The information providing device according to claim 1,
Have a communication department,
The communication unit can output information corresponding to the outside situation to the outside, and can input information corresponding to the notification,
The control unit causes the external device to make a determination to perform the second notification at least when the outside condition subsequently satisfies the predetermined condition.
Information providing device. The information providing device according to claim 6,
The control unit causes the external device to make a determination to perform the first notification when the outside condition satisfies the predetermined condition.
Information providing device. The information providing device according to claim 1,
The controller is
When a lane departure of the vehicle is detected based on the outside situation, a beep sound is notified as the first notification,
Subsequently, when a lane departure of the vehicle is detected based on the outside situation, a notification that prompts a break is performed as the second notification.
Information providing device. The information providing device according to claim 1,
The controller is
When a pedestrian is detected based on the outside situation, a beep sound is notified as the first notification,
Subsequently, when a pedestrian is detected based on the outside situation, the second notification is made to notify the driver of slowing down.
Information providing device. The information providing device according to claim 1,
The controller is
In addition to information corresponding to the outside situation, information corresponding to the speed of the vehicle is acquired,
When a pedestrian is detected based on the outside situation, a beep sound is notified as the first notification,
Subsequently, when a pedestrian is detected based on the outside situation, and the speed of the vehicle is equal to or higher than a predetermined value, a notification is given to prompt slowing as the second notification.
Information providing device. The information providing device according to claim 1,
Is integral with the vehicle having wheels,
Information providing device. Can be mounted on a vehicle,
An information providing method that can be used in an information providing apparatus including a control unit that acquires an outside situation that is at least an outside situation of the vehicle and notifies at least an inside of the vehicle based on the outside situation,
When the outside situation satisfies a predetermined condition, the control unit performs a first notification,
Subsequently, when the outside condition satisfies the predetermined condition, the control unit performs a second notification.
Information provision method. Can be mounted on a vehicle,
A program that can be executed by an information providing apparatus that includes a control unit that acquires an outside situation that is at least an outside situation of the vehicle and notifies at least an inside of the vehicle based on the outside situation,
When the outside situation satisfies a predetermined condition, the control unit performs a first notification,
Subsequently, when the outside condition satisfies the predetermined condition, the control unit performs a second notification.
program.   A server for storing the program according to claim 13 in a downloadable state. Can be mounted on a vehicle,
A control unit that acquires an outside situation that is at least an outside situation of the vehicle, and notifies at least an inside of the vehicle based on the outside situation;
A communication unit capable of outputting information corresponding to the outside situation to the outside, and capable of inputting the notification information;
An information providing device comprising:
Based on the information corresponding to the outside situation, when the outside situation satisfies a predetermined condition, the information corresponding to the first notification is output,
Subsequently, when the outside situation satisfies the predetermined condition, information corresponding to the second notification is output.
Server,
An information providing system comprising:
The control unit performs the first notification and the second notification based on information corresponding to the first notification and information corresponding to the second notification.
Information provision system.

Images