JP2018030499A - Vehicle outside information providing device and vehicle outside information providing method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a driver with information on existence of a person outside a vehicle who intends to communicate with a driver.SOLUTION: A vehicle outside information providing device includes a call determination part and a notification part. The call determination part detects a person outside a vehicle and determines whether the person calls to an occupant inside the vehicle. The notification part notifies the occupant of existence of the person when the call determination part determines that the person calls to the driver.SELECTED DRAWING: Figure 2A

Description

  Embodiments disclosed herein relate to a vehicle outside information providing apparatus and a vehicle outside information providing method.

  2. Description of the Related Art Conventionally, a vehicle outside information providing apparatus that collects information outside a vehicle and provides the information to the inside of a vehicle interior for a driver driving the vehicle is known. For example, Patent Document 1 detects an area where there is a person outside the vehicle (hereinafter referred to as “vehicle outsider”), collects outside sound using this area as a sound collection direction, and outputs the outside sound to a passenger in the vehicle interior. A sound providing apparatus is disclosed.

JP 2011-201406 A

  However, when the above-described conventional technology is used, there is a possibility that the driver cannot be provided with information on the presence of an outsider who wants to convey his will to the driver.

  For example, in the above-described vehicle exterior sound providing device, regardless of whether or not it is desired to convey the will, the vehicle exterior sound is provided with the direction of sound collection as long as the vehicle is in the direction of the person outside the vehicle. The driver may not be able to hear the voice from outsiders.

  In general, when a person wants to convey his / her will, it may indicate that he / she wants to convey his / her will, for example, by gestures. Therefore, when a certain outside person expresses that fact only by gesture gesture, the above-described outside sound providing device cannot provide information on the presence of the outside person to the driver.

  One aspect of the embodiments has been made in view of the above, and provides an out-of-vehicle information providing apparatus and out-of-vehicle information providing method capable of providing information to the driver of the existence of an outside person who wants to convey his will to the driver. For the purpose.

  The vehicle exterior information provision apparatus which concerns on the one aspect | mode of embodiment is provided with the call determination part and the alerting | reporting part. The call determination unit detects a person outside the vehicle and determines whether the person is calling the passenger in the vehicle. The notification unit notifies the passenger of the presence of the person when the call determination unit determines that the person is making the call.

  According to one aspect of the embodiment, it is possible to provide the driver with information on the presence of an outsider who wants to convey his will to the driver.

FIG. 1A is a schematic explanatory diagram (part 1) of the vehicle information providing method according to the embodiment. FIG. 1B is a schematic explanatory diagram (part 2) of the vehicle exterior information provision method according to the embodiment. FIG. 1C is a schematic explanatory diagram (part 3) of the vehicle exterior information provision method according to the embodiment. FIG. 1D is a schematic explanatory diagram (part 4) of the external information providing method according to the embodiment. FIG. 1E is a schematic explanatory diagram (part 5) of the vehicle information providing method according to the embodiment. FIG. 2A is a block diagram of the information providing apparatus outside the vehicle according to the first embodiment. FIG. 2B is a block diagram of an outsider call determination unit according to the first embodiment. FIG. 2C is a block diagram of a driver recognition determination unit according to the first embodiment. FIG. 3A is a diagram illustrating an example of defining feature points of outsiders for pattern matching. FIG. 3B is a diagram illustrating an example of gesture pattern information. FIG. 3C is a diagram illustrating a modified example of the outsider gesture analysis processing. FIG. 3D is a diagram illustrating an example of the audio pattern information 12b. FIG. 4A is a diagram illustrating a specific example of the feature when the outside person who is calling is a positive example. FIG. 4B is a diagram illustrating a specific example of a feature when a driver that does not recognize a call is a positive example. FIG. 5 is a diagram illustrating an example of notification information according to the first embodiment. FIG. 6 is a flowchart showing a processing procedure executed by the outside-vehicle information providing apparatus according to the first embodiment. FIG. 7A is a block diagram of an outsider call determination unit according to the second embodiment. FIG. 7B is a schematic bird's-eye view around the stop. FIG. 7C is a diagram illustrating a specific example of the feature when the outsider who is calling is a positive example in the second embodiment. FIG. 8 is a diagram illustrating an example of notification information according to the second embodiment. FIG. 9 is a flowchart illustrating a processing procedure executed by the outside-vehicle information providing apparatus according to the second embodiment. FIG. 10A is a block diagram of an outsider call determination unit according to the third embodiment. FIG. 10B is a schematic bird's-eye view around the outside of the vehicle. FIG. 10C is a diagram illustrating a specific example of the feature when the outsider who is calling is a positive example in the third embodiment. FIG. 11 is a diagram illustrating an example of notification information according to the third embodiment. FIG. 12 is a flowchart illustrating a processing procedure executed by the outside-vehicle information providing apparatus according to the third embodiment. FIG. 13A is a block diagram of an outsider call determination unit according to the fourth embodiment. FIG. 13B is a diagram illustrating an example of waiting registration information. FIG. 13C is a diagram illustrating a specific example of the feature when the outside person who is calling is a positive example in the fourth embodiment. FIG. 14 is a diagram illustrating an example of notification information according to the fourth embodiment. FIG. 15 is a flowchart illustrating a processing procedure executed by the outside-vehicle information providing apparatus according to the fourth embodiment.

  Hereinafter, with reference to the accompanying drawings, embodiments of an outside information providing apparatus and an outside information providing method disclosed in the present application will be described in detail. In addition, this invention is not limited by embodiment shown below.

  In the following, the “outside vehicle” simply refers to a person outside the vehicle, regardless of whether he / she is walking or staying there. In the following, expressing that the “outside person” wants to convey the will to the driver is referred to as “call”. In the following, such “calling” includes a voice call and gesture gesture, and the gesture gesture is described as “gesture”.

  In the following, after describing the outline of the vehicle information providing method according to the present embodiment with reference to FIGS. 1A to 1E, the vehicle information providing apparatus 1 of the vehicle information providing system 1 to which the vehicle information providing method according to the embodiment is applied. 10 will be described with reference to FIGS. 2A to 15.

  First, the outline | summary of the information provision method outside a vehicle concerning this embodiment is demonstrated using FIG. 1A-FIG. 1E. FIG. 1A to FIG. 1E are schematic explanatory views (No. 1) to (No. 5) of the outside-vehicle information providing method according to the embodiment.

  As shown in FIG. 1A, it is assumed that an outsider W exists for a vehicle C driven by a driver D. Then, it is assumed that the vehicle outsider W is calling the driver D. In such a case, it is conceivable that the outside person W takes actions such as making a call such as “Wait!”, Performing a gesture such as waving a hand, or chasing the vehicle C. That is, there are various modes for calling.

  If the driver D recognizes such a call from the outsider W, the driver D can communicate with the outsider W by stopping the vehicle C. However, as shown in FIG. When D drives the vehicle C, the driver D tends to overlook the presence of the outsider W because the driver usually watches the traveling direction. This is even more so if the vehicle outsider W is at a position where the driver D becomes a blind spot.

  Further, even if the driver D looks at the direction of the outsider W, it is possible that the driver D does not recognize the call from the outsider W if he / she is driving casually.

  Therefore, in the present embodiment, regarding the vehicle outsider W, first, the presence of the vehicle outsider W is detected, and “vehicle outsider call determination” is performed to determine whether or not the detected vehicle outsider W is calling the driver D. It was decided to carry out (step S1).

  In the “outside car call determination”, for example, the outside person W analyzes the various elements represented by the outside person W, such as the body direction, the face direction, the gesture, the movement vector, and the voice of the outside person W. It is determined whether or not a call is made to the driver D.

  In the present embodiment, regarding the driver D, “driver recognition determination” is performed to determine whether or not the driver D recognizes the call from the outsider W (step S2).

  In such “driver recognition determination”, for example, the driver D analyzes the various elements representing the state of the driver D such as the face direction of the driver D, the direction of the line of sight, the physical information of the driver D, and the driver D calls the outsider W. It is determined whether or not it is recognized.

  In the present embodiment, it is determined whether or not to notify the driver D of the presence of the outside person W who is calling based on the determination results of these “outside car call determination” and “driver recognition determination”. “Notification determination” is performed (step S3). When it is determined to notify the driver D of the presence of the outside person W who is calling, the driver D is notified (step S4).

  As a result, it is possible to provide the driver D with information about the presence of the outside person W who is calling on the driver D.

  The notification to the driver D is not limited as long as the driver D can recognize the presence of the outside person W who is calling, such as voice output and display output. Further, not only the driver D but also the outside person W may be notified that the driver D has been notified.

  Thus, for example, if the vehicle outsider W is chasing the vehicle C, his / her feet can be loosened, the burden can be reduced quickly, and the safety of the vehicle outsider W can be ensured when the vehicle C stops suddenly. Can be secured.

  In addition, each step S1-S4 mentioned above will be performed by the vehicle exterior information provision apparatus 10 mounted in the vehicle C. FIG.

  The above-described vehicle information provision method according to the present embodiment described above can be applied to various scenes. For example, as shown in FIG. 1B, it is a scene of “when leaving” where there is an outside person W who follows the vehicle C leaving the parking space SP to the parking space SP and appeals to the driver D about the presence of leftovers. .

  Further, for example, as shown in FIG. 1C, it is a scene of “when the bus departs from the bus stop” where there is an outsider W who appeals to the driver D of the bus B to depart in the vicinity of the bus stop BS.

  Further, for example, as shown in FIG. 1D, it is a scene of “during taxi travel” where there is an outside person W who appeals to the driver D of the taxi T from the sidewalk.

  Further, for example, as shown in FIG. 1E, it is a scene of “waiting” where an outsider W who is a meeting person who appeals to the driver D about his / her presence exists.

  Hereinafter, the outside information providing apparatus 10 of the outside information providing system 1 to which the above-described outside information providing method is applied will be described more specifically. In the following, for the first embodiment, “when leaving” shown in FIG. 1B is taken as an example, and for the second embodiment, “when bus departs from a stop” shown in FIG. 1C, as an example For example, the third embodiment will be described in the case of “cab driving” shown in FIG. 1D, and the fourth embodiment will be described in the order of “meeting time” shown in FIG. 1E. To do.

(First embodiment)
FIG. 2A is a block diagram of the external information providing apparatus 10 according to the first embodiment. FIG. 2B is a block diagram of the outsider call determination unit 11a according to the first embodiment. FIG. 2C is a block diagram of the driver recognition determination unit 11c according to the first embodiment.

  In FIG. 2A to FIG. 2C, only constituent elements necessary for explaining the features of the present embodiment are represented by functional blocks, and descriptions of general constituent elements are omitted.

  In other words, each component illustrated in FIGS. 2A to 2C is functionally conceptual and does not necessarily need to be physically configured as illustrated. For example, the specific form of distribution / integration of each functional block is not limited to the one shown in the figure, and all or a part thereof is functionally or physically distributed in arbitrary units according to various loads or usage conditions.・ It can be integrated and configured. In addition, this point is the same also in each block diagram shown later besides FIG. 2A-FIG. 2C.

  First, as shown in FIG. 2A, the outside information providing system 1 includes an external camera 2, a radar 3, a communication terminal 4, a microphone 5, a vibration sensor 6, a vehicle information sensor 7, and an internal camera 8. A body information sensor 9, a vehicle outside information providing device 10, and a notification unit 20.

  The external camera 2 includes an image sensor such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor). A plurality of external cameras 2 are provided, for example, at the front, rear, and both sides of the vehicle C. The imaging information around the vehicle C is output to the outside information providing apparatus 10.

  The radar 3 is, for example, a millimeter wave radar or an ultrasonic sensor mounted on the vehicle C, and outputs target information such as an outside person W and an obstacle existing around the vehicle C to the outside information providing apparatus 10. The communication terminal 4 is a terminal device that is communicably connected to the outside information providing apparatus 10 and is, for example, a smartphone carried by the outside person W.

  The microphone 5 is mounted on the vehicle C, collects sound around the vehicle C, and outputs the collected sound information to the outside information providing apparatus 10. The vibration sensor 6 is mounted, for example, on the rear part of the vehicle body of the vehicle C, and outputs vibration information to the outside information providing apparatus 10 when an outsider W chasing the vehicle C hits the rear part of the vehicle body, for example.

  The vehicle information sensor 7 is a device that detects information such as a vehicle speed and a rudder angle relating to the operation of the vehicle C, and includes, for example, a vehicle speed sensor and a rudder angle sensor. The information is output to the information providing apparatus 10.

  The internal camera 8 is provided, for example, above the steering column of the driver's seat of the vehicle C so that the face of the driver D is included in the imaging region. For example, the internal camera 8 is provided as a set of an infrared camera and an infrared LED so that the line-of-sight direction of the driver D can be detected. The internal camera 8 outputs imaging information such as the face of the driver D that has been imaged to the vehicle outside information providing apparatus 10.

  The body information sensor 9 is provided around the driver's seat of the vehicle C, and is provided so as to be able to detect the body information of the driver D, for example, the brain wave and pulse of the driver D. The physical information sensor 9 outputs the detected physical information to the outside information providing apparatus 10.

  The notification unit 20 is various devices that enable notification to the driver D or the outside person W. As the driver D, for example, a display such as a navigation device mounted in the passenger compartment of the vehicle C, an in-vehicle speaker, and the like. is there. Moreover, there are a brake lamp, a hazard lamp, a horn, and the like for the outside person W.

  The vehicle exterior information providing apparatus 10 includes a control unit 11 and a storage unit 12. The control unit 11 includes an outsider call determination unit 11a, a notification determination unit 11b, a driver recognition determination unit 11c, and a notification information generation unit 11d.

  The storage unit 12 is a storage device such as a hard disk drive, a nonvolatile memory, or a register, and stores gesture pattern information 12a, sound pattern information 12b, and vibration pattern information 12c.

  The control unit 11 controls the outside information providing apparatus 10 as a whole. The outsider call determination unit 11a determines whether or not the outsider W is calling the driver D based on various information output from the external camera 2, the radar 3, the communication terminal 4, the microphone 5, the vibration sensor 6, and the like. And the determination result is output to the notification determination unit 11b.

  More specifically, as shown in FIG. 2B, the outsider call determination unit 11a includes an outsider detection unit 11aa, an outsider orientation analysis unit 11ab, an outsider face orientation analysis unit 11ac, and an outsider gesture analysis unit. 11ad, outsider movement vector analysis part 11ae, outsider voice analysis part 11af, and outsider vibration analysis part 11ag.

  The vehicle outsider detection unit 11aa detects a vehicle outsider W existing around the vehicle C based on various information from the external camera 2, the radar 3, and the communication terminal 4.

  For each detected outside person W, the outside person direction analyzing unit 11ab analyzes the direction of the body of the outside person W based on, for example, imaging information from the external camera 2, and the analysis result is determined as the outside person calling determination unit 11a. Return to. For each detected outsider W, the outsider face orientation analyzing unit 11ac analyzes the orientation of the face of the outsider W based on, for example, imaging information from the external camera 2, and the analysis result is used as an outsider call determining unit. Return to 11a.

  The outsider gesture analysis unit 11ad analyzes a gesture performed by the outsider W based on, for example, the imaging information from the external camera 2 and the gesture pattern information 12a, and returns the analysis result to the outsider call determination unit 11a. The vehicle outsider gesture analysis unit 11ad analyzes a gesture performed by the vehicle outsider W by pattern matching based on a comparison between imaging information from the external camera 2 and the gesture pattern information 12a, for example.

  Here, an example of an outsider gesture analysis process executed by the outsider gesture analysis unit 11ad will be described with reference to FIGS. 3A to 3C. FIG. 3A is a diagram illustrating an example of defining feature points of an outsider W for pattern matching. FIG. 3B is a diagram illustrating an example of the gesture pattern information 12a. FIG. 3C is a diagram illustrating a modified example of the outsider gesture analysis processing.

  When performing pattern matching of gestures, for example, when the outside person W moves his / her body, it is preferable to preliminarily determine each point that will define the posture and orientation as a feature point.

  For example, FIG. 3A shows an example in which 20 feature points j1 to j20 are defined as the feature points that define the movement of the outsider W. Note that the feature points j1 to j4 correspond to the head, the shoulder center, the turning portion, and the hip center in order. Further, the feature points j5 to j8 correspond to the right hand tip, the right wrist, the right elbow, and the shoulder right, respectively, in order.

  Also, the feature points j9 to j12 correspond to the right hip, the right knee, the right ankle, and the right foot, respectively, in order. Further, the feature points j13 to j16 correspond to the left hand tip, the left wrist, the left elbow, and the left shoulder part in order. Also, the feature points j17 to j20 correspond to the left hip, the left knee, the left ankle, and the left foot, respectively, in order.

  As shown in FIG. 3B, various gesture pattern information is registered in advance in the gesture pattern information 12a. The gesture pattern information 12a is, for example, information that associates “gesture type”, “template image”, and “feature point image”.

  FIG. 3B shows, as an example, “ride appeal” when the outside person W wants to get on the bus B or taxi T, and “existence appeal” when the outside person W wants to appeal his / her own location. The “template image” and “feature point image” may be a still image or a moving image.

  The outsider gesture analysis unit 11ad performs the outsider W by comparing, for example, the imaging information from the external camera 2 and the feature points j1 to j20 extracted from the imaging information with the gesture pattern information 12a. Analyze gestures. Then, if there is something that matches the gesture pattern information 12a, the gesture type is returned to the outsider call determination unit 11a, and if there is nothing that matches, that fact is returned.

  When comparing the feature points j1 to j20, it is preferable to perform analysis by matching the movement vectors and movement speeds of the feature points j1 to j20. This is because, depending on the mode of the gesture, it may be difficult to determine whether it is intended to convey a will or just a greeting. By matching up to the movement vectors and movement speeds of the feature points j1 to j20, it is possible to analyze such gestures that are difficult to discriminate.

  As a modified example, as shown in FIG. 3C, a learning unit 11e that receives pre-registered gesture pattern information 12a is provided, and publicly known machine learning is executed by the learning unit 11e. The gesture discrimination model 12d is generated in advance, and the outsider gesture analysis unit 11ad may discriminate the gesture of the outsider W based on the gesture discrimination model 12d. As a result, the processing load required for pattern matching can be reduced and the processing speed can be improved.

  Returning to the description of FIG. 2B, the vehicle outsider movement vector analysis unit 11 ae will be described. The outsider movement vector analysis unit 11ae analyzes the movement vector for each outsider W based on the imaging information from the external camera 2 and the target information from the radar 3, for example, and the analysis result is used as the outsider call determination unit 11a. Return to.

  The outsider voice analysis unit 11af analyzes the voices uttered by each outsider W based on the voice information from the microphone 5, and returns the analysis result to the outsider call determination unit 11a.

  Here, an example of the outsider voice analysis process executed by the outsider voice analysis unit 11af will be described with reference to FIG. 3D. FIG. 3D is a diagram illustrating an example of the audio pattern information 12b.

  The outsider voice analysis unit 11af analyzes the voice generated by the outsider W by comparing the voice information from the microphone 5 with the voice pattern information 12b. As shown in FIG. 3D, the voice pattern information 12b is information in which “voice type” and “character information” of a voice often used in a calling scene are associated with each other.

  The outsider voice analysis unit 11af converts, for example, voice information from the microphone 5 into text, and if there is a part of the text that matches the “character information” of the voice pattern information 12b, the “character information” is included in the text information. The associated “voice type” is returned to the outsider call determination unit 11a, and if there is no match, the fact is returned to the outsider call determination unit 11a.

  By comparing the voice with text, it is possible to simply analyze the content that the voice is trying to convey, regardless of age or gender of the outside person W, or by removing the inflection added to the voice.

  Returning to the description of FIG. 2B, the vehicle exterior vibration analysis unit 11ag will be described. The outsider vibration analysis unit 11ag compares the vibration information from the vibration sensor 6 with the vibration pattern information 12c in which a vibration pattern such as when the outsider W hits the rear part of the vehicle body for calling, for example. Thus, it is analyzed whether the vibration information is due to a call from the outsider W, and the analysis result is returned to the outsider call determination unit 11a.

  The vehicle exterior call determination unit 11a includes a vehicle exterior direction analysis unit 11ab, a vehicle exterior face orientation analysis unit 11ac, a vehicle exterior gesture analysis unit 11ad, a vehicle exterior movement vector analysis unit 11ae, a vehicle exterior voice analysis unit 11af, and a vehicle exterior vibration analysis unit. Based on the analysis results of 11ag, it is determined whether or not a call is made by the outside person W.

  For example, the outsider call determination unit 11a determines that there is a call from the outsider W if at least one of the above analysis results indicates that the outsider W is calling. Alternatively, the outsider call determination unit 11a may determine that there is a call from the outsider W when all the analysis results indicate that a call is being made.

  In addition, the outsider call determination unit 11a includes an outsider direction analysis unit 11ab, an outsider face direction analysis unit 11ac, an outsider gesture analysis unit 11ad, an outsider movement vector analysis unit 11ae, an outsider voice analysis unit 11af, and The vehicle outsider W may be evaluated based on an evaluation model using various elements representing the vehicle outsider W analyzed by the vehicle outside vibration analysis unit 11ag as parameters. Such a modification will be described later with reference to FIG. 4B.

  Returning to the description of FIG. 2A, the driver recognition determination unit 11c will be described. The driver recognition determination unit 11c determines whether the driver D recognizes the call from the outsider W based on various information output from the internal camera 8, the physical information sensor 9, and the like, and notifies the determination result. To the unit 11b.

  More specifically, as shown in FIG. 2C, the driver recognition determination unit 11c includes a driver face orientation analysis unit 11ca, a driver gaze analysis unit 11cb, and a driver body information analysis unit 11cc.

  The driver face orientation analysis unit 11ca analyzes the face direction of the driver D based on, for example, imaging information from the internal camera 8, and returns the analysis result to the driver recognition determination unit 11c. The driver line-of-sight analysis unit 11cb analyzes the line-of-sight direction of the driver D based on, for example, imaging information from the internal camera 8, and returns the analysis result to the driver recognition determination unit 11c.

  For example, the driver line-of-sight analysis unit 11cb is based on the positional relationship between a pupil in an infrared image obtained by capturing an image of the face of the driver D illuminated with an infrared LED with an infrared camera and an infrared illumination reflection image generated on the eyeball. The line-of-sight direction of the driver D can be analyzed.

  The driver physical information analysis unit 11cc analyzes the physical information of the driver D based on the physical information from the physical information sensor 9, for example, and returns the analysis result to the driver recognition determination unit 11c. The analysis content is, for example, content indicating whether the driver D is driving indiscriminately. Thereby, the awakening state and physical condition of the driver D can be analyzed, and it can contribute to the accuracy improvement in the driver recognition determination part 11c.

  The driver recognition determination unit 11c determines whether or not the driver D recognizes the call from the outsider W based on the analysis results of the driver face direction analysis unit 11ca, the driver gaze analysis unit 11cb, and the driver physical information analysis unit 11cc. To do.

  For example, the driver recognition determination unit 11c determines that the driver D is recognized if at least one of the above analysis results indicates that the driver D recognizes the call from the outsider W. To do. Alternatively, the driver recognition determination unit 11c may determine that the driver D is recognized when all the analysis results indicate that the call is recognized.

  In addition, as already described with respect to the outsider call determination unit 11a, the driver recognition determination unit 11c is a driver D analyzed by the driver face direction analysis unit 11ca, the driver gaze analysis unit 11cb, and the driver body information analysis unit 11cc. The driver D may be evaluated based on an evaluation model having various elements representing the state of

  Here, the modified example of the vehicle outsider call determination part 11a and the driver recognition determination part 11c is demonstrated. First, the outsider call determination unit 11a will be described. The vehicle outsider call determination unit 11a evaluates the vehicle outsider W based on an evaluation model using various elements representing the vehicle outsider W as parameters.

  Specifically, the outsider call determination unit 11a has an evaluation model that calculates the evaluation score y of the outsider W using, for example, a regression equation represented by the following equation (1).

y = a ₁ · x ₁ + a ₂ · x ₂ + ... + a _n · x _n (1)

In the above formula (1), a _n (n is an arbitrary number) is a coefficient, and x _n is a feature (explanatory variable). First, the outsider call determination unit 11a includes the above-described outsider direction analysis unit 11ab, outsider face direction analysis unit 11ac, outsider gesture analysis unit 11ad, outsider movement vector analysis unit 11ae, outsider voice analysis unit 11af, and outside the vehicle. Based on each analysis result analyzed by the person vibration analysis unit 11ag, a feature for the outside person W who is calling is obtained.

For example, when the outside person W who is calling is taken as a positive example, if the feature vector of the outside person W who is calling is included, “x _n ” = “1”; _n ”=“ 0 ”. Further, a _n as a weight value of x _n may be adjusted by learning a linear model with positive examples outside the vehicle's W are subjected to interrogation by the formula (1).

For example, outside party call determination unit 11a, a a _n in formula (1) as a parameter, the weight of a _n by regression analysis techniques, such as support vector regression using pattern recognition machine, such as of SVM (Support Vector Machine) Adjust.

  Here, an example has been given in which the outsider W who is calling is a positive example, but the outsider W who is calling is extracted by taking the outsider W who is not calling as a positive example. May be. Moreover, the evaluation model which the vehicle outsider call determination part 11a has is not limited to the above-described evaluation model.

(Specific examples of _xn )
Next, FIG. 4A shows a specific example of _xn required for the evaluation with the outsider W who is calling by the outsider call determination unit 11a as a positive example. FIG. 4A is a diagram illustrating a specific example of the feature when the outside person W who is calling is taken as a positive example.

  Here, examples where n = 1 to 6 are given. The “corresponding item” includes an outsider direction analysis unit 11ab, an outsider face direction analysis unit 11ac, an outsider gesture analysis unit 11ad, an outsider movement vector analysis unit 11ae, an outsider voice analysis unit, which are inputs for obtaining the feature. 11af and the analysis results of the vehicle exterior vibration analysis unit 11ag.

As shown in FIG. 4A, for example, x ₁ can be obtained by setting “condition” as “whether it is within a predetermined range from the directly-facing position” based on the analysis result of the outside-orientation analysis unit 11ab. . That is, next if "outside party directed" is within a predetermined range from the confronting position x ₁ is "1", if the other x ₁ is "0".

  This is because if the “outside person direction” is within a predetermined range from the directly-facing position, it is easy to estimate that the outside person W is calling.

Further, for example, x _2, based on the analysis result of the outside's face orientation analyzing section 11ac, the "condition" can be determined by a "whether the vehicle direction is within a predetermined range." That is, the if "outside who face orientation" is within a predetermined range from the vehicle direction x ₂ is "1", if the other x ₂ is "0".

  This is because if the “outside vehicle face direction” is within a predetermined range from the direction of the vehicle, it is easy to estimate that the vehicle outsider W is calling.

Further, for example, x _3, based on the analysis result of the outside's gesture analysis unit 11ad, the "condition" can be determined by a "whether the call gesture." That is, if the “outside car gesture” is a call gesture, x ₃ is “1”, otherwise x ₃ is “0”.

Further, for example, x _4, based on the analysis result of the outside's motion vector analyzing section 11ae, the "condition" can be determined by a "whether within a predetermined range from the vehicle movement trajectory". In other words, the "outside party movement vector" is becomes "1" if it is within the predetermined range x ₄ is from the vehicle moving trajectory, if other x ₄ is "0". This is because if the “outside vehicle movement vector” is within a predetermined range from the own vehicle movement locus, it is easy to estimate that the outside vehicle W is calling.

Further, for example, x _5, based on the analysis result of the outside's speech analysis unit 11Af, the "condition" can be determined by a "whether the call audio". In other words, it is if the voice call is "outside of the vehicle's speech" x ₅ becomes "1", the x ₅ If the other "0".

Further, for example, x _6, based on the analysis result of the outside's vibration analysis unit 11AG, the "condition" can be determined by a "whether the call oscillation". That is, if the “outside vehicle vibration” is a call vibration, x ₆ is “1”, otherwise x ₆ is “0”.

The outside party call determination part 11a, in such a modification, after seeking x ₁ ~x _n along each shown as one example in FIG. 4A "condition", the outside party W by the above formula (1) An evaluation score is calculated. Then, the outsider call determination unit 11a notifies the calculated determination score to the notification determination unit 11b.

  For the driver recognition determination unit 11c, the same method according to the above equation (1) can be used. That is, the driver recognition determination unit 11c obtains a feature for the driver D that does not recognize the call based on the analysis results analyzed by the driver face orientation analysis unit 11ca, the driver gaze analysis unit 11cb, and the driver physical information analysis unit 11cc. .

For example, when a driver D that does not recognize a call is taken as a positive example, “x _n ” = “1” if the feature vector of the driver D that does not recognize the call is included, and “x” _n ”=“ 0 ”.

  In this example, the driver D that does not recognize the call is taken as a positive example, but the driver D that does not recognize the call is extracted by using the driver D that recognizes the call as a positive example. May be.

FIG. 4B shows a specific example of _xn that is obtained by the driver recognition determination unit 11c for evaluation using the driver D that has not recognized the appeal as a positive example. FIG. 4B is a diagram illustrating a specific example of a feature when a driver D that does not recognize a call is a positive example.

  Here, examples of n = 1 to 3 are given. Further, the “corresponding item” is an analysis result of the driver face orientation analysis unit 11ca, the driver gaze analysis unit 11cb, and the driver body information analysis unit 11cc, which are inputs for obtaining the feature.

As shown in FIG. 4B, for example, x ₁ can be obtained by setting “condition” as “whether the direction is other than the location of the outside person” based on the analysis result of the driver face orientation analysis unit 11ca. That is, next to "Driver face orientation" is x ₁ if other than the location direction of the outside have "1", x ₁ if other is "0".

  This is because if the “driver's face direction” is other than the direction of the outsider's location, it is easy to estimate that the driver D does not recognize the call.

Further, for example, x _2, based on the analysis result of the driver sight analysis unit 11cb, the "condition" can be determined by the "whether or not other than the location direction of the outside party." That is, if the “driver's line of sight” is other than the direction in which the person outside the vehicle W is located, x ₂ is “1”, otherwise x ₂ is “0”.

  This is because if the “driver's line of sight” is in a direction other than the direction in which the person outside the vehicle W is located, it is easy to estimate the driver D who has not recognized the call.

Further, for example, x _3, based on the analysis result of the driver body information analysis unit 11 cc, the "condition" can be determined by a "whether absentminded is in operation." That is, x ₃ is “1” if the “driver physical information” indicates that the driver is driving freely, and x ₃ is “0” otherwise.

Then, in this modification, the driver recognition determination unit 11c obtains x ₁ to x _n along each “condition” shown as an example in FIG. 4B, and then evaluates the evaluation score of the driver D according to the above equation (1). Is calculated. Then, the driver recognition determination unit 11c notifies the notification determination unit 11b of the calculated evaluation score.

  Returning to the description of FIG. 2A, the notification determination unit 11b will be described. Based on the vehicle information from the vehicle information sensor 7, the notification determination unit 11 b determines whether or not it is a driving situation in which it is necessary to make a notification regarding the call of the outsider W, and if it is not necessary, a notification regarding the call of the outsider W is issued. Do not do it.

  In addition, if it is a driving situation that needs to be performed, the notification determination unit 11b calls the driver D based on one or both of the determination results of the outsider call determination unit 11a and the driver recognition determination unit 11c. It is determined whether or not the presence of the person outside the vehicle W is to be notified, and the determination result is output to the notification information generating unit 11d.

  For example, the notification determination unit 11b determines to notify the driver D of the fact that at least the outsider call determination unit 11a determines that there is a call from the outsider W.

  For example, even if the driver D recognizes such an outsider W, by notifying that there is an outsider W making a call in this way, the outsider W can be re-recognized in the sense of confirmation. it can. From the outsider W, it can be reminded that there is a will to be communicated to the driver D.

  In addition, for example, the notification determination unit 11b determines to the driver D when the vehicle outsider call determination unit 11a determines that the vehicle outsider W is calling and the driver recognition determination unit 11c determines that the driver D is not recognized. It determines with alerting | reporting presence of the outside person W who is calling.

  As a result, when necessary in the true sense, that is, when the driver D is not even aware, the driver D is made aware of the presence of the outsider W who is calling and gives an opportunity to establish communication. be able to.

  Further, for example, the notification determination unit 11b uses the modified example described with reference to FIGS. 4A and 4B, the vehicle outsider call determination unit 11a provides the evaluation score of the vehicle outsider W, and the driver recognition determination unit 11c provides the evaluation score of the driver D. When each is notified, it is determined that the driver D is notified if the score of the evaluation score is within a predetermined range indicating that notification is necessary.

  The notification information generation unit 11d generates notification information to be notified to the notification unit 20 and causes the notification unit 20 to notify when receiving a determination result of notification to the driver D. Here, an example of the notification information according to the first embodiment is shown in FIG.

  As illustrated in FIG. 5, for example, the notification information in which “notification form” is voice and “notification target” is the driver D includes voice guidance and alarm sound. Further, for example, the notification information in which “notification form” is a display and the “notification target” is the driver D includes a notification image and an icon display on the display.

  Further, for example, the notification information in which “notification form” is displayed and “notification target” is an outsider W includes blinking of a brake lamp or a hazard lamp. Further, the notification information in which the “notification form” is a voice and the “notification target” is the outsider W includes a horn sound. The notification information generation unit 11d generates notification information corresponding to such “notification form” and “notification target”, and notifies the various devices of the notification unit 20 of the notification information.

  Next, a processing procedure executed by the outside information providing apparatus 10 according to the first embodiment will be described with reference to FIG. FIG. 6 is a flowchart showing a processing procedure executed by the outside-vehicle information providing apparatus 10 according to the first embodiment. That is, the processing procedure in the scene of “when leaving” (see FIG. 1B).

  First, the ignition is turned on (step S101). And the alert determination part 11b determines whether the vehicle speed of the vehicle C is 10 km / h or less based on the vehicle information from the vehicle information sensor 7 (step S102).

  Here, when the determination condition of step S102 is satisfied (step S102, Yes), the notification determination unit 11b subsequently determines whether or not the moving distance from the start of the vehicle C is, for example, 10 m or less (step S103). ).

  Here, when the determination condition of step S103 is satisfied (step S103, Yes), the vehicle outsider call determination unit 11a executes vehicle outsider call determination processing (step S104). Further, the driver recognition determination unit 11c executes a driver recognition determination process (step S105). It should be noted that both of the outsider call determination process (step S104) and the driver recognition determination process (step S105) shown in FIG. 6 may be performed substantially simultaneously. Also, one process may be performed at a timing earlier in time than the other process, or may be performed at a later timing.

  Then, the notification determination unit 11b performs notification determination processing based on one or both of the determination results of the outsider call determination unit 11a and the driver recognition determination unit 11c, or at least the determination result of the outsider call determination unit 11a (step S106). ).

  As a result, if it is determined that notification is required (step S107, Yes), it is notified that the vehicle outsider W is calling the driver D based on the notification information generated by the notification information generation unit 11d. This is notified from the unit 20 (step S108). Then, the processing from step S102 is repeated.

  If the determination conditions of steps S102, S103, and S107 are not satisfied (step S102, No / step S103, No / step S107, No), the process ends.

  As described above, the outside information providing apparatus 10 according to the first embodiment includes the outside person call determination unit 11a (corresponding to an example of a “call determination unit”) and the notification unit 20. The vehicle outsider call determination unit 11a detects a vehicle outsider W (corresponding to an example of “a person outside the vehicle”), and the vehicle outsider W calls the driver D (corresponding to “a passenger in the vehicle”). It is determined whether or not. The notification unit 20 notifies the driver D of the presence of the vehicle outsider W when the vehicle outsider call determination unit 11a determines that the vehicle outsider W is calling.

  Therefore, according to the outside information providing apparatus 10 according to the first embodiment, it is possible to provide the driver D with information on the presence of the outside person W who wants to convey his will to the driver D.

(Second Embodiment)
Next, a second embodiment will be described. The second embodiment is a scene of “when the bus departs from the bus stop” (see FIG. 1C). In the second embodiment, portions different from those in the first embodiment will be mainly described, and description of portions having overlapping contents will be omitted.

  FIG. 7A is a block diagram of an outsider call determination unit 11aA according to the second embodiment. FIG. 7A corresponds to FIG. 2B, and the outsider call determination unit 11aA according to the second embodiment is further different from the outsider call determination unit 11a according to the first embodiment. Is different. Further, the difference is that the outsider direction analysis unit 11ab, the outsider face direction analysis unit 11ac, the outsider movement vector analysis unit 11ae, and the outsider vibration analysis unit 11ag do not necessarily operate. It may operate.

  The outsider position analyzing unit 11ah analyzes the position of the outsider W based on the position of the stop BS based on various information from the external camera 2 and the radar 3, for example.

  FIG. 7B is a schematic bird's-eye view around the stop BS. The vehicle outsider position analyzing unit 11ah determines whether or not the vehicle outsider W exists within a predetermined range from the stop BS, which is shown as a solid portion in FIG. 7B. As shown in FIG. 7B, the predetermined range is a range of ± n meters (for example, ± 30 meters) along the sidewalk from the stop BS.

  In the second embodiment, if there is a vehicle outsider W who is calling the driver D of the bus B within the predetermined range, the vehicle outsider W is regarded as a passenger who has missed and a notification regarding this passenger is made. .

  For convenience of explanation, FIG. 7C shows a specific example of the feature in a case where the outside person W who is calling is a positive example in the second embodiment, corresponding to FIG. 4A.

  Here, examples of n = 1 to 3 are given. The “corresponding item” is an analysis result of the vehicle outsider position analysis unit 11ah, the vehicle outsider gesture analysis unit 11ad, and the vehicle outsider voice analysis unit 11af.

As shown in FIG. 7C, for example x _1, based on the analysis result of the outside's position analysis portion 11ah, the "condition" can be determined by a "whether within a predetermined range from the stop." That is, x ₁ is “1” if the “outside vehicle position” is within a predetermined range from the stop BS, and x ₁ is “0” otherwise.

  This is because if the “outside vehicle position” is within a predetermined range from the stop BS, it is easy to estimate that the outside vehicle W is calling.

Further, for example, x _2, based on the analysis result of the outside's gesture analysis unit 11ad, the "condition" can be determined by a "whether the boarding appeal gesture". In other words, it is "the outside of the vehicle's gesture" is ride if the appeal gesture x ₂ becomes "1", the x ₂ if the other "0".

Further, for example, x _3, based on the analysis result of the outside's speech analysis unit 11Af, the "condition" can be determined by a "whether the boarding appeal audio". In other words, the next x ₃ if it is "outside the vehicle's voice" is riding appeal voice is "1", if the other x ₃ is "0".

Thereafter, in the first embodiment, as in the example shown in FIG. 4A, the outsider call determination unit 11a obtains x ₁ to x _n according to each “condition” shown as an example in FIG. 7C, for example. In addition, by calculating the evaluation score of the outside person W by the above formula (1), it is possible to evaluate the degree that the outside person W who is a late passenger is calling in the second embodiment. .

  As a result, it is possible to detect an outside person W who has missed the ride but is willing to get on the bus B.

  Next, the notification information according to the second embodiment is shown in FIG. FIG. 8 corresponds to FIG. 5, but is particularly different in the second embodiment in that a message is displayed to the outside person W who is a late passenger. This is because, for example, the bus B has a display area for displaying a destination display, a route number, and the like, so that the display area is used.

  By displaying a message such as “I understand. I will stop again” in this display area, it is possible to give a sense of security to the outsider W who has missed the ride.

  Next, a processing procedure executed by the outside information providing apparatus 10 according to the second embodiment will be described with reference to FIG. FIG. 9 is a flowchart showing a processing procedure executed by the outside-vehicle information providing apparatus 10 according to the second embodiment.

  First, the door of bus B is once closed (step S201). And the alert determination part 11b determines whether the vehicle speed of the bus | bath B is 10 km / h or less based on the vehicle information from the vehicle information sensor 7 (step S202).

  Here, when the determination condition of step S202 is satisfied (step S202, Yes), the presence / absence of an outside person W is determined (step S203). Here, when the determination condition of step S203 is satisfied (step S203, Yes), the outsider call determination unit 11aA executes an outsider call determination process (step S204).

  And the alerting | reporting determination part 11b determines whether it is a passenger who got late based on the determination result of the vehicle outsider call determination part 11aA (step S205).

  As a result, when it is determined that the passenger is late (step S205, Yes), based on the notification information generated by the notification information generation unit 11d, the passenger is present within a predetermined range from the stop BS. This is notified from the notification unit 20 (step S206).

  If the determination conditions of steps S203 and S205 are not satisfied (step S203, No / step S205, No), the process from step S202 is repeated, and if the determination conditions of step S202 are not satisfied (step S202, No), the process Exit.

  As described above, in the second embodiment, the vehicle outsider call determination unit 11aA analyzes whether or not the vehicle outsider W making a call exists within a predetermined range from the stop BS. It was decided to.

  Therefore, according to the second embodiment, it is possible to provide the driver D with information on the presence of the outside person W who appeals to board the passenger within the predetermined range from the stop BS.

(Third embodiment)
Next, a third embodiment will be described. The third embodiment is a scene during “cab driving” (see FIG. 1D). In the third embodiment, portions different from those in the first and second embodiments will be mainly described, and description of portions having overlapping contents will be omitted.

  FIG. 10A is a block diagram of an outsider call determination unit 11aB according to the third embodiment. FIG. 10A corresponds to FIGS. 2B and 7A, and the outsider call determination unit 11aB according to the third embodiment is further different from the outsider call determination unit 11a according to the first embodiment. The difference is that an analysis unit 11ah ′ is provided. Further, the point that the outsider face orientation analysis unit 11ac operates is different from the outsider call determination unit 11aA according to the second embodiment.

  The vehicle outsider position analyzing unit 11ah 'analyzes whether the position of the vehicle outsider W is within the taxiable range of the taxi T based on various information from the external camera 2, the radar 3, the vehicle information sensor 7, and the like.

  FIG. 10B is a schematic bird's-eye view around the outsider W. The vehicle outsider position analyzing unit 11ah ′ safely decelerates the area shown as a solid portion in FIG. 10B within a range of ± n meters of the outsider W, whether it is a general road or outside a parking and parking prohibited area. Analyzing whether the vehicle can stop.

  In the third embodiment, if all the conditions related to such a region are satisfied, it is within the possible range, and if the outsider W is calling, the outsider W is regarded as a taxi passenger. Information about customers.

  As in the past, in the third embodiment, FIG. 10C shows a specific example of the feature when the outside person W who is calling is a positive example.

  Here, examples where n = 1 to 4 are given. The “corresponding item” is an analysis result of the outsider position analysis unit 11ah ′, the outsider face orientation analysis unit 11ac, the outsider gesture analysis unit 11ad, and the outsider voice analysis unit 11af.

As shown in FIG. 10C, for example, x _1, based on the analysis result of the outside's position analyzing unit 11ah ', the "condition" can be determined by a "whether the riding range". That is, x ₁ is “1” if the “outside vehicle position” is within the boarding range, and x ₁ is “0” otherwise.

Further, for example, x _2, based on the analysis result of the outside's face orientation analyzing section 11ac, the "condition" can be determined by a "whether the vehicle direction is within a predetermined range." That is, the if "outside who face orientation" is within a predetermined range from the vehicle direction x ₂ is "1", if the other x ₂ is "0".

Further, for example, x _3, based on the analysis result of the outside's gesture analysis unit 11ad, the "condition" can be determined by a "whether the boarding appeal gesture". In other words, if it is "outside the vehicle's gesture" is riding appeal gesture x ₃ is "1", if the other x ₃ is "0".

Further, for example, x _4, based on the analysis result of the outside's speech analysis unit 11Af, the "condition" can be determined by a "whether the boarding appeal audio". In other words, it is "the outside of the vehicle's voice" is riding appeal if the voice x ₄ is "1", if the other x ₄ is "0".

Thereafter, as in the past, the outsider call determination unit 11aB obtains x ₁ to x _n according to each “condition” shown as an example in FIG. By calculating the evaluation score of the person W, it is possible to evaluate the degree of call by the outside person W who is a taxi passenger existing in the possible boarding range in the third embodiment.

  As a result, the driver D can be provided with information on the presence of the outside person W who is willing to get on the taxi T and can safely get in the taxiable range.

  In addition, the condition that the taxi T can be boarded may include a case where the super sign is “empty vehicle”, “extra charge”, or the like based on vehicle information.

  The notification information according to the third embodiment is shown in FIG. FIG. 11 corresponds to FIG. 5 and FIG. 8, but the third embodiment is particularly different from the driver D in that the position of a taxi passenger or a boarding area can be clearly defined by an emphasis frame or an arrow icon. It is a point to be displayed. Thereby, the driver D can be surely provided with information on the existence of a taxi passenger that can be safely boarded.

  Next, a processing procedure executed by the outside information providing apparatus 10 according to the third embodiment will be described with reference to FIG. FIG. 12 is a flowchart illustrating a processing procedure executed by the outside-vehicle information providing apparatus 10 according to the third embodiment.

  First, it is determined from the vehicle information whether a taxi passenger can ride (step S301). Here, when the determination condition of step S301 is satisfied (step S301, Yes), the presence / absence of the outside person W is determined (step S302).

  And when satisfy | filling the determination conditions of step S302 (step S302, Yes), the vehicle outsider call determination part 11aB performs vehicle outside person call determination processing (step S303). Further, the driver recognition determination unit 11c executes driver recognition determination processing (step S304). It should be noted that both of the outsider call determination process (step S303) and the driver recognition determination process (step S304) shown in FIG. 12 may be performed substantially simultaneously. Also, one process may be performed at a timing earlier in time than the other process, or may be performed at a later timing.

  Then, the notification determination unit 11b performs notification determination processing based on one or both of the determination results of the outsider call determination unit 11aB and the driver recognition determination unit 11c, or at least the determination result of the outsider call determination unit 11aB (step S305). ).

  As a result, when it is determined that the notification is required (passenger) (Yes in step S306), there is a taxi passenger that can be safely boarded based on the notification information generated by the notification information generation unit 11d. The effect is notified from the notification unit 20 (step S307).

  If the determination condition in step S306 is not satisfied (No in step S306), the processing from step S301 is repeated. If the determination conditions of steps S301 and S302 are not satisfied (step S301, No / step S302, No), the process ends.

  As described above, in the third embodiment, it is analyzed whether or not an element relating to the presence of an outsider who is calling is within the possible boarding range.

  Therefore, according to the third embodiment, it is possible to provide information to the driver D about the presence of the outside person W who is a taxi passenger who can safely get on.

(Fourth embodiment)
Next, a fourth embodiment will be described. The fourth embodiment is a scene of “when waiting” (see FIG. 1E). In the fourth embodiment, parts different from those in the first to third embodiments will be mainly described, and the description of overlapping parts will be omitted.

  FIG. 13A is a block diagram of an outsider call determination unit 11aC according to the fourth embodiment. FIG. 13A corresponds to FIG. 2B, FIG. 7A, and FIG. 10A, and the outsider call determination unit 11aC according to the fourth embodiment is further different from the outsider call determination unit 11a according to the first embodiment. The difference is that the vehicle outsider authentication unit 11aj is provided. Moreover, the point which the vehicle exterior direction analysis part 11ab operate | moves differs from the vehicle exterior person call determination parts 11aA and 11aB which concern on 2nd and 3rd embodiment. Moreover, the point which refers the waiting registration information 12e registered previously differs from the 1st-3rd embodiment.

  The vehicle outsider authentication unit 11aj is provided so as to be capable of information communication with the communication terminal 4, for example, and performs authentication processing for the vehicle outsider W based on the authentication information regarding the vehicle outsider W from the communication terminal 4 and the waiting registration information 12e.

  FIG. 13B is a diagram illustrating an example of the waiting registration information 12e. The meeting registration information 12e is information that associates the “destination” with, for example, “meeting person face image”, “meeting person telephone number”, “meeting person mail address” and the like that can identify the meeting person. The meeting registration information 12e is registered when setting a meeting destination.

  The vehicle outsider authentication unit 11aj connects the communication terminal 4 carried by the vehicle outsider W based on the contents of the waiting registration information 12e if the vehicle C approaches the destination, and if the connection is established, the communication terminal 4, the data registered in the waiting registration information 12e (for example, a face image) is acquired, and the person outside the vehicle W is authenticated as a waiting person.

  Then, the outsider W who is the queuing person performs an outsider call determination process, that is, analysis of at least one of direction, face direction, gesture, and voice. Do.

  As in the past, in the fourth embodiment, FIG. 13C shows a specific example of the feature when the outside person W who is calling is a positive example.

  Here, examples where n = 1 to 5 are given. The “corresponding item” is an authentication result of the outsider authentication unit 11aj, an analysis result of the outsider direction analysis unit 11ab, an outsider face direction analysis unit 11ac, an outsider gesture analysis unit 11ad, and an outsider voice analysis unit 11af. is there.

As shown in FIG. 13C, for example, x _1, based on the authentication result of the outside authenticating section 11Aj, the "condition" can be determined by a "whether the authentication OK". That is, x ₁ is “1” if “outside vehicle authentication” is authentication OK, and x ₁ is “0” otherwise.

Since x ₂ ~x ₅ are the same as before, the description thereof is omitted. Thereafter, the outsider call determination unit 11aC obtains x ₁ to x _n according to each “condition” shown as an example in FIG. 13C, for example, and then calculates the evaluation score of the outside person W by the above formula (1). By calculating, it is possible to evaluate the degree to which the outside person W who is a meeting person is calling in the fourth embodiment. In addition, the driver recognition determination unit 11c performs a driver recognition determination process similar to that of the first embodiment, calculates the evaluation score of the driver D, and evaluates the degree that the driver D does not recognize the call. Also good.

  As a result, the vehicle occupant W who is the queuing person can be detected easily and reliably, and when the driver D does not recognize it, it can be notified with certainty. In addition, it is possible to prevent the driver D from being distracted to look for a meeting person. Therefore, safe waiting for the driver D can be performed.

  The notification information according to the fourth embodiment is shown in FIG. FIG. 14 corresponds to FIG. 5, FIG. 8, and FIG. 11, but the difference in the fourth embodiment is that a warning sound is notified to the driver D or a weak horn is given to the outside person W. It is a point that sounds and informs the approach of the driver D. Thereby, it is possible to provide information that contributes to smooth waiting for both the driver D and the outsider W.

  Next, a processing procedure executed by the outside information providing apparatus 10 according to the fourth embodiment will be described with reference to FIG. FIG. 15 is a flowchart illustrating a processing procedure executed by the outside-vehicle information providing apparatus 10 according to the fourth embodiment.

  First, the presence / absence of the waiting registration information 12e is determined (step S401). Here, when there is the waiting registration information 12e (step S401, Yes), it is determined whether or not it is near the destination (step S402).

  Here, when the determination condition of step S402 is satisfied (step S402, Yes), the presence / absence of the outside person W is determined (step S403).

  When the determination condition of step S403 is satisfied (step S403, Yes), the vehicle outsider authentication unit 11aj performs a vehicle outsider W authentication process (step S404). Here, when it is not authenticated that the person is a meeting person (step S405, No), the processing from step S402 is repeated. Also, when the determination conditions of steps S402 and S403 are not satisfied (step S402, No / step S403, No), the processing from step S402 is repeated.

  Although not shown, the outsider call determination unit 11aC may perform the outsider call determination process other than the authentication process.

  If the determination condition in step S405 is satisfied (step S405, Yes), the driver recognition determination unit 11c executes a driver recognition determination process (step S406).

  As a result, when it is determined that the driver D has not recognized (step S407, No), the notification unit 20 notifies that there is a waiting person based on the notification information generated by the notification information generation unit 11d. (Step S408).

  If the determination condition of step S401 is not satisfied (step S401, No), or if the determination condition of step S407 is satisfied (step S407, Yes), the process ends.

  As described above, in the fourth embodiment, it is authenticated whether or not an outside person near the destination is a meeting person, and an outside person calling determination process and a driver recognition process are performed on the authenticated meeting person. It was decided.

  Therefore, according to the fourth embodiment, the waiting can be performed smoothly and safely. In addition, the authentication process of the outside person W does not necessarily need to be performed. For example, only the destination for meeting may be registered, and the outsider call determination process and the driver recognition process that do not include the authentication process may be performed when the destination approaches.

  Further effects and modifications can be easily derived by those skilled in the art. Thus, the broader aspects of the present invention are not limited to the specific details and representative embodiments shown and described above. Accordingly, various modifications can be made without departing from the spirit or scope of the general inventive concept as defined by the appended claims and their equivalents.

DESCRIPTION OF SYMBOLS 1 Outside-vehicle information provision system 10 Outside-vehicle information provision apparatus 11 Control part 11a, 11aA, 11aB, 11aC Outsider call determination part 11aa Outsider detection part 11ab Outsider direction analysis part 11ac Outsider face direction analysis part 11ad Outsider gesture analysis part 11ae Vehicle exterior movement vector analysis unit 11af Vehicle exterior sound analysis unit 11ag Vehicle exterior vibration analysis unit 11ah, 11ah 'Vehicle exterior position analysis unit 11aj Vehicle exterior authentication unit 11b Notification determination unit 11c Driver recognition determination unit 11ca Driver face direction analysis unit 11cb Driver line of sight Analysis unit 11cc Driver body information analysis unit 11d Notification information generation unit 11e Learning unit 12 Storage unit 12a Gesture pattern information 12b Voice pattern information 12c Vibration pattern information 12d Gesture discrimination model 12e Waiting registration information 0 notification unit B bus BS stop C vehicle D driver T taxi W outside of the vehicle's

Claims (9)

A call determination unit that detects a person outside the vehicle and determines whether the person is calling a passenger in the vehicle;
An outside information providing apparatus comprising: a notifying unit that notifies the passenger of the presence of the person when the call determining unit determines that the person is making the call. A detection unit for detecting the person based on imaging information outside the vehicle;
A gesture analysis unit that analyzes a gesture of the person based on a detection result of the detection unit,
The call determination unit
The outside information providing apparatus according to claim 1, wherein it is determined whether the person is making the call based on an analysis result of the gesture analysis unit. The detector is
Detecting the voice in the direction of the person,
A voice analysis unit for analyzing the voice based on a detection result of the detection unit;
The call determination unit
The outside information providing apparatus according to claim 2, wherein it is determined whether the person is making the call based on an analysis result of the voice analysis unit. The outside information providing apparatus according to claim 2, further comprising: a recognition determination unit that determines whether the passenger recognizes the call by the person based on in-vehicle imaging information. The recognition determination unit
The outside information providing apparatus according to claim 4, wherein whether the passenger recognizes the call by the person is determined based on physical information of the passenger. A position analysis unit that analyzes the position of the person based on the detection result of the detection unit;
The call determination unit
The outside information providing apparatus according to any one of claims 2 to 5, wherein it is determined whether the person is making the call based on an analysis result of the position analysis unit. The passenger is a bus driver,
When it is determined by the position analysis unit that the person is within a predetermined range from the bus stop, and when the call determination unit determines that the person is making the call,
The notification unit
The outside information providing apparatus according to claim 6, wherein the driver is notified of the presence of the person. The passenger is a taxi driver,
When it is determined by the position analysis unit that the person is present at the taxi-capable position, and the call determination unit determines that the person is making the call,
The notification unit
The outside information providing apparatus according to claim 6, wherein the driver is notified of the presence of the person. A call determination step of detecting a person outside the vehicle and determining whether the person is calling a passenger in the vehicle;
An outside information providing method comprising: a notifying step of notifying the passenger of the presence of the person when the call determining step determines that the person is making the call.

Images