JP2022118527A - Information notification system, and information notification method - Google Patents

Abstract

To provide an information notification system capable of providing information which is useful for a user of a mobile, in simple configuration and an information notification method.SOLUTION: An information notification system 10 comprises: a mobile situation notification accepting unit 23 for accepting an implementation of a mobile situation notification by outputting from an output device used in a mobile 1 the notification necessity confirmation information inquiring the necessity of the mobile situation notification when a behavior of a user estimated to get off the mobile 1 is recognized by a user behavior recognition unit 21; and a mobile situation notification unit 24 by which the mobile situation notification is transmitted to a user terminal used by the user after a mobile situation is recognized by a mobile situation recognition unit 22 when the implementation of the mobile situation notification is accepted by the mobile situation notification accepting unit 23.SELECTED DRAWING: Figure 3

Description

The present invention relates to an information notification system and an information notification method.

Conventionally, when a user gets off the vehicle, it acquires information related to the location of the vehicle from a database, converts the acquired information into voice data, and outputs normal information by voice. An information notification device has been proposed (see Patent Document 1, for example). The information notification device outputs crime prevention information, traffic congestion information, shopping information, event information, etc. as notification information related to the location of the vehicle.

JP 2017-528085 A

The above-described conventional information notification device needs to configure a database in order to obtain information about the location of the vehicle, which complicates the system configuration. Moreover, the notification information to be output is limited to uniform information stored in advance in the database, and there is a risk that useful information cannot be obtained for the user.
SUMMARY OF THE INVENTION The present invention has been made in view of such a background, and aims to provide an information notification system and an information notification method capable of providing useful information to users of moving bodies such as vehicles with a simple configuration. aim.

As a first mode for achieving the above object, based on the detection status by a user action recognition unit that recognizes the action of a user on board a mobile object and a detection unit provided in the mobile object, the above-mentioned A mobile body situation recognition unit that recognizes a mobile body situation, which is a situation inside or around the mobile body, and the user behavior recognition part, the behavior that the user is estimated to get off the mobile body. When it is recognized, notification necessity confirmation information for inquiring whether or not to notify the status of the mobile body is output from the output device used in the mobile body, and the notification of the status of the mobile body is performed. a moving body status notification receiving unit for receiving; and a mobile unit status notification unit that transmits a mobile unit status notification to the user terminal used by the user.

In the above information notification system, the moving body situation recognition unit may use a raindrop sensor provided in the moving body as the detection unit, and may recognize the amount of rain detected by the raindrop sensor as the moving body situation. good.

In the above information notification system, when the mobile body status notification receiving unit accepts the mobile body status notification and the mobile body status recognition part recognizes rainfall equal to or greater than a predetermined amount, the mobile body The configuration may include a first moving body evacuation support unit that executes processing for moving to a location.

In the above information notification system, the moving body situation recognition unit may use a temperature sensor provided in the moving body as the detection unit, and may recognize the temperature detected by the temperature sensor as the moving body situation. good.

In the above information notification system, when the mobile body status notification receiving unit accepts the mobile status notification and the mobile status recognition unit recognizes a temperature equal to or higher than the upper limit temperature or lower than the lower limit temperature, the The configuration may include a second moving body evacuation support unit that executes processing for moving the moving body to a predetermined location.

In the information notification system described above, the moving object situation recognition unit may use a camera provided on the moving object as the detection unit, and may recognize an image captured by the camera as the moving object situation.

In the above information notification system, an image of a person having a predetermined characteristic is obtained from the photographed image recognized by the mobile body situation recognition unit, when the mobile body status notification reception unit accepts the implementation of the mobile body situation notification. The configuration may include a first suspicious person handling unit that, when extracted, executes a process for activating an alarm device provided in the moving body.

In the above information notification system, the mobile body situation recognition section uses the communication unit provided in the mobile body as the detection section to detect the communication status between the communication unit and communication terminals existing in the vicinity of the mobile body. , may be recognized as the moving body situation.

In the above information notification system, the identification information of the communication terminal is registered in advance based on the communication status recognized by the mobile status notification receiving unit and the mobile status notification receiving unit. A configuration may also be provided in which a second suspicious person handling unit executes processing for activating an alarm device provided in the moving object when it is recognized that the information is other than the identified identification information.

As a second aspect for achieving the above object, there is provided an information notification method executed by a computer, comprising: a moving body situation recognition step of recognizing a moving body situation, which is a situation inside or around the moving body, based on the detection situation by the detection unit; an output device used in the moving body to output notification necessity confirmation information for inquiring whether or not to notify the status of the moving body when an action that is estimated to get off the moving body is recognized. and a mobile body status notification receiving step for receiving implementation of the mobile body status notification, and when implementation of the mobile body status notification is received by the mobile body status notification receiving step, the mobile body status recognition a mobile body status notification step of recognizing the mobile body status and transmitting the mobile body status notification to the user terminal used by the user.

According to the above-mentioned information notification system, the situation of the moving body recognized by the detection unit provided in the moving body is transmitted to the user terminal with a simple configuration. It is possible to notify the situation inside or around the moving object, which can be expected to be useful information.

FIG. 1 is an explanatory diagram of a mode in which the information notification system recognizes the vehicle status and transmits a mobile status notification to the user terminal. FIG. 2 is a configuration diagram of a vehicle equipped with an information notification system. FIG. 3 is a configuration diagram of an information notification system. FIG. 4 is a flow chart of a process for receiving notification of the state of the mobile object at the timing when the user gets off the vehicle. FIG. 5 is a first flow chart of processing for transmitting a mobile status notification. FIG. 6 is a second flow chart of the process of transmitting mobile status notification.

[1. Transmission of mobile status notification by information notification system]
With reference to FIG. 1, a mode of transmitting a mobile status notification by the information notification system 10 of this embodiment will be described. The information notification system 10 is mounted on the vehicle 1 and communicates with the user terminal 150 used by the user U of the vehicle 1 and the vehicle management server 600 that manages the usage status of the vehicle 1 via the communication network 500. communication. The vehicle 1 corresponds to a mobile body of the present disclosure.

Although the details will be described later, the vehicle 1 includes a camera for photographing the surroundings of the vehicle 1, a camera for photographing the interior of the vehicle 1, a temperature sensor for detecting the temperature in the vicinity of the vehicle 1, a raindrop sensor for detecting the amount of rain, and the like. section is provided. When the information notification system 10 recognizes the behavior of the user U who is riding in the vehicle 1 and recognizes the behavior of the vehicle 1 stopping and the user U getting off the vehicle 1, the touch panel 90 , a reception screen 200 for inquiring whether or not to notify the state of the vehicle 1 is displayed. The touch panel 90 corresponds to the output device of the present disclosure, and the reception screen corresponds to the notification necessity confirmation information of the present disclosure.

The user U can set the implementation of the mobile status notification by visually recognizing the reception screen 200 and touching the "yes" selection button. In the information notification system 10, when the implementation of the mobile status notification is set in this way and the implementation of the mobile status notification is received, the user gets off the vehicle 1 and moves to the office building 700 or the like. A mobile status notification Csi is transmitted to the user terminal 150 of the person U.

The information notification system 10 captures the surroundings and interior of the vehicle 1 with a camera, recognizes the communication status with communication terminals near the vehicle 1, and recognizes the outside temperature near the vehicle 1 from the detection signal of the temperature sensor. , the rainfall around the vehicle 1 is recognized from the detection signal of the rainfall sensor. Then, the information notification system 10 transmits the image captured by the camera and the mobile unit status notification Csi based on the recognition result thereof to the user terminal 150 via the communication network 500 .

The moving object status notification Csi contains the surrounding image of the vehicle 1, the image inside the vehicle 1, the outside temperature around the vehicle 1, the amount of rainfall around the vehicle 1, the information of the suspicious person recognized from the image, and the communication terminal around the vehicle 1. This includes information on suspicious persons recognized from communication with The user terminal 150 that has received the mobile unit status notification Csi displays a vehicle status screen 210 displaying the status of the vehicle 1 on the display unit. FIG. 1 shows an example in which an image 211 of the surroundings of the vehicle 1 and information 212 on the outside temperature, amount of rainfall, and suspicious persons are displayed on the vehicle status screen 210 .

In this way, the information notification system 10 displays the reception screen 200 on the touch panel 90 of the vehicle 1 at the timing when the user U gets off the vehicle 1 to receive the transmission of the moving body status notification, and gets off the vehicle 1. The situation of the vehicle 1 is notified to the distant user U. As a result, the user U returning to the vehicle 1 can be notified of the temperature and rainfall conditions in the vicinity of the vehicle 1 and encouraged to prepare clothes and rain gear. The information notification system 10 also executes processing for moving the vehicle 1 to an indoor parking lot (corresponding to a predetermined location in the present disclosure) or the like, depending on the situation of the vehicle 1, although the details will be described later.

[2. Vehicle configuration]
The configuration of the vehicle 1 equipped with the information notification system 10 will be described with reference to FIG. The vehicle 1 is a passenger car with a seating capacity of five, and includes a driver's seat 7a, a front passenger's seat 7b, a right rear seat 7c, a center rear seat 7d, and a left rear seat 7e. Each of the seats 7a-7e is provided with seat belt switches 60-64 for detecting whether or not a seat belt is worn, and seating sensors 70-74. The vehicle 1 is also provided with a horn 112 and lights 113 (headlights, small lights, winker lights, etc.) (see FIG. 3).

FIG. 2 shows a situation in which the user U who has the portable key 160 of the vehicle 1 is seated in the driver's seat 7a. A user terminal 150 used by the user U is placed on the front passenger seat 7b. The vehicle 1 includes a right front door 2 , a left front door 3 , a right rear door 4 , and a left rear door 5 . A door knob of the right front door 2 is provided with a door touch sensor 53 . A user U who possesses the portable key 160 can unlock the doors 2 to 6 of the vehicle 1 by touching the door touch sensor 53 .

A front camera 40 for photographing the front of the vehicle 1 is provided at the front of the vehicle 1 , and a rear camera 43 for photographing the rear of the vehicle 1 is provided at the rear of the vehicle 1 . A right side camera 41 for photographing the right side of the vehicle 1 is provided on the right side of the vehicle 1 , and a left side camera 42 for photographing the left side of the vehicle 1 is provided on the left side of the vehicle 1 .

A dashboard in the passenger compartment is provided with a front-seat camera 45 for capturing images of users seated in the driver's seat 7a and the passenger's seat 7b, a touch panel 90, and a speaker 91. - 特許庁Rear-seat cameras 46 are provided on the ceiling of the passenger compartment to capture images of users seated in the rear right seat 7c, the rear center seat 7d, and the rear left seat 7e.

Door switches 80 to 83 for detecting opening/closing of the doors are provided for the doors 2 to 5, respectively. The tailgate 6 is also provided with a door switch 85 for detecting opening and closing of the tailgate 6 . Further, a power switch 54 and a shift switch 55a for detecting the shift position of the shift lever 55 are provided near the driver's seat 7a. The vehicle 1 also includes a side brake switch 52a that detects whether the side brake pedal 52 is on or off.

Further, the vehicle 1 includes door lock mechanisms 100 to 104 for locking the doors 2 to 5 and the tailgate 6, a temperature sensor 110 for detecting the temperature around the vehicle 1, a raindrop sensor 111 for detecting the amount of rainfall, and the running speed of the vehicle 1. , a communication unit 130 , a navigation device 140 , a vehicle ECU (Electronic Control Unit) 141 , and a spray unit 142 .

The communication unit 130 communicates with the user terminal 150, the mobile key 160, the vehicle management server, communication terminals near the vehicle 1, and the like. The navigation device 140 has a GPS (Global Positioning System) sensor (not shown) and map data, and executes route guidance to a destination based on the position of the vehicle 1 detected by the GPS sensor and the map data. The vehicle ECU 141 controls the overall operation of the vehicle 1 including traveling by automatic driving of the vehicle 1 . The spraying unit 142 sprays tear gas around the vehicle 1, sprays snow-melting agent, and the like.

[3. Configuration of information notification system]
The configuration of the information notification system 10 will be described with reference to FIG. The information notification system 10 includes a processor 20 (corresponding to the computer of the present disclosure), a memory 30, an interface circuit (not shown), and the like. The memory 30 stores an information notification program 31 for executing the transmission process of the mobile unit status notification Csi described above and user registration information 32 in which identification information of users of the vehicle 1 including the user U is recorded. It is A user whose identification information is recorded in the user registration information 32 is hereinafter referred to as a registered user. In this embodiment, the face image of the registered user and the identification code (communication address, etc.) of the user terminal used by the registered user are recorded as the identification information of the registered user.

Images around the vehicle 1 captured by the front camera 40 , the right side camera 41 , the left side camera 42 and the rear camera 43 are input to the information notification system 10 . Images of the interior of the vehicle 1 photographed by the front-seat camera 45 and the rear-seat camera 46 are also input to the information notification system 10 .

Furthermore, the information notification system 10 includes a side brake switch 52a, a door touch sensor 53, a power switch 54, a shift switch 55a, seat belt switches 60-64, seating sensors 70-74, detection signals from door switches 80-84, and A lock detection signal for each of the doors 2 to 5 and the tailgate 6 is input from a door lock sensor (not shown) provided in the door lock mechanisms 100 to 104 .

Further, the information notification system 10 includes a touch position detection signal of the touch panel 90, a temperature detection signal of the temperature sensor 110, a detection signal of the raindrop sensor 111, a speed detection signal of the speed sensor 120, and the vehicle 1 detected by the navigation device 140. The information of the current position (latitude, longitude) of is input.

Screen display on the touch panel 90, sound output from the speaker 91 (audio guidance, chime sound, etc.), operation of the door lock mechanisms 100 to 104 (lock, unlock), and lights are controlled by the control signal output from the information notification system 10. 113 operation (lighting, blinking, extinguishing), the operation of the spray unit 142, etc. are controlled. In addition, the information notification system 10 communicates with the vehicle ECU 141, and communicates with the user terminal 150, the vehicle management server 600, and communication terminals possessed by pedestrians near the vehicle 1 via the communication unit 1130. Communicate with

By reading and executing the information notification program 31 stored in the memory 30, the processor 20 performs a user action recognition unit 21, a mobile object situation recognition unit 22, a mobile object condition notification reception unit 23, and a mobile object condition notification unit 24. , a first moving body evacuation response unit 25 , a second moving body evacuation response unit 26 , a first suspicious person response unit 27 , and a second suspicious person response unit 28 .

The user behavior recognition unit 21 captures an image of the surroundings of the vehicle 1 captured by the front camera 40, the right side camera 41, the left side camera 42, and the rear camera 43, and the vehicle interior of the vehicle 1 captured by the front seat camera 45 and the rear seat camera 46. , side brake switch 52a, door touch sensor 53, power switch 54, shift switch 55a, seat belt switches 60-64, seating sensors 70-74, detection signals of door switches 80-84, and door lock mechanism 100- The action of the user U is recognized based on the lock detection signals of the doors 2 to 5 and the tailgate 6 by a door lock sensor (not shown) provided in 104 .

In this embodiment, the user behavior recognition unit 21 detects the movement of the user U toward the door recognized from the photographed image of the interior of the vehicle 1, detects a change in the operation state of the side brake by the side brake switch 52a, It is presumed that the user gets off the vehicle 1 by recognizing the off operation of the switch 54, the change from the on detection state (seating detection state) to the off detection state (seating non-detection state) of the seating sensors 70 to 74, and the like. recognizing behavior that

The mobile body situation recognition unit 22 recognizes the following situations as the mobile body situation of the present disclosure.
(1) the temperature around the vehicle 1 based on the detection signal of the temperature sensor 110;
(2) amount of rain around the vehicle 1 based on the detection signal of the raindrop sensor 111;
(3) Captured images of the surroundings of the vehicle 1 by the front camera 40, the right side camera 41, the left side camera 42, and the rear camera 43;
(4) Photographed images of the interior of the vehicle 1 by the front seat camera 45 and the rear seat camera 46 .
(5) Communication status with communication terminals existing near the vehicle 1 by the communication unit 130 .

When the user behavior recognizing unit 21 recognizes that the user riding in the vehicle 1 has exited the vehicle 1, the moving body status notification receiving unit 23 performs the above-described action with reference to FIG. Then, the reception screen 200 is displayed on the touch panel 90 of the vehicle 1 to inquire whether or not the mobile status notification Csi is necessary, and to accept the transmission of the mobile status notification Csi. The mobile unit status notification unit 24 transmits the mobile unit status notification Csi to the user terminal 150 when the mobile unit status notification reception unit 23 accepts the transmission of the mobile unit status notification Csi.

After the user gets off the vehicle 1 when the transmission of the mobile body situation notification Csi is accepted, the first mobile body evacuation handling unit 25 When the amount of rain exceeds a predetermined amount, the vehicle ECU 141 is sent instruction information to automatically drive the vehicle 1 to an indoor parking lot. This allows the vehicle 1 to automatically travel to the indoor parking lot and protect the vehicle 1 from heavy rain.

The second mobile body evacuation support unit 26, when the transmission of the mobile body situation notification Csi is accepted, after the user gets off the vehicle 1, When the temperature becomes equal to or lower than the low temperature threshold or equal to or higher than the high temperature threshold, instruction information for automatically driving the vehicle 1 to the indoor parking lot is transmitted to the vehicle ECU 141 . This allows the vehicle 1 to automatically travel to the indoor parking lot and protect the vehicle 1 from low or high temperatures. Further, when the temperature in the vicinity of the vehicle 1 recognized by the mobile body situation recognition unit 22 is equal to or lower than the low temperature threshold, the first moving body evacuation support unit 25 sprays the snow melting agent near the vehicle 1 using the spray unit 142. to prevent the road surface near the vehicle 1 from freezing.

The first suspicious person handling unit 27 extracts a person's face image from the photographed image of the surroundings of the vehicle 1 and the photographed image of the interior of the vehicle 1 recognized by the moving object situation recognition unit 22, and extracts the user registration information 32. match the face image of the registered user recorded in the Then, if a person whose matching rate with the face image of the registered user is equal to or lower than the determination threshold stays near the vehicle 1 for a predetermined time or longer, the first suspicious person handling unit 27 regards the person as a suspicious person. , and operates the horn 112 and the light 113 to issue an alarm. In this case, horn 112 and light 113 correspond to the alarm device of the present disclosure. When the suspicious person does not leave the vehicle 1 even after issuing the alarm, the first suspicious person handling unit 27 sprays tear gas with the spray unit 142 and requests the vehicle management server 600 to guard the vicinity of the vehicle 1. Send information.

The second suspicious person handling unit 28 collates the identification code of the communication terminal near the vehicle 1 recognized by the mobile object situation recognition unit 22 with the identification code of the user terminal recorded in the user registration information 32 . Then, if a communication terminal having an identification code that does not match the identification code of the user terminal stays near the vehicle 1 for a predetermined time or longer, the second suspicious person handling unit 28 detects that the suspicious person is near the vehicle 1 . It recognizes that you are in the area and activates the horn 112 and the light 113 to issue an alarm. When the suspicious person does not leave the vehicle 1 even after issuing the alarm, the second suspicious person handling unit 28 sprays tear gas with the spray unit 142 and requests the vehicle management server 600 to guard the vicinity of the vehicle 1. Send information.

[4. Reception processing for implementation of mobile unit status notification]
A reception process for implementing mobile status notification will be described according to the flowchart shown in FIG. In the following, as shown in FIG. 1, a situation will be described in which the user U gets off the vehicle 1 and transmits a mobile unit status notification to the user terminal 150. FIG. When the moving object status notification receiving unit 23 recognizes that the vehicle 1 has stopped from the detection signal of the speed sensor 120 in step S1 of FIG. 4, the process proceeds to step S2. In step S<b>2 , the user behavior recognition unit 21 recognizes the behavior of the user U riding the vehicle 1 .

In subsequent step S3, when the user behavior recognition unit 21 recognizes that the user U will get off the vehicle 1, the moving body status notification receiving unit 23 advances the process to step S4. On the other hand, when the user behavior recognizing unit 21 does not recognize the behavior that the user U is expected to get off the vehicle 1, the moving body status notification receiving unit 23 advances the process to step S1.

In step S4, the mobile unit status notification reception unit 23 displays the reception screen 200 (see FIG. 1) on the touch panel 90 to inquire whether mobile unit information notification is necessary. In the next step S5, when the mobile body status notification receiving unit 23 receives the transmission of the mobile body information status notification Csi by the user U, the process proceeds to step S6. is executed. On the other hand, when the user U has not issued an instruction to perform mobile status notification, the mobile status notification reception unit 23 advances the process to step S7, and in this case, the mobile status notification transmission process is not executed.

[5. Transmission processing of mobile unit status notification]
The transmission processing of the mobile status notification will be described according to the flow charts shown in FIGS. In step S1 of FIG. 5, the moving body status notification unit 24 advances the process to step S11 when it is time to transmit the mobile body status notification. The timing of sending the notification of the status of the mobile object is determined by the application of the notification of the status of the mobile object executed by the user terminal 150. It is set, for example, when there is a notification request operation.

In step S<b>11 , the moving object status notification unit 24 recognizes the temperature around the vehicle 1 based on the detection signal of the temperature sensor 110 . In the next step S<b>12 , the moving object condition notification unit 24 recognizes the rainfall around the vehicle 1 based on the detection signal of the raindrop sensor 111 . In the subsequent step S13, the moving body status notification unit 24 captures the surroundings of the vehicle 1 with the front camera 40, the right side camera 41, the left side camera 42, and the rear camera 43, and The inside of the vehicle 1 is photographed.

In the next step S14, the first suspicious person handling unit 27 extracts the face image of the person extracted from the photographed images around and inside the vehicle 1 and the face of the registered user of the vehicle 1 recorded in the user registration information 32. By checking with the image, it is determined whether there is a suspicious person in the vicinity of the vehicle 1 or in the vehicle.

In subsequent step S<b>16 , the second suspicious person handling unit 28 detects communication terminals existing near or inside the vehicle 1 from the communication status of the communication unit 130 . Then, in the next step S17, the second suspicious person handling unit 28 retrieves the identification code of the detected communication terminal and the identification code of the user terminal of the registered user of the vehicle 1 recorded in the user registration information 32. By collation, it is determined whether there is a suspicious person in the vicinity of the vehicle 1 or in the vehicle.

In the next step S<b>17 , the mobile unit status notification unit 24 transmits the mobile unit status notification to the user terminal 150 . As described above, the moving body status notification includes information such as temperature and rainfall near the vehicle 1, captured images around and inside the vehicle 1, presence or absence of a suspicious person near or inside the vehicle 1, and the like. The vehicle status screen 210 (see FIG. 1) including these information is displayed on the user terminal 150 that has received the mobile status notification.

In step S18 of FIG. 6, when the rainfall amount near the vehicle 1 recognized by the mobile body situation recognition unit 22 is greater than or equal to the predetermined rainfall amount, the first moving body evacuation support unit 25 advances the process to step S30 to 1 is automatically moved to the indoor parking lot, and the process proceeds to step S19. This movement is executed under the control of the vehicle ECU 141 as described above.

In subsequent step S19, when the temperature in the vicinity of the vehicle 1 recognized by the mobile body situation recognition unit 22 is equal to or lower than the low temperature threshold, the second moving body evacuation support unit 26 advances the predetermined process to step S40, and the vehicle 1 is automatically moved to an indoor parking lot. If the vehicle 1 has already moved to the indoor parking lot by the process of step S30, the process of step S40 is omitted. In the next step S41, the second moving body evacuation support unit 26 sprays the snow-melting agent around the vehicle 1 using the spray unit 142, and the process proceeds to step S21.

In step S20, when the temperature in the vicinity of the vehicle 1 recognized by the mobile body situation recognition unit 22 is equal to or lower than the high temperature threshold, the second moving body evacuation support unit 26 advances the process to step S50 to move the vehicle 1. It is automatically moved to an indoor parking lot, and the process proceeds to step S2. If the vehicle 1 has already moved to the indoor parking lot by the process of step S30, the process of step S50 is omitted.

In step S21, the first suspicious person handling unit 27 advances the process to step S60 when a suspicious person is recognized by the process of step S14 described above. Further, when the second suspicious person handling unit 28 recognizes a suspicious person by the process of step S16 described above, the process proceeds to step S60. In step S60, the first suspicious person handling unit 27 or the second suspicious person handling unit 28 activates the light 113 and the horn 112 to warn the suspicious person. In the next step S<b>61 , the first suspicious person handling section 27 or the second suspicious person handling section 28 sprays tear gas from the spray unit 142 .

[6. Other embodiments]
In the above embodiment, the four-wheeled vehicle 1 is illustrated as a mobile body of the present invention, but the present invention can be applied to various riding mobile bodies such as two-wheeled vehicles, aircraft, and boats.

In the above-described embodiment, the mobile body status notification reception unit 23 inquires whether or not the mobile body information notification Csi is necessary by displaying the reception screen 200 on the touch panel 90 of the vehicle 1. However, the guidance voice is output from the speaker 91. By doing so, it may be possible to inquire whether or not the mobile unit status notification Csi is necessary. Alternatively, the reception screen 200 may be displayed and the guidance voice may be output to inquire whether or not the mobile status notification Csi is necessary.

In the above-described embodiment, as the mobile object status of the present disclosure, the temperature and amount of rain near the vehicle 1, which is a mobile object, the image captured by the camera around and inside the vehicle 1, and the communication status with a communication terminal near the vehicle 1 recognized. As another embodiment, only some of these mobile statuses may be recognized and transmitted in the mobile status notification, rather than all of them. Alternatively, a detection target other than these mobile object conditions may be set as the mobile object condition.

In the above-described embodiment, the information notification system 10 is configured to include the first moving body evacuation support unit 25 and the second moving body evacuation support unit 26. However, the first moving body evacuation support unit 25 and the second moving body evacuation support unit A configuration in which only one of the corresponding units 26 is provided may be employed. Alternatively, the first moving body evacuation support section 25 and the second moving body evacuation support section 26 may be omitted.

In the above-described embodiment, the information notification system 10 has the first suspicious person handling unit 27 and the second suspicious person handling unit 28 . It is good also as a structure provided with only either one. Alternatively, the first suspicious person handling section 27 and the second suspicious person handling section 28 may be omitted.

Although the information notification system 10 is installed in the vehicle 1 in the above embodiment, the information notification system 10 may be configured by the vehicle management server 600 . In this case, the computer that constitutes the vehicle management server 600 executes a program corresponding to the information notification program 31 so that the user behavior recognition unit 21, the mobile unit situation recognition unit 22, the mobile unit situation notification reception unit 23, It functions as a mobile status notification unit 24 , a first mobile evacuation response unit 25 , a second mobile evacuation response unit 26 , a first suspicious person response unit 27 , and a second suspicious person response unit 28 . Then, the vehicle management server 600 receives the detection information of the detection unit transmitted from the vehicle 1 , recognizes the status of the vehicle 1 , and transmits mobile body status notification to the user terminal 150 .

Also, a user action recognition unit 21, a mobile object situation recognition unit 22, a mobile object condition notification reception unit 23, a mobile object condition notification unit 24, a first mobile object evacuation correspondence unit 25, a second mobile object evacuation correspondence unit 26, a The information notification system 10 may be configured by distributing the first suspicious person handling unit 27 and the second suspicious person handling unit 28 to the vehicle management server 600 and the vehicle 1 .

It should be noted that FIG. 3 is a schematic diagram showing the functional configuration of the information notification system 10 divided according to the main processing content, in order to facilitate understanding of the present invention. It may be configured by the division of Also, the processing of each component may be executed by one hardware unit or may be executed by a plurality of hardware units. Also, the processing by each component shown in FIGS. 4 to 6 may be executed by one program or may be executed by a plurality of programs.

[7. Configuration supported by the above embodiment]
The above embodiment is a specific example of the following configuration.

(Section 1) Based on the detection situation by the user behavior recognition unit that recognizes the behavior of the user riding on the moving body and the detection unit provided in the moving body, the inside of the moving body or the moving body When the mobile object situation recognition unit that recognizes the situation of the mobile object, which is the situation around the body, and the user behavior recognition unit recognize an action that the user is expected to get off the mobile object, the Mobile body status notification reception for receiving notification of the mobile body status by outputting notification necessity confirmation information for inquiring whether or not mobile body status notification for notifying the mobile body status is required from an output device used in the mobile body and when the execution of the mobile body status notification is received by the mobile body status notification receiving part, the mobile body status recognition part recognizes the mobile body status and sends the mobile body status notification to the an information notification system comprising: a mobile unit status notification unit that transmits information to a user terminal used by a user.
According to the information notification system of item 1, with a simple configuration of transmitting the mobile body situation recognized by utilizing the detection unit provided in the mobile body to the user terminal, after getting off the mobile body It is possible to notify the user of the situation inside or around the moving object, which can be expected to be useful information for the user.

(Section 2) In the first term, the mobile object situation recognition unit uses a raindrop sensor provided in the mobile object as the detection unit, and recognizes the amount of rain detected by the raindrop sensor as the mobile object condition. The information notification system described.
According to the information notification system of item 2, the rainfall situation at the point where the mobile body is located is notified to the user who gets off the mobile body and is away from the mobile body, and then returns to the mobile body. It is possible to prompt the user to deal with the sudden rainfall.

(Section 3) When the mobile body status notification receiving unit accepts the mobile status notification and the mobile body status recognition unit recognizes rainfall equal to or greater than a predetermined amount, the mobile body is moved to a predetermined location. 3. The information notification system according to claim 2, comprising a first moving body evacuation support section that executes processing for moving the mobile body to the .
According to the information notification system of item 3, when the amount of rainfall at the point where the mobile body is located increases, the process for moving the mobile body to a predetermined place such as indoors is executed. can be protected.

(Section 4) The moving body situation recognition unit uses a temperature sensor provided in the moving body as the detection unit, and recognizes the temperature detected by the temperature sensor as the moving body situation from the first term The information notification system according to any one of items 3 to 3.
According to the information notification system of item 4, the temperature situation at the point where the moving body is located is notified to the user who gets off the moving body and is in a place away from the moving body, and then returns to the moving body. The user can be urged to cope with the cold or heat of the day.

(Section 5) When the moving object status notification receiving unit accepts the mobile object condition notification and the moving object condition recognition unit recognizes a temperature equal to or higher than the upper limit temperature or lower than the lower limit temperature, the movement 5. The information notification system according to claim 4, comprising a second moving body evacuation support section that executes processing for moving the body to a predetermined location.
According to the information notification system of item 5, when the temperature at the point where the mobile object is located is high or low, the process for moving the mobile object to a predetermined place such as indoors is executed. , can protect the moving body.

(Section 6) The mobile object situation recognition unit uses a camera provided on the mobile object as the detection unit, and recognizes an image captured by the camera as the mobile object situation of items 1 to 5. The information notification system according to any one of the items.
According to the information notification system of item 6, by transmitting to the user terminal an image of the interior of the mobile body or the surroundings of the mobile body photographed by the camera provided on the mobile body, it is possible to It is possible to notify the user of the surrounding conditions of the body.

(Section 7) An image of a person having a predetermined characteristic is extracted from the photographed image recognized by the mobile body situation recognition unit after receiving the mobile body status notification by the mobile body status notification reception unit. 7. The information notification system according to claim 6, comprising a first suspicious person handling unit that executes processing for activating an alarm device provided in the moving object when the alarm is detected.
According to the information notification system of item 7, when it is presumed that a suspicious person or the like is inside or near the moving body from the image taken by the camera, the alarm provided in the moving body is activated. be able to.

(Section 8) The mobile body situation recognition section uses a communication unit provided in the mobile body as the detection section to detect the communication status between the communication unit and a communication terminal existing in the vicinity of the mobile body, 5. The information notification system according to any one of items 1 to 4, wherein the information notification system is recognized as the mobile state.
According to the eighth information notification system, by notifying the user terminal of the communication status with the communication terminal existing in the vicinity of the mobile body, it is possible to detect that there is a pedestrian or the like carrying a communication terminal near the mobile body. can be recognized by the user.

(Section 9) Identification information of the communication terminal is registered in advance from the communication status recognized by the mobile status notification receiving unit, and the mobile status notification receiving unit accepts the mobile status notification. 9. The information notification system according to claim 8, comprising a second suspicious person handling unit that executes processing for activating an alarm device provided in the mobile object when the information is recognized as other than the identification information.
According to the information notification system in Clause 9, based on the communication status with the communication unit of the mobile, it is presumed that a suspicious person, etc. possessing a communication terminal with unregistered identification information is in the vicinity of the mobile. An alarm device provided in the moving body can be activated when the vehicle is activated.

(Section 10) An information notification method executed by a computer, comprising a user action recognition step of recognizing actions of a user on board a mobile object, and detection status by a detection unit provided on the mobile object. When the user gets off the mobile body, the mobile body situation recognition step recognizes the mobile body situation, which is the situation inside or around the mobile body, and the user action recognition step based on When the estimated behavior is recognized, notification necessity confirmation information for inquiring whether or not to notify the status of the mobile body is output from the output device used in the mobile body, and the movement is performed. a moving body status notification receiving step for receiving implementation of the mobile body status notification; a mobile status notification step of recognizing and transmitting said mobile status notification to a user terminal used by said user.
By executing the information notification method of item 10 by a computer, it is possible to obtain the same effects as the information notification system of item 1 above.

1 Vehicle (mobile body) 10 Information notification system 20 Processor 21 User action recognition unit 22 Mobile condition recognition unit 23 Mobile condition notification reception unit 24 Mobile condition notification unit , 25 . User registration information 90 Touch panel (output device) 91 Speaker (output device) 110 Temperature sensor 111 Raindrop sensor 112 Horn (alarm device) 113 Light (alarm device) 150 User terminal.

Claims (10)

a user behavior recognition unit that recognizes behavior of a user on board a mobile object;
a moving body situation recognition unit that recognizes a moving body situation, which is a situation inside or around the moving body, based on a detection situation by a detection unit provided in the moving body;
Notification necessity confirmation information for inquiring whether or not mobile body status notification for notifying the status of the mobile body is required when the user action recognition unit recognizes an action that the user is estimated to get off the mobile body. from an output device used in the mobile body, and a mobile body status notification receiving unit that receives implementation of the mobile body status notification;
When the execution of the mobile status notification is accepted by the mobile status notification receiving unit, the mobile status recognition unit recognizes the mobile status, and the mobile status notification is sent by the user. a mobile unit status notification unit that transmits to the user terminal used;
Information notification system. 2. The information notification system according to claim 1, wherein the moving object situation recognition unit uses a raindrop sensor provided in the moving object as the detection unit, and recognizes rainfall detected by the raindrop sensor as the mobile object situation. . for moving the mobile object to a predetermined location when the mobile object status notification receiving unit accepts the mobile object status notification and the mobile object condition recognition unit recognizes rainfall equal to or greater than a predetermined amount; 3. The information notification system according to claim 2, further comprising a first mobile evacuation support unit that executes processing. 4. The moving object situation recognition unit uses a temperature sensor provided in the moving object as the detecting unit, and recognizes a temperature detected by the temperature sensor as the moving object situation. The information notification system according to any one of items 1 and 2. When the moving body status notification receiving unit receives the notification of the moving body status and the moving body status recognition part recognizes a temperature equal to or higher than the upper limit temperature or lower than the lower limit temperature, the mobile body is moved to a predetermined place. 5. The information notification system according to claim 4, further comprising a second mobile evacuation support unit that executes processing for moving. 6. The mobile object situation recognition unit uses a camera provided on the mobile object as the detection unit, and recognizes an image captured by the camera as the mobile object situation. The information notification system described in . When the implementation of the mobile status notification is accepted by the mobile status notification receiving unit and an image of a person having a predetermined characteristic is extracted from the captured image recognized by the mobile status recognition unit, 7. The information notification system according to claim 6, further comprising a first suspicious person handling unit that executes processing for activating an alarm device provided in said moving body. The mobile object situation recognition unit uses a communication unit provided in the mobile object as the detection unit, and recognizes a communication condition between the communication unit and a communication terminal existing in the vicinity of the mobile object as the mobile object condition. The information notification system according to any one of claims 1 to 4, wherein the information notification system recognizes. Implementation of the mobile status notification is accepted by the mobile status notification receiving unit, and from the communication status recognized by the mobile status recognition unit, the identification information of the communication terminal other than the pre-registered identification information 9. The information notification system according to claim 8, further comprising: a second suspicious person handling unit that, when a certain situation is recognized, executes processing for activating an alarm device provided in the mobile object. A computer-implemented information notification method comprising:
a user action recognition step of recognizing actions of a user boarding a mobile object;
a moving body situation recognition step of recognizing a moving body situation, which is a situation inside or around the moving body, based on a detection situation by a detection unit provided in the moving body;
Notification necessity confirmation information for inquiring whether or not mobile body status notification for notifying the status of the mobile body is required when the user behavior recognition step recognizes the behavior that the user is estimated to get off the mobile body. from an output device used in the mobile body, and a mobile body status notification receiving step of receiving implementation of the mobile body status notification;
When execution of the mobile status notification is accepted by the mobile status notification receiving step, the mobile status is recognized by the mobile status recognition step, and the mobile status notification is sent by the user. a mobile unit status notification step for transmitting to the user terminal used;
Information notification method including;

Images