JP7013407B2 - Vehicle management system - Google Patents

Description

The present invention relates to a vehicle management system.

Conventionally, there is a technique for estimating a user's emotion. Patent Document 1 discloses a technique for estimating a user's emotion in a vehicle. The information presenting device of Patent Document 1 estimates the emotions of passengers when the vehicle is a taxi, and if the passengers have feelings of fear, limits the speed without notifying the driver, makes the accelerator heavier, or makes the accelerator heavier. , Controls such as switching to automatic operation.

JP-A-2017-73107

Here, it is desired that a passenger's request can be appropriately grasped in a shared vehicle in which a plurality of passengers ride. The passenger may wish to convey the request to the vehicle side without the knowledge of other passengers. For example, if the vehicle side wants the passengers who are doing annoying acts to be careful, if the request can be communicated to the vehicle side without being known by other passengers, the convenience of the shared vehicle will be improved. do.

An object of the present invention is to provide a vehicle management system capable of communicating a request to a vehicle side without the passengers being known to other passengers.

The vehicle management system of the present invention is provided in a shared vehicle, and is an image pickup device that images a plurality of passengers on the vehicle, and one of the plurality of passengers based on the image pickup result by the image pickup device. A detection unit that detects that a user has performed a predetermined operation, which is a pre-registered operation, and a command registered in advance as a command corresponding to the predetermined operation when the predetermined operation is detected. It is characterized by including a control unit that controls the vehicle based on a predetermined command.

The vehicle management system according to the present invention is provided in a shared vehicle, and is an image pickup device that images a plurality of passengers on the vehicle, and a user who is one of the plurality of passengers based on the image pickup result by the image pickup device. Is based on a detection unit that detects that a predetermined operation is performed, which is a pre-registered operation, and a predetermined command, which is a command registered in advance as a command corresponding to the predetermined operation when the predetermined operation is detected. It is provided with a control unit for controlling the vehicle. According to the vehicle management system according to the present invention, by performing a predetermined operation registered in advance, it is possible to convey a request to the vehicle side without being known to other passengers.

FIG. 1 is a block diagram of a vehicle management system according to an embodiment. FIG. 2 is a perspective view of a main part of the vehicle according to the embodiment. FIG. 3 is a cross-sectional view of the vehicle according to the embodiment. FIG. 4 is a layout diagram of the in-vehicle system according to the embodiment. FIG. 5 is a flowchart relating to the registration of a predetermined operation in the embodiment. FIG. 6 is a flowchart relating to vehicle control in the embodiment. FIG. 7 is another flowchart relating to vehicle control in the embodiment.

Hereinafter, the vehicle management system according to the embodiment of the present invention will be described in detail with reference to the drawings. The present invention is not limited to this embodiment. In addition, the components in the following embodiments include those that can be easily assumed by those skilled in the art or those that are substantially the same.

[Embodiment]
An embodiment will be described with reference to FIGS. 1 to 7. The present embodiment relates to a vehicle management system. 1 is a block diagram of a vehicle management system according to an embodiment, FIG. 2 is a perspective view of a main part of a vehicle according to an embodiment, FIG. 3 is a sectional view of a vehicle according to an embodiment, and FIG. 4 is an embodiment. A layout diagram of the in-vehicle system, FIG. 5 is a flowchart relating to registration of a predetermined operation in the embodiment, FIG. 6 is a flowchart relating to vehicle control in the embodiment, and FIG. 7 is another flowchart relating to vehicle control in the embodiment. be.

As shown in FIG. 1, the vehicle management system 1 according to the embodiment includes an in-vehicle system 2 and a center system 3. The in-vehicle system 2 is a system arranged in the vehicle 100. The vehicle 100 according to the embodiment is a shared ride vehicle (ride share vehicle), and is a vehicle in which a plurality of passengers who wish to share a ride are carried together. The vehicle 100 makes each passenger board the desired drop-off point. The vehicle 100 may have each passenger boarded at a boarding point designated by the passenger, or may have passengers boarded at a predetermined boarding point.

The vehicle 100 of the present embodiment is an automatic traveling vehicle that automatically travels. That is, the vehicle 100 can travel with only passengers on board without the driver being on board.

As shown in FIGS. 3 and 4, the vehicle 100 has a plurality of seats S. The plurality of seats S are arranged along the vehicle front-rear direction and the vehicle width direction. As shown in FIG. 4, the seat S arranged at the front of the vehicle 100 has a first seat S1 and a second seat S2. The first seat S1 is a seat S arranged in the front right portion of the vehicle interior IN. The second seat S2 is a seat S arranged at the left front portion in the vehicle interior IN. The passenger is seated in one of the plurality of seats S. In the following description, the passenger seated in the seat S is referred to as "passenger P". Further, the passenger seated in the first seat S1 is described as "first passenger P1", and the passenger seated in the second seat S2 is described as "second passenger P2".

As shown in FIG. 1, the in-vehicle system 2 includes a system control unit 4, a vehicle control processing unit 5, an image processing unit 6, an audio output processing unit 7, a directional speaker 8, a speaker 9, a personal display 10, and a display 11. It has a hand button 12, a camera 13, and a communication device 14.

The system control unit 4 controls the vehicle 100 in an integrated manner. The system control unit 4 is, for example, an electronic control device. The system control unit 4 has a calculation unit, a storage unit, an interface, and the like. The system control unit 4 is communicably connected to each unit constituting the in-vehicle system 2.

The vehicle control processing unit 5 controls various operations of the vehicle 100. The vehicle control processing unit 5 executes, for example, travel control of the vehicle 100 and control of opening and closing the door of the vehicle 100. The vehicle control processing unit 5 controls various actuators provided in the vehicle 100 based on a command from the system control unit 4. The actuator provided in the vehicle 100 includes an actuator for driving a vehicle, an actuator for braking, an actuator for steering, an actuator for opening and closing a door, and the like. The vehicle control processing unit 5 can automatically drive the vehicle 100. The vehicle control processing unit 5 acquires information from various sensors and navigation devices arranged in the vehicle 100, controls the actuator based on the acquired information, and automatically drives the vehicle 100.

The image processing unit 6 executes image processing on the image captured by the camera 13. More specifically, the image processing unit 6 detects the movements of the plurality of passengers P who are on the vehicle 100 based on the image captured by the camera 13. The movement of the passenger P includes the posture of the passenger P, the direction of the face, the direction of the line of sight, and the like. The information of the detection result of the image processing unit 6 is transmitted to the system control unit 4.

The voice output processing unit 7 processes the voice output in the vehicle 100. The voice output processing unit 7 generates a voice signal to be output from the directional speaker 8 or the speaker 9, for example, based on the voice data stored in advance. The information of the processing result by the voice output processing unit 7 is sent to the system control unit 4.

One directional speaker 8 and one personal display 10 are provided for each passenger P of the vehicle 100. The speaker 9 and the display 11 are common devices provided for a plurality of passengers P. As shown in FIGS. 2 to 4, the first module 21 and the second module 22 are arranged in the vehicle 100. The first module 21 is a common module provided for a plurality of passengers P. The first module 21 of this embodiment is common to all passengers P, and is provided only once in the vehicle 100. The second module 22 is a personal module provided for each passenger P one by one. That is, the second module 22 is arranged in the same number as the number of seats S arranged in the vehicle 100.

The first module 21 and the second module 22 are arranged on the roof member (roof) RF of the vehicle 100. The roof member RF is supported by the body body BO of the vehicle 100 via the pillar PL. The first module 21 and the second module 22 are fixed to the vehicle interior side of the roof member RF. The first module 21 is arranged in the center of the front part of the roof member RF. The second module 22 is arranged corresponding to each seat S. The second module 22 has a right front module 22A and a left front module 22B.

The right front module 22A is the second module 22 corresponding to the first seat S1 among the plurality of second modules 22 possessed by the vehicle 100. The right front module 22A is arranged on the front right side of the roof member RF. The left front module 22B is the second module 22 corresponding to the second seat S2. The left front module 22B is arranged on the front left side of the roof member RF.

As shown in FIG. 4, the first module 21 includes a speaker 9, a display 11, a camera 13, and a microphone 15. The speaker 9 outputs sound to all passengers P of the vehicle 100. The display 11 is arranged so as to face the rear of the vehicle. The display 11 displays an image toward all passengers P. The display 11 is arranged, for example, at a position visible to all passengers P.

The camera 13 is an image pickup device that captures an image of the vehicle interior IN. The camera 13 is arranged above the display 11 in the first module 21. The camera 13 is arranged so as to face the rear of the vehicle, and images the rear of the camera 13 in the vehicle interior IN. The camera 13 is configured to be capable of capturing, for example, all passengers P. For example, the arrangement and angle of view of the camera 13 are set so that the faces and upper bodies of all passengers P can be imaged. The camera 13 may perform imaging in response to an imaging command from the system control unit 4, or may perform imaging automatically and continuously. The camera 13 of the present embodiment is, for example, a video camera, and captures a moving image of the vehicle interior IN.

The microphone 15 is a microphone that collects the sound of the vehicle interior IN. The microphone 15 is configured to detect, for example, the voices of all passengers P. The microphone 15 is arranged so as to face the rear of the vehicle.

The second module 22 has a directional speaker 8 and a personal display 10. The directional speaker 8 is a speaker that outputs directional sound. For example, the directional speaker 8 of the right front module 22A is configured to output directional voice targeting the first passenger P1. That is, the directional speaker 8 of the right front module 22A outputs the directional sound so that the passengers P other than the first passenger P1 cannot hear the sound. Similarly, the directional speaker 8 of the left front module 22B is configured to output directional audio for the second passenger P2. The directional speaker 8 may be arranged in the headrest or the like of each seat S instead of being arranged in the second module 22.

The personal display 10 is a personal display device arranged for each passenger P. For example, the personal display 10 of the right front module 22A is a dedicated display for the first passenger P1. The personal display 10 may be configured so that the image cannot be seen by the passenger P other than the target passenger P. For example, the personal display 10 of the right front module 22A may output directional display light so that the image cannot be seen by the passengers P except the first passenger P1.

The hand button 12 is a button arranged at the hand of each passenger P. The hand button 12 may be provided in each seat S, for example, or may be arranged in the vicinity of each seat S in the body body BO. The passenger P can issue a command or a request to the in-vehicle system 2 by the hand button 12.

The communication device 14 is a wireless communication device that transmits / receives radio waves to / from the center system 3. The communication device 14 may directly communicate with the communication device 34 of the center system 3, or may communicate with the communication device 34 via relay by a base station or relay by another vehicle 100. The communication between the communication device 14 of the in-vehicle system 2 and the communication device 34 of the center system 3 may include wired communication.

The center system 3 includes a system control unit 31, a monitor 32, a microphone 33, and a communication device 34. The center system 3 is a system that manages a plurality of vehicles 100. The center system 3 acquires information such as the current position of the vehicle 100 and the presence / absence of the occupant P from each vehicle 100 by communication. The center system 3 can also acquire image data captured by the camera 13 from each vehicle 100 and monitor the state of the vehicle interior IN of the vehicle 100. In addition, the center system 3 transmits information about passengers scheduled to board to each vehicle 100 by communication. The center system 3 may have a camera that captures an image of the center observer 300, which will be described later.

The monitor 32 displays information for monitoring the vehicle 100. The monitor 32 displays, for example, an image captured by the camera 13. The monitor 32 can display information about a plurality of vehicles 100 or can display information about a specific vehicle 100. The vehicle 100 is monitored by a center watchman 300. The microphone 33 picks up the voice of the center observer 300. The microphone 33 may be provided on the headset worn by the center observer 300. The center watchman 300 can talk to the occupant P of the vehicle 100, for example, via a headset.

The center observer 300 operates the center system 3 to monitor each vehicle 100. For example, when a response request is made from the vehicle 100, the center observer 300 corresponds to the passenger P of the vehicle 100. Further, the center observer 300 monitors the vehicle 100 when an abnormality or the like is detected in the vehicle 100. Further, when the vehicle 100 detects that the passenger P is in trouble, the center observer 300 may send an individual message to the passenger P.

The operation of the vehicle management system 1 according to the present embodiment will be described with reference to FIGS. 5 and 6. FIG. 5 shows a procedure for the user 200 using the vehicle 100 to register a signal. The user 200 who uses the vehicle 100 of the present embodiment can make a request or a command to the vehicle management system 1 by a signal other than voice. The user 200 can register the operation (signal) corresponding to the request or the command in the vehicle management system 1 in advance.

In the following description, the operation registered in advance by the user 200 is referred to as "predetermined operation". The predetermined operation is associated with a command to the vehicle management system 1. The user 200 registers in advance a command for the vehicle 100 by a predetermined operation in the vehicle management system 1. In the following description, a command registered by the user 200 and registered in advance as a command corresponding to a predetermined operation is referred to as a “predetermined command”.

The user 200 registers a predetermined operation and a predetermined command using, for example, the smartphone 201. As shown in FIG. 1, the in-vehicle system 2 and the center system 3 of the embodiment can communicate with the smartphone 201. The communication between the in-vehicle system 2 and the smartphone 201 is performed by, for example, short-range wireless communication. Communication between the center system 3 and the smartphone 201 is performed using, for example, a communication line of a communication company.

In the vehicle management system 1 of the present embodiment, the center system 3 accepts registration of predetermined operations and predetermined commands. The registration operation is executed by, for example, an application of the smartphone 201. In this application, as shown in step S10 of FIG. 5, personal information such as the name and address of the user 200 is registered. The personal information entered in the application is transmitted to the center system 3. The center system 3 assigns a user ID to the user 200 and stores personal information in association with the user ID.

Next, as shown in step S20, a photograph of the face of the user 200 is registered. The user 200 captures his / her face with the camera of the smartphone 201 and generates face image data. The user 200 specifies the face image data to be transmitted in the application. At this time, a plurality of face image data captured in different directions may be transmitted. For example, in addition to the image obtained by capturing the face of the user 200 from the front, an image obtained by capturing the face from an oblique direction may be transmitted. The designated face image data is transmitted from the smartphone 201 to the center system 3. The center system 3 stores face image data in association with the user ID. The in-vehicle system 2 identifies the user 200 based on the face image data.

Next, in step S30, it is confirmed whether or not to register the data for gesture and lip surgery. In the present embodiment, gestures and mouth movements can be registered as predetermined movements. That is, in step S30, it is confirmed whether or not to register the predetermined operation. When the user 200 specifies in step S30 to register the predetermined operation (S30-Y), the process proceeds to step S40, and when it is specified not to register the predetermined operation (S30-N), the control flow ends.

In step S40, the user 200 registers a predetermined operation. The user 200 shoots a moving image of a predetermined operation by the smartphone 201. In this case, the user 200 performs a predetermined operation and shoots a moving image of the user 200 performing the operation. The user 200 specifies the moving image data to be transmitted in the application. One moving image data corresponds to, for example, one predetermined operation. In this case, when registering a plurality of predetermined operations, a plurality of moving image data are transmitted. Further, the user 200 specifies a command corresponding to a predetermined operation. A command that can be associated with a predetermined operation is prepared in advance by, for example, the vehicle management system 1.

The commands that can be selected include, for example, a command from the vehicle 100 to alert another occupant P who is annoying. In the following description, a command for alerting another passenger P who causes annoying acts from the vehicle 100 is referred to as a "first predetermined command". Further, the predetermined operation for executing the first predetermined command is referred to as "first predetermined operation".

The commands that can be selected may include commands that change the drop-off point of the user 200. The command to change the disembarkation point may be, for example, a command to change the disembarkation point from the nearest toilet to a nearby point. In the following description, the command to change the drop-off point is referred to as a "second predetermined command". Further, the predetermined operation for executing the second predetermined command is referred to as "second predetermined operation".

The commands that can be selected may include commands that promptly stop the vehicle 100. The command to stop the vehicle 100 promptly is referred to as a "third predetermined command". Further, the predetermined operation for executing the third predetermined command is referred to as "third predetermined operation".

The commands that can be selected may include commands that notify the center observer 300. This notification may be, for example, a notification requesting individual communication with the user 200, or a notification notifying that a trouble has occurred in the vehicle interior IN. The command to notify the center observer 300 from the vehicle 100 is referred to as a "fourth predetermined command". Further, the predetermined operation for executing the fourth predetermined command is referred to as "fourth predetermined operation".

The user 200 specifies in the application a combination of the moving image data of the predetermined operation and the predetermined command corresponding to the predetermined operation. The moving image data and the corresponding predetermined command are transmitted to the center system 3. The center system 3 stores a combination of moving image data of a predetermined operation and a predetermined command corresponding to the predetermined operation in association with the user ID. For example, the center system 3 stores the first predetermined operation and the first predetermined command in association with each other, and stores the second predetermined operation and the second predetermined command in association with each other. When step S40 is completed, this control flow ends.

When the user 200 uses the vehicle 100, the user 200 makes a reservation for use in the center system 3. The usage reservation is made, for example, by the application of the smartphone 201. The user 200 registers reservation information such as a usage date, a boarding place, a boarding time, a disembarkation place, and a disembarkation time in the center system 3. The center system 3 stores reservation information in association with the user ID. The center system 3 allocates the vehicle 100 based on the reservation information. The center system 3 transmits the user ID, reservation information, predetermined operation information, and predetermined command of the user 200 to the vehicle 100 assigned to the user 200. The information of the predetermined operation may be the moving image data itself registered by the user 200, or may be information extracted from the moving image data, that is, information for detecting the predetermined operation from the image.

The vehicle 100 stops at the designated boarding place at the boarding time designated by the reservation information. The user 200 authenticates the user when he / she gets on the vehicle 100. User authentication is performed, for example, by an application on the smartphone 201. For example, a user ID and reservation information are transmitted from the smartphone 201 to the in-vehicle system 2. The in-vehicle system 2 confirms that the reserved user 200 has boarded based on the received information. The predetermined operation and the transmission of the predetermined command from the center system 3 to the in-vehicle system 2 may be performed at the same time as the transmission of the reservation information, or may be performed after the boarding of the user 200 is confirmed. Alternatively, the predetermined operation and the predetermined command may be transmitted from the smartphone 201 to the in-vehicle system 2 when performing user authentication.

When the user 200 is seated in the seat S, the seating position is confirmed. The seating position is confirmed, for example, based on the result of image processing by the image processing unit 6. The system control unit 4 passes the face image data of the user 200 to the image processing unit 6, for example. The image processing unit 6 determines which seat S the user 200 is seated in based on the image captured by the camera 13. The image processing unit 6 sends the position of the seat S in which the user 200 is seated to the system control unit 4 based on the determination result.

With reference to FIG. 6, the operation of the vehicle management system 1 when the user 200 uses the vehicle 100 will be described. In step S110 of FIG. 6, the user 200 gets on the vehicle 100. The vehicle 100 authenticates the user as described above, and identifies the seat S in which the user 200 is seated. In the following description, it is assumed that the user 200 is sitting in the left front seat S2. That is, the user 200 is on the vehicle 100 as the second passenger P2.

Next, in step S120, a situation occurs in which the user 200 wants to notify the vehicle management system 1. For example, it is assumed that the user 200 feels annoyed, for example, the first passenger P1 of the first seat S1 is speaking loudly. In this case, the user 200 wants the first passenger P1 to pay attention from the vehicle 100. However, we do not want the first passenger P1 to know that the person who made the attention is the user 200. As described below, the vehicle management system 1 of the present embodiment can issue a command to the vehicle 100 without being known to the other passenger P.

In step S130, the user 200 performs a predetermined operation registered in advance. The predetermined operation performed here is the first predetermined operation. The first predetermined movement may be, for example, a gesture, a movement of the mouth, a specific shape of the mouth, or another movement.

In step S140, the in-vehicle system 2 determines whether or not a predetermined operation has been detected. When the user 200 gets on board, the system control unit 4 sends information about the predetermined operation of the user 200 to the image processing unit 6. The image processing unit 6 determines whether or not a predetermined operation of the user 200 is detected based on the image data captured by the camera 13. When the predetermined operation of the user 200 is detected, the image processing unit 6 sends the detected predetermined operation to the system control unit 4. For example, when the first predetermined operation by the user 200 is detected, the image processing unit 6 informs the system control unit 4 that the first predetermined operation has been detected. If it is affirmed that a predetermined operation is detected in step S140 (S140-Y), the process proceeds to step S150, and if a negative determination is made (S140-N), the process proceeds to step S120.

In step S150, the system control unit 4 performs control according to the first predetermined command. The system control unit 4 causes the voice output processing unit 7 to prepare voice data for paying attention to annoying acts. The prepared message is, for example, a voice message saying "Please stop annoying other passengers". The system control unit 4 outputs this voice message by the directional speaker 8 or the speaker 9. When the passenger P who is performing annoying acts is specified, a message may be output by the directional speaker 8. For example, if it can be determined that the first passenger P1 is performing a nuisance act, a message may be output by the directional speaker 8 of the right front module 22A.

The system control unit 4 may display characters and images to be careful of annoying acts on the personal display 10 and the display 11. If the nuisance passenger P is identified, a message may be displayed on the personal display 10. For example, if it can be determined that the first passenger P1 is performing a nuisance, a message may be displayed on the personal display 10 of the right front module 22A. When step S150 is executed, this control flow ends.

The vehicle management system 1 of the present embodiment can automatically detect that the passenger P is in trouble even when the predetermined operation is not detected. The operation of automatically detecting the troubled passenger P will be described with reference to FIG. 7. In step S210 of FIG. 7, the user 200 gets on the vehicle 100. The vehicle 100 authenticates the user and identifies the seat S in which the user 200 is seated. The user 200 may or may not have registered the predetermined operation. The user 200 is seated in, for example, the second seat S2. When step S210 is executed, the process proceeds to step S220.

In step S220, the image processing unit 6 detects the operation of the user 200. The image processing unit 6 also detects the operation of the passenger P other than the user 200. When step S220 is executed, the process proceeds to step S230.

In step S230, it is determined whether or not the user 200 is likely to be in trouble. The image processing unit 6 calculates the degree of similarity between the operation detected in step S220 and the sample operation stored in advance. Here, the sample operation is an operation registered as a general operation performed by the troubled passenger P. The sample motion is, for example, a motion of turning away from another passenger P who is performing annoying acts, a motion of frowning, a motion of restlessness, and a fidgeting motion. The sample movement may be a movement in which the posture of the passenger P changes from a relaxed posture to a tense posture.

The image processing unit 6 calculates the degree of similarity between the operation of the user 200 detected in step S220 and the sample operation. When the similarity is high, the image processing unit 6 determines that the user 200 has performed the same operation as the sample operation. The image processing unit 6 transmits the determination result to the system control unit 4. When the system control unit 4 receives from the image processing unit 6 the determination result that the user 200 has performed the same operation as the sample operation, the system control unit 4 determines that the user 200 is likely to be in trouble. If the user 200 is determined to be in trouble in step S230 (S230-Y), the process proceeds to step S240, and if the user 200 is determined to be negative (S230-N), the process proceeds to step S220.

In step S240, the system control unit 4 executes individual communication with the user 200. Here, the individual communication is a secret communication made unknown to the passenger P other than the user 200. For example, the system control unit 4 outputs a voice message to the user 200 by the directional speaker 8. The voice message at this time is, for example, a message such as "If you are in trouble, please tell me by gesture or mouth movement."

When the user 200 has registered a predetermined operation in advance, the user 200 can issue a command to the vehicle 100 by performing the predetermined operation. When the predetermined operation is not detected well or the predetermined operation is not registered, the user 200 may perform the operation presented by the vehicle management system 1. The system control unit 4 informs the user 200 of the operation for communicating the troubled content by individual communication. For example, the system control unit 4 outputs a voice message from the directional speaker 8 stating, "If you feel annoyed by other passengers, look at the camera 13 for 10 seconds." When the system control unit 4 asks the user 200, the process proceeds to step S250.

In step S250, the system control unit 4 determines whether the user 200 is actually in trouble. The system control unit 4 determines whether or not the user 200 is actually in trouble by the operation of the user 200 after the question is made to the user 200. The operation performed in response to the question to the user 200 is referred to as "response operation". For example, when the user 200 keeps looking at the camera 13 for 10 seconds in response to a question, the system control unit 4 determines that the user 200 is actually in trouble. On the other hand, when the user 200 does not continue to look at the camera 13, the system control unit 4 determines that the user 200 is not in trouble. If the user 200 is determined to be in trouble in step S250 (S250-Y), the process proceeds to step S260, and if the user 200 is determined to be negative (S250-N), the process proceeds to step S220.

In step S260, the system control unit 4 executes control according to the response operation of the user 200. The system control unit 4 pays attention to the passenger P who is performing an annoying act according to the response operation in which the user 200 looks at the camera 13 for 10 seconds. The system control unit 4 outputs, for example, a voice message "Please stop annoying other passengers" from the speaker 9 and the directional speaker 8. When step S260 is executed, this control flow ends.

In individual communication with the user 200, the system control unit 4 may display a question to the user 200 on the personal display 10. When the personal display 10 outputs a display light having high directivity, it is possible to ask the user 200 without being known by the other passenger P.

The response operation performed by the user 200 to the question from the system control unit 4 is not limited to the operation of looking at the camera 13. The response operation performed by the user 200 may be, for example, an operation of pressing the hand button 12. For example, depending on the number of times the hand button 12 is pressed, it is possible to notify the troubled content or a command to the vehicle 100. Depending on the number of times the hand button 12 is pressed, "other passengers are noisy and in trouble", "want to go to the toilet", "want to notify the center guard 300", "want to stop immediately", etc. You can send a message.

The question to the user 200 may be made by the center observer 300. In this case, the center observer 300 tells the user 200 to perform a response operation when in trouble. When the user 200 responds to the question, the center observer 300 gives a command to the in-vehicle system 2. For example, when the user 200 performs a response operation indicating that he / she is in trouble due to annoying acts, the center observer 300 instructs the in-vehicle system 2 to pay attention to the annoying acts.

As described above, the vehicle management system 1 according to the present embodiment includes a camera 13, an image processing unit 6, and a system control unit 4. The camera 13 is an image pickup device provided in the vehicle 100 as a shared vehicle. The camera 13 captures a plurality of passengers P who are on board the vehicle 100. The image processing unit 6 functions as a detection unit that detects that the user 200, which is one of the plurality of passengers P, has performed a predetermined operation. The image processing unit 6 detects a predetermined operation based on the image pickup result by the camera 13. The predetermined operation is an operation registered in advance by the user 200.

The system control unit 4 is a control unit that controls the vehicle 100 based on a predetermined command when a predetermined operation is detected. The predetermined command is a command registered in advance as a command corresponding to the predetermined operation. According to the vehicle management system 1 according to the present embodiment, the user 200 can issue a command to the vehicle 100 without being known to the other passenger P.

[Modified example of the embodiment]
The user 200 can also use the smartphone 201 to issue various commands to the vehicle 100 side. For example, the first predetermined command to the fourth predetermined command may be transmitted to the in-vehicle system 2 by the smartphone 201. The user 200 may convey a request to the in-vehicle system 2 by a combination of communication by the smartphone 201 and a predetermined operation.

The contents disclosed in the above-described embodiments and modifications can be combined and executed as appropriate.

1 Vehicle management system 2 In-vehicle system 3 Center system 4 System control unit 5 Vehicle control processing unit 6 Image processing unit 7 Audio output processing unit 8 Directional speaker 9 Speaker 10 Personal display 11 Display 12 Hand button 13 Camera 14 Communication device 15 Mike 21 First module 22 Second module 22A: Right front module, 22B: Left front module 31 System control unit 32 Monitor 33 Mike 34 Communication device 100 Vehicle 200 User 201 Smartphone 300 Center observer P Passenger P1: First passenger, P2: Second passenger S seat S1: Right front seat, S2: Left front seat

Claims (7)

An image pickup device installed in a shared vehicle and capturing images of a plurality of passengers on the vehicle, and an image pickup device.
A detection unit that detects that a user, who is one of the plurality of passengers, has performed a predetermined operation, which is an operation registered by the user in advance, based on the image pickup result by the image pickup device.
A control unit that controls the vehicle based on a predetermined command that is a command registered in advance as a command corresponding to the predetermined operation when the predetermined operation is detected.
A personal module that is provided for each seat of the vehicle and outputs audio or image to the passenger in each seat so as not to be known by the passenger in another seat.
A vehicle management system characterized by being equipped with. The predetermined command is a command for alerting the passenger who causes annoying acts from the vehicle .
The control unit causes the passenger who performs annoying acts to output a message of caution by the personal module.
The vehicle management system according to claim 1. The vehicle management system according to claim 1, wherein the predetermined command is a command for changing the drop-off point of the user. The vehicle management system according to claim 3, wherein the predetermined command is a command to change the disembarkation point from the nearest toilet to a nearby point. When the passenger performs a general operation of the person in need, the control unit asks the passenger whether he / she is actually in trouble by individual communication using the personal module .
The vehicle management system according to any one of claims 1 to 4, wherein the control unit controls the vehicle based on a response operation performed by the passenger in response to a question from the control unit. The individual communication is to inform a specific action to convey that the person is actually in trouble.
The vehicle management system according to claim 5 , wherein the control unit determines that the passenger is in trouble when the response operation is the specific operation, and controls the vehicle based on the response operation . The control unit notifies the passenger of the operation for communicating the troubled content by the individual communication.
When the response operation is an operation for transmitting the troubled content, the control unit controls the vehicle according to the troubled content.
The vehicle management system according to claim 5 .

Images