JP2021149380A - Management device, management method, and program - Google Patents

Abstract

To provide a management device, a management method, and a program for providing a transportation service that can be used more at east.SOLUTION: In a system in which a vehicle, a terminal device, and a management device can communicate with each other via a network, a management device 300 includes a communication unit 310, a front processing unit 320, a transportation schedule determination unit 330, a route determination unit 340, a settlement processing unit 350, and a storage unit 370. The front processing unit 320 includes a reception unit 322, a recognition unit 324, a notification control unit 326, and a detection unit 328. The detection unit 328 detects an inappropriate number of passengers by comparing the number of pieces of first information received from the terminal device by the communication unit 310 with the number of vehicle users U recognized by the recognition unit 324.SELECTED DRAWING: Figure 3

Description

The present invention relates to management devices, management methods, and programs.

An invention relating to a pick-up service using an autonomous vehicle in which a driver does not ride is disclosed (Patent Document 1).

JP-A-2019-79462

In this type of service, it is assumed that an inappropriate user who has not made a reservation for the pick-up service will board the vehicle. When an inappropriate user gets on the vehicle, the appropriate user who has made a reservation for using the pick-up service may not be able to get on the vehicle.

The present invention has been made in consideration of such circumstances, and an object of the present invention is to provide a management device, a management method, and a program capable of grasping that an inappropriate number of passengers are on board. It is one of.

The management device, management method, and program according to the present invention have adopted the following configurations.
(1) The management device of one aspect of the present invention is a management device that manages a service in which a driver runs a vehicle that can autonomously travel without getting on the vehicle and transports a user by the vehicle in a designated section. An acquisition unit that acquires an image captured by the imaging unit in the vehicle interior of the vehicle, and a recognition unit that recognizes the number of users in the vehicle based on the image acquired by the acquisition unit. , The notification control unit that outputs a boarding confirmation notification to the user to the user's first terminal device that is known to be in the vehicle, and the boarding confirmation notification from the first terminal device are used. By comparing the number of the users recognized by the recognition unit with the receiving unit that receives the first information indicating that the person has confirmed, and the number of the first information received by the receiving unit. It is provided with a detection unit that detects an inappropriate number of passengers.

The aspect (2) is the management device according to the above aspect (1), in which the notification control unit sends an inquiry notification to the first terminal device to inquire about the number of users currently in the vehicle. Further output, the receiving unit receives the second information in response to the inquiry notification from the first terminal device, and the detecting unit further outputs an inappropriate number of passengers based on the second information. It is to detect.

The aspect (3) is the management device according to the above aspect (1) or (2), in which the notification control unit informs the first terminal device of the number of users who are scheduled to get on the vehicle. Further notification is given.

The aspect (4) is the management device according to any one of the above aspects (1) to (3), in which the notification control unit gets on the vehicle based on the transportation schedule of the user by the vehicle. Information indicating the number of users estimated to be present is displayed on a display device mounted on the vehicle.

The aspect (5) is the management device according to any one of the above aspects (1) to (4), in which the detection unit provides information to an external device when an inappropriate number of passengers are detected. be.

In the aspect (6), the management device according to any one of the above aspects (1) to (5) relays communication between the second terminal device used by the operator of the service and the first terminal device. The relay unit further includes a relay unit, and when the detection result of the detection unit indicates that the number of the first terminal devices and the number of the first information do not match, the relay unit is currently in the vehicle. It is intended to start communication between at least one of the first terminal devices of the user and the second terminal device.

In the aspect (7), when the management device according to any one of the above aspects (1) to (6) detects that an inappropriate number of passengers are on board by the detection unit, the transportation schedule of the user by the vehicle A penalty is given to a specific unit that identifies an appropriate user and a user other than the appropriate user specified by the specific unit among the users who are in the vehicle. It further includes a granting unit.

(8) The management method of another aspect of the present invention realizes a management device that manages a service in which a driver runs a vehicle that can autonomously travel without getting on the vehicle and transports a user by the vehicle in a designated section. The computer acquires an image captured by the imaging unit in the vehicle interior of the vehicle, recognizes the number of users in the vehicle based on the acquired image, and gets in the vehicle. A boarding confirmation notice to the user is output to the user's first terminal device that is known to be present, and the first information indicating that the user has confirmed the boarding confirmation notice is output from the first terminal device. By comparing the number of received and recognized users with the number of received first information, an inappropriate number of passengers are detected.

(9) The program of another aspect of the present invention realizes a management device that manages a service in which a driver runs a vehicle that can autonomously travel without getting on the vehicle and transports a user by the vehicle in a designated section. The computer is made to acquire an image taken by the imaging unit in the vehicle interior of the vehicle, recognizes the number of users in the vehicle based on the acquired image, and is in the vehicle. The first terminal device of the user who is aware of the fact is made to output the boarding confirmation notice to the user, and the first information indicating that the user has confirmed the boarding confirmation notice is received from the first terminal device. By comparing the number of recognized users with the number of received first information, an inappropriate number of passengers are detected.

According to the above aspects (1) to (9), it is possible to grasp that an inappropriate number of passengers are on board.

It is a block diagram of the system including the management device 300. It is a block diagram of the vehicle 200. It is a block diagram of the management device 300. It is a figure which shows an example of the content of the user information 372. It is a figure which shows an example of the contents of the transportation request list information 374. It is a figure which shows an example of the contents of the transportation schedule information 376. It is a figure which shows an example of the image IMa1 displayed on the terminal device 100 in the boarding confirmation notification. It is a flowchart which shows an example of the flow of the process executed in the management apparatus 300 of embodiment. It is a figure which shows an example of the image IMa2 displayed on the terminal apparatus 100 in the inquiry notification. It is a flowchart which shows an example of the flow of the process executed in the management apparatus 300 of the modification 1. It is a figure which shows an example of the image IMa3 displayed on the terminal device 100 in the notification which informs the number of users U who are going to get on a vehicle 200. It is a figure which shows an example of the vehicle interior which looked at the vehicle 200 from above. It is a figure which shows an example of the image IMa4 displayed on the display device DP in the number-of-person notification. It is a block diagram of the system including the management apparatus 300 which concerns on modification 3. It is a block diagram of the system including the management apparatus 301 which concerns on modification 4. FIG. It is a figure which shows an example of the structure of the management apparatus 301 which concerns on modification 4. It is a figure which shows an example of the structure of the management apparatus 302 which concerns on modification 5. It is a figure which shows an example of the content of the transportation request list information 374a which concerns on modification 5. FIG.

Hereinafter, embodiments of the management device, management method, and program of the present invention will be described with reference to the drawings. The management device is a device that manages a service in which a driver runs a vehicle that can autonomously travel without getting on the vehicle and transports the user by vehicle in a designated section. The designated section is a section designated by a user who gets on the vehicle or another user.

[overall structure]
FIG. 1 is a configuration diagram of a system including a management device 300. This system includes one or more terminal devices 100, one or more vehicles 200, and a management device 300 used by the user. These components can communicate with each other via the network NW. The network NW includes the Internet, WAN (Wide Area Network), LAN (Local Area Network), public line, provider device, dedicated line, wireless base station and the like. The "terminal device used by the user" is a terminal device that can be used by an unspecified number of people, such as a terminal device of an Internet cafe, and may include a terminal device that is temporarily used by the user. In any case, the "user's terminal device" refers to a terminal device in which the user being operated is specified by, for example, a login operation in which a login name is input.

[Terminal device]
The terminal device 100 is, for example, a smartphone, a tablet terminal, a personal computer, or the like. In the terminal device 100, an application program for using the above service, a browser, or the like is started to support the services described below. In the following description, it is assumed that the terminal device 100 is a smartphone and an application program (vehicle dispatch application) for receiving the service is activated. The vehicle dispatch application communicates with the management device 300 according to the operation of the user, transmits a transportation request from the user to the management device 300, and provides information based on the information received from the management device 300. The transportation request is electronic information requesting that the user be transported over a designated section by the vehicle 200. In the example of FIG. 1, two users, users U1 and U2, are illustrated. In the following description, when users U1 and U2 are not distinguished from each other, they are simply described as "user U". The user U is a person who causes the terminal device 100 to send a transportation request for receiving the service. The terminal device 100 is an example of the “first terminal device”.

In addition, the user U also makes a transportation request to receive the service for other users U who use the service together with the user U (for example, the protected person (children, the elderly, etc.) of the user U). The terminal device 100 may make a call. In this case, the other user U does not launch the transportation request by the terminal device 100 owned by the other user U. In this way, there may be users of various aspects.

[vehicle]
The vehicle 200 is a vehicle having at least a passenger compartment. FIG. 2 is a configuration diagram of the vehicle 200. The vehicle 200 includes, for example, a monitoring unit 210, a communication device 220, a navigation device 230, an HMI (Human machine Interface) 238, a vehicle interior monitoring device 240, an authentication device 242, a driving force output device 260, and a brake. It includes a device 262, a steering device 264, a door lock device 266, and an automatic operation control unit 270.

The monitoring unit 210 is, for example, a camera that images the space outside the vehicle 200, a radar or LIDAR (Light Detection and Ranging) that has a detection range outside the vehicle 200, and an object recognition that performs sensor fusion processing based on these outputs. Including equipment and the like. The monitoring unit 210 estimates the types of objects (particularly vehicles, pedestrians, and bicycles) existing around the vehicle 200, and outputs the information of the position and speed to the automatic driving control unit 270.

The communication device 220 is, for example, a wireless communication module for connecting to a network NW or directly communicating with a terminal device of another vehicle or a pedestrian. The communication device 220 performs wireless communication based on Wi-Fi, DSRC (Dedicated Short Range Communications), Bluetooth (registered trademark), and other communication standards. As the communication device 220, a plurality of communication devices 220 may be prepared according to the application.

The navigation device 230 includes, for example, an HMI (Human machine Interface) 232, a GNSS (Global Navigation Satellite System) receiver 234, and a navigation control device 236. The HMI 232 includes, for example, a touch panel display device, a speaker, a microphone, and the like. The GNSS receiver 234 positions its own position (position of the vehicle 200) based on radio waves arriving from a GNSS satellite (for example, a GPS satellite). The navigation control device 236 includes, for example, a CPU (Central Processing Unit) and various storage devices, and controls the entire navigation device 230. Map information (navigation map) is stored in the storage device. A navigation map is a map that expresses roads with nodes and links. The navigation device 230 uses the communication device 220 to upload position information indicating the positioned position to the management device 300. The location information is uploaded periodically, for example, in milliseconds to seconds.

The HMI 238 is an interface device for exchanging information with a user inside or outside the vehicle interior. The HMI 238 includes, for example, input / output interfaces such as a display device, a speaker, a touch panel, a button, a mouse, and a keyboard.

The vehicle interior monitoring device 240 includes, for example, a camera and an infrared sensor that image the space inside the vehicle interior. The image captured by the camera may be uploaded to the management device 300 by the communication device 220. The vehicle interior monitoring device 240 is an example of an "imaging unit" that images the vehicle interior of the vehicle 200.

The authentication device 242 is a device for confirming that the user who intends to get on the vehicle 200 is a legitimate user (authentication of the user). A legitimate user is a user who has an agreement with the management device 300 for boarding. The authentication device 242 may be any device as long as it has an authentication function, such as a short-range wireless communication device, a biometric authentication device, and a password input device. The authentication device 242 outputs the authentication result to the automatic operation control unit 270.

The driving force output device 260 outputs a traveling driving force (torque) for the vehicle to travel to the driving wheels. The driving force output device 260 includes, for example, a combination of an internal combustion engine, a motor, a transmission, and the like, and a power ECU that controls them. The power ECU controls the above configuration according to the information input from the automatic operation control unit 270 or the information input from the operation operator (not shown).

The brake device 262 includes, for example, a brake caliper, a cylinder that transmits flood pressure to the brake caliper, an electric motor that generates flood pressure in the cylinder, and a brake ECU. The brake ECU controls the electric motor according to the information input from the automatic operation control unit 270 or the information input from the operation operator so that the brake torque corresponding to the braking operation is output to each wheel. The brake device 262 may include a mechanism for transmitting the hydraulic pressure generated by the operation of the brake pedal included in the operation operator to the cylinder via the master cylinder as a backup. The brake device 262 is not limited to the configuration described above, and is an electronically controlled hydraulic brake device that controls the actuator according to the information input from the automatic operation control unit 270 to transmit the oil pressure of the master cylinder to the cylinder. May be good.

The steering device 264 includes, for example, a steering ECU and an electric motor. The electric motor, for example, applies a force to the rack and pinion mechanism to change the direction of the steering wheel. The steering ECU drives the electric motor according to the information input from the automatic operation control unit 270 or the information input from the operation operator to change the direction of the steering wheel.

The door lock device 266 locks or unlocks the door provided in the vehicle 200. The door lock device 266 may include a mechanism for automatically opening and closing the door.

The automatic driving control unit 270 includes, for example, a route travel control unit 272, an boarding / alighting position search unit 274, a user recognition unit 276, a boarding / alighting control unit 280, and an HMI control unit 290. The boarding / alighting control unit 280 includes, for example, a stop / start control unit 282 and a door lock control unit 284. These components are realized, for example, by executing a program (software) by a hardware processor such as a CPU (Central Processing Unit). Some or all of these components are hardware such as LSI (Large Scale Integration), ASIC (Application Specific Integrated Circuit), FPGA (Field-Programmable Gate Array), GPU (Graphics Processing Unit) It may be realized by (including circuits), or it may be realized by the cooperation of software and hardware. The program may be stored in advance in a storage device (a storage device including a non-transient storage medium) such as an HDD (Hard Disk Drive) or a flash memory, or a removable storage device such as a DVD or a CD-ROM. It is stored in a medium (non-transient storage medium), and may be installed in the storage device by mounting the storage medium in the drive device.

The route travel control unit 272 controls the driving force output device 260, the brake device 262, and the steering device 264 so that the vehicle 200 travels on the designated route. The route information is received from the management device 300 by the communication device 220. The route information includes information on the boarding position and the getting-off position for each user. For example, the route travel control unit 272 applies the route acquired from the management device 300 to the high-precision map information, and determines the recommended lane in which the vehicle 200 should travel on the route. The high-precision map information is more accurate than the map information held by the navigation device 230, and includes, for example, information such as a road width, a slope, a curvature, and a signal position for each lane. The recommended lane is a lane determined in order to efficiently travel on the route based on a standard such as moving to the left lane before turning left at an intersection or the like.

Then, the route travel control unit 272 automatically travels the vehicle 200 so as to avoid contact with an object whose position and speed are input from the monitoring unit 210, while traveling in the recommended lane in principle. The route travel control unit 272 generates a target track on which the vehicle 200 will travel in the future. The target trajectory includes, for example, a velocity element. For example, the target track is expressed as a series of points (track points) to be reached by the vehicle 200. The track point is a point to be reached by the vehicle 200 for each predetermined mileage, and separately, the target speed and target acceleration for each predetermined sampling time (for example, about 0 commas [sec]) are the target track. Generated as part. Further, the track point may be a position to be reached by the vehicle 200 at the sampling time for each predetermined sampling time. In this case, the information of the target velocity and the target acceleration is expressed by the interval of the orbital points. The boarding / alighting control unit 280 also has the same function.

The boarding / alighting position search unit 274 refers to the input information from the monitoring unit 210, the high-precision map information, and the like, and stops the vehicle 200 at the boarding position and the getting-off position included in the route information acquired from the management device 300. Search for a stop position (boarding / alighting position) where the user can get on or off. The boarding / alighting position search unit 274 searches for a boarding / alighting position based on recognizable white lines and yellow lines on the road, road signs, road widths, presence / absence of sidewalks and guardrails, etc. based on input information from the monitoring unit 210. decide.

The user recognition unit 276 recognizes the user who is about to get on the vehicle 200 based on the input information from the monitoring unit 210. For example, the user recognition unit 276 attempts to get on the vehicle 200 by inputting the image of the camera included in the monitoring unit 210 into a model that can be learned by machine learning and can determine the "user who is trying to get on". Recognize the users who are.

The stop / start control unit 282 of the boarding / alighting control unit 280 performs deceleration control and steering control for stopping the vehicle 200 at the boarding / alighting position searched and determined by the boarding / alighting position search unit 274, and from the boarding / alighting position toward the roadway. It performs deceleration control and steering control for starting the vehicle 200.

The door lock control unit 284, for example, when the vehicle 200 stops at the boarding / alighting position and the authentication device 242 obtains information that the user has been successfully authenticated, the door of the predetermined door of the door lock device 266. Unlock the lock. Further, the door lock control unit 284 locks the door lock of a predetermined door of the door lock device 266 after the user gets on the vehicle 200 and before the vehicle 200 is started by the stop / start control unit 282. do.

The HMI control unit 290 controls the HMI 238 so as to output various information to the user, and controls the HMI 238 and other devices so as to reflect the instruction from the user received by the HMI 238.

[Management device]
FIG. 3 is a configuration diagram of the management device 300. The management device 300 includes, for example, a communication unit 310, a front processing unit 320, a transportation schedule determination unit 330, a route determination unit 340, a settlement processing unit 350, and a storage unit 370. The front processing unit 320 includes a reception unit 322, a recognition unit 324, a notification control unit 326, and a detection unit 328. These components are realized, for example, by a hardware processor such as a CPU executing a program (software). Some or all of these components may be realized by hardware such as LSI, ASIC, FPGA, GPU (including circuit part; circuitry), or realized by collaboration between software and hardware. May be good. The program may be stored in advance in a storage device such as an HDD or a flash memory (a storage device including a non-transient storage medium), or a removable storage medium such as a DVD or a CD-ROM (non-transient). It is stored in a sex storage medium), and may be installed in the storage device by mounting the storage medium in the drive device. The management device 300 may include a storage unit 370. The storage unit 370 is realized by a DVD, a RAM (Random Access Memory), a flash memory, or the like. Information such as user information 372, transportation request list information 374, transportation schedule information 376, and map information 378 is stored in the storage unit 370.

FIG. 4 is a diagram showing an example of the contents of the user information 372. The user information 372 is, for example, associated with a user ID, which is user identification information, with a name, gender, age, address, occupation, emergency contact information, and the like. Each item of the user information 372 is registered in advance at the time of subscribing to the service managed by the management device 300. Each part of the management device 300 performs various processes with reference to the user information 372.

The communication unit 310 is, for example, a network card for connecting to the network NW. The communication unit 310 communicates with the terminal device 100 and the vehicle 200 via the network NW. In the communication unit 310, the vehicle interior monitoring device 240 takes an image of the inside of the vehicle 200 from the terminal device 100, and receives (acquires) the generated vehicle interior image. The communication unit 310 is an example of the “acquisition unit” in the process of acquiring the vehicle interior image from the terminal device 100.

The reception unit 322 acquires the transportation request issued from the user's terminal device 100 via the communication unit 310, and registers it in the storage unit 370 as the transportation request list information 374.

FIG. 5 is a diagram showing an example of the contents of the transportation request list information 374. The transportation request list information 374 is, for example, an applicant ID which is a user ID of the user (applicant) who sent the transportation request, and a passenger ID which is a user ID of the user (passenger) who gets on the vehicle 200. , The boarding point that is the start point and the disembarkation point that is the end point of the section related to transportation, the desired boarding time, and the transportation decided flag indicating whether or not transportation is decided by the transportation schedule determination unit 330 (for example, 1 is transportation decision completed). , 0 indicates undecided transportation) and the like are information associated with each other. A set of an applicant ID, a passenger ID, a guardian ID, a boarding point, a disembarking point, a desired boarding time, and a transportation determined flag related to one transportation request are referred to as a record. A transport request is any form of information that contains the content required for a record to be generated.

The recognition unit 324 recognizes the number of users U in the vehicle 200 based on the vehicle interior image acquired by the communication unit 310. The recognition unit 324 is used, for example, based on the difference between the vehicle interior image in which the user U is not in the vehicle 200 and the vehicle interior image acquired by the communication unit 310, and is in the vehicle 200. Recognize the number of person U.

The recognition process of the recognition unit 324 is an example, and is not limited to this. The recognition unit 324 recognizes an object in the vehicle 200 based on a time-dependent change of the vehicle interior image captured by the vehicle interior monitoring device 240 at predetermined time intervals, and makes a movement peculiar to a person among the objects. You may recognize the object you are doing as a person. Further, the recognition unit 324 uses, for example, a machine-learned learning model based on a photograph in which a predetermined number of users U are in the vehicle 200 (or a vehicle of the same model as the vehicle 200) in advance. It may be used to recognize the number of users U in the vehicle 200.

The notification control unit 326 transmits information indicating various notifications to the terminal device 100 of the user U who is known to be in the vehicle 200, and cooperates with the application program of the terminal device 100 to provide a terminal. The device 100 is made to output a boarding confirmation notification to the user U. The form of notification to the user U is not limited to this, and may be in the form of providing an e-mail or a web page. Details will be described later.

The detection unit 328 compares the number of first information received from the terminal device 100 by the communication unit 310 with the number of users U of the vehicle 200 recognized by the recognition unit 324 to obtain an inappropriate number of users. Detect boarding. The first information is a notification given by the notification control unit 326, and is information indicating that the user U has confirmed the boarding confirmation notification described later. Here, a occupant who is not a user of the service (hereinafter referred to as an unsuitable occupant) may board the vehicle 200 even though the transportation request for receiving the service has not been transmitted. The detection unit 328 compares the number of the first information with the number of users U of the vehicle 200 recognized by the recognition unit 324, and if the numbers do not match, an inappropriate number of passengers are boarded. Is detected.

The transportation schedule determination unit 330 determines the transportation schedule of the user by the vehicle 200 based on the record registered in the transportation request list information 374, and registers it in the transportation schedule information 376. FIG. 6 is a diagram showing an example of the contents of the transportation schedule information 376. The transportation schedule information 376 is generated for each operation day and, for example, a vehicle ID which is identification information of the vehicle 200 used when a plurality of vehicles 200 exist. The transportation schedule information 376 is, for example, information in which information such as a boarding / alighting point, an estimated arrival time, information indicating boarding / alighting, and a user ID of a user getting on / off is arranged in chronological order. The transportation schedule determination unit 330 determines the estimated arrival time in the case of boarding based on the desired boarding time of the record of the transportation request list information 374, and when disembarking in consideration of the traffic information of the day, the legal speed information, and the like. Determine the estimated arrival time.

The route determination unit 340 determines the route to be instructed to the vehicle 200 based on the transportation schedule information 376 and the map information 378, and transmits the route information to the vehicle 200 using the communication unit 310. The function of the route determination unit 340 is the same as that of the existing navigation system.

The payment processing unit 350 performs processing for collecting charges from the user. For example, the payment processing unit 350 cooperates with a credit card or electronic money management server to collect charges from users.

[Form of boarding confirmation notification]
Based on the transportation schedule information 376, the notification control unit 326 sets the terminal device 100 of the user U at a time when the user U who uses the service is scheduled to board the vehicle 200 or at a time substantially coincide with the time. To output a boarding confirmation notification. FIG. 7 is a diagram showing an example of the image IMa1 displayed on the terminal device 100 in the boarding confirmation notification. For example, the notification control unit 326 instructs the terminal device 100 to display the image IMa1 and outputs a boarding confirmation notification.

The image IMa1 includes, for example, a message MS1 inquiring the user U whether or not he / she got on the vehicle 200 according to the transportation schedule. This message MS1 is, for example, a message such as "Did you get on the vehicle as planned?" Further, the image IMa1 includes a button B1 that gives a positive answer to the inquiry of the message MS1 and a button B2 that gives a negative answer.

The user U receives the boarding confirmation notification by displaying the image IMa1 on the display unit of the terminal device 100. Then, the user U performs an operation of confirming the boarding confirmation notification by selecting the button B1 or the button B2 shown in the image IMa1. The terminal device 100 transmits the first information indicating that the user U has confirmed the boarding confirmation notification to the management device 300. The terminal device 100 transmits, for example, first information including the vehicle ID of the vehicle 200 used by the user U to the management device 300.

In the above description, the case where the notification control unit 326 causes the terminal device 100 to display the image IMa1 to give the boarding confirmation notification has been described, but the present invention is not limited to this. The notification control unit 326 may give a boarding confirmation notification by, for example, causing the terminal device 100 to output the message MS1 by voice. In this case, the user U may respond to the boarding confirmation notification by speaking a positive answer or a negative answer to the voice. The terminal device 100 has, for example, a function of recognizing by voice recognition whether the utterance of the user U in response to the boarding confirmation notification is a positive answer or a negative answer, and the recognition result is first. It is transmitted to the management device 300 as information.

The detection unit 328 detects an inappropriate number of passengers by comparing the number of users U recognized by the recognition unit 324 with the number of first information received by the communication unit 310. The detection unit 328 uses, for example, the vehicle ID of the vehicle 200 whose number of users U is recognized by the recognition unit 324 as a search key, and among the first information received by the communication unit 310, the vehicle ID is included. 1 Specify the information. The detection unit 328 compares the number of users U with the number of the first information specified by the recognition unit 324.

When the number of the first information and the number of users U recognized by the recognition unit 324 match, the detection unit 328 detects that an appropriate number of people are on the vehicle 200. When the number of the first information and the number of users U recognized by the recognition unit 324 do not match, the detection unit 328 detects that the vehicle 200 to be compared is improperly boarded. Then, the detection unit 328 detects the number obtained by subtracting the number of the first information from the number of users U recognized by the recognition unit 324 as the number of inappropriate occupants.

[Operation flow]
FIG. 8 is a flowchart showing an example of a processing flow executed by the management device 300 of the embodiment. The flowchart shown in FIG. 8 is repeatedly executed at predetermined time intervals.

First, the communication unit 310 acquires information indicating an vehicle interior image from the vehicle interior monitoring device 240 (step S100). Next, the recognition unit 324 recognizes the number of users U in the vehicle 200 based on the vehicle interior image acquired by the communication unit 310 (step S102). The notification control unit 326 is based on the transportation schedule information 376, among the users U who use the service, the current time is the time when the vehicle 200 is scheduled to be boarded, or the user U whose current time is substantially the same as the scheduled time. Is specified (step S104). The notification control unit 326 causes the terminal device 100 of the specified user U to output a boarding confirmation notification (step S106).

The notification control unit 326 controls, for example, the terminal device 100 to display the image IMa1 and outputs a boarding confirmation notification. The terminal device 100 causes the display unit to display the image IMa1 based on the instruction from the management device 300 to output the boarding confirmation notification. The user U receives the boarding confirmation notification by displaying the image IMa1 on the display unit of the terminal device 100. Then, the user U performs an operation of confirming the boarding confirmation notification by selecting the button B1 or the button B2 shown in the image IMa1. The terminal device 100 transmits the first information indicating that the user U has confirmed the boarding confirmation notification to the management device 300.

The communication unit 310 receives (acquires) the first information from the terminal device 100 (step S108). The detection unit 328 compares the number of users U recognized by the recognition unit 324 with the number of first information received by the communication unit 310, and determines whether or not the numbers match (step S110). .. The detection unit 328 uses, for example, the vehicle ID of the vehicle 200 whose number of users U is recognized by the recognition unit 324 as a search key, and among the first information received by the communication unit 310, the vehicle ID is included. 1 Specify the information. The detection unit 328 compares the number of users U with the number of the first information specified by the recognition unit 324.

When the number of the first information and the number of users U recognized by the recognition unit 324 match, the detection unit 328 detects that an appropriate number of people are on the vehicle 200 (step S112). .. If the number of the first information and the number of users U recognized by the recognition unit 324 do not match, the detection unit 328 determines that the vehicle 200 to be compared is improperly boarded and recognizes it. The number obtained by subtracting the number of the first information from the number of users U recognized by the unit 324 is detected as the number of inappropriate occupants (step S114).

[Summary of Embodiment]
As described above, the management device 300 of the present embodiment manages a service in which a vehicle 200 capable of autonomously traveling without a driver getting on the vehicle is driven and a user U is transported by the vehicle 200 in a designated section. In the device 300, an acquisition unit (communication unit in this example) that acquires an image (in this example, a vehicle interior image) captured by an image pickup unit (in this example, a vehicle interior monitoring device 240) in the vehicle interior of the vehicle 200. 310), the recognition unit 324 that recognizes the number of users U who are in the vehicle 200 based on the image acquired by the acquisition unit, and the user who is known to be in the vehicle 200. The user U has confirmed the boarding confirmation notification from the notification control unit 326 that causes the first terminal device (terminal device 100 in this example) of U to output the boarding confirmation notification to the user U and the first terminal device. Compares the number of users U recognized by the recognition unit 324 with the receiving unit (communication unit 310 in this example) that receives the first information indicating the above, and the number of the first information received by the receiving unit. It is provided with a detection unit 328 that detects an inappropriate number of passengers.

As a result, the management device 300 of the present embodiment can grasp that an inappropriate number of passengers are on board.

<Modification example 1>
Hereinafter, a modification 1 of the above-described embodiment will be described. In the embodiment, a case where the detection unit 328 detects an inappropriate occupant's boarding based on the number of users U who are in the vehicle 200 recognized by the recognition unit 324 has been described. In the first modification, the detection unit 328 detects an inappropriate occupant's boarding based on the result of inquiring the terminal device 100 about the number of users U currently in the vehicle 200. The same components as those in the above-described embodiment are designated by the same reference numerals and the description thereof will be omitted.

When the number of users U recognized by the recognition unit 324 by the detection unit 328 and the number of the first information do not match, the notification control unit 326 outputs an inquiry notification to the terminal device 100 that outputs the boarding confirmation notification. Let me. FIG. 9 is a diagram showing an example of the image IMa2 displayed on the terminal device 100 in the inquiry notification. For example, the notification control unit 326 instructs the terminal device 100 to display the image IMa2, and outputs an inquiry notification.

In the image IMa2, for example, when the user U gets on the vehicle 200, the message inquiring how many users (including himself / herself) are currently on the vehicle 200. MS2 is included. This message MS2 is, for example, a message such as "How many users are currently on board?" Further, in the image IMa2, a numeric keypad KY used when responding to the inquiry of the message MS2 and a comment box BX indicating the number of users U input by the user U using the numeric keypad KY are input. A button B3 for confirming the contents is included.

The user U receives an inquiry notification when the image IMa2 is displayed on the display unit of the terminal device 100. Then, the user U performs an operation of confirming the inquiry notification by operating the numeric keypad KY and the button B3 shown in the image IMa2. The terminal device 100 transmits to the management device 300 the second information indicating the number of passengers input by the user U in response to the inquiry notification. The terminal device 100 transmits, for example, second information including the vehicle ID of the vehicle 200 used by the user U to the management device 300.

The detection unit 328 of the modification 1 further identifies the number of users U in the vehicle 200 based on the second information acquired by the communication unit 310. The notification control unit 326 outputs an inquiry notification when, for example, the number of users U recognized by the recognition unit 324 and the number of the first information are not located. Then, when the number of users U shown in the first information and the number of users U shown in the second information match, the detection unit 328 uses the number of matching users U thereafter. If they do not match, the subsequent comparison process is performed using the number of users U shown in the second information.

[Operation flow]
FIG. 10 is a flowchart showing an example of the flow of processing executed in the management device 300 of the first modification. The flowchart shown in FIG. 10 is repeatedly executed at predetermined time intervals. Of the processes shown in FIG. 10, the same processes as those shown in FIG. 8 are assigned the same step numbers and the description thereof will be omitted.

When the detection unit 328 determines that the numbers do not match in the process of step S110, the notification control unit 326 causes the terminal device 100 of the specified user U to output an inquiry notification (step S116).

The notification control unit 326 controls, for example, the terminal device 100 to display the image IMa2, and outputs an inquiry notification. The terminal device 100 causes the display unit to display the image IMa2 based on the instruction from the management device 300 to output the inquiry notification. The user U receives an inquiry notification when the image IMa2 is displayed on the display unit of the terminal device 100. Then, the user U performs an operation of confirming the inquiry notification by operating the numeric keypad KY and the button B3 shown in the image IMa2. The terminal device 100 transmits to the management device 300 the second information indicating the number of passengers input by the user U in response to the inquiry notification.

The communication unit 310 receives (acquires) the second information from the terminal device 100 (step S118). The notification control unit 326 compares the number of the first information with the number of users U indicated by the second information, and determines whether or not the numbers match (step S120). When the number of the first information and the number of users U indicated by the second information match, the detection unit 328 proceeds to step S112 and detects that an appropriate number of people are on the vehicle 200. do. If the number of the first information and the number of users U indicated by the second information do not match, the detection unit 328 determines that the vehicle 200 to be compared is improperly boarded, and determines that the vehicle is improperly boarded. 2 The number obtained by subtracting the number of the first information from the number of users U indicated by the information is detected as the number of inappropriate occupants (step S114).

[Summary of Modification 1]
As described above, the detection unit 328 is a user who is difficult to be recognized by the recognition unit 324, such as a short user U or a user U who gets on a position that is difficult to be recognized from the imaging direction of the vehicle interior monitoring device 240. Even when the U gets on the vehicle 200, the user U can be detected with high accuracy, and it can be grasped that an inappropriate number of people are getting on the vehicle.

In the above description, when the number of users U recognized by the recognition unit 324 by the detection unit 328 and the number of the first information do not match, the notification control unit 326 outputs a boarding confirmation notification to the terminal device 100. The case where the inquiry notification is output to is described, but the present invention is not limited to this. The notification control unit 326 causes the terminal device 100 to output an inquiry notification at the same time as the boarding confirmation notification, for example, after a predetermined time has elapsed since the boarding confirmation notification was transmitted, or after receiving the first information. You may.

In this case, the detection unit 328 specifies the number of users U who get on the vehicle 200 based on the number of users U recognized by the recognition unit 324 and the number of users U indicated by the second information. For example, when the number of user U recognized by the recognition unit 324 and the number of user U indicated by the second information do not match, the detection unit 328 uses the number of user U indicated by the second information. Subsequent comparison processing may be performed. As a result, the detection unit 328 allows the user U, which is difficult to be recognized by the recognition unit 324, such as a short user U and a user U who rides in a position that is difficult to be recognized from the imaging direction of the vehicle interior monitoring device 240. Even when boarding the 200, it is possible to detect the user U with high accuracy and grasp that an inappropriate number of passengers are boarding.

Further, when the number of user U recognized by the recognition unit 324 and the number of user U indicated by the second information do not match, the detection unit 328 uses the number of user U recognized by the recognition unit 324. After that, the comparison process may be performed. As a result, the detection unit 328 accurately detects the user U based on the vehicle interior image even when the user U riding in the vehicle 200 gives a false response or an erroneous response to the inquiry notification. Can be detected.

<Modification 2>
Hereinafter, a modification 2 of the above-described embodiment will be described. In the second modification, a case will be described in which the user U of the vehicle 200 can grasp that an inappropriate number of passengers are riding in the vehicle 200. The same reference numerals are given to the above-described embodiments and the same configurations as those of the modified examples, and the description thereof will be omitted.

FIG. 11 is a diagram showing an example of the image IMa3 displayed on the terminal device 100 in the notification notifying the number of users U who are scheduled to get on the vehicle 200. For example, the notification control unit 326 instructs the terminal device 100 to display the image IMa3, and causes the user U to output a notification (hereinafter, number of people notification) notifying the number of users U riding in the vehicle 200. ..

The image IMa3 includes, for example, a message MS3 informing the user U of the number of users U riding in the vehicle 200 used by the user U. The message MS3 is, for example, a message such as "<Schedule information> Three users are scheduled to ride in this vehicle."

The notification control unit 326 causes the terminal device 100 to output the number of people notification, for example, at the same time as the boarding confirmation notification, after a predetermined time has elapsed since the boarding confirmation notification was transmitted, and after receiving the first information. May be good. As a result, the management device 300 can make the user U know whether or not an appropriate number of people are on the vehicle 200.

Note that the notification control unit 326 may cause the HMI 238 to output the number of people notification instead of (or in addition to) the number of people notification of the terminal device 100. FIG. 12 is a diagram showing an example of the interior of the vehicle when the vehicle 200 is viewed from above. The display device DP is provided to, for example, any user U seated in the driver's seat ST1, the passenger seat ST2, the rear seat ST3 installed behind the passenger seat ST2, and the rear seat ST4 installed behind the driver's seat ST1. Is installed in a position that is easy to see. In the vehicle interior of the illustrated example, the display device DP included in the HMI 238 is installed in the center of the instrument panel (between the driver's seat ST1 and the passenger seat ST2).

FIG. 13 is a diagram showing an example of the image IMa4 displayed on the display device DP in the notification of the number of people. The notification control unit 326 instructs, for example, display the image IMa4 on the display device DP. For example, the notification control unit 326 instructs the terminal device 100 to display the image IMa4, and outputs a notification of the number of people. The image IMa4 includes, for example, the message MS3. The notification control unit 326 specifies, for example, the number of passengers U on board based on the transportation schedule information 376.

In addition, the image IMa4 may include a message MS4 notifying the number of users U who will board the vehicle 200 from now on. The message MS4 is, for example, a message such as "One more user is scheduled to board after this". In this case, the notification control unit 326 gets on the vehicle 200 within a predetermined time (for example, several to several tens [minutes]) from the current time among the users U who use the service based on the transportation schedule information 376. The user U to be used is specified for each vehicle 200. The notification control unit 326 instructs the automatic driving control unit 270 to display the image IMa4 including the message MS4 indicating the number of the specified users U on the display device DP of the corresponding vehicle 200. The automatic operation control unit 270 causes the display device DP to display the image IMa4 based on the instruction of the notification control unit 326. The message MS4 is an example of "information indicating the number of users estimated to be in the vehicle 200 based on the transportation schedule of the user U by the vehicle 200".

[Summary of Modification 2]
As described above, the notification control unit 326 uses the vehicle 200 to indicate that an inappropriate number of people are boarding the vehicle 200 by outputting the number notification to the terminal device 100 or the display device DP. The person U can be grasped.

<Modification example 3>
Hereinafter, a modification 3 of the above-described embodiment will be described. In the third modification, when it is detected that the management device 300 is riding an inappropriate number of people in the vehicle 200, information indicating that an inappropriate number of people are riding is transmitted to the external device. The case of providing will be described. The same configuration as that of the above-described embodiment will be described with the same reference numerals.

FIG. 14 is a configuration diagram of a system including the management device 300 according to the third modification. This system includes one or more terminal devices 100 used by the user, one or more vehicles 200, a management device 300, and an external device 400. These components can communicate with each other via the network NW.

The external device 400 is, for example, a device provided in a company that operates and manages services. Hereinafter, a case where the external device 400 is a device provided in a security company corresponding to a trouble that occurs in a service will be described. When the detection unit 328 detects that an inappropriate number of people are riding in the vehicle 200, the external device 400 provides information indicating that an inappropriate number of people are riding (hereinafter, detection information). Provide information to. The detection unit 328 determines, for example, the vehicle ID of the vehicle 200 that has detected that an inappropriate number of passengers are riding based on the transportation schedule information 376, and the passenger ID of the user U who rides on the vehicle 200. Identify. The detection unit 328 generates detection information including the specified vehicle ID, passenger ID, and information on the route on which the vehicle 200 travels, and causes the generated communication unit 310 to transmit the detection information to the external device 400 via the network NW. ..

The detection unit 328 acquires, for example, an vehicle interior image from the vehicle interior monitoring device 240 of the vehicle 200 that has detected that an inappropriate number of passengers are riding, and includes information indicating the acquired vehicle interior image. The detection information may be generated. Further, the detection unit 328 acquires information indicating the current position of the vehicle 200 from the GNSS receiver 234 of the vehicle 200 that has detected that an inappropriate number of passengers are riding, and includes the acquired current position information. Detection information may be generated.

The external device 400 provides the detection information to the security guard SG of the security company. The external device 400 provides the security guard SG with the detection information by displaying an image showing the detection information on the display unit of the external device 400, for example. By confirming the detection information using the external device 400, the guard SG can take some measures for the vehicle 200 in which an inappropriate number of passengers are on board. For example, the guard SG confirms that an inappropriate number of passengers are riding in the vehicle 200, and rushes to the vehicle 200 or makes an inappropriate ride from the speaker of the HMI 238 of the vehicle 200. The external device 400 is operated in order to output a voice prompting the user U to get off. In this case, the external device 400 and the HMI 238 have a function of outputting a predetermined voice (or the voice of the guard SG acquired by the external device 400 by the microphone) from the HMI 238 according to the instruction of the external device 400.

[Summary of Modification 3]
As described above, when the detection unit 328 detects that an inappropriate number of passengers are riding, the detection unit 328 provides information to the external device 400, and informs the information about the inappropriate number of passengers through the external device 400. The person who received the offer (in this case, the guard SG) can be made to deal with it.

<Modification example 4>
Hereinafter, a modification 4 of the above-described embodiment will be described. In the fourth modification, when the detection result of the detection unit 328 indicates that an inappropriate number of passengers are riding in the vehicle 200, the management device 300 determines the terminal device 100 of the user U of the vehicle 200 and the terminal device 100 of the user U of the vehicle 200. A case of relaying communication with an operator who operates and manages a service will be described. The same components as those in the above-described embodiment are designated by the same reference numerals and the description thereof will be omitted.

FIG. 15 is a configuration diagram of a system including the management device 301 according to the modified example 4. This system includes one or more terminal devices 100 used by the user, one or more vehicles 200, a management device 301, and an operator device 500. These components can communicate with each other via the network NW.

The operator device 500 is, for example, a terminal device used by an operator OP who operates and manages a service. When the detection unit 328 detects that an inappropriate number of passengers are riding in the vehicle 200, the detection unit 328 communicates between the terminal device 100 of the user U currently in the vehicle 200 and the operator device 500. Let's get started. The operator device 500 is an example of a “second terminal device”.

FIG. 16 is a diagram showing an example of the configuration of the management device 301 according to the modified example 4. As shown in FIG. 16, the management device 301 further includes a relay unit 360 in addition to the configuration provided in the management device 300. For example, when the detection unit 328 detects that an inappropriate number of passengers are boarding the relay unit 360, the relay unit 360 of the user U who is currently in the vehicle 200 based on the transportation schedule information 376. Identify the user ID.

The relay unit 360 starts communication between the terminal device 100 owned by the user U having the specified user ID and the operator device 500.
In this case, the transportation schedule information 376 may include, for example, information related to the terminal device 100 of the user U in addition to the above-mentioned information. The information related to the terminal device 100 of the user U is, for example, information used when starting communication (or a call) between the terminal device 100 and the operator device 500. Specifically, the information related to the terminal device 100 of the user U is, for example, the telephone number of the terminal device 100 or the information used in the vehicle allocation application, and the terminal device 100 and the operator device 500 are provided via the vehicle allocation application. Information that enables communication. Hereinafter, a case where the information relating to the terminal device 100 of the user U is information that enables communication between the terminal device 100 and the operator device 500 via the vehicle allocation application will be described.

The relay unit 360 starts communication between the terminal device 100 and the operator device 500, for example, by using the information related to the terminal device 100 of the user U associated with the specified user ID. To start communication means, for example, that the relay unit 360 provides the operator device 500 with information related to the terminal device 100 of the user U and instructs the operator device 500 to call the terminal device 100. Unit 360 instructs the terminal device 100 to provide the information related to the terminal device 100 of the user U to the operator device 500, or provides the information related to the operator device 500 to the terminal device 100 to the terminal device 100. For example, instructing the operator device 500 to make a call. As a result, the relay unit 360 starts communication between the user U and the operator OP.

The communication between the user U and the operator OP may be a voice call, a video call, or a chat format using a vehicle dispatch application.

Further, in the relay unit 360, when there are a plurality of users U currently in the vehicle 200 for which an inappropriate number of passengers have been detected by the detection unit 328, the relay unit 360 may have a plurality of users U. Communication between the terminal device 100 of all or some of the users U and the operator device 500 may be started.

[Summary of Modification 4]
As described above, when the relay unit 360 detects that an inappropriate number of passengers are on board, the relay unit 360 starts communication between the terminal device 100 of the user U and the operator device 500, and the user U causes the user U to start communication. It is possible to easily request the operator OP to take action.

<Modification 5>
Hereinafter, a modified example 5 of the above-described embodiment will be described. In the fifth modification, when it is detected that an inappropriate number of passengers are riding in the vehicle 200, a case where the management device 300 gives a penalty to the user U who is riding inappropriately will be described. do. The same components as those in the above-described embodiment are designated by the same reference numerals and the description thereof will be omitted.

FIG. 17 is a diagram showing an example of the configuration of the management device 302 according to the modified example 5. As shown in FIG. 17, the management device 302 includes a storage unit 371 in place of (or in addition to) the storage unit 370 included in the management device 300. The storage unit 371 includes, for example, user information 372, transportation request list information 374a, transportation schedule information 376, and map information 378.

FIG. 18 is a diagram showing an example of the contents of the transportation request list information 374a according to the modified example 5. Penalty information is further associated with the record of the transportation request list information 374a, for example, in addition to the record of the transportation request list information 374. The penalty information is, for example, information indicating a penalty given to the user U who illegally boarded the vehicle 200. The user U who has been given a penalty is less likely to use the service than the user U who has not been given a penalty. Specifically, the penalty is that the use of the service is prohibited, the fee for illegally boarding the vehicle 200, or the fee for boarding the vehicle 200 via the next service is charged in addition to the fee. That and so on. Along with this, the penalty information includes information indicating that the service cannot be used and information indicating an additional fee to be collected.

Returning to FIG. 17, the management device 302 further includes a specific unit 362 and a penalty granting unit 364 in addition to the configuration provided by the management device 300 (or the management device 302).

For example, when an inappropriate number of passengers are detected by the detection unit 328, the specific unit 362 is among the users U who are on the vehicle 200 based on the transportation schedule information 376 of the user U by the vehicle 200. , Appropriate user U, or user U other than appropriate user U (hereinafter, inappropriate user U) is specified.

When the user ID of the user U shown in the transportation schedule information 376 is acquired by the authentication device 242, the identification unit 362 identifies the user U of the user ID as an appropriate user U. Further, when the user ID other than the user ID of the user U shown in the transportation schedule information 376 is acquired by the authentication device 242, the specific unit 362 sets the user U of the user ID as an inappropriate user. Specify as U.

The penalty giving unit 364 gives the penalty information to the record of the transportation request list information 374a related to the inappropriate user U specified by the specific unit 362.

In the above description, the case where the identification unit 362 identifies an inappropriate user U based on the user ID of the user U acquired by the authentication device 242 has been described, but the present invention is not limited to this. For example, the identification unit 362 may identify an appropriate user U or an inappropriate user U based on the vehicle interior image and the user image showing the characteristics of the user U.

For example, the user U of the service may register a user image that captures the characteristics of the user U at the start of using the service so that the user U can be recognized by the image. In this case, the information indicating the registered user image is associated with other information included in the user information 372 as the user information 372. The identification unit 362 identifies a user image of an appropriate user U who uses the vehicle 200 based on the record of the transportation request list information 374a. Then, the identification unit 362 identifies the user U who is in the vehicle 200 by recognizing the image based on the vehicle interior image received (acquired) from the vehicle interior monitoring device 240 and the specified user image. do. The identification unit 362 identifies the user U other than the user U shown in the transportation schedule information 376 as an inappropriate user U among the specified user U.

[Summary of Modification 5]
As described above, in the management device 302 of the modified example 5, the specific unit 362 identifies an inappropriate user U among the users U of the vehicle 200, and the penalty giving unit 364 is specified by the specific unit 362. A penalty is given to the improper user U. As a result, the management device 302 suppresses the improper user U from illegally getting on the vehicle 200, and the inappropriate user U uses the vehicle 200 so that the appropriate user U can use the vehicle 200. It can be prevented from becoming unavailable.

According to the embodiment described above, it is possible to realize a transportation service that can be used with greater peace of mind.

The embodiment described above can be expressed as follows.
It is a management device that manages a service in which a driver runs a vehicle capable of autonomous driving without getting on the vehicle and transports the user by the vehicle in a designated section.
A storage device that stores programs and
With a hardware processor,
When the hardware processor executes the program,
An image captured by the imaging unit in the vehicle interior of the vehicle is acquired, and the image is acquired.
Based on the acquired image, the number of users in the vehicle is recognized, and
A boarding confirmation notification to the user is output to the first terminal device of the user who is known to be in the vehicle.
From the first terminal device, the first information indicating that the user has confirmed the boarding confirmation notification is received, and the first information is received.
By comparing the number of recognized users with the number of received first information, an inappropriate number of passengers are detected.
Management device.

Although the embodiments for carrying out the present invention have been described above using the embodiments, the present invention is not limited to these embodiments, and various modifications and substitutions are made without departing from the gist of the present invention. Can be added.

For example, the management device 300 may be mounted on the vehicle 200. Further, the vehicle 200 may be a remote-controlled vehicle that is remotely controlled from a remote location. In this case, the vehicle 200 transmits various information acquired by the monitoring unit 210 to the external device by the communication device 220. The external device generates (or reproduces) an image showing the surrounding situation of the vehicle 200 based on various received information and presents it to the remote operator. At this time, in order to cover the delay due to communication, the image or the like may be corrected by the look-ahead process. The remote operator operates the driving operator based on the presented image. The operation performed on the driving operator is transmitted to the vehicle 200, and the vehicle 200 travels based on the received operation.

100 ... terminal device, 200 ... vehicle, 210 ... monitoring unit, 220 ... communication device, 230 ... navigation device, 234 ... GNSS receiver, 236 ... navigation control device, 240 ... vehicle interior monitoring device, 242 ... authentication device, 260 ... Driving force output device, 262 ... Brake device, 264 ... Steering device, 266 ... Door lock device, 270 ... Automatic operation control unit, 272 ... Route travel control unit, 274 ... Boarding / alighting position search unit, 276 ... User recognition unit, 280 ... Boarding / alighting control unit, 282 ... Stop / start control unit, 284 ... Door lock control unit, 290 ... HMI control unit, 300, 301, 302 ... Management device, 310 ... Communication unit, 320 ... Front processing unit, 322 ... Reception unit , 324 ... recognition unit, 326 ... notification control unit, 328 ... detection unit, 330 ... transportation schedule determination unit, 340 ... route determination unit, 350 ... payment processing unit, 360 ... relay unit, 362 ... specific unit, 364 ... penalty grant Department, 370, 371 ... Storage unit, 372 ... User information, 374, 374a ... Transportation request list information, 376 ... Transportation schedule information, 378 ... Map information, 400 ... External device, 500 ... Operator device

Claims (9)

It is a management device that manages a service in which a driver runs a vehicle capable of autonomous driving without getting on the vehicle and transports the user by the vehicle in a designated section.
An acquisition unit that acquires an image captured by the imaging unit in the vehicle interior of the vehicle, and an acquisition unit.
A recognition unit that recognizes the number of users in the vehicle based on the image acquired by the acquisition unit.
A notification control unit that outputs a boarding confirmation notification to the user to the first terminal device of the user who is known to be in the vehicle.
A receiving unit that receives first information indicating that the user has confirmed the boarding confirmation notification from the first terminal device.
A detection unit that detects an inappropriate number of passengers by comparing the number of users recognized by the recognition unit with the number of the first information received by the reception unit.
A management device equipped with. The notification control unit causes the first terminal device to further output an inquiry notification inquiring about the number of users currently in the vehicle.
The receiving unit receives the second information in response to the inquiry notification from the first terminal device.
The detection unit further detects an inappropriate number of passengers on the vehicle based on the second information.
The management device according to claim 1. The notification control unit further notifies the first terminal device of the number of users who are planning to get on the vehicle.
The management device according to claim 1 or 2. The notification control unit causes a display device mounted on the vehicle to display information indicating the number of users estimated to be in the vehicle based on the transportation schedule of the user by the vehicle.
The management device according to any one of claims 1 to 3. When the detection unit detects an inappropriate number of passengers, it provides information to an external device.
The management device according to any one of claims 1 to 4. Further, a relay unit for relaying communication between the second terminal device used by the operator of the service and the first terminal device is provided.
When the detection result of the detection unit indicates that the number of the first terminal devices and the number of the first information do not match, the relay unit indicates that the user currently in the vehicle is the first. Communication between at least one of the first terminal devices and the second terminal device in one terminal device is started.
The management device according to any one of claims 1 to 5. When an inappropriate number of passengers are detected by the detection unit, a specific unit that identifies an appropriate user among the users in the vehicle based on the transportation schedule of the user by the vehicle. ,
Further provided with a granting unit that grants a penalty to a user other than the appropriate user specified by the specific unit.
The management device according to any one of claims 1 to 6. A computer that realizes a management device that manages a service that allows a driver to drive a vehicle that can autonomously travel without getting on the vehicle and transport the user by the vehicle in a designated section.
An image captured by the imaging unit in the vehicle interior of the vehicle is acquired, and the image is acquired.
Based on the acquired image, the number of users in the vehicle is recognized, and
A boarding confirmation notification to the user is output to the first terminal device of the user who is known to be in the vehicle.
From the first terminal device, the first information indicating that the user has confirmed the boarding confirmation notification is received, and the first information is received.
By comparing the number of recognized users with the number of received first information, an inappropriate number of passengers are detected.
Management method. A computer that realizes a management device that manages a service that allows a driver to drive a vehicle that can autonomously travel without getting on the vehicle and transport the user by the vehicle in a designated section.
An image captured by the imaging unit in the vehicle interior of the vehicle is acquired, and the image is acquired.
Based on the acquired image, the number of users in the vehicle is recognized.
The first terminal device of the user who is known to be in the vehicle is made to output a boarding confirmation notification to the user.
The first information indicating that the user has confirmed the boarding confirmation notification is received from the first terminal device.
By comparing the number of recognized users with the number of received first information, an inappropriate number of passengers are detected.
program.

Images