JP7462022B1 - Information processing device, information processing method, and information processing program - Google Patents

Abstract

[Problem] To realize an autonomous vehicle that provides a comfortable autonomous driving experience for passengers. [Solution] The information processing device according to the present application includes an acquisition unit that acquires biometric information of a first passenger of the autonomous vehicle, an identification unit that identifies, based on the biometric information of the first passenger, information on a dangerous place where the first passenger felt the danger of being driven by the autonomous vehicle, an acceptance unit that accepts reservation information related to a reservation for use of the autonomous vehicle from a second passenger, and a determination unit that determines route information related to a driving route from a departure point to a destination related to the reservation information, based on the information on the dangerous place. [Selected Figure] Figure 2

Description

The present invention relates to an information processing device, an information processing method, and an information processing program.

In recent years, technological development related to autonomous driving has become more active. Autonomous driving technology is a technology that automates the driving operation of a vehicle using a control system installed in the vehicle (hereinafter referred to as the "autonomous driving system") instead of the driver performing the driving operation. In the following, driving operations performed by the driver may be referred to as "manual driving", and driving operations performed by the autonomous driving system may be referred to as "autonomous driving".

The levels of autonomous driving technology (hereinafter referred to as "autonomous driving levels") are classified into five levels, for example, from level 1 to level 5, depending on the entity performing driving operations (if the level where unmanned autonomous driving is possible is also included, there are six levels). At autonomous driving level 4 or autonomous driving level 5, autonomous driving is performed without a driver. As autonomous driving technology continues to improve in the future, it is expected that it will become possible to provide autonomous driving mobility services at autonomous driving levels 4 and 5, where driving is performed without a driver.

Also, conventionally, there is known a technology that assists a driver in driving a vehicle safely. For example, hazard map information is stored that records the locations where the driver's biometric information changes, which is created based on the driver's biometric information measured during past vehicle driving. Also, the vehicle's position and the biometric information of the driver who drives the vehicle measured in real time are acquired. Next, when the acquired vehicle position is at a location recorded in the hazard map information, it is determined whether the driver who drives the vehicle is in a dangerous state based on the acquired biometric information of the driver who drives the vehicle. Then, when it is determined that the driver who drives the vehicle is in a dangerous state, a technology is known that issues a warning to the driver who drives the vehicle to call attention.

JP 2011-242190 A

However, the above-mentioned conventional technologies merely determine whether the driver of a vehicle is in a dangerous state based on the driver's biometric information, and therefore may not be able to realize a comfortable autonomous driving experience for passengers in autonomous vehicles.

Therefore, the present disclosure aims to provide an information processing device, an information processing method, and an information processing program that can realize comfortable autonomous driving for passengers in autonomous vehicles.

The information processing device according to the present application includes an acquisition unit that acquires biometric information of a first passenger of an autonomous vehicle, an identification unit that identifies information about a dangerous place where the first passenger felt the danger of being driven by the autonomous vehicle based on the biometric information of the first passenger, a reception unit that receives reservation information about a reservation for use of the autonomous vehicle from a second passenger, and a determination unit that determines route information about a driving route from a departure point to a destination related to the reservation information based on the information about the dangerous place.

According to one aspect of the embodiment, it is possible to realize autonomous driving that is comfortable for passengers in autonomous vehicles.

FIG. 1 is a diagram illustrating an example of the configuration of an information processing system according to an embodiment. FIG. 2 is a diagram showing an overview of information processing according to the embodiment. FIG. 3 is a diagram illustrating an example of the configuration of the information processing device according to the embodiment. FIG. 4 is a diagram illustrating an example of information stored in a biological information storage unit according to the embodiment. FIG. 5 is a diagram illustrating an example of information stored in a danger location information storage unit according to the embodiment. FIG. 6 is a flowchart showing an information processing procedure by the information processing device according to the embodiment. FIG. 7 is a flowchart showing an information processing procedure by the information processing device according to the embodiment. FIG. 8 is a hardware configuration diagram illustrating an example of a computer that realizes the functions of the information processing device.

Below, the information processing device, information processing method, and information processing program according to the present application will be described in detail with reference to the drawings. Note that the information processing device, information processing method, and information processing program according to the present application are not limited to these embodiments. In addition, the same parts in the following embodiments will be denoted by the same reference numerals, and duplicated descriptions will be omitted.

(Embodiment)
1. Introduction
In the future, as autonomous driving technology continues to improve, it is expected that it will become possible to provide autonomous driving level 4 and level 5 autonomous driving services that operate without a driver. In order to provide such autonomous driving services that operate without a driver, it is expected that autonomous vehicles that can run safely will be created by having the autonomous driving system memorize machine learning processing and traffic rules for many driving situations.

However, when operating vehicles with people on board as passengers, it is necessary not only to operate safely but also to provide a comfortable driving experience that does not make people feel uneasy. For example, current technological improvements during autonomous driving demonstrations rely on the suggestions of professional drivers based on their intuition and experience, so there are limits to the accuracy of improvements. Furthermore, in order to realize comfortable autonomous driving experience that does not make people feel uneasy in more areas, it is necessary to detect issues with scalability in mind.

In response to this, the information processing device according to the embodiment performs automatic driving with a tester passenger aboard the automatic driving vehicle to provide a transportation service by automatic driving that is operated without a driver, and acquires biometric information of the passenger while the automatic driving is being performed. In this way, the information processing device acquires biometric information of the passenger, and thereby can acquire information on near-miss events felt by people in so-called near-miss cases (i.e., situations in which driving is felt to be dangerous), such as sudden steering or sudden braking, which cannot be acquired from vehicle data. As a result, the information processing device can acquire sensitive information felt by people, such as near-miss events felt by people, and can improve the automatic driving system so as to avoid situations in which passengers of the automatic driving vehicle feel the risk of driving. Specifically, it is considered that a situation in which a passenger of the automatic driving vehicle feels the risk of driving occurs when the automatic driving vehicle travels through a specific location. Therefore, in providing a transportation service by automatic driving that is operated without a driver, the information processing device determines a driving route that avoids a location where a situation in which a passenger of the automatic driving vehicle feels the risk of driving occurs (hereinafter, also referred to as a "dangerous location"). As a result, the information processing device can avoid situations in which passengers of the autonomous vehicle feel unsafe while driving, allowing passengers of the autonomous vehicle to ride in the autonomous vehicle with peace of mind without feeling anxious. Furthermore, for example, when there is no driving route that avoids a dangerous location, the information processing device can reduce the degree of danger felt by passengers by slowing down the driving speed when driving through the dangerous location. Therefore, the information processing device can realize autonomous driving that is comfortable for passengers of the autonomous vehicle.

In the following, the vehicle according to this embodiment (hereinafter, the vehicle) is equipped with a known autonomous driving system. Specifically, the vehicle is equipped with a function for recognizing information about the situation around the vehicle. For example, the vehicle is equipped with various sensors such as a camera, LiDAR, millimeter wave radar, or ultrasonic sensor, and constantly monitors the surroundings and the front of the vehicle, recognizing other vehicles, pedestrians, white lines on the road, signs, etc. from image data acquired by the sensors.

The vehicle may also be equipped with a global navigation satellite system (GNSS) such as a GPS to determine its own position. The vehicle may also be equipped with a distance measuring instrument (DMI) that measures distance from the number of tire rotations, and an inertial measurement unit (IMU) that measures angular velocity and acceleration to determine its own position. The vehicle may also use SLAM technology to determine its own position.

In addition, the vehicle may improve the accuracy of identifying its own vehicle position by matching its own vehicle position information with sensor data using highly accurate three-dimensional map information that includes road signs and lane information.

2. Configuration of Information Processing System
First, the configuration of an information processing system 1 according to an embodiment will be described with reference to FIG. 1. FIG. 1 is a diagram showing an example of the configuration of the information processing system 1 according to an embodiment. As shown in FIG. 1, the information processing system 1 includes a sensor device 10, a user device 20, an in-vehicle device 30, and an information processing device 100. The sensor device 10, the user device 20, the in-vehicle device 30, and the information processing device 100 are connected to each other via a predetermined network N so as to be able to communicate with each other by wire or wirelessly. Note that the information processing system 1 shown in FIG. 1 may include a plurality of sensor devices 10, a plurality of user devices 20, a plurality of in-vehicle devices 30, and a plurality of information processing devices 100.

The sensor device 10 has a function of detecting biometric information of passengers (hereinafter, sometimes simply referred to as "passengers") of an autonomous vehicle. The sensor device 10 may constantly detect the biometric information of passengers. Specifically, the sensor device 10 is a biosensor. For example, the sensor device 10 may be various sensors that detect heart rate, pulse, blood pressure, sweat rate, respiration, brain waves, electromyography, etc. Here, the biometric information is information detected by a biosensor and is information indicating the passenger's heart rate, pulse, blood pressure, sweat rate, respiration, brain waves, electromyography, etc. For example, the sensor device 10 may be a biosensor of a type that is worn on the human body (also called a contact type). For example, the sensor device 10 may be a wearable device of a glasses type worn on the head, a watch type worn on the wrist, or a wristband type worn on the arm. The passenger constantly wears the sensor device 10 while riding. Furthermore, the contact-type sensor device 10 may be equipped with an acceleration sensor or a gyro sensor, and may acquire various behavioral information of the passenger as an example of biometric information. For example, the sensor device 10 may acquire the head movement of the passenger using a glasses-type wearable device, and recognize the head gesture of the passenger from the acceleration of the head movement.

The sensor device 10 may be a non-contact sensor. For example, the sensor device 10 may be a camera or a microphone. The non-contact sensor device 10 may be mounted on an autonomous vehicle. For example, the sensor device 10 may detect information indicating a pulse interval (the time interval between pulses) from a facial image of a passenger captured by a camera as an example of biometric information. The sensor device 10 may detect audio information of a passenger captured by a microphone as an example of biometric information. The sensor device 10 may be provided with a plurality of the types of sensors described above. The sensor device 10 transmits biometric information of the passenger to the information processing device 100 at predetermined time intervals.

The user device 20 is an information processing device used by a user who uses an autonomous driving mobility service (hereinafter, simply referred to as "mobility service") that operates without a driver. For example, the user device 20 is a smart device such as a smartphone or tablet terminal, a feature phone, a PC (Personal Computer), a PDA (Personal Digital Assistant), a game console or AV device with a communication function, a car navigation system, a wearable device such as a smart watch or a head-mounted display, smart glasses, etc.

The user device 20 accepts input of reservation information related to a reservation for use of an autonomous vehicle in accordance with the operation of a user of a mobility service. For example, the user device 20 accepts input of information such as passenger type, departure point, destination, departure time, arrival time, number of passengers, and whether or not carpooling is possible, as examples of reservation information. When the user device 20 accepts input of reservation information, it transmits the input reservation information to the information processing device 100.

Here, passenger type refers to the degree to which a passenger tolerates the danger felt in dangerous places. For example, if a passenger tolerates the danger felt in dangerous places and prefers arriving at their destination quickly rather than risking danger, they can select the "speed priority type" from among the passenger types. On the other hand, if a passenger does not tolerate the danger felt in dangerous places and prefers a comfortable ride without any danger, they can select the "comfort priority type" from among the passenger types.

The in-vehicle device 30 is an information processing device mounted on a vehicle. The in-vehicle device 30 is equipped with a known automatic driving system. Specifically, the in-vehicle device 30 has a function of determining the behavior of the vehicle based on information about the situation around the vehicle recognized by the vehicle. The in-vehicle device 30 also receives route information about the driving route from the departure point to the destination from the information processing device 100. The in-vehicle device 30 also has a function of making decisions such as changing the route or changing lanes based on congestion information, etc. while driving the driving route related to the received route information. The in-vehicle device 30 also has a function of controlling the vehicle based on a determination about the behavior of the vehicle. For example, the in-vehicle device 30 has a function of controlling the steering wheel, the accelerator pedal, etc.

The information processing device 100 is an information processing device that provides a transportation service by autonomous driving that operates without a driver. The information processing device 100 acquires biometric information of passengers of the autonomous vehicle from the sensor device 10 at predetermined time intervals. Furthermore, based on the biometric information of the passenger acquired in the past, the information processing device 100 identifies information on dangerous places where the passenger felt the danger of being driven by the autonomous vehicle. Furthermore, the information processing device 100 accepts reservation information regarding a reservation for the use of the autonomous vehicle from the user device 20 of the user of the transportation service (the future passenger). Furthermore, based on the information on the dangerous place, the information processing device 100 determines route information regarding the driving route from the departure point to the destination related to the reservation information. When the information processing device 100 determines the route information regarding the driving route, it transmits the route information to the in-vehicle device 30.

Next, an overview of information processing according to an embodiment will be described with reference to FIG. 2. FIG. 2 is a diagram showing an overview of information processing according to an embodiment. The information processing described in FIG. 2 is executed by the information processing system 1 described in FIG. 1.

In FIG. 2, the information processing device 100 acquires biometric information of passenger U1 of the autonomous vehicle from the sensor device 10 (step S1). Specifically, the information processing device 100 may acquire information indicating the heart rate of passenger U1 as an example of the biometric information of passenger U1. For example, the sensor device 10 may be a contact-type heart rate sensor attached to the body of passenger U1. Furthermore, passenger U1 may be a tester.

Furthermore, when the information processing device 100 acquires the biometric information of passenger U1, it identifies information on a dangerous place where passenger U1 felt the risk of being driven by an autonomous vehicle based on the acquired biometric information of passenger U1 (step S2). For example, the information processing device 100 may identify a place where the change in passenger U1's heart rate before and after driving exceeds a predetermined threshold as a dangerous place. Note that the information processing device 100 may identify other dangerous places other than the place where passenger U1 felt the risk of being driven by an autonomous vehicle based on the biometric information of passengers other than passenger U1.

The information processing device 100 also receives reservation information regarding a reservation for use of an autonomous vehicle from the user device 20 of a user of the mobility service (later passenger U2) (step S3). For example, the information processing device 100 receives information regarding the passenger type, departure point, and destination as an example of reservation information.

When the information processing device 100 receives reservation information, the information processing device 100 determines route information regarding the driving route from the departure point to the destination related to the received reservation information based on information regarding the identified hazardous location (step S4). Specifically, the information processing device 100 searches for a driving route from the departure point to the destination related to the reservation information. The information processing device 100 acquires route information regarding the driving route with the shortest driving time as a search result corresponding to the driving route from the departure point to the destination.

Then, the information processing device 100 decides to travel along a route that corresponds to the passenger type. For example, when the passenger type is the "comfort-priority type", if a dangerous place exists on the route with the shortest travel time, the information processing device 100 decides to search again for a route that avoids the dangerous place, or to travel along the route with the shortest travel time while reducing the travel speed at the dangerous place. On the other hand, when the passenger type is the "speed-priority type", even if a dangerous place exists on the route with the shortest travel time, the information processing device 100 decides to travel along the route with the shortest travel time in the shortest travel time.

When the information processing device 100 has determined the route information, it provides the route information to the in-vehicle device 30 mounted on the autonomous vehicle V2 in which the passenger U2 rides (step S5). The in-vehicle device 30 controls the autonomous driving of the vehicle V2 based on the route information received from the information processing device 100 so that the vehicle V2 travels along the travel route determined by the information processing device 100.

3. Configuration of information processing device
Next, the configuration of the information processing device 100 according to the embodiment will be described with reference to Fig. 3. Fig. 3 is a diagram showing an example of the configuration of the information processing device 100 according to the embodiment. As shown in Fig. 3, the information processing device 100 has a communication unit 110, a storage unit 120, and a control unit 130.

(Communication unit 110)
The communication unit 110 is realized by, for example, a network interface card (NIC) etc. The communication unit 110 is connected to the sensor device 10, the user device 20, and the in-vehicle device 30 via the network N in a wired or wireless manner, and is a communication interface that controls communication of information between the sensor device 10, the user device 20, and the in-vehicle device 30.

(Memory unit 120)
The storage unit 120 is realized by, for example, a semiconductor memory element such as a random access memory (RAM) or a flash memory, or a storage device such as a hard disk or an optical disk. The storage unit 120 stores a program (an example of an information processing program) executed by the control unit 130, or data processed by the control unit 130.

As shown in FIG. 3, the storage unit 120 includes a biometric information storage unit 121 and a dangerous place information storage unit 122. The information stored in these units will be explained in order below.

(Biometric information storage unit 121)
The biometric information storage unit 121 stores various types of information related to the biometric information of passengers. The biometric information storage unit 121 stores a history of the biometric information of passengers. Here, an example of information stored in the biometric information storage unit 121 will be described with reference to Fig. 4. Fig. 4 is a diagram illustrating an example of information stored in the biometric information storage unit according to the embodiment.

In the example shown in FIG. 4, the biometric information storage unit 121 stores information related to the following items in association with each other: "Road ID," "Passenger type," "Acquisition date and time," "Day of the week," "Holiday," "Time period (hour)," "Rear heart rate (HR)," "Anterior heart rate (HR)," and "Autonomic nerve (CVRR)."

"Road ID" refers to identification information that identifies the road on which the autonomous vehicle traveled. Specifically, the "road ID" may be identification information that identifies each link in a national transportation network.

"Passenger type" indicates the passenger type selected by the passenger when accepting the reservation. For example, the "speed priority type" among the passenger types indicates that the passenger is willing to tolerate the danger felt in dangerous places and prefers to arrive at the destination quickly rather than risk. Also, the "comfort priority type" among the passenger types indicates that the passenger is willing to tolerate the danger felt in dangerous places and prefers a comfortable ride without any danger.

"Acquisition date and time" indicates the date and time when the passenger's biometric information was acquired from the sensor device 10. "Day of the week" indicates the day of the week when the autonomous vehicle traveled on the road identified by the road ID. "Holiday" indicates whether the day when the autonomous vehicle traveled on the road identified by the road ID was a holiday or not. "Time of day (hour)" indicates the time of day when the autonomous vehicle traveled on the road identified by the road ID.

"Post-heart rate (HR)" indicates the passenger's heart rate immediately after the autonomous vehicle has traveled on the road identified by the road ID. Specifically, "post-heart rate (HR)" may be the passenger's heart rate at the time when the autonomous vehicle has traveled the end point of the road identified by the road ID. "Pre-heart rate (HR)" indicates the passenger's heart rate immediately before the autonomous vehicle has traveled on the road identified by the road ID. Specifically, "pre-heart rate (HR)" may be the passenger's heart rate at the time when the autonomous vehicle has traveled the start point of the road identified by the road ID. For example, a large change in the passenger's heart rate before and after travel on the road identified by the road ID indicates a large degree of danger felt by the passenger while traveling on the road identified by the road ID. On the other hand, a small change in the passenger's heart rate before and after travel on the road identified by the road ID indicates a small degree of danger felt by the passenger while traveling on the road identified by the road ID.

"Autonomic nerve (CVRR)" indicates the change in the coefficient of heart rate variability of a passenger before and after traveling on a road identified by a road ID. In general, the time interval between one heartbeat and the next is called the heartbeat interval. Heart rate variability refers to the periodic variation of the heartbeat interval. Heart rate variability is an index showing the regulating function of the autonomic nerves, and a small heart rate variability indicates that the sympathetic nerves are dominant and stress is high. On the other hand, a large heart rate variability indicates that the parasympathetic nerves are dominant and stress is low. The coefficient of heart rate variability (CVRR) is biometric information used to test autonomic nerve function. For example, a large change in the coefficient of heart rate variability of a passenger before and after traveling on a road identified by a road ID indicates a large degree of danger felt by the passenger while traveling on the road identified by the road ID. On the other hand, a small change in the coefficient of heart rate variability of a passenger before and after traveling on a road identified by a road ID indicates a small degree of danger felt by the passenger while traveling on the road identified by the road ID.

The information stored in the biometric information storage unit 121 is not limited to information related to the items "Road ID", "Passenger type", "Acquisition date and time", "Day of the week", "Holiday", "Time period (hour)", "Rear heart rate (HR)", "Anterior heart rate (HR)", and "Autonomic nerve (CVRR)", and any other information related to the biometric information of a passenger may be stored.

(Dangerous place information storage unit 122)
The danger place information storage unit 122 stores various information related to danger places. Here, an example of information stored in the danger place information storage unit 122 will be described with reference to Fig. 5. Fig. 5 is a diagram showing an example of information stored in the danger place information storage unit according to the embodiment.

In the example shown in FIG. 5, the danger place information storage unit 122 stores information related to the items "danger place ID," "road ID," "passenger type," "day of the week," "holiday," and "time period (hour)" in association with each other.

"Dangerous location ID" indicates identification information that identifies a dangerous location. "Road ID" indicates identification information that identifies a road on which a dangerous location is located. Specifically, "Road ID" may be identification information that identifies each link in a national transportation network. "Passenger type" indicates the passenger type selected by the passenger when accepting the reservation. "Day of the week" indicates the day of the week on which the autonomous vehicle traveled on the road identified by the road ID. "Holiday" indicates whether the day on which the autonomous vehicle traveled on the road identified by the road ID was a holiday or not. "Time period (hour)" indicates the time period on which the autonomous vehicle traveled on the road identified by the road ID.

The information stored in the danger place information storage unit 122 is not limited to information related to the items "danger place ID," "road ID," "passenger type," "day of the week," "holiday," and "time period (hour)," and any other information related to danger places may be stored.

(Control unit 130)
The control unit 130 is a controller, and is realized by, for example, a central processing unit (CPU), a micro processing unit (MPU), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), etc., executing various programs (corresponding to an example of an information processing program) stored in a storage device inside the information processing device 100 using a storage area such as a RAM as a working area. In the example shown in FIG. 3, the control unit 130 has an acquisition unit 131, a specification unit 132, a reception unit 133, a determination unit 134, and a provision unit 135.

(Acquisition unit 131)
The acquisition unit 131 acquires biometric information of passengers of the autonomous driving vehicle. For example, the acquisition unit 131 may acquire the biometric information of the passengers from the sensor device 10 at predetermined time intervals.

The acquisition unit 131 also acquires information indicating the passenger type of the passenger. For example, if the passenger is a tester, the acquisition unit 131 may acquire information indicating the passenger type self-reported by the tester from the tester. Furthermore, if the reception unit 133 receives reservation information regarding a reservation for use of an autonomous vehicle from a passenger, the acquisition unit 131 acquires information indicating the passenger type included in the reservation information received by the reception unit 133.

The acquisition unit 131 also acquires driving information of the autonomous vehicle from the in-vehicle device 30 mounted on the autonomous vehicle carrying a passenger. For example, the acquisition unit 131 acquires vehicle position information as the vehicle driving information. The vehicle position information may include information related to the vehicle driving date and time. When acquiring the vehicle position information, the acquisition unit 131 may identify the road link on which the autonomous vehicle is driving based on the vehicle position information. For example, the acquisition unit 131 acquires the latest map information in advance. Next, the acquisition unit 131 may identify the road link on which the autonomous vehicle is driving based on the vehicle position information and the map information. Note that the acquisition unit 131 may acquire information capable of identifying the road link on which the autonomous vehicle is driving from the in-vehicle device 30 as the vehicle driving information.

When the acquisition unit 131 acquires the passenger's biometric information, passenger type, and vehicle driving information, it stores the passenger's biometric information, passenger type, and vehicle driving information in the biometric information storage unit 121 in association with each other.

(Identification unit 132)
The identification unit 132 identifies information on a dangerous place where the passenger felt the danger of driving the autonomous vehicle based on the passenger's biometric information acquired by the acquisition unit 131. Specifically, the identification unit 132 determines whether each road link corresponds to a dangerous place based on the value of the amount of change in the heart rate of the passenger in the autonomous vehicle traveling on each road link, as an example of biometric information. For example, when the acquisition unit 131 acquires the passenger's biometric information, the identification unit 132 refers to the biometric information storage unit 121 to calculate the difference between the posterior heart rate and the anterior heart rate included in the passenger's biometric information. Next, the identification unit 132 determines whether the value of the difference between the posterior heart rate and the anterior heart rate exceeds a first threshold. When the identification unit 132 determines that the value of the difference between the posterior heart rate and the anterior heart rate exceeds the first threshold, the identification unit 132 determines that the passenger felt the danger of driving. When the identification unit 132 determines that the passenger feels the danger of driving, the identification unit 132 identifies a road link identified by a road ID linked to the biometric information as a dangerous place by referring to the biometric information storage unit 121. When the identification unit 132 identifies a road link identified by a road ID linked to the biometric information as a dangerous place, the identification unit 132 stores information about the identified dangerous place in the dangerous place information storage unit 122. For example, the identification unit 132 stores information about the dangerous place, such as a road ID, a passenger type, and a travel date and time, in association with each other in the dangerous place information storage unit 122.

In the above example, the identification unit 132 identifies a dangerous place based on the value of the amount of change in the passenger's heart rate as an example of biometric information. However, the identification unit 132 may identify a dangerous place based on the value of the amount of change in the passenger's heart rate variability coefficient. Specifically, the identification unit 132 refers to the biometric information storage unit 121 to acquire the value of the autonomic nerve (amount of change in the heart rate variability coefficient) included in the passenger's biometric information. Next, the identification unit 132 determines whether the amount of change in the heart rate variability coefficient exceeds a second threshold. If the identification unit 132 determines that the value of the amount of change in the heart rate variability coefficient exceeds the second threshold, it determines that the passenger has sensed the danger of driving. If the identification unit 132 determines that the passenger has sensed the danger of driving, it refers to the biometric information storage unit 121 to identify a road link identified by a road ID linked to the biometric information as a dangerous place.

The identification unit 132 may also calculate a score that combines the value of the change in the passenger's heart rate and the value of the change in the heart rate variation coefficient. The identification unit 132 may determine whether or not the passenger felt the danger of driving based on the calculated score value.

(Reception unit 133)
The reception unit 133 receives reservation information related to a reservation for use of an autonomous driving vehicle from a passenger. Specifically, the reception unit 133 receives the reservation information from the user device 20 used by the passenger. For example, the reception unit 133 receives information such as passenger type, departure place, destination, departure time, arrival time, number of passengers, and whether or not carpooling is possible, as examples of the reservation information.

(Determination Unit 134)
The determination unit 134 determines route information regarding a travel route from the departure point related to the reservation information to the destination based on information regarding the hazardous location. Specifically, the determination unit 134 searches for a travel route from the departure point related to the reservation information to the destination. The determination unit 134 acquires route information regarding a travel route with the shortest travel time (hereinafter, a first travel route) as a search result corresponding to the travel route from the departure point to the destination.

Then, the determination unit 134 determines a travel route according to the information indicating the passenger type. Specifically, the determination unit 134 determines whether or not a dangerous place exists on the first travel route acquired as a search result. For example, the determination unit 134 refers to the dangerous place information storage unit 122 and determines whether or not a road link corresponding to a dangerous place is included among the road links included in the first travel route acquired as a search result. At this time, when the passenger type is the "comfort priority type", the determination unit 134 refers to the data in the dangerous place information storage unit 122 in which the passenger type is the "comfort priority type" and determines whether or not a road link corresponding to a dangerous place is included among the road links included in the first travel route. Also, when the passenger type is the "speed priority type", the determination unit 134 refers to the data in the dangerous place information storage unit 122 in which the passenger type is the "speed priority type" and determines whether or not a road link corresponding to a dangerous place is included among the road links included in the first travel route.

When the determination unit 134 determines that no road link corresponding to a dangerous location is included among the road links included in the first driving route, it determines that no dangerous location exists on the first driving route. When the determination unit 134 determines that no dangerous location exists on the first driving route, it decides to travel along the first driving route and confirms the reservation.

Furthermore, when the determination unit 134 determines that a road link corresponding to a dangerous place is included among the road links included in the first travel route, it determines that a dangerous place exists on the first travel route. When the determination unit 134 determines that a dangerous place exists on the first travel route (i.e., the first travel route includes the dangerous place), it searches again for another travel route (hereinafter, a second travel route) that can be traveled in the same travel time as the first travel route and does not include the dangerous place. When the determination unit 134 determines that a second travel route exists, it determines that the travel route is changed from the first travel route to the second travel route. When the determination unit 134 determines that the travel route is changed from the first travel route to the second travel route, it confirms the reservation.

If the second driving route does not exist, the decision unit 134 searches again and again for another driving route (hereinafter, the third driving route) that can be traveled in a longer driving time than the first driving route and does not include a dangerous location. If the third driving route exists, the decision unit 134 decides to change the driving route from the first driving route to the third driving route. When the decision unit 134 decides to change the driving route from the first driving route to the third driving route, it confirms the reservation. Note that, if the passenger type is the "speed priority type", the decision unit 134 may decide to travel on the first driving route instead of changing the driving route from the first driving route to the third driving route, and confirm the reservation.

In addition, when the third travel route does not exist, the determination unit 134 determines to travel the first travel route with the travel speed reduced in dangerous places. Specifically, the determination unit 134 determines to travel the first travel route with the travel speed reduced in road links corresponding to dangerous places among the road links included in the first travel route. In addition, the determination unit 134 calculates the travel time when traveling at a reduced travel speed in road links corresponding to dangerous places among the road links included in the first travel route. When the determination unit 134 determines to travel the first travel route with the travel speed reduced in dangerous places, it confirms the reservation. Note that, in the case where the passenger type is the "speed priority type", the determination unit 134 may determine to travel the first travel route in the shortest travel time and confirm the reservation, instead of determining to travel the first travel route with the travel speed reduced in dangerous places.

(Providing Unit 135)
The providing unit 135 provides the route information determined by the determining unit 134 to the in-vehicle device 30. Specifically, when a reservation is confirmed by the determining unit 134, the providing unit 135 transmits the route information determined by the determining unit 134 to the in-vehicle device 30 mounted on the vehicle that is the subject of the reservation.

[4. Information Processing Procedures]
6 is a flowchart showing an information processing procedure by the information processing device according to the embodiment. In FIG. 6, the acquisition unit 131 acquires biometric information of a passenger of the autonomous vehicle (step S101). The identification unit 132 identifies information on a dangerous place where the passenger felt the danger of driving the autonomous vehicle based on the biometric information of the passenger acquired by the acquisition unit 131 (step S102).

Figure 7 is a flowchart showing an information processing procedure by the information processing device according to the embodiment. In Figure 7, the reception unit 133 receives reservation information relating to a reservation for use of an autonomous vehicle from a passenger (step S201). In Figure 7, the reception unit 133 receives, as an example of reservation information, information indicating that the passenger type is a "comfort-priority type," and information relating to the departure point and destination.

The determination unit 134 searches for a driving route from the departure point to the destination related to the reservation information received by the reception unit 133 (step S202). For example, the determination unit 134 acquires a driving route that can be traveled in the shortest driving time (hereinafter, the first driving route) as a search result. Next, the determination unit 134 determines whether or not a dangerous place exists on the first driving route (step S203). If the determination unit 134 determines that a dangerous place does not exist on the first driving route (step S203; No), it decides to travel on the first driving route and confirms the reservation (step S206).

On the other hand, when the determination unit 134 determines that a dangerous place exists on the first driving route (step S203; Yes), it searches again for another driving route (hereinafter, the second driving route) that can be traveled in the same driving time as the first driving route and does not include the dangerous place (step S204). When the determination unit 134 determines that a second driving route exists (step S204; Yes), it determines to change the driving route from the first driving route to the second driving route (step S205). When the determination unit 134 determines to change the driving route from the first driving route to the second driving route, it confirms the reservation (step S206).

On the other hand, if the second driving route does not exist (step S204; No), the decision unit 134 searches again and again for another driving route (hereinafter, the third driving route) that can be traveled in a longer driving time than the first driving route and does not include a dangerous location (step S209). If the third driving route exists (step S209; Yes), the decision unit 134 decides to change the driving route from the first driving route to the third driving route (step S210). If the decision unit 134 decides to change the driving route from the first driving route to the third driving route, it confirms the reservation (step S206).

On the other hand, if there is no third driving route (step S209; No), the decision unit 134 calculates the driving time when the driving speed is reduced in the dangerous place included in the first driving route, and decides to drive the first driving route with the driving speed reduced in the dangerous place (step S211). When the decision unit 134 decides to drive the first driving route with the driving speed reduced in the dangerous place, it confirms the reservation (step S206).

When the reservation is confirmed by the determination unit 134, the provision unit 135 provides route information regarding the driving route determined by the determination unit 134 to the in-vehicle device 30 installed in the autonomous vehicle that is the subject of the reservation (step S207). In addition, the acquisition unit 131 acquires and registers biometric information of passengers of the autonomous vehicle (step S208).

5. Modifications
The processing according to the above-described embodiment may be implemented in various different forms other than the above embodiment.

[5-1. Changing the route of an autonomous vehicle while it is in motion]
In the above-described embodiment, the identification unit 132 identifies information about a hazardous place before the autonomous vehicle to be reserved travels. Then, the determination unit 134 determines a driving route before the autonomous vehicle to be reserved travels, based on information about the hazardous place identified before the autonomous vehicle to be reserved travels. In a modified example, the identification unit 132 identifies information about a hazardous place while the autonomous vehicle to be reserved (hereinafter, the first autonomous vehicle) is traveling. Then, the determination unit 134 changes a driving route of another autonomous vehicle to be reserved (hereinafter, the second autonomous vehicle) traveling near the first autonomous vehicle, based on information about the hazardous place identified by the identification unit 132.

Specifically, the acquisition unit 131 acquires biometric information of a first passenger who is a passenger of a first autonomous vehicle traveling along an already determined fourth driving route. The identification unit 132 identifies information related to a first hazardous place based on the biometric information of the first passenger. When the identification unit 132 identifies information related to the first hazardous place, the determination unit 134 identifies a second autonomous vehicle traveling within a predetermined range from the first hazardous place. Next, the determination unit 134 changes the driving route of the second autonomous vehicle traveling along an already determined fifth driving route based on the information related to the first hazardous place identified by the identification unit 132. For example, the determination unit 134 identifies the driving position (hereinafter, the first position) of the second autonomous vehicle at the time when the identification unit 132 identifies information related to the first hazardous place.

Then, the decision unit 134 determines whether or not the first danger location is present on the travel route from the first position to the destination of the fifth travel route (hereinafter, the sixth travel route). If the decision unit 134 determines that the first danger location is not present on the sixth travel route, it decides to continue traveling on the sixth travel route. If the decision unit 134 determines that the first danger location is present on the sixth travel route, it searches for another travel route (hereinafter, the seventh travel route) that can be traveled in the same travel time as the sixth travel route and does not include the first danger location. If the seventh travel route is present, the decision unit 134 decides to change the travel route from the sixth travel route to the seventh travel route.

Furthermore, if the seventh driving route does not exist, the decision unit 134 searches again for another driving route (hereinafter, the eighth driving route) that can be traveled in a longer driving time than the sixth driving route and does not include the first dangerous location. If the eighth driving route exists, the decision unit 134 decides to change the driving route from the sixth driving route to the eighth driving route. Note that, if the passenger type is the "speed priority type", the decision unit 134 may decide to travel on the sixth driving route instead of changing the driving route from the sixth driving route to the eighth driving route.

In addition, when the eighth travel route does not exist, the decision unit 134 decides to travel on the sixth travel route with the travel speed reduced in the first dangerous place. Specifically, the decision unit 134 decides to travel on the sixth travel route with the travel speed reduced in the road link corresponding to the first dangerous place among the road links included in the sixth travel route. In addition, the decision unit 134 calculates the travel time when traveling on the road link corresponding to the first dangerous place among the road links included in the sixth travel route with the travel speed reduced. Note that, in the case where the passenger type is the "speed priority type", the decision unit 134 may decide to travel on the sixth travel route in the shortest travel time instead of deciding to travel on the sixth travel route with the travel speed reduced in the first dangerous place.

[5-2. When passengers are detected to be in poor health]
In the above-described embodiment, the identification unit 132 identifies information on a dangerous place based on the passenger's biometric information. Then, the determination unit 134 determines route information on a travel route based on the information on the dangerous place identified by the identification unit 132. In a modified example, the identification unit 132 identifies whether the passenger is in poor health based on the passenger's biometric information. For example, the identification unit 132 identifies the passenger as being in poor health when the amount of change in the passenger's heart rate during a predetermined time period acquired by the acquisition unit 131 exceeds a third threshold. When the identification unit 132 identifies the passenger as being in poor health, the determination unit 134 determines a new travel route with a medical institution as the destination. For example, the determination unit 134 identifies the travel position (hereinafter, second position) of the autonomous vehicle at the time when the identification unit 132 identifies the passenger as being in poor health. Next, the determination unit 134 searches for a new travel route from the second position to the nearest medical institution as the destination.

6. Effects
As described above, the information processing device 100 according to the embodiment includes an acquisition unit 131, an identification unit 132, a reception unit 133, and a determination unit 134. The acquisition unit 131 acquires biometric information of a first passenger of the autonomous vehicle. The identification unit 132 identifies information about a dangerous place where the first passenger felt the risk of being driven by the autonomous vehicle, based on the biometric information of the first passenger. The reception unit 133 accepts reservation information related to a reservation for use of the autonomous vehicle from a second passenger. The determination unit 134 determines route information related to a driving route from a departure point to a destination related to the reservation information, based on the information about the dangerous place.

In this way, the information processing device 100 can obtain information on near miss events felt by people in so-called near miss cases (i.e., situations in which driving is felt to be dangerous), such as sudden steering or sudden braking, which cannot be obtained from vehicle data, by acquiring the passenger's biometric information. As a result, the information processing device 100 can obtain sensitive information felt by people, such as near miss events felt by people, and can improve the automatic driving system so as to avoid situations in which passengers of automatic driving vehicles feel dangerous driving. Specifically, it is considered that situations in which passengers of automatic driving vehicles feel dangerous driving occur when the automatic driving vehicle travels in a specific location. Therefore, when providing a transportation service by automatic driving that is operated without a driver, the information processing device 100 determines a driving route that avoids a location where a situation occurs in which a passenger of the automatic driving vehicle feels dangerous driving (hereinafter also referred to as a "dangerous location"). As a result, the information processing device 100 can avoid situations in which passengers of automatic driving vehicles feel dangerous driving, and therefore it is possible for passengers of automatic driving vehicles to ride in automatic driving vehicles without feeling anxious and with peace of mind. Furthermore, for example, when there is no driving route that avoids a dangerous place, the information processing device 100 can reduce the degree of danger felt by passengers by slowing down the driving speed when driving through the dangerous place. Therefore, the information processing device 100 can realize an autonomous driving that is comfortable for passengers of the autonomous vehicle.

The decision unit 134 also searches for driving routes as route information, and if a first driving route corresponding to the search results includes a dangerous location, it re-searches for another driving route that can be traveled in the same driving time as the first driving route and does not include the dangerous location, and if a second driving route corresponding to the search results of the re-search exists, it decides to travel the second driving route.

In this way, the information processing device 100 enables the autonomous vehicle to avoid locations where situations occur in which passengers feel that driving is unsafe, thereby making it possible to realize autonomous driving that is comfortable for passengers of the autonomous vehicle. In addition, the information processing device 100 enables the autonomous vehicle to arrive at the destination in the shortest driving time, thereby making it possible to realize autonomous driving that is more comfortable for passengers of the autonomous vehicle.

In addition, if there is no second driving route corresponding to the search result of the second search, the decision unit 134 searches again as route information for another driving route that can be traveled in a longer driving time than the first driving route and does not include dangerous locations, and if there is a third driving route corresponding to the search result of the third search, it decides to travel the third driving route.

As a result, the information processing device 100 enables the autonomous vehicle to avoid locations where situations occur in which passengers feel that driving is unsafe, thereby making it possible to realize autonomous driving that is comfortable for passengers of the autonomous vehicle.

In addition, if there is no third driving route corresponding to the search result of the third search as route information, the decision unit 134 decides to drive along the first driving route while reducing the driving speed in dangerous areas.

As a result, the information processing device 100 enables the autonomous vehicle to drive at a reduced driving speed in places where a situation occurs in which passengers feel that driving is dangerous, thereby reducing the danger felt by passengers of the autonomous vehicle.

The reception unit 133 also receives information indicating the passenger type selected by the second passenger from the second passenger. The determination unit 134 determines the travel route according to the information indicating the passenger type.

As a result, the information processing device 100 enables the autonomous vehicle to travel a route that corresponds to the passenger type, thereby enabling autonomous driving that is comfortable for the passengers of the autonomous vehicle.

The acquisition unit 131 also acquires biometric information of a first passenger who is a passenger of a first autonomous vehicle traveling along an already determined fourth driving route. The identification unit 132 identifies information about a first dangerous place based on the biometric information of the first passenger. The determination unit 134 changes the driving route of a second autonomous vehicle traveling along an already determined fifth driving route based on the information about the first dangerous place.

As a result, the information processing device 100 enables the autonomous vehicle to avoid in real time locations where situations occur in which passengers feel driving is unsafe, thereby making autonomous driving more comfortable for passengers in the autonomous vehicle.

The identification unit 132 also identifies whether the first passenger is in poor health based on the biometric information of the first passenger. If the identification unit 132 identifies that the first passenger is in poor health, the decision unit 134 determines a new driving route with a medical institution as the destination.

This allows the information processing device 100 to improve safety for passengers.

7. Hardware Configuration
Moreover, an information processing device such as the information processing device 100 according to the embodiment described above is realized by a computer 1000 having a configuration as shown in Fig. 8, for example. The information processing device 100 according to the embodiment will be described below as an example. Fig. 8 is a hardware configuration diagram showing an example of a computer that realizes the functions of the information processing device. The computer 1000 includes a CPU 1100, a RAM 1200, a ROM 1300, a HDD 1400, a communication interface (I/F) 1500, an input/output interface (I/F) 1600, and a media interface (I/F) 1700.

The CPU 1100 operates based on a program stored in the ROM 1300 or the HDD 1400, and controls each component. The ROM 1300 stores a boot program executed by the CPU 1100 when the computer 1000 is started, and programs that depend on the hardware of the computer 1000, etc.

HDD 1400 stores programs executed by CPU 1100 and data used by such programs. Communication interface 1500 receives data from other devices via a specified communication network and sends it to CPU 1100, and transmits data generated by CPU 1100 to other devices via the specified communication network.

The CPU 1100 controls output devices such as a display and a printer, and input devices such as a keyboard and a mouse, via the input/output interface 1600. The CPU 1100 acquires data from the input devices via the input/output interface 1600. The CPU 1100 also outputs generated data to the output devices via the input/output interface 1600.

The media interface 1700 reads a program or data stored in the recording medium 1800 and provides it to the CPU 1100 via the RAM 1200. The CPU 1100 loads the program from the recording medium 1800 onto the RAM 1200 via the media interface 1700 and executes the loaded program. The recording medium 1800 is, for example, an optical recording medium such as a DVD (Digital Versatile Disc) or a PD (Phase change rewritable Disc), a magneto-optical recording medium such as an MO (Magneto-Optical disk), a tape medium, a magnetic recording medium, or a semiconductor memory.

For example, when the computer 1000 functions as the information processing device 100 according to the embodiment, the CPU 1100 of the computer 1000 executes programs loaded onto the RAM 1200 to realize the functions of the control unit 130. The CPU 1100 of the computer 1000 reads and executes these programs from the recording medium 1800, but as another example, the CPU 1100 may obtain these programs from another device via a specified communication network.

Although some of the embodiments of the present application have been described in detail above with reference to the drawings, these are merely examples, and the present invention can be embodied in other forms that incorporate various modifications and improvements based on the knowledge of those skilled in the art, including the forms described in the disclosure section of the invention.

[7. Other]
Furthermore, among the processes described in the above embodiments and modifications, all or part of the processes described as being performed automatically can be performed manually, or all or part of the processes described as being performed manually can be performed automatically by a known method. In addition, the information including the processing procedures, specific names, various data and parameters shown in the above documents and drawings can be changed arbitrarily unless otherwise specified. For example, the various information shown in each drawing is not limited to the illustrated information.

In addition, each component of each device shown in the figure is a functional concept, and does not necessarily have to be physically configured as shown in the figure. In other words, the specific form of distribution and integration of each device is not limited to that shown in the figure, and all or part of them can be functionally or physically distributed and integrated in any unit depending on various loads, usage conditions, etc.

The above-described embodiments and variations can be combined as appropriate to the extent that they do not cause inconsistencies in the processing content.

REFERENCE SIGNS LIST 1 Information processing system 10 Sensor device 20 User device 30 Vehicle-mounted device 100 Information processing device 110 Communication unit 120 Storage unit 121 Biometric information storage unit 122 Dangerous place information storage unit 130 Control unit 131 Acquisition unit 132 Identification unit 133 Reception unit 134 Determination unit 135 Provision unit

Claims (8)

An acquisition unit that acquires biometric information of a first passenger of the autonomous vehicle;
An identification unit that identifies information regarding a dangerous location where the first passenger felt a danger of being driven by the autonomous vehicle based on biometric information of the first passenger;
a reception unit that receives reservation information related to a reservation for use of the autonomous driving vehicle from a second passenger;
A determination unit that determines route information regarding a travel route from a departure point to a destination related to the reservation information based on the information regarding the dangerous place;
Equipped with
The acquisition unit is
Acquire biometric information of a first passenger who is a passenger of a first autonomous vehicle traveling along a fourth travel route that has already been determined;
The identification unit is
Identifying information regarding a first hazardous location based on the biometric information of the first passenger;
The determination unit is
changing a driving route of a second autonomous vehicle that is traveling on a fifth driving route that has already been determined, based on the information on the first hazardous location;
Information processing device. The determination unit is
searching for the travel route as the route information, and if a first travel route corresponding to a search result of the search includes the dangerous place, searching again for another travel route which can be traveled in the same travel time as the first travel route and does not include the dangerous place, and if a second travel route corresponding to the search result of the second search is present, determining to travel the second travel route.
The information processing device according to claim 1 . The determination unit is
When a second travel route corresponding to the search result of the second search is not present as the route information, another travel route that can be traveled in a longer travel time than the first travel route and does not include the dangerous location is searched again, and when a third travel route corresponding to the search result of the third search is present, it is determined to travel the third travel route.
The information processing device according to claim 2 . The determination unit is
When a third travel route corresponding to the search result of the third search is not present as the route information, it is determined to travel along the first travel route while reducing a travel speed in the dangerous area.
The information processing device according to claim 3 . The reception unit is
accepting information from the second passenger indicative of a passenger type selected by the second passenger;
The determination unit is
determining the travel route in response to the information indicating the passenger type;
The information processing device according to claim 1 . The identification unit is
Identifying whether the first passenger is unwell based on the biometric information of the first passenger;
The determination unit is
When the identification unit identifies that the first passenger is in poor health, a new driving route having a medical institution as a destination is determined.
The information processing device according to claim 1 . An information processing method implemented by a program executed by an information processing device, comprising:
An acquisition step of acquiring biometric information of a first passenger of the autonomous vehicle;
An identification process for identifying information regarding a dangerous location where the first passenger felt a danger of being driven by the autonomous vehicle based on biometric information of the first passenger;
a receiving step of receiving reservation information regarding a reservation for use of the autonomous vehicle from a second passenger;
a determining step of determining route information regarding a travel route from a departure point to a destination related to the reservation information based on the information regarding the dangerous place;
Including,
The obtaining step includes:
Acquire biometric information of a first passenger who is a passenger of a first autonomous vehicle traveling along a fourth travel route that has already been determined;
The identifying step includes:
Identifying information regarding a first hazardous location based on the biometric information of the first passenger;
The determining step includes:
changing a driving route of a second autonomous vehicle that is traveling on a fifth driving route that has already been determined, based on the information on the first hazardous location;
Information processing methods. an acquisition step for acquiring biometric information of a first passenger of the autonomous vehicle;
An identification step of identifying information regarding a dangerous location where the first passenger felt a danger of being driven by the autonomous vehicle based on biometric information of the first passenger;
a receiving step of receiving reservation information related to a reservation for use of the autonomous vehicle from a second passenger;
a determination step of determining route information regarding a travel route from a departure point to a destination related to the reservation information based on the information regarding the dangerous place;
Run the following on your computer :
The acquisition step includes:
Acquire biometric information of a first passenger who is a passenger of a first autonomous vehicle traveling along a fourth travel route that has already been determined;
The identification step includes:
Identifying information regarding a first hazardous location based on the biometric information of the first passenger;
The determination procedure includes:
changing a driving route of a second autonomous vehicle that is traveling on a fifth driving route that has already been determined, based on the information on the first hazardous location;
Information processing program.

Images