JP2024057141A - Information processing device, control method, program, and storage medium - Google Patents

Abstract

To provide an information processing device capable of suitably mediating the communication between a driver of a mobile body and a user existing outside the mobile body.SOLUTION: An on-vehicle machine 1 or a server device 5, which is an information processing device used in a system mediating the communication between a driver of a target vehicle, which is a mobile body, and a user of an out-of-vehicle terminal 2 existing outside the target vehicle, comprises prediction means and display control means. The prediction means calculates a workload prediction value, which is a prediction value of an index value on a degree of an operation load of the driver of the target vehicle. The display control means causes the out-of-vehicle terminal 2 to display operation load prediction information indicative of a time-series workload prediction value during a prediction period.SELECTED DRAWING: Figure 7

Description

The present invention relates to a system that mediates communication between a driver of a mobile object and a user outside the mobile object.

Technologies that enable conversation between a vehicle driver and a person outside the vehicle have been known for some time. For example, Patent Document 1 discloses a conversation providing system that enables a conversation between the vehicle driver and a conversation partner by communicating with an in-vehicle system via a communication network.

JP 2017-138277 A

When the driver is talking to someone outside the vehicle, it is difficult for the person outside the vehicle to understand the driver's psychological state, so even when the driver is under high driving stress, the conversation cannot be interrupted, which can increase the driver's driving stress.

In view of the above-mentioned problems, one of the objectives of the present invention is to provide an information processing device that can effectively mediate communication between a driver of a moving body and a user outside the moving body.

The invention described in claim 1 is
An information processing device used in a system that mediates communication between a driver of a moving body and a user outside the moving body, comprising:
A prediction means for calculating a predicted index value which is a predicted value of an index value relating to a degree of a driving load of a driver of the moving body;
A display control means for displaying, on a terminal device of the user, driving load prediction information indicating the prediction index value in a time series for a predetermined period of time;
The present invention is characterized in that the information processing device has the following features.

The invention described in claim 8 is as follows:
A control method executed by an information processing device used in a system that mediates communication between a driver of a moving body and a user present outside the moving body, comprising:
A prediction step of calculating a predicted index value which is a predicted value of an index value related to a degree of a driving load of a driver of the moving body;
a display control step of displaying, on a terminal device of the user, driving load prediction information indicating the prediction index value in a time series for a predetermined period of time;
The control method is characterized by having the following features.

The invention described in claim 9 is as follows:
A program executed by a computer of an information processing device used in a system that mediates communication between a driver of a moving body and a user outside the moving body, comprising:
A prediction means for calculating a predicted index value which is a predicted value of an index value relating to a degree of a driving load of a driver of the moving body;
The program causes a computer to function as a display control means for displaying, on a terminal device of the user, driving load prediction information indicating the prediction index value in a time series for a predetermined period.

1 illustrates a configuration example of a driving call system according to an embodiment. 2 shows an example of a schematic configuration of an in-vehicle device. 2 shows an example of a schematic configuration of an external terminal. 13 shows a first example of a display on an external terminal when a target vehicle is traveling. 13 shows a second example of a display on the external terminal when the target vehicle is traveling. 13 shows a third example of a display on the external terminal when the target vehicle is traveling. 4 is an example of a flowchart showing a procedure of a process executed by an in-vehicle device. 13 shows a configuration example of a driving call system according to a modified example. 2 illustrates an example of a schematic configuration of a server device.

In one preferred embodiment of the present invention, an information processing device used in a system that mediates communication between a driver of a mobile body and a user outside the mobile body includes a prediction means for calculating a predicted index value, which is a predicted index value relating to the degree of driving load of the driver of the mobile body, and a display control means for displaying driving load prediction information indicating the predicted index value in a time series for a predetermined period on a terminal device of the user.

The information processing device described above can allow a user outside the vehicle to easily recognize the predicted driving load of the driver in a time series for a predetermined period of time. This allows the user to smoothly communicate with the driver according to the predicted driving load.

In one aspect of the information processing device, the prediction means calculates the prediction index value based on a predicted state of at least one of the driving behavior of the moving body, the driver, or the driving environment during the specified period. This allows the information processing device to accurately calculate the prediction index value of the driving load.

In another aspect of the information processing device, the prediction means predicts the state of the driving behavior or driving environment during the predetermined period based on route information regarding the route of the moving body and the expected arrival time of the moving body at each point on the route. This allows the information processing device to accurately predict the state of the driving behavior or driving environment of the moving body and accurately calculate a predicted index value for the driving load.

In another aspect of the information processing device, the prediction means predicts the state of the driver during the predetermined period based on biological information detected from the driver. With this aspect, the information processing device can calculate a prediction index value for the driving load that takes into account the physical condition of the driver.

In another aspect of the information processing device, the display control means causes the terminal device to display, as the driving load prediction information, a graph showing the relationship between the time in the specified period and the prediction index value at that time. This allows the information processing device to present the prediction results of the driving load in a time series in the specified period to the user of the terminal device in an intuitively easy-to-understand manner.

In another aspect of the information processing device, the display control means causes the terminal device to display a map showing the route of the moving body, and determines the display mode of the route on the map based on the prediction index value. In a preferred example, the display control means may determine the color of the route corresponding to each point on the route based on the prediction index value at each point. This aspect also allows the information processing device to present the prediction results of the driving load in a time series for a predetermined period to the user of the terminal device in an intuitively easy-to-understand manner.

In another preferred embodiment of the present invention, a control method is executed by an information processing device used in a system that mediates communication between a driver of a mobile body and a user outside the mobile body, and includes a prediction step of calculating a predicted index value that is a predicted index value related to the degree of driving load of the driver of the mobile body, and a display control step of displaying driving load prediction information indicating the predicted index value in a time series for a predetermined period on a terminal device of the user. By executing this control method, the information processing device can appropriately recognize the predicted driving load of the driver in a time series for a predetermined period.

In yet another embodiment of the present invention, a program is executed by a computer of an information processing device used in a system that mediates communication between a driver of a mobile body and a user outside the mobile body, the program causing the computer to function as a prediction means for calculating a predicted index value, which is a predicted index value relating to the degree of driving load of the driver of the mobile body, and a display control means for displaying driving load prediction information indicating the predicted index value in a time series for a predetermined period on a terminal device of the user. By executing this program, the computer of the information processing device can preferably recognize the predicted driving load of the driver in a time series for a predetermined period. Preferably, the above program is stored in a storage medium.

Below, a preferred embodiment of the present invention will be described with reference to the drawings.

(1) System configuration
1 shows a configuration example of a driving call system according to a first embodiment. The driving call system has an in-vehicle device 1 installed in a vehicle and an external terminal 2 used by a person outside the vehicle. In the driving call system, the in-vehicle device 1 and the external terminal 2 communicate with each other to mediate a voice call between the driver of the vehicle and the user of the external terminal 2, and the user of the external terminal 2 talks to the driver of the vehicle while checking various information obtained from the vehicle through the external terminal 2.

The on-board device 1 moves with the vehicle and performs processing to realize a call between the driver of the vehicle and the user of the external terminal 2. Hereinafter, the vehicle equipped with the on-board device 1 is also referred to as the "target vehicle". The on-board device 1 performs data communication with the external terminal 2 via a communication network 3 such as the Internet or a dedicated communication network. Data exchanged between the on-board device 1 and the external terminal 2 includes voice data generated during a call between the driver of the target vehicle and the user of the external terminal 2, and display instruction data for displaying information about the target vehicle or the driver. In this embodiment, the on-board device 1 transmits display instruction data including information about the driver's driving load (workload) (also referred to as "workload-related information") to the external terminal 2.

The vehicle-mounted device 1 may be a navigation device that is installed in the target vehicle and provides route guidance to a set destination, or may be a mobile terminal such as a smartphone on which an application that realizes a route guidance function is installed. The vehicle-mounted device 1 may also be incorporated in the target vehicle. The vehicle-mounted device 1 is an example of an "information processing device." The target vehicle is an example of a "mobile body."

The external terminal 2 is a terminal operated by a person outside the target vehicle, and performs data communication with the in-vehicle device 1 via the communication network 3. The external terminal 2 is, for example, a mobile terminal such as a smartphone. For example, the external terminal 2 establishes communication with the in-vehicle device 1 while the target vehicle is being driven, and exchanges voice data with the in-vehicle device 1 for a call between the driver and the user of the external terminal 2. The external terminal 2 also receives display instruction data including workload-related information from the in-vehicle device 1 during the call, and displays the driver's workload status, etc. based on the display instruction data. In this way, the external terminal 2 allows the user of the external terminal 2 to recognize the driver's workload status, and preferably provides information that can be used to determine a convenient timing for talking to the driver. The external terminal 2 is an example of a "terminal device".

The communication between the in-vehicle unit 1 and the external terminal 2 may be realized by being relayed by a server device (not shown). Even if the in-vehicle unit 1 and the external terminal 2 establish direct communication, the in-vehicle unit 1 and/or the external terminal 2 may exchange information (e.g., communication address information, etc.) necessary for the in-vehicle unit 1 and the external terminal 2 to establish communication with the server device. In these cases, the server device performs the processes necessary for the in-vehicle unit 1 and the external terminal 2 to perform data communication (including authentication processes for the in-vehicle unit 1 and the external terminal 2).

(2) Device configuration
2 shows an example of a schematic configuration of the vehicle-mounted device 1. The vehicle-mounted device 1 mainly includes a communication unit 11, a storage unit 12, an input unit 13, a control unit 14, a sensor group 15, a display unit 16, and a sound output unit 17. The elements in the vehicle-mounted device 1 are connected to each other via a bus line 10.

The communication unit 11 performs data communication with other terminals under the control of the control unit 14. For example, the communication unit 11 may receive map data for updating the map DB (Database) 4 from a map management server (not shown).

The storage unit 12 is composed of various types of memory such as RAM (Random Access Memory), ROM (Read Only Memory), and non-volatile memory (including hard disk drive, flash memory, etc.). The storage unit 12 stores programs for the in-vehicle device 1 to execute predetermined processes. The above-mentioned programs may include application programs for making calls, and application programs for causing the external terminal 2 to display maps and images captured in the target vehicle. The storage unit 12 is also used as a working memory for the control unit 14. The programs executed by the in-vehicle device 1 may be stored in a storage medium other than the storage unit 12.

The memory unit 12 also stores a map DB (Data Base) 4. Various data necessary for route guidance is recorded in the map DB 4. The map DB 4 is data necessary for map display based on a specified position such as the current position of the target vehicle. The map DB 4 is a database that includes, for example, road data that represents a road network by a combination of nodes and links, and facility data that indicates facilities that are candidates for a destination, a stop-off point, or a landmark. The map DB 4 may be updated based on information received by the communication unit 11 from a map management server under the control of the control unit 14.

The input unit 13 is a button, a touch panel, a remote controller, a voice input device, etc. that the user operates. The display unit 16 is a display or the like that displays information based on the control of the control unit 14. The sound output unit 17 is a speaker or the like that outputs sound based on the control of the control unit 14.

The sensor group 15 includes various sensors that sense the state of the target vehicle or the environment outside the vehicle. The sensor group 15 includes an exterior camera 51, a driver camera 52, a vehicle behavior detector 53, and a biosensor 54.

The exterior camera 51 is one or more cameras that capture images of the area outside the target vehicle, such as the area in front of the target vehicle, and generates images captured at predetermined time intervals (also called "exterior image"). The driver camera 52 is a camera that is installed so that the driver's face is included in the capture range, and generates images captured at predetermined time intervals (also called "driver image").

The vehicle behavior detector 53 generates detection signals indicating the behavior of the target vehicle, such as the current position, vehicle speed, acceleration, steering angle, etc. The vehicle behavior detector 53 includes, for example, a Global Navigation Satellite System (GNSS) receiver, a gyro sensor, an Inertial Measurement Unit (IMU), a vehicle speed sensor, an acceleration sensor, a steering angle sensor, etc.

The biosensor 54 is one or more sensors that generate biosignals that indicate the driver's biophenomena, such as heart rate and sweat rate.

The sensor group 15 may include various external sensors (including cameras, lidars, radars, ultrasonic sensors, infrared sensors, sonar, etc.) and internal sensors in addition to the exterior camera 51, the driver camera 52, the vehicle behavior detector 53, and the biosensor 54.

The control unit 14 includes a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), etc., and controls the entire in-vehicle device 1. The control unit 14 functions as a "prediction means," a "display control means," a computer that executes programs, etc.

The processing executed by the control unit 14 is not limited to being realized by software using a program, but may be realized by any combination of hardware, firmware, and software. The processing executed by the control unit 14 may also be realized using a user-programmable integrated circuit, such as an FPGA (Field-Programmable Gate Array) or a microcomputer. In this case, the program executed by the control unit 14 in this embodiment may be realized using this integrated circuit.

The configuration of the vehicle-mounted device 1 shown in FIG. 2 is an example, and various modifications may be made to the configuration shown in FIG. 2. For example, instead of the map DB 4 being stored in the memory unit 12, the control unit 14 may receive map information from a map management server (not shown) via the communication unit 11. In another example, at least one of the input unit 13, the display unit 16, and the sound output unit 17 may be provided in the target vehicle as an external device of the vehicle-mounted device 1, and may supply the generated signal to the vehicle-mounted device 1. In addition, at least some of the sensors in the sensor group 15 may be sensors provided in the target vehicle. In this case, the vehicle-mounted device 1 may obtain information output by the sensors provided in the target vehicle from the target vehicle based on a communication protocol such as CAN (Controller Area Network).

Figure 3 shows an example of the schematic configuration of the external terminal 2. The external terminal 2 mainly has a communication unit 21, a memory unit 22, an input unit 23, a control unit 24, a sensor group 25, a display unit 26, and a sound output unit 27. The elements in the external terminal 2 are connected to each other via a bus line 20.

The communication unit 21 performs data communication with other terminals under the control of the control unit 24. The storage unit 22 is composed of various types of memory such as RAM, ROM, and non-volatile memory. The storage unit 22 stores programs for the external terminal 2 to execute predetermined processes. The above-mentioned programs may include application programs for calling the driver, displaying information related to the driving of the target vehicle of the in-vehicle device 1 (including displaying maps and various captured images), and displaying information related to the driver's workload when communication with the in-vehicle device 1 is established. The storage unit 22 is also used as a working memory for the control unit 24. The programs executed by the external terminal 2 may be stored in a storage medium other than the storage unit 22.

The input unit 23 is a button, a touch panel, a remote controller, a voice input device, etc. that the user operates. The display unit 26 is a display or the like that displays information based on the control of the control unit 24. The sound output unit 27 is a speaker or the like that outputs sound based on the control of the control unit 24. The sensor group 25 includes an internal sensor that senses the state of the external terminal 2, and an external sensor that senses the state of the external world of the external terminal 2.

The control unit 24 includes a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), etc., and controls the entire external terminal 2. Note that the configuration of the external terminal 2 shown in FIG. 3 is an example, and various modifications may be made to the configuration shown in FIG. 3.

(3) Display of workload-related information
Next, the display of workload-related information regarding the driving load (workload) of the driver of the target vehicle will be described. In summary, the in-vehicle device 1 predicts the driver's workload over time and displays the prediction result on the external terminal 2. In this way, the in-vehicle device 1 allows the user of the external terminal 2 to recognize the prediction result of the driver's workload over time, and the user of the external terminal 2 can appropriately determine the timing to communicate with the driver.

(3-1) Calculation of Current Workload Value A method for calculating a workload value, which is a value (score) indicating the degree of workload, will be described below. For ease of explanation, it is assumed that a higher workload value indicates a higher degree of the driver's workload. Below, a method for calculating a workload value indicating the current degree of the driver's workload (also referred to as a "current workload value") will be described, and then a method for calculating a workload value indicating a predicted value of the degree of the driver's workload in the future (also referred to as a "predicted workload value") will be described.

The vehicle-mounted device 1 calculates the current workload value based on a score (also called "element-specific score") that evaluates the current state for each element related to the workload (also called "workload-related element"). The workload-related element is an element that represents the state related to the target vehicle, the driver, or the driving environment, and examples of the workload-related element include elements related to the environment of the road (driving road) on which the target vehicle is traveling (also called "road environment element"), elements related to driving behavior (driving operation) that affects the workload (also called "driving behavior element"), and elements related to the driver's physical condition (also called "driver physical condition element"). Note that the workload-related element may be an element obtained by further subdividing at least one of the road environment element, driving behavior element, and driver physical condition element.

Therefore, for example, while communication for a call is established with the external terminal 2, the vehicle-mounted device 1 calculates an element-specific score that evaluates the current state of the target vehicle, the driver, or the driving environment for each workload-related element. Then, the vehicle-mounted device 1 determines the total value, average value, or other representative value of the calculated element-specific scores as the current workload value. Note that the workload-related elements for which the element-specific score is calculated may be all of the road environment elements, driving behavior elements, and driver physical condition elements, or any one of these, or any two of them. In addition, the element-specific score may preferably be weighted according to the degree of influence of each workload-related element on the workload. In this case, for example, the weighting coefficient multiplied by the element-specific score of an element with a high degree of influence on the workload is a larger value, and information indicating these weighting coefficients is stored in advance in the storage unit 12, etc.

Here, when the vehicle-mounted device 1 calculates the element-specific score of the road environment element, for example, the vehicle-mounted device 1 calculates the element-specific score by taking into account at least one of the congestion degree, width, speed limit, and visibility of the traveling road. In this case, for example, the vehicle-mounted device 1 refers to the road information in the map DB 4 or the road traffic information acquired by the communication unit 11, and identifies each degree of the congestion degree, width, speed limit, visibility, etc. of the traveling road, and converts each identified degree into an element-specific score by referring to a predetermined formula or table. The predetermined formula or table is stored in the storage unit 12 or the like in advance. Note that the road environment element may be subdivided into multiple workload-related elements. In this case, for example, the vehicle-mounted device 1 may regard each of the congestion degree, width, speed limit, and visibility of the traveling road as a workload-related element and calculate the element-specific score for each of them.

In addition, when the vehicle-mounted device 1 calculates the element-specific score of the driving operation element, for example, the vehicle-mounted device 1 determines whether the current driving operation corresponds to a driving operation such as a right turn, a left turn, a merge, or a temporary stop, and calculates the element-specific score according to the determined driving operation. In this case, for example, the vehicle-mounted device 1 determines the element-specific score of the driving operation element by referring to a table or the like that associates the corresponding driving operation with the element-specific score of the driving operation element. Here, the vehicle-mounted device 1 may determine the current driving operation based on information obtained by a route guidance process executed when a destination is set (for example, the current position of the target vehicle and the route to the destination), or may determine the current driving operation based on a signal indicating the state of the turn signal or the steering state obtained from the target vehicle. In addition, the vehicle-mounted device 1 may determine the element-specific score of the driving operation element based on the presence or absence of auto-cruise driving (or the presence or absence of other automatic driving functions). The driving operation element may be subdivided into multiple workload-related elements. For example, whether or not to turn right, whether or not to turn left, whether or not to merge, whether or not to stop, and whether or not to drive on auto-cruise are each set as workload-related elements, and the vehicle-mounted device 1 determines the element-specific score for each of these workload-related elements by referring to a predetermined table or the like, depending on the presence or absence of the corresponding driving action.

Furthermore, when calculating the element-specific score of the driver's physical condition element, the vehicle-mounted device 1 calculates the element-specific score by taking into account at least one of the driver's continuous driving time, drowsiness level (alertness level), and other bioindicators that affect driving. In this case, the vehicle-mounted device 1, for example, identifies the drowsiness level or other bioindicators that affect driving based on the signal output by the biosensor 54. The vehicle-mounted device 1 then refers to a predetermined formula or table and converts the identified continuous driving time and one or more bioindicators into an element-specific score of the driver's physical condition element. Note that the driver's physical condition element may be subdivided into multiple workload-related elements. In this case, for example, the vehicle-mounted device 1 may regard each of the drowsiness level and the continuous driving time as a workload-related element and calculate the element-specific score for each of these.

By doing the above, the vehicle-mounted device 1 can determine the current workload value by taking into account various factors that affect the workload.

(3-2) Calculation of Workload Prediction Value Next, a method for calculating the workload prediction value will be described. The vehicle-mounted device 1 calculates a workload prediction value at each time (also called "prediction time") determined for each predetermined time interval during a predetermined future period (also called "prediction period") for which the workload prediction is to be performed. The length of the prediction period and the predetermined time interval may each be a preset value, or may be a setting value (user setting value) based on a user input received from the user via the input unit 13.

In this case, the vehicle-mounted device 1 calculates the workload prediction value for each prediction time based on a score (also called the "element-specific prediction score") that evaluates the predicted state of the target vehicle, driver, or driving environment at the prediction time for each workload-related element. Here, the workload-related elements for which the element-specific prediction score is calculated may be all of the road environment elements, driving behavior elements, and driver physical condition elements, or any one of these, or any two of them. The element-specific prediction score may preferably be weighted according to the degree of influence of each workload-related element on the workload. In this case, for example, the weight coefficient multiplied by the element-specific prediction score of an element with a high degree of influence on the workload is a larger value, and information indicating these weight coefficients is stored in advance in the storage unit 12, etc.

Here, when the vehicle-mounted device 1 calculates the element-specific prediction score of the road environment element, for example, the vehicle-mounted device 1 calculates the element-specific prediction score by taking into account at least one of the congestion degree, width, speed limit, and visibility of the road (also called the "travel prediction road") on which the target vehicle is predicted to travel at the predicted time. In this case, for example, the vehicle-mounted device 1 specifies the travel prediction road at each predicted time based on route information on the route (guidance route) to the destination specified by the user and the predicted arrival time of the target vehicle at each point on the guidance route. Note that the above-mentioned information on the guidance route and the predicted arrival time is generated by the vehicle-mounted device 1 performing a route search process when the user specifies the destination. The route search process may be performed by any method. Then, the vehicle-mounted device 1 refers to the road information in the map DB 4 or the road traffic information acquired by the communication unit 11, etc., to specify the degree of congestion, width, speed limit, visibility, etc. of the planned travel road, and converts each specified degree into an element-specific prediction score by referring to a predetermined formula or table. The predetermined formula or table is stored in advance in the storage unit 12, etc. In addition, the road environment elements may be subdivided into multiple workload-related elements.

When calculating the element-specific prediction score of the driving action element, the vehicle-mounted device 1 determines whether the driving action at the predicted time corresponds to a right turn, left turn, merge, stop, etc., and calculates the element-specific prediction score according to the determined driving action. In this case, for example, the vehicle-mounted device 1 identifies the predicted position of the target vehicle on the guided route at each predicted time based on the route information and the predicted arrival time of the target vehicle at each point on the guided route, and determines whether or not a right turn, left turn, merge, or stop is required at the predicted position in order to move along the guided route. Then, based on the result of the determination of whether or not each driving action is required, the vehicle-mounted device 1 refers to a table or the like that associates the required driving action with the score to be set, and calculates the element-specific prediction score of the driving action element.

In addition, when calculating the element-specific prediction score of the driver's physical condition element, the vehicle-mounted device 1 calculates the element-specific prediction score by taking into account at least one of the driver's continuous driving time at the predicted time, drowsiness level (alertness level), and other bioindicators that affect driving. In this case, the vehicle-mounted device 1, for example, identifies the drowsiness level or other bioindicators that affect driving at the predicted time based on the signals output by the biosensor 54 at present and in the past. In this case, the vehicle-mounted device 1 predicts the bioindicator at the predicted time from the current and past bioindicators based on, for example, any prediction technology. In another example, the vehicle-mounted device 1 assumes that the current state will not change until the predicted time, and assumes the bioindicator at the current time to be the bioindicator at the predicted time. Then, the vehicle-mounted device 1 refers to a predetermined formula or table and converts the identified continuous driving time at the predicted time and one or more bioindicators into an element-specific prediction score of the driver's physical condition element. Note that the driver's physical condition element may be subdivided into multiple workload-related elements.

By doing the above, the vehicle-mounted device 1 can determine the workload prediction value at each prediction time by taking into account various factors that affect the workload.

(3-3) Display Example Fig. 4 shows a first display example of the external terminal 2 when the target vehicle of the in-vehicle device 1 is traveling. The external terminal 2 has established communication with the in-vehicle device 1, and displays the display screen shown in Fig. 4 on the display unit 26 based on the display instruction data received from the in-vehicle device 1.

Here, the display screen shown in FIG. 4 has an outside-vehicle image display area 60, a workload-related information display area 61, and a map display area 62.

The exterior terminal 2 displays the latest exterior image (moving image) generated by the exterior camera 51 on the exterior image display field 60. In this case, the vehicle-mounted device 1 transmits display instruction data including the latest exterior image generated by the exterior camera 51 to the exterior terminal 2.

In addition, the external terminal 2 displays a display window 71 and an indicator 72 in the workload-related information display area 61 based on the workload-related information included in the display instruction data transmitted by the vehicle-mounted device 1.

The display window 71 displays the level of the workload value calculated by the vehicle-mounted device 1. In this case, since the workload value calculated by the vehicle-mounted device 1 is the second lowest level in a five-point evaluation, the display window 71 displays "Low (2/5)."

The indicator 72 is a graph showing the relationship between each predicted time in the prediction period and the degree of the workload at each predicted time. Here, the prediction period is 5 minutes, and the predicted time is a time at 1-minute intervals from the current time. In the indicator 72, a slot (field) of a certain width is assigned to the current time and each predicted time, and each slot is colored according to the level of the workload value for the corresponding current time or predicted time. Here, the vehicle-mounted device 1 uses a more noticeable color (darker color) for slots corresponding to higher levels of workload values. Note that the corresponding predicted time is displayed above each slot, and the corresponding workload value level is displayed below each slot. For example, the vehicle-mounted device 1 generates display instruction data including workload-related information for displaying the indicator 72, and transmits the display instruction data to the external terminal 2 to display the indicator 72 on the external terminal 2. The indicator 72 is an example of "driving load prediction information." Note that the driving load prediction information is display information related to the prediction result of the degree of driving load of the driver of the mobile body.

The external terminal 2 also displays a map of the vicinity of the current position of the target vehicle on the map display area 62. The in-vehicle device 1 generates display instruction data for the external terminal 2 to display the above-mentioned map based on the state of the target vehicle estimated based on the vehicle behavior detector 53, the map DB 4, and information related to route guidance to the destination, and transmits the display instruction data to the external terminal 2. Note that here, in the map display area 62, a current position mark 73 indicating the current position of the target vehicle and a route line 74 indicating the guided route along which the in-vehicle device 1 will guide the driver of the target vehicle are superimposed on the map.

In this way, in the first display example, the in-vehicle device 1 can allow the user of the external terminal 2 to recognize the transition of the driver's workload over time in an optimal manner. This allows the user of the external terminal 2 to take action such as speaking to the driver of the in-vehicle device 1 during a time period when the driver has time to drive (for example, now or 4 to 5 minutes from now).

Figure 5 shows a second display example of the external terminal 2 when the target vehicle of the in-vehicle device 1 is traveling. The external terminal 2 has established communication with the in-vehicle device 1, and displays the display screen shown in Figure 5 on the display unit 26 based on the display instruction data received from the in-vehicle device 1. The external terminal 2 has an external-vehicle captured image display area 60, a workload-related information display area 61, and a map display area 62 on the display screen.

The external terminal 2 displays the latest external image (video) generated by the external camera 51 on the external image display area 60 based on the display instruction data received from the vehicle-mounted device 1. The external terminal 2 also displays a map of the area around the current position of the target vehicle on the map display area 62 based on the display instruction data received from the vehicle-mounted device 1. The external terminal 2 also displays a display window 71 showing the same content as the first display example and an indicator 72A on the workload-related information display area 61 based on the workload-related information included in the display instruction data received from the vehicle-mounted device 1. A graph showing the relationship between the color in the indicator 72A and the magnitude of the workload value is shown below the indicator 72A.

The indicator 72A is a graph showing the relationship between each predicted time in the prediction period and the degree of the workload at each predicted time, and continuously shows the transition of the workload value during the last 5 minutes, which is the prediction period. In this case, the vehicle-mounted device 1 calculates the workload predicted value at any time during the prediction period by interpolation using, for example, the current workload value and the workload predicted value at each predicted time. In this case, the vehicle-mounted device 1 may calculate the workload predicted value at any time during the prediction period using any interpolation method such as spline interpolation. Then, the vehicle-mounted device 1 transmits display instruction data including the workload predicted value at any time during the prediction period to the external terminal 2, and the external terminal 2 displays the indicator 72A based on the received display instruction data. Note that the above-mentioned interpolation process may be performed by the external terminal 2 instead of the vehicle-mounted device 1. The indicator 72A is an example of "driving load prediction information".

In this way, even in the second display example, the in-vehicle device 1 can allow the user of the external terminal 2 to easily recognize the change in the driver's workload over time. This allows the user of the external terminal 2 to take action such as talking to the driver of the in-vehicle device 1 during a time period when the driver has free time to drive.

Figure 6 shows a third display example of the external terminal 2 when the target vehicle of the in-vehicle device 1 is traveling. The external terminal 2 has established communication with the in-vehicle device 1, and displays the display screen shown in Figure 6 on the display unit 26 based on the display instruction data received from the in-vehicle device 1. The external terminal 2 has an external-vehicle captured image display field 60, a workload-related information display field 61, and a map display field 62 on the display screen. Here, the display contents of the external-vehicle captured image display field 60 and the workload-related information display field 61 are the same as those in the first display example, so their explanation will be omitted.

Here, the display mode of the route line 74A in the map display area 62 is determined based on the workload prediction value. More specifically, the vehicle-mounted device 1 causes the external terminal 2 to display the route line 74A, which is color-coded for each section according to the workload prediction value (and the workload current value), together with a current position mark 73 indicating the current position of the target vehicle on a map around the current position of the target vehicle in the map display area 62. In this case, the vehicle-mounted device 1 determines the color of the route line 74A corresponding to each point on the guide route indicated by the route line 74A based on the workload prediction value (and the workload current value) at each point.

Here, the vehicle-mounted device 1 assigns colors to the route line 74A according to the same rules as the indicator 72, thereby associating each slot of the indicator 72 with a corresponding section of the route line 74A and displaying them on the external terminal 2. For example, the level of the workload prediction value in the driving section from the current position of the target vehicle to the position just before the first right turn point is "2", which is the same as the level of the workload current value, so the vehicle-mounted device 1 determines the color scheme of the driving section of the route line 74A in the same color as the slot corresponding to "present" of the indicator 72. On the other hand, the level of the workload prediction value in the driving section from the position just before the first right turn point to the first left turn point is "3", which is the same as the level of the workload prediction value one minute later and two minutes later, so the vehicle-mounted device 1 determines the color scheme of the driving section of the route line 74A in the same color as the slot corresponding to "one minute later" and "two minutes later" of the indicator 72. In addition, since the level of the workload prediction value in the driving section from the first left turn point to the second right turn point is "4", which is the same as the level of the workload prediction value three minutes later, the vehicle-mounted device 1 draws that driving section of the route line 74A in the same color as the slot corresponding to "3 minutes later" on the indicator 72. Since the level of the workload prediction value in the driving section after the second right turn point is "2", which is the same as the level of the workload prediction value four minutes later and five minutes later, the vehicle-mounted device 1 determines the color scheme of that driving section of the route line 74A in the same color as the slots corresponding to "4 minutes later" and "5 minutes later" on the indicator 72.

After generating the map display information to be displayed by the external terminal 2 in the map display field 62, the in-vehicle device 1 supplies display instruction data including the generated map display information to the external terminal 2, and the external terminal 2 displays the map display field 62 shown in FIG. 6 based on the received map display information. The map display information in the third display example is an example of "driving load prediction information."

In this way, in the third display example, the in-vehicle device 1 determines the display mode of the guide route at the predicted position of the corresponding target vehicle according to the change in the workload prediction value over time. This allows the user of the external terminal 2 to refer to a map of the area around the current position of the target vehicle and decide the right timing to communicate with the driver.

Note that the display layouts in the first to third display examples are merely examples, and various modifications may be applied. For example, the exterior terminal 2 may display an image captured by the driver instead of an image captured outside the vehicle, based on an operation of the user of the exterior terminal 2 on the exterior terminal 2. In another example, the exterior terminal 2 may provide only one of the exterior captured image display field 60 and the map display field 62 on the display screen. In yet another example, the exterior terminal 2 may provide only the workload related information display field 61 on the display screen. In yet another example, when performing the map display of the third display example, the exterior terminal 2 may only perform the map display of the third display example.

(4) Processing flow
Fig. 7 is an example of a flowchart showing a procedure of a process executed by the vehicle-mounted device 1. The vehicle-mounted device 1 executes the process of the flowchart shown in Fig. 7 when communication with the external terminal 2 is established and a call is started.

First, the vehicle-mounted device 1 calculates an element-specific score at the current time for each workload-related element related to the workload of the driver of the target vehicle and an element-specific predicted score at each predicted time (step S101). In this case, the vehicle-mounted device 1 calculates an element-specific score for each element at the current time, such as a road environment element, a driving operation element, a driver's physical condition element, or a subdivision of these, and an element-specific predicted score for each element at each predicted time, based on the data output by the map DB 4 and the sensor group 15.

Next, the vehicle-mounted device 1 calculates the current workload value and the predicted workload value at each predicted time based on the element-specific score or the predicted element-specific score for the corresponding time (step S102). In this case, the vehicle-mounted device 1 calculates the current workload value based on the element-specific score corresponding to the current time, and calculates the predicted workload value at each predicted time based on the predicted element-specific score corresponding to each predicted time. In this case, the vehicle-mounted device 1 may calculate a workload value by adding up or averaging (including the case where a weighting factor is used) the element-specific scores for each time, or may calculate a workload value for each time by substituting the element-specific score for each time into a calculation formula for the workload value stored in advance in the storage unit 12, etc.

Next, the on-board device 1 supplies display instruction data related to the current workload value and the predicted workload value to the external terminal 2 (step S103). In this case, the external terminal 2 performs display showing the transition of the workload value in time series during the prediction period based on the workload-related information included in the display instruction data. Note that if the display instruction data includes at least one of an image taken outside the vehicle, an image of the driver, or map display information for displaying a map around the current position, the external terminal 2 may perform display based on at least one of the image taken outside the vehicle, the image of the driver, or the map display information. Also, when the on-board device 1 generates map display information showing a map reflecting the current workload value and the predicted workload value as in the third display example, the on-board device 1 regards the map display information as part of the workload-related information and supplies display instruction data including the map display information to the external terminal 2.

Then, the vehicle-mounted device 1 determines whether the call has ended (step S104). If the vehicle-mounted device 1 determines that the call has ended (step S104; Yes), it ends the processing of the flowchart. On the other hand, if the vehicle-mounted device 1 determines that the call has not ended (step S104; No), it returns the processing to step S101.

(5) Modifications
Next, preferred modifications of the above-mentioned embodiment will be described. The following modifications may be combined and applied to the above-mentioned embodiment.

(Variation 1)
At least a part of the processing executed by the vehicle-mounted device 1 may be executed by a server device that performs data communication with the vehicle-mounted device 1 and the external terminal 2 .

Figure 8 shows an example of the configuration of a driving call system according to a modified example. The driving call system has an in-vehicle device 1A, an external terminal 2, and a server device 5. The in-vehicle device 1A and the server device 5, and the external terminal 2 and the server device 5 each perform data communication via the communication network 3.

The vehicle-mounted device 1A has the same configuration as the vehicle-mounted device 1 described in the first embodiment above (see FIG. 2). Note that, if the server device 5 performs processing based on the map DB 4, the vehicle-mounted device 1A does not need to have the map DB 4. The vehicle-mounted device 1A then transmits to the server device 5 an upload signal including information output by the sensor group 15 and input information input by the input unit 13.

The server device 5 relays data necessary for a voice call between the in-vehicle device 1A and the external terminal 2. During a voice call, the server device 5 generates display instruction data based on an upload signal or the like received from the in-vehicle device 1A, and transmits the generated display instruction data to the external terminal 2. Specifically, during a voice call, the server device 5 executes the process of the flowchart shown in FIG. 7 based on an upload signal or the like received from the in-vehicle device 1A.

Figure 9 shows an example of the schematic configuration of the server device 5. The server device 5 mainly has a communication unit 41, a storage unit 42, and a control unit 44. The elements in the server device 5 are connected to each other via a bus line 40.

The communication unit 41 performs data communication with external devices such as the in-vehicle unit 1A and the external terminal 2 under the control of the control unit 44. The storage unit 42 is composed of various types of memory such as RAM, ROM, and non-volatile memory (including a hard disk drive, flash memory, etc.). The storage unit 42 stores programs for the server device 5 to execute predetermined processes. The storage unit 42 also includes a map DB 4. The control unit 44 includes a CPU, GPU, etc., and controls the entire server device 5. The control unit 44 also executes the programs stored in the storage unit 42 to perform processes required to display workload-related information on the external terminal 2.

In this way, even if the server device 5 executes the processing required to display workload-related information on the external terminal 2, the driving call system, as in the embodiment, allows the user of the external terminal 2 to easily recognize the driver's workload state, and enables the user to choose a convenient time to talk to the driver. In this modified example, the server device 5 is an example of an "information processing device."

(Variation 2)
Even if a guide route to the destination has not been set, the vehicle-mounted unit 1 may determine a predicted route along which the target vehicle is predicted to travel based on the driving history of the target vehicle, and calculate an element-specific prediction score for the prediction period based on the predicted route.

In this case, the storage unit 12 stores driving history information indicating the driving history of the target vehicle regarding the roads, etc. on which the target vehicle has traveled. The vehicle-mounted device 1 then refers to the driving history information and determines the predicted route from the current position of the target vehicle. For example, the vehicle-mounted device 1 determines the most frequently traveled route as the predicted route among the routes indicated by the past driving history of the target vehicle, including the current position of the target vehicle. The vehicle-mounted device 1 then calculates the predicted arrival time of the target vehicle at each point on the predicted route, and identifies the planned road or predicted position of the target vehicle at each predicted time. This allows the vehicle-mounted device 1 to determine the element-specific prediction scores of the road environment elements and the element-specific prediction scores of the driving operation elements, etc., in the same manner as in the above-mentioned embodiment.

As described above, the in-vehicle device 1 or the server device 5 is an information processing device used in a system that mediates communication between a driver of a target vehicle, which is a moving body, and a user of an external terminal 2 located outside the target vehicle, and has a prediction means and a display control means. The prediction means calculates a workload prediction value, which is a prediction value of an index value related to the degree of driving load of the driver of the target vehicle. Then, the display control means causes the external terminal 2 to display driving load prediction information indicating the workload prediction value in a time series during the prediction period. This makes it possible for the in-vehicle device 1 or the server device 5 to suitably provide the user of the external terminal 2 with information that will serve as material for appropriately determining the timing to communicate with the driver.

In each of the above-mentioned embodiments, the program can be stored using various types of non-transitory computer readable media and supplied to a control unit, which is a computer. Non-transitory computer readable media include various types of tangible storage media (tangible storage media). Examples of non-transitory computer readable media include magnetic storage media (e.g., flexible disks, magnetic tapes, hard disk drives), magneto-optical storage media (e.g., magneto-optical disks), CD-ROMs (Read Only Memory), CD-Rs, CD-R/Ws, semiconductor memories (e.g., mask ROMs, PROMs (Programmable ROMs), EPROMs (Erasable PROMs), flash ROMs, and RAMs (Random Access Memory).

Although the present invention has been described above with reference to the embodiments, the present invention is not limited to the above-mentioned embodiments. Various modifications that a person skilled in the art can understand can be made to the configuration and details of the present invention within the scope of the present invention. In other words, the present invention naturally includes various modifications and amendments that a person skilled in the art could make in accordance with the entire disclosure, including the scope of the claims, and the technical ideas. In addition, the disclosures of the above cited patent documents and the like are incorporated into this document by reference.

1, 1A Vehicle-mounted device 2 External terminal 3 Communication network 4 Map DB
5 Server device 11, 21, 41 Communication unit 12, 22, 42 Storage unit 13 Input unit 14, 24, 44 Control unit 15, 25 Sensor group 16, 26 Display unit 17, 27 Sound output unit

Claims (10)

An information processing device used in a system that mediates communication between a driver of a moving body and a user outside the moving body, comprising:
A prediction means for calculating a predicted index value which is a predicted value of an index value relating to a degree of a driving load of a driver of the moving body;
A display control means for displaying driving load prediction information indicating the prediction index value in a time series for a predetermined period on a terminal device of the user;
An information processing device having the above configuration. The information processing device according to claim 1, wherein the prediction means calculates the prediction index value based on a predicted state of at least one of the driving behavior of the moving body, the driver, or the driving environment during the specified period. The information processing device according to claim 2, wherein the prediction means predicts the state of the driving behavior or the driving environment during the predetermined period based on route information regarding the route of the moving body and the expected arrival time of the moving body at each point on the route. The information processing device according to claim 2, wherein the prediction means predicts the state of the driver during the predetermined period based on biometric information detected from the driver. The information processing device according to any one of claims 1 to 4, wherein the display control means causes the terminal device to display, as the driving load prediction information, a graph showing the relationship between the time in the predetermined period and the prediction index value at that time. The information processing device according to any one of claims 1 to 4, wherein the display control means causes the terminal device to display a map showing the route of the moving object, and determines the display mode of the route on the map based on the prediction index value. The information processing device according to claim 6, wherein the display control means determines the color of the route corresponding to each point on the route based on the predicted index value at each point. A control method executed by an information processing device used in a system that mediates communication between a driver of a moving body and a user present outside the moving body, comprising:
A prediction step of calculating a predicted index value which is a predicted value of an index value related to a degree of a driving load of a driver of the moving body;
a display control step of displaying, on a terminal device of the user, driving load prediction information indicating the prediction index value in a time series for a predetermined period of time;
The control method includes: A program executed by a computer of an information processing device used in a system that mediates communication between a driver of a moving body and a user outside the moving body, comprising:
A prediction means for calculating a predicted index value which is a predicted value of an index value relating to a degree of a driving load of a driver of the moving body;
A program that causes a computer to function as a display control means for displaying, on a terminal device of the user, driving load prediction information indicating the prediction index value in a time series for a predetermined period of time. A storage medium storing the program according to claim 9.