JP7443908B2 - Control device, information processing system, and control method - Google Patents

Description

The present disclosure relates to a control device, an information processing system, and a control method.

2. Description of the Related Art There is a known technology that detects the state of a vehicle interior space based on information from an in-vehicle device such as a sensor, and presents the detection results. For example, Patent Document 1 discloses an in-vehicle inspection that sends a predetermined message to the inside of the car when a difference is detected by comparing pre-stored comparison data and current video data captured by a camera inside the car. An apparatus is disclosed.

Furthermore, various technologies have been developed for determining the state of a user staying in a vehicle interior space based on information from an in-vehicle device. For example, there are techniques that determine the level of drowsiness of a user based on information from an on-vehicle sensor.

Japanese Patent Application Publication No. 2013-191053

By the way, in recent years, there has been a need to spend meaningful time in the interior of a car. However, each of the above-mentioned conventional technologies performs a specific output in a specific state, and does not improve the quality of the user's stay in the vehicle interior space.

One aspect of the present disclosure aims to enable a user to spend meaningful time in a vehicle interior space.

In order to solve the above problems, a control device according to one aspect of the present disclosure includes a sensor information acquisition unit that acquires sensor information regarding a user staying in a vehicle interior space from an in-vehicle sensor, and a sensor information acquisition unit that acquires sensor information regarding a user staying in a vehicle interior space, and a an evaluation value calculation unit that calculates an evaluation value of the user based on at least a part of the sensor information; a presentation unit that presents the evaluation value to the user via a display device; a target value calculation unit that calculates the user's target value for each of the plurality of evaluation axes based on the goal input by the user, and the presentation unit further includes the user's target value for each evaluation axis. The method is characterized in that an evaluation value and the target value for each evaluation axis are presented to the user.

According to the above configuration, it is possible to present to the user a target value that is a numerical value of the user's goal, and an evaluation value that is a numerical value that is an evaluation based on objective information such as sensor information. Therefore, the user can materialize his or her goals and obtain an objective evaluation of himself or herself while staying in the vehicle interior space. Therefore, the user can spend meaningful time in the space inside the car.

In the control device, the presentation unit may present the evaluation value and the target value in a graph. According to the above configuration, the evaluation value and the target value can be presented so that the user can understand them at a glance.

The control device may include a training determining unit that determines one or more types of training based on a difference between the evaluation value and the target value for each of the plurality of evaluation axes, and the training is determined based on the evaluation value. The training may be performed in the interior of the vehicle, and the presentation unit of the control device may display the training determined by the training determination unit via the display device. Training may be presented to the user.

According to the above configuration, training that can be done in the interior of the car in order to approach the goal input by the user is presented to the user. Therefore, by performing the presented training, the user can make meaningful use of the time spent in the vehicle interior.

The control device may include a log data creation unit that creates evaluation value log data that includes at least the evaluation value calculated by the evaluation value calculation unit and the calculation date and time of the evaluation value, and the control device The training determining unit may determine the training based on the evaluation value log data of the user and a difference between the evaluation value and the target value.

According to the above configuration, training can be determined in consideration of evaluation values calculated in the past. Therefore, according to the above configuration, it is possible to present training that is more effective for achieving a goal to the user.

In the control device, the training may include operations related to driving a vehicle having the interior space.

According to the above configuration, the user can train to achieve his or her goals by driving the vehicle. Therefore, the user can effectively utilize the time spent driving the vehicle to perform training.

In the control device, the training may be performed using various devices mounted on a vehicle having the interior space, and the control device may be configured to perform the training based on the usage status of the various devices. It may also include an execution detection unit that performs detection. The sensor information acquisition unit of the control device may reacquire the sensor information when the execution detection unit detects execution of the training, and the evaluation value calculation unit may acquire the sensor information again from the reacquired sensor information. The user's evaluation value for each of the plurality of evaluation axes may be recalculated based on the information, and the presentation unit may calculate the recalculated evaluation value and the previously calculated evaluation value. At least one of the differences from the evaluation value may be presented to the user via the display device.

According to the above configuration, changes in evaluation values due to execution of training can be presented to the user. This makes it possible to show the user the effects actually obtained from the training.

The control device may include an achievement determination unit that determines whether the recalculated evaluation value is equal to or greater than the target value for each evaluation axis, and the presentation unit of the control device may include an achievement determination unit that determines whether the recalculated evaluation value is equal to or greater than the target value. When the determination unit determines that the recalculated evaluation value for at least one evaluation axis is equal to or greater than the target value, a notification indicating that the target value has been reached may be presented to the user.

According to the above configuration, it is possible to notify that the user's current evaluation, in which the evaluation value is equal to or greater than the target value, has reached the target value related to the goal input by the user.

In the control device, the in-vehicle sensor may include at least one camera, and the sensor information may include image data including an image of the user captured by the camera; The evaluation axes may include an evaluation axis related to appearance. The evaluation value calculation unit of the control device may calculate the user's evaluation value on the evaluation axis regarding the appearance based on the image data.

According to the above configuration, the user can obtain an objective evaluation of his or her appearance diagnosed from images taken by the camera while staying in the vehicle interior space.

In the control device, the in-vehicle sensor may include at least one biosensor, and the sensor information may include biometric information of the user measured or acquired by the biosensor. The evaluation axes may include an evaluation axis related to health status. The evaluation value calculation unit of the control device may calculate the evaluation value of the user on the evaluation axis related to the health condition based on the biological information.

According to the above configuration, the user can obtain an objective evaluation of his or her health condition diagnosed from biological information while staying in the vehicle interior space.

In the control device, the in-vehicle sensor may include at least a microphone, and the sensor information may include audio data including utterances of the user. The evaluation axis may include an evaluation axis related to human personality tendency or thinking tendency, and the evaluation value calculation unit calculates the evaluation value of the user on the evaluation axis related to human personality tendency or thinking tendency. may be calculated based on the result of voice recognition of the voice data.

According to the above configuration, the user can obtain an objective evaluation of his or her inner state diagnosed from the audio data while staying in the vehicle interior space.

In order to solve the above problems, an information processing system according to one aspect of the present disclosure includes the control device, the on-vehicle sensor, the input device, and the display device. According to the above configuration, the same effects as those of the control device can be achieved.

In order to solve the above problems, a control method according to an aspect of the present disclosure is a control method for a control device, and includes sensor information acquisition for acquiring sensor information regarding a user staying in a vehicle interior space from a vehicle-mounted sensor. an evaluation value calculation step of calculating the user's evaluation value for each of the plurality of evaluation axes based on at least a portion of the sensor information; and presenting the evaluation value to the user via a display device. a first presentation step; a target value calculation step of calculating the user's target value for each of the plurality of evaluation axes based on the goal input by the user via an input device; and the user regarding each evaluation axis. and a second presenting step of presenting the evaluation value of and the target value for each evaluation axis to the user. According to the above configuration, the same effects as those of the control device can be achieved.

According to one aspect of the present disclosure, a user can spend meaningful time in a vehicle interior space.

1 is a block diagram showing a main part configuration of an information processing system according to a first embodiment; FIG. FIG. 2 is a diagram illustrating an example arrangement of an on-vehicle sensor, a display device, an input device, and an audio output device. It is a flow chart which shows the flow of processing concerning presentation of evaluation value and target value. FIG. 2 is a diagram showing an example of an image displayed on a display device. FIG. 2 is a diagram showing an example of an image displayed on a display device. FIG. 2 is a diagram showing an example of an image displayed on a display device. FIG. 2 is a diagram showing an example of an image displayed on a display device. It is a flowchart which shows the flow of the process which determines training and presents it to a user. FIG. 2 is a diagram showing an example of an image displayed on a display device. FIG. 2 is a diagram showing an example of an image displayed on a display device. FIG. 2 is a block diagram showing the configuration of main parts of an information processing system according to a second embodiment.

[Embodiment 1]
≪Main part configuration≫
A first embodiment of the present invention will be described below. FIG. 1 is a block diagram showing the configuration of main parts of an information processing system 100 according to the first embodiment. Information processing system 100 includes at least information processing device 1 , in-vehicle sensor 2 , display device 3 , and input device 4 . Further, the information processing system 100 may include an audio output device 5 and an in-vehicle device 6. In this embodiment, the information processing device 1, the on-board sensor 2, the display device 3, the input device 4, the audio output device 5, and the on-board device 6 are arranged in the interior space of the vehicle 9. The specific type of vehicle 9 is not particularly limited. An example of the vehicle 9 is a passenger car. Further, the information processing device 1, the in-vehicle sensor 2, the display device 3, the input device 4, the audio output device 5, and the in-vehicle device 6 are each connected by wire or wirelessly. The specific connection method between the information processing device 1 and each device is not particularly limited.

(In-vehicle sensor 2)
The on-vehicle sensor 2 consists of one or more sensors mounted on the vehicle 9. The on-vehicle sensor 2 measures or acquires various information regarding a person staying in the interior space of the vehicle 9. The in-vehicle sensor 2 transmits various measured or acquired information to the information processing device 1 .

Hereinafter, a person staying in the interior space of the vehicle 9, that is, a user of the vehicle 9, will be simply referred to as a "user." Furthermore, information regarding the user that is measured or acquired by the on-vehicle sensor 2 is referred to as "sensor information." Sensor information includes, for example, still image and video data of the user, various vital data such as the user's pulse, breathing rate, body temperature, and blood pressure, and audio data including the user's utterances. , or at least one of them. The information processing system 100 according to the present embodiment includes a camera 21 , a biological sensor 22 , and a microphone 23 as an example of the in-vehicle sensor 2 .

The camera 21 photographs an image including at least a portion of the user's appearance, and transmits the image data to the information processing device 1. Note that the image taken by the camera 21 may be a still image or a moving image. The biosensor 22 measures or acquires the user's vital data. The biosensor 22 may be, for example, a sensor that measures the user's muscle percentage or body fat percentage. Furthermore, the biosensor 22 may be, for example, a sensor that measures the user's pulse. The microphone 23 acquires sounds from the surroundings, that is, inside the vehicle, converts them into audio data, and transmits the audio data to the information processing device 1 . When the user speaks, the microphone 23 acquires the sound including the user's speech and converts it into audio data.

In addition, the vehicle-mounted sensor 2 may also include a pressure sensor that measures the pressure applied to the seat when a user sits on the seat. Further, the number and arrangement of the on-vehicle sensors 2, and the type of sensor information acquired by the on-vehicle sensors 2 are not particularly limited.

(Display device 3 and input device 4)
The display device 3 displays images under the control of the information processing device 1. The input device 4 receives a user's input operation, and transmits input information indicating the content of the input operation to the information processing device 1. For example, upon receiving an input operation for inputting a user's goal, the input device 4 transmits input information, that is, information indicating the user's goal to the information processing device 1 .

The display device 3 is realized by, for example, a liquid crystal display attached to the vehicle 9. The input device 4 is realized by, for example, a physical button arranged on a dashboard or a liquid crystal display, a touch screen, or the like. Note that the display device 3 and the input device 4 may be configured integrally. In this embodiment, the vehicle 9 is assumed to be a touch panel display in which a display as the display device 3 and a touch panel as the input device 4 are integrated.

(Information processing device 1)
The information processing device 1 is a device that creates various information to be provided to users. The information processing device 1 includes a control section (control device) 10 and a storage section 11. The control unit 10 controls the information processing device 1 in an integrated manner. The storage unit 11 stores various data necessary for the operation of the information processing device 1.

(Control unit 10)
The control unit 10 includes a sensor information acquisition unit 101, an evaluation value calculation unit 102, a presentation unit 103, an input information acquisition unit 104, a target value calculation unit 105, and a training determination unit 106. Further, the control unit 10 may include a voice control unit 107 and a log data creation unit 108.

The sensor information acquisition unit 101 acquires sensor information from the in-vehicle sensor 2. The sensor information acquisition unit 101 outputs the acquired sensor information to the evaluation value calculation unit 102.

The evaluation value calculation unit 102 calculates the user's evaluation value for each of the plurality of evaluation axes based on the sensor information. The evaluation value calculation unit 102 first determines the evaluation axis of the user to be evaluated. Here, "evaluation axis" means an evaluation policy. For example, the evaluation value calculation unit 102 may select a plurality of evaluation axes from the evaluation axes set in the evaluation axis setting database (DB) 113 stored in the control unit 12, and use them as the user's evaluation axes.

The evaluation axis setting DB 113 is a database containing information indicating at least a plurality of evaluation axes. The evaluation axis setting DB 113 may be, for example, a data table that holds data in which evaluation axes are associated with selection conditions for the evaluation axes as one record. The "evaluation axis selection condition" may be, for example, the type of sensor information. That is, one record of the evaluation axis setting DB may be information that associates a certain evaluation axis with sensor information that allows calculation of evaluation values along the evaluation axis. In this case, the evaluation value calculation unit 102 may select an evaluation axis corresponding to the type of sensor information input from the sensor information acquisition unit 101 from the evaluation axis setting DB 113 as the evaluation axis of the user to be evaluated.

Note that the evaluation axis setting DB 113 is not an essential configuration. Furthermore, the evaluation axis selection method of the evaluation value calculation unit 102 is not limited to the above-mentioned method. The evaluation value calculation unit 102 may determine the evaluation axis according to the type of sensor information input to the evaluation value calculation unit 102, for example. For example, the evaluation value calculation unit 102 may determine the evaluation axis based on a user's instruction input via the input device 4. Further, for example, the evaluation axis may be determined in advance.

The specific content of the evaluation axis is not particularly limited. For example, the evaluation axis may be an evaluation axis regarding the user's appearance. The evaluation value calculation unit 102 can calculate the evaluation value on the evaluation axis by evaluating the user's appearance from the image taken by the camera 21.

Further, for example, the evaluation axis may be an evaluation axis related to the user's health condition. The evaluation value calculation unit 102 can calculate the evaluation value on the evaluation axis by evaluating the user's health condition from the image taken by the camera 21 or the biological information from the biological sensor 22.

Further, for example, the evaluation axis may be an evaluation axis related to the user's personality tendency or thinking tendency. Furthermore, for example, the evaluation axis may be an evaluation axis related to the tendency of the user's sense of values. The evaluation value calculation unit 102 evaluates the user's personality tendency, thinking tendency, and value tendency from the user's voice itself or the utterance content indicated by the voice data included in the voice data of the microphone 23, and It is possible to calculate the evaluation value on the evaluation axis. For example, the brightness of the user's personality may be evaluated according to the pitch of the user's voice and the speed of speech. Furthermore, the strength of the user's tendency toward a specific thought or specific value may be identified from the tendency of words included in the user's utterance content.

After determining the evaluation axes, the evaluation value calculation unit 102 next calculates the user's evaluation value for each evaluation axis. The "evaluation value" is an index value when a user is evaluated along a certain evaluation axis based on at least part of the sensor information. In other words, the evaluation value is a numerical value of the user's evaluation regarding a certain evaluation axis based on objective information such as sensor information.

Note that the specific method of calculating the evaluation value is not particularly limited. If the evaluation axis is an evaluation axis related to the user's appearance, the evaluation value calculation unit 102 may calculate the evaluation value based on the data of the image taken by the camera 21, for example. Further, when the evaluation axis is an evaluation axis related to the user's health condition, the evaluation value calculation unit 102 may calculate the evaluation value based on biological information measured or acquired by the biological sensor 22. Further, when the evaluation axis is an evaluation axis related to the user's personality tendency or thinking tendency, the evaluation value calculation unit 102 may calculate the evaluation value based on the result of voice recognition of the voice data acquired by the microphone 23. . For example, the control unit 10 may input the voice data acquired by the sensor information acquisition unit 101 to the learned model 111, thereby causing the learned model 111 to recognize the voice data. Then, the control unit 10 may acquire the voice recognition result from the trained model 111 and use the voice recognition result to calculate the evaluation value in the evaluation value calculation unit 102.

The evaluation value calculation unit 102 outputs to the presentation unit 103 and the training determination unit 106 information in which information indicating the selected plurality of evaluation axes is associated with the evaluation value calculated for each evaluation axis. Hereinafter, information in which information indicating a plurality of selected evaluation axes is associated with evaluation values calculated for each evaluation axis will be referred to as "evaluation information." When the control unit 10 includes the log data creation unit 108, the evaluation value calculation unit 102 also outputs evaluation information to the log data creation unit 108. Furthermore, the evaluation value calculation unit 102 outputs information indicating the selected plurality of evaluation axes or evaluation information to the target value calculation unit 105.

The input information acquisition unit 104 acquires input information from the input device 4. When the input information acquisition unit 104 acquires input information indicating the user's goal, the input information acquisition unit 104 outputs the input information to the target value calculation unit 105. Note that the input information acquisition unit 104 may acquire various input information in addition to the input information indicating the user's goal. For example, the input information acquisition unit 104 may acquire input information indicating a user's instruction to change the display on the display device 3. Further, the input information acquisition unit 104 may acquire information indicating the user's desired training policy as input information.

The target value calculation unit 105 calculates the user's target value for each of the plurality of evaluation axes based on the user's target. "Target value" is an index value that quantifies the user's goal from the viewpoint of a certain evaluation axis.

The target value calculation unit 105 acquires information indicating a plurality of selected evaluation axes or evaluation information from the evaluation value calculation unit 102. In this state, when the target value calculation unit 105 acquires input information indicating the user's goal, the target value calculation unit 105 calculates the following values for each evaluation axis indicated by the acquired evaluation information (or information indicating a plurality of evaluation axes). Calculate the user's target value. That is, the “multiple evaluation axes” in the target value calculation unit 105 are the same as the “multiple evaluation axes” selected in the evaluation value calculation unit 102. Note that the specific method for calculating the target value is not particularly limited.

Target value calculation section 105 outputs the calculated target value to presentation section 103 and training determination section 106. When the control unit 10 includes the log data creation unit 108, the target value calculation unit 105 may output the target value to the log data creation unit 108.

Upon acquiring the evaluation information and the target value, the training determining unit 106 determines one or more types of training based on the difference between the evaluation value and the target value for each of the plurality of evaluation axes indicated by the evaluation information. Here, "training" is training for bringing the evaluation value on any evaluation axis closer to the target value on the same evaluation axis, and is training performed in the interior space of the vehicle 9. The training determining unit 106 outputs information indicating the determined training to the presenting unit 103.

The specific content of the training is not particularly limited. For example, training does not have to be physical training. For example, the training may be training to improve the user's communication skills, or training to improve the user's personality or thinking tendencies.

For example, the training may not be performed actively by the user, but may be performed passively by staying in the vehicle 9. Specifically, for example, a seat whose shape is at least partially variable may be changed to a shape that allows a user to train specific muscles by sitting on the seat. This allows the user to train specific muscles simply by sitting on the seat. Therefore, the training can be expected to have the effect of increasing evaluation values on evaluation axes such as "muscle mass" or "muscle percentage".

Alternatively, for example, a seat whose shape is variable at least in part may be changed to a shape that improves the position of a specific part of the user's body when the user sits on the seat. Thereby, the user can improve his or her blood circulation, that is, improve his/her health condition, simply by sitting on the seat. Therefore, the training can be expected to have the effect of increasing evaluation values on evaluation axes such as "good complexion" or "skin condition".

Note that the training may be performed using the in-vehicle device 6. For example, the training may include actions related to driving the vehicle 9. Here, the "operations related to driving" may include, for example, operations on the steering wheel, accelerator, and brake of the vehicle 9. In this way, by including driving-related actions in the training, the user can train to achieve his or her goals by driving the vehicle 9. Therefore, the user can effectively utilize the time spent driving the vehicle to perform training. More specifically, the training may include driving methods that do not put a burden on the passenger, such as not slamming on the brakes. The training may have an effect of increasing the evaluation value indicating the user's kindness.

Furthermore, the method for determining training is not particularly limited. In this embodiment, as an example, a training DB 112 is stored in the storage unit 11, and the training determining unit 106 refers to the training DB 112 to determine the training to be presented to the user.

The training DB 112 is a database that defines training and its effects. One record of the training DB 112 indicates data regarding one training. Each record in the training DB 112 associates training identification information, an evaluation axis on which the training has an effect, and an amount of variation in the evaluation value on the evaluation axis. The training identification information is information for uniquely identifying the training, such as the name of the training. The amount of variation in evaluation value is the amount of increase or decrease in evaluation value per unit time or unit amount of training.

The training determining unit 106 may determine training using the following method, for example. That is, the training determining unit 106 first identifies an evaluation axis whose evaluation value is less than the target value from the evaluation information and the target value. Hereinafter, the evaluation axis specified here will be referred to as the "goal unattainment evaluation axis." The training determining unit 106 refers to the training DB 112 and extracts one or more trainings that can increase the evaluation value for the target unachievement evaluation axis. The training determining unit 106 determines the training to be presented to the user from the extracted training. As described above, an upper limit may be set on the number of trainings presented to the user.

Note that, as described above, since there are multiple evaluation axes, there may also be multiple target unachievement evaluation axes. When there are multiple goal unattainment evaluation axes, the training determining unit 106 refers to the training DB 112 and selects training that is effective (that is, can increase the evaluation value) for each of the multiple goal unattainment evaluation axes. Extract. Next, the training determining unit 106 determines the training to be presented to the user from among the extracted trainings so as to obtain effects on as many target non-attainment evaluation axes as possible by combining one or more trainings. . As a result, when the user executes the training determined by the training determining unit 106, it is possible to achieve more of the target value input by the user, that is, the target desired by the user.

Further, it is desirable that the training determining unit 106 preferentially adopt training that is effective for evaluation axes in which the difference between the evaluation value and the target value is large as the training to be presented to the user. This allows the user to efficiently achieve his or her goals when performing training.

Further, the training determining unit 106 may acquire input information indicating a desired training policy from the input information acquiring unit 104. Then, the training determining unit 106 performs one training based on the difference between the evaluation value indicated by the evaluation information acquired from the evaluation value calculation unit 102 and the target value acquired from the target value calculation unit 105, and the desired policy. The above may be determined.

The training determining unit 106 may further create a training schedule including the determined one or more trainings. The training schedule defines the timing of training to achieve the target value. Note that the training schedule may include information that defines the amount of training to be performed per unit period. In this embodiment, the training determining unit 106 defines the days on which each training should be performed for a plurality of trainings as a training schedule.

Note that when the control unit 10 includes a log data creation unit 108 and the evaluation value log data is created by the log data creation unit 108 and stored as the evaluation value log DB 114, the training determination unit 106 determines the training. At this time, the evaluation value log data may be taken into consideration. That is, the training determining unit 106 reads the user's evaluation value log data from the evaluation value log DB 114, and determines training based on the evaluation value log data and the difference between the evaluation value and the target value in each evaluation axis. It's okay.

Thereby, the training determining unit 106 can determine training taking into consideration the evaluation values calculated in the past. Therefore, the information processing device 1 can determine training that is more effective for achieving the goal as the training to be presented to the user.

The presentation unit 103 presents various information to the user via the display device 3 by displaying various images on the display device 3. For example, when the presentation unit 103 acquires the evaluation information from the evaluation value calculation unit 102, the presentation unit 103 causes the display device 3 to display an image showing each evaluation axis and the evaluation value corresponding to each evaluation axis. For example, when the presentation unit 103 acquires the target value following the evaluation information, the presentation unit 103 causes the display device 3 to display an image showing the evaluation value for each evaluation axis and the target value for each evaluation axis. For example, the presenting unit 103 may display at least one of the training determined by the training determining unit 106 and the training schedule on the display device 3. In addition to this, the presentation unit 103 may display various images created by the control unit 10 on the display device 3.

Note that the evaluation value and target value are preferably shown in a graph. Thereby, the presentation unit 103 can present the evaluation value and the target value so that the user can understand them at a glance.

The audio control unit 107 controls the audio output device 5. For example, the audio control unit 107 may cause the audio output device 5 to output an explanation of the image displayed on the display device 3 by the presentation unit 103. Furthermore, the voice control unit 107 may cause the voice output device 5 to output a voice prompting the user to input using the input device 4 . Further, the audio control unit 107 may cause the audio output device 5 to output the output result of the learned model 111 stored in the storage unit 11 as audio.

The log data creation unit 108 creates evaluation value log data based on the evaluation information. The evaluation value log data is data indicating the history of evaluation values calculated for a certain user. The evaluation value log data includes at least the evaluation value for each evaluation axis calculated by the evaluation value calculation unit 102 and the calculation date and time of the evaluation value. Note that the calculation date and time of the evaluation value may be specified, for example, by the control unit 10 acquiring time information from a timer built into the information processing device 1 or from a timer that is an external device of the information processing device 1. . Furthermore, the evaluation value log data may include at least one of information indicating an evaluation axis of each evaluation value, information indicating a target value corresponding to each evaluation value, and user identification information.

The log data creation unit 108 stores the created evaluation value log data in the storage unit 11 as one record of the evaluation value log DB 114. As a result, evaluation value log data is accumulated in the evaluation value log DB 114.

The evaluation value log DB 114 is a database of evaluation value log data. The evaluation value log DB 114 may be created for each user, or evaluation value log data regarding a plurality of users may be collectively managed in one evaluation value log DB 114. Note that when the evaluation value log DB 114 includes evaluation value log data of a plurality of users, each record (that is, each evaluation value log data) of the evaluation value log DB 114 includes user identification information.

(Storage unit 11)
The storage unit 11 stores, for example, a trained model 111, a training DB 112, and an evaluation axis setting DB 113. Further, when the control unit 10 includes the log data creation unit 108, the storage unit 11 stores the evaluation value log DB 114. The data structures of the training DB 112, evaluation axis setting DB 113, and evaluation value log DB 114 are as described above.

The trained model 111 is an AI (artificial intelligence) model that determines the content of speech to the user, recognizes the content of the user's speech, and determines a response according to the recognition result. The sensor information acquisition unit 101 of the control unit 10 inputs audio data acquired from the microphone 23 to the learned model 111. The trained model 111 returns an output corresponding to the input to the control unit 10. The audio control unit 107 of the control unit 10 causes the audio output device 5 to output audio according to the output result.

(Audio output device 5)
The audio output device 5 outputs audio under the control of the audio control unit 107 of the information processing device 1 . The audio output device 5 may be configured integrally with the display device 3 and the input device 4. For example, the audio output device 5 may be a speaker integrated with a touch panel display.

(In-vehicle device 6)
The on-vehicle devices 6 are various devices mounted on the vehicle 9. Note that the "various devices" mentioned here also include parts or units of the vehicle 9. The in-vehicle device 6 is a device, part, or unit that can be used for training performed in a space inside a vehicle. For example, the in-vehicle device 6 may be a steering wheel, an accelerator, a brake, a seat reclining mechanism, etc. of the vehicle 9. Note that the in-vehicle sensor 2, display device 3, input device 4, and audio output device 5 may also serve as the in-vehicle device 6.

(Example of placement of in-vehicle sensors and various input/output devices)
FIG. 2 is a diagram showing an example of the arrangement of the in-vehicle sensor 2, display device 3, input device 4, and audio output device 5. It is desirable that the camera 21 be placed at a position where it can photograph the user from the front when the user is seated in the vehicle. With this, it is possible to photograph the user's facial expressions, movements, and the like. It is desirable that the microphone 23 be placed at a position where the user's voice can be recorded. For example, in the case of the information processing system 100 intended for a person sitting in a driver's seat, the camera 21 and the microphone 23 are preferably attached to the dashboard of the vehicle 9 so as to substantially face the user.

Further, the biosensor 22 is arranged at a position depending on the type of biometric information measured by the biosensor 22. For example, if the biosensor 22 is a sensor that measures the user's muscle mass, the sensor may be built into the seat of the vehicle 9. Thereby, when the user is seated on the seat, the biosensor 22 can measure the muscle percentage of the user's body.

By arranging various in-vehicle sensors 2 as shown in FIG. 2, the camera 21 images the user's appearance, the biosensor 22 measures the user's biometric information (for example, muscle percentage), and the microphone 23 measures the user's utterances. Audio can be obtained. In this manner, by acquiring multiple types of sensor information and transmitting them to the sensor information acquisition unit 101, the evaluation value calculation unit 102 of the information processing device 1 can evaluate the user based on a wider variety of evaluation axes. Furthermore, by calculating the evaluation value by combining multiple types of sensor information in the evaluation value calculation unit 102, it is possible to calculate the evaluation value more precisely.

The display device 3 is arranged at a position where the user can view the display device 3. Further, the input device 4 is arranged at a position where the user can operate the input device 4. Furthermore, the audio output device 5 is arranged at a position where the user can listen to the audio. For example, in the case of the information processing system 100 intended for a person sitting in a driver's seat, the display device 3, input device 4, and audio output device 5 are mounted on the dashboard of the vehicle 9 so as to substantially face the user. It is desirable to be present.

Note that the information processing device 1 may guide input operations in the information processing system 100 using the display screen of the display device 3 and the output audio of the audio output device 5. Further, the information processing device 1 may prompt the user to have a conversation with the information processing system 100 using the display screen of the display device 3 and the output audio of the audio output device 5. Then, the content of the user's utterance may be identified by performing voice recognition using the learned model 111 on voice data obtained by acquiring the conversation with the microphone 23. Then, a reply corresponding to the content of the utterance may be outputted via the audio output device 5. That is, the information processing device 1 may interact with the user using the learned model 111.

(Modified example of main part configuration)
The storage unit 11 may be an external device of the information processing device 1. When the storage unit 11 is an external device of the information processing device 1, the storage unit 11 and the information processing device 1 are connected by wire or wirelessly, and various data are transmitted and received.

Further, the microphone 23 of the on-vehicle sensor 2 or a microphone placed in the vehicle 9 other than the microphone 23 may be used as the input device 4. That is, various input operations by the user may be performed by voice input. In this case, the control unit 10 inputs the audio data of the microphone 23 acquired by the sensor information acquisition unit 101 to the learned model 111. As a result, the learned model 111 performs voice recognition on the voice data, and specifies the content of the user's utterance included in the voice data. The input information acquisition unit 104 of the control unit 10 acquires the output result of the trained model 111 (that is, the speech recognition result) as input information, and outputs it to each unit.

≪Presentation of evaluation values and target values≫
Next, the flow of processing when presenting evaluation values and target values to the user in the information processing system 100 will be described in detail using FIGS. 3 to 7. FIG. 3 is a flowchart showing the flow of processing related to presentation of evaluation values and target values in the information processing device 1. Further, FIGS. 4 to 7 are diagrams each showing an example of an image displayed on the display device 3 by the presentation unit 103. Note that in the flowchart of FIG. 3, it is assumed that the information processing device 1 includes the log data creation unit 108. Furthermore, in the flowchart of FIG. 3, the evaluation value calculation unit 102 outputs evaluation information to the target value calculation unit 105. Furthermore, in the screen examples shown in FIGS. 4 to 7, object images having the same function are assigned the same member number and the description will not be repeated.

The information processing device 1 starts a series of processes shown in FIG. 3, for example, when the input information acquisition unit 104 acquires input information indicating the user's first input operation. The “first input operation” is, for example, an input operation in which the user instructs the information processing system 100 to perform an evaluation.

The sensor information acquisition unit 101 of the control unit 10 acquires sensor information from at least one sensor of the in-vehicle sensor 2 (S11 in FIG. 3, sensor information acquisition step). The sensor information acquisition unit 101 outputs the acquired sensor information to the evaluation value calculation unit 102.

The evaluation value calculation unit 102 determines a plurality of evaluation axes based on sensor information. Subsequently, the evaluation value calculation unit 102 calculates the user's evaluation value for each of the plurality of evaluation axes (S12 in FIG. 3, evaluation value calculation step). The evaluation value calculation unit 102 outputs evaluation information to the presentation unit 103 , target value calculation unit 105 , training determination unit 106 , and log data creation unit 108 . Note that when the evaluation axis is fixed, the evaluation value calculation unit 102 does not determine the evaluation axis, but only needs to calculate the evaluation value for the specified evaluation axis.

The log data creation unit 108 creates evaluation value log data based on the evaluation information (S13 in FIG. 3). The log data creation unit 108 stores the created evaluation value log data in the storage unit 11 as one record of the evaluation value log DB 114.

On the other hand, the presentation unit 103 that has acquired the evaluation information causes the display device 3 to display the user's evaluation value indicated by the evaluation information (S14 in FIG. 3, first presentation step). For example, the presentation unit 103 creates a graph such as a bar graph, a pie chart, or a radar chart showing the user's evaluation value for each evaluation axis, and causes the display device 3 to display an image including the graph. Thereby, the user is presented with the user's current evaluation value.

An image 51 shown in FIG. 4 is an example of an image displayed on the display device 3 by the presentation unit 103 through the process of S14. In the example of FIG. 4, the image 51 includes evaluation values for eight evaluation axes: facial expression, hairstyle, kindness, talk level, amount of knowledge, skin age, muscle mass, and fashion level, in the form of a radar chart G1. Contains image objects that can be viewed at a glance. In this way, by showing the evaluation values on the radar chart, it is possible to inform the user of his or her strengths (that is, strengths) and weaknesses (that is, weaknesses) in an easy-to-understand manner. Further, as shown in the figure, the image 51 includes, as UI objects, a button B1 for instructing a transition to the previous screen, and a button B2 for instructing a transition to the next screen. Good too.

Note that the presentation unit 103 may present the evaluation value to the user not only in numerical value but also in text. Furthermore, the presentation unit 103 may present comments to the user depending on the level of the evaluation value. For example, as shown in FIG. 4, the presentation unit 103 sends a comment T1 according to the content of the evaluation axis whose evaluation value is the first value (for example, half of the maximum value) or more among the eight evaluation axes. It may be included in the image 51. Further, the presentation unit 103 may include in the image 51 a comment T2 corresponding to the content of the evaluation axis whose evaluation value is less than or equal to a second value (for example, 40% of the maximum value). . It can be said that evaluation axes with high evaluation values are the user's strengths, and evaluation axes with low evaluation values are the user's weaknesses. Therefore, by presenting the comments T1 and T2 to the user, the user can more clearly know his/her weaknesses and strengths.

The user who has recognized his or her current evaluation value by checking the image 51 displayed on the display device 3 then inputs his or her goal via the input device 4 . The presentation unit 103 causes the display device 3 to display a UI image for the user to input (designate) a goal in response to a predetermined input operation by the user. Specifically, the presentation unit 103 causes the display device 3 to display an image as shown in FIG. 5 when the input information acquisition unit 104 acquires input information indicating an operation to select button B2 in FIG. .

An image 52 shown in FIG. 5 is an example of a UI image that the presentation unit 103 displays on the display device 3. For example, the presentation unit 103 causes the display device 3 to display an image 52 including a button group B3 indicating the user's goal. When the user selects various buttons included in the button group B3, it means that the user has specified the target corresponding to the selected button. In the example in Figure 5, the user specifies the goals of becoming a person who is "muscular," "beautiful," "fashionable," "kind-looking," "knowledgeable," and "good at talking." I can say that. In other words, the button group B3 can be said to be the user's target options.

When the user selects the button B2 that transitions to the next screen with a desired button selected from the button group B3, information specifying the selected button from the button group B3 is input. The information is transmitted from the input device 4 to the input information acquisition unit 104 as information. The input information acquisition unit 104 outputs the input information, that is, information indicating the user's goal, to the target value calculation unit 105.

The explanation will be given again by returning to the flowchart of FIG. The input information acquisition unit 104 of the information processing device 1 acquires input information input by the user and indicating the user's goal (S15 in FIG. 3). The input information acquisition unit 104 outputs the acquired input information to the target value calculation unit 105.

The target value calculation unit 105 calculates target values for each evaluation axis indicated by the evaluation information acquired from the evaluation value calculation unit 102 (S16 in FIG. 3, target value calculation step). Target value calculation unit 105 outputs the calculated target value to presentation unit 103 and training determination unit 106.

Upon acquiring the target value from the target value calculation unit 105, the presentation unit 103 creates an image including the evaluation value acquired from the evaluation value calculation unit 102 and the target value acquired from the target value calculation unit 105, and displays the image on the display device 3. (S17 in FIG. 3, second presentation step). For example, the presentation unit 103 creates a graph such as a bar graph, a pie chart, or a radar chart showing the user's evaluation value and target value for each evaluation axis, and causes the display device 3 to display the graph. Note that the evaluation value and the target value may be shown overlappingly in one graph, or may be divided into two graphs and shown side by side. Thereby, the user's current evaluation value and the target value, which is a numerical value of the user's goal, are presented to the user so that they can be compared.

For example, the presentation unit 103 may display the evaluation value and the target value in one graph in an overlapping manner. The image 53 shown in FIG. 6 is an example of an image that the presentation unit 103 displays on the display device 3 through the process of S17. In the example of FIG. 6, the image 53 includes an image object that shows evaluation values and target values for the same eight evaluation axes as the image 51 in the form of a radar chart G2. In this way, by superimposing and showing the evaluation value and target value on the radar chart, the user can easily understand the difference between his or her current evaluation value and the target value that will be met if the goal is achieved. I can do it. Note that the image 53 may include an image P1 when the user achieves the goal, as shown in the figure.

Further, the presentation unit 103 may divide the evaluation value and the target value into two graphs and display them side by side. The image 54 shown in FIG. 7 is another example of an image displayed by the presentation unit 103 on the display device 3 through the process of S17. In the example of FIG. 7, the image 53 includes a radar chart G1 showing evaluation values for the same eight evaluation axes as the image 51, and a radar chart G3 showing target values for the same eight evaluation axes. ing. In this way, by showing the evaluation value and target value side by side on the radar chart, it is possible to clearly inform the user of the difference between his or her current evaluation value and the target value that will be met if the goal is achieved. .

Note that the log data creation unit 108 is not an essential component in the information processing device 1. Therefore, the processing in S13 is also not essential. Further, the timing of the process in S13 is not limited to between the process in S12 and the process in S14. That is, the process in S13 may be executed at any timing after the process in S12.

According to the above process, it is possible to present to the user a target value that is a numerical representation of the user's goal, and an evaluation value that is a numerical representation of an evaluation based on objective information such as sensor information. Therefore, the user can materialize his or her goals and obtain an objective evaluation of himself or herself while staying in the vehicle interior space. Therefore, the user can spend meaningful time in the space inside the car.

≪Training presentation processing≫
Finally, the flow of processing when the information processing system 100 determines training to be presented to the user and presents it to the user will be described in detail using FIGS. 8 to 10. FIG. 8 is a flowchart showing the flow of processing in which training is determined and presented to the user in the information processing device 1. 9 to 10 are diagrams showing examples of images displayed on the display device 3 by the presentation unit 103. In the example of FIG. 8, the training determining unit 106 determines training based on the user's desired training policy. In the example of FIG. 8, the training determining unit 106 also determines the training schedule.

The information processing apparatus 1 starts a series of processes shown in FIG. 2, for example, when the input information acquisition unit 104 acquires input information indicating the user's second input operation. The "second input operation" is, for example, the input operation of selecting button B2 in FIG. When the input information acquisition unit 104 acquires the input information indicating the second input operation, the presentation unit 103 causes the display device 3 to display a UI image for the user to input a desired training policy.

An image 55 shown in FIG. 9 is an example of a UI image that the presentation unit 103 displays on the display device 3. For example, the presentation unit 103 causes the display device 3 to display an image 52 including a button group B4 indicating the desired policy. When the user selects various buttons included in the button group B4, it means that the user desires the training policy corresponding to the selected button. In the example of FIG. 9, it can be said that the user desired a training policy of "strengthening weaknesses." In other words, the button group B4 can be said to be options for the user's desired policy.

When the user selects the button B2 for transitioning to the next screen with a desired button selected from the button group B4, information specifying the selected button from the button group B4 is input. The information is transmitted from the input device 4 to the input information acquisition unit 104 as information. The input information acquisition unit 104 outputs the input information, that is, information indicating the user's desired policy to the target value calculation unit 105.

The explanation will be given by returning to FIG. 8 again. When the training determining unit 106 acquires input information indicating a desired training policy from the input information acquiring unit 104 (S21 in FIG. 8), the training determining unit 106 determines one or more trainings. That is, the training determining unit 106 selects one training based on the difference between the evaluation value indicated by the evaluation information acquired from the evaluation value calculation unit 102 and the target value acquired from the target value calculation unit 105, and the desired policy. The above determination is made (S22 in FIG. 8). The training determining unit 106 then determines a training schedule (S23 in FIG. 8). The training determining unit 106 outputs information indicating the determined training and schedule to the presenting unit 103.

The presenting unit 103 that has acquired the information indicating the training and schedule from the training determining unit 106 presents the training and schedule to the user by displaying an image including the training and schedule on the display device 3 (S24 in FIG. 8). ).

An image 56 shown in FIG. 10 is an example of an image that the presentation unit 103 displays on the display device 3 through the process of S24. In the example of FIG. 10, the image 56 includes a text T3 indicating the content of the training determined by the training determining unit 106, and an image P2 indicating the implementation schedule of each training.

According to the above process, the information processing device 1 presents the user with training that can be done in the interior of the car in order to get closer to the goal input by the user. Therefore, by performing the presented training, the user can make meaningful use of the time spent in the vehicle interior.

[Embodiment 2]
In the information processing system according to the present disclosure, the control device may include an execution detection unit that detects execution of training from the usage status of the in-vehicle device 6. Further, the sensor information acquisition unit 101 may acquire sensor information again when the execution detection unit detects execution of training. Furthermore, the evaluation value calculation unit 102 may recalculate the user's evaluation value for each of the plurality of evaluation axes selected last time based on the sensor information reacquired by the sensor information acquisition unit 101. Further, the presentation unit 103 may present at least one of the recalculated evaluation value and the difference between the recalculated evaluation value and the previously calculated evaluation value to the user via the display device 3. .

Furthermore, in the information processing system according to the present disclosure, the control device may include an achievement determination unit that determines whether the recalculated evaluation value is equal to or greater than the target value for each evaluation axis. Then, when the achievement determination unit determines that the recalculated evaluation value is equal to or higher than the target value for at least one evaluation axis, the presentation unit 103 presents a notification to the user indicating that the target value has been reached. You may.

A second embodiment of the present disclosure will be described below. In addition, in the embodiments after this embodiment, for convenience of explanation, members having the same functions as the members described in the previous embodiment are denoted by the same reference numerals, and the description thereof will not be repeated.

≪Main part configuration≫
FIG. 11 is a block diagram showing the main configuration of the information processing system 200 according to this embodiment. The information processing system 200 differs from the information processing system 100 according to the first embodiment in that it includes an information processing device 7 instead of the information processing device 1. The information processing device 7 includes a control section (control device) 12 instead of the control section 10 .

(Control unit 12)
The control unit 12 includes an execution detection unit 121 and an achievement determination unit 122 in addition to each member included in the control unit 10 . Note that in this embodiment, the training determined by the training determining unit 106 is training performed using the in-vehicle device 6. Further, in this embodiment, the evaluation value calculation unit 102 also outputs evaluation information to the achievement determination unit 122. Further, in this embodiment, the target value calculation unit 105 also outputs the target value to the achievement determination unit 122.

Further, the in-vehicle device 6 transmits information indicating the usage status of the in-vehicle device to the control unit 12. Here, "information indicating usage status" is information that can be measured using a sensor attached to the on-vehicle device 6, for example. For example, when the in-vehicle device 6 is the brake of the vehicle 9, the information indicating the usage status is information indicating the number of times the user has stepped on the brake and the strength of the depression. Further, for example, when the in-vehicle device 6 is the microphone 23, the information indicating the usage status is the audio data itself acquired by the microphone 23.

The execution detection unit 121 detects that the training determined by the training determination unit 106 has been executed based on the usage status of the in-vehicle device 6. The method of detecting training execution by the execution detection unit 121 is not particularly limited. For example, if the training determined by the training determining unit 106 is training for “conducting a dialogue with the information processing system 100,” the execution detecting unit 121 determines whether or not the audio data acquired by the microphone 23 includes user utterances. Determine whether If the utterance is included, the execution detection unit 121 determines that the user has executed the training of "interacting with the information processing system 100." When the execution detection unit 121 detects the execution of training, it notifies the sensor information acquisition unit 101 and the achievement determination unit 122 to that effect.

Upon receiving the notification from the execution detection unit 121 , the sensor information acquisition unit 101 according to the present embodiment reacquires sensor information from the on-vehicle sensor 2 and outputs the sensor information to the evaluation value calculation unit 102 . The evaluation value calculation unit 102 according to the present embodiment recalculates the user's evaluation value for each of the plurality of evaluation axes selected last time, based on the sensor information reacquired by the sensor information acquisition unit 101. The recalculated evaluation value is included in the evaluation information and output to each section in the same way as when the evaluation value is calculated for the first time.

The presentation unit 103 according to the present embodiment presents at least one of the recalculated evaluation value and the difference between the recalculated evaluation value and the previously calculated evaluation value to the user via the display device 3. . For example, the presentation unit 103 may cause the display device 3 to display an image showing the recalculated evaluation value as a radar chart. For example, the presentation unit 103 may cause the display device 3 to display an image in which the recalculated evaluation value and the previously calculated evaluation value are superimposed on one radar chart. For example, the presentation unit 103 may cause the display device 3 to display an image in which two radar charts of the recalculated evaluation value and the previously calculated evaluation value are arranged side by side.

The achievement determination unit 122 determines whether the recalculated evaluation values for the plurality of evaluation axes selected by the evaluation value calculation unit 102 are equal to or greater than the target values calculated by the target value calculation unit 105. When the recalculated evaluation value is equal to or greater than the target value, the achievement determination unit 122 causes the display device 3 to display a notification indicating that the user has reached the target value. Note that the notification may be made by the audio control unit 107 instead of the presentation unit 103 in the form of audio via the audio output device 5.

According to the configuration according to the present embodiment, when the user executes training, the information processing device 7 can present to the user a change in the evaluation value due to the execution of the training. That is, the information processing device 7 can show the user the effects actually obtained through training. Further, according to the configuration according to the present embodiment, it is possible to notify that the evaluation value has become equal to or higher than the target value, that is, that the user's current evaluation has reached the target value related to the goal input by the user. .

[Modified example]
The information processing device 1 and the information processing device 7 may operate in cooperation with a terminal device such as a smartphone owned by the user. In this case, the information processing device 1 and the information processing device 7 are provided with a communication unit that communicates with an external device. Further, in this case, it is preferable that the information processing device 1 or the information processing device 7 and the terminal device be paired in advance.

For example, the input information acquisition unit 104 of the information processing device 1 or the information processing device 7 may acquire information indicating an input operation on the terminal device as input information via the communication unit. Thereby, the user can perform various input operations using his or her own terminal device instead of the input device 4.

Further, the control unit 10 of the information processing device 1 and the control unit 12 of the information processing device 7 may acquire personal information of the user, such as the user's height and weight, from the user's terminal device. Furthermore, the evaluation value calculation unit 102 may select the evaluation axis and calculate the evaluation value, taking the personal information into account. Thereby, evaluation values can be calculated more precisely using more appropriate evaluation axes. Further, the training determining unit 106 may decide on training and the training schedule, taking the personal information into consideration. Thereby, a more effective training or training implementation schedule can be presented to the user.

The information processing device 1 and the information processing device 7 may control the in-vehicle device 6 to emphasize the user's strengths or make the user's weaknesses less noticeable in accordance with the user's instructions. As described above, a user's strengths and weaknesses can be identified by the height of the evaluation value. In other words, it can be said that the higher the evaluation value, the more the user considers the evaluation axis corresponding to the evaluation value to be a strength. Conversely, the lower the evaluation value, the weaker the user is in the evaluation axis corresponding to the evaluation value.

For example, in the case of a user who has an evaluation axis of "muscularity" as a strength, that is, a muscular user, the control unit 10 of the information processing device 1 or the control unit 12 of the information processing device 7 adjusts the reclining mechanism of the seat. , the user's physique may be adjusted to an angle that makes the user's physique appear largest to the passenger. Thereby, the user's in-vehicle experience can be further improved.

In addition, by changing the brightness and color tone of the in-vehicle lighting as the in-vehicle device 6 according to the evaluation axis and evaluation value regarding the user's appearance, the user's strengths regarding the evaluation axis can be emphasized or the user's weaknesses can be emphasized. may be made inconspicuous. for example,
(Other ways to use evaluation values)
The information processing device 1 and the information processing device 7 may include a communication unit that communicates with an external device. Then, the control unit 10 of the information processing device 1 or the control unit 12 of the information processing device 7 creates an introduction image that is an image for introducing the user and includes information indicating the user's current evaluation value. Good too. For example, the control unit 10 and the control unit 12 may create an introduction image including the radar chart G1 of FIG. 4.

Then, the information processing device 1 and the information processing device 7 may transmit the introduction image to an external device via the communication unit. For example, the information processing device 1 and the information processing device 7 may transmit the introduction image to a terminal device owned by the user.

Further, the information processing device 1 and the information processing device 7 may post the introduction image to a social network service (SNS) or the like on the Internet. Note that it is desirable that the account used to post the image be registered in the information processing device 1 and the information processing device 7 in advance.

Further, the information processing device 1 and the information processing device 7 may transmit the introduction image to other vehicles that exist near the vehicle 9 in which the information processing device 1 and the information processing device 7 are mounted. Further, an introduction image of a user of another vehicle may be received from another vehicle equipped with an information processing device having a configuration similar to that of the information processing device 1 and the information processing device 7, and may be displayed on the display device 3. .

In this way, by using the information related to the evaluation value calculated by the evaluation value calculation unit 102 to introduce the user, the user can use the information processing device 1 or the information processing device even when not staying in the vehicle 9. The evaluation value calculated by the device 7 can be effectively utilized.

[Example of implementation using software]
The control blocks of the control unit 10 and the control unit 12 may be realized by a logic circuit (hardware) formed in an integrated circuit (IC chip) or the like, or may be realized by software.

In the latter case, the control unit 10 and the control unit 12 are equipped with a computer that executes instructions of a program that is software that implements each function. This computer includes, for example, one or more processors and a computer-readable recording medium storing the program. Then, in the computer, the processor reads the program from the recording medium and executes it, thereby achieving the object of the present disclosure. As the processor, for example, a CPU (Central Processing Unit) can be used. As the recording medium, in addition to "non-temporary tangible media" such as ROM (Read Only Memory), tapes, disks, cards, semiconductor memories, programmable logic circuits, etc. can be used. Further, the computer may further include a RAM (Random Access Memory) for expanding the program. Further, the program may be supplied to the computer via any transmission medium (communication network, broadcast wave, etc.) that can transmit the program. Note that one aspect of the present disclosure may also be realized in the form of a data signal embedded in a carrier wave, in which the program is embodied by electronic transmission.

The present disclosure is not limited to the embodiments described above, and various changes can be made within the scope of the claims, and embodiments obtained by appropriately combining technical means disclosed in different embodiments. are also included within the technical scope of the present disclosure.

100, 200 Information processing system 1, 7 Information processing device 2 Vehicle-mounted sensor 3 Display device 4 Input device 5 Audio output device 6 Vehicle-mounted device 9 Vehicles 10, 12 Control section 11 Storage section 21 Camera 22 Biological sensor 23 Microphone 101 Sensor information acquisition section 102 Evaluation value calculation unit 103 Presentation unit 104 Input information acquisition unit 105 Target value calculation unit 106 Training determination unit 107 Voice control unit 108 Log data creation unit 111 Learned model 112 Training DB
113 Evaluation axis setting DB
114 Evaluation value log DB
121 Execution detection unit 122 Achievement determination unit

Claims (11)

a sensor information acquisition unit that acquires sensor information regarding a user staying in the vehicle interior space from an in-vehicle sensor;
an evaluation value calculation unit that calculates the user's evaluation value for each of the plurality of evaluation axes based on at least a part of the sensor information;
a presentation unit that presents the evaluation value to the user via a display device;
a target value calculation unit that calculates the user's target value for each of the plurality of evaluation axes based on the target input by the user via an input device,
The presentation unit further presents the user with the user's evaluation value for each evaluation axis and the target value for each evaluation axis,
The in-vehicle sensor includes at least a microphone,
The sensor information includes audio data including utterances of the user,
The evaluation axes include evaluation axes related to human personality tendencies or thinking tendencies,
The control device is characterized in that the evaluation value calculation unit calculates the evaluation value of the user on an evaluation axis related to the human personality tendency or thinking tendency based on the result of voice recognition of the voice data. The control device according to claim 1, wherein the presentation unit presents the evaluation value and the target value in a graph. comprising a training determining unit that determines one or more trainings based on the difference between the evaluation value and the target value for each of the plurality of evaluation axes,
The training is training for bringing the evaluation value closer to the target value, and is training performed in the interior space of the vehicle,
The control device according to claim 1 or 2, wherein the presentation unit presents the training determined by the training determination unit to the user via the display device. comprising a log data creation unit that creates evaluation value log data that includes at least the evaluation value calculated by the evaluation value calculation unit and the calculation date and time of the evaluation value,
The control according to claim 3, wherein the training determining unit determines the training based on the evaluation value log data of the user and a difference between the evaluation value and the target value. Device. 5. The control device according to claim 3, wherein the training includes an operation related to driving a vehicle having the interior space. The training is performed using various devices installed in a vehicle having the interior space,
comprising an execution detection unit that detects execution of the training from the usage status of the various devices,
The sensor information acquisition unit reacquires the sensor information when the execution detection unit detects execution of the training,
The evaluation value calculation unit recalculates the user's evaluation value for each of the plurality of evaluation axes based on the reacquired sensor information,
The presentation unit is characterized by presenting at least one of the recalculated evaluation value and the difference between the recalculated evaluation value and the previously calculated evaluation value to the user via the display device. The control device according to any one of claims 3 to 5. For each evaluation axis, an achievement determination unit is provided that determines whether the recalculated evaluation value is equal to or higher than the target value,
The presenting unit presents a notification to the user indicating that the target value has been reached, when the achievement determining unit determines that the recalculated evaluation value is equal to or higher than the target value for at least one evaluation axis. The control device according to claim 6, characterized in that: The on-vehicle sensor includes at least one camera,
The sensor information includes image data including the user's appearance taken by the camera,
The evaluation axis includes an evaluation axis regarding appearance,
The control device according to any one of claims 1 to 7, wherein the evaluation value calculation unit calculates the evaluation value of the user on the evaluation axis related to appearance based on the image data. The in-vehicle sensor includes at least one biological sensor,
The sensor information includes biological information of the user measured or acquired by the biological sensor,
The evaluation axis includes an evaluation axis related to health status,
The control device according to any one of claims 1 to 8, wherein the evaluation value calculation unit calculates the evaluation value of the user on the evaluation axis related to the health condition based on the biological information. . A control device according to any one of claims 1 to 9,
The in-vehicle sensor;
the input device;
An information processing system comprising: the display device. A control method for a control device, the method comprising:
a sensor information acquisition step of acquiring sensor information regarding a user staying in the vehicle interior space from an in-vehicle sensor;
an evaluation value calculation step of calculating the user's evaluation value for each of a plurality of evaluation axes based on at least a part of the sensor information;
a first presentation step of presenting the evaluation value to the user via a display device;
a target value calculation step of calculating the user's target value for each of the plurality of evaluation axes based on the target input by the user via an input device;
a second presenting step of presenting the user's evaluation value for each evaluation axis and the target value for each evaluation axis,
The in-vehicle sensor includes at least a microphone,
The sensor information includes audio data including utterances of the user,
The evaluation axes include evaluation axes related to human personality tendencies or thinking tendencies,
A control method characterized in that, in the evaluation value calculation step, an evaluation value of the user on an evaluation axis related to the human personality tendency or thinking tendency is calculated based on a result of voice recognition of the voice data.

Images