JP2021012409A - On-vehicle system - Google Patents

Abstract

To provide a technique for suitably improving a state of a passenger.SOLUTION: An on-vehicle system 100 for performing processing to give multiple stimulations to a passenger of a vehicle includes detection sections 2, 3, an estimation section, a selection section, and a processing section. The detection sections detect a state of a passenger. The estimation section estimates values of multiple indexes indicating a physicomental state of a passenger based on a state of a passenger. The selection section selects at least one stimulation to be given to a passenger among the multiple stimulations based on an emotion vector 7 corresponding to each one of the multiple stimulations and values of multiple indexes estimated by the estimation section. The processing section performs processing to give at least one stimulation selected by the selection section to a passenger.SELECTED DRAWING: Figure 4

Description

The present disclosure relates to an in-vehicle system that performs processing for giving a plurality of stimuli to a vehicle occupant.

Devices that prevent occupants from falling asleep are known. In Patent Document 1, the drowsiness level and psychological state of the occupant are estimated based on the occupant's condition detected by the detection device, and an alarm for calling attention is issued to the occupant based on the estimation result. The device is disclosed. Further, in the device, the psychological state of the occupant before and after the alarm is estimated, and the method and intensity of the alarm are adjusted based on the estimation result.

JP-A-2018-169906

Here, in the device described in Patent Document 1, the psychological state of the occupant is estimated using the arousal level and the comfort level as indexes. Then, the device selects an alarm to be issued to the occupant from a plurality of alarms according to the result of estimating the psychological state of the occupant. However, it was not known how much each index indicating the occupant's psychological state would change when the selected alarm was issued to the occupant. Therefore, the occupant may be issued an unpleasant alarm many times or may not reach the optimum psychological state.

One aspect of the present disclosure provides a technique for suitably improving the condition of an occupant.

One aspect of the present disclosure is an in-vehicle system (100) configured to perform processing for giving a plurality of stimuli to a vehicle occupant, and includes a detection unit (2, 3) and an estimation unit (S210). A selection unit (S220) and a processing unit (S230) are provided. The detection unit detects the state of the occupant. The estimation unit estimates the values of a plurality of indicators indicating the physical and mental condition of the occupant based on the condition of the occupant. The selection unit selects at least one stimulus given to the occupant from among the plurality of stimuli based on the emotional vector (7) corresponding to each of the plurality of stimuli and the values of the plurality of indexes estimated by the estimation unit. Select. The emotional vector indicates how much the value of each of the plurality of indicators indicating the physical and mental state of the occupant changes when the occupant is given a stimulus corresponding to the emotional vector. The processing unit performs processing for giving the occupant at least one stimulus selected by the selection unit.

According to such a configuration, the in-vehicle system selects at least one stimulus given to the occupant based on the estimation result of the values of a plurality of indicators indicating the mental and physical condition of the occupant and the emotional vector corresponding to each stimulus. To do. Therefore, the in-vehicle system can grasp in advance how much each value of the plurality of indicators changes when each selected stimulus is given to the occupant. As a result, it is possible to prevent the occupant from being given an inappropriate stimulus or the like, so that the condition of the occupant can be suitably improved.

In addition, the reference numerals in parentheses described in this column and the scope of claims indicate the correspondence with the specific means described in the embodiment described later as one embodiment, and limit the technical scope of the present disclosure. It is not something to do.

It is a block diagram of an in-vehicle system. It is explanatory drawing about an emotion vector. It is explanatory drawing about the mental and physical condition of an occupant. It is a flowchart of improvement processing.

Hereinafter, embodiments of the present disclosure will be described with reference to the drawings.
[1. Constitution]
The in-vehicle system 100 shown in FIG. 1 is mounted on a vehicle and includes an improvement device 1, a camera 2, and a heart rate sensor 3. Hereinafter, the vehicle equipped with the in-vehicle system 100 will be referred to as the own vehicle. The camera 2 and the heart rate sensor 3 are connected to the improvement device 1 via an in-vehicle LAN or a dedicated communication line. The camera 2 and the heart rate sensor 3 may be configured as a part of the improvement device 1. Further, the automatic operation control device 4, the display device 51, the air conditioner 52, the vibration device 53, the scent generator 54, and the dialogue unit 55 are connected to the improvement device 1 via an in-vehicle LAN or a dedicated communication line. You may be. The in-vehicle LAN may be, for example, CAN (registered trademark).

The camera 2 photographs the body of the occupant of the own vehicle and outputs the captured data to the improvement device 1. The occupant may be a driver, or may be a person seated in the passenger seat or the rear seat. The camera 2 may capture a part of the occupant's body (for example, the occupant's face) or the entire occupant's body (for example, the occupant's posture).

The heart rate sensor 3 measures the heart rate of the occupant and outputs the measurement data to the improvement device 1.
The automatic driving control device 4 performs automatic driving control that automatically controls all or part of acceleration / deceleration and steering of the own vehicle. The automatic driving control eliminates the need for all or part of the driving operation by the driver. The automatic driving control device 4 controls acceleration / deceleration, steering, and the like of the own vehicle within a range corresponding to the automatic driving level. As the automatic driving level increases, the degree of control such as acceleration / deceleration and steering of the own vehicle by the automatic driving control device 4 increases. When the automatic driving level is the highest, the automatic driving control device 4 completely controls acceleration / deceleration, steering, and the like.

The display device 51 displays an image or characters in front of the occupant, or emits light to the occupant. The display device 51 is configured as, for example, a meter, a center display, a head-up display, and a lighting device.

The air conditioner 52 blows cold air or hot air to the occupants. The air conditioner 52 is configured as an air conditioner as an example.
The vibrating device 53 presses or vibrates a part of the occupant's body. The vibrating device 53 is attached to, for example, an occupant's seat, seat belt, steering wheel, footrest, wearable device, or the like, and is configured to stimulate the occupant's tactile sensation.

The scent generator 54 generates a scent that has a relaxing effect and an effect of enhancing concentration on the occupant. The scent generator 54 is configured as an aroma diffuser as an example.

The dialogue unit 55 is configured to give a plurality of dialogue stimuli to the occupant. In addition, each of the plurality of dialogue stimuli is configured to present at least one message having a unique content in order to interact with the occupant. The dialogue unit 55 may be configured to receive the reaction of the occupant to the message and present at least one further message according to the reaction. These messages may be, for example, messages for conducting daily conversations with the occupants, or messages indicating questions or problems to the occupants.

The dialogue unit 55 may present these messages or receive a response to the messages in various ways. The dialogue unit 55 may include, for example, a speaker and a microphone, emit these messages from the speaker, and collect the reaction of the occupant to the message with the microphone. Further, the dialogue unit 55 may output these messages to the display device 51 and present the messages on the display device 51. Further, the dialogue unit 55 may be configured to receive the manual input of the occupant for these messages via an operation unit such as a touch panel.

In addition to this, the improvement device 1 may be connected to another device provided on the instrument panel or the like via a communication line such as an in-vehicle LAN. Then, the improvement device 1 may cause these devices to execute various processes by communicating with these devices via the communication line.

Further, the improvement device 1 includes a microcomputer having a CPU 10, semiconductor memories such as RAM, ROM, and flash memory (hereinafter referred to as memory 11), an in-vehicle communication unit 12, and an external communication unit 13. The CPU 10 executes a program stored in the memory 11. Each function of the improvement device 1 is realized by the CPU 10 executing the program stored in the non-transitional substantive storage medium. In this example, the memory 11 corresponds to a non-transitional substantive storage medium in which a program is stored. Moreover, when this program is executed, the method corresponding to the program is executed. The improvement device 1 may include one microcomputer or a plurality of microcomputers. Further, the method for realizing the function of the improvement device 1 is not limited to software, and some or all of the functions may be realized by using an electronic circuit. In this case, the electronic circuit may be configured as a digital circuit, an analog circuit, or a combination thereof.

The in-vehicle communication unit 12 is connected to a communication line such as an in-vehicle LAN and communicates with other devices. As an example, the in-vehicle communication unit 12 communicates with the automatic driving control device 4 and receives the automatic driving level set by the automatic driving control device 4.

[2. Function of improvement device]
The in-vehicle system 100 is to perform a process for giving a plurality of stimuli to the occupant via at least one of visual, olfactory, auditory, and tactile senses in order to improve the physical and mental condition of the occupant. It is configured. In the present embodiment, the mental and physical condition of the occupant is expressed by using two index values, a comfort degree which is a value indicating the degree of comfort of the occupant and an arousal degree which is a value indicating the degree of awakening of the occupant. To. The mental and physical condition of the occupant may be expressed by using other indexes in addition to the comfort level and the alertness level. In addition, the mental and physical condition of the occupant may be expressed by using another index instead of both or one of the comfort level and the alertness level.

The CPU 10 estimates the occupant's comfort level and arousal level based on both or one of the photographing data output by the camera 2 and the heart rate measurement data output by the heart rate sensor 3. Specifically, the CPU 10 may estimate the occupant's comfort level and arousal level based on the occupant's facial expression or posture. The comfort level and the alertness level can be plotted on a two-dimensional graph (hereinafter referred to as a graph) as shown in FIG. 2 as an example. Moreover, the value may be determined stepwise, for example. The x-axis of the graph shows comfort and the y-axis of the graph shows alertness. A negative value indicates unpleasantness, and a positive value indicates comfortableness. A negative value indicates a sleep state, a positive value indicates a hypervigilance state, and a value of 0 indicates an optimal arousal state.

[3. About emotional vector]
An emotional vector 7 is set for each of the plurality of stimuli given to the occupant (see FIG. 2). Hereinafter, the aggregate of the emotional vectors 7 corresponding to each of these stimuli will be referred to as the emotional vector DB70. Although the details will be described later, the in-vehicle system 100 selects a stimulus to be given to the occupant based on the emotion vector 7 in the emotion vector DB 70 in order to improve the mental and physical condition of the occupant.

Each component of the emotion vector 7 indicates how much the value of each index indicating the mental and physical state of the occupant changes when the stimulus corresponding to the emotion vector 7 is given to the occupant. In other words, the emotional vector 7 indicates the direction in which the mental and physical state of the occupant changes on the graph when the stimulus corresponding to the emotional vector 7 is given to the occupant. Hereinafter, the component indicating the change in the comfort level of the occupant when the stimulus is given to the occupant will be referred to as the comfort level component, and the component indicating the change in the alertness level will be referred to as the arousal level component. Then, a path indicating a change in the mental and physical state of the occupant to which the stimulus is given (hereinafter, a stimulus path) is represented on the graph as a path extending in the same direction as the emotion vector 7 corresponding to the stimulus. The length of the stimulation pathway can be determined according to, for example, the intensity of the given stimulation, the period during which the stimulation is given, or the like.

The in-vehicle system 100 may select a stimulus to be given to each occupant by using the common emotion vector DB 70. In this case, each emotion vector 7 included in the emotion vector DB 70 may indicate a change in the average mental and physical state that can occur when a stimulus corresponding to the emotion vector 7 is given to the occupant. Such an emotional vector 7 may be determined based on the average value of the measurement results of changes in the mental and physical states when a plurality of persons are given a stimulus corresponding to the emotional vector 7.

Further, the in-vehicle system 100 may select a stimulus by using a plurality of emotional vectors DB 70. Specifically, for example, each emotion vector DB 70 reflecting a change in the mental and physical state of each occupant may be provided corresponding to the occupant. Then, the in-vehicle system 100 may select the stimulus to be given to the occupant by using the emotion vector DB 70 corresponding to the occupant.

In addition to this, the emotion vector DB 70 may be provided with characteristic information indicating the characteristics (for example, age, gender, body type, etc.) of the occupant corresponding to the emotion vector DB 70. Then, when the in-vehicle system 100 stimulates an occupant who is not provided with the corresponding emotion vector DB 70, the characteristics of the occupant may be detected by a camera 2 or the like. Then, the in-vehicle system 100 obtains the emotion vector DB 70 provided corresponding to the occupant showing the same or similar characteristics as the occupant based on the detected characteristics of the occupant and the characteristic information provided in the emotion vector DB 70. You may search. Then, the emotion vector DB 70 found by the search may be used for selecting the stimulus to be given to the occupant.

In addition, for example, occupants are classified into a plurality of types according to age, gender, body type, etc., and emotions reflecting changes in the mental and physical condition that can typically occur in the occupants classified into the types corresponding to each type of occupants. The vector DB 70 may be provided. Then, the in-vehicle system 100 may determine the type of the occupant to be stimulated by the camera 2 or the like, and select the stimulus to be given to the occupant by using the emotion vector DB 70 corresponding to the determined type.

Further, for example, an emotional vector DB 70 may be provided that reflects a change in the mental and physical state that can typically occur in the occupant of the own vehicle in each state in response to the state of the outside environment (for example, weather or outside air temperature). Then, the in-vehicle system 100 may select the stimulus to be given to the occupant by using the emotion vector DB 70 corresponding to each state indicating the current vehicle exterior environment. Further, for example, an emotion vector DB 70 may be provided corresponding to the control state of the own vehicle (for example, the automatic driving level) and reflecting the change in the mental and physical state that can typically occur in the occupant of the own vehicle in each control state. .. Then, the in-vehicle system 100 may select a stimulus to be given to the occupant by using the emotion vector DB 70 corresponding to the current control state of the own vehicle.

Each emotion vector DB 70 described above may be stored in the improvement device 1 (for example, in the memory 11). Further, each emotion vector DB 70 may be stored in the cloud server 6. Then, the out-of-vehicle communication unit 13 may acquire the emotion vector DB 70 used to stimulate the current occupant from the server 6 by accessing the Internet via wireless communication.

[4. About stimulation pattern]
Here, the mental and physical state indicated by the comfort level and the arousal level estimated by the CPU 10 is defined as the start state A (see FIG. 3). In addition, the mental and physical state when each of the comfort level and the arousal level is within a predetermined appropriate range is defined as the target state B. The CPU 10 selects at least one stimulus to be given to the occupant as a stimulus pattern based on the start state A, the target state B, and the emotion vector 7 corresponding to each stimulus. The stimulus pattern may be composed of a plurality of stimuli. In this case, the order in which these stimuli are given to the occupants is set. That is, even if there are a plurality of stimulus patterns composed of the three stimuli A, B, and C, if the order in which the three stimuli are given to the occupant is different, these stimulus patterns will be different. Further, when the emotion vector DB 70 is provided for each occupant, the stimulus pattern may be selected based on the emotion vector DB 70 corresponding to the occupant to which at least one stimulus is given.

Further, the period during which at least one stimulus, which is a stimulus pattern, is given is defined as a stimulus period. The stimulus pattern means that when at least one stimulus, which is the stimulus pattern, is given to the occupant, the mental and physical state that was the start state A at the start of the stimulus period changes to the target state B. This is what the corresponding emotional vector 7 shows.

More specifically, at least one stimulus, which is a stimulus pattern, is given to the occupant in the order set in the stimulus pattern. Then, on the graph of FIG. 2, when the stimulus pathways corresponding to each of the at least one stimulus are combined according to the order, as shown in FIG. 3, the pathway from the start state A to the target state B (hereinafter, hereafter). A stimulation pattern pathway 71) is formed. That is, when the at least one stimulus is given to the occupant in this order, it is presumed that the mental and physical state of the occupant, which was the start state A, changes along the stimulus pattern path 71 and becomes the target state B.

The CPU 10 may visually display the difference between the start state A and the target state B of the occupant to the occupant. For example, the CPU 10 may display the graph shown in FIG. 3 via the display device 51 as a diagram showing the deviation between the start state A and the target state B of the occupant. As a result, the occupant can easily visually recognize how much the start state A and the target state B are separated from each other.

The CPU 10 performs a process of stimulating the occupant based on the stimulus pattern. The display of images and characters in front of the occupant by the display device 51, or the light emission to the occupant corresponds to one of the stimuli given to the occupant. Further, the blowing of cold air or hot air to the occupant by the air conditioner 52 corresponds to one of the stimuli given to the occupant. Further, the pressing or vibration of the vibration device 53 on a part of the occupant's body corresponds to one of the stimuli given to the occupant. Further, the generation of the scent to the occupant by the scent generator 54 corresponds to one of the stimuli given to the occupant. Further, the dialogue stimulus by the dialogue unit 55 corresponds to one of the stimuli given to the occupant. In addition, for example, a buzzer sound for an occupant by a buzzer generator (not shown) or music reproduction by a music playback device (not shown) corresponds to one of the stimuli given to the occupant.

[5. Improvement process]
Next, the process of improving the physical and mental condition of the occupant will be described with reference to the flowchart of FIG. The improvement process may be periodically executed by the CPU 10 of the in-vehicle system 100.

In S200, the CPU 10 sets the target state B. The target state B may be included in a predetermined area (hereinafter, target area C). As an example, the target region C may be a region in which the comfort level is a positive value and the arousal level is a value near 0.

Further, the target state B may be set according to the automatic driving level received by the in-vehicle communication unit 12, as an example. For example, when the automatic driving level is low, that is, when most of the acceleration / deceleration and steering of the own vehicle are performed by the driver's operation, the target state B is set so that the arousal degree is a positive value near 0. May be done. On the other hand, when the automatic driving level is high, that is, when all or most of the acceleration / deceleration and steering of the own vehicle are controlled by the automatic driving control device 4, the degree of arousal is slightly lower than when the automatic driving level is low. You may. Therefore, the target state B may be set so as to be included in the target area C and the range of the arousal degree indicating the target state B is wider than when the automatic driving level is low. As an example, the target state B may be set so that the arousal level is a negative value near 0.

Further, for example, the CPU 10 may accept the manual input of the occupant for setting the range of the comfort level and the arousal level indicating the target state B via the operation unit.
In S200, the CPU 10 may set a target state different from the target state B set in the previous improvement process. The target state may be included in the target area C. The target state and the target state B may be different in all or part of the values of each index.

That is, in S200 of each improvement process, the CPU 10 may set a target state that is different from the target state set in the improvement process from the previous time to x times before and is included in the target area C. Note that x may be, for example, a positive integer of 2 or more.

In S205, the CPU 10 detects the state of the occupant by at least one of the camera 2 and the heart rate sensor 3.
In S210, the CPU 10 estimates the comfort level and the arousal level indicating the current mental and physical state of the occupant based on the detection result in S205. The mental and physical states indicated by the estimated comfort and arousal levels correspond to the above-mentioned starting state A.

In S215, the CPU 10 determines whether the mental and physical state of the occupant has reached the target state B from the start state A. If an affirmative judgment is obtained (S215: Yes), it is considered that the physical and mental condition of the occupant is appropriate and no improvement is necessary, and this process is terminated. If a negative determination is obtained (S215: No), the process proceeds to S220.

In S220, the CPU 10 selects the above-mentioned stimulation pattern capable of changing the mental and physical state of the occupant from the start state A to the target state B. When a plurality of such stimulation patterns exist, one of these stimulation patterns (hereinafter, selection target) may be selected as follows. In order to make the selection, it is necessary to grasp the change in the comfort level and / or the arousal level of the occupant when at least one stimulus to be selected is given. The change is grasped based on the stimulus pattern pathway 71 corresponding to the selection target, in other words, based on each emotion vector 7 corresponding to at least one stimulus constituting the selection target.

For example, the CPU 10 may select one of a plurality of selection targets based on the automatic driving level received by the in-vehicle communication unit 12. That is, when the automatic driving level is low, the selection target may be selected in which the arousal level is the earliest in the range of values near 0, and then the arousal level is maintained in this range until the end of the stimulation period. On the other hand, when the automatic driving level is high, the selection target may be selected in which the deterioration of the arousal level is suppressed and the comfort level is a positive value for most of the stimulation period.

Further, for example, the CPU 10 may select a plurality of selection targets having the smallest degree of increase / decrease in comfort and arousal during the stimulation period. That is, among the plurality of selection targets, the one with the shortest stimulation pattern path 71 may be selected. The stimulation pattern path 71 may be searched by a general path search method (for example, Dijkstra's algorithm or A * search algorithm).

In addition, one of the comfort and alertness indexes that should be prioritized is set as the specific index. For example, in the CPU 10, the value of the specific index reaches the predetermined range (hereinafter, the first range) earliest among the plurality of selection targets, and the value of the specific index is in the first range until the stimulation period ends. You may choose the one that is maintained in. The first range is, for example, a range in which the comfort level is a positive value when the comfort level is a specific index, and a range in which the arousal level is a value near 0 when the arousal level is a specific index. It may be.

Further, for example, the comfort level may be used as a specific index, and the range in which the comfort level is a positive value may be set as the first range. In this case, when there are a plurality of selection targets composed of the same stimulus, the CPU 10 may select a stimulus pattern that gives the occupant a stimulus that brings the comfort level closer to a positive value earlier. good.

Further, for example, the CPU 10 may select a plurality of selection targets in which the mental and physical condition of the occupant does not reach a predetermined specific range (hereinafter, the second range) during the stimulation period. The second range may indicate a state inappropriate for the driving of the occupant. More specifically, the second range may be, for example, a range in which the comfort level is a negative value, a range in which the arousal level is a negative value, or a range in which the comfort level is a negative value. There may be a range in which the arousal level is a negative value. The second range may be set according to the automatic driving level received by the in-vehicle communication unit 12. Specifically, for example, when the automatic driving level is low, the range of the arousal degree constituting the second range may be expanded in the second range as compared with the case where the automatic driving level is high. As a result, it is possible to prevent the occupant from being in an inappropriate state for driving his / her own vehicle.

Further, for example, the CPU 10 may select a plurality of selection targets in which the mental and physical state of the occupant reaches a predetermined specific range (hereinafter, the third range) during the stimulation period. As an example, the third range may be a range near the target area C.

Further, for example, the CPU 10 may display a plurality of selection targets to the occupant via the display device 51. Then, the CPU 10 may accept the manual input of the occupant for selecting one of the plurality of displayed selection targets via the operation unit.

In S225, the CPU 10 estimates the comfort level and the arousal level indicating the mental and physical state of the occupant (hereinafter, the first mental and physical state) in the same manner as in S210.
In S230, the CPU 10 performs a process of giving the occupant any stimulus that has not yet been given to the occupant, which constitutes the stimulus pattern selected in S220. As a result, the CPU 10 gives each stimulus to the occupant according to the order set in the stimulus pattern. The stimulus may be given to the occupant by any of the display device 51, the air conditioner 52, the vibration device 53, the scent generator 54, and the dialogue unit 55 based on the processing by the CPU 10.

In S235, the CPU 10 estimates the comfort level and the arousal level indicating the mental and physical state of the occupant (hereinafter, the second mental and physical state) in the same manner as in S210. Then, the CPU 10 determines the difference value of the comfort level and the difference value of the arousal level between the first and second mental and physical states based on the estimation result of the comfort level and the arousal level indicating the first mental and physical state and the second mental and physical state. calculate. The calculated difference value of each index is stored in the memory 11 in association with the stimulus given to the occupant in S230. Further, the CPU 10 uses the difference value calculated in S235 and the same emotion vector DB70 used for selecting the stimulus pattern in S220 for each index, and the same stimulus calculated in the past improvement process. You may calculate the average value with the difference value in.

In S240, it is determined whether all the stimuli constituting the stimulus pattern selected in S220 have been given to the occupant. If an affirmative determination is obtained (S240: Yes), the process proceeds to S215 again. On the other hand, when a negative determination is obtained (S240: No), the process proceeds to S225, and S225 to S240 are repeated.

In S245, the CPU 10 corrects the emotion vector 7 corresponding to each stimulus constituting the stimulus pattern among the emotion vectors 7 in the emotion vector DB 70 used for selecting the stimulus pattern in S220. Specifically, the CPU 10 receives the emotion vector 7 corresponding to the stimulus based on the average value of the difference values of the comfort level and the arousal level calculated in S235 for each stimulus constituting the stimulus pattern selected in S220. Corrects the comfort and alertness components of. As an example, the CPU 10 may replace the component of each index in the emotion vector 7 with the average value of the difference values for the index in the stimulus to which the emotion vector 7 corresponds, or may bring them closer to each other. When the emotion vector DB 70 is provided for each occupant, in S245, the comfort component and the alertness component of the emotion vector 7 in the emotion vector DB 70 corresponding to the stimulated occupant are corrected. The occupant's emotional vector 7 can be updated.

[6. effect]
According to the embodiment described in detail above, the following effects are obtained.
(6a) According to the above embodiment, the in-vehicle system 100 is given to the occupant at least 1 based on the estimation result of the comfort level and the arousal level indicating the mental and physical state of the occupant and the emotion vector 7 corresponding to each stimulus. Select one stimulus. Therefore, the in-vehicle system 100 can grasp in advance how much the comfort level and the arousal level change when each of the selected stimuli is given to the occupant. As a result, it is possible to prevent the occupant from being given an inappropriate stimulus or the like, so that the condition of the occupant can be suitably improved.

(6b) Further, the in-vehicle system 100 selects at least one stimulus described above in which the mental and physical state of the occupant can change from the start state A to the target state B as the stimulus pattern. Further, the process in which the mental and physical state of the occupant reaches the target state B from the start state A by being given the stimulus is represented by the stimulus pattern path 71. Therefore, the in-vehicle system 100 can grasp in advance the change in the mental and physical state of the occupant when at least one stimulus constituting the stimulus pattern is given to the occupant. Thereby, the condition of the occupant can be preferably improved.

(6c) Further, the in-vehicle system 100 may select a stimulation pattern based on the automatic driving level of the vehicle. That is, for example, when the automatic driving level is low, the in-vehicle system 100 may select a stimulation pattern in which the arousal level becomes appropriate at an early stage and the mental and physical state of the occupant can be changed from the start state A to the target state B. good. Further, for example, when the automatic driving level is high, the in-vehicle system 100 may select a stimulation pattern capable of changing the mental and physical state of the occupant from the start state A to the target state B while maintaining good comfort. .. As a result, the condition of the occupants can be effectively improved.

(6d) Further, it is assumed that there are a plurality of stimulation patterns that can change the mental and physical state of the occupant from the start state A to the target state B. In this case, for example, the in-vehicle system 100 may select a stimulation pattern that forms the shortest stimulation pattern path 71. As a result, the mental and physical condition of the occupant can be changed from the start state A to the target state B at an early stage.

Further, in the above case, one of the comfort and alertness indexes that should be prioritized may be used as the specific index. Then, for example, the in-vehicle system 100 may select a stimulation pattern in which the value of the specific index reaches the first range earliest in the stimulation period and the value is maintained in the first range until the stimulation period ends. .. As a result, the mental and physical state of the occupant can be changed from the start state A to the target state B while preferentially changing the specific index to a good value.

Further, for example, the in-vehicle system 100 may select a stimulation pattern in which the mental and physical condition of the occupant does not reach the second range during the stimulation period. As a result, the mental and physical condition of the occupant can be changed from the start state A to the target state B while suppressing the deterioration of the mental and physical condition of the occupant.

Further, for example, the in-vehicle system 100 may select a stimulation pattern in which the mental and physical condition of the occupant reaches the third range during the stimulation period. As a result, the mental and physical condition of the occupant can be suitably changed from the start state A to the target state B.

(6e) Further, in the improvement process, the in-vehicle system 100 sets a target state that is different from the target state B set in the previous improvement process and is included in the target area C. As a result, a stimulus pattern different from the stimulus pattern selected in the previous improvement process can be selected. Therefore, it is possible to suppress the occupant's accustomed to the stimulus.

(6f) Further, in the in-vehicle system 100, for each of the stimuli constituting the stimulus pattern, the comfort level between the first mental and physical state before the stimulus is given and the second mental and physical state after the stimulus is given. Calculate the difference value and the difference value of the arousal level. Then, the in-vehicle system 100 corrects the comfort component and the alertness component of the emotion vector 7 corresponding to the stimulus based on these difference values. As a result, the accuracy of the emotion vector 7 corresponding to the stimulus is improved.

(6g) Further, the in-vehicle system 100 sets the target state B based on the automatic driving level of the vehicle. Specifically, the in-vehicle system 100 changes the range of the arousal degree indicating the target state B according to the automatic driving level. Therefore, the condition of the occupant can be preferably improved.

(6h) Further, the state of the occupant is detected by at least one of the camera 2 and the heart rate sensor 3. Then, based on the detection result of the occupant's state, the comfort level and the arousal level indicating the mental and physical state of the occupant are estimated. Therefore, the mental and physical condition of the occupant can be suitably grasped.

(6i) Further, in order to improve the condition of the occupant, a dialogue stimulus by the dialogue unit 55 is given to the occupant. Therefore, the mental and physical condition of the occupant can be preferably changed.
(6j) Further, the mental and physical condition of the occupant is expressed by using the values of two indexes, the comfort level and the alertness level. Therefore, the mental and physical condition of the occupant can be suitably grasped.

[7. Other embodiments]
Although the embodiments of the present disclosure have been described above, the present disclosure is not limited to the above-described embodiments, and can be implemented in various modifications.

(7a) In the above embodiment, the vehicle-mounted system 100 illustrates a configuration including a camera 2 and a heart rate sensor 3. However, the in-vehicle system 100 uses other sensors such as an electrocardiographic sensor, an IR sensor, an outside temperature sensor, and a room temperature sensor in place of both or one of the camera 2 and the heart rate sensor 3, to provide occupant comfort and comfort. The degree of arousal may be estimated.

(7b) Further, in the case where each device of the own vehicle performs a process of improving the mental and physical condition of the occupant in accordance with the operation of the occupant while riding, as in the case of the stimulus corresponding to each emotion vector 7 in the emotion vector DB 70. There can be. In this case, the in-vehicle system 100 may set the process as a stimulus and newly register the emotion vector 7 indicating the change in the mental and physical state of the occupant due to the process in the emotion vector DB 70.

That is, the in-vehicle system 100 may detect an operation by an occupant to perform the above processing (for example, a processing for outputting a predetermined music or video) by receiving an input signal via a communication line. Then, the in-vehicle system 100 may estimate the comfort level and the arousal level of the occupant when the operation is performed. Further, when the in-vehicle system 100 detects that the above processing is completed (for example, the output of music or video is completed) via the communication line, the occupant's comfort level and arousal level can be estimated again. good. Then, when the in-vehicle system 100 compares the results of these estimations and detects a change in the comfort level and the arousal level, the above process may be set as a new stimulus. Further, the in-vehicle system 100 may register the change in the comfort level and the arousal level of the occupant due to the process as a new emotional vector 7 in the emotional vector DB 70.

(7c) Further, in the above-described embodiment, a configuration in which the target state B is set or the stimulation pattern is selected according to the automatic driving level is illustrated. However, the in-vehicle system 100 may set the target state B or select the stimulation pattern based on other control states of the vehicle such as the vehicle speed instead of the automatic driving level.

(7d) Further, S245 may be omitted in the improvement process.
(7e) Further, in the above embodiment, the process of improving the mental and physical condition of one occupant is illustrated, but the in-vehicle system 100 is configured to perform the process of improving the mental and physical condition of a plurality of occupants of the own vehicle. It may be configured. Specifically, the in-vehicle system 100 may detect the states of a plurality of occupants in the own vehicle in S205 of the improvement process. Further, in S210, the in-vehicle system 100 may estimate the comfort level and the arousal level indicating the mental and physical states of each occupant based on the detection result, and calculate the average value of each of the comfort level and the arousal level. Further, the in-vehicle system 100 may use the average value as an index value indicating the start state A of the entire plurality of occupants.

The in-vehicle system 100 may detect the characteristics of a plurality of occupants, for example. Further, in the in-vehicle system 100, the characteristic common to the largest number of occupants among the detected characteristics of each occupant may be the characteristic of the entire occupant. Further, an average characteristic may be calculated from the detected characteristics of each occupant, and the characteristics may be used as the characteristics of the entire occupant. Then, the in-vehicle system 100 may search the emotion vector DB 70 provided corresponding to the occupant showing the same or similar characteristics as the characteristics of the entire occupant. Then, the emotion vector DB 70 found by the search may be used for selecting the stimulus to be given to the entire occupant.

In S220, the in-vehicle system 100 may select a stimulation pattern that can change the mental and physical states of the entire plurality of occupants from the start state A to the target state B by using the emotion vector DB 70. Then, at least one stimulus constituting the selected stimulus pattern may be given to the entire occupant in S230.

Further, in S225 and S235, the in-vehicle system 100 may estimate the comfort level and the arousal level indicating the mental and physical states of each occupant, and calculate the average value of the comfort level and the arousal level. Then, the in-vehicle system 100 uses the average value in S225 as the value of the index indicating the first mental and physical condition of the entire plurality of occupants, and the average value in S235 as the value of the index indicating the second mental and physical condition of the entire plurality of occupants. You may use it.

(7f) A plurality of functions possessed by one component in the above embodiment may be realized by a plurality of components, or one function possessed by one component may be realized by a plurality of components. .. Further, a plurality of functions possessed by the plurality of components may be realized by one component, or one function realized by the plurality of components may be realized by one component. Further, a part of the configuration of the above embodiment may be omitted. In addition, at least a part of the configuration of the above embodiment may be added or replaced with the configuration of the other above embodiment.

(7g) In addition to the above-described in-vehicle system 100, the present disclosure can be realized in various forms such as a program for operating a computer as the in-vehicle system 100 and an optimization method by the in-vehicle system 100.

[5. Correspondence of wording]
In the present embodiment, the camera 2 and the heart rate sensor 3 correspond to an example of the detection unit. Further, the in-vehicle communication unit 12 corresponds to an example of a specific unit. Further, S200 in the improvement process corresponds to the setting unit. Further, S210, S225, and S235 correspond to the estimation unit. Further, S220 corresponds to the selection unit. Further, S230 corresponds to the processing unit. Further, S245 corresponds to the correction unit.

1 ... improvement device, 2 ... camera, 3 ... heart rate sensor, 4 ... automatic driving control device, 6 ... server, 7 ... emotion vector, 10 ... CPU, 11 ... memory, 12 ... in-vehicle communication unit, 13 ... out-of-vehicle communication unit, 51 ... Display device, 52 ... Air conditioner, 53 ... Vibration device, 54 ... Fragrance generator, 55 ... Dialogue unit, 70 ... Emotion vector DB, 71 ... Stimulation pattern path, 100 ... In-vehicle system.

Claims (13)

An in-vehicle system (100) configured to perform processing for giving a plurality of stimuli to a vehicle occupant.
The detection unit (2, 3) that detects the state of the occupant and
An estimation unit (S210) that estimates values of a plurality of indicators indicating the mental and physical condition of the occupant based on the condition of the occupant, and an estimation unit (S210).
Based on the emotional vector (7) corresponding to each of the plurality of stimuli and the values of the plurality of indexes estimated by the estimation unit, at least one of the plurality of stimuli is given to the occupant. A selection unit (S220) for selecting a stimulus and
A processing unit (S230) that performs a process for giving the occupant at least one stimulus selected by the selection unit, and a processing unit (S230).
With
The emotion vector indicates how much the value of each of the plurality of indicators indicating the mental and physical states of the occupant changes when the stimulus corresponding to the emotion vector is given to the occupant.
In-vehicle system. The in-vehicle system according to claim 1.
The mental and physical state indicated by the values of the plurality of indexes estimated by the estimation unit is defined as the start state (A).
The mental and physical state in which the value of each of the plurality of indexes is within a predetermined range is defined as the target state (B).
The selection unit further takes into account the target state and selects at least one stimulus as the stimulus pattern.
The period during which the at least one stimulus, which is the stimulus pattern, is given is defined as a stimulus period.
The stimulation pattern means that when the at least one stimulus is given to the occupant, the mental and physical state that was the starting state at the start of the stimulating period changes to the target state. The corresponding sentimental vector indicates,
In-vehicle system. The in-vehicle system according to claim 2.
A specific unit (12) for specifying the control state of the vehicle is further provided.
The selection unit selects the stimulation pattern based on the control state of the vehicle specified by the specific unit.
In-vehicle system. The in-vehicle system according to claim 2.
The selection unit selects the stimulus pattern having the smallest degree of increase / decrease in the value of each of the indexes during the stimulus period, which is grasped based on the emotion vector corresponding to the at least one stimulus included in the stimulus pattern. To do,
In-vehicle system. The in-vehicle system according to claim 2.
The selection unit selects at least one stimulus given to the occupant in a predetermined order as the stimulus pattern.
A part of the plurality of indicators is used as a specific index.
In the stimulation period, the selection unit reaches the value of the specific index earliest in the predetermined first range, and the value of the specific index is maintained in the first range until the stimulation period ends. That is, the stimulus pattern indicated by the emotional vector corresponding to the at least one stimulus is selected.
In-vehicle system. The in-vehicle system according to claim 2.
The selection unit selects the stimulus pattern indicated by the emotional vector corresponding to the at least one stimulus that the mental and physical state does not reach a predetermined second range during the stimulus period.
In-vehicle system. The in-vehicle system according to any one of claims 2 to 6.
A setting unit (S200) for setting the target state is further provided.
In-vehicle system. The in-vehicle system according to claim 7.
A region in which the values of each of the plurality of indexes are within a predetermined range is defined as a target region (C).
The setting unit repeatedly sets the target state included in the target area, and sets the target state repeatedly.
When the target state is newly set by the setting unit, the selection unit further takes into account the target state and selects at least one stimulus as the stimulus pattern.
When the at least one stimulus is newly selected by the selection unit, the processing unit performs a process for giving the at least one stimulus to the occupant.
The setting unit is different from the target state added when the stimulus pattern is selected after the at least one stimulus which is the stimulus pattern is given to the occupant, and is included in the target region. Set the target state
In-vehicle system. The in-vehicle system according to claim 7.
Further provided with a specific unit for specifying the control state of the vehicle,
The setting unit sets the target state according to the control state of the vehicle specified by the specific unit.
In-vehicle system. The in-vehicle system according to any one of claims 1 to 9.
A correction unit (S245) for correcting the emotion vector is further provided.
The estimation unit (S225, S235) estimates the values of the plurality of indicators indicating the first mental and physical state of the occupant before the stimulus is applied, and after the stimulus is applied, the estimation unit (S225, S235) estimates the values of the plurality of indexes indicating the first mental and physical state. The values of the plurality of indicators indicating the second mental and physical condition, which is the mental and physical condition of the occupant, are estimated.
The correction unit has the first mind-body state and the second mind-body state based on the difference between the values of the plurality of indicators indicating the first mind-body state and the values of the plurality of indicators indicating the second mind-body state. Correcting the emotional vector corresponding to the stimulus given to the occupant when estimating the values of the plurality of indicators indicating the state.
In-vehicle system. The in-vehicle system according to any one of claims 1 to 10.
The detection unit detects the state of the occupant by using at least one of the image of the occupant and the heart rate of the occupant.
In-vehicle system. The in-vehicle system according to any one of claims 1 to 11.
At least a part of the plurality of stimuli is a plurality of dialogue stimuli.
The plurality of dialogue stimuli are provided with the emotional vectors corresponding to each of the plurality of dialogue stimuli.
Each of the plurality of dialogue stimuli presents at least one message having a unique content in order to interact with the occupant.
In-vehicle system. The in-vehicle system according to any one of claims 1 to 12.
One of the plurality of indicators is the comfort level indicating the degree of comfort of the occupant, and the other of the plurality of indicators is the arousal level indicating the degree of awakening of the occupant.
In-vehicle system.