JP2022068567A - Information presentation device, information presentation method and information presentation program - Google Patents

Abstract

To provide an information presentation device, information presentation method and an information presentation program whereby, in the case of obtaining an evaluation result of presented information on the basis of a user's feeling, it is possible to obtain the evaluation result that is less affected by the feelings unrelated to the presented information.SOLUTION: An information presentation device comprises an information presentation part which presents recommended information to a crew member in a vehicle, a feeling estimation part which estimates the feeling of the crew member and an evaluation part which executes evaluation concerning presentation of the recommended information on the basis of an estimation result of feeling of the crew member after presentation of the recommended information of the information presentation part.SELECTED DRAWING: Figure 1

Description

The present invention relates to an information presentation device, an information presentation method, and an information presentation program.

In recent years, for example, a technique has been developed in which an emotion estimation device such as a computer estimates a person's emotions based on the behavior of a person's voice, facial expression, or the like.

For example, in Patent Document 1, when a vehicle visits a facility in a specific area such as an event or shopping, the emotion estimation unit estimates the emotions of the passenger within a specified time after the vehicle leaves the visited facility. A facility satisfaction calculation device for calculating the satisfaction of the facility is disclosed.

Japanese Unexamined Patent Publication No. 2018-0555550

However, in the facility satisfaction calculation device of Patent Document 1, for example, when an event that affects the occupant's emotion occurs when estimating the occupant's emotion, the facility is affected. It may not be possible to calculate the correct degree of satisfaction.

The present invention has been made in view of the above points, and in obtaining the evaluation result of the presented information based on the emotion of the user, it is possible to obtain the evaluation result in which the influence of the emotion unrelated to the presented information is suppressed. It is an object of the present invention to provide an information presenting device, an information presenting method, and an information presenting program thereof.

The invention according to claim 1 is an information presentation unit that presents recommended information to a vehicle occupant, an emotion estimation unit that estimates the occupant's emotions, and the occupant after the information presentation unit presents the recommended information. The information presenting device is characterized by comprising an evaluation unit for evaluating the presentation of the recommended information based on the estimation result of emotions.

The invention according to claim 10 is an information presenting method of an information presenting device for presenting recommended information to a vehicle occupant, wherein the information presenting unit presents the recommended information to the occupant of the vehicle, and an information presenting step. An emotion estimation step in which the emotion estimation unit estimates the occupant's emotion, and an evaluation step in which the evaluation unit evaluates the recommended information based on the estimation result of the occupant's emotion after the information presentation unit presents the recommended information. And is characterized by including.

The invention according to claim 11 is an information presentation program, in which an information presenting unit presents the recommended information to the occupant of the vehicle on a computer mounted on an information presenting device that presents recommended information to the occupant of the vehicle. The recommendation is based on the information presentation step, the emotion estimation step in which the emotion estimation unit estimates the occupant's emotion, and the estimation result of the occupant's emotion after the information presentation unit presents the recommended information. It is characterized by executing an evaluation step for evaluating information.

It is a perspective view of the front seat portion of the automobile equipped with the information presenting apparatus which concerns on Embodiment 1 of this invention. It is a functional block diagram of the information presenting apparatus 10 which concerns on Example 1 of this application. It is a flow chart of the operation routine of the information presenting apparatus 10 which concerns on Embodiment 1 of this application. It is a flow chart of the operation routine of the information presenting apparatus 10 which concerns on Embodiment 1 of this application. It is a top view of the automobile equipped with the information presenting apparatus which concerns on Example 1 of this invention. It is a functional block diagram of the information presenting apparatus 10 which concerns on Example 2 of this application. It is a flow chart of the operation routine of the information presenting apparatus 10 which concerns on Embodiment 2 of this application. It is a functional block diagram of the information presenting apparatus 10 which concerns on Example 3 of this application. It is a flow chart of the operation routine of the information presenting apparatus 10 which concerns on Example 3 of this application. It is a functional block diagram of the information presenting apparatus 10 which concerns on Example 4 of this application. It is a flow chart of the operation routine of the information presenting apparatus 10 which concerns on Example 4 of this application.

Hereinafter, preferred embodiments of the present invention will be described. However, these may be appropriately modified and combined. Further, in the following description and the accompanying drawings, substantially the same or equivalent parts will be described with the same reference numerals. Further, in the following description, the video will be described as including a moving image and a still image.

Hereinafter, the information presentation system 100 including the information presentation device 10 according to the first embodiment of the present invention will be described with reference to the attached drawings. In the first embodiment, the case where the information presenting device 10 is mounted on the automobile M will be described as an example.

FIG. 1 is a diagram showing an example of a front seat portion of an automobile M as a vehicle equipped with the information presenting device 10 according to the first embodiment of the present application. FIG. 1 shows a case where the information presenting device 10 is attached to the center console CC portion of the front seat of the automobile M as an attachment example.

The in-vehicle camera 21 is a camera capable of photographing the occupant of the automobile M. The in-vehicle camera 21 is provided on the dashboard DB, for example, and is oriented so as to be able to photograph an occupant in the vehicle interior of the automobile M, particularly the facial expression or the upper body of the occupant. It should be noted that the in-vehicle camera 21 may be arranged at a position where the situation such as the facial expression of the occupant or the movement of the body can be photographed. For example, the in-vehicle camera 21 may be provided on the rearview mirror RM, or may be provided on the upper end of the windshield FG or on the ceiling portion near the upper end. Further, the in-vehicle camera 21 is communicably connected to the information presenting device 10, and can transmit the signal of the captured image to the information presenting device 10.

A plurality of in-vehicle cameras 21 may be installed in the vehicle interior of the automobile M. For example, an in-vehicle camera 21 capable of photographing each occupant of the driver's seat and the passenger seat is provided on the dashboard DB, and an in-vehicle camera 21 capable of photographing each occupant of the rear seat is provided on the back surface of the driver's seat and the passenger's seat. It may be provided on each of the back surfaces of the headrest. Further, the in-vehicle camera 21 may be configured to be capable of photographing not only the upper body of the occupant but also the whole body.

The in-vehicle microphone 22 is a microphone device that receives the sound in the vehicle, and is arranged on the dashboard DB, for example. The in-vehicle microphone 22 may be provided anywhere, such as a rear-view mirror RM or a handle, as long as it can receive the sound in the vehicle. The in-vehicle microphone 22 is communicably connected to the information presenting device 10, and can transmit the collected sound signal to the information presenting device 10.

The in-vehicle camera 21 and the in-vehicle microphone 22 are in-vehicle status acquisition devices 20 for the information presenting device 10 to acquire in-vehicle status information in the vehicle interior of the vehicle M. The information presenting device 10 includes at least one of an in-vehicle camera 21 and an in-vehicle microphone 22.

The speaker 31 is provided, for example, on the vehicle interior side of the pillar P or the door DR. The speaker 31 is communicably connected to the information presenting device 10, and can emit sounds such as music and voice based on the control of the information presenting device 10.

The display 32 is, for example, a display such as a liquid crystal display capable of displaying an image. The display 32 is arranged on the dashboard DB, for example. The display 32 may be arranged in a place that can be visually recognized by the occupants in the vehicle interior. For example, the display 32 may be attached to the center console CC in the dashboard DB. The display 32 is communicably connected to the information presenting device 10, and can display a screen based on the control of the information presenting device 10. The display 32 may be a touch panel monitor in which a display such as a liquid crystal display capable of displaying an image and a touch panel are combined. In that case, the display 32 can transmit a signal representing an input operation to the touch panel received from the occupant to the information presenting device 10.

The speaker 31 and the display 32 are information presentation devices 30 for the information presentation device 10 to present information to the occupants in the vehicle interior of the automobile M.

The GPS receiver 41 is a device that receives a signal (GPS signal) from a GPS (Global Positioning System) satellite. The GPS receiver 41 is arranged on the dashboard DB, for example. The GPS receiver 41 may be arranged anywhere as long as it can receive GPS signals. The GPS receiver 41 is communicably connected to the information presenting device 10, and can transmit the received GPS signal to the information presenting device 10.

FIG. 2 shows the configuration of the information presentation device 10. The information presenting device 10 is, for example, a device in which the storage unit 53, the control unit 55, the input unit 57, and the output unit 59 cooperate with each other via the system bus 51.

The storage unit 53 is composed of, for example, a hard disk device, an SSD (solid state drive), a flash memory, or the like, and stores various programs such as an operating system and software for terminals.

The various programs may be acquired from another server device or the like via a network, or may be recorded on a recording medium and read via various drive devices. That is, various programs stored in the storage unit 53 (including a program for executing processing in the information presenting device 10 described later) can be transmitted via a network and can be transmitted to a computer-readable recording medium. It can be recorded and transferred.

Further, the storage unit 53 stores, for example, map information and information on facilities corresponding to the map information. In the facility information recorded in the storage unit 53, for example, category information such as restaurants, shopping facilities, tourist spots such as scenic spots, and amusement facilities is recorded. In addition, the facilities or tourist spots included in each category are classified into a plurality of subcategories. For example, facilities included in the restaurant category are classified into subcategories such as Japanese food, Chinese food, and pasta shops. The information presenting device 10 is connected to the Internet by wireless communication, and by acquiring the information via the Internet, the facility information stored in the storage unit 53 is added, and the word-of-mouth information of the facility is updated at any time. It may be done.

The control unit 55 is composed of a CPU (Central Processing Unit) 55A, a ROM (Read Only Memory) 55B, a RAM (Random Access Memory) 55C, and the like, and functions as a computer. Then, the CPU 55A realizes various functions by reading and executing various programs stored in the ROM 55B and the storage unit 53.

The input unit 57 is an interface unit that communicably connects the information presenting device 10 and the vehicle interior status acquisition device 20. The information presenting device 10 can receive a video signal from the in-vehicle camera 21 and an audio signal from the in-vehicle microphone 22 via the input unit 57. Further, the information presenting device 10 can receive a signal of the current position information of the automobile M from the GPS receiver 41 via the input unit 57.

The output unit 59 is communicably connected to the speaker 31 and the display 32, and transmits an audio signal to the speaker 31 to output sound, or transmits a video or image signal to the display 32 to display the sound. It is possible.

As described above, the information presenting device 10 receives the signal of the current position information of the automobile M from the GPS receiver 41 via the input unit 57. The control unit 55 is a facility that should be recommended to the occupants of the vehicle M in the vicinity of the vehicle M or in the traveling direction from the position information of the vehicle M received via the input unit 57 and the map information recorded in the storage unit 53. It is possible to present recommended information such as. At this time, the control unit 55 functions as an information presentation unit. In other words, the information presenting device 10 includes a control unit 55 as an information presenting unit that presents recommended information to the occupants of the automobile M.

Further, as described above, the information presenting device 10 receives the image of the inside of the vehicle including the occupant of the vehicle M from the in-vehicle camera 21 via the input unit 57. Further, the information presenting device 10 receives the voice including the voice of the occupant in the vehicle interior of the automobile M from the in-vehicle microphone 22 via the input unit 57. The information presenting device 10 acquires information on behavior such as facial expressions or movements of the occupant from the received video. Alternatively, the information presenting device 10 acquires information on the voice of the occupant or the sound generated by the operation of the occupant from the received voice in the vehicle interior. Hereinafter, it is also simply referred to as the behavior of the occupant including the behavior and voice of the occupant. The control unit 55 can extract the behavior and voice of the occupant from the video and audio received via the input unit 57, and can infer the emotion of the occupant from the extracted behavior and voice.

For example, the control unit 55 estimates the emotions of the occupant based on the facial expressions of the occupants taken by the in-vehicle camera 21, movements such as gestures, or the loudness or tone of the occupant's voice input by the in-vehicle microphone 22. At this time, the control unit 55 functions as an emotion estimation unit. In other words, the information presenting device 10 includes a control unit 55 as an emotion estimation unit that estimates the emotions of the occupant.

In estimating the emotions of the occupant by the control unit 55, for example, the control unit 55 compares the facial expression or voice of the occupant recorded in advance in the storage unit 53 with the facial expression or voice obtained by extracting the above. Estimate emotions. Specifically, for example, emotions are estimated by comparing the shapes of the eyes or mouth of the occupant's facial expressions. Further, for example, the control unit 55 estimates emotions from the movement amount of each part of the occupant's body in comparison with the movement amount of each part of the occupant's body, particularly the upper body, recorded in advance in the storage unit 53. .. Further, for example, the control unit 55 compares the state of the voice such as the volume and color of the voice of the occupant in the calm state recorded in the storage unit 53 in advance with the state of the extracted voice, and the emotion of the occupant. To estimate. In addition, regarding the above facial expressions, movement amount of each part of the body, and voice state, the difference from the calm time recorded in advance is measured as each feature amount, and the emotion of the occupant is estimated from the distribution tendency of each feature amount. You may try to do it.

The estimation of the occupant's emotion by the control unit 55 is not limited to the estimation of the occupant's emotion by the control unit 55 comparing with the occupant's data previously recorded in the storage unit 53 as described above. For example, the emotions of the occupant may be inferred from the video and audio in the vehicle interior by deep learning by an artificial intelligence (AI) program stored in the storage unit 53.

Further, the target for estimating the emotion by the control unit 55 may be only the occupant appearing in the driver's seat, or may be a specific preset occupant. Further, the target for estimating the emotion by the control unit 55 may be all the occupants boarding in the passenger compartment of the automobile M. In that case, for example, the emotions of the occupants who are presumed to be the most emotional among the occupants who are in the passenger compartment of the automobile M may be used as the representative value, or the occupants who are in the passenger compartment of the automobile M may be used as representative values. After estimating and quantifying the emotions of all the members, the average value of the values may be used as a representative value.

The information presenting device 10 presents the recommended information to the occupants in the passenger compartment of the automobile M, and then estimates the emotions of the occupants as described above and evaluates the recommended information. Specifically, the control unit 55 evaluates the recommended information presented according to the estimated emotion obtained after the information of the recommended information is presented, and changes the content of the category of the recommended information to be presented thereafter and the frequency of presentation. .. At this time, the control unit 55 functions as an evaluation unit. In other words, the information presenting device 10 has a control unit 55 as an evaluation unit that evaluates the presentation of the recommended information based on the estimation result of the occupant's emotion after the presentation of the recommended information of the control unit 55 as the information presentation unit. Be prepared.

Specifically, for example, after the information presenting device 10 presents information on a reputable pasta shop in the traveling direction of the automobile M as recommended information, the emotions estimated from the occupants in the passenger compartment of the automobile M are calm. It is presumed that the state changed from a positive state to positive emotions such as joy and enjoyment. At this time, the information presenting device 10 determines that the occupant currently in the passenger compartment prefers information belonging to the restaurant category, particularly the pasta shop subcategory. In this case, the information presenting device 10 makes changes such as increasing the frequency of presenting the pasta shop and facilities belonging to the same category or subcategory in the subsequent presentation of recommended information.

On the other hand, for example, when it is estimated that the emotion estimated from the occupant changes from a calm state to a negative emotion such as anger or disgust after the information presenting device 10 presents the recommended information, the control unit In the subsequent presentation of recommended information, 55 makes changes such as reducing the frequency of presentation of facilities belonging to the same category or subcategory.

That is, the information presenting device 10 can present more recommended information according to the preference of the occupant by repeatedly presenting the recommended information and evaluating the recommended information.

When estimating the emotions of the occupant after presenting the recommended information as described above, it is preferable that the emotions of the occupant are in a calm state at the time of presenting the recommended information. For example, when presenting recommended information, there are quarrels between occupants inside the vehicle, traffic jams outside the vehicle, and sudden interruptions of other vehicles in front of the vehicle. In the following, also referred to simply as an event), the occupant's emotions may not be calm. In such a case, even if the recommended information is presented and the occupant's emotions are estimated after the recommended information is presented, the recommended information is not properly evaluated due to the occupant's emotions caused by the above-mentioned event. There is. In other words, the evaluation of the recommended information is preferably performed when the occupant's emotions are calm at the time of presenting the recommended information.

Therefore, the information presenting device 10 may estimate the occupant's emotions as described above before presenting the recommended information. Specifically, the control unit 55 may present the recommended information only when the emotions of the occupants in the vehicle interior are calm at the time of presenting the recommended information or immediately before that. Further, the control unit 55 may suspend the presentation of the recommended information at the time of or immediately before the presentation of the recommended information until the feelings of the occupants in the vehicle interior are estimated to be calm. As a result, the information presenting device 10 can more appropriately evaluate the recommended information.

That is, the control unit 55 as the information presenting unit does not present the recommended information during the period when the emotion of the occupant estimated by the control unit 55 as the emotion estimation unit is in a specific state.

An example of the operation routine of the information presenting apparatus 10 when functioning as the information presenting apparatus will be described below.

3 and 4 are diagrams showing information presentation routines R1 and R2 as an example of an operation routine. The information presentation routine R1 shown in FIG. 3 shows a routine for presenting recommended information among the operation routines of the information presentation device 10. Further, the information presentation routine R2 shown in FIG. 4 shows the routines after the presentation of recommended information among the operation routines of the information presentation device 10. The information presentation routines R1 and R2 are executed consecutively, for example. Further, the information presentation routines R1 and R2 are repeatedly executed, for example, when the power of the information presentation device 10 is turned on.

When the information presentation routine R1 is started, the control unit 55 first searches for recommended information to be recommended to the occupants on the vehicle M (step S101). Specifically, the control unit 55 compares the position information of the GPS receiver 41 received via the input unit 57 with the map information and facility information recorded in the storage unit 53, and the surroundings of the automobile M, Search for recommendations that can be provided to occupants regarding facilities in the direction of travel or on the set route.

Next, the control unit 55 determines as a result of the search whether or not the recommended information to be recommended to the occupant on the vehicle M has been found (step S102). In this determination, for example, when the recommended information is found in the search in step S101, the control unit 55 compares the found recommended information with the occupant's information such as the occupant's preference, and the recommended information is used by the occupant. If it is the recommended information that should be recommended to the occupants, it is determined that the recommended information that should be recommended to the occupants has been found.

When it is determined in step S102 that the control unit 55 has not found the recommended information to be recommended to the occupant on the vehicle M (step S102: No), the control unit 55 repeats the process of step S101. Execute and search for recommended information.

If it is determined in step S102 that the control unit 55 has found recommended information that should be recommended to the occupant in the vehicle M (step S102: Yes), the control unit 55 gets in the vehicle interior of the vehicle M. Estimate the emotions of the occupants (step S103). As described above, the control unit 55 estimates the occupant's emotions based on the occupant's video and audio data received from the vehicle interior situation acquisition device 20 via the input unit 57.

Next, the control unit 55 determines whether or not the occupant's emotions are calm as a result of estimating the occupant's emotions (step S104).

When the control unit 55 determines in step S104 that the occupant's emotions are not calm (step S104: No), the control unit 55 repeatedly executes the process of step S103, and determines that the occupant's emotions are calm. Wait until

When the control unit 55 determines in step S104 that the occupant's emotions are calm (step S104: Yes), the operation routine of the information presentation device 10 shown in FIG. 4 shifts to the information presentation routine R2 and is an information presentation step. The control unit 55 presents the recommended information to the occupants (step S105). The presentation of the recommended information is output from the information presentation device 30 via the output unit 59. Specifically, the control unit 55 outputs recommended information to the occupant by outputting audio information from the speaker 31 and image information from the display 32 via the output unit 59.

Next, as an emotion estimation step, the control unit 55 again estimates the emotions of the occupant (step S106). In the estimation of the occupant's emotion in this step, the control unit 55 determines the occupant's emotion based on the occupant's video and audio data received from the in-vehicle condition acquisition device 20 via the input unit 57, as in the process of step S103. presume.

Next, as an evaluation step, the control unit 55 evaluates the recommended information based on the estimated emotion (step S107). The control unit 55 records the evaluation result of the recommended information in the storage unit 53, and in the subsequent search for the recommended information in step S101, the search condition or extraction of facilities and the like belonging to the same category or subcategory as the recommended information evaluated this time. Make changes to the frequency, etc.

As described above, in the information presentation method of the information presentation device 10, the control unit 55 as the information presentation unit presents the recommended information to the occupant of the automobile M, and the control unit 55 as the emotion estimation unit is the occupant. An emotion estimation step for estimating emotions, and an evaluation step in which the control unit 55 as an evaluation unit evaluates recommended information based on the estimation result of the occupant's emotions after the recommended information of the control unit 55 as an information presentation unit is presented. ,including.

As a result, by repeating the operation routine of the information presenting device 10, it becomes possible to present more recommended information according to the preference of the occupant.

The process of estimating the emotion in step S106 and reflecting the evaluation in step S107 does not necessarily have to be performed in this flow. For example, the video and audio data of the occupant when the recommended information is presented may be stored, and the emotion estimation in step S106 and the reflection processing of the determination of the evaluation of the recommended information in step S107 may be performed later based on the stored video and audio data.

The information presentation system 200 of the second embodiment will be described below. Similar to the information presentation system 100 of the first embodiment, the information presentation system of the second embodiment is an in-vehicle situation acquisition device 20 and a speaker 31 including an in-vehicle camera 21 and an in-vehicle microphone 22 connected to the information presentation device so as to be capable of information communication. The information presenting device 30 including the display 32 and the display 32 is included.

In the first embodiment, in order to properly evaluate the recommended information presented by the information presenting device 10, the presentation of the recommended information is interrupted until the feelings of the occupants in the vehicle interior are estimated to be calm before the recommended information is presented. I explained the case of doing. However, the information presenting device may determine, for example, whether an event affecting the emotions of the occupant has occurred inside or outside the vehicle, and determine whether to present recommended information.

FIG. 5 is a top view of an automobile M as a vehicle equipped with an information presentation system 200 including the information presentation device 10A according to the second embodiment of the present application. The configuration of the information presentation system 200 including the information presentation device 10A in the second embodiment is basically the same as that of the first embodiment described above, but the outside camera 42 and the outside of the vehicle acquire information indicating the situation outside the vehicle of the vehicle M. It differs in that it has an out-of-vehicle situation acquisition device 40 including a microphone 43 and an out-of-vehicle sensor 44.

The out-of-vehicle camera 42 is a camera capable of photographing the surroundings of the automobile M. The outside camera 42 is provided on, for example, the front grille GR, and is provided on each of the front camera 42A and both side mirrors SM, which are oriented so as to be able to photograph the front in the traveling direction of the automobile M, and can photograph the sides. Includes side cameras 42B, 42C, and rear camera 42D oriented so that the rear of the vehicle M can be photographed. The camera 42 outside the vehicle may be arranged at least at a position where the front of the vehicle M can be photographed. For example, the vehicle exterior camera 42 may be provided on the rearview mirror RM (see FIG. 1) or on the upper end of the windshield FG (see FIG. 1) or on the ceiling near the upper end. Further, the out-of-vehicle camera 42 is communicably connected to the information presenting device 10A, and can transmit the signal of the captured image to the information presenting device 10A.

The external microphone 43 is a microphone device that receives sounds around the automobile M, and is arranged, for example, on the bumper of the automobile M. The external microphone 43 may be provided anywhere as long as it can receive the sound around the automobile M, such as the side mirror SM or the front grill GR. The external microphone 43 is communicably connected to the information presenting device 10A, and can transmit the collected sound signal to the information presenting device 10A.

The vehicle exterior sensor 44 is, for example, a sensor capable of detecting an object around the automobile M, and is arranged, for example, on the front grill GR of the automobile M. The external sensor 44, for example, scans a pulsed laser beam and generates a range-finding image that images the distance from the reflected light to the reflected object from the time until the reflected light is received from the reflective object, LIDAR (Laser Imaging Detection). and Ranging) and other object detection sensors. Further, the out-of-vehicle sensor 44 is communicably connected to the information presenting device 10A, and can transmit the distance measurement data signal to the information presenting device 10A.

A plurality of external sensors 44 may be installed so as to be able to detect the entire circumference of the vehicle M outside the vehicle. For example, an outside sensor 44 capable of detecting the front of the vehicle M is provided on the front grill GR, an outside sensor 44 capable of detecting the rear of the vehicle M is provided on the rear bumper RB or the back door BD of the vehicle M, and the side of the vehicle M is provided. An external sensor 44 capable of detecting each of the above may be provided on each of the side mirror SM or the door DR.

The vehicle exterior camera 42, the vehicle exterior microphone 43, the vehicle exterior sensor 44, and the GPS receiver 41 described above are vehicle exterior status acquisition devices 40 for the information presenting device 10A to acquire vehicle exterior status information of the vehicle M.

FIG. 6 shows the configuration of the information presentation device 10A. As described above, the configuration of the information presentation device 10A is basically the same as that of the information presentation device 10 of the first embodiment. Further, the description of the part overlapping with the information presenting device 10 will be omitted.

The input unit 57 is an interface unit that communicably connects the information presenting device 10A and the outside vehicle status acquisition device 40 in addition to the vehicle interior status acquisition device 20. The information presenting device 10A can receive a video signal from the vehicle outside camera 42, an audio signal from the vehicle outside microphone 43, and a ranging data signal from the vehicle outside sensor 44 via the input unit 57. Further, the information presenting device 10A can receive road congestion information, weather information, and the like from the GPS receiver 41 from the GPS receiver 41 in addition to the signal of the current position information of the automobile M via the input unit 57.

When the information presenting device 10A determines that an event affecting the emotions of the occupant has occurred inside or outside the vehicle at the time of presenting the recommended information, the information presenting device 10A presents the recommended information until it is determined that the event has settled down. To interrupt.

Specifically, the control unit 55 causes an event that affects the emotions of the occupant based on the in-vehicle situation information and the out-of-vehicle situation information received from the in-vehicle situation acquisition device 20 and the out-of-vehicle situation acquisition device 40 via the input unit 57. Determine if you are doing it. At this time, the control unit 55 functions as a situation determination unit. In other words, the information presenting device 10A includes a control unit 55 as a situation determination unit for determining the presence or absence of an influence event presumed to affect the emotions of the occupant in the vehicle interior of the vehicle M or outside the vehicle M. Further, the control unit 55 as the information presenting unit does not present the recommended information during the period when it is determined that the influential event has occurred.

For example, when a quarrel between occupants occurs in the vehicle interior, the control unit 55 sets the control unit 55 in the vehicle interior based on the image of the occupant taken by the in-vehicle camera 21 or the occupant's voice input by the in-vehicle microphone 22. It is determined that there is a quarrel between the occupants. Specifically, for example, in the video signal input from the in-vehicle camera 21, the control unit 55 acts as an event that affects the occupant's emotions in the vehicle interior from movements such as facial expressions, mouth movements, and gestures of the occupant. It is determined that there is a quarrel between the occupants. Further, for example, when the control unit 55 detects a sudden change in tone such as a loud voice of the occupant or a specific word voice in the voice signal input from the microphone 22 in the vehicle, the control unit 55 affects the emotion of the occupant in the vehicle interior. Determine that an event has occurred.

Further, the control unit 55 may predict, for example, whether or not an event affecting the emotions of the occupant may occur from the out-of-vehicle situation information input from the out-of-vehicle situation acquisition device 40. Specifically, when the vehicle M goes straight through the intersection, the GPS receiver 41 detects that the vehicle M is approaching the intersection, and the vehicle outside camera 42 and the vehicle outside sensor 44 detect oncoming vehicles and pedestrians. Predict sudden right turns of oncoming vehicles and pedestrians jumping out.

Further, for example, when a sudden interruption of another vehicle to the front of the vehicle M, which is the own vehicle, occurs outside the vehicle, the control unit 55 uses the image in front of the vehicle M taken by the vehicle outside camera 42 or the vehicle exterior sensor 44. Based on the object detection in front of the vehicle M that has been distance-measured, it is determined that a sudden interruption of another vehicle to the front of the vehicle M has occurred. Further, in an event that affects the emotions of the occupants outside the vehicle, for example, the siren sound of the emergency vehicle is detected around the vehicle M from the sound of the vehicle outside microphone 43, which detects the transition of the signal in front from the image of the vehicle outside camera 42. Or, congestion information was detected on the progress of the vehicle M from the received data of the GPS receiver 41.

As a result, the information presenting device 10A determines for itself whether or not an event that affects the occupant's emotions has occurred based on the in-vehicle situation information and the out-of-vehicle situation information received from the in-vehicle situation acquisition device 20 and the out-of-vehicle situation acquisition device 40. By making predictions, it becomes possible to present recommended information at an appropriate timing with more safety in mind.

An example of the operation routine of the information presenting apparatus 10A when functioning as the information presenting apparatus will be described below.

FIG. 7 is a diagram showing an information presentation routine R3 as an example of an operation routine. The information presentation routine R3 shown in FIG. 7 shows a routine for presenting recommended information among the operation routines of the information presentation device 10A. The processing of steps S201 and S202 of the information presentation routine R3 corresponds to steps S101 and S102 of the information presentation routine R1 shown in FIG. 3, respectively, and the processing contents are the same, so the description thereof is omitted. Further, the routine after the presentation of the recommended information is the same as the information presentation routine R2 shown in FIG. In the description of the second embodiment, the description of the information presentation routine R2 shown in FIG. 4, which overlaps with the first embodiment, is omitted.

After it is determined in step S202 that the control unit 55 has found the recommended information, the control unit 55 acquires the vehicle interior status information from the vehicle interior status acquisition device 20 (step S203).

Next, the control unit 55 determines whether or not an event that affects the emotions of the occupant has occurred in the vehicle interior based on the vehicle interior situation information (step S204).

When the control unit 55 determines in step S204 that an event affecting the emotions of the occupant has occurred in the vehicle interior (step S204: Yes), the control unit 55 repeatedly executes the process of step S203. Wait until it is determined that the events in the passenger compartment have settled down.

In step S204, when the control unit 55 determines that an event affecting the emotions of the occupant has not occurred in the vehicle interior (step S204: No), the control unit 55 receives the vehicle exterior status information from the vehicle exterior status acquisition device 40. Acquire (step S205).

Next, the control unit 55 determines whether or not an event that affects the emotions of the occupant has occurred outside the vehicle based on the information on the situation outside the vehicle (step S206).

When the control unit 55 determines in step S206 that an event affecting the emotions of the occupant has occurred outside the vehicle (step S206: Yes), the control unit 55 repeatedly executes the process of step S203 to execute the vehicle. Wait until it is determined that the events inside and outside the vehicle have settled down.

In step S206, when the control unit 55 determines that an event affecting the emotions of the occupant has not occurred outside the vehicle (step S206: No), the control unit 55 after the presentation of the recommended information shown in FIG. The process proceeds to the processing of the information presentation routine R2, which is a routine, and the recommended information presented is evaluated.

As a result, the information presenting device 10A can present recommended information at an appropriate timing in consideration of safety.

In the second embodiment, after determining whether an event affecting the emotions of the occupant has occurred inside the vehicle, it is determined whether an event affecting the emotion of the occupant has occurred outside the vehicle. explained. However, the order of determining whether or not an event affecting the emotions of the occupant occurs inside or outside the vehicle is not limited to this. For example, it may be determined first whether an event affecting the emotions of the occupant has occurred outside the vehicle, or the determination process may be performed at the same time.

In the first and second embodiments, the case where the presentation of the recommended information is interrupted until the information presenting device 10 or the information presenting device 10A can present the recommended information has been described. However, the timing of presenting the recommended information is not limited to this. For example, when it is urgent to present the recommended information, the information presenting device may present the recommended information after calling the occupant to suppress the occupant's emotions.

The urgent recommended information is, for example, when a branch route to the facility searched for as recommended information is imminent. In this case, the information presenting device needs to present recommended information before the automobile M passes through the branch road. Therefore, it is preferable that the information presenting device presents the recommended information after suppressing the emotions of the occupants when presenting the recommended information.

FIG. 8 shows the configuration of the information presentation system 300 including the information presentation device 10B according to the third embodiment of the present invention. The configuration of the information presentation device 10B is basically the same as that of the information presentation device 10 of the first embodiment, except that it has a stimulus generation unit 60 that generates a stimulus for suppressing the emotions of the occupant. The description of the configuration overlapping with the information presenting device 10 will be omitted.

When the information presenting device 10B estimates that the occupant's emotions in the passenger compartment are not calm, the stimulus generating unit 60 as the emotion sedating unit puts the occupant's emotions into a calm state via the output unit 59. Generates a stimulus to suppress. The stimulus for suppressing the emotions of the occupant is a stimulus that stimulates the five senses of the occupant to give a relaxing effect. Specific examples thereof include a sound logo that attracts the attention of the occupant, a preset call for the occupant's name, and relaxing audio or acoustic content or video content. In this case, the stimulus generation unit 60 is output from the speaker 31 or the display 32. Further, a massage by a vibrator built in the seat in the vehicle interior or an aroma pot provided in the vehicle interior may generate a relaxing odor. The stimulus that suppresses the emotions of the occupant may be one of the stimuli, or a plurality of stimuli may be generated at the same time. In other words, the information presentation device 10B includes a stimulus generation unit 60 that emits a stimulus that suppresses emotions toward the occupant.

When the information presenting device 10B presents urgent recommended information, if it is presumed that the emotions of the occupants in the vehicle interior are calm, the information presenting device 10B promptly presents the recommended information. Further, when the information presenting device 10B presents urgent recommended information, if it is presumed that the emotions of the occupants in the vehicle interior are not calm, the stimulus generation unit 60 generates a stimulus that suppresses the emotions of the occupants. After that, the recommended information will be presented. In other words, in the control unit 55 as the information presentation unit, when the emotion of the occupant estimated by the control unit 55 as the emotion estimation unit is in a specific state, the stimulus generation unit 60 suppresses the emotion toward the occupant. Present recommendations after stimulating. In other words, the control unit 55 as the information presentation unit does not require urgent presentation of recommended information when the emotion of the occupant estimated by the control unit 55 as the emotion estimation unit is in a specific state. If the presentation of the recommended information is urgent, the recommended information is presented after outputting the stimulus for suppressing the emotions of the occupants.

As a result, the information presenting device 10B can appropriately evaluate the presented recommended information even when it is estimated that the emotions of the occupants in the vehicle interior are not calm when presenting the urgent recommended information. Become.

An example of the operation routine of the information presenting apparatus 10B when functioning as the information presenting apparatus will be described below.

FIG. 9 is a diagram showing an information presentation routine R4 as an example of an operation routine. The information presentation routine R4 shown in FIG. 9 shows a routine for presenting recommended information among the operation routines of the information presentation device 10B. The processes of steps S301 to S303 of the information presentation routine R4 correspond to steps S101 to S103 of the information presentation routine R1 shown in FIG. 3, respectively, and the processing contents are the same, so the description thereof is omitted. Further, the routine after the presentation of the recommended information is the same as the information presentation routine R2 shown in FIG. In the description of the third embodiment, the description of the information presentation routine R2 shown in FIG. 4, which overlaps with the first embodiment, is omitted.

In the processes from steps S301 to S303, the control unit 55 discovers the recommended information and estimates the emotions of the occupants in the vehicle interior.

Next, the control unit 55 determines whether or not the occupant's emotions are calm as a result of estimating the occupant's emotions (step S304).

When the control unit 55 determines in step S304 that the occupant's emotions are calm (step S304: Yes), the control unit 55 is the information presentation routine R2 which is a routine after the presentation of the recommended information shown in FIG. Move on to processing and evaluate the recommended information presented.

In step S304, when the control unit 55 determines that the occupant's emotions are not calm (step S304: No), the control unit 55 determines whether the recommended information found in step S301 is urgent information (step). S305). In this determination, for example, the control unit 55 compares the current position of the automobile M received by the GPS receiver 41 with the map information recorded in the storage unit 53, and a branch point to the route to the recommended information is determined. Judgment is made based on whether it is within a predetermined distance or the like.

When the control unit 55 determines in step S305 that the recommended information is information that does not require urgent information (step S305: No), the control unit 55 returns to the process of step S303 and determines that the occupant's emotions are calm. Wait until it is guessed or the recommended information becomes urgent information.

When the control unit 55 determines in step S305 that the recommended information is urgent information (step S305: Yes), the control unit 55 suppresses the emotions of the occupant from the stimulus generation unit 60 via the output unit 39. The stimulus is output (step S306). As described above, the stimulus that suppresses the occupant's emotions is a stimulus that stimulates the occupant's five senses and gives a relaxing effect.

After executing the process of this step, the control unit 55 may wait for a predetermined time, for example, until it is considered that the emotions of the occupant are suppressed. Further, the predetermined time may be changed variably according to the estimated type of the occupant's emotion until it is considered that the occupant's emotion is suppressed. For example, if the estimated occupant's emotions are joy or enjoyment, the control unit 55 may assume that the time required to transition to the calm state is short and shorten the waiting time. On the other hand, if the estimated emotion of the occupant is anger or sadness, the control unit 55 may assume that it takes time to transition to the calm state and shorten the waiting time. That is, the control unit 55 as the evaluation unit is the occupant's emotion at the time when the first time elapses after the recommended information is presented by the control unit 55 as the information presentation unit as the emotion of the occupant used for the evaluation regarding the provision of the recommended information. The evaluation regarding the presentation of the recommended information is performed based on the estimation result of the emotional state, and the control unit 55 as the evaluation unit changes the first time based on the estimation result of the emotion of the occupant at the time of presenting the recommended information. do.

Further, the control unit 55 may estimate the occupant's emotion again after this step and repeatedly output a stimulus that suppresses the occupant's emotion until the occupant's emotion is suppressed.

Further, the control unit 55 may variably change the time for generating the stimulus that suppresses the occupant's emotion according to the estimated type of the occupant's emotion. That is, the control unit 55 as the information presentation unit is based on the estimation result by the control unit 55 as the emotion estimation unit of the emotional state of the occupant when the control unit 55 as the information presentation unit tries to present recommended information. , The length of time for emitting a stimulus that suppresses emotions toward the occupant of the stimulus generation unit 60 is changed.

After that, the control unit 55 shifts to the processing of the information presentation routine R2, which is a routine after the presentation of the recommended information shown in FIG. 4, and evaluates the presented recommended information.

As a result, the information presenting device 10B can appropriately evaluate the presented recommended information even when it is estimated that the emotions of the occupants in the vehicle interior are not calm when presenting the urgent recommended information. Become.

In the third embodiment, even when the presentation of the recommended information is urgent, in order to properly evaluate the recommended information presented by the information presenting device 10, the occupant's emotions are not calm when the recommended information is presented. The case of presenting recommended information after generating a stimulus that suppresses the emotions of the occupants was explained. However, the information presenting device determines, for example, whether an event affecting the occupant's emotions has occurred inside or outside the vehicle, and if an event affecting the occupant's emotions has occurred, the occupant's emotions. The recommended information may be presented after the stimulus that suppresses the stimulus is generated.

In other words, when it is determined that an event has occurred when the control unit 55 as the information presentation unit tries to present the recommended information, the stimulus generation unit 60 gives a stimulus to the occupant to suppress emotions. The recommended information will be presented after the issuance. In other words, when the control unit 55 as the information presentation unit determines that an event has occurred by the control unit 55 as the situation determination unit, when the presentation of recommended information is not urgent. If the recommendation information is not presented and the presentation of the recommendation information is urgent, the recommendation information is presented after outputting the stimulus for suppressing the emotions of the occupants.

FIG. 10 shows the configuration of the information presentation system 400 including the information presentation device 10C according to the fourth embodiment of the present application. The configuration of the information presentation device 10C in the fourth embodiment is basically the same as that of the information presentation device 10B of the third embodiment described above, but the vehicle outside camera 42 and the vehicle outside microphone that acquire information indicating the situation outside the vehicle of the automobile M are obtained. It differs in that it has an out-of-vehicle situation acquisition device 40 including an out-of-vehicle situation sensor 44 and an out-of-vehicle sensor 44. Further, the vehicle outside situation acquisition device 40 is the same as the information presentation device 10A of the second embodiment described above.

When the information presenting device 10C determines that an event affecting the emotions of the occupant has occurred inside or outside the vehicle when the recommended information is presented, the stimulus generation unit 60 generates a stimulus that suppresses the emotions of the occupant. After that, the recommended information will be presented.

As a result, the information presenting device 10B properly evaluates the presented recommended information even when an event that affects the emotions of the occupant occurs inside or outside the vehicle when presenting the urgent recommended information. It will be possible to do.

An example of the operation routine of the information presenting apparatus 10C when functioning as the information presenting apparatus will be described below.

FIG. 11 is a diagram showing an information presentation routine R5 as an example of an operation routine. The information presentation routine R5 shown in FIG. 11 shows a routine for presenting recommended information among the operation routines of the information presentation device 10C. The processes of steps S401 and S402 of the information presentation routine R5 correspond to steps S101 and S102 of the information presentation routine R1 shown in FIG. 3, respectively, and the processing contents are the same, so the description thereof is omitted. Further, the routine after the presentation of the recommended information is the same as the information presentation routine R2 shown in FIG. In the description of the fourth embodiment, the description of the information presentation routine R2 shown in FIG. 4, which overlaps with the first embodiment, is omitted.

After it is determined in step S402 that the control unit 55 has found the recommended information, the control unit 55 acquires the vehicle interior status information from the vehicle interior status acquisition device 20 (step S403).

Next, the control unit 55 determines whether or not an event that affects the emotions of the occupant has occurred in the vehicle interior based on the vehicle interior situation information (step S404).

In step S404, when the control unit 55 determines that an event affecting the emotions of the occupant has not occurred in the vehicle interior (step S404: No), the control unit 55 receives the vehicle exterior status information from the vehicle exterior status acquisition device 40. Acquire (step S405).

Next, the control unit 55 determines whether or not an event that affects the emotions of the occupant has occurred outside the vehicle based on the information on the situation outside the vehicle (step S406).

In step S406, when the control unit 55 determines that an event affecting the emotions of the occupant has not occurred outside the vehicle (step S406: No), the control unit 55 after the presentation of the recommended information shown in FIG. The process proceeds to the processing of the information presentation routine R2, which is a routine, and the recommended information presented is evaluated.

When the control unit 55 determines in step S404 or step S406 that an event affecting the emotions of the occupant has occurred inside or outside the vehicle (step S404: Yes or step S406: Yes), the control unit 55 determines. It is determined whether the recommended information found in step S401 is urgent information (step S407). This determination is the same as step S305 of the information presentation routine R4 shown in FIG. Specifically, for example, the control unit 55 compares the current position of the automobile M received by the GPS receiver 41 with the map information recorded in the storage unit 53, and a branch point to the route to the recommended information. Is within a predetermined distance or the like.

When the control unit 55 determines in step S407 that the recommended information is not urgent information (step S407: No), the control unit 55 returns to the process of step S403, and the events inside and outside the vehicle are settled. Wait until it is determined that you have done so or until the recommended information becomes urgent information.

When the control unit 55 determines in step S407 that the recommended information is urgent information (step S407: Yes), the control unit 55 suppresses the emotions of the occupant from the stimulus generation unit 60 via the output unit 39. The stimulus is output (step S408). As described above, the stimulus that suppresses the occupant's emotions is a stimulus that stimulates the occupant's five senses and gives a relaxing effect.

As in the second embodiment, after the processing of this step is executed, the control unit 55 may wait for a predetermined time, for example, until it is considered that the emotions of the occupants are suppressed. Further, the predetermined time may be changed variably according to the estimated type of the occupant's emotion until it is considered that the occupant's emotion is suppressed. Further, the control unit 55 may estimate the occupant's emotion again after this step and repeatedly output a stimulus that suppresses the occupant's emotion until the occupant's emotion is suppressed.

After that, the control unit 55 shifts to the processing of the information presentation routine R2, which is a routine after the presentation of the recommended information shown in FIG. 4, and evaluates the presented recommended information.

As a result, the information presenting device 10B properly evaluates the presented recommended information even when an event that affects the emotions of the occupant occurs inside or outside the vehicle when presenting the urgent recommended information. It will be possible to do.

It should be noted that each of the above-mentioned Examples 1 to 4 is only an example. For example, each of the above examples can be combined.

For example, by combining the information presentation device 10 of the first embodiment and the information presentation device 10B of the third embodiment, even if the recommended information is urgent information, the recommended information is presented according to the type of emotion of the occupant in the vehicle interior. It may be determined whether to perform or interrupt. Specifically, when the occupant's emotions are not calm, the judgment of the occupant's emotions is that the recommended information is presented after the stimulus that suppresses the occupant's emotions is generated, or the presentation of the occupant's emotional information is interrupted. It may be done based on the type.

In addition, for example, by combining all the examples, it depends on each pattern of whether or not the occupant's emotions are calm, whether or not there is an event that affects the emotions inside the vehicle, and whether or not there is an event that affects the emotions outside the vehicle. , The presentation of the recommended information may be performed after the stimulus that suppresses the emotion of the occupant is generated, or the presentation of the emotional information of the occupant may be interrupted.

Specifically, for example, when an event that affects the occupant's emotion is determined or predicted even if the occupant's emotion is calm, it is recommended after generating a stimulus that suppresses the occupant's emotion. Information may be presented. On the other hand, even if the occupant's emotions are calm, if an event that affects the occupant's emotions is determined or predicted outside the vehicle, the presentation of the recommended information may be interrupted.

Also, for example, if an event that affects the occupant's emotions occurs inside the vehicle but not outside the vehicle, the recommended information should be presented after generating a stimulus that suppresses the occupant's emotions. You may do it. On the other hand, if an event that affects the emotions of the occupant does not occur inside the vehicle but occurs outside the vehicle, the presentation of recommended information may be interrupted.

In addition to the above combination example, further recommended information presentation patterns may be added based on the estimated emotion type of the occupant.

Further, in Examples 1 to 4, the information presenting devices 10, 10A, 10B, and 10C are all described as devices attached to the automobile M, but the present invention is not limited thereto. The information presenting device of the present invention may be a portable device such as a smartphone or tablet carried by the user. In this case, the portable device as the information presenting device of the present invention is wirelessly or wirelessly with at least a part of the in-vehicle condition acquisition device 20, the information presentation device 30, the out-of-vehicle condition acquisition device 40, and the stimulus generation unit 60 mounted on the automobile M. A communication connection may be made by wire.

Alternatively, the information presenting device of the present invention may be a server device installed outside the automobile M. In this case, the portable device as the information presenting device of the present invention includes at least a part of the in-vehicle condition acquisition device 20, the information presentation device 30, the out-of-vehicle condition acquisition device 40, and the stimulus generation unit 60 mounted on the automobile M and a wireless network. A communication connection may be made via.

100 Information presentation system 200 Information presentation system 300 Information presentation system 400 Information presentation system 10 Information presentation device 20 In-vehicle situation acquisition device 21 In-vehicle camera 22 In-vehicle microphone 30 Information presentation device 31 In-vehicle speaker 32 Display 40 Outside status acquisition device 41 GPS receiver 42 Outside camera 43 Outside microphone 44 Outside sensor 51 System bus 53 Storage 55 Control 57 Input 59 Output 60 Stimulation generator

Claims (12)

An information presentation unit that presents recommended information to vehicle occupants,
The emotion estimation unit that estimates the emotions of the occupants, and
An information presenting device comprising: an evaluation unit for evaluating the presentation of the recommended information based on an estimation result of the emotion of the occupant after the presentation of the recommended information of the information presenting unit. The information presenting device according to claim 1, wherein the information presenting unit does not present the recommended information during a period in which the emotion of the occupant estimated by the emotion estimation unit is in a specific state. The information presenting device further includes an emotional sedative unit that emits an emotional suppressing stimulus toward the occupant.
When the emotion of the occupant estimated by the emotion estimation unit is in a specific state, the information presenting unit provides the recommended information after the emotion sedation unit emits a stimulus toward the occupant to suppress the emotion. The information presentation device according to claim 1, wherein the information is presented. The information presenting unit expresses emotions toward the occupant of the emotional sedation unit based on the estimation result of the emotional state of the occupant when the information presenting unit tries to present the recommended information by the emotion estimation unit. The information presenting apparatus according to claim 3, wherein the length of time during which a stimulus is emitted is changed. The information presenting unit does not present the recommended information when the emotion of the occupant estimated by the emotion estimation unit is in a specific state and the presentation of the recommended information is not urgent. The information presenting device according to claim 3 or 4, wherein when the presentation of the recommended information is urgent, the recommended information is presented after outputting a stimulus for suppressing the emotion of the occupant. The evaluation unit estimates the emotional state of the occupant at the time when the first time elapses after the recommended information is presented by the information presentation unit as the emotion of the occupant used for the evaluation regarding the provision of the recommended information. Based on the above, the evaluation unit evaluates the presentation of the recommended information, and the evaluation unit changes the first time based on the estimation result of the emotion of the occupant at the time of presenting the recommended information. Item 5. The information presenting device according to any one of Items 1 to 5. The information presenting device further includes a situation determination unit for determining the presence or absence of an influential event presumed to affect the emotions of the occupant in the passenger compartment of the vehicle or outside the vehicle.
The information presenting device according to claim 1, wherein the information presenting unit does not present the recommended information during the period when it is determined that the affected event has occurred. The information presenting device determines the presence or absence of an emotional sedation unit that emits a stimulus that suppresses emotions toward the occupant, and an influence event that is presumed to affect the occupant's emotions inside or outside the vehicle. Further equipped with a situation judgment unit,
If it is determined that the influential event has occurred when the information presenting unit tries to present the recommended information, the emotional sedation unit issues a stimulus toward the occupant to suppress the emotion. The information presenting apparatus according to claim 1, wherein the recommended information is presented. When the situation determination unit determines that the influence event has occurred, the information presenting unit does not present the recommended information when the presentation of the recommended information is not urgent, and the recommended information is not presented. The information presenting apparatus according to claim 8, wherein when the presentation of information is urgent, the recommended information is presented after outputting a stimulus for suppressing the emotion of the occupant. It is an information presentation method of an information presentation device that presents recommended information to vehicle occupants.
An information presentation step in which the information presentation unit presents the recommended information to the occupant of the vehicle, and
The emotion estimation step in which the emotion estimation unit estimates the emotions of the occupant, and
An information presentation method comprising an evaluation step in which an evaluation unit evaluates the recommended information based on an estimation result of the occupant's emotion after the recommended information is presented by the information presentation unit. On the computer installed in the information presentation device that presents recommended information to the occupants of the vehicle,
An information presentation step in which the information presentation unit presents the recommended information to the occupant of the vehicle, and
The emotion estimation step in which the emotion estimation unit estimates the emotions of the occupant, and
An information presentation program characterized in that an evaluation unit executes an evaluation step of evaluating the recommended information based on an estimation result of the emotions of the occupant after the recommended information is presented by the information presentation unit. A computer-readable recording medium comprising storing the information presentation program according to claim 11.

Images