JP2021018551A - Information apparatus, automatic setting method, and automatic setting program - Google Patents

Abstract

To automatically adjust settings of an information apparatus in accordance with an environment of use and emotion of a user.SOLUTION: Information apparatuses 100, 100A includes: operation units 20, 40, 70 which perform operation on the basis of operation adjustment values; environment recognition units 73, 91 which detect surrounding environment information; emotion recognition units 75, 85 which detect emotion information of a user; and a setting adjustment unit 71 which sets the operation adjustment values on the basis of the environment information detected by the environment recognition units 73, 91 and the emotion information detected by the emotion recognition units 75, 85. The apparatus also includes a storage unit 83 which stores the emotion information detected by the emotion recognition units 75, 85 and the operation adjustment values set by the setting adjustment unit 71 in association with each other for each environment information detected by the environment recognition units 73, 91. The setting adjustment unit 71 acquires, at start-up, the operation adjustment values from the storage units 83 for setting, on the basis of the environment information detected by the environment recognition units 73, 91 and the emotion information detected by the emotion recognition units 75, 85.SELECTED DRAWING: Figure 2

Description

The present invention relates to an information device, an automatic setting method, and an automatic setting program.

A dialogue device that detects various human emotions and outputs information from the computer side in response to these emotions, and a sentiment analyzer that analyzes human voice and displays the human emotions are disclosed (patented). Refer to Documents 1 and 2). In recent years, robots that recognize human emotions and change the content of conversation have been proposed.

Japanese Unexamined Patent Publication No. 08-339446 Japanese Unexamined Patent Publication No. 2004-317822

Conventionally, the user himself has changed the settings of information devices such as computers. However, since changing the settings of the information device requires some knowledge, a user who is not very familiar with the settings of the information device cannot adjust the settings to his / her desired settings. Further, even if there is a more preferable setting, the user may not notice it or consider the change operation to be troublesome, and may continue to use the setting that the user originally made. In addition, the optimum setting for the user differs depending on the usage environment of the information device and the mood and emotion of the user at that time. However, the settings of the information device did not automatically change according to the user's emotions in the individual usage environment of the information device. Therefore, there is a demand for a technique in which the settings of the information device are automatically adjusted to the settings desired by the user according to the usage environment and the emotions of the user, regardless of the user's own operation.

The present invention has been made in view of the above, and an object of the present invention is to provide an information device, an automatic setting method, and an automatic setting program that automatically adjust settings according to a usage environment and user's emotions.

The information device according to the present invention includes an operation unit that performs an operation based on an operation adjustment value, an environment recognition unit that detects surrounding environment information, an emotion recognition unit that detects user emotion information, and the environment recognition unit. It includes a setting adjustment unit that sets the operation adjustment value based on the detected environmental information and the emotion information detected by the emotion recognition unit.

In the automatic setting method according to the present invention, the operation of the operation unit is performed based on the operation adjustment value, the surrounding environment information is detected, the user's emotion information is detected, and the detected environment information is used. It includes setting the motion adjustment value based on the emotion information.

The automatic setting program according to the present invention includes a process of performing an operation of an operation unit based on an operation adjustment value, a process of detecting surrounding environment information, a process of detecting user emotion information, and the detected environment information. The computer is made to execute the process of setting the operation adjustment value based on the emotion information.

According to the present invention, the setting of the information device can be automatically adjusted according to the usage environment and the emotion of the user.

FIG. 1 is a schematic view showing an example of an information device according to the first embodiment of the present invention. FIG. 2 is a functional block diagram showing an example of the control unit of the information device. FIG. 3 is a functional block diagram showing an example of the emotion recognition unit of the information device. FIG. 4 is a diagram showing an example of a case where a face image is displayed on the display unit of the information device. FIG. 5 is a diagram showing another example in which a face image is displayed on the display unit of the information device. FIG. 6 is a diagram showing an example of a data table in which emotion information data stored in the storage unit of the information device and data related to settings are associated with each other. FIG. 7 is a flowchart showing an example of the operation at the time of starting the information device itself or various applications. FIG. 8 is a flowchart showing an example of the operation after the activation of the information device itself or various applications. FIG. 9 is a functional block diagram showing an example of the information device according to the second embodiment of the present invention. FIG. 10 is a functional block diagram showing an example of the emotion recognition unit of the information device according to the second embodiment.

Hereinafter, embodiments of the present invention will be described with reference to the drawings. The present invention is not limited to the following embodiments. In addition, the components in the following embodiments include those that can be easily replaced by those skilled in the art, or those that are substantially the same.

[First Embodiment]
FIG. 1 is a schematic view showing an example of an information device according to the first embodiment of the present invention. The information device 100 shown in FIG. 1 includes a housing 10, a display unit 20, a voice input unit 30, a voice output unit 40, a touch panel input unit 50, and a communication unit 60 (a connection line in the communication unit). A control unit 70 and an image input unit 90 are provided. The information device 100 includes, for example, a smartphone, a tablet computer, a notebook computer, a desktop computer, a navigation device, an electronic book reader, a wristwatch-type wearable device, an audio / visual device, a home-use game machine, a portable game machine, and a communication device. Examples include various communicable electronic devices such as robots.

The housing 10 holds each unit of the display unit 20, the voice input unit 30, the voice output unit 40, the touch panel input unit 50, the communication unit 60, the control unit 70, and the image input unit 90. The display unit 20 can display information such as an image and a video, and is composed of a display panel such as a liquid crystal display or an organic EL display. The voice input unit 30 is composed of, for example, a microphone or the like. The audio output unit 40 is composed of, for example, a speaker or the like. The touch panel input unit 50 is arranged on the display unit 20 and is used when the user performs an operation such as inputting or selecting information displayed on the display unit 20. For example, when there are a plurality of movie candidates that can be viewed, the information device 100 displays the movie candidates on the display unit 20, and the user selects a desired movie by touching the touch panel input unit 50 on the display unit 20. It is also possible to do. The communication unit 60 transmits and receives information to and from the network NW. Examples of the network NW include various networks such as the Internet and an intranet. The image input unit 90 is composed of, for example, a camera or the like. The image input unit 90 can also be used as a video camera. Here, the audio input unit 30, the audio output unit 40, and the image input unit 90 may be held in the housing 10 as described above, or may be provided separately from the housing 10. For example, the voice input unit 30, the voice output unit 40, and the image input unit 90 may be a wireless microphone, a speaker, headphones, a camera, or the like linked with the information device 100.

FIG. 2 is a functional block diagram showing an example of the control unit 70 of the information device 100. The control unit 70 is configured by using a CPU, ROM, RAM, and the like, and controls the entire information device 100.

The control unit 70 includes an arithmetic processing unit 71, a display control unit 72, a voice recognition unit 73, a voice synthesis unit 74, an emotion recognition unit 75, an emotion control unit 76, a timing generation unit 78, and a timer 79. , A mode switching control unit 80, a face image generation unit 82, a storage unit 83, and an image recognition unit 91.

The arithmetic processing unit 71 performs various arithmetic operations. As will be described later, the arithmetic processing unit 71 has a function as a setting adjustment unit that acquires and sets an operation adjustment value (setting value) of the information device 100 according to the detection result of the emotion recognition unit 75 from the storage unit 83. .. The display control unit 72 controls the display operation of the display unit 20. The voice recognition unit 73 recognizes the voice data input from the voice input unit 30 and determines a predetermined word. The voice recognition unit 73 has, for example, voice recognition software, voice recognition dictionary data, and the like. The voice synthesis unit 74 has voice synthesis software, voice data, and the like. The voice synthesis unit 74 can synthesize, for example, a voice spoken by a human.

The emotion recognition unit 75 detects emotion information from the voice input from the voice input unit 30. FIG. 3 is a functional block diagram showing an example of the emotion recognition unit 75. As shown in FIG. 3, the emotion recognition unit 75 includes a prosodic feature detection unit 75a and an emotion analysis unit 75b. The prosodic feature detection unit 75a detects the prosodic feature from the voice signal input to the voice input unit 30. The sentiment analysis unit 75b numerically outputs the degree of emotions, emotions, surprises, etc. based on the detected prosodic features. In the present embodiment, the sentiment analysis unit 75b shall detect three types of joy, sadness, and anger. That is, the emotional information detected by the emotion recognition unit 75 includes, for example, the type of emotion (joy, sadness, anger) and the value of the degree of emotion for each type of emotion. As a specific method for detecting emotions, known techniques can be appropriately used.

The emotion control unit 76 forms a predetermined emotional state based on the detection result of the emotion recognition unit 75. For example, the emotion control unit 76 sets the intonation and content of the voice synthesized by the voice synthesis unit 74, the facial expression of the face image displayed on the display unit 20 by the face image generation unit 82, and the like in the conversation mode.

The timing generation unit 78 measures the time using, for example, a timer 79. The timing generation unit 78 detects the processing of various applications (hereinafter, applications) of the information device 100, the timing of screen switching, and / or the timing of breaks in the content being played.

The mode switching control unit 80 has a first mode that outputs information for exchanging information with the user to at least one of the display unit 20 and the voice output unit 40, and the mode switching control unit 80 outputs information from the network to the display unit 20 and the voice. This is performed by switching between the second mode of outputting to at least one of the output units 40. The first mode includes, for example, a conversation mode in which the user talks to the information device 100 and the information device 100 responds to the user's talk. The second mode includes an information display mode for displaying information acquired via the network NW. The face image generation unit 82 causes the display unit 20 to display the face image in the conversation mode.

4 and 5 are diagrams showing an example in which a face image is displayed on the display unit 20 of the information device 100 in the conversation mode. As shown in FIG. 4, only the eyes and the mouth may be displayed on the display unit 20. In this case, the eyes and mouth can be emphasized. Further, as shown in FIG. 5, the display unit 20 may be displayed with the outline of the face included. In this case, the conversation mode feels close to the actual conversation state, and it is easy to embrace emotions. The display mode of the face image is not limited to the above two types, and may be another mode. In the conversation mode, the information device 100 that is easy to use and enjoyable can be realized by switching the display mode of such a face image.

The storage unit 83 stores various types of information. FIG. 6 is a diagram showing an example of a data table 86 in which the emotion information data stored in the storage unit 83 and the data related to the setting are associated with each other. As shown in FIG. 6, in the present embodiment, the data table 86 has individual arrays (for example, records and fields) depending on various applications such as movies, sports, conversations, and the contents of displayed contents. There is. The emotion information data and the data related to the setting are read into the RAM of the control unit 70 when the information device 100 is started, changed during the operation, and written back to the storage at the end of the program. The arrangement of data on each RAM is arbitrary, but it is managed as an array.

In the present embodiment, the data used when playing a movie in the information display mode will be described as an example. The storage unit 83 stores data related to the brightness of the display unit 20, the contrast of the display unit 20, the audio level of the audio output unit 40, the audio tone of the audio output unit 40, and emotional expression as adjustment items when playing a movie. ..

In the present embodiment, the surrounding environmental state is measured and detected, and the emotion of the user at that time is recognized. While searching for a setting that improves the user's emotions in the environment (for example, makes the user feel more enjoyable), change the setting to a better setting, and store the setting value and the setting history. The emotional uplifting of the user may be broadly classified into emotions and emotions, and the type of emotional uplifting may be changed depending on the types of various applications and displayed contents. For example, when displaying a movie on the display unit 20, the information device 100 is set so that the user feels more happy if the movie is fun, and the user feels more sad if the movie is sad. As described above, since the user's emotion changes depending on the type and content of the movie to be watched, the storage unit 83 stores the emotion information data and the setting data for each movie to be watched by the user in the data table 86. To do.

In the case of brightness, the ambient brightness is divided into 5 levels 1 to 5. The ambient brightness is obtained by reading the input level of the image input unit 90. Further, when the AGC (automatic gain control) of the video signal is operating, the level of the control signal indicates the brightness of the surroundings. Then, each level has a parameter of emotional state (detected emotion). In FIG. 6, five values a to e are shown as parameters of the emotional state at each of the levels 1 to 5. In the present embodiment, the emotional state parameter indicates the degree of "fun", "sad" or "anger", and indicates whether the user feels good or bad. In addition, set values are assigned to each emotional state parameter. In FIG. 6, five values A to E are assigned as set values to the emotional state parameters a to e. Further, the set value of the brightness when the emotion is improved in the past is stored as the setting history 1. In the initial state, the value stored as the setting history 1 is selected as the setting value. The setting history 2 will be described later.

In the case of contrast, as in the case of brightness, the ambient brightness is divided into five levels 1 to 5. The other configurations are the same as for the luminance case. In the case of voice level and voice tone, ambient noise is divided into 5 levels 1 to 5. The other configurations are the same as for the luminance case. In the case of emotional expression, the set value corresponding to the emotional information detected by the emotional recognition unit 75 is stored without depending on the environmental parameters.

The image recognition unit 91 recognizes the image data input from the image input unit 90, grasps features from the image or moving image, and identifies the object. The image recognition unit 91 has, for example, image recognition software, image recognition dictionary data, and the like.

Next, the operation of the information device 100 configured as described above will be described. FIG. 7 is a flowchart showing an example of the operation at the time of starting the information device 100 itself or various applications. In the present embodiment, the operation at the time of starting the application for playing a movie will be described as an example. As shown in FIG. 7, the arithmetic processing unit 71 activates the application when the user selects an application for playing a movie displayed on the display unit 20 (step S101).

Next, the voice recognition unit 73 and the image recognition unit 91 detect the surrounding environment information by using the voice input unit 30 and the image input unit 90 (step S102). For example, the image recognition unit 91 measures the ambient brightness using the image input unit 90. When the image recognition unit 91 recognizes the user in the center of the image by image recognition, the image recognition unit 91 measures the brightness of the surroundings excluding the user. Further, the voice recognition unit 73 measures the ambient noise using the voice input unit 30. At this time, the voice recognition unit 73 measures the microphone input level when the user is not in a voice dialogue.

Next, the emotion recognition unit 75 performs emotion recognition based on the voice signal input to the voice input unit 30 and detects emotion information (step S103). In the present embodiment, the mode switching control unit 80 temporarily switches to the conversation mode during the information display mode as the dialogue mode. The arithmetic processing unit 71 simply interacts with the user in this interactive mode. The emotion recognition unit 75 performs emotion recognition based on the user's voice at the time of this dialogue. After performing emotion recognition, the mode switching control unit 80 ends the interactive mode and returns to the information display mode. At this point, the detection of environmental information and emotional information is completed.

Next, the arithmetic processing unit 71 adjusts various settings based on the environmental information and the emotion information (step S104). Specifically, the arithmetic processing unit 71 acquires the most appropriate set value from the data table 86 stored in the storage unit 83 based on the ambient brightness and the user's emotional state (detected emotion). And set. For example, if the ambient brightness of the display unit 20 is level 2 and the emotional state (detected emotion) parameter is c, the arithmetic processing unit 71 has a parameter c from the data table 86. The value c1 stored as the setting history 1 corresponding to is set as the setting value. Here, when the setting history 1 does not exist in the data table 86 stored in the storage unit 83, the arithmetic processing unit 71 sets the median value of the brightness of the display unit 20 as the set value.

The arithmetic processing unit 71 sets the contrast of the display unit 20 in the same manner as the brightness of the display unit 20. Further, the arithmetic processing unit 71 describes the voice level of the voice output unit 40 and the voice tone of the voice output unit 40 in the data table 86 stored in the storage unit 83 based on the ambient noise level and the emotional state of the user. From, obtain and set the most appropriate setting value. Further, the emotional expression determines how to set the emotional expression of the face image displayed on the display unit 20 in the conversation mode. The emotional expression is set based only on the user's emotional state (detected emotion). Based on the emotional state of the user, the arithmetic processing unit 71 acquires the most appropriate emotional expression setting value from the data table 86 stored in the storage unit 83 and notifies the emotion control unit 76. The emotion control unit 76 makes the user feel cheerful about the voice synthesized by the voice synthesis unit 74 and the emotional expression of the face image displayed on the display unit 20 based on the set value of the emotion expression notified from the arithmetic processing unit 71. Set to respond brightly when you feel sad, and respond quietly when you feel sad. The arithmetic processing unit 71 updates these set values in the data table 86 (step S105).

Finally, the arithmetic processing unit 71 confirms whether the setting processing of all five items of the brightness of the display unit 20, the contrast of the display unit 20, the voice level, the voice tone, and the emotional expression is completed (step S106). When the setting process of all five items is incomplete (No in step S106), the arithmetic processing unit 71 performs the setting process of the remaining unfinished items (returns to step S104). When the setting processing of all five items is completed (Yes in step S106), the arithmetic processing unit 71 ends a series of processing.

FIG. 8 is a flowchart showing an example of the operation after the information device 100 itself or various applications are started (during operation). When the information device 100 itself or various applications shown in FIG. 7 is started, the arithmetic processing unit 71 acquires and sets the most appropriate setting value from the data table 86 stored in the storage unit 83. After that, while the information device 100 itself or various applications shown in FIG. 8 is in operation, the arithmetic processing unit 71 tries to change the setting by a minute amount on a trial basis at a predetermined timing, and the setting is changed by a minute amount. It analyzes how the user's emotions have changed, adjusts the settings according to the analysis results, and saves the setting values at that time.

In the present embodiment, the operation of the application for playing a movie during operation will be described as an example. As shown in FIG. 8, the timing generation unit 78 detects the timing of the running application and the displayed content (step S201). The timing generation unit 78 detects, for example, the timing of application processing and screen switching, the timing of movie playback start / end, the timing of pause (interruption), fast forward / rewind, and other operations during movie playback. To do. These detection processes can be performed by incorporating a timing detection program into the program of the application or the OS (operating system) of the information device 100.

Next, the arithmetic processing unit 71 adjusts the setting at the timing detected by the timing generation unit 78 to change the setting by a minute amount from the current setting (step S202). For example, the arithmetic processing unit 71 sets the predetermined parameters of the above five items to a value one step larger or smaller than the current set value. Next, the arithmetic processing unit 71 detects surrounding environmental information using the voice input unit 30 and the image input unit 90 (step S203). Next, the emotion recognition unit 75 performs emotion recognition based on the voice signal input to the voice input unit 30 and detects emotion information (step S204). Next, the arithmetic processing unit 71 determines whether or not the emotion level has improved based on the detected emotion information (step S205).

When the arithmetic processing unit 71 determines that the emotional level has improved (Yes in step S205), the arithmetic processing unit 71 officially adopts the set value (this set value) at that time as it is, and sets the set value in the data table 86 this time. Update to the set value of (step S206). Further, the arithmetic processing unit 71 updates the “setting history 1” in the data table 86 to the current set value (step S207). That is, when the emotion level rises for the above five items, the arithmetic processing unit 71 writes the set value at that time in the set value of the data table 86 and the “setting history 1”. Next, the process returns to step S201, and steps S201 to S207 are repeated until the emotional level does not improve (until the result becomes No in step S205). At this time, the adjustment direction of the set value (whether the set value is set to a large value or a small value) is the same direction.

On the other hand, when the arithmetic processing unit 71 determines that the emotional level has decreased (No in step S205), the arithmetic processing unit 71 records the set value (current set value) at that time in the data table 86 for "setting history 2". After updating to the current set value (step S208), the arithmetic processing unit 71 returns the current set value to the previous set value, which is the original value before the minute amount change (step S209).

The arithmetic processing unit 71 determines whether or not the adjustment direction of the set value has been changed (step S210). If the adjustment direction of the set value has not been changed (No in step S210), the arithmetic processing unit 71 changes the adjustment direction of the set value (step S211). Specifically, if the previous adjustment was in the direction of increasing the set value, the setting value is changed in the direction of decreasing. If the previous adjustment was in the direction of decreasing the set value, change it in the direction of increasing the set value. Next, the process proceeds to step S201. In step S202, the set value is changed in the changed adjustment direction, and the process proceeds to step S203 and subsequent steps.

When the adjustment direction of the set value has been changed (Yes in step S210), the arithmetic processing unit 71 confirms whether the setting process of all the above five items has been completed (step S212). When the setting process of all five items is incomplete (No in step S212), the arithmetic processing unit 71 performs the setting process of the remaining unfinished items (returns to step S201). When the setting processing of all five items is completed (Yes in step S212), the arithmetic processing unit 71 ends a series of processing.

As a result, in the set value of the data table 86 and the "setting history 1" stored in the storage unit 83, the set value in the state where the emotion is most improved at present remains. Further, in the "setting history 2", the set value when the emotion level is low with respect to the set value of the "setting history 1" remains.

The "setting history 1" and "setting history 2" serve as reference data for determining the direction to be changed when the setting is changed next time. In other words, the adjustment direction to be set next is determined depending on whether the emotion is lowered because the setting level is raised or the emotion is lowered because the setting level is lowered.

As described above, the information device 100 according to the present embodiment is an information device 100 that connects to the network NW and acquires information, and includes a voice recognition unit 73 and an image recognition unit 91 that detect surrounding environment information. The emotion recognition unit 75 that detects the user's emotion information, the storage unit 83 that stores the emotion information and the set value for each environmental information in association with each other, and the storage unit 83 that stores the set value according to the detection result of the emotion recognition unit 75. It includes an arithmetic processing unit 71 that is selected and set.

In this configuration, the emotion recognition unit 75 can detect the user's emotions and automatically select and set the set value based on the detected user's emotions for each usage environment. This makes it possible to realize the information device 100 that can be automatically adjusted to the setting according to the usage environment and the emotion of the user.

[Second Embodiment]
FIG. 9 is a functional block diagram showing an example of the information device 100A according to the second embodiment of the present invention. As shown in FIG. 9, the information device 100A has a facial expression analysis unit 84 in addition to the configuration of the information device 100 of the above embodiment, and has an emotion recognition unit 85 instead of the emotion recognition unit 75. The facial expression analysis unit 84 analyzes the user's facial expression based on an image such as a user's face image input to the image input unit 90. The facial expression analysis unit 84 is formed by using, for example, known software that performs image processing and performs facial expression analysis using the result of the image processing. Further, the emotion recognition unit 85 performs emotion recognition based on the voice signal input to the voice input unit 30 and the analysis result (facial expression analysis result) of the facial expression analysis unit 84, and detects emotion information indicating the user's emotion.

FIG. 10 is a functional block diagram showing an example of the emotion recognition unit 85. The emotion recognition unit 85 has a prosodic feature detection unit 85a, an emotion analysis unit 85b, and a comprehensive analysis unit 85c. The prosodic feature detection unit 85a and the sentiment analysis unit 85b are the same as the prosodic feature detection unit 75a and the sentiment analysis unit 75b described in the first embodiment. That is, the prosodic feature detection unit 85a detects the prosodic feature from the voice signal input to the voice input unit 30. The sentiment analysis unit 85b numerically outputs the degree of emotions, emotions, surprises, etc. based on the detected prosodic features. The comprehensive analysis unit 85c comprehensively analyzes the user's emotions based on the analysis result of the sentiment analysis unit 85b and the analysis result of the facial expression analysis unit 84. For example, a coefficient is set and multiplied for each emotion indicated by each analysis result, and these are added to obtain a comprehensive calculated value including voice and facial expression. Here, the comprehensive analysis unit 85c may analyze the user's emotion using only the analysis result of the sentiment analysis unit 85b when there is only voice input, or the facial expression analysis unit 84 when there is only image input. The user's emotions may be analyzed using only the analysis results. That is, the comprehensive analysis unit 85c may analyze the user's emotions based on at least one of the user's voice and facial expression. Therefore, the emotional information detected by the emotion recognition unit 85 includes, for example, the type of emotion (joy, sadness, anger) and the value of the degree of emotion for each type of emotion. The arithmetic processing unit 71 automatically adjusts the settings based on the emotion information detected by the emotion recognition unit 85 and the data table 86 stored in the storage unit 83.

When the information device 100A itself or various applications configured as described above are activated, in step S103 shown in FIG. 7, the emotion recognition unit 85 is the analysis result of the voice signal and facial expression analysis unit 84 input to the voice input unit 30. Emotion recognition is performed based on at least one of them, and emotion information is detected (step S103). In the present embodiment, the mode switching control unit 80 temporarily switches to the conversation mode during the information display mode as the dialogue mode. The arithmetic processing unit 71 simply has a user dialogue with the information device 100A in this dialogue mode. The emotion recognition unit 85 recognizes emotions based on the user's voice and facial expression during dialogue. After performing emotion recognition, the mode switching control unit 80 ends the interactive mode and returns to the information display mode. That is, emotion recognition is performed based on at least one of the user's voice and facial expression. Other operations are as shown in FIG.

Further, while the information device 100A itself or various applications are in operation, in steps S203 to S205 shown in FIG. 8, the arithmetic processing unit 71 detects surrounding environment information using the voice input unit 30 and the image input unit 90 (step). S203). Next, the emotion recognition unit 85 performs emotion recognition based on at least one of the voice signal input to the voice input unit 30 and the analysis result of the facial expression analysis unit 84, and detects the emotion information (step S204). Next, the arithmetic processing unit 71 confirms a change in the user's emotion, for example, an increase or decrease in the emotion level, based on the emotion information detected by the emotion recognition unit 85 (step S205). That is, the change in the user's emotion is confirmed based on at least one of the user's voice and facial expression. Other operations are as shown in FIG.

As described above, the information device 100A according to the present embodiment includes both the voice input unit 30 capable of inputting the user's voice and the image input unit 90 capable of inputting the user's face image, and the emotion recognition unit 85 Emotional information may be detected based on at least one of a user's voice input to the voice input unit 30 and a face image input to the image input unit 90. As a result, the user's emotions can be recognized with higher accuracy, and the settings can be adjusted more appropriately according to the usage environment and the user's emotions.

[Modification example]
In the above embodiment, the information device 100 or 100A uses the voice input unit 30 and the image input unit 90 to detect the user's emotional information, but the user further touches the touch panel input unit 50 on the display unit 20. The user's emotional information may be detected from the timing, strength, and the like. Further, the information device 100 or 100A may detect the emotion information of the user by using another sensor group linked with the information device 100 or 100A. For example, the information device 100 or 100A uses a gyroscope, an inertial measurement unit (IMU), or the like mounted on the information device 100 or 100A to detect that the user is emotionally shaking the information device 100 or 100A. , The user's emotional information may be detected.

Further, the information devices 100 and 100A do not have to include the display unit 20 and the touch panel input unit 50. For example, the information devices 100 and 100A may use an input device such as a physical keypad or a keyboard instead of the touch panel input unit 50. When the information devices 100 and 100A are communication robots, emotions may be expressed by a function or gesture corresponding to the face instead of the face image displayed on the display unit 20.

Further, in step S106 shown in FIG. 7 and step S212 shown in FIG. 8, the arithmetic processing unit 71 sets all five items of the brightness of the display unit 20, the contrast of the display unit 20, the voice level, the voice tone, and the emotional expression. However, in reality, only specific items may be set. For example, the arithmetic processing unit 71 sets the brightness and contrast of the display unit 20 when it detects a decrease in the ambient brightness and a decrease in the user's emotion level, thereby increasing the ambient noise and the user's emotion level. When a decrease is detected, the sound level and the sound tone may be set.

As described above, the information device according to the present invention includes an operation unit that performs an operation based on an operation adjustment value, an environment recognition unit that detects surrounding environment information, and an emotion recognition unit that detects user emotion information. , The setting adjustment unit for setting the operation adjustment value based on the environment information detected by the environment recognition unit and the emotion information detected by the emotion recognition unit is provided. Here, the operating unit corresponds to the display unit 20, the audio output unit 40, and the control unit 70 described above. The environment recognition unit corresponds to the voice recognition unit 73 and the image recognition unit 91 described above. The emotion recognition unit corresponds to the emotion recognition unit 75 or the emotion recognition unit 85 described above. The setting adjustment unit corresponds to the above-mentioned arithmetic processing unit 71. The operation adjustment values correspond to the respective set values for the brightness of the display unit 20, the contrast of the display unit 20, the audio level of the audio output unit 40, and the audio tone of the audio output unit 40.

The technical scope of the present invention is not limited to the above-described embodiment, and modifications can be made as appropriate without departing from the spirit of the present invention. For example, in the above embodiment, the display unit 20 and the voice output unit 40 have been described as examples of the operation unit that performs the operation based on the operation adjustment value, but the present invention is not limited thereto. The operating unit may be another part of the information device 100.

Further, for example, in the above embodiment, the configuration including the storage unit 83 for storing the environmental information, the emotional information, and the motion adjustment value in association with each other has been described as an example, but the present invention is not limited to this. For example, the environment information, the emotion information, and the motion adjustment value may be stored in, for example, an external storage unit, and the information devices 100 and 100A may access the external storage unit by communication or the like.

NW ... network, 10 ... housing, 20 ... display unit, 30 ... voice input unit, 40 ... voice output unit, 50 ... touch panel input unit, 60 ... communication unit, 70 ... control unit, 71 ... arithmetic processing unit, 72 ... Display control unit, 73 ... voice recognition unit, 74 ... voice synthesis unit, 75, 85 ... emotion recognition unit, 75a, 85a ... rhyming feature amount detection unit, 75b, 85b ... emotion analysis unit, 76 ... emotion control unit, 78 ... Timing generation unit, 79 ... Timer, 80 ... Mode switching control unit, 82 ... Face image generation unit, 83 ... Storage unit, 84 ... Sentiment analysis unit, 85c ... Comprehensive analysis unit, 86 ... Data table, 90 ... Image input unit , 91 ... Image recognition unit, 100, 100A ... Information device

Claims (7)

An operation unit that operates based on the operation adjustment value,
An environment recognition unit that detects surrounding environment information,
An emotion recognition unit that detects user's emotion information,
A setting adjustment unit that sets the operation adjustment value based on the environment information detected by the environment recognition unit and the emotion information detected by the emotion recognition unit.
An information device equipped with. A storage unit that stores the environmental information detected by the environment recognition unit, the emotion information detected by the emotion recognition unit, and the operation adjustment value set by the setting adjustment unit in association with each other is further provided.
At startup, the setting adjustment unit acquires and sets the operation adjustment value from the storage unit based on the environmental information detected by the environment recognition unit and the emotion information detected by the emotion recognition unit. The information device according to claim 1. The information device according to claim 2, wherein the setting adjustment unit changes the set operation adjustment value at a predetermined timing after activation, and detects a change in the emotion information detected by the emotion recognition unit. The emotional information includes the degree of emotion of the user.
The setting adjustment unit sets the operation adjustment value obtained by the current setting when the degree of the emotion detected by the environment recognition unit is improved as compared with the degree of the emotion detected at the time of the previous setting. The information device according to claim 3, wherein the operation adjustment value set as the set value is associated with the emotion information and stored in the storage unit as a first setting history. The emotional information includes the degree of emotion of the user.
When the degree of the emotion detected by the environment recognition unit is lower than the degree of the emotion detected at the time of the previous adjustment, the setting adjustment unit associates the motion adjustment value with the emotion information and second. The information device according to claim 3 or 4, which stores the setting history in the storage unit and sets the previous operation adjustment value as the set value. Performing the operation of the operation part based on the operation adjustment value,
Detecting surrounding environment information and
Detecting user emotional information and
An automatic setting method including setting the operation adjustment value based on the detected environmental information and emotion information. The process of performing the operation of the operation unit based on the operation adjustment value,
Processing to detect surrounding environment information and
Processing to detect user's emotional information and
An automatic setting program that causes a computer to execute a process of setting the operation adjustment value based on the detected environmental information and emotion information.

Images