JP2022123355A - image display system - Google Patents

Abstract

To provide an image display system which can easily grasp a feeling of a user wearing a mask.SOLUTION: A feeling unit 20 acquires at least one feeling data for specifying a feeling K of a user U1 in a wearing state in which the user U1 wears a mask M1. A mask unit M10 transmits the at least one feeling data to an image display device 100. A feeling specification unit 103 specifies the feeling of the user U1 in the wearing state on the basis of the at least one feeling data received by the image display device 100. A display unit 107 displays a feeling image G1 corresponding to the specific feeling being the feeling K of the user U1 in the wearing state specified by the feeling specification unit 103.SELECTED DRAWING: Figure 1

Description

The present disclosure relates to an image display system having a configuration using a mask.

In recent years, more and more people are wearing masks. Hereinafter, a person or user who wears a mask is also referred to as a "mask wearer". It is difficult to identify the facial condition of the mask wearer. Therefore, a mask has been proposed that can simulate the face of the mask wearer.

For example, Patent Literature 1 discloses a configuration (hereinafter also referred to as “related configuration A”) for simulating the face of a mask wearer. Related configuration A uses a flexible display covering the mask body and a sensor for detecting movement of the mask wearer's mouth. In related configuration A, the flexible display displays an image synchronized with the movement of the mask wearer's mouth detected by the sensor.

Japanese Patent No. 6693626

In order to liven up the conversation in a situation of having a conversation with a person, it is important to grasp the person's emotions.

In related configuration A, a flexible display that covers the mask body displays images synchronized with the movement of the mask wearer's mouth detected by the sensor. A configuration that displays an image synchronized with the movement of the mask wearer's mouth, such as related configuration A, has the problem that it is not easy to grasp the emotions of the mask wearer, who is the user of the mask. .

The present disclosure has been made to solve the above problems, and an object thereof is to provide an image display system capable of easily grasping the emotions of a user wearing a mask.

To achieve the above object, an image display system according to one aspect of the present disclosure includes an image display device and a mask unit that has a function of communicating with the image display device and that can be worn by a user. The state of the mask unit includes a wearing state in which the user wears the mask unit. In the wearing state, the mask unit includes a sheet-like mask that covers the lower part of the face of the user; an emotion unit that obtains at least one emotion data for identifying an emotion of the user in the wearing state, the wearing state being a state in which the user is wearing the mask, the emotion unit comprising: provided on the mask, wherein the mask unit transmits the at least one emotion data to the image display device, and the image display device receives the at least one emotion data based on the at least one emotion data received by the image display device and an emotion identification unit that identifies the emotion of the user in the wearing state, and a display unit that displays an image corresponding to the specific emotion, which is the emotion of the user in the wearing state, identified by the emotion identification unit. Prepare.

According to the present disclosure, the state of the mask unit includes a wearing state in which the user wears the mask unit. The mask unit includes a mask that covers the lower portion of the user's face in the wearing state. The wearing state is a state in which the user wears the mask. An emotion unit obtains at least one emotion data for identifying the user's emotion in the wearing state. The mask unit transmits the at least one emotion data to an image display device. The emotion identification unit identifies the user's emotion in the wearing state based on the at least one emotion data received by the image display device. The display unit displays an image corresponding to the specific emotion, which is the emotion of the user in the wearing state, specified by the emotion specifying unit.

This makes it possible to easily grasp the emotions of the user wearing the mask.

1 is a diagram showing the configuration of an image display system according to Embodiment 1; FIG. 2 is a plan view showing the configuration of a mask according to Embodiment 1; FIG. 2 is a block diagram showing the main configuration of a mask unit according to Embodiment 1; FIG. 1 is a block diagram showing the configuration of an image display device according to Embodiment 1; FIG. It is a figure which shows an example of an emotional image. 4 is a flowchart of emotion presentation control processing according to Embodiment 1; It is a figure which shows the example of the hardware constitutions of an image display apparatus. It is a figure which shows the example of the hardware constitutions of an image display apparatus.

Hereinafter, embodiments will be described with reference to the drawings. In the following drawings, the same components are given the same reference numerals. Components with the same reference numerals have the same names and functions. Therefore, detailed descriptions of some of the components denoted by the same reference numerals may be omitted.

Note that the dimensions, materials, shapes, and relative arrangement of the components illustrated in the embodiments may be appropriately changed according to the configuration of the apparatus, various conditions, and the like. Also, the dimensions of components in the drawings may differ from the actual dimensions.

<Embodiment 1>
(Constitution)
An image display system 500 according to Embodiment 1 will be described. FIG. 1 is a diagram showing the configuration of an image display system 500 according to Embodiment 1. As shown in FIG. FIG. 1 shows a face F1 of user U1 that is not included in image display system 500 for the sake of explanation.

As shown in FIG. 1, the image display system 500 includes an image display device 100 and a mask unit M10. The image display device 100 has a function of displaying images. The image display device 100 is, for example, a display.

The mask unit M10 has a function of communicating with the image display device 100 . Communication performed by the mask unit M10 with the image display device 100 is wireless communication. That is, the mask unit M10 has a function of wirelessly communicating with the image display device 100. FIG. The wireless communication is, for example, communication according to Wi-Fi or Bluetooth. "Bluetooth" is a registered trademark.

Further, the mask unit M10 is configured so that the user U1 can wear the mask unit M10. Hereinafter, the state in which the user U1 wears the mask unit M10 is also referred to as "wearing state". Further, hereinafter, the state in which the user U1 does not wear the mask unit M10 is also referred to as "non-wearing state".

The state of the mask unit M10 includes a wearing state and a non-wearing state. FIG. 1 shows the mask unit M10 in a worn state.

The mask unit M10 includes a mask M1, an emotion unit 20, and a communication section 6. FIG. 2 is a plan view showing the configuration of the mask M1 according to Embodiment 1. FIG. FIG. 2 also shows a vibration sensor 2, which will be described later.

Hereinafter, the horizontal direction is also referred to as “horizontal direction Dr1” or “direction Dr1”. In addition, the vertical direction is hereinafter also referred to as “vertical direction Dr2” or “direction Dr2”. Horizontal direction Dr1 and vertical direction Dr2 are shown in FIG. The horizontal direction Dr1 and the vertical direction Dr2 are orthogonal to each other.

FIG. 3 is a block diagram showing the main configuration of the mask unit M10 according to Embodiment 1. As shown in FIG. The mask M1 is not shown in FIG. 3 for the sake of clarity of the main configuration of the mask unit M10.

First, referring to FIGS. 1 and 2, the mask M1 is configured so that the user U1 can wear the mask M1. Moreover, the mask M1 is configured so that the mask M1 covers the lower portion of the face F1 of the user U1 when worn. A mouth and a nose are provided in the lower part of the face F1 of the user U1. The wearing state is also a state in which the user U1 wears the mask M1.

The shape of the mask M1 is sheet-like. Moreover, the shape of the mask M1 in plan view is a rectangle. The mask M1 has a surface M1a and an inner surface M1b. The inner surface M1b faces the face F1 of the user U1 when worn. In addition, the inner surface M1b contacts the cheeks of the face F1 of the user U1 when worn.

The size of the mask M1 is a size for covering the lower portion of the face F1 of the user U1. The size of the mask M1 may be such that the mask M1 covers substantially the entire face F1 including the lower part of the face F1.

The mask M1 in the wearing state vibrates due to the movement of the face F1 of the user U1.

The mask M1 is made of a flexible and breathable material. The material constituting the mask M1 is, for example, cloth, gauze, non-woven cloth, etc., like common medical masks.

Next, referring to FIGS. 1 and 3, communication unit 6 has a function of communicating with image display device 100 . Communication performed by the communication unit 6 with the image display device 100 is wireless communication. That is, the communication unit 6 has a function of wirelessly communicating with the image display device 100 . The wireless communication is, for example, communication according to Wi-Fi or Bluetooth. The communication unit 6 is provided, for example, on the surface M1a of the mask M1.

The emotion unit 20 is provided on the mask M1. In the following, the data for specifying the emotion of the user U1 in the wearing state is also referred to as "emotion data".

The emotion unit 20 has a function of acquiring at least one emotion data. The emotion unit 20 of the mask unit M10 transmits emotion data to the image display device 100. FIG.

The emotion unit 20 has a vibration sensor 2, an audio detection section 3, a piezoelectric element 4, and a temperature detection section 5, which are detection sections. That is, the emotion unit 20 has a plurality of detectors.

Note that the emotion unit 20 may be configured to have one detection unit. In this configuration, the single detection unit is any one of the vibration sensor 2 , the sound detection unit 3 , the piezoelectric element 4 and the temperature detection unit 5 . That is, the emotion unit 20 may have any one of the vibration sensor 2, the sound detection unit 3, the piezoelectric element 4, and the temperature detection unit 5, which are detection units.

Moreover, the emotion unit 20 may be configured to have a part of the vibration sensor 2, the voice detection section 3, the piezoelectric element 4, and the temperature detection section 5 as constituent elements. In this configuration, the plurality of detection units included in the emotion unit 20 include the vibration sensor 2 as a component, the sound detection unit 3 as a component, the piezoelectric element 4 as a component, and the temperature detection unit 5 as a component. consists of two or more components.

For example, the multiple detectors included in the emotion unit 20 may be the vibration sensor 2 and the voice detector 3 . Further, for example, the multiple detection units included in the emotion unit 20 may be the voice detection unit 3 and the temperature detection unit 5 . Further, for example, the plurality of detection units included in the emotion unit 20 may be the vibration sensor 2 , the voice detection unit 3 and the temperature detection unit 5 .

The communication unit 6 is connected to the vibration sensor 2, the sound detection unit 3, the piezoelectric element 4, and the temperature detection unit 5, which are detection units. The communication unit 6 transmits data transmitted from the vibration sensor 2 , the sound detection unit 3 , the piezoelectric element 4 and the temperature detection unit 5 as detection units to the image display device 100 .

Each of the vibration sensor 2, the sound detection section 3, the piezoelectric element 4, and the temperature detection section 5 is provided on the inner surface M1b of the mask M1.

The vibration sensor 2 has a function of detecting vibration of the mask M1. Hereinafter, the vibration of the mask M1 is also referred to as "mask vibration". Further, hereinafter, the mask vibration along the horizontal direction Dr1 that occurs in the mask M1 is also referred to as "horizontal vibration". Further, hereinafter, the mask vibration along the vertical direction Dr2 that occurs in the mask M1 is also referred to as "vertical vibration".

The vibration sensor 2 is provided on the inner surface M1b of the mask M1 so that the vibration sensor 2 can detect horizontal vibration and vertical vibration. FIG. 2 shows a state in which the vibration sensor 2 is provided on the inner surface M1b of the mask M1. The vibration sensor 2 is composed of four vibration sensors.

In the following, the four vibration sensors forming the vibration sensor 2 are also referred to as vibration sensors 2a, 2b, 2c, and 2d. That is, the vibration sensor 2 is composed of vibration sensors 2a, 2b, 2c, and 2d. Each of the vibration sensors 2a, 2b, 2c and 2d has a function of detecting mask vibration. The vibration sensors 2a, 2b, 2c and 2d are provided on the inner surface M1b of the mask M1.

The vibration sensors 2b and 2c are provided on the inner surface M1b of the mask M so that the vibration sensors 2b and 2c are arranged along the horizontal direction Dr1. The vibration sensors 2a and 2d are provided on the inner surface M1b of the mask M1 so that the vibration sensors 2a and 2d are arranged along the vertical direction Dr2.

When each of the vibration sensors 2b and 2c detects mask vibration, the vibration sensor 2 detects horizontal vibration as the mask vibration. When each of the vibration sensors 2a and 2d detects mask vibration, the vibration sensor 2 detects vertical vibration as the mask vibration.

The vibration sensor 2 can detect, for example, the amount of opening of the mouth of the user U1 in the horizontal direction Dr1, for example, from the magnitude of the detected horizontal vibration. Further, the vibration sensor 2 can detect the amount of mouth opening of the user U1 in the vertical direction Dr2, for example, based on the magnitude of the detected vertical vibration.

In the following, the mask vibration data detected by the vibration sensor 2 is also referred to as "vibration data". The vibration data is, for example, data indicating that mask vibration has occurred, duration of mask vibration, strength of mask vibration, and the like. The mask vibration is horizontal vibration and/or vertical vibration.

When detecting mask vibration, the vibration sensor 2 generates vibration data of the detected mask vibration, and acquires the vibration data as emotion data. Vibration sensor 2 transmits emotion data as vibration data to image display device 100 via communication unit 6 .

In the following, the voice uttered by user U1 is also referred to as "user voice". The user's voice is, for example, voice uttered by the user U1 in the wearing state.

The voice detection unit 3 has a function of detecting user voice, which is the voice uttered by the user U1. User voices are, for example, laughter, sighs, and the like. The voice detection unit 3 is composed of, for example, a microphone and a recognition unit having a function of recognizing the user's voice detected by the microphone. The voice detection unit 3 also has a function of detecting laughter. Laughter is recognized by the recognition unit. The voice detector 3 detects laughter by recognizing the laughter by the recognition unit. The voice detection unit 3 also has a function of recognizing the detected tone of voice. Therefore, the voice detection unit 3 has a function of detecting high-pitched sounds, for example.

Note that the voice detection unit 3 may be configured by a microphone.

The voice detector 3 is provided on the inner surface M1b of the mask M1 so that the voice detector 3 can sense the user's voice.

The data of the user's voice detected by the voice detection unit 3 is hereinafter also referred to as "voice data". The audio data indicates the user's voice, the volume of the user's voice, the length of the user's voice, the type of the user's voice, and the like. The unit of user voice loudness is decibels.

When the user's voice is detected, the voice detection unit 3 generates voice data of the detected user's voice, and acquires the voice data as emotion data. Voice detection unit 3 transmits emotion data as voice data to image display device 100 via communication unit 6 .

In the following, the pressure applied to the piezoelectric element 4 due to the movement of the face F1 of the user U1 in the wearing state is also referred to as "mouth pressure". The mouth pressure is pressure applied to the piezoelectric element 4 by movement of the mouth of the face F1 of the user U1.

The piezoelectric element 4 has a function of detecting mouth pressure. The piezoelectric element 4 is provided on the inner surface M1b of the mask M1 so that the piezoelectric element 4 can detect the mouth pressure.

The mouth pressure is, for example, the pressure applied to the piezoelectric element 4 by the user U1 exhaling (hereinafter also referred to as "breath pressure"). The mouth pressure is, for example, the pressure applied to the piezoelectric element 4 by the cheeks of the face F1 (hereinafter also referred to as "cheek pressure"). The cheek pressure is generated, for example, by the face F1 of the user U1 smiling and the cheeks moving.

In addition, the piezoelectric element 4 has a function of detecting the number of times the mouth pressure is generated (hereinafter also referred to as "the number of pressure generation times") per unit time. A unit time is, for example, 10 seconds.

In addition, the piezoelectric element 4 has a function of detecting continuous breath pressure as mouth pressure. Continuous breath pressure is, for example, breath pressure that continues for two seconds or longer.

In the following, the mouth pressure data detected by the piezoelectric element 4 is also referred to as "pressure data". The pressure data is data indicating the strength of the mouth pressure, the duration of the mouth pressure, the number of times the pressure is generated, and the like.

When detecting the mouth pressure, the piezoelectric element 4 generates pressure data of the detected mouth pressure, and acquires the pressure data as emotion data. Piezoelectric element 4 transmits emotion data as pressure data to image display device 100 via communication unit 6 .

Hereinafter, the temperature of the face F1 of the user U1 is also referred to as "face temperature".

The temperature detection unit 5 has a function of detecting face temperature. The temperature detection unit 5 is provided on the inner surface M1b of the mask M1 so that the temperature detection unit 5 can detect the face temperature.

User U1's emotion may cause the face temperature to rise. Hereinafter, a phenomenon in which the face temperature rises by a predetermined temperature over a predetermined period of time is also referred to as "temperature rise". The predetermined time is, for example, a time within a range from 10 seconds to 120 seconds. The predetermined temperature is, for example, a temperature within a range from 0.1 degrees to 3 degrees. A temperature rise is, for example, a phenomenon in which the face temperature rises by 1 degree over a period of 30 seconds.

Moreover, the temperature detection unit 5 has a function of detecting a temperature rise as a face temperature. In the following, the face temperature data detected by the temperature detection unit 5 is also referred to as "temperature data". The temperature data is, for example, data indicating the face temperature, the face temperature maintenance time, the fact that the temperature has risen, and the like. The face temperature maintenance time is the time during which the face temperature is maintained at or above a predetermined temperature. The predetermined temperature is, for example, 37 degrees.

When detecting the face temperature, the temperature detection unit 5 generates temperature data of the detected face temperature, and acquires the temperature data as emotion data. Temperature detection unit 5 transmits emotion data as temperature data to image display device 100 via communication unit 6 .

Next, the configuration of the image display device 100 will be described. FIG. 4 is a block diagram showing the configuration of the image display device 100 according to Embodiment 1. As shown in FIG. 1 and 4, image display device 100 includes communication unit 102, emotion identification unit 103, image generation unit 104, image processing unit 106, and display unit 107. FIG.

The communication section 102 has a function of wirelessly communicating with the mask unit M10. The wireless communication is, for example, communication according to Wi-Fi or Bluetooth. A communication unit 102 is provided in the image display device 100 . The communication section 102 receives data transmitted from the communication section 6 of the mask unit M10. Communication unit 102 transmits the received data to emotion identification unit 103 .

Hereinafter, the emotion of the user U1 wearing the mask unit M10 is also referred to as "emotion K". Emotion K is the emotion of user U1 in the wearing state. Also, hereinafter, the rule for identifying the emotion K of the user U1 is also referred to as the "emotion identification rule".

Emotion identification section 103 receives emotion data transmitted from mask unit M10. The emotion identification unit 103 may receive data different from emotion data. In this case, the emotion identification unit 103 determines that the received data is not emotion data, and waits for reception of the next emotion data.

The emotion specifying unit 103 also holds emotion specifying rules. Although the details will be described later, the emotion identification unit 103 identifies the emotion K of the user U1 in the wearing state based on the emotion data. In the following, the processing for specifying emotion K is also referred to as "emotion specifying processing". The emotion identification unit 103 performs emotion identification processing.

Identification of the emotion K in the emotion identification process is performed based on the emotion identification rule. In the emotion identification process, emotions such as emotions are identified as an example. That is, in the emotion identification process, as an example, four types of emotions such as "joy", "anger", "sadness" and "fun" are identified.

Hereinafter, the element for specifying that the emotion K is "joy" is also referred to as "joy element". Also, hereinafter, the element for specifying that the emotion K is "anger" is also referred to as "anger element". Also, hereinafter, the element for specifying that the emotion K is "sadness" is also referred to as the "sadness element". Also, hereinafter, the element for specifying that the emotion K is "fun" will also be referred to as the "fun factor".

Emotion specific rules include joy rules, anger rules, sadness rules and fun rules. The joy rule is a rule for specifying that the feeling K is "joy". The anger rule is a rule for specifying that the emotion K is "anger". The sadness rule is a rule for specifying that the emotion K is "sadness". The enjoyment rule is a rule for specifying that the emotion K is "enjoyment".

Hereinafter, the emotion K of the user U1 in the worn state, which is specified by the emotion specifying unit 103, is also referred to as "specific emotion". Emotion identification unit 103 notifies image generation unit 104 of the specific emotion.

Also, hereinafter, the image corresponding to the specific emotion is also referred to as "emotion image G1" or "emotion image". That is, the emotion image G1 is an image expressing a specific emotion. The emotional image G1 is, for example, an image based on emotions. That is, the emotional image G1 is an image corresponding to, for example, "joy", "anger", "sadness", "fun", and the like. FIG. 5 is a diagram showing an example of an emotion image.

Note that the emotion identification unit 103 may be configured to determine the strength of the emotion of the user U1 based on the emotion data. In this configuration, the emotion specifying unit 103 notifies the image generating unit 104 of the specific emotion and the intensity of the emotion.

The image generator 104 generates an emotion image G1 corresponding to the specific emotion. Image generation unit 104 transmits generated emotion image G1 to image processing unit 106 . The emotional image G1 is, for example, an image of a face, an image expressed in color, a mark, or the like.

Hereinafter, the emotion image G1 corresponding to the specific emotion "joy" is also referred to as a "joy image". The joy image is, for example, an emotion image G1 showing a smile, as shown in FIG. 5(a).

A joy image is, for example, an image expressed in pink. A joy image is, for example, an image represented by a double circle as a mark.

Also, hereinafter, the emotion image G1 corresponding to the specific emotion "anger" is also referred to as an "anger image". An angry image is, for example, an emotional image G1 showing a face with a mouth shaped like a letter "C" as shown in FIG. 5(b).

Also, an angry image is, for example, an image of a face showing raised eyes and eyebrows. An angry image is, for example, an image expressed in black.

Also, hereinafter, the emotion image G1 corresponding to the specific emotion "sorrow" is also referred to as "sorrow image". The sorrow image is, for example, an emotion image G1 expressing a tearful face shown in FIG. 5(c). A sadness image is, for example, an image of a face showing drooping eyes. A sadness image is, for example, an image expressed in gray.

Also, hereinafter, the emotion image G1 corresponding to the specific emotion "fun" is also referred to as a "fun image". The amusement image is, for example, an emotion image G1 showing a face with a wide open mouth and a smiling expression, as shown in FIG. 5(d). Also, the pleasure image is, for example, an image of a face whose eyes are semicircular in shape. A fun image is, for example, an image expressed in pink, yellow, or the like.

Image processing unit 106 generates a video signal of a video showing emotion image G<b>1 and transmits the video signal signal to display unit 107 .

The display unit 107 has a function of displaying images and videos. The display unit 107 is a display. Display unit 107 displays emotion image G1 based on the video signal.

(motion)
Next, processing performed by the image display system 500 (hereinafter also referred to as “emotion presentation control processing”) will be described. FIG. 6 is a flowchart of emotion presentation control processing according to the first embodiment. Emotion presentation control processing includes emotion data acquisition handling processing and emotion identification handling processing.

The emotion data acquisition support process is a process performed by the mask unit M10. The emotion identification handling process is a process performed by the image display device 100 . Here, the flow of the emotion presentation control process will be briefly described, and a specific example of the emotion presentation control process will be described later.

In the emotion data acquisition handling process of the emotion presentation control process, step S11 is first performed. In step S11, emotion data acquisition processing is performed. In the emotion data acquisition process, the emotion unit 20 of the mask unit M10 acquires one or more emotion data. Specifically, one or more detection units included in the emotion unit 20 acquire one or more emotion data. The one or more detection units are all or part of the vibration sensor 2 , the sound detection unit 3 , the piezoelectric element 4 and the temperature detection unit 5 .

Next, in step S12, emotion data transmission processing is performed. In the emotion data transmission process, the emotion unit 20 of the mask unit M10 transmits one or more emotion data acquired by the one or more detection units to the image display device 100 via the communication unit 6 . That is, the mask unit M10 transmits to the image display device 100 the one or more emotion data acquired by the one or more detection units.

Here, it is assumed that a plurality of detection units each acquire a plurality of emotion data in the emotion data acquisition process. The plurality of detection units are all or part of the vibration sensor 2 , the sound detection unit 3 , the piezoelectric element 4 and the temperature detection unit 5 . In this case, in the emotion data transmission process, the mask unit M10 transmits to the image display device 100 the plurality of emotion data respectively acquired by the plurality of detection units.

In the emotion identification handling process of the emotion presentation control process, step S101 is first performed. In step S101, the emotion identification unit 103 determines whether or not the image display device 100 has received emotion data.

When the image display device 100 receives emotion data (step S101: Yes), the process proceeds to step S102. On the other hand, if the image display device 100 has not received emotion data (step S101: No), step S101 is performed again.

In step S102, emotion identification processing is performed. In the emotion identification process, the emotion identification unit 103 identifies the emotion K of the user U1 in the wearing state based on one or more emotion data received by the image display device 100 . Specifically, the emotion identification unit 103 identifies the emotion K of the user U1 in the wearing state based on one or more emotion data and an emotion identification rule.

After identifying the emotion K of the user U1 in the wearing state, the emotion identification unit 103 notifies the image generation unit 104 of the emotion K of the user U1 as the specific emotion.

Next, in step S103, emotion image generation processing is performed. In the emotion image generation process, the image generation unit 104 generates an emotion image G1 corresponding to the emotion K of the user U1 as the specific emotion. Image generation unit 104 transmits generated emotion image G1 to image processing unit 106 .

Next, in step S104, emotional image display processing is performed. In the emotion image display process, the display unit 107 displays the emotion image G1. Specifically, image processing unit 106 creates a video signal of a video showing emotion image G<b>1 and transmits the video signal to display unit 107 . Display unit 107 displays emotion image G1 based on the video signal. Thus, the emotion presentation control process ends.

(Example of emotion presentation control processing)
Next, a specific example of the emotion presentation control process of FIG. 6 will be described. First, a specific example of emotion presentation control processing for specifying that user U1's emotion K is "joy" based on the joy rule of the emotion specifying rule will be described. If the emotion K of the user U1 is "joy", it is assumed that the user U1 stretches his mouth horizontally to make a smile and laugh.

The joy rule specifies that the emotion K is "joy" if the joy element occurs. Joy elements are, for example, the aforementioned "horizontal vibration" and "laughter".

A “horizontal vibration” occurs, for example, when the mouth of the face F1 of the user U1 extends horizontally and the face F1 smiles. In the emotion presentation control process, when the mouth of the face F1 extends horizontally in the wearing state, the vibration sensor 2 of the emotion unit 20 detects horizontal vibration and generates vibration data of the horizontal vibration. Thereby, the vibration sensor 2 acquires the vibration data as emotion data (step S11). The vibration sensor 2 transmits the emotion data as the vibration data to the image display device 100 via the communication section 6 (step S12).

Also, in the emotion presentation control process, when the user U1 laughs in the worn state, the voice detection section 3 of the emotion unit 20 detects the laughter as the user's voice. The voice detection unit 3 generates voice data of the detected laughter as user voice, and acquires the voice data as emotion data (step S11). The voice detection unit 3 transmits the emotion data as voice data to the image display device 100 via the communication unit 6 (step S12).

Through step S<b>12 described above, the emotion unit 20 of the mask unit M<b>10 transmits to the image display device 100 a plurality of emotion data respectively acquired by the vibration sensor 2 and the voice detection section 3 as a plurality of detection sections.

Next, the emotion specifying unit 103 of the image display device 100 determines the emotion K based on the joy rule included in the emotion specifying rule and the vibration data of horizontal vibration and the voice data of laughter as a plurality of received emotion data. is "joy" (step S102).

In this example, the emotion identifying unit 103 recognizes that "horizontal vibration" and "laughter" have occurred from vibration data of horizontal vibration and audio data of laughter as a plurality of emotion data, and based on the above joy rule, to specify that the emotion K is "joy". That is, the emotion identification unit 103 identifies the emotion K of the user U1 in the wearing state based on the plurality of emotion data received by the image display device 100 .

The emotion specifying unit 103 notifies the image generating unit 104 of the emotion K as the specific emotion.

Next, the image generator 104 generates an emotion image G1 corresponding to the emotion K "joy" as the specific emotion (step S103). The emotion image G1 is, for example, the emotion image G1 in FIG. 5(a).

Next, display unit 107 displays emotion image G1 (step S104). Through the above processing, the emotion image G1 corresponding to the emotion K of the user U1 is displayed.

It should be noted that when the emotion identification unit 103 receives a plurality of emotion data as described above, the degree of joy of the user U1 may be determined based on the plurality of emotion data.

Next, a specific example of emotion presentation control processing for specifying that user U1's emotion K is "anger" based on the anger rule will be described. When the emotion K of the user U1 is "anger", for example, it is assumed that the user U1's breath becomes rough, the shape of the mouth of the face F1 becomes an inverted V shape, and the face temperature rises.

The anger rule specifies that the emotion K is specified as 'anger' if an anger element occurs. Anger elements are, for example, "a plurality of continuously occurring breath pressures", the above-mentioned "vertical vibration", and the above-mentioned "temperature rise".

The “several breath pressures occurring in succession” occurs, for example, when the user U1 takes multiple strong breaths in succession (that is, when the user U1 breathes heavily). In the emotion presentation control process, when the user U1 continuously exhales a plurality of strong breaths, the piezoelectric element 4 of the emotion unit 20 outputs a plurality of breath pressures corresponding to the plurality of strong breaths as the mouth pressure. To detect.

The piezoelectric element 4 generates pressure data of the mouth pressure, which indicates the number of occurrences of breath pressure as the mouth pressure per unit time, the intensity of the mouth pressure, and the like. The piezoelectric element 4 acquires the generated pressure data of the mouth pressure as emotion data (step S11). The piezoelectric element 4 transmits the emotion data as pressure data of the mouth pressure to the image display device 100 via the communication section 6 (step S12).

A “vertical vibration” occurs, for example, when the shape of the mouth of the face F1 becomes an inverted V-shape. In the emotion presentation control process, when the shape of the mouth of the face F1 of the user U1 is in the wearing state, the vibration sensor 2 of the emotion unit 20 detects vertical vibration, and the vibration sensor 2 detects the vertical vibration. Generate vibration data for vertical vibration. Thereby, the vibration sensor 2 acquires the vibration data of the vertical vibration as emotion data (step S11). Vibration sensor 2 transmits emotion data as vibration data to image display device 100 via communication unit 6 (step S12).

"Temperature rise" occurs, for example, when user U1 has strong anger as an emotion for a long period of time. In the emotion presentation control process, when the user U1 has strong anger as an emotion for a long time, the temperature detection section 5 of the emotion unit 20 detects the temperature rise as the face temperature. The temperature detection unit 5 generates temperature data indicating the face temperature, temperature rise, and the like. Then, the temperature detection unit 5 acquires the temperature data as emotion data (step S11). Temperature detection unit 5 transmits emotion data as temperature data to image display device 100 via communication unit 6 (step S12).

Next, the emotion identification unit 103 of the image display device 100 identifies the anger rule included in the emotion identification rule, the pressure data of the mouth pressure, the vibration data of the vertical vibration, and the temperature rise as a plurality of received emotion data. Based on the indicated temperature data, it is specified that the emotion K is "anger" (step S102).

In this example, the emotion identifying unit 103 uses the pressure data of the mouth pressure, the vibration data of the vertical vibration, and the temperature data indicating the temperature rise to determine "a plurality of continuously occurring breath pressures," "vertical vibration," and " It recognizes that "temperature rise" has occurred, and specifies that the emotion K is "anger" based on the above-mentioned anger rule.

Thereafter, in steps S103 and S104, the display unit 107 displays, for example, the emotion image G1 of FIG. 5(b) corresponding to the emotion K "anger" of the user U1.

As described above, when the emotion identification unit 103 receives a plurality of emotion data, the degree of anger of the user U1 may be determined based on the plurality of emotion data.

Next, a specific example of emotion presentation control processing for specifying that user U1's emotion K is "sadness" based on the sadness rule will be described. If user U1's emotion K is "sadness," for example, assume that user U1 sighs, user U1's breathing rate decreases, and user U1 pouts.

The sadness rule specifies that emotion K is identified as "sadness" if a sadness element occurs. Sadness factors are, for example, "continuous breath pressure", "decrease in breath pressure occurring per unit time", and "horizontal and vertical vibration".

"Continuous breath pressure" occurs, for example, when user U1 sighs. In the emotion presentation control process, when the user U1 sighs, the piezoelectric element 4 detects continuous breath pressure corresponding to the sigh. Continuous breath pressure is, for example, breath pressure that continues for a predetermined time or longer. The predetermined time is, for example, 2 seconds.

The piezoelectric element 4 produces mouth pressure pressure data indicative of continuous breath pressure. The piezoelectric element 4 acquires the generated pressure data of the mouth pressure as emotion data (step S11). The piezoelectric element 4 transmits the emotion data as pressure data of the mouth pressure to the image display device 100 via the communication section 6 (step S12).

“Decrease in breath pressure occurring per unit time” occurs, for example, when user U1's number of breaths per unit time decreases. In the emotion presentation control process, when the number of breaths per unit time decreases, the piezoelectric element 4 detects the decrease in breath pressure occurring per unit time as the mouth pressure. In response to this detection, the piezoelectric element 4 generates mouth pressure data indicating a decrease in breath pressure, and acquires the mouth pressure data as emotion data (step S11). The piezoelectric element 4 transmits the emotion data as pressure data of the mouth pressure to the image display device 100 via the communication section 6 (step S12).

"Horizontal and vertical vibration" occurs when user U1's mouth contracts in horizontal direction Dr1 and vertical direction Dr2. In the emotion presentation control process, when the mouth of user U1 shrinks in horizontal direction Dr1 and vertical direction Dr2, vibration sensor 2 detects both horizontal vibration and vertical vibration. In response to the detection, the vibration sensor 2 generates vibration data of horizontal vibration and vertical vibration. Thereby, the vibration sensor 2 acquires the vibration data as emotion data (step S11). The vibration sensor 2 transmits the emotion data as the vibration data to the image display device 100 via the communication section 6 (step S12).

Next, the emotion specifying unit 103 of the image display device 100 extracts the sadness rule included in the emotion specifying rule, pressure data of two types of mouth pressure as emotion data, and horizontal vibration and vertical vibration as emotion data. Based on the vibration data, the emotion K is identified as "sadness". After that, in steps S103 and S104, the display unit 107 displays, for example, the emotion image G1 of FIG. 5(c) corresponding to the emotion K "sadness" of the user U1.

It should be noted that when the emotion identification unit 103 receives a plurality of emotion data as described above, the degree of sadness of the user U1 may be determined based on the plurality of emotion data.

Next, a specific example of emotion presentation control processing for specifying that user U1's emotion K is "enjoyment" based on the enjoyment rule will be described. If user U1's emotion K is "fun", for example, it is assumed that user U1 speaks with a higher tone, that user U1 speaks more, and that user U1 laughs frequently.

The enjoyment rule specifies that the emotion K is "enjoyment" if the enjoyment element occurs. Fun elements are, for example, "high pitched sounds", "continuous multiple voices", "continuous multiple breath pressures", and "continuous horizontal and vertical vibrations".

A “high tone” occurs, for example, when the tone of voice uttered by the user U1 becomes high. In the emotion presentation control process, when the tone of the voice uttered by the user U1 becomes high, the voice detection unit 3 detects a high-pitched voice as the user's voice. In response to the detection, the voice detection unit 3 generates high-pitched voice data as user voice, and acquires the voice data as emotion data (step S11). The voice detection unit 3 transmits the emotion data as voice data to the image display device 100 via the communication unit 6 (step S12).

“Continuous plural voices” occurs, for example, when the amount of conversation of user U1 increases. In the emotion presentation control process, when the amount of conversation of the user U1 increases, the voice detection unit 3 detects a plurality of continuous voices as user voices. In response to the detection, the voice detection unit 3 generates voice data of a plurality of continuous voices as user voices, and acquires the voice data as emotion data (step S11). The voice detection unit 3 transmits the emotion data as voice data to the image display device 100 via the communication unit 6 (step S12).

“Several breath pressures occurring in succession” occurs, for example, when user U1 laughs frequently. In the emotion presentation control process, when the user U1 laughs frequently, the piezoelectric element 4 detects a plurality of continuously occurring breath pressures. In response to the detection, the piezoelectric element 4 generates pressure data of a plurality of continuously occurring breath pressures, and acquires the pressure data as emotion data (step S11). The piezoelectric element 4 transmits emotion data as pressure data to the image display device 100 via the communication section 6 (step S12).

“Continuously occurring horizontal and vertical vibrations” occur when the amount of conversation of user U1 increases and user U1's mouth moves frequently in horizontal direction Dr1 and vertical direction Dr2. In the emotion presentation control process, when the mouth of user U1 frequently moves in horizontal direction Dr1 and vertical direction Dr2, vibration sensor 2 detects horizontal and vertical vibrations that occur continuously. In response to the detection, the vibration sensor 2 generates vibration data of horizontal vibration and vertical vibration that occur continuously, and acquires the vibration data as emotion data (step S11). Vibration sensor 2 transmits emotion data as vibration data to image display device 100 via communication unit 6 (step S12).

Next, the emotion specifying unit 103 of the image display device 100 extracts the enjoyment rule included in the emotion specifying rule, two types of voice data as emotion data, pressure data of a plurality of breath pressures as emotion data, and horizontal vibration. and the vibration data of the vertical vibration, it is specified that the emotion K is "enjoyment".

Thereafter, in steps S103 and S104, the display unit 107 displays, for example, the emotion image G1 of FIG. 5(d) corresponding to the user U1's emotion K "enjoyment".

It should be noted that when the emotion identification unit 103 receives a plurality of emotion data as described above, the degree of enjoyment of the user U1 may be determined based on the plurality of emotion data.

(Another example of emotion presentation control processing)
Next, another example of emotion presentation control processing will be described. Here, it is assumed that the enjoyment elements of the enjoyment rule included in the emotion specifying rule are, for example, "mask vibration that continues for a predetermined time or longer" and "loud user voice". The predetermined time is, for example, 3 seconds. “Mask vibration that continues for a predetermined time or longer” occurs, for example, when user U1 laughs.

A loud user voice is, for example, a voice above 60 decibels. A “loud user voice” occurs, for example, when user U1 laughs.

When the user U1 laughs, in the emotion presentation control process, the vibration sensor 2 of the emotion unit 20 detects "mask vibration that continues for a predetermined time or longer" and generates vibration data of the mask vibration. The vibration data indicates that the mask vibration has occurred, and the duration of the mask vibration that is longer than or equal to a predetermined time.

Thereby, the vibration sensor 2 acquires the vibration data as emotion data (step S11). The vibration sensor 2 transmits the emotion data as the vibration data to the image display device 100 (step S12).

Also, when the user U1 laughs, in the emotion presentation control process, the voice detection unit 3 of the emotion unit 20 detects "loud user voice" and generates voice data of the loud user voice. The voice data indicates that a loud user voice has been generated and a value of 60 decibels or more as the loudness of the user voice.

Thereby, the voice detection unit 3 acquires the voice data as emotion data (step S11). The voice detection unit 3 transmits the emotion data as the voice data to the image display device 100 (step S12).

Through step S<b>12 described above, the emotion unit 20 of the mask unit M<b>10 transmits to the image display device 100 a plurality of emotion data respectively acquired by the vibration sensor 2 and the voice detection section 3 as a plurality of detection sections. The plurality of emotion data are vibration data and voice data.

The emotion specifying unit 103 specifies that the emotion K is "enjoyment" based on the enjoyment rule included in the emotion specifying rule and the vibration data and the voice data as the plurality of emotion data received by the image display device 100. (step S102).

Specifically, in step S102, the emotion identifying unit 103 recognizes that "a mask vibration that continues for a predetermined time or longer" has occurred based on the received vibration data as emotion data. Also, in step S102, the emotion identification unit 103 recognizes that a "loud user voice" has been generated based on the received voice data as emotion data. That is, the emotion identifying unit 103 recognizes that "mask vibration that continues for a predetermined time or longer" and "loud user voice" have occurred.

The emotion specifying unit 103 specifies that the emotion K is "enjoyment" based on the recognition and the enjoyment rule specifying that the emotion K is specified by the occurrence of the pleasure element. As described above, the enjoyment rule specifies that the emotion K is "enjoyment" when an enjoyment element occurs.

That is, the emotion identification unit 103 identifies the emotion K of the user U1 in the wearing state based on the plurality of emotion data received by the image display device 100 . The processing after step S102 is the same as the processing described above.

Next, still another example of emotion presentation control processing will be described. Here, it is assumed that the pleasure elements of the pleasure rule included in the emotion specifying rule are, for example, "mask vibration that continues for a predetermined time or longer" and "high face temperature that is maintained for a predetermined time or longer". The predetermined time is, for example, 10 seconds. The high face temperature is, for example, 37 degrees or higher. “Mask vibration that continues for a predetermined time or longer” occurs, for example, when user U1 continues to have a conversation.

“High face temperature maintained for a predetermined time or longer” means that a high face temperature is maintained for a predetermined time or longer. “High face temperature maintained for a predetermined time or more” occurs, for example, when user U1 continues to have a conversation. This is because the temperature on the inner surface M1b side of the mask M1 rises when the user U1 continues to talk while the user U1 is wearing the mask M1.

When the user U1 continuously converses, in the emotion presentation control process, the vibration sensor 2 of the emotion unit 20 detects "mask vibration that continues for a predetermined time or longer" and generates vibration data of the mask vibration. The vibration data indicates that the mask vibration has occurred, and the duration of the mask vibration that is longer than or equal to a predetermined time. The predetermined time is, for example, 10 seconds.

Thereby, the vibration sensor 2 acquires the vibration data as emotion data (step S11). The vibration sensor 2 transmits the emotion data as the vibration data to the image display device 100 (step S12).

Further, when the user U1 continues to have a conversation, in the emotion presentation control process, the temperature detection unit 5 of the emotion unit 20 detects "a high face temperature that is maintained for a predetermined period of time or longer" and detects the high face temperature. Generate data. The temperature data indicates a high face temperature and a maintenance time longer than or equal to a predetermined time, which is the time during which the high face temperature is maintained. The predetermined time is, for example, 10 seconds.

Thereby, the temperature detection unit 5 acquires the temperature data as emotion data (step S11). The temperature detection unit 5 transmits the emotion data as the temperature data to the image display device 100 (step S12).

Through step S<b>12 described above, the emotion unit 20 of the mask unit M<b>10 transmits to the image display device 100 a plurality of emotion data respectively acquired by the vibration sensor 2 and the temperature detection section 5 as a plurality of detection sections. The plurality of emotion data are vibration data and temperature data.

The emotion specifying unit 103 specifies that the emotion K is "enjoyment" based on the enjoyment rule included in the emotion specifying rule and the vibration data and the temperature data as the plurality of emotion data received by the image display device 100. (step S102).

Specifically, in step S102, the emotion identifying unit 103 recognizes that "a mask vibration that continues for a predetermined time or longer" has occurred based on the received vibration data as emotion data. Also, in step S102, the emotion identification unit 103 recognizes that "a high face temperature that is maintained for a predetermined time or longer" has occurred based on the received temperature data as emotion data. That is, the emotion identifying unit 103 recognizes that "mask vibration that continues for a predetermined time or longer" and "high face temperature that is maintained for a predetermined time or longer" have occurred.

The emotion specifying unit 103 specifies that the emotion K is "enjoyment" based on the recognition and the enjoyment rule specifying that the emotion K is specified by the occurrence of the pleasure element. That is, the emotion identification unit 103 identifies the emotion K of the user U1 in the wearing state based on the plurality of emotion data received by the image display device 100 . The processing after step S102 is the same as the processing described above.

(Example of emotion presentation control processing using one detection unit)
In the emotion presentation control process described above, a specific example of the process in which the emotion unit 20 has a plurality of detection units has been described. Here, a specific example of emotion presentation control processing in a configuration in which the emotion unit 20 has one detection unit (hereinafter also referred to as “configuration C1”) will be described.

Hereinafter, the configuration in which one detection unit in the configuration C1 is the vibration sensor 2 is also referred to as "configuration C1a." Further, hereinafter, the configuration in which one detection unit in the configuration C1 is the voice detection unit 3 is also referred to as “configuration C1b”. Further, hereinafter, the configuration in which one detection unit in the configuration C1 is the piezoelectric element 4 is also referred to as "configuration C1c". Further, hereinafter, the configuration in which one detection unit in the configuration C1 is the temperature detection unit 5 is also referred to as "configuration C1d".

First, a specific example of the emotion presentation control process in the configuration C1a in which one detection unit is the vibration sensor 2 will be described. Here, in configuration C1a, it is assumed that the enjoyment element of the enjoyment rule included in the emotion specifying rule is, for example, "mask vibration that continues for a predetermined time or longer". The predetermined time is, for example, 3 seconds. “Mask vibration that continues for a predetermined time or longer” occurs, for example, when user U1 laughs.

When the user U1 laughs, in the emotion presentation control process, the vibration sensor 2 of the emotion unit 20 detects "mask vibration that continues for a predetermined time or longer" and generates vibration data of the mask vibration. The vibration data indicates that the mask vibration has occurred, and the duration of the mask vibration that is longer than or equal to a predetermined time.

Thereby, the vibration sensor 2 acquires the vibration data as emotion data (step S11). The vibration sensor 2 transmits the emotion data as the vibration data to the image display device 100 (step S12).

The emotion specifying unit 103 specifies that the emotion K is "enjoyment" based on the pleasure rule included in the emotion specifying rule and the vibration data as the emotion data received by the image display device 100 (step S102). . Specifically, in step S102, the emotion identifying unit 103 recognizes that "a mask vibration that continues for a predetermined time or longer" has occurred based on the received vibration data as emotion data. The emotion specifying unit 103 specifies that the emotion K is "enjoyment" based on the recognition and the enjoyment rule specifying that the emotion K is specified by the occurrence of the pleasure element. The processing after step S102 is the same as the processing described above.

Next, a specific example of the emotion presentation control process in the configuration C1b in which one detector is the voice detector 3 will be described. Here, in configuration C1b, it is assumed that the enjoyment element of the enjoyment rule included in the emotion specifying rule is, for example, the aforementioned "loud user voice". A loud user voice is, for example, a voice above 60 decibels. A “loud user voice” occurs, for example, when user U1 laughs.

When the user U1 laughs, in the emotion presentation control process, the voice detection unit 3 of the emotion unit 20 detects "loud user voice" and generates voice data of the loud user voice. The voice data indicates that a loud user voice has been generated and a value of 60 decibels or more as the loudness of the user voice.

Thereby, the voice detection unit 3 acquires the voice data as emotion data (step S11). The voice detection unit 3 transmits the emotion data as the voice data to the image display device 100 (step S12).

The emotion specifying unit 103 specifies that the emotion K is "enjoyment" based on the pleasure rule included in the emotion specifying rule and the voice data as the emotion data received by the image display device 100 (step S102). . Specifically, in step S102, the emotion identification unit 103 recognizes that a "loud user voice" has been generated based on the received voice data as emotion data. The emotion specifying unit 103 specifies that the emotion K is "enjoyment" based on the recognition and the enjoyment rule specifying that the emotion K is specified by the occurrence of the pleasure element. The processing after step S102 is the same as the processing described above.

Next, a specific example of the emotion presentation control process in the configuration C1c in which one detection unit is the piezoelectric element 4 will be described. Here, in configuration C1c, it is assumed that the sadness element of the sadness rule included in the emotion specifying rule is, for example, "mouth pressure that continues for a predetermined time or longer". The predetermined time is, for example, 2 seconds. A mouth pressure that lasts longer than a predetermined time is a continuous breath pressure. “Mouth pressure that continues for a predetermined time or longer” occurs, for example, when user U1 sighs.

When the user U1 sighs, in the emotion presentation control process, the piezoelectric element 4 of the emotion unit 20 detects "mouth pressure that continues for a predetermined time or longer" and generates pressure data of the mouth pressure. The pressure data indicates that the mouth pressure is generated as breath pressure, and the duration of the mouth pressure that is longer than or equal to a predetermined time. The duration is, for example, 2 seconds.

As a result, the piezoelectric element 4 acquires the pressure data as emotion data (step S11). The piezoelectric element 4 transmits the emotion data as the pressure data to the image display device 100 (step S12).

The emotion specifying unit 103 specifies that the emotion K is "sadness" based on the sadness rule included in the emotion specifying rule and the pressure data as the emotion data received by the image display device 100 (step S102). . Specifically, in step S102, the emotion identification unit 103 recognizes that "mouth pressure that continues for a predetermined time or more" has occurred based on the received pressure data as emotion data. The emotion specifying unit 103 specifies that the emotion K is "sadness" based on the recognition and the sadness rule that specifies that the emotion K is specified by the occurrence of the sadness element. As described above, the sadness rule specifies that the emotion K is "sadness" when a sadness element occurs. The processing after step S102 is the same as the processing described above.

Next, a specific example of the emotion presentation control process in the configuration C1d in which one detector is the temperature detector 5 will be described. Here, in the configuration C1d, it is assumed that the enjoyment element of the enjoyment rule included in the emotion specifying rule is, for example, "a high face temperature that is maintained for a predetermined time or longer". The predetermined time is, for example, 10 seconds. The high face temperature is, for example, 37 degrees or higher. “High face temperature maintained for a predetermined time or longer” means that a high face temperature is maintained for a predetermined time or longer. “High face temperature maintained for a predetermined time or more” occurs, for example, when user U1 continues to have a conversation. This is because the temperature on the inner surface M1b side of the mask M1 rises when the user U1 continues to talk while the user U1 is wearing the mask M1.

When the user U1 continues to have a conversation, in the emotion presentation control process, the temperature detection unit 5 of the emotion unit 20 detects "a high face temperature that is maintained for a predetermined time or longer", and outputs the temperature data of the high face temperature. Generate. The temperature data indicates a high face temperature and a maintenance time longer than or equal to a predetermined time, which is the time during which the high face temperature is maintained. The predetermined time is, for example, 10 seconds.

Thereby, the temperature detection unit 5 acquires the temperature data as emotion data (step S11). The temperature detection unit 5 transmits the emotion data as the temperature data to the image display device 100 (step S12).

Emotion identification unit 103 identifies that emotion K is “enjoyment” based on the enjoyment rule included in the emotion identification rule and the temperature data as the emotion data received by image display device 100 (step S102). . Specifically, in step S102, the emotion identification unit 103 recognizes that "a high face temperature that is maintained for a predetermined time or longer" has occurred based on the received temperature data as emotion data. The emotion specifying unit 103 specifies that the emotion K is "enjoyment" based on the recognition and the enjoyment rule specifying that the emotion K is specified by the occurrence of the pleasure element. The processing after step S102 is the same as the processing described above.

(effect)
As described above, according to the present embodiment, the state of the mask unit M10 includes a wearing state in which the user U1 wears the mask unit M10. The mask unit M10 includes a mask M1 that covers the lower portion of the face F1 of the user U1 when worn. The wearing state is a state in which the user U1 wears the mask M1. The emotion unit 20 acquires at least one emotion data for specifying the emotion K of the user U1 in the wearing state. Mask unit M10 transmits at least one piece of emotion data to image display device 100 . Emotion identification unit 103 identifies the emotion of user U1 in the wearing state based on at least one piece of emotion data received by image display device 100 . The display unit 107 displays an emotion image G1 corresponding to the specific emotion identified by the emotion identification unit 103, which is the emotion K of the user U1 in the wearing state.

This makes it possible to easily grasp the emotions of the user wearing the mask.

Further, according to the present embodiment, it is possible to identify the emotion of user U1 wearing a mask and display an image corresponding to the emotion.

Further, according to the present embodiment, emotion identifying section 103 identifies emotion K of user U1 based on a plurality of emotion data. Therefore, it is possible to accurately identify the emotion K of the user U1.

Further, according to the present embodiment, it is possible to specify the emotion K of user U1 even with a single detection unit.

(Hardware configuration example of image display device)
7 and 8 are diagrams showing examples of the hardware configuration of the image display device 100. FIG. Functions of a plurality of main components related to the present technology included in the image display device 100 shown in FIG. 4 are realized by, for example, the processing circuit 70 and the display 81 shown in FIG. That is, the image display device 100 includes a processing circuit 70 and a display 81 as main components related to the present technology.

As described above, the emotion unit 20 of the mask unit M10 acquires at least one emotion data for identifying the user's emotion when the user wears the mask.

Processing circuitry 70 identifies the user's emotion in the wearing state based on the at least one emotion data. The processing circuit 70 corresponds to the emotion identification section 103 .

The display 81 displays an image corresponding to the specific emotion identified by the processing circuit 70, which is the user's emotion in the wearing state. The display 81 corresponds to the display section 107 .

Processing circuitry 70 may be dedicated hardware. Moreover, the processing circuit 70 may be configured using a processor that executes a program stored in a memory. The processor is, for example, a CPU (Central Processing Unit), a central processing unit, an arithmetic unit, a microprocessor, a microcomputer, a DSP (Digital Signal Processor), or the like.

Hereinafter, the situation in which the processing circuit 70 is dedicated hardware is also referred to as "situation St1". Further, hereinafter, a situation in which the processing circuit 70 is configured using a processor is also referred to as "situation St2".

In situation St1, the processing circuit 70 is, for example, a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array), or any of these. A combination is applicable. The function of the emotion identification unit 103 included in the image display device 100 is implemented by the processing circuit 70 .

FIG. 8 is a diagram showing an example of the hardware configuration of image display device 100 in situation St2 in which processing circuit 70 is configured using a processor. The configuration of FIG. 8 is a configuration in which the processing circuit 70 of FIG. 7 is realized by a processor 71 and a memory 72.

In situation St2, software A implements the function of emotion identification unit 103 . Software A is software or firmware. Also, the software A may be composed of a combination of software and firmware. Software A is written as a program and stored in memory 72 .

In situation St2, processor 71 reads out the program stored in memory 72 and executes the program, thereby realizing the function of emotion identification unit 103 . That is, the memory 72 stores the following programs.

The program causes the processor 71 to perform a process of identifying the user's emotion in the wearing state of the mask based on at least one emotion data for identifying the user's emotion in the wearing state of the mask. It is a program for

The program also causes a computer to execute the procedure of processing performed by the emotion identifying unit 103, the method of executing the processing, and the like.

Here, the memory 72 is a nonvolatile or volatile semiconductor memory such as RAM (Random Access Memory), ROM (Read Only Memory), flash memory, EPROM, EEPROM, or the like. Also, the memory 72 is, for example, a magnetic disk, a flexible disk, an optical disk, a compact disk, a mini disk, a DVD, or the like. Also, the memory 72 may be any storage medium that will be used in the future.

As described above, the image display device 100 can implement the functions described above by hardware, software A, or a combination thereof.

In addition, the present technology may be implemented as an emotion identification handling method in which operations of characteristic components included in the image display device 100 are performed as steps. Also, the present technology may be implemented as a program that causes a computer to execute each step included in such an emotion-specific handling method.

Also, the present technology may be implemented as a computer-readable recording medium that stores such a program. Also, the program may be distributed via a transmission medium such as the Internet. The emotion identification handling method according to the present technology corresponds to, for example, the flowchart on the right side of FIG.

All the numerical values used in the above embodiment are numerical values of an example for specifically describing the present technology. That is, the present technology is not limited to each numerical value used in the above embodiments.

(Other modifications)
In addition, it is possible to modify or omit the embodiments as appropriate.

For example, image display device 100 may not include all the components shown in the drawing. That is, the image display device 100 only needs to include minimum components that can achieve the effects of the present technology. For example, the image display device 100 may be configured without the image generator 104 that generates the emotion image G1. In this configuration, for example, the image processing unit 106 selects, from a plurality of different emotion images prepared in advance, an emotion image corresponding to the image corresponding to the specific emotion, which is the user's emotion, identified by the emotion identification unit 103. do. Display unit 107 displays the selected emotion image.

Further, for example, the communication performed by the mask unit M10 with the image display device 100 may be wired communication.

2, 2a, 2b, 2c, 2d vibration sensor, 3 sound detection unit, 4 piezoelectric element, 5 temperature detection unit, 6, 102 communication unit, 20 emotion unit, 100 image display device, 103 emotion identification unit, 104 image generation unit , 107 display unit, 500 image display system, M1 mask, M10 mask unit.

Claims (8)

An image display system including an image display device and a mask unit capable of communicating with the image display device and capable of being worn by a user,
The state of the mask unit includes a wearing state in which the user wears the mask unit,
The mask unit is
a sheet-shaped mask that covers the lower part of the user's face in the wearing state;
an emotion unit for obtaining at least one emotion data for identifying the user's emotion in the wearing state;
The wearing state is a state in which the user wears the mask,
The emotion unit is provided on the mask,
the mask unit transmitting the at least one emotion data to the image display device;
The image display device is
an emotion identification unit that identifies the emotion of the user in the wearing state based on the at least one emotion data received by the image display device;
a display unit that displays an image corresponding to the specific emotion, which is the emotion of the user in the wearing state, specified by the emotion specifying unit;
Image display system. The mask unit has a function of wirelessly communicating with the image display device,
The image display system according to claim 1. The image display device further comprises
An image generation unit that generates an image corresponding to the specific emotion,
3. The image display system according to claim 1 or 2. The emotion unit has one detection unit,
The one detection unit is a vibration sensor that detects vibration of the mask and acquires vibration data, which is data of the detected vibration, as the emotion data.
The image display system according to any one of claims 1 to 3. The emotion unit has one detection unit,
The one detection unit is a voice detection unit that detects a voice uttered by the user and acquires voice data, which is data of the detected voice, as the emotion data.
The image display system according to any one of claims 1 to 3. The emotion unit has one detection unit,
The one detection unit is a piezoelectric element,
The piezoelectric element detects pressure applied to the piezoelectric element by movement of the user's face, and acquires pressure data, which is data of the detected pressure, as the emotion data.
The image display system according to any one of claims 1 to 3. The emotion unit has one detection unit,
The one detection unit is a temperature detection unit that detects the temperature of the user's face and acquires temperature data, which is data of the detected temperature, as the emotion data.
The image display system according to any one of claims 1 to 3. The emotion unit has a plurality of detection units,
The plurality of detection units are composed of two or more components selected from a vibration sensor as a component, an audio detection unit as a component, a piezoelectric element as a component, and a temperature detection unit as a component. ,
The vibration sensor detects vibration of the mask, acquires vibration data, which is data of the detected vibration, as the emotion data,
The voice detection unit detects a voice uttered by the user, acquires voice data, which is data of the detected voice, as the emotion data,
the piezoelectric element detects pressure applied to the piezoelectric element due to movement of the user's face, and acquires pressure data, which is data of the detected pressure, as the emotion data;
The temperature detection unit detects the temperature of the user's face, acquires temperature data, which is data of the detected temperature, as the emotion data,
wherein the mask unit transmits the plurality of emotion data respectively acquired by the plurality of detection units to the image display device;
The emotion identification unit identifies the user's emotion in the wearing state based on the plurality of emotion data received by the image display device.
The image display system according to any one of claims 1 to 3.

Images