JP6170834B2 - Emotion expression device, emotion expression method, and computer program - Google Patents

Description

  The present invention relates to an emotion expression device, an emotion expression method, and a computer program.

  In recent years, the performance of mobile terminals such as smartphones and tablet computers has improved, and it has become common to view video content such as animation, which has been difficult to view on mobile terminals in the past, on mobile terminals. Also, in school classes, tutorials, news, online chat, and the like, moving image content in which animated characters appear as explainers is distributed to mobile terminals and is being viewed on mobile terminals.

  Conventionally, it has been studied to improve the ability of information transmission by an animation character by making the emotional expression of the animation character rich by the voice, facial expression, gesture, etc. of the animation character. However, since the mobile terminal generally has a display screen size smaller than that of a personal computer or television receiver, there is a problem that it is difficult to understand the facial expression and gesture of an animated character on the display screen. For this reason, the prior art for making the emotional expression of the animation character on the display screen easy to understand is known.

  In the prior art described in Non-Patent Document 1, the original gesture of an animation character is changed, and thus an exaggerated effect such as acceleration or deceleration is generated, thereby generating a more understandable animation. In the prior art described in Non-Patent Document 2, it is shown that vibrations generated by a vibrator (vibration generator) mounted on a portable terminal are connected to emotions. In particular, it shows that the emotions evoked differ depending on the period and strength of vibration. In the prior art described in Patent Document 1, emotion is transmitted from vibration simultaneously with voice. In the prior art described in Patent Document 2, emotions of child's pleasure, discomfort, and caution are transmitted to the information presentation communication device at the workplace where the mother works, and the information presentation communication device transmits the emotional state of the child by sound, light Or it is known by the mechanical method of vibration. In the prior art described in Patent Document 3, a plurality of actuators are temporally and spatially controlled by tactile stimulus information, and the tactile stimulus information is synchronized with the media clip.

JP 2006-047640 A JP 2006-051317 A Special table 2011-523364 gazette

Akiko Kuwabara, Mitsunori Makino, “Proposal of an exaggerated expression creation auxiliary system for CG animation”, Journal of the Society of Arts and Sciences Vol. 2 No. 1 pp.21-30, 2003 Katri Salminen, Veikko Surakka, Jani Lylykangas, Jukka Raisamo, Rami Saarinen, Roope Raisamo, Jussi Rantala, and Grigori Evreinov, “Emotional and behavioral responses to haptic stimulation.In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '08 ) ”, ACM, New York, NY, USA, 1555-1562, 2008 J.A. Russell, “A Circumplex Model of Affect”, Journal of Personality and Social Psychology, 39 (6), 1161-1178, 1980

However, the conventional techniques described above have the following problems.
In the prior art described in Non-Patent Document 1, since the motion data is corrected, the motion of the animation character may become unnatural due to a problem of accuracy. In addition, since the calculation amount is large, it is difficult to apply to a portable terminal that has a low calculation capability and is concerned about battery consumption. In the prior art described in Non-Patent Document 2, the problem is how to apply the relationship between the vibration period and strength and the aroused emotion to changes in the emotion of the animation character.

  In the prior arts described in Patent Documents 1 and 2, since they are not linked to animation, the issue is how to control vibration in response to changes in the emotion of the animation character. The prior art described in Patent Document 3 is based on the premise that a plurality of parts of the human body are stimulated by a plurality of actuators, and thus is difficult to apply when stimulating the human body with a single portable terminal. Furthermore, since changes in emotion are not taken into account, there is a problem that the emotional expression of animation characters cannot be enriched.

  The present invention has been made in consideration of such circumstances, and it is an object of the present invention to provide an emotion expression device, an emotion expression method, and a computer program that can express changes in emotion in accordance with the reproduction of content data such as animation. To do.

(1) An emotion expression device according to the present invention includes an emotion change information acquisition unit that acquires emotion change information representing an emotion change from content data, and an emotion change expression corresponding to the emotion change indicated by the emotion change information. An emotion change expression data generation unit that generates data, and an output control unit that controls an output operation based on the emotion change expression data based on the timing of the change of the emotion indicated by the emotion change information when reproducing the content data And an output unit that performs an output operation based on the emotion change expression data in accordance with the control of the output control unit.

(2) The emotion change device according to the present invention is the emotion change device according to (1), wherein the emotion change device stores basic information of emotion change expressions indicating emotion change expressions that call human empathy for changes in human emotions. An expression basic information storage unit is provided, and the emotion change expression data generation unit generates the emotion change expression data based on the emotion change expression basic information.

(3) In the emotion expression device according to the present invention, in the emotion expression device according to any one of (1) and (2), the output control unit may change the emotion change with respect to a start period or an end period of the output operation. The intensity of the output operation is controlled according to a change in emotion indicated by the information.

(4) The emotion expression device according to the present invention is the emotion expression device according to (3), wherein the output control unit is configured to change the emotion change indicated by the emotion change information from a pleasant emotion to an unpleasant emotion. The strength in the end period of the output operation is made weaker than the start period of the output operation.

(5) The emotion expression device according to the present invention is the emotion expression device according to (3), wherein the output control unit is configured such that when the emotion change indicated by the emotion change information is from an unpleasant emotion to a pleasant emotion, The strength in the start period and the end period of the output operation is made weaker than the period between the start period and the end period.

(6) The emotion expression device according to the present invention is the emotion expression device according to any one of (3) to (5), wherein the output control unit performs the output operation in a start period or an end period of the output operation. It is characterized by changing strength.

(7) The emotion expression device according to the present invention is the emotion expression device according to any one of (1) to (6) above, wherein the output control unit is configured according to the degree of change in emotion indicated by the emotion change information. The intensity of the output operation is controlled.

(8) An emotion expression method according to the present invention is an emotion expression method of an emotion expression device, and the emotion expression device acquires emotion change information representing emotion change from content data; An emotion change expression data generation step in which the emotion expression device generates emotion change expression data corresponding to the emotion change indicated by the emotion change information; and the emotion expression device reproduces the emotion change when the content data is reproduced. An output control step for controlling an output operation based on the emotion change expression data based on the emotion change timing indicated by the information; and the emotion expression device converts the emotion change expression data into the emotion change expression data according to the control of the output control step. And an output step for performing an output operation based on the output step.

(9) A computer program according to the present invention includes an emotion change information acquisition step for acquiring, from a content data, emotion change information representing an emotion change, and an emotion corresponding to the emotion change indicated by the emotion change information. An emotion change expression data generation step for generating change expression data, and an output for controlling an output operation based on the emotion change expression data based on the emotion change timing indicated by the emotion change information when the content data is reproduced It is a computer program for executing a control step and an output step for performing an output operation based on the emotion change expression data in accordance with the control of the output control step.

  According to the present invention, it is possible to express a change in emotion in accordance with the reproduction of content data such as animation. Thereby, the effect that the viewer of content data can recognize the change of the emotion contained in content data more impressively is acquired.

It is a block diagram which shows the structure of the emotion expression apparatus 1 which concerns on one Embodiment of this invention. It is a flowchart which shows the procedure of the emotion expression method which concerns on one Embodiment of this invention. It is a graph which shows the example of the emotion model which concerns on one Embodiment of this invention. It is a wave form diagram which shows the example of the emotion change expression basic information 105 which concerns on one Embodiment of this invention. It is a figure explaining the example of the output control operation | movement by the output control part 14 which concerns on one Embodiment of this invention. It is a figure explaining the example of the output control operation | movement by the output control part 14 which concerns on one Embodiment of this invention. It is a figure explaining the example of the image pattern of the visual effect image which concerns on one Embodiment of this invention.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
FIG. 1 is a block diagram showing a configuration of an emotion expression device 1 according to an embodiment of the present invention. In FIG. 1, the emotion expression device 1 includes an emotion change information acquisition unit 11, an emotion change expression basic information storage unit 12, an emotion change expression data generation unit 13, an output control unit 14, and an output unit 15. The content data 100 is input to the emotion expression device 1. The content data 100 is input to the content playback device 2 and played back.

  The content data 100 includes information on emotional changes, and examples thereof include data such as video content, text content, and audio content. Examples of the moving image content include an animation by computer graphics and a moving image by a live action. Examples of text content include novels, books such as magazines, and blogs. Examples of the audio content include reading of music, novels, and the like. The moving image content and the text content are displayed and reproduced on the display screen of the content reproduction device 2. The audio content is played back by the content playback device 2.

  In the emotion expression device 1, the emotion change information acquisition unit 11 acquires emotion change information 101 representing a change in emotion from the content data 100. The emotion change expression basic information storage unit 12 stores emotion change expression basic information 105 indicating an emotion change expression that calls a person's sympathy for a change in the person's emotion. The emotion change expression data generation unit 13 generates emotion change expression data 102 corresponding to the emotion change indicated by the emotion change information 101. The emotion change expression basic information 105 is used by the emotion change expression data generation unit 13 when the emotion change expression data 102 is generated. The output control unit 14 controls the output operation based on the emotion change expression data 102 based on the emotion change timing indicated by the emotion change information 101 when the content data 100 is reproduced.

  The output unit 15 performs an output operation based on the emotion change expression data 102 in accordance with the control signal 103 from the output control unit 14. As the output unit 15, for example, a vibration generator that generates vibration based on the emotion change expression data 102, a sound generator that generates sound based on the emotion change expression data 102, and an image generation that generates an image based on the emotion change expression data 102 Examples thereof include devices. The vibration, sound, and image generated by the output unit 15 are provided to the user who views the content data 100 reproduced by the content reproduction device 2.

  Further, the output control unit 14 outputs a playback control signal 104 of the content data 100 to the content playback device 2. The reproduction control signal 104 of the content data 100 is for synchronizing the timing of the output operation based on the emotion change expression data 102 by the output unit 15 and the reproduction operation of the content data 100 by the content reproduction apparatus 2.

  Next, the operation of the emotion expression device 1 according to the present embodiment will be described with reference to FIG. FIG. 2 is a flowchart showing the procedure of the emotion expression method according to the present embodiment. In the following description, an animation (hereinafter referred to as animation 100) is taken as an example of the content data 100.

[Step S1: Emotion change information acquisition step]
The emotion change information acquisition unit 11 acquires the emotion change information 101 from the animation 100 input to the emotion expression device 1. Emotion change information 101 indicates emotion change timing (emotion change timing), emotions before and after the change, and the like.

  The animation 100 expresses the emotion of a character by an animation character (hereinafter simply referred to as a character) changing voices, facial expressions, gestures, etc. over time. The emotion change information acquisition unit 11 acquires emotion change information 101 representing a change in emotion of the character from the animation 100. As examples of the emotion change information acquisition method, two examples A-1 and A-2 will be described below. In these examples A-1 and A-2, for convenience of explanation, “pleasant emotion” and “unpleasant emotion” are used as two types of emotions. For this reason, there are two types of emotion changes: a change from pleasant emotion to unpleasant emotion and a change from unpleasant emotion to pleasant emotion.

(Example A-1) In Example A-1, in the animation 100, the facial expression of the character is created using three-dimensional computer graphics using polygons and textures corresponding to the facial expression of the character. . In the animation 100, a basic expression set “F = {F ⁰ , F ¹ ,..., F ^N }” is defined. F ⁿ represents a basic facial expression. “N = 0, 1,..., N”, where N is a positive integer. The animation 100 includes time change information of the basic facial expression set F for each frame as metadata. The facial expression of the character in each frame of the animation 100 is indicated by the time change information of the basic facial expression set F.

  The emotion change information acquisition unit 11 maps the facial expression of the character in the animation 100 to the emotion model shown in FIG. The emotion change information acquisition unit 11 holds in advance facial expression conversion coordinate information indicating the correspondence between facial expressions and emotion model coordinates. The emotion change information acquisition unit 11 acquires the emotion model coordinates from the facial expression of the character indicated by the time change information of the basic facial expression set F for each frame of the animation 100 based on the facial expression conversion coordinate information.

  FIG. 3 is a graph showing an example of an emotion model according to the present embodiment. In FIG. 3, the x-axis indicates the degree of pleasant emotion and unpleasant emotion, and the y-axis indicates the degree of emotional activity. In the example shown in FIG. 3, the facial expression is coordinate 201 in a certain frame, but the facial expression changes from coordinate 202 to coordinate 206 in each subsequent frame. In the example of FIG. 3, it can be seen that the emotion of the character changes from unpleasant to pleasant from the frame of the coordinate 203 to the frame of the coordinate 204.

  The emotion change information acquisition unit 11 obtains information indicating the emotion change timing, information indicating each emotion before and after the change, and emotion model coordinates from the result of mapping the facial expression of the character in each frame of the animation 100 to the emotion model. Information “E (t) = {x (t), y (t)} is acquired. T is the frame time of the animation 100. In the example of FIG. Between the frames, before the change is unpleasant emotion, and after the change is pleasant emotion.

  When the animation 100 has a plurality of facial expressions, there are a plurality of pieces of time change information of the basic facial expression set F for each frame, and there are a plurality of character facial expressions in each frame of the animation 100. In this case, the emotion change information acquisition unit 11 maps the facial expression of the character to the emotion model for each time change information of the basic facial expression set F. As a result, for each time change information of the basic facial expression set F, a facial expression change vector (corresponding to an arrow broken line in FIG. 3) is generated on the emotion model. The emotion change information acquisition unit 11 obtains an average of the expression change vectors. Then, the emotion change information acquisition unit 11 acquires, from the average vector, information indicating the emotion change timing, information indicating each emotion before and after the change, and emotion model coordinate information E (t).

(Example A-2) In Example A-2, the facial expression of the character is created in the animation 100 using a combination of each part of the character's face by three-dimensional computer graphics. The emotion change information acquisition unit 11 acquires time (frame) information of each part from the animation 100, and determines the facial expression of the character based on the time information of each part. Here, in the case of a single emotion, the facial expression is estimated by using a FACS (Facial Action Coding System) using a clear correspondence between each part and the facial expression. On the other hand, when there are a plurality of emotions, it may not be possible to narrow down to a single expression from the plurality of facial expressions indicated by the combination of the parts. In this case, one of a plurality of facial expressions is selected using a Greedy algorithm.

  As in Example A-1, the emotion change information acquisition unit 11 maps the emotional expression of the character in each frame of the animation 100 to the emotion model, information indicating the emotion change timing, and each emotion before and after the change. And emotion model coordinate information E (t) are acquired.

  The above is an explanation of an example of a method for acquiring the emotion change information 101. The emotion change information acquisition unit 11 outputs the emotion change information 101 to the emotion change expression data generation unit 13 and the output control unit 14. The emotion change information 101 includes information indicating the emotion change timing, information indicating each emotion before and after the change, and emotion model coordinate information E (t).

  In addition, when the animation 100 has information indicating emotion change timing, information indicating each emotion before and after the change, and emotion model coordinate information E (t) as metadata, the information is acquired to change the emotion. Used for information 101.

[Step S2: Emotion change expression data generation step]
The emotion change expression data generation unit 13 generates emotion change expression data 102 corresponding to the emotion change indicated by the emotion change information 101. The emotion change expression basic information 105 is used by the emotion change expression data generation unit 13 when the emotion change expression data 102 is generated.

  FIG. 4 is a waveform diagram showing an example of emotion change expression basic information 105 according to the present embodiment. FIG. 4 shows an example of emotion change expression basic information 105 when a vibration generator is provided as the output unit 15. The waveform in FIG. 4A is a vibration pattern 301 when changing from pleasant emotion to unpleasant emotion. This vibration pattern 301 is an intermittent vibration pattern having a relatively large vibration intensity and a relatively short vibration cycle. With this vibration pattern 301, it is possible to call human empathy for a change from pleasant emotion to unpleasant emotion.

  The waveform in FIG. 4B is a vibration pattern 302 when changing from an unpleasant emotion to a pleasant emotion. This vibration pattern 302 is a continuous vibration pattern having a relatively small vibration intensity and a relatively long vibration cycle. This vibration pattern 302 can call human empathy for a change from an unpleasant emotion to a pleasant emotion.

  The emotion change expression data generation unit 13 selects the emotion change expression basic information 105 corresponding to the emotion change based on the emotion before and after the change indicated by the emotion change information 101. For example, when changing from pleasant emotion to unpleasant emotion, the vibration pattern 301 is selected. On the other hand, when changing from an unpleasant emotion to a pleasant emotion, the vibration pattern 302 is selected.

  Next, the emotion change expression data generation unit 13 generates emotion change expression data 102 in which the selected emotion change expression basic information 105 is associated with the emotion change timing indicated by the emotion change information 101. The emotion change expression data 102 includes emotion change expression basic information 105, information of emotion change timing indicated by the emotion change information 101, and emotion model coordinate information E (t). The emotion change expression data generation unit 13 outputs the emotion change expression data 102 to the output control unit 14 and the output unit 15.

[Step S3: Output Control Step]
The output control unit 14 controls an output operation based on the emotion change expression data 102 based on the emotion change timing indicated by the emotion change information 101 when the animation 100 is reproduced. The output control unit 14 outputs a control signal 103 that conveys the control to the output unit 15. The emotion change timing indicated by the emotion change information 101 is acquired from the emotion change expression data 102.

  The output control step will be described below with a specific example. Here, it is assumed that a vibration generator is provided as the output unit 15 and the vibration patterns 301 and 302 in FIG. 4 are used.

  The output control unit 14 controls the vibration intensity in the vibration start period or the vibration end period for the vibration pattern indicated by the emotion change expression data 102 in accordance with the change in emotion. 5 and 6 are diagrams illustrating an example of an output control operation by the output control unit 14 according to the present embodiment.

  FIG. 5 shows a case where the pleasant emotion changes to the unpleasant emotion. In FIG. 5, the output control unit 14 sets the start timing of the vibration pattern 301 immediately before the emotion change timing t0 (for example, 0.5 seconds before). Further, the output control unit 14 sets the duration of the vibration pattern 301 to a shorter one of a certain time (for example, 5 seconds) and the time until the next emotion change timing.

  The vibration intensity is controlled in the following two stages.

(First Stage of Vibration Intensity Control) The output control unit 14 adaptively controls the vibration intensity based on the emotion model coordinate information E (t). Specifically, the output control unit 14 calculates the control weight w (t) of the vibration intensity from [Equation 1]. The output control unit 14 weights the vibration pattern 301 with respect to the intensity during the duration with the control weight w (t).

However, E ^max is the largest E (t) in the duration of the vibration pattern 301.

  By controlling the vibration intensity based on the emotion model coordinate information E (t), it is possible to realize a vibration intensity corresponding to the degree of emotion change. For example, when angry after accumulating for a long time, the vibration intensity is slowly increased, and the maximum of emotion and the maximum of vibration intensity can be synchronized.

(Second stage of vibration intensity control) The output control unit 14 controls the vibration intensity using a predetermined window function 401. In the window function 401 when changing from pleasant emotion to unpleasant emotion, as illustrated in FIG. 5, the vibration intensity in the vibration start period is not adjusted, and the vibration intensity in the vibration end period is faded out. Therefore, the strength in the vibration end period becomes weaker than the vibration start period.

  FIG. 6 shows a case where an unpleasant emotion changes to a pleasant emotion. In FIG. 6, the method for setting the start timing and duration of the vibration pattern 302 is the same as that of the vibration pattern 301 in FIG. Further, the control of the vibration intensity is performed in two steps, as in the case of the vibration pattern 301 in FIG. The first stage of vibration intensity control is the same as in the case of the vibration pattern 301 in FIG.

  In the second stage of vibration intensity control, the output control unit 14 controls the vibration intensity using a predetermined window function 402. In the window function 402 when changing from an unpleasant emotion to a pleasant emotion, as illustrated in FIG. 6, the vibration intensity in the vibration start period is faded in, and the vibration intensity in the vibration end period is faded out. Therefore, the strength in the vibration start period and the vibration end period is weaker than the period between the vibration start period and the vibration end period.

  When there is a concern about battery consumption, such as when a mobile terminal is used as the emotion expression device 1, the frequency, duration, and intensity of vibration should be reduced at a certain rate according to the remaining battery level. It may be. For example, when the remaining battery level drops to 20% or less, the frequency of vibration can be reduced to 50%, the duration can be shortened to 70%, or the strength can be reduced to 80%. .

[Step S4: Output step]
The output unit 15 performs an output operation based on the emotion change expression data 102 in accordance with the control signal 103 from the output control unit 14. For example, when a vibration generating device is provided as the output unit 15, the vibration generating device generates vibration according to the vibration control shown in FIG. This generated vibration is provided to the viewer of the animation 100. At this time, the output control unit 14 outputs the playback control signal 104 of the animation 100 to the content playback device 2. The reproduction control signal 104 of the animation 100 is used to synchronize the timing of the vibration generation by the vibration generation device of the output unit 15 and the reproduction operation of the animation 100 by the content reproduction device 2. As a result, when the animation 100 is played back, vibrations that call human empathy for the change in the emotion are provided to the viewer of the animation 100 at the timing of the change in the emotion of the character. The viewer can recognize the change in the emotion of the character more impressively by the vibration.

  As mentioned above, although embodiment of this invention was explained in full detail with reference to drawings, the specific structure is not restricted to this embodiment, The design change etc. of the range which does not deviate from the summary of this invention are included.

  For example, the output unit 15 may include a sound generation device, an image generation device, and the like. When a sound generation device is provided as the output unit 15, sound effect sound patterns corresponding to emotional changes are prepared. For example, a dark trumpet sound pattern is prepared for a change from pleasant emotion to unpleasant emotion. On the other hand, a bright electronic sound pattern with a strong sound is prepared for a change from unpleasant emotion to pleasant emotion. Note that the sound intensity control method by the output control unit 14 is the same as the vibration intensity control method described above. However, the maximum volume of the sound effect is about half the volume of the animation 100.

  When an image generation device is provided as the output unit 15, image patterns of visual effect images corresponding to emotional changes are prepared. For example, an image pattern is prepared in which a broken heart (color is blue) 501 illustrated in FIG. 7A flashes at regular time intervals in response to a change from pleasant emotion to unpleasant emotion. On the other hand, an image pattern in which a heart (color is pink) 502 illustrated in FIG. 7B flashes at a constant time interval in response to a change from unpleasant emotion to pleasant emotion is prepared. The image intensity control method by the output control unit 14 is the same as the vibration intensity control method described above. However, the size or brightness of the image is controlled as the image intensity.

  Note that the emotion expression device 1 and the content reproduction device 2 shown in FIG. 1 may be independent devices or may be configured as one device. For example, the emotion expression device 1 and the content reproduction device 2 may be realized with one mobile terminal.

  Further, a computer program for realizing the emotion expression device 1 described above may be recorded on a computer-readable recording medium, and the program recorded on the recording medium may be read into a computer system and executed. Here, the “computer system” may include an OS and hardware such as peripheral devices.

  “Computer-readable recording medium” refers to a flexible disk, a magneto-optical disk, a ROM, a writable nonvolatile memory such as a flash memory, a portable medium such as a DVD (Digital Versatile Disk), and a built-in computer system. A storage device such as a hard disk.

Further, the “computer-readable recording medium” means a volatile memory (for example, DRAM (Dynamic DRAM) in a computer system that becomes a server or a client when a program is transmitted through a network such as the Internet or a communication line such as a telephone line. Random Access Memory)), etc., which hold programs for a certain period of time.
The program may be transmitted from a computer system storing the program in a storage device or the like to another computer system via a transmission medium or by a transmission wave in the transmission medium. Here, the “transmission medium” for transmitting the program refers to a medium having a function of transmitting information, such as a network (communication network) such as the Internet or a communication line (communication line) such as a telephone line.
The program may be for realizing a part of the functions described above. Furthermore, what can implement | achieve the function mentioned above in combination with the program already recorded on the computer system, and what is called a difference file (difference program) may be sufficient.

  Moreover, as a computer program for implement | achieving the emotion expression apparatus 1 mentioned above, program forms, such as a library, API (Application Programming Interface), a dedicated application, a Web application, are mentioned, for example. For example, HTML (HyperText Markup Language) 5 includes an API for controlling a vibrator and WebGL for character display, which can be used.

DESCRIPTION OF SYMBOLS 1 ... Emotion expression apparatus, 2 ... Content reproduction apparatus, 11 ... Emotion change information acquisition part, 12 ... Emotion change expression basic information storage part, 13 ... Emotion change expression data generation part, 14 ... Output control part, 15 ... Output part

Claims (9)

An emotion change information acquisition unit for acquiring emotion change information representing a change in emotion from content data;
An emotion change expression data generation unit for generating emotion change expression data corresponding to the emotion change indicated by the emotion change information;
An output control unit that controls an output operation based on the emotion change expression data based on a timing of a change in emotion indicated by the emotion change information when the content data is reproduced;
An output unit that performs an output operation based on the emotion change expression data according to the control of the output control unit ,
The output control unit controls the intensity of the output operation according to a change in emotion indicated by the emotion change information for a start period or an end period of the output operation,
The output control unit, when the change in emotion indicated by the emotion change information is from a pleasant emotion to an unpleasant emotion, the strength in the end period of the output operation is weaker than the start period of the output operation,
Emotion expression device characterized by that. An emotion change information acquisition unit for acquiring emotion change information representing a change in emotion from content data;
An emotion change expression data generation unit for generating emotion change expression data corresponding to the emotion change indicated by the emotion change information;
An output control unit that controls an output operation based on the emotion change expression data based on a timing of a change in emotion indicated by the emotion change information when the content data is reproduced;
An output unit that performs an output operation based on the emotion change expression data according to the control of the output control unit,
The output control unit controls the intensity of the output operation according to a change in emotion indicated by the emotion change information for a start period or an end period of the output operation,
When the change in emotion indicated by the emotion change information is from an unpleasant emotion to a pleasant emotion, the output control unit determines the strength in the start period and the end period of the output operation between the start period and the end period. Weaker than the period between,
Emotion expression device characterized by that. Emotion change expression basic information storage unit that stores emotion change expression basic information indicating emotion change expression that calls people's sympathy for changes in human emotion,
The emotion change expression data generation unit generates the emotion change expression data based on the emotion change expression basic information.
The emotion expression device according to any one of claims 1 and 2 . Wherein the output control section, at the start time or end time of the output operation, emotional expressions device according to any one of claims 1 to 3, characterized by changing the intensity of the output operation. The output control unit, emotional apparatus according to any one of claims 1 4, characterized in that to control the intensity of the output operation in accordance with the degree of change of the emotion represented by the emotion change information . Emotion expression method of emotion expression device,
An emotion change information acquisition step in which the emotion expression device acquires emotion change information representing a change in emotion from content data;
An emotion change expression data generation step in which the emotion expression device generates emotion change expression data corresponding to an emotion change indicated by the emotion change information;
An output control step for controlling an output operation based on the emotion change expression data based on the emotion change timing indicated by the emotion change information when the emotion expression device reproduces the content data;
The emotional expression device in accordance with the control of the output control step, see containing and an output step of performing the output operation based on the emotion change expression data,
The output control step controls the intensity of the output operation according to a change in emotion indicated by the emotion change information for a start period or an end period of the output operation,
In the output control step, when the emotion change indicated by the emotion change information is a pleasant emotion to an unpleasant emotion, the strength in the end period of the output operation is weaker than the start period of the output operation.
Emotion expression method characterized by that. Emotion expression method of emotion expression device,
An emotion change information acquisition step in which the emotion expression device acquires emotion change information representing a change in emotion from content data;
An emotion change expression data generation step in which the emotion expression device generates emotion change expression data corresponding to an emotion change indicated by the emotion change information;
An output control step for controlling an output operation based on the emotion change expression data based on the emotion change timing indicated by the emotion change information when the emotion expression device reproduces the content data;
The emotion expression device includes an output step of performing an output operation based on the emotion change expression data according to the control of the output control step,
The output control step controls the intensity of the output operation according to a change in emotion indicated by the emotion change information for a start period or an end period of the output operation,
In the output control step, when the emotion change indicated by the emotion change information is from an unpleasant emotion to a pleasant emotion, the strength of the output operation in the start period and the end period is set to the intensity of the start period and the end period. Weaker than the period between,
Emotion expression method characterized by that. On the computer,
An emotion change information acquisition step of acquiring emotion change information representing a change in emotion from content data;
An emotion change expression data generation step for generating emotion change expression data corresponding to the emotion change indicated by the emotion change information;
An output control step for controlling an output operation based on the emotion change expression data based on a timing of a change in emotion indicated by the emotion change information when the content data is reproduced;
Under the control of the output control step, a computer program for executing an output step of performing the output operation based on the emotion change expression data,
The output control step controls the intensity of the output operation according to a change in emotion indicated by the emotion change information for a start period or an end period of the output operation,
In the output control step, when the emotion change indicated by the emotion change information is a pleasant emotion to an unpleasant emotion, the strength in the end period of the output operation is weaker than the start period of the output operation.
Computer program. On the computer,
An emotion change information acquisition step of acquiring emotion change information representing a change in emotion from content data;
An emotion change expression data generation step for generating emotion change expression data corresponding to the emotion change indicated by the emotion change information;
An output control step for controlling an output operation based on the emotion change expression data based on a timing of a change in emotion indicated by the emotion change information when the content data is reproduced;
An output step of performing an output operation based on the emotion change expression data according to the control of the output control step, and a computer program for executing
The output control step controls the intensity of the output operation according to a change in emotion indicated by the emotion change information for a start period or an end period of the output operation,
In the output control step, when the emotion change indicated by the emotion change information is from an unpleasant emotion to a pleasant emotion, the strength of the output operation in the start period and the end period is set to the intensity of the start period and the end period. Weaker than the period between,
Computer program.

Images