JP5233159B2 - Group emotion recognition support system - Google Patents

Description

  The present invention relates to a system that supports integration of emotions possessed by a plurality of humans existing in a certain space and recognizes them as collective emotions.

  Conventionally, with regard to recognizing human emotions, it is based on “biological information that makes it possible to make a correct decision as the time is appropriate and used longer, and to make an accurate emotion determination according to the patient's condition. To provide an emotion recognition system. As a technology for the purpose, "the emotion recognition system 1 based on biometric information uses a sensor 31 that can be attached to and detached from the patient's body, and captures a biometric signal emitted from the patient's body." And an emotion recognition device 5 that captures a biological signal from the biological information collecting device 3 and performs a fuzzy function process to recognize the current emotion of the living organism and output the recognition result. Is proposed (Patent Document 1).

  In addition, “a mobile terminal with a mail creation function by voice emotion recognition, a mobile terminal system, and a mail creation by voice emotion recognition, which makes it possible to create a fun email or message containing pictographs or emoticons by user voice input. Provide a method. As a technology for the purpose of the above, “in a portable terminal, voice input means 8 for inputting voice uttered by a user, input voice conversion means 9 for converting user input voice into text, and emotion from user input voice” Is converted into a corresponding emotion keyword, and the text converted from the user input voice by the input voice conversion means 9 is converted into a corresponding pronunciation keyword, the converted pronunciation keyword and the emotion recognition means 3 On the basis of the emotion keyword converted by the above, the document registration list 5 is searched, and a conversion unit 4 such as a conversion unit 4 for converting into a corresponding symbol, emoticon, or pictogram is provided. Is proposed (Patent Document 2).

  Further, regarding the use of the result of recognizing emotion, “providing a presentation support device that enables the presenter to grasp his / her own presentation situation and cope with it. As a technique for the purpose of the above, “the speech of the presenter is given to the emotion recognition unit 12 to recognize the presenter's psychological state, and the reaction generation unit 13 generates display information of the reaction according to the recognition result. The announcement content generated by the announcement content generation unit 14 is displayed on the display unit 15. Is proposed (Patent Document 3).

JP 2006-130121 A (summary) JP 2006-277567 A (summary) JP 10-254484 A (summary)

  In a space where people gather, it may be useful to recognize the collective emotions of a group of these people. For example, this corresponds to recognizing the emotions of participants in a presentation or meeting.

However, the techniques described in Patent Document 1 and Patent Document 2 are techniques for recognizing individual emotions and do not handle collective emotions.
It may be possible to recognize the feelings of the group by implementing the emotion recognition technology for individuals individually for the members of the group and integrating the results, but it is necessary to perform emotion recognition processing for the number of people. Therefore, when this is performed by the system, a system load is applied, and when a human judges group feelings individually, the burden on the person is large.

  On the other hand, the technique described in Patent Document 3 relating to the use of human emotion recognition results in presentations such as presentations, the subject of emotion recognition is the presenter himself and does not recognize group emotions. . Therefore, there is no disclosure regarding using the recognition results of group emotions.

  From the above background, a system capable of supporting recognition of collective feelings of a group of a plurality of people has been desired.

A group emotion recognition support system according to the present invention is a system for recognizing the collective emotion of a group consisting of a plurality of people and supporting the progress of a presentation of a speaker who is presenting to the audience, An emotion information acquisition unit that acquires information representing the emotions of individuals belonging to a group, a group emotion analysis unit that integrates information acquired by the emotion information acquisition unit to analyze the collective emotion of the group, and the group emotion analysis Based on the analysis result of the part, classify the interests of the audience, generate and output the ratio data of the interests from the classification results, and distribute the attention degree distribution information from the degree of attention of the slide of the presentation An output data processing unit for generating and outputting the ratio data and the distribution data output from the output data processing unit to the speaker. Comprising an output unit that outputs presenting, wherein the output data processing unit, in the speaker of the presentation is continued, in which repeatedly executes the generation of the ratio data and the distribution information.

  According to the collective emotion recognition support system according to the present invention, collective emotions are analyzed by processing the emotions of individuals belonging to the collective, and the analysis results are output. Can help.

Embodiment 1 FIG.
FIG. 1 is a functional block diagram of group emotion recognition support system 100 according to Embodiment 1 of the present invention. Here, the following explanation is given on the assumption that the speaker is giving a presentation to the audience.
The group emotion recognition support system 100 analyzes the collective emotions of the audience and assists the speaker in recognizing it, and uses the analysis result to support the progress of the speaker's presentation.

The place of presentation is a one-to-many space consisting of speakers and audiences, and has the feature that information transmission is directed from one to many and the information transmission source is almost fixed.
Therefore, in the first embodiment, it is considered that the collective emotion is recognized by detecting the line of sight toward the speaker side by using the one-way information transmission.

  The group emotion recognition support system 100 includes an information acquisition unit 101, a group emotion analysis unit 102, an input unit 103, an output data processing unit 104, an output unit 105, a speaker display unit 105A, an audience display unit 105B, and a storage unit 106. Prepare.

The information acquisition unit 101 acquires evaluation data used for performing group emotion recognition. The evaluation data here is audience gaze information.
In other words, a gaze detection device is placed in the presentation venue, and the audience's gaze is tracked by irradiating infrared light from the gaze detection device to the audience's eyes and measuring the light reflected and returned. .

  The information acquisition unit 101 also acquires information related to the presentation. The information related to the presentation here refers to information such as (1) the content of the displayed presentation slide, (2) the presentation slide switching timing, and (3) the content of the speaker's presentation.

The line-of-sight information acquired by the information acquisition unit 101 and the information related to the presentation are output to the group emotion analysis unit 102 and the storage unit 106.
In addition, you may comprise so that an audience may input own emotion into the information acquisition part 101 via the input part 103 grade | etc.,. The same applies to the following embodiments.

The collective emotion analysis unit 102 analyzes the collective emotions of the audience at the presentation venue based on the line-of-sight information received from the information acquisition unit 101 and information related to the presentation. Here, group emotions are analyzed from the audience's visual dose, gaze point (gaze movement), and the like.
The analysis of group emotion can be performed, for example, as in (1) and (2) below.

(1) When there is a large proportion of the audience's line of sight directed at the speaker or the audience display unit 105B described later, it is determined that the presentation is interested by the audience.
On the other hand, when there is a large proportion of the line of sight that is directed to other than the speaker or the audience display unit 105B described below, among the line-of-sight information acquired by the information acquisition unit 101 (or the number of audiences at the presentation venue), the presentation Concludes that the audience is not interested or bored.

(2) From the information such as which part of the presentation slide the line of sight poured into the audience display unit 105B described later is concentrated on the slide or how the line of sight flows on the slide, The degree of comprehension (ease of viewing the slide, whether the line of sight is gathered at the part intended by the speaker), etc. can be determined.

  The analysis result of the group emotion analysis unit 102 is output to the output data processing unit 104 and the storage unit 106.

The input unit 103 receives input to the collective emotion recognition support system 100 from a speaker using an input device such as a keyboard.
The input here includes (1) a presentation slide switching instruction, and (2) a presentation support information display switching instruction processed through the group emotion analysis unit 102 and the output data processing unit 104. (2) will be described later.

The output data processing unit 104 generates information output by the output unit 105.
For example, necessary information is generated to perform processing such as switching slide display of the audience display unit 105B described later based on a presentation slide switching instruction from the input unit 103.
Further, when the analysis result of the collective emotion analysis unit 102 is displayed on the speaker display unit 105A described later, it is processed or selected into a necessary format.
Examples of processing or selection here include the following (1) and (2).

(1) Audience interests based on visual dose are classified into (a) directed to the audience display unit 105B, (b) directed to the speaker, (c) otherwise, and Generate percentage data.

(2) Of the interests mainly directed to the audience display unit 105B, which part of the presentation slide is attracting attention is collected as distribution information, and this is used as support information for the speaker. It is processed so as to be displayed on the display unit 105A.

The processing result of the output data processing unit 104 is output to the output unit 105 and the storage unit 106.
It should be noted that the content of processing or sorting can be changed by instructing from the input unit 103.

The output unit 105 outputs the group emotion recognition support system 100. In the first embodiment, it is subdivided into a speaker display unit 105A and an audience display unit 105B.
The speaker display unit 105A is an information output device realized by a screen display device such as a display, and presents information to the speaker. The presentation content is information generated and processed by the output data processing unit 104 for the speaker display unit 105A.
The audience display unit 105B is an information output device realized by a projector and a screen, for example, and presents information to the audience of the presentation. The presentation content is information generated and processed by the output data processing unit 104 for the audience display unit 105B.

The storage unit 106 stores information output by the information acquisition unit 101, the group information analysis unit 102, and the output data processing unit 104. Information stored in the storage unit 106 can be used for reflection and analysis of the presentation after the presentation is completed.
That is, the storage unit 106 stores the speaker's speech state, slide state, and audience's (as a group) reaction in the presentation in a synchronized manner. This makes it easy to analyze and compare which behavior during the presentation has drawn which behavior, impulse, and emotion of the audience.

The information acquisition unit 101 includes necessary interfaces according to the specifications of the line-of-sight detection device and the specifications of presentation software and the like.
The collective emotion analysis unit 102 and the output data processing unit 104 can be realized as hardware such as a circuit device that realizes these functions, or as software executed on a calculation device such as a CPU or a microcomputer. You can also.
The output unit 105, the speaker display unit 105A, and the audience display unit 105B include necessary interfaces, driver software, and the like according to these specifications.
The storage unit 106 can be configured by a writable storage device such as an HDD (Hard Disk Drive).
Furthermore, all or part of these functional units can be realized by a computer. Moreover, it is not necessary to integrate these functional units, and each unit may be configured separately.

  The “emotion information acquisition unit” in the first embodiment corresponds to the information acquisition unit 101.

FIG. 2 shows a state where the group emotion recognition support system 100 is used at the presentation venue.
The speaker speaks the content of the presentation slide while looking at the speaker display unit 105A on the podium. The audience is watching the content of the slide displayed on the audience display unit 105B. The audience may focus on a particular part of the slide or may focus on the speaker.

In FIG. 2, the speaker display unit 105A is configured as a display unit of a notebook computer. The audience display unit 105B includes a large projector and a screen.
The input unit 103 and the storage unit 106 include an input device such as a keyboard of the computer 200 and an HDD. The group emotion analysis unit 102 and the output data processing unit 104 are configured as programs executed on the computer 200.
Presentation slide data is stored on the computer 200.
In the information acquisition unit 101, the function of detecting the audience's line of sight is configured as a line-of-sight detection device such as an infrared eye camera, and the detection information is output to the computer 200.
In addition, since the presentation slide is stored on the computer 200, the computer 200 acquires information on the presentation by itself.

  FIG. 3 is an operation flow of the collective emotion recognition support system 100. Hereinafter, each step will be described.

(S301)
For the initial state before the presentation starts, initial processing is executed as follows.
(1) The information acquisition unit 101 acquires audience gaze information and information related to the presentation. The acquired information is output to the collective emotion analysis unit 102.
(2) The group emotion analysis unit 102 analyzes the audience's group emotion based on the output from the information acquisition unit 101. The analysis result is output to the output data processing unit 104.
(3) The output data processing unit 104 generates and processes information for display by the speaker display unit 105A and the audience display unit 105B.
(4) The processing results of the information acquisition unit 101, group emotion analysis unit 102, and output data processing unit 104 are stored in the storage unit 106 as initial state data.

(S302)
The speaker starts a presentation (such as explaining the contents of a slide). At this time, the speaker inputs using the input unit 103 to start the slide, whereby the group emotion recognition support system 100 recognizes that the presentation has started.

(S303)
The processes in steps S304 to S308 are repeatedly executed while the presentation is continued. In addition, the collective emotion recognition support system 100 recognizes that the speaker has input to the input unit 103 to end the presentation.

(S304)
The speaker display unit 105 </ b> A and the audience display unit 105 </ b> B perform respective displays based on the output from the output data processing unit 104.
(S305)
The information acquisition unit 101 acquires audience gaze information and presentation information. The acquired information is output to the collective emotion analysis unit 102 and the storage unit 106.

(S306)
The group emotion analysis unit 102 analyzes the audience's collective psychological state based on the audience's line-of-sight information received from the information acquisition unit 101.
Here, the degree of interest in the presentation (the ratio of how much the line of sight has been poured into the speaker and the presentation material to be displayed) and the part of the slide where the line of sight is concentrated are analyzed.
The analysis result is output to the output data processing unit 104 and the storage unit 106.

(S307)
Based on the instruction input from the input unit 103, the output data processing unit 104 generates and processes information for display by the speaker display unit 105A and the audience display unit 105B.
(S308)
The storage unit 106 stores the information output by the information acquisition unit 101, the collective emotion analysis unit 102, and the output data processing unit 104 in synchronization with each other.
As a method of synchronization, any method may be used as appropriate, for example, holding the association in the relationship table format or storing them in the same folder. The same applies to the following embodiments.

In the first embodiment, assuming a presentation scene, the information acquisition unit 101, group emotion analysis unit 102, input unit 103, output data processing unit 104, speaker display unit 105A, and audience display unit 105B are configured. And explained the operation.
These functional units may take appropriate configurations and operations as appropriate when the use scene of the collective emotion recognition support system 100 is different.

As described above, according to the first embodiment, the emotions of a plurality of audiences present at the presentation venue can be handled in an integrated manner and recognized as a collective emotion.
Moreover, by presenting the group emotion obtained as a result of the analysis to the speaker immediately by the speaker display unit 105A, the speaker can quickly grasp the audience's reaction to the presentation, and refer to the audience's reaction status. The development of the presentation can be adjusted immediately, such as changing the utterance content of the presentation so that it is easier to understand and attract attention.

  For example, if the audience does not attract attention to the part intended by the speaker, a word to call attention can be added before the explanation. Also, if the audience is bored or distracted due to fatigue, try changing the tempo of the presentation or changing the order of content that is easy to draw attention (such as videos). Can take.

  In addition, since information related to presentations and analysis results of group sentiment are stored in the storage unit 106, the stored data is used not only during the presentation but also for reflection and analysis of the presentation after the presentation. can do.

  Since various data (presentation contents, slide switching timing, group emotion analysis results, etc.) are stored in synchronization in the storage unit 106, their mutual relationship, for example, the audience's line of sight moves along the slide contents. It is easy to grasp whether or not the presentation is being performed, and the reflection and analysis of the presentation can be performed with a small burden.

  Furthermore, by analyzing what the action that triggered the audience reaction was, the next presentation could incorporate that trigger and induce a similar audience response.

Embodiment 2. FIG.
In the first embodiment, a presentation venue having a one-to-many configuration of speakers vs. audience is assumed, and group emotion is recognized based on audience gaze information.
In the second embodiment of the present invention, unlike the first embodiment in which information transmission is unidirectional, a situation in which the information transmission source changes in a fluid manner is handled. In this case, since it is difficult to analyze group emotions only by integrating line-of-sight information due to the characteristics of the situation, a plurality of other information is acquired and integrated to recognize group emotions.
In this section, a system for performing group emotion recognition with respect to a conference participant assuming a conference scene and using the result to support conference management will be described.

FIG. 4 is a functional block diagram of group emotion recognition support system 400 according to Embodiment 2 of the present invention.
The group emotion recognition support system 400 includes an information acquisition unit 401, a group emotion analysis unit 102, an input unit 103, an output processing unit 402, an output unit 403, a display unit 403A, an operation unit 403B, and a storage unit 106.
In addition, about the function part similar to or corresponding to FIG. 1, the same code | symbol is attached | subjected and description is abbreviate | omitted thru | or supplementary description.

  The information acquisition unit 401 acquires information about the conference and evaluation data for performing group emotion recognition. The information acquisition unit 401 is subdivided into an anti-site sensor 401A and an anti-participant sensor 401B.

  The on-site sensor 401A acquires information on the physical environment in the conference room such as temperature and humidity measured by a thermometer installed in the conference room, for example. By acquiring these changes, it is possible to obtain an index such as the degree of discomfort in the conference room and the incandescence of the discussion.

  The anti-participant sensor 401B acquires information such as the following (1) to (3).

(1) Biological information of the conference participant For example, the conference participant is allowed to wear a sensor for measuring body temperature, heart rate, sweating, an electroencephalogram measurement device, etc., and the emotion of the conference participant from the acquired information・ Analyze the state.

(2) Information on Conference Participant's Speech / Speech / Volume For example, a personal microphone is installed in front of each conference participant to acquire voice data. To detect stagnation of the meeting from the increase in the percentage of no-speaking time and use it as a guideline to put a break, or to detect the active part of the meeting from the distribution of speaking places and to talk to people with few utterances It can be used as a guideline.

(3) Information related to the posture status of the conference participants Attaching a pressure sensor to the chair back in the conference room, etc., detects the posture status of the conference participants (the amount of leaning on the chair), and participates in the conference based on the change. Analyzing the person's emotions and conditions.
For example, if there are a large number of participants such as (a) leaning on the back, (b) often sitting back, (c) putting their hands on the armrests and not moving for a while, fatigue, boredom, no interest in the meeting room It can be judged that feelings such as are dominant.
In addition, it is possible to install a vibration sensor on the floor and use the stepping action of the conference participants as an indicator of group emotion.

  Information acquired by the information acquisition unit 401 is output to the group emotion analysis unit 102 and the storage unit 106.

  The operation of the collective emotion analysis unit 102 is the same as that of the first embodiment. However, since the information acquisition unit 401 acquires a plurality of types of information, unlike the first embodiment, the acquired information is integrated to analyze the collective emotion. Perform the process.

  The operation of the input unit 103 is the same as that in the first embodiment. A person who can operate the input unit 103 can be arbitrarily set, such as narrowing down to all the conference participants or a specific person such as a chairperson.

The output processing unit 402 generates information output by the output unit 403.
For example, based on the analysis result of the collective emotion analysis unit 102, information necessary for switching the screen display of the display unit 403A described later is processed. Also, information necessary for giving an instruction to the operation unit 403B is processed.

  The processing of information necessary for switching the screen display of the display unit 403A is, for example, that when the group emotion analysis unit 102 determines that the conference is stagnant, the chairperson should propose a break. Output only to the information presentation device.

The instruction to the operation unit 403B is, for example, that when the group emotion analysis unit 102 determines that the frustration of the conference participant is rising, the head is cooled down by lowering the room temperature.
Details of the operation unit 403B will be described later.

  The output unit 403 is subdivided into a display unit 403A and an operation unit 403B.

The display unit 403A displays materials used by the conference participants or information processed by the output processing unit 402.
The display unit 403A can be configured by, for example, a computer display assigned to each conference participant, or an information presentation device including a screen and a projector installed in the conference room.

The operation unit 403B is a functional unit that controls the operation of the air conditioning equipment in the conference room, for example, and adjusts the temperature in the conference room based on an instruction from the output processing unit 402. Moreover, it may replace with operation | movement control of an air conditioner, and you may comprise so that operation | movement, such as putting music in a meeting room, spraying the fragrance which has a relaxation effect | action in a meeting room, and changing illumination, may be performed.
That is, the operation unit 403B has a function of executing an action of changing the physical environment in the conference room based on an instruction from the output processing unit 402.

  The content stored in the storage unit 106 is the same as that in the first embodiment, but the stored content can also be used as a meeting minutes.

  The output processing unit 402 can be realized as hardware such as a circuit device that realizes the function, or can be realized as software executed on an arithmetic device such as a CPU or a microcomputer.

The “emotion information acquisition unit” in the second embodiment corresponds to the information acquisition unit 401 and the participant sensor 401B.
The “sensor unit” corresponds to the information acquisition unit 401 and the anti-site sensor 401A.

FIG. 5 shows a state in which the group emotion recognition support system 400 is used in the conference room.
The anti-participant sensor 401B is attached to each conference participant, and acquires biometric information, speech voice data, posture information, and the like of each individual.
The input unit 103 and the storage unit 106 are configured by an input device such as a keyboard of the computer 500 and an HDD. The group emotion analysis unit 102 and the output processing unit 402 are configured as programs executed on the computer 500.

  FIG. 6 is an operation flow of the collective emotion recognition support system 400. Hereinafter, each step will be described.

(S601)
For the initial state before the start of the conference, the initial process is executed as follows.
(1) The information acquisition unit 401 acquires information on the above-described conference and evaluation data for performing group emotion recognition. The acquired information is output to the collective emotion analysis unit 102.
(2) The group emotion analysis unit 102 analyzes the group emotions of the conference participants based on the output from the information acquisition unit 401. The analysis result is output to the output processing unit 402.
(3) The display unit 403A displays the materials used by the conference participants and the information processed by the output processing unit 402.
(4) The processing results of the information acquisition unit 401, the collective emotion analysis unit 102, and the output processing unit 402 are stored in the storage unit 106 as initial state data.

(S602)
When the conference is started, for example, the chairman inputs the information from the input unit 103, and the collective emotion recognition support system 400 recognizes that the conference is started.
(S603)
The processes in steps S604 to S608 are repeatedly executed while the conference is continued. In addition, the collective emotion recognition support system 400 recognizes that the end of the conference is input to the input unit 103 by the chairperson.

(S604)
The output processing unit 402 updates the output content based on the analysis result of the collective emotion analysis unit 102. The display unit 403 </ b> A and the operation unit 403 </ b> B perform respective operations based on the output from the output processing unit 402.
(S605)
The information acquisition unit 401 acquires information on the above-described conference and evaluation data for performing group emotion recognition. Information acquired by the information acquisition unit 401 is output to the group emotion analysis unit 102 and the storage unit 106.

(S606)
The group emotion analysis unit 102 analyzes the group psychological state of the conference participant based on the information received from the information acquisition unit 401.
The analysis result is output to the output processing unit 402 and the storage unit 106.

(S607)
Based on the instruction input from the input unit 103 and the analysis result of the collective emotion analysis unit 102, the output processing unit 402 generates information for the display unit 403A and the operation unit 403B to perform the respective operations.
(S608)
The storage unit 106 stores information output by the information acquisition unit 401, the collective emotion analysis unit 102, and the output processing unit 402 in synchronization with each other.

In the second embodiment, the configuration and operation of the information acquisition unit 401, the collective emotion analysis unit 102, the input unit 103, the output processing unit 402, the display unit 403A, and the operation unit 403B have been described assuming a meeting scene.
These functional units may take appropriate configurations and operations as appropriate when the use scene of the collective emotion recognition support system 400 is different.

As described above, according to the second embodiment, a plurality of sensors are arranged in a conference room and measurement data obtained therefrom are integrated in a case where the information transmission source is fluidly changed as in a conference. By analyzing, it is possible to recognize the collective feelings of the conference participants.
In addition, by adjusting the air conditioning in the conference room based on the recognition results of group emotions, the conference room environment is appropriately changed by implementing actions on the physical environment in the conference room to support efficient conference management. can do.

Embodiment 3 FIG.
In the second embodiment, the conference participants are treated as a group, and based on the recognition result of the group emotion, for example, the physical action that exerts an effect on the entire group is performed such as adjusting the air conditioning of the conference room.
In the third embodiment of the present invention, a configuration example will be described in which an operation that has an effect on the entire group and an operation tailored to the individuals making up the group are implemented.
Here, as in the case of Embodiment 2, assuming a meeting scene, when it is determined that a break should be sandwiched by recognition of group participants' emotions, herbal tea that matches the individual preferences of the participants is supplied. An example will be described.

FIG. 7 is a functional block diagram of group emotion recognition support system 700 according to Embodiment 3 of the present invention.
The group emotion recognition support system 700 includes an information acquisition unit 401, a group emotion analysis unit 701, an input unit 103, a database 702, an output processing unit 703, an output unit 704, a display unit 704A, an operation unit 704B, and a storage unit 106.
In addition, about the function part which is the same as that of FIG. 4 of Embodiment 2, or respond | corresponds, the same code | symbol is attached | subjected and description is abbreviate | omitted thru | or supplementary description.

  The function of the information acquisition unit 401 is the same as that of the second embodiment. Information acquired by the information acquisition unit 401 is output to the collective emotion analysis unit 701, the storage unit 106, and the database 702.

As in the second embodiment, the collective emotion analysis unit 701 performs collective emotion recognition by handling the information acquired by the information acquisition unit 401 in an integrated manner. In addition to this, the participants will also recognize the emotions of individual participants. Any known technique is used as a method of personal emotion recognition.
The analysis result is output to the output processing unit 703 and the storage unit 106. Further, the emotion recognition result of the individual conference participant is also output to the database 702. Details will be described later.

The database 702 holds data regarding the characteristics of individual conference participants.
The data relating to the characteristics of the individual conference participants here are, for example, the following data (1) and (2).

(1) Preferences related to herbal teas The preferences regarding herbal teas of individual conference participants are entered into the database 702 through interviews and questionnaires conducted in advance for the conference participants, or by the conference participants themselves entering the input unit 103. Store it.

(2) Emotion change tendency during meeting Based on the output from the information acquisition unit 401 and the result of individual emotion analysis by the group emotion analysis unit 701, the tendency of emotion change during the meeting is stored in the database 702 for each individual conference participant. Keep it.

  Information held in the database 702 is used when an operation unit 704B described later executes an operation on a conference participant.

  The database 702 can be configured by storing necessary data files in a writable storage device such as an HDD.

  The output processing unit 402 generates information to be output by the output unit 704. For example, the following information (1) (2) is generated. These pieces of information can be changed by inputting instructions from the input unit 103.

(1) Based on the analysis result of the collective emotion analysis unit 701, the display unit 704A is instructed to display an instruction relating to herbal tea arrangement. Details will be described later.
(2) Based on the analysis results of the collective emotion analysis unit 701, the preferences regarding the herbal tea of the conference participants are read from the database 702, and the herbal tea is formulated and created according to the preferences of the conference participants. The operation unit 704B is instructed. Details will be described later.

  The output unit 704 is subdivided into a display unit 704A and an operation unit 704B.

  The display unit 704A performs the following operation in addition to the operation of displaying the conference material and the like described in the second embodiment based on the instruction from the output processing unit 402.

(1) Display instructions for timing of bringing herbal tea into the conference room.
(2) Display individual instructions for herbal teas formulated for each individual participant.

  These displays may be displayed only on a display at hand of the chairman, for example, or may be displayed to an operating staff waiting outside the conference room.

Based on the instruction of the output processing unit 402, the operation unit 704B performs herbal tea blending and creation in addition to the control operation of the air conditioning equipment in the conference room described in the second embodiment.
The operation unit 704B is linked to, for example, an electronically controllable tea server, and receives an instruction from the output processing unit 402 to mix and create herbal tea according to the personal preference of the conference participant. Give instructions to the tea server.
Herbal tea is arranged by the management staff separately according to the display on the display unit 704A.

  FIG. 8 is an operation flow of the collective emotion recognition support system 700. Hereinafter, each step will be described.

(S801)
For the initial state before the start of the conference, the initial process is executed as follows.
(1) The information acquisition unit 401 acquires information on the above-described conference and evaluation data for performing group emotion recognition. The acquired information is output to the collective emotion analysis unit 701 and the database 702.
(2) The group emotion analysis unit 701 analyzes a group participant's group emotion based on the output from the information acquisition unit 401. The analysis result is output to the output processing unit 703.
In addition, the collective emotion analysis unit 701 recognizes the emotions of individual conference participants based on the output from the information acquisition unit 401. The recognition result is stored in the database 702 as initial state data.
(3) The display unit 704A displays the materials used by the conference participants and the information processed by the output processing unit 703.
(4) The processing results of the information acquisition unit 401, group emotion analysis unit 701, and output processing unit 703 are stored in the storage unit 106 as initial state data.

(S802) to (S803)
This is the same as steps S602 to S603 in FIG.
(S804)
The output processing unit 703 updates the output content based on the analysis result of the group emotion analysis unit 701. The display unit 704A and the operation unit 704B perform respective operations based on the output from the output processing unit 703.

(S805)
The information acquisition unit 401 acquires information on the above-described conference and evaluation data for performing group emotion recognition. Information acquired by the information acquisition unit 401 is output to the group emotion analysis unit 701 and the database 702.

(S806)
The group emotion analysis unit 701 analyzes a group participant's group psychological state based on the information received from the information acquisition unit 401. In addition, we will recognize the emotions of individual participants.
The analysis result is output to the output processing unit 703, the storage unit 106, and the database 702.
(S807)
The database 702 receives the result of emotion recognition of individual conference participants from the collective emotion analysis unit 701 and receives the information acquired by the information acquisition unit 401 and stores it.

(S808)
Based on the instruction input from the input unit 103, the analysis result of the collective emotion analysis unit 701, and the data held in the database 702, the output processing unit 703 is used for the display unit 704A and the operation unit 704B to perform respective operations. Generate information.
(S809)
The storage unit 106 stores the information output by the information acquisition unit 401, the collective emotion analysis unit 701, and the output processing unit 703 in synchronization with each other.

  In the third embodiment, it has been described that in the meeting scene, herbal tea is supplied according to the individual preferences of the meeting participants and the meeting operation is supported, but the use situation of the collective emotion recognition support system 700 is different. In addition to those described in the third embodiment, appropriate configurations and operations may be taken as appropriate.

  The operation unit 704B mixes and creates herbal tea according to the preferences of the conference participants. However, the operation unit 704B is not limited to this. For example, the action unit 704B emits a scent or changes lighting. You may comprise as what implements.

  In the third embodiment, an example in which personal characteristics are stored in the database 702 and used is described. However, group characteristics may be stored in the database 702 and used.

As described above, according to the third embodiment, not only the conference participants are handled as a group, but also based on the database 702 storing the individual preferences of the conference participants and the results of the emotion recognition of the individual conference participants, An output tailored to the individual of the conference participant can be performed (in the third embodiment, herbal tea is used as an example).
That is, it is possible to perform output for the entire group based on recognition of group emotions and to perform output optimized for each individual regarding individual outputs.

Embodiment 4 FIG.
In the above first to third embodiments, the configuration examples for supporting the presentation and conference management based on the recognition result of the collective emotion have been described.
As another use example of group emotion recognition, for example, use in a learning environment (a school or a cram school) can be considered.

For example, students 'feelings about classes are treated as group feelings, and the students' feelings about the contents of the classes (the contents were understood, difficult to understand, etc.) are recognized, and teachers are promoted based on this. It is possible.
Further, in addition to the operations for the student group, a usage example is also conceivable in which a student's learning progress is stored in a database, and a task tailored to the student is automatically generated.

  In Embodiments 1 to 4 described above, group emotion recognition in a certain space has been described, but group emotion recognition may be performed for a plurality of spaces.

1 is a functional block diagram of a group emotion recognition support system 100 according to Embodiment 1. FIG. 2 shows a state where the group emotion recognition support system 100 is used at a presentation venue. It is an operation | movement flow of the group emotion recognition assistance system 100. FIG. It is a functional block diagram of the group emotion recognition support system 400 which concerns on Embodiment 2. FIG. This shows how the group emotion recognition support system 400 is used in a conference room. It is an operation | movement flow of the group emotion recognition assistance system 400. FIG. FIG. 10 is a functional block diagram of a collective emotion recognition support system 700 according to Embodiment 3. It is an operation | movement flow of the group emotion recognition support system 700. FIG.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 100 Group emotion recognition support system, 101 Information acquisition part, 102 Group emotion analysis part, 103 Input part, 104 Output data processing part, 105 Output part, 105A Speaker display part, 105B Audience display part, 106 Storage part, 400 Group emotion recognition support system, 401 information acquisition unit, 402 output processing unit, 403 output unit, 403A display unit, 403B operation unit, 700 group emotion recognition support system, 701 group emotion analysis unit, 702 database, 703 output processing unit, 704 Output unit, 704A display unit, 704B operation unit.

Claims (9)

A system for recognizing the collective feelings of a group of multiple audiences and supporting the progress of a speaker presenting to the audience,
An emotion information acquisition unit for acquiring information representing the emotions of individuals belonging to the group;
A collective emotion analysis unit that integrates information acquired by the emotion information acquisition unit and analyzes the collective emotion of the group;
Based on the analysis result of the group sentiment analysis unit,
Classifying the audience's interests, generating and outputting the percentage data of the interests from the classification results,
An output data processing unit that generates and outputs distribution information of the degree of attention from the degree of attention of the slide of the presentation;
An output unit for outputting the ratio data and the distribution information output from the output data processing unit to the speaker;
With
The output data processing unit
A group emotion recognition support system characterized by repeatedly generating the ratio data and the distribution information while the speaker's presentation continues. A sensor unit that acquires information on a physical environment of a space in which the group exists;
The group sentiment analysis unit
The emotion information acquisition unit acquires information, population emotion recognition support system according to claim 1, wherein the sensor unit is based on the obtained information, characterized by analyzing the collective feelings of the population. Population feelings of claim 1 or claim 2 characterized by comprising an operation unit that performs a physical action to vary the physical environment of space where the population based on the output of the output portion is present Recognition support system. The group sentiment analysis unit
Analyzing the collective emotions and analyzing changes in the emotions of individuals belonging to the group,
The output unit is
The group emotion recognition support system according to any one of claims 1 to 3 , wherein the group emotion analysis unit outputs an analysis result of an individual emotion change. A storage unit that stores the analysis results of the group emotion analysis unit in chronological order,
The storage unit
Analysis results of the population emotion analysis section, information in which the emotion information acquisition unit acquires, and wherein the output content of the output unit, in any one of claims 1 to 4, characterized in that storing in synchronism Group emotion recognition support system. A database for holding information on characteristics of individuals belonging to the group;
The output unit is
The group emotion recognition support system according to any one of claims 1 to 5 , wherein information stored in the database is output together with an analysis result of the group emotion analysis unit. A database for holding information on characteristics of individuals belonging to the group;
The operating unit is
The group emotion recognition support system according to claim 3 , wherein the physical action corresponding to the characteristics of individuals belonging to the group is executed based on information stored in the database. The group emotion recognition support system according to any one of claims 1 to 7 , wherein the emotion information acquisition unit is a sensor that acquires biological information of individuals belonging to the group. The group emotion recognition support system according to any one of claims 1 to 8 , further comprising a display unit configured to display an output of the output unit on a screen.

Images