JP2016162339A - Program, terminal, and system for estimating activation of debate for each group - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a program, terminal, and system capable of estimating activation of a debate for each group and clearly indicating the situation to a coordinator.SOLUTION: The program causes a computer to function to estimate activation of a debate for each group. The program causes the computer to function as: speech storage means that stores speech times and speech time lengths issued by respective members; group speech classification means that classifies the speech times and speech time lengths of the respective members in time series for each group; speech density contribution ratio calculation means that calculates a speech density contribution ratio representing a ratio of the speech time length of each member to the speech time length of all members for each group; and group graph generation means that generates a graph drawing the speech density contribution ratios of the respective members for each group, where the graph is clearly presented to a user.SELECTED DRAWING: Figure 3

Description

  The present invention relates to a technique for analyzing speech (voice data) by a large number of users.

  Conventionally, in order to estimate the activity of group discussion, there is a technique of analyzing the time transition of utterance interaction and analyzing the degree of participation of each member in conversation (for example, see Non-Patent Document 1).

  There is also a technique for recognizing the degree of excitement for each conference hall for a remote conference between a plurality of conference halls (see, for example, Patent Document 1). According to this technology, it is possible to acquire information on a participant's speech operation at each conference hall and share the degree of excitement among sites.

  In addition, there is a technique for determining an average brain activity level of a large number of people based on uttered speech and evaluating the activity level of work in a team composed of the large number of people (see, for example, Patent Document 2).

  Further, there is a technique for calculating the participation attitude value of each participant with respect to the conference (see, for example, Patent Document 3). According to this technology, the participation attitude value is obtained based on the participant parameters related to the number of utterances, the utterance time and / or energy, and the weighting coefficient of each participant parameter, by acquiring the volume and acceleration of the participant's voice. Is done.

  Further, there is a conference system technology that creates a drawing event from posture information of a mobile terminal and user operation information (see, for example, Patent Document 4). According to this technique, it is possible to grasp the content of the conference at a low cost based on the drawing event and the conference material.

JP 2006-302047 A JP 2007-267965 A JP 2012-113442 A JP 2014-103451 A

Yuri Moriya, Takaaki Tanaka, Toshimitsu Miyajima, Shinya Fujita, “A Study on Estimating Conversation Activity Based on Voice Information during Voice Chat”, Journal of Human Interface Society Vol.14, No.3, pp.57-66 , 2012, [online], [Search on February 11, 2015], Internet <URL: http://reality.ei.tuat.ac.jp/papers/HI14-3.pdf> Yuki Hayashi, Hiroshi Ogawa, Yukiko Nakano, “Visualization of learning attitudes based on non-linguistic information in collaborative learning”, IPSJ Transactions, Vol.55 No.1, pp.189-198, 2014, [online], [Heisei Search on February 11, 2015], Internet <URL: http://ci.nii.ac.jp/naid/110009660247> Mayumi Bono, Noriko Suzuki, Tomohiro Katagiri, “Participation Structure Analysis in Multi-person Conversation: Extracting Interests from Interaction Behavior”, Cognitive Science Vol. 11 No. 3 pp. 214-227, 2004, [online], [Heisei Search on February 11, 2015], Internet <URL: https://www.jstage.jst.go.jp/article/jcss/11/3/11_3_214/_article/-char/ja/>

  Participants are expected to discover learning effects and ideas through discussions about group learning in classrooms and other group discussions in company training. However, according to the above-described prior art, the individual speech activity level within one group is merely estimated according to the number of utterances and the degree of concentration. On the other hand, a facilitator who teaches the entire group can act to increase its activity if it can recognize a group in which no active interaction has occurred.

  On the other hand, can the inventors of the present application effectively transmit the active state of each group to the progressors who simultaneously teach a plurality of groups? I thought. In other words, is it possible to support group discussion by visually indicating the results of estimating the activity of group discussion to the progressors (administrators) and users as appropriate? I thought.

  Therefore, an object of the present invention is to provide a program, a terminal, and a system that can estimate the activation of discussion for each group and clearly indicate the situation to a progressor.

According to the present invention, there is provided a program for causing a computer to function to estimate the activation of discussion for each group,
Utterance storage means for storing the utterance time and utterance time length of each member uttered;
Group utterance classifying means for classifying each member's utterance time and utterance time length in time series for each group;
For each group, an utterance density contribution rate calculating means for calculating an utterance density contribution rate representing the utterance time length of each member with respect to the overall utterance time length;
For each group, the computer functions as group graph generation means for generating a graph in which the utterance density contribution rate of each member is drawn, and the graph is clearly shown to the user.

According to another embodiment of the program of the present invention,
Causing the computer to function as a group utterance activity calculating means for calculating a group utterance activity representing the ratio of the utterance time length of the group to the average value of the utterance time length of all the groups;
The group graph generation means preferably causes the computer to function to generate a graph in which the group speech activity of each group is further drawn.

According to another embodiment of the program of the present invention,
The group graph generation means preferably causes the computer to function so as to simultaneously generate a radar chart or bar graph having each member as an element for each group in a plurality of groups.

According to another embodiment of the program of the present invention,
For each group, for each member, the overlap time length of the utterance time of the member and the utterance time of the other member is detected, and an overlap ratio representing the overlap time length with respect to the utterance time length of the member is calculated. Let the computer further function as a rate calculation means,
The group graph generation means preferably causes the computer to function to generate a graph in which the overlap rate of each member is further drawn for each group.

According to another embodiment of the program of the present invention,
The group graph generation means generates a graph visually highlighting members whose utterance density contribution rate belongs to the first predetermined condition range and whose overlap rate belongs to the second predetermined condition range for each group. It is also preferable to make the computer function like this.

According to another embodiment of the program of the present invention,
A support message representing the member characteristic is associated with each predetermined range of the utterance density contribution rate and / or every predetermined range of the overlap rate and stored in advance, and the utterance density contribution rate of the graph It is also preferable to further function the computer as a support message selection means for selecting a support message according to the overlap rate, and to further indicate the selected support message to the user.

According to the present invention, there is provided a terminal for causing the above-described program to function by a computer,
Further comprising speech utterance acquisition means for storing the utterance time and utterance time length of the member detected from the utterance voice of the member collected by the microphone in the utterance storage means;
The graph generated by the group graph generating means is specified on the display in real time.

According to the present invention, a plurality of terminals that allow a computer to function the above-described program are connected to each other via a network,
The terminal immediately transmits the utterance time and utterance time length detected from the utterance voice of the member collected by the microphone to the other terminal,
All the terminals share the information stored in the utterance storage unit immediately, and the graph generated by the group graph generation unit is displayed on the display in real time.

According to the present invention, a server that causes the above-described program to function by a computer;
A system having a terminal that immediately transmits to the server the utterance time and the utterance time length detected from the utterance voice of the member picked up by the microphone,
The server is characterized in that the graph generated by the group graph generating means is transmitted in real time to a terminal designated in advance for the group manager.

  According to the program, terminal, and system of the present invention, activation of discussion for each group can be estimated, and the situation can be clearly shown to the progressor.

It is a 1st system block diagram in this invention. It is a 2nd system block diagram in this invention. It is a function block diagram of the terminal in this invention. It is explanatory drawing showing the example of the utterance density and overlap rate in a group and a member. It is a graph showing group activation in this invention. It is a graph showing the group speech activity according to time passage.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

  FIG. 1 is a first system configuration diagram according to the present invention.

  According to FIG. 1, a large number of members are classified into a plurality of groups. Each user who becomes a member possesses a terminal such as a smartphone or a wearable device. Each terminal can communicate with a management terminal (another user terminal) of a progressor or a management apparatus on the Internet via, for example, a wireless LAN. Each terminal is equipped with a microphone, collects the utterance voice of each member, and immediately transmits the utterance time and the utterance time length detected from the utterance voice to the management terminal or the management apparatus. The management device or the management terminal estimates activation of discussion for each group and clearly indicates the situation to the user (progressor).

  Of course, the terminals may mutually transmit and receive the utterance time and the utterance time length. In this case, each terminal is installed with an application executed on the management terminal or the management apparatus. Each terminal can also estimate the activation of discussion for each group and make the situation clear to the members.

  FIG. 2 is a second system configuration diagram according to the present invention.

  According to FIG. 2, for each group, a member's speech is always collected by a microphone. The utterance voice data is immediately transmitted to the management apparatus 1. The management device 1 classifies the uttered voice collected by each microphone by speaker recognition (voice recognition) for each member. In this case, it is necessary to register each member's voiceprint in advance. And the management apparatus 1 acquires the utterance time and utterance time length detected from the utterance voice of each member. Of course, the microphone may be a pin microphone that is attached to each member instead of the collective microphone, and may collect only the utterance voice unique to the member and transmit the utterance voice to the management apparatus 1.

  FIG. 3 is a functional configuration diagram of the terminal in the present invention.

  According to FIG. 3, the terminal 1 estimates activation of discussion for each group, and clearly indicates the situation to the user (progressor). The terminal 1 includes an utterance voice acquisition unit 10, an utterance storage unit 11, a group utterance classification unit 12, an utterance density contribution rate calculation unit 13, a group utterance activity level calculation unit 14, an overlap rate calculation unit 15, A group graph generation unit 16 and a support message selection unit 17 are included. These functional components can be realized by executing a program that causes a computer installed in the terminal to function.

[Speech voice acquisition unit 10]
The utterance voice acquisition unit 10 causes the utterance storage unit 11 to store the utterance time and utterance time length of the member detected from the utterance voice of the member collected by the microphone. The utterance time length may be measured in units of 3 seconds, for example. The utterance time length is divided every time a silent section of 3 seconds or longer is detected.

[Speech storage unit 11]
The utterance storage unit 11 stores the utterance time and the utterance time length when each member utters. The utterance time and the utterance time length are extracted from each member's utterance voice, not the voice data itself.

[Group utterance classification unit 12]
The group utterance classification unit 12 uses the utterance storage unit 11 to classify the utterance time and utterance time length of each member in time series for each group.

  FIG. 4 is an explanatory diagram showing an example of speech density and overlap rate in groups and members.

  According to FIG. 4, it is assumed that four groups of five members are discussing simultaneously in parallel. Of course, the number of members constituting each group may be different for each group. FIG. 4 shows the duration of the utterance in units of 3 seconds for a discussion time of 1800 seconds (30 minutes), for example.

[Speech density contribution rate calculation unit 13]
The utterance density contribution rate calculation unit 13 calculates, for each group, an “utterance density contribution rate” that represents the ratio of the utterance time length of the member to the utterance time length of all members. For example, according to FIG.
Speech density contribution rate U _{A1 of} member _A1
= Total utterance time length of member A1 (U _A1 ) / Total utterance time length (Σ _{A = A1 to A5} U _A )
= 600/1370
= 0.438
Speech density contribution rate U _{A2 of} member A2 = 90/1370 = 0.066
Speech density contribution rate of member A3 U _A3 = 500/1370 = 0.365
Speech density contribution rate U _{A4 of} member A4 = 120/1370 = 0.088
Speech density contribution rate U _{A5 of} member A5 = 60/1370 = 0.044

[Group utterance activity calculation unit 14]
The group utterance activity level calculation unit 14 calculates “group utterance activity level” representing the ratio of the utterance time length of the group to the average value of the utterance lengths of all groups. For example, according to FIG.
Group A speech activity UG _A
= Average Group A total speech duration / total group speech time length _{= (Σ A = A1~A5 U A} ) / ((Σ g = A~D UG g) / the number of groups)
= 1370/915
= 1.497
Group B speech activity UG _B = 1650/915 = 1.803
Speech activity of group C UG _C = 210/915 = 0.230
Group D speech activity UG _D = 430/915 = 0.470

[Overlap rate calculation unit 15]
The overlap rate calculation unit 15 detects, for each group, the “overlap time length” between the utterance time of the member and the utterance time of the other member for each member, and the overlap time length with respect to the utterance time length of the member The overlap ratio representing is calculated. The overlap (when one member is speaking and the other member also speaks) can be detected from the speaking time and speaking time length between the members. For example, according to FIG.
Overlap rate OL _{A1 of} member _A1
= Overlap time length / Speech time length = 240/600
= 0.4
Overlap ratio of the member _{A2 OL A2 = 36/90 =} 0.4
Overlap ratio of member _{A3 OL A3 = 100/500 =} 0.2
Overlap ratio of the member _{A4 OL A4 = 24/120 =} 0.2
Overlap ratio of members _{A5 OL A5 = 0/60 =} 0

The overlap rate calculation unit 15 calculates the ratio of the total overlap time length to the utterance time length of all members for each group.
Group A overlap rate OL _A
= Total overlap time length / Speech time length of all members = Σ _{A = A1 to A5} OL _A / Σ _{A = A1 to A5} U _A
= 400/1370
= 0.3
Group B overlap rate OL _B = 880/1650 = 0.533
Group C overlap rate OL _C = 55/210 = 0.262
Group D overlap rate OL _D = 95/430 = 0.221

The “individual activity level” of the member shown in FIG. 4 is calculated as follows.
Individual activity = utterance density contribution rate + overlap rate

[Group Graph Generation Unit 16]
The group graph generation unit 16 generates a graph in which the utterance density contribution rate and the overlap rate of each member are drawn for each group. The progressor can visually recognize the activity level of each group under the situation where the discussion is performed in parallel in a plurality of groups. This graph is in the form of a radar chart or a bar having each member as an element for each group, and is generated simultaneously in a plurality of groups. For each group, the progress can be confirmed in a state such as being entirely uplifted / partially biased / low activity / average, etc., and it is possible to identify group members to be instructed. it can. In addition, it is also preferable that the group graph production | generation part 16 produces | generates the graph which further drawn the group speech activity of each group.

  FIG. 5 is an explanatory diagram showing a group graph.

  According to FIG. 5, the utterance density contribution rate and the overlap rate of each member are shown in parallel for each group. In particular, in the case of a radar chart, the degree of activity for each group can be compared at a glance mainly from the way in which the figure spreads. According to FIG. 5, it is recognized that the activities of groups C and D are lower than those of groups A and B. These group graphs are preferably updated almost in real time (for example, every 30 seconds).

  In the case of a bar graph, the utterance density contribution rate and the overlap rate between members in each group can be compared as relative trends. For example, it is possible to instruct the replacement of a member between a group C in which a plurality of members with low activity exist and a group B in which there are many active members. This can mitigate the unevenness of activity between groups.

  Further, the group graph generation unit 16 visually highlights, for each group, members whose utterance density contribution rate belongs to the first predetermined condition range and whose overlap rate belongs to the second predetermined condition range. A graph can also be generated. Thereby, for example, a member (for example, A3) having a relatively high speech density contribution rate and a low overlap rate can be found at a glance. Such members are observing the manners and can be considered leader candidates for group activities.

[Support message selection unit 17]
The support message selection unit 17 stores in advance a support message representing the member characteristics in association with each predetermined range of the utterance density contribution rate and / or for every predetermined range of the overlap rate. . Then, the support message selection unit 17 selects a support message according to the utterance density contribution rate and / or the overlap rate of the graph. The selected assistance message is further revealed to the user. By clearly indicating a support message about points to be noted with priority, information that is helpful for activating the discussion can be quickly alerted regardless of the experience of the progressors themselves.

The above-described support message as shown in FIG. 5 can explicitly express group members to which the progressor should pay attention.
(1) When there are a plurality of members having a group activity level of 0.7 or less and an individual activity level of 0, according to FIG.
Message: “Group C has low activity and needs attention”
(2) In addition to the condition (1), when there is a group whose group activity exceeds 1.5 and does not include a member whose personal activity is 0, group B is selected according to FIG.
The member C3 having the lowest individual activity in the group C is selected.
The member B4 having the highest individual activity in the group B is selected.
Message: “Replace group C member C3 with group B member B4”
(3) When there is a member having an utterance density contribution ratio of 0.3 or more and an overlap ratio exceeding 70%, according to FIG. 4, member A1 of group A is selected.
Message: “Member A1 is active but seems to have many interruptions”
(4) When there is a member having an utterance density contribution rate of 0.3 or more and an overlap rate of 20% or less, according to FIG. 4, member A3 of group A is selected.
Message: “Member A3 is an active example that protects the manners”

  FIG. 6 is a graph showing the group utterance activity according to the passage of time.

According to FIG. 6, the group utterance activity is represented by a line graph corresponding to the passage of time. The support message selection unit 17 may further select a support message according to the group utterance activity level corresponding to the passage of time.
(1) When the group utterance activity level rises within a specified range over time Message: “Group x is gradually rising”
(2) When the group utterance activity level rises or falls within a specified range over time Message: “Group x seems to change drastically”
(3) When the group utterance activity level falls within the specified range over time Message: “Group x is gradually sinking”

  According to FIG. 1 described above, the group graph and the support message are clearly shown to the management terminal. These graphs and messages may be generated by the management terminal itself, or may be received from the management apparatus. Further, the management device may transmit a graph and a message to a terminal possessed by a member, or may be generated by the member terminal itself. As a result, the activity level of the group discussion can be visually confirmed by the progressors and members themselves.

  As described above in detail, the program, terminal, and system of the present invention can estimate the activation of discussion for each group and clearly indicate the situation to the progressor. In particular, the contribution of the discussion within the group to the activity varies depending on the member. According to the present invention, support is provided by finding a leader-like member in the group or a member with a low contribution degree from the bias of the member characteristics in the group and feeding back to the progressor. This allows the facilitator to instruct to increase / maintain the activity of the entire group according to the situation of the discussion.

  Various changes, modifications, and omissions of the above-described various embodiments of the present invention can be easily made by those skilled in the art. The above description is merely an example, and is not intended to be restrictive. The invention is limited only as defined in the following claims and the equivalents thereto.

DESCRIPTION OF SYMBOLS 1 Terminal, smart phone 10 Utterance voice acquisition part 11 Utterance storage part 12 Group utterance classification part 13 Utterance density contribution rate calculation part 14 Group utterance activity calculation part 15 Overlap rate calculation part 16 Group graph generation part 17 Support message selection part

Claims (9)

A program that allows a computer to function to estimate the activation of discussion for each group,
Utterance storage means for storing the utterance time and utterance time length of each member uttered;
Group utterance classification means for classifying the utterance time and the utterance time length of each member in time series for each group;
For each group, an utterance density contribution rate calculating means for calculating an utterance density contribution rate representing the ratio of the utterance time length of each member to the overall utterance time length;
A program for causing a computer to function as group graph generation means for generating a graph in which the utterance density contribution rate of each member is drawn for each group, and clearly displaying the graph to the user. Causing the computer to function as a group utterance activity calculating means for calculating a group utterance activity representing the ratio of the utterance time length of the group to the average value of the utterance time length of all the groups;
The program according to claim 1, wherein the group graph generation unit causes a computer to generate a graph in which the group utterance activity of each group is further drawn. The group graph generating means causes the computer to function so as to simultaneously generate a radar chart or bar graph having each member as an element for each group in a plurality of groups. 2. The program according to 2. For each group, for each member, the overlap time length of the utterance time of the member and the utterance time of the other member is detected, and an overlap ratio representing the overlap time length with respect to the utterance time length of the member is calculated. Let the computer further function as a rate calculation means,
The said group graph production | generation means makes a computer function so that the graph which further drawn the said overlap rate of each member may be produced | generated for every group. program. The group graph generation means visually highlights, for each group, members whose utterance density contribution rate belongs to the first predetermined condition range and whose overlap rate belongs to the second predetermined condition range. The program according to claim 4, wherein the computer is caused to function to generate a graph. A support message representing the member characteristic is stored in advance in association with each predetermined range of the utterance density contribution rate and / or for every predetermined range of the overlap rate, and the utterance density of the graph 5. The computer according to claim 4, wherein the computer further functions as a support message selection unit that selects the support message according to a contribution rate and / or an overlap rate, and the selected support message is further indicated to a user. 5. The program according to 5. A terminal that allows a computer to function the program according to any one of claims 1 to 6,
Utterance voice acquisition means for storing the utterance time and utterance time length of the member detected from the utterance voice of the member collected by the microphone into the utterance storage means;
The terminal characterized in that the graph generated by the group graph generating means is shown in real time on a display. A system in which a plurality of terminals that allow a computer to function the program according to any one of claims 1 to 6 is connected to each other via a network,
The terminal immediately transmits the utterance time and utterance time length detected from the uttered voice of the member collected by the microphone to the other terminal,
All terminals share the information memorize | stored in the said utterance memory | storage means immediately, and show the said graph produced | generated by the said group graph production | generation means in real time on a display. A server that causes a computer to function the program according to any one of claims 1 to 6;
A system having a terminal that immediately transmits the utterance time and the utterance time length detected from the utterance voice of the member picked up by the microphone to the server,
The server is characterized in that the graph generated by the group graph generating means is transmitted in real time to a terminal designated in advance for a group manager.

Images