JP2022129627A - Electronic conference management device, electronic conference recording system, electronic conference reproduction system, electronic conference management method and program - Google Patents

Abstract

To enable contents of a conference to be easily confirmed in a highly convenient mode.SOLUTION: In an electronic conference management device, a group channel corresponding to only a portion of participants of an electronic conference can be set in addition to an overall channel. Conference data showing contents of an electronic conference (a general conference) in the overall channel and conference data showing contents of an electronic conference (a group conference) in the group channel are individually recorded in a recording device. Transmitting individually the conference data of the overall channel and the conference data of the group channel to a reproduction device enables them to be reproduced individually.SELECTED DRAWING: Figure 21

Description

The present invention relates to an electronic conference management device, an electronic conference recording system, an electronic conference playback system, an electronic conference management method, and a program.

Electronic conferences (web conferences) have been widely put into practical use, in which a plurality of persons hold a conference using a plurality of terminal devices without the plurality of persons meeting together. Not limited to electronic conferences, in conferences with a large number of participants, there may be occasions where conversations (so-called private conversations, etc.) with only some participants are desired. In response to this, it is considered to prepare a channel that realizes a conversation with only some participants.

JP 2016-229902 A

On the other hand, there is also a demand for reproduction (playback) of the content of the electronic conference. By recording the entire electronic conference, it is possible to reproduce the entire electronic conference.

An object of the present invention is to provide an electronic conference management apparatus, an electronic conference recording system, an electronic conference playback system, an electronic conference management method, and a program that contribute to improving the convenience of confirming the content of an electronic conference.

An electronic conference management apparatus according to the present invention is an electronic conference management apparatus used for conducting an electronic conference among a plurality of persons using a plurality of terminal devices connected to each other through a network, and includes all of the plurality of persons. a channel setting unit for setting a first channel for a possible first group of persons and a second channel for a second group of persons including only some of the plurality of persons; and a first electronic conference on the first channel a recording control unit for individually recording, in a recording device, first conference data indicating the content of the second electronic conference and second conference data indicating the content of the second electronic conference on the second channel; a reproduction transmission control unit capable of individually transmitting the first conference data and the second conference data to the reproduction device in order to enable the reproduction device to reproduce the content of the electronic conference; is any one of the plurality of terminal devices, or has a configuration (first configuration) different from any of the plurality of terminal devices.

The electronic conference management apparatus according to the first configuration further includes an authentication information setting unit that sets first authentication information associated with the first channel and second authentication information associated with the second channel. , the transmission control unit for reproduction responds to reception of a first transmission request signal including the first authentication information from the reproduction device after the end of the first electronic conference and the second electronic conference, and performs the first A configuration for transmitting conference data to the reproducing device, or transmitting the second conference data to the reproducing device in response to reception of a second transmission request signal including the second authentication information from the reproducing device (Second configuration).

In the electronic conference management apparatus according to the first or second configuration, by acquiring individual voice data individually representing utterance contents of the plurality of persons for each of the persons, a plurality of personal voices of the plurality of persons are obtained. A configuration (third configuration) further comprising a personal voice data acquisition unit for acquiring data, wherein the transmission control unit for reproduction can selectively transmit any one of the plurality of personal voice data to the reproduction device. It can be.

In the electronic conference management apparatus according to any one of the first to third configurations, the first conference data includes first voice data representing the utterance content of the first group of people on the first channel, and the second The conference data includes second audio data representing the utterance content of the second group of people on the second channel, and the electronic conference management device reproduces the first audio data or the second audio data by the reproducing device. A configuration (fourth configuration) that further includes a sound adjustment unit that adjusts the reproduction volume or the reproduction sound quality at the time of listening may be used.

In the electronic conference management device according to the fourth configuration, the sound adjustment unit is configured to be able to individually adjust the playback volume of the utterance content of the first group of people when the first audio data is played back. Alternatively, the configuration (fifth configuration) may be configured such that the reproduction volume of the utterance content of the second person group can be individually adjusted when the second audio data is reproduced.

In the electronic conference management apparatus according to any one of the first to fifth configurations, the first conference data includes first audio data representing the contents of speech of the first group of people on the first channel, and a first image. data and first additional data for the first electronic conference, wherein the first image data is a conference image displayed on each terminal device assigned to the first person group in the first electronic conference. and the reproduction transmission control unit can display the first additional data on the display screen of the reproduction device when the first audio data and the first image data are reproduced by the reproduction device. The first conference data may be transmitted to the playback device in response to a request from the playback device (sixth configuration).

In the electronic conference management device according to any one of the first to sixth configurations, the second conference data includes second audio data representing the content of speech of the second group of people on the second channel, and a second image. data and second additional data for the second electronic conference, wherein the second image data is a conference image displayed on each terminal device assigned to the second person group in the second electronic conference. and the reproduction transmission control unit can display the second additional data on the display screen of the reproduction device when the second audio data and the second image data are reproduced by the reproduction device. The configuration (seventh configuration) may be such that the second conference data is transmitted to the playback device in response to a request from the playback device.

In the electronic conference management device according to any one of the first to seventh configurations, the second electronic conference is held during part of the holding period of the first electronic conference, and the second electronic conference is held during the holding period of the first electronic conference. , the first person group is composed of all of the plurality of persons during a period when the second electronic conference is not held, and the second person group is excluded from the plurality of persons during the period when the second electronic conference is held. A configuration (eighth configuration) in which the first group of persons is configured in .

An electronic conference recording system according to the present invention includes an electronic conference management device according to any one of the first to eighth configurations, the recording device, and the plurality of terminal devices (the ninth configuration ).

An electronic conference reproduction system according to the present invention includes an electronic conference management apparatus according to any one of the first to eighth configurations, the recording apparatus, and the reception of the first conference data or the second conference data. and the reproducing device capable of reproducing the first conference data or the second conference data (a tenth configuration).

An electronic conference management method according to the present invention is an electronic conference management method used for conducting an electronic conference between a plurality of persons using a plurality of terminal devices connected to each other through a network, and includes all of the plurality of persons. a channel setting step of setting a first channel for a first group of possible persons and a second channel for a second group of persons including only a portion of said plurality of persons; and a first electronic conference on said first channel. a recording control step of individually recording, in a recording device, first conference data indicating the content of the second electronic conference and second conference data indicating the content of the second electronic conference on the second channel; a reproduction transmission control step capable of individually transmitting the first conference data and the second conference data to the reproduction device in order to allow the reproduction device to reproduce the contents of the electronic conference, wherein the reproduction device comprises: is any one of the plurality of terminal devices, or is a configuration (eleventh configuration) different from any of the plurality of terminal devices.

A program according to the present invention has a configuration (a twelfth configuration) that causes an arithmetic processing apparatus to implement the electronic conference management method according to the eleventh configuration.

According to the present invention, it is possible to provide an electronic conference management apparatus, an electronic conference recording system, an electronic conference playback system, an electronic conference management method, and a program that contribute to improving the convenience of confirming the content of an electronic conference.

1 is an overall configuration diagram of a conference system (electronic conference system) according to an embodiment of the present invention; FIG. 3 is an internal configuration diagram of the terminal device according to the embodiment of the present invention; FIG. 3 is an internal configuration diagram of the server device according to the embodiment of the present invention; FIG. 1 is an overall configuration diagram of a conference system according to an embodiment of the present invention; FIG. 3 is an internal configuration diagram of the terminal device according to the embodiment of the present invention; FIG. FIG. 4 is a diagram showing how audio signals are output from each terminal device according to the embodiment of the present invention; It is a figure which shows the content of the participant information which concerns on embodiment of this invention. FIG. 4 is a functional block diagram of a server control unit according to the embodiment of the present invention; FIG. 5 is a diagram showing the relationship between a general conference holding period and a group conference holding period according to the embodiment of the present invention; FIG. 10 is a diagram showing how conference data is recorded during a normal period (a period when a group conference is not held) according to the embodiment of the present invention; FIG. 10 is a diagram showing how meeting data is recorded during a group meeting period according to the embodiment of the present invention; FIG. 4A is a diagram showing an outline of voice data of conference data of a general channel, and FIG. FIG. 4 is a diagram showing the structure of general channel conference data and group channel conference data according to an embodiment of the present invention; FIG. 5 is a diagram showing an example of the relationship between a general conference holding period and a plurality of group conference holding periods according to the embodiment of the present invention; FIG. 10 is a diagram showing another example of the relationship between a general conference holding period and a plurality of group conference holding periods according to the embodiment of the present invention; FIG. 4 is a diagram showing recording of each conference data of a plurality of group channels according to the embodiment of the present invention; 1 is a diagram showing the relationship between a server device and a playback device according to an embodiment of the present invention; FIG. FIG. 10 is an operation flowchart relating to recording of conference data according to the first example belonging to the embodiment of the present invention; FIG. FIG. 10 is a flowchart of group conference start processing according to the first example belonging to the embodiment of the present invention; FIG. FIG. 10 is a flowchart of group conference end processing according to the first example belonging to the embodiment of the present invention; FIG. FIG. 4 is a diagram showing the flow of setting general channels and group channels and recording each conference data according to the first example belonging to the embodiment of the present invention; FIG. 10 is an explanatory diagram of transmission operation of each conference data to a reproducing device according to the first example belonging to the embodiment of the present invention; FIG. 10 is an explanatory diagram of a method of generating personal voice data according to a second example belonging to the embodiment of the present invention; FIG. 10 is a diagram showing how a personal voice data recording area is provided in a recording device according to a second example belonging to an embodiment of the present invention; FIG. 10 is an explanatory diagram of transmission and reproduction operations of personal voice data according to the second example belonging to the embodiment of the present invention;

Hereinafter, examples of embodiments of the present invention will be specifically described with reference to the drawings. In each figure referred to, the same parts are denoted by the same reference numerals, and redundant descriptions of the same parts are omitted in principle. In this specification, for simplification of description, by describing symbols or codes that refer to information, signals, physical quantities, or members, etc., the names of information, signals, physical quantities, or members, etc. corresponding to the symbols or codes are It may be omitted or abbreviated. For example, the personal voice data acquisition unit referred to by "170" (see FIG. 8) may be referred to as the personal voice data acquisition unit 170, or may be abbreviated as the acquisition unit 170. , they all refer to the same thing.

FIG. 1 shows the overall configuration of the system SYS according to this embodiment. Although the system SYS can be used for various purposes, in this embodiment, it is assumed that the system SYS is used for holding a conference (conversation) between a plurality of persons PS. In this case, the system SYS functions as a conference system (electronic conference system), and is hereinafter referred to as the conference system SYS. A conference in this embodiment is an electronic conference, and in this embodiment, a conference and an electronic conference refer to the same thing. In an electronic conference, a conversation is realized between a plurality of persons PS through transmission and reception of signals (including at least voice signals) between a plurality of terminal devices without the plurality of persons PS meeting together. Electronic conferencing is also commonly referred to as web conferencing. Each person PS corresponds to a participant in the electronic conference.

The conference system SYS includes a plurality of terminal devices 10, a server device 30, and a recording device 50 as constituent elements. The server device 30 is an example of an electronic conference management device. Each terminal device 10 is assigned to one of the plurality of persons PS. Each terminal device 10 and server device 30 are connected to a network 70 including the Internet. In other words, the plurality of terminal devices 10 and server devices 30 are connected to each other through the network 70 . Each of the plurality of terminal devices 10 and server device 30 is capable of two-way communication with arbitrary devices connected to network 70 .

Each terminal device 10 is an electronic device such as a personal computer, tablet, or smart phone. The plurality of terminal devices 10 incorporated in the conference system SYS may be electronic devices of the same type, or may be electronic devices of different types. However, hereinafter, it is assumed that the plurality of terminal devices 10 have the same configuration.

FIG. 2 shows the internal configuration of one terminal device 10. As shown in FIG. The terminal device 10 includes a communication processing section 11 , a storage section 12 , a terminal control section 13 , a display screen 14 , an operation section 15 , a camera 16 , a microphone 17 and a speaker 18 . In describing the internal configuration of the terminal device 10 , one terminal device 10 that has received attention is referred to as a focused terminal device 10 as necessary. Also, the person PS who is the user of the attention terminal device 10 may be referred to as the attention person PS. The attention terminal device 10 is the terminal device 10 assigned to the attention person PS (associated with the attention person PS) in the conference system SYS. Each terminal device 10 incorporated in the conference system SYS can be the focused terminal device 10 .

The communication processing unit 11 performs two-way communication with the counterpart device through the network 70 . In the terminal device of interest 10, two-way communication includes a transmission operation of outputting arbitrary information to the network 70 to transmit the information to the counterpart device, and an operation of transmitting arbitrary information output to the network 70 by the counterpart device. and a receive operation to receive. A counterpart device for the terminal device of interest 10 is the server device 30 or a terminal device 10 other than the terminal device of interest 10 . The communication processing unit 11 in the terminal device of interest 10 can bi-directionally communicate with each terminal device 10 other than the terminal device of interest 10 via the network 70 and the server device 30 . The communication processing unit 11 in the focused terminal device 10 may be capable of realizing two-way communication with each terminal device 10 other than the focused terminal device 10 without going through the server device 30 . As described above, communication between the target terminal device 10 and the counterpart device is performed using the communication processing unit 11, but the description of the communication processing unit 11 may be omitted in the following description.

The storage unit 12 consists of a magnetic disk, a semiconductor memory, or the like, or a combination thereof, and stores various programs and data. The programs stored in the nonvolatile memory in the storage unit 12 include a terminal program PG1.

The terminal control unit 13 includes a CPU (Central Processing Unit), a ROM (Read only memory), a RAM (Random access memory), etc., which is an arithmetic processing unit, and controls the operation of each part in the terminal device 10 in an integrated manner. At the same time, the program stored in the storage unit 12 is executed by the arithmetic processing unit in the terminal control unit 13 to realize various functions.

The display screen 14 is composed of a liquid crystal display panel, an organic electroluminescence panel, or the like, and displays an arbitrary image (in other words, video) under the control of the terminal control section 13 . The person of interest PS can visually recognize the display contents of the display screen 14 of the terminal device of interest 10 . In the following description, display on a certain terminal device 10 means display on the display screen 14 provided on the terminal device 10 .

The operation unit 15 receives various operations from an operator. The operator of the target terminal device 10 is the target person PS. If the terminal device 10 is provided with a touch panel, the touch panel may constitute the display screen 14 and the operation unit 15 .

The camera 16 takes an image within its own field of view and outputs an image signal (image data) representing the imaged result. The field of view of the camera 16 of the terminal device of interest 10 may include the whole body or part of the person of interest PS.

The microphone 17 converts its own ambient sound into an audio signal and outputs the audio signal. In the conference system SYS, the main purpose of the microphone 17 in the focused terminal device 10 is to pick up the utterance content of the focused person PS. Therefore, the microphone 17 in the target terminal device 10 picks up the speech content of the target person PS, converts the picked-up sound into a voice signal, and outputs the voice signal.

Under the control of the terminal control unit 13, the speaker 18 outputs the audio signal input to itself as sound (as sound waves). The person of interest PS can hear the output sound of the speaker 18 of the terminal device of interest 10 . In the following description, sound output or voice output from a certain terminal device 10 means sound output or voice output from the speaker 18 provided in the terminal device 10 .

FIG. 3 shows the internal configuration of the server device 30. As shown in FIG. The server device 30 includes a communication processing section 31 , a storage section 32 and a server control section 33 . Incidentally, the server device SV may be composed of one or more computer devices. The conference system SYS may be configured using so-called cloud computing.

The communication processing unit 31 performs two-way communication with the counterpart device through the network 70 . In the server device 30, two-way communication includes a transmission operation of outputting arbitrary information to the network 70 to transmit the information to the partner device, and receiving arbitrary information output from the partner device to the network 70. and a receive operation to. A counterpart device for server device 30 is an arbitrary device connected to network 70 . Each of the plurality of terminal devices 10 corresponds to a counterpart device for the server device 30 . As described above, communication between the server device 30 and the partner device is performed using the communication processing unit 31, but the description of the communication processing unit 31 may be omitted in the following description.

The storage unit 32 consists of a magnetic disk, a semiconductor memory, or the like, or a combination thereof, and stores various programs and data. The programs stored in the non-volatile memory in the storage unit 32 include the server program PG2.

The server control unit 33 includes a CPU (Central Processing Unit), which is an arithmetic processing unit, ROM (Read only memory), RAM (Random access memory), etc., and comprehensively controls the operation of each part in the server device 30. At the same time, various functions are realized by executing programs stored in the storage unit 32 in the arithmetic processing unit in the server control unit 33 .

A recording device 50 (see FIG. 1) is composed of a non-volatile recording medium and is connected to the server device 30 . The recording device 50 records arbitrary data and information under the control of the server device 30 . Also, the server device 30 can read arbitrary data and information recorded in the recording device 50 .

The conference system SYS can execute voice transmission processing in an electronic conference. In the voice transmission process, the content of the utterance of an arbitrary person PS is output as voice from the terminal device 10 assigned to another person PS. In the voice transmission process when the person of interest PS speaks, the content of the speech of the person of interest PS is picked up by the microphone 17 of the terminal device of interest 10 and converted into an audio signal, and the audio signal representing the content of the speech of the person of interest PS is generated. It is transmitted from the focused terminal device 10 to each of the other terminal devices 10 via the network 70 and the server device 30 . Then, in each of the terminal devices 10 other than the target terminal device 10, the speaker 18 outputs an audio signal representing the utterance content of the target person PS.

The conference system SYS can execute conference image display processing in an electronic conference. The conference image here is an image shared among all the terminal devices 10 that make up the conference system SYS. be. The conference image is, for example, a material called presentation material (explanatory summary, graph, table, still image, moving image). The server control unit 33 can set an arbitrary image displayed on the display screen 14 of the attention terminal device 10 as a conference image according to the operation content of the operation unit 15 of the attention terminal device 10 (attention person Assume a situation in which the PS is granted control authority). In this case, the image signal of the conference image is transmitted from the server device 30 to each terminal device 10 other than the target terminal device 10 . The terminal control unit 13 of each terminal device 10 other than the focused terminal device 10 displays the conference image on the display screen 14 based on the received image signal. Alternatively, the server control unit 33 may set a pre-registered image as the conference image. In this case, the image signal of the conference image is transmitted from the server device 30 to each terminal device 10, and the terminal control section 13 of each terminal device 10 displays the conference image on the display screen 14 based on the received image signal. A conference image may include an image captured by the camera 16 of one of the terminal devices 10 .

With reference to FIG. 4, hereinafter, for the purpose of concrete description, it is assumed that the plurality of terminal devices 10 are n terminal devices 10, and among the n terminal devices 10, the first to n-th terminals The devices 10 are referred to as terminal devices 10[1] to 10[n]. A person PS to whom the terminal device 10[i] is assigned is referred to as a person PS[i]. n represents any integer of 4 or more. However, "n=3" may be used. i represents any natural number equal to or less than n. Further, as shown in FIG. 5, the communication processing unit 11, the storage unit 12, the terminal control unit 13, the display screen 14, the operation unit 15, the camera 16, the microphone 17 and the speaker 18 in the terminal device 10[i] are connected to each other. Processing unit 11[i], storage unit 12[i], terminal control unit 13[i], display screen 14[i], operation unit 15[i], camera 16[i], microphone 17[i], and speaker 18 It may be referred to as [i].

Further, as shown in FIG. 6, an audio signal output from the terminal device 10[i] to the network 70 during the electronic conference is called an audio signal AS[i]. Audio signal AS[i] is transmitted to and received by server device 30 over network 70 . Audio signal AS[i] may be transmitted to terminal devices 10 other than terminal device 10[i] without going through server device 30 . The terminal device 10[i] generates an audio signal AS[i] by performing predetermined audio signal processing on the audio signal output from the microphone 17[i]. Since the microphone 17[i] picks up the utterance content of the person PS[i], the audio signal AS[i] includes an audio signal representing the utterance content of the person PS[i]. Each terminal device 10 is provided with an echo canceller. Due to the function of the echo canceller, the signal component of the sound output from the speaker 18[i] is removed or sufficiently reduced in the audio signal AS[i].

FIG. 7 shows participant information 510 relating to the electronic conference. Participant information 510 includes personal identification information, terminal identification information, and participation location information for each of persons PS[1] to PS[n]. In the conference system SYS, a unique personal identification number is given to each of the persons PS[1] to PS[n] who are participants in the electronic conference. The personal identification number of the person PS[i] is referenced by the symbol "ID_PS[i]".

The terminal identification information associated with the person PS[i] is referenced by the symbol "ID_TM[i]". The terminal identification information ID_TM[i] is identification information of the terminal device 10 used by the person PS[i] in the electronic conference. Here, since it is assumed that the electronic conference is held in a state where the terminal device 10[i] is assigned to the person PS[i], the terminal identification information ID_TM[i] is represents the unique identification assigned to the . However, an electronic conference may be held with a plurality of persons PS sharing one terminal device 10. In this case, common terminal identification information is associated with the plurality of persons PS.

The participation place information associated with the person PS[i] represents the place where the person PS[i] was located during the holding period of the electronic conference (corresponding to the holding period of the general conference, which will be described later; see FIG. 9). Participation location information may be created by the person PS[i] inputting his/her own location into the operation unit 15[i], or participation location information may be created using a GPS (Global Positioning System). may be created. Note that the participant information 510 does not have to include the participating place information.

FIG. 8 shows a functional block diagram of the server control section 33. As shown in FIG. The server control unit 33 includes a plurality of functional blocks including a participant information acquisition unit 110, a conference period setting unit 120, a channel setting unit 130, a conference data generation unit 140, a recording control unit 150, an authentication information setting unit 160, and personal voice data acquisition. 170 , an authentication processing unit 210 , a reproduction transmission control unit 220 and a sound adjustment unit 230 . Among these functional blocks, the functional blocks referenced by reference numerals 110 to 170 function effectively mainly during the holding period of the electronic conference, and the functional blocks referenced by reference numerals 210 to 230 mainly function electronically after the electronic conference ends. It functions effectively at the stage of reproducing the content of the conference. Note that the server control unit 33 is not necessarily provided with all the functional blocks referenced by reference numerals 110-170 and 210-230.

The participant information acquisition unit 110 creates and acquires the above-described participant information 510 (see FIG. 7). The participant information acquisition unit 110 may create and acquire the participant information 510 in advance before the electronic conference is held (before time t _S0 described later; see FIG. 9). (at time t _S0 described later; see FIG. 9) or after that, the participant information 510 may be created and acquired.

The conference period setting unit 120 sets the holding period of the electronic conference. There are two types of electronic conferences, one type of electronic conference (first electronic conference) is a general conference, and the other type of electronic conference (second electronic conference) is a group conference. Not limited to electronic conferences, in conferences with a large number of participants, there may be occasions where conversations (so-called private conversations, etc.) with only some participants are desired. An electronic conference with only some participants corresponds to a group conference. Therefore, as shown in FIG. 9, there are a general conference holding period during which the general conference is held and a group conference holding period during which the group conference is held as the holding period of the electronic conference.

Times t _S0 and t _E0 represent the start time and end time of the general conference holding period, respectively. Naturally, the time t _E0 comes after the time t _S0 . Times t _S1 and t _E1 represent the start time and end time of the group conference holding period, respectively. Naturally, the time t _E1 comes after the time t _S1 . The time t _S1 is later than the time t _S0 , and the time t _E1 is earlier than the time t _E0 . That is, the group meeting is held during a part of the general meeting holding period. Therefore, the group meeting period is included in the general meeting period. For the sake of convenience, a period during which no group conference is held (a period during which no group conference is held) is referred to as a normal period. In FIG. 9, the period from time _tS0 to time _tS1 and the period from time _tE1 to time _tE0 correspond to the normal period. The conference period setting unit 120 sets the general conference period and the group conference period. This setting also determines the normal period. For example, when a person PS[1] desires a group meeting with only a person PS[2] as a communication partner, the person PS[1] inputs a predetermined operation to the operation unit 15[1] so that the person PS[ 1] and PS[2] is held in a group containing only PS[2].

The channel setting unit 130 sets a general channel for general conferences and a group channel for group conferences. The conference data generator 140 generates conference data indicating the content of the electronic conference for each channel. The recording control unit 150 performs recording control on the recording device 50 and causes the recording device 50 to record arbitrary data and information at desired timing. As a characteristic operation, the recording control unit 150 causes the recording device 50 to record the general channel conference data and the group channel conference data individually. The conference data of the general channel is, in other words, the conference data of the general conference, and the conference data of the group channel is, in other words, the conference data of the group conference. The general channel conference data is data indicating the content of the electronic conference (ie general conference) on the general channel, and the group channel conference data is data indicating the content of the electronic conference (ie group conference) on the group channel. The content of the electronic conference (ie, general conference) on the overall channel includes the utterance content of each member of the overall channel, and the content of the electronic conference (ie, group conference) on the group channel includes the utterance content of each member of the group channel.

Contents recorded in the recording device 50 during the normal period will be described with reference to FIG. In the normal period, all persons PS[1] to PS[n] are participants in the general conference. That is, during the normal period, all of the persons PS[1] to PS[n] are members of the general channel, and conference data including the utterance contents of each member of the general channel is generated as conference data of the general channel. . The recording control unit 150 sets a recording area 51 for all channels in the recording device 50, and records conference data for all channels in the normal period in the recording area 51. FIG.

Contents recorded in the recording device 50 during the holding period of the group conference will be described with reference to FIG. In the example of FIG. 11, persons PS[h+1] to PS[n] are participants in the group conference. That is, during the group conference holding period according to the example of FIG. not included in Members of the group channel are some of the persons PS[1] to PS[n], and h is an integer that satisfies "h+1<n". During the period in which the group conference is held according to the example of FIG. 11, only the persons PS[1] to PS[h] constitute the general channel.

Therefore, it can also be expressed as follows. Channel setting unit 130 sets the first channel (entire channel) for the first group of persons PS[1] to PS[n] and the second group of persons PS[1] to PS[n]. set the second channel (group channel) for The first group of people can include all of the people PS[1] to PS[n], while the second group of people includes only some of the people PS[1] to PS[n]. In other words, the second person group is composed of some of the persons PS[1] to PS[n] (persons PS[h+1] to PS[n] in the example of FIG. 11). Group meetings will be held during part of the plenary session. During the period during which the group conference is not held (normal period) in the period during which the general conference is held, the first person group is composed of all of the persons PS[1] to PS[n] (that is, the persons PS[1] to All of PS[n] are included in the members of the entire channel). On the other hand, during the group conference period, the number of members of the overall channel is temporarily reduced. That is, during the group meeting period, the first person group is formed by excluding the second person group (persons PS[h+1] to PS[n] in the example of FIG. 11) from the persons PS[1] to PS[n]. be done.

During the period in which the group conference is held, conference data including the utterances of the constituent members of the overall channel (persons PS[1] to PS[h] in the example of FIG. 11) are generated as conference data for the overall channel. In the example of FIG. 11, the conference data of all channels during the period in which the group conference is held in FIG. 9 does not include the utterances of persons PS[h+1] to PS[n]. Conference data for all channels during the group conference period is also recorded in the recording area 51 for all channels. Therefore, at the end of the general conference _holding period shown in FIG. 9, as shown in FIG. _12A , the conference data (person PS[ 1] to PS[n]) and conference data indicating the contents of the electronic conference of the entire channel during the group conference period between times _tS1 and _tE1 (persons PS[1] to PS[n]). h] and does not include the utterances of persons PS[h+1] to PS[n]), and the conference showing the contents of the electronic conference of all channels during the normal period between times t _E1 and t _E0 data (meeting data including the utterances of persons PS[1] to PS[n]) are recorded in the recording area 51 as meeting data for the entire channel.

During the period in which the group conference is held, conference data including the utterances of each constituent member of the group channel (persons PS[h+1] to PS[n] in the example of FIG. 11) are generated as group channel conference data. The conference data of the group channel during the group conference period shown in FIG. 9 does not include the utterance contents of the persons PS[1] to PS[h]. The recording control unit 150 sets a recording area 52 for the group channel in the recording device 50 and records conference data of the group channel in the recording area 52 during the holding period of the group conference. As shown in FIG. 12(b), the conference data recorded in the recording area 52 is the conference data (person _PS [ _h +1] ~PS[n] and does not contain the utterances of persons PS[1] to PS[h]).

A recording area 52 is a recording area different from the recording area 51 . The recording apparatus 50 may be composed of a plurality of physically separated recording media, and the recording medium on which the recording area 51 is set and the recording medium on which the recording area 52 is set may be different from each other. Alternatively, the recording areas 51 and 52 may be set within the single recording medium by virtually dividing the entire recording area of the single recording medium included in the recording device 50 . In addition, a method of adding identification data such as an identification flag for recording is also possible. In this case, necessary filter processing is performed with the identification data at the time of reproduction.

FIG. 13 shows the structure of the conference data of the general channel and the structure of the conference data of the group channel. The general channel conference data includes audio data AD_W, image data VD_W, and additional data DD_W. Group channel conference data includes audio data AD_G, image data VD_G, and additional data DD_G.

The audio data AD_W is data indicating the audio content in the electronic conference of the general channel, and represents the speech content of each constituent member of the general channel. The voice data AD_W is generated based on the voice signal transmitted to the server device 30 from the terminal device 10 assigned to each constituent member of the overall channel. 9 and 11, a composite signal of the audio signals AS[1] to AS[n] between times t _S0 and t _S1 and an audio signal between times t _S1 and t _E1 Audio obtained by combining the synthesized signal of AS[1] to AS[h] and the synthesized signal of the audio signals AS[1] to AS[n] between times t _E1 and t _E0 along the time series The data corresponds to audio data AD_W.

The image data VD_W is image data of the conference image displayed on each display screen 14 of the terminal device 10 assigned to each constituent member of the overall channel. Since the conference image is shared not only by each terminal device 10 but also by the server device 30, the server device 30 can acquire the image data of the conference image at any time. 9 and 11, the conference images displayed on the display screens 14 of the terminal devices 10[1] to 10[n] between times t _S0 and t _S1 and the time t _S1 and _tE1 between the conference images displayed on the respective display screens 14 of the terminal devices 10[1] to 10[h], and between the times _tE1 and _tE0 , the terminal devices 10[1] to 10[n] The image data of the moving image obtained by combining the meeting images displayed on each display screen 14 in chronological order corresponds to the image data VD_W.

The additional data DD_W includes general conference participant information indicating who each constituent member of the general channel is and from where each constituent member of the general channel participates in the general conference. 7 participant information 510. The participant information 510 itself may be included in the general conference participant information. Further, the additional data DD_W includes general conference date and time information indicating the date and time of the general conference holding period. The general meeting date and time information specifies times t _S0 and t _E0 in the examples of FIGS. 9 and 11 . Furthermore, the additional data DD_W can include material data associated with the general meeting. This material data is, for example, material data registered in advance in the server control unit 33 as material to be circulated to each participant before the holding period of the electronic conference (before time t _S0 in FIG. 9). be. However, material data uploaded to the server device 30 using the terminal device 10[i] corresponding to any member of the general channel after the start of the electronic conference of the general channel (after time t _S0 in FIG. 9) , may be included in the additional data DD_W. When the material data uploaded here is image data, the image shown by the material data can be displayed on each display screen 14 of the terminal device 10 of each constituent member of the general channel as a kind of conference image.

The audio data AD_G is data indicating the audio content in the electronic conference of the group channel, and represents the speech content of each constituent member of the group channel. The voice data AD_G is generated based on voice signals transmitted to the server device 30 from the terminal devices 10 assigned to each member of the group channel. 9 and 11, the audio data AD_G corresponds to a synthesized signal of the audio signals AS[h+1] to AS[n] between times t _S1 and t _E1 .

The image data VD_G is image data of the conference image displayed on each display screen 14 of the terminal device 10 assigned to each constituent member of the group channel. 9 and 11, the image data VD_G is the conference image displayed on the display screen 14 of each of the terminal devices 10[h+1] to 10[n] between times t _S1 and t _E1 . is the image data of

The additional data DD_G includes group conference participant information indicating who each constituent member of the group channel is and from where each constituent member of the group channel participates in the group conference. 7 participant information 510. The participant information 510 itself may be included in the group conference participant information. Further, the additional data DD_G includes group meeting date and time information indicating the date and time of the group meeting holding period. The group meeting date and time information specifies times t _S1 and t _E1 in the example of FIG. Furthermore, the additional data DD_G can include material data associated with the group meeting. For example, after the start of the electronic conference of the group channel (after time t _S1 in FIG. 9), material data uploaded to the server device 30 using the terminal device 10[i] corresponding to one of the constituent members of the group channel is , may be included in the additional data DD_G. When the material data uploaded here is image data, the image shown by the material data can be displayed on each display screen 14 of the terminal device 10 of each constituent member of the group channel as a kind of conference image.

Note that the conference data of the general channel may include both additional data DD_W and additional data DD_G as additional data. Also, the conference data of the group channel may include both additional data DD_W and additional data DD_G as additional data. Also, as a method of recording audio data and image data in conference data, a method of dividing data into units of a predetermined time (for example, 10 seconds), and compressing and recording the data for each unit may be adopted. At this time, as for the additional data, the additional data may be added for each unit, or the additional data may be added collectively to the data for the entire time of the audio data and the image data. Regardless of which recording method is used, each piece of recorded data is appended with a time stamp representing the date and time when the data was generated or acquired.

FIG. 9 focuses on one group conference set during one general conference holding period, but as shown in FIG. 14 or 15, a plurality of group conference holding periods are held during one general conference holding period. may be set. In the example of FIG. 14, a first group conference is started during one general conference, and a second group conference is started after the first group conference is over. Therefore, in the example of FIG. 14, during one general meeting period, the first group meeting period, which is the period during which the first group meeting is held, and the second group meeting period, which is the period during which the second group meeting is held. exist without overlapping each other. In the example of FIG. 15, during one general conference, the first group conference starts, the second group conference starts before the first group conference ends, and then after the first group conference ends. The second group meeting ends. Therefore, in the example of FIG. 15, during one general meeting period, the first group meeting period, which is the period in which the first group meeting is held, and the second group meeting period, which is the period in which the second group meeting is held. It exists in a partially overlapping manner. 9, 14, and 15 are only examples of methods for setting group meeting holding periods, and three or more group meeting holding periods may be set during one general meeting holding period, and a plurality of group meeting holding periods may be set. There are various relationships between the start time and end time of the conference holding period.

When multiple group meetings are held, multiple group channels corresponding to the multiple group meetings are set up. A group channel recording area is set in the recording device 50 for each group channel, and group channel conference data is recorded in the recording device 50 for each group channel.

For example, as shown in FIG. 16, a first group channel including only persons PS[1] and PS[2] as members is set, and only persons PS[3] to PS[5] as members are set. When the second group channel is set, a recording area 52a for the first group channel and a recording area 52b for the second group channel are set in the recording device 50 separately. While the first group channel meeting data indicating the content of the group meeting of the first group channel is recorded in the recording area 52a, the second group channel meeting data indicating the content of the second group channel group meeting is recorded in the recording area 52a. It is recorded in the recording area 52b.

Referring to FIG. 8 again, the authentication information setting unit 160 sets authentication information necessary for reproducing conference data recorded in the recording device 50 for each channel. The personal voice data acquisition unit 170 will be described later. The authentication processing unit 210 executes authentication processing for reproducing conference data recorded in the recording device 50 . The reproduction transmission control unit 220 transmits the conference data in the recording device 50 to the reproduction device that is to reproduce the conference data through authentication processing. The sound adjustment unit 230 adjusts the reproduction volume or the reproduction sound quality when the conference data is reproduced by the reproduction device.

FIG. 17 shows the relationship between the server device 30 and the playback device 10R. The server device 30 and the playback device 10R are connected to the network 70 and are capable of two-way communication through the network 70. FIG. The playback device 10R can be any one of the terminal devices 10[1] to 10[n], and can be different from any of the terminal devices 10[1] to 10[n]. However, even if the playback device 10R is different from each terminal device 10, the playback device 10R has the same configuration as each terminal device 10, and has at least the function of playing back audio data and image data. shall be

In response to a request from the reproduction device 10R, the reproduction transmission control unit 220 can transmit the conference data of the general channel to the reproduction device 10R so that the content of the general conference can be reproduced by the reproduction device 10R, Alternatively, in response to other requests from the playback device 10R, the group channel meeting data can be sent to the playback device 10R so that the content of the group meeting can be played back on the playback device 10R.

Hereinafter, specific operation examples, applied techniques, modified techniques, and the like regarding the conference system SYS will be described among a plurality of embodiments. The matters described above in the present embodiment are applied to each of the following examples unless otherwise stated and without contradiction. In each embodiment, if there are matters that contradict the above-described matters, the description in each embodiment may take precedence. In addition, as long as there is no contradiction, the matter described in any of the following embodiments can be applied to any other embodiment (i.e. any two or more of the embodiments). It is also possible to combine the examples of .

<<First embodiment>>
A first embodiment will be described. FIG. 18 is a flow chart showing operations of the conference system SYS relating to recording of conference data. 19 and 20 are flowcharts of the group conference start processing and group conference end processing shown in FIG. 18, respectively. The flow of operations related to recording conference data will be described with reference to FIGS. 18 to 20. FIG.

A state in which no electronic conference is being held in the conference system SYS is assumed as an initial state. In the initial state, the process of step S11 is first executed. In step S11, the conference period setting unit 120 confirms whether the conditions for starting the general conference are met. The conditions for starting the general conference may be arbitrary conditions predetermined in the conference system SYS. For example, when a predetermined conference start operation is input to the operation unit 15 of a specific terminal device 10 among the terminal devices 10[1] to 10[n], the specific terminal device 10 sends a start trigger to the server device 30. When the signal is transmitted and the start trigger signal is received by the server device 30, the conditions for starting the general conference are established. Alternatively, the conditions for starting the general conference may be met when the current time reaches a predetermined start time. If the conditions for starting the general conference are not met (N in step S11), the process of step S11 is repeated. When the conditions for starting the general conference are established (Y in step S11), the process proceeds from step S11 to step S12, and the processes of steps S12 to S15 are executed.

In step S12, channel setting section 130 sets the overall channel. In step S13, the recording control unit 150 sets the recording area 51 for all channels in the recording device 50, and then starts recording conference data for all channels in the recording area 51 in step S14. Recording of the audio data AD_W and the image data VD_W in the conference data of all channels is started here, and the recording of the audio data AD_W and the image data VD_W is continued until step S21, which will be described later. Although the timing of recording the additional data DD_W in the recording area 51 is arbitrary, the additional data DD_W may be recorded in the recording area 51 in step S14 or S21, for example. After 1 is assigned to the variable x managed by the server control unit 33 in step S15, the process proceeds to step S16.

In step S16, the conference period setting unit 120 confirms whether or not the conditions for ending the general conference are met. The conditions for ending the general conference may be arbitrary conditions predetermined in the conference system SYS. For example, when a predetermined conference termination operation is input to the operation unit 15 of a specific terminal device 10 among the terminal devices 10[1] to 10[n], the specific terminal device 10 sends an end trigger to the server device 30. When the signal is transmitted and the end trigger signal is received by the server device 30, the conditions for ending the general conference are established. Alternatively, the conditions for ending the general conference may be met when the current time reaches a predetermined end set time. If the end condition of the general conference is not satisfied (N of step S16), the process proceeds from step S16 to step S17. proceed to

In step S17, the conference period setting unit 120 confirms whether the conditions for starting the x-th group conference are met. The x-th group meeting refers to the x-th group meeting that can be held during the holding period of the general meeting. The conditions for starting the x-th group conference may be arbitrary conditions predetermined in the conference system SYS. For example, in response to an input operation to the operation unit 15 of one or more terminal devices 10 (an operation requesting or instructing the start of the x-th group conference), it is transmitted from the one or more terminal devices 10 to the server device 30 and Based on the signal received at 30, the conference duration setting unit 120 confirms whether the conditions for starting the x-th group conference are met. More specifically, for example, a group conference is held between terminal devices 10[1] and 10[2] based on input operations to operation units 15[1] and 15[2] by persons PS[1] and PS[2]. are mutually exchanged through the server device 30, the conditions for starting the x-th group conference are established, and in this case, the members of the x-th group channel are the persons PS[1] and PS[2 ] becomes.

If the conditions for starting the x-th group conference are satisfied in step S17 (Y in step S17), the process proceeds from step S17 to step S18. ), the process proceeds from step S17 to step S19.

In step S18, the server control unit 33 executes group conference start processing. In the group conference start process, the processes of steps S31 to S35 in FIG. 19 are sequentially executed. In the group conference start process, first, the value of the variable x is substituted for the variable y managed by the server control unit 33 in step S31. In the subsequent step S32, the channel setting unit 130 sets the y-th group channel, and in step S33, the recording control unit 150 sets the recording area 52 for the y-th group channel. The recording area 52 for the y-th group channel set here is a kind of the recording area 52 shown in FIG. =2" corresponds to the recording area 52b in FIG.

When the recording area 52 for the y-th group channel is set, the recording control unit 150 starts recording the meeting data of the y-th group channel in the recording area 52 for the y-th group channel in step S34. Recording is started here for the audio data AD_G and the image data VD_G in the meeting data of the y-th group channel. Although the timing of recording the additional data DD_G in the recording area 52 is arbitrary, for example, the additional data DD_G is recorded in the recording area 52 at the stage of step S34 or at the stage when the recording of the meeting data of the y-th group channel is finished. Good to be recorded. At step S35, 1 is added to the variable x. The group conference start process ends when the processes of steps S31 to S35 are completed, and then the process proceeds to step S19 in FIG.

In step S<b>19 , the conference period setting unit 120 confirms whether or not any of the group conferences that are being held satisfies the conditions for ending the group conferences. For example, if only the first group meeting is being held as a group meeting, only the success or failure of the termination condition of the first group meeting is confirmed in step S19, and the first and second group meetings are being held as group meetings. If there is, it is checked in step S19 whether the conditions for ending the first group conference and the conditions for ending the second group conference are met. The conditions for ending the j-th group conference may be arbitrary conditions predetermined by the conference system SYS (j is an arbitrary natural number). For example, when the members of the j-th group channel corresponding to the j-th group meeting are the persons PS[1] and PS[2], an input operation to the operation unit 15[1] or 15[2] (j-th group Based on a signal transmitted from the terminal device 10[1] or 10[2] to the server device 30 and received by the server device 30 in response to an operation for requesting or instructing the end of the conference, the conference period setting unit 120 Check whether the conditions for ending the j-th group meeting are met.

Only when one or more group conferences are being held at the stage of step S19 and the conditions for ending one of the group conferences being held are satisfied (step S19 Y) The process proceeds to step SS20, otherwise (N in step S19) the process returns to step S16.

In step S20, the server control unit 33 executes group conference end processing. In the group conference ending process, the processes of steps S51 to S54 in FIG. 20 are sequentially executed. In the group conference termination process, first, in step S51, the group channel number of the satisfied termination condition is substituted for the variable z managed by the server control unit 33 . That is, when the condition for ending the j-th group meeting is established in step S19 and the process reaches step S20, the value of j is substituted for the variable z. After that, in step S52, the recording control unit 150 finishes recording the conference data of the z-th group channel to the recording device 50 (recording area 52). That is, for example, when focusing on the first group conference (that is, when considering "y=z=1"), the recording of the audio data AD_G and the image data VD_G of the first group channel started in step S34 of FIG. Recording to the device 50 (recording area 52) ends in step S52. The same applies to the second group meeting and the like.

Thereafter, in step S53, the authentication information setting unit 160 sets authentication information PW_G[z], which is authentication information associated with the meeting data of the z-th group channel. Authentication information PW_G[z] is issued to each terminal device 10 corresponding to the z-th group channel. That is, for example, if the members of the z-th group channel are persons PS[1] and PS[2], the authentication information setting unit 160 sets terminal device 10[1] corresponding to persons PS[1] and PS[2]. ] and 10[2]. In response to this, the authentication information PW_G[z] is displayed on the display screens 14[1] and 14[2], and stored in the storage units 12[1] and 12[2] as necessary. In step S54 following step S53, the authentication information setting unit 160 stores the set authentication information PW_G[z] in an authentication information storage area (not shown) in the recording device 50 in association with the meeting data of the z-th group channel. save. Information automatically generated by the authentication information setting unit 160 using a random number or the like may be set as the authentication information PW_G[z]. [z] may be defined.

The group conference ending process ends when the processes of steps S51 to S54 are completed, and then the process returns to step S16 in FIG.

The operation after shifting from step S16 to step S21 will be described. In step S21, the recording control unit 150 finishes recording the conference data of the general channel into the recording device 50 (recording area 51). That is, the recording of the audio data AD_W and the image data VD_W of all the channels, which was started in step S14, to the recording device 50 (recording area 51) ends in step S21.

After that, in step S22, the authentication information setting unit 160 sets the authentication information PW_W, which is the authentication information associated with the conference data of the general channel. The authentication information PW_W is issued to all terminal devices 10 corresponding to each constituent member of the entire channel. That is, the authentication information setting unit 160 transmits the authentication information PW_W to each of the terminal devices 10[1] to 10[n] corresponding to the persons PS[1] to PS[n]. In response to this, the authentication information PW_W is displayed on each of the display screens 14[1] to 14[n] and stored in the storage units 12[1] to 12[n] as required. In step S23 following step S22, the authentication information setting unit 160 stores the set authentication information PW_W in an authentication information storage area (not shown) in the recording device 50 in association with the conference data of the general channel. Information automatically generated by the authentication information setting unit 160 using random numbers or the like may be set as the authentication information PW_W, or any member of the entire channel may operate the operation unit 15 to determine the authentication information PW_W. . A series of operations related to the recording of the conference data ends when the process of step S23 ends.

In addition, it is assumed that the transition to step S21 is restricted so that the conditions for ending the general conference are not satisfied while one or more group conferences are being held.

FIG. 21 is a conceptual diagram of the flow of recording conference data in case α. In case α, first and second group conference holding periods that do not overlap each other are set during one general conference holding period. Case α corresponds to the case shown in FIG. In case α, as time progresses, times t _S0 , t _S1 , t _E1 , t _S2 , t _E2 , t _{E0 arrive} in this order. Referring to FIG. 21, the flow of recording conference data in case α will be described (see FIGS. 18 to 20 as appropriate).

Recording of the conference data of the general channel to the recording area 51 is started by the start of the general conference holding period at time t _S0 (step S14). After that, when the conditions for starting the first group conference are met based on an input operation to the operation unit 15 by at least one of the persons PS[1] and PS[2] (Y in step S17 for the first time), the person PS[ 1] and PS[2] as constituent members are set (first step S32), and recording of the conference data of the first group channel in the recording area 52a is started from time _tS1 . (First step S34). After that, when at least one of the persons PS[1] and PS[2] performs an input operation to the operation unit 15 and the condition for ending the first group conference is met (Y in step S19 for the first time), time _tE1 . Recording of the conference data of the first group channel ends (first step S52), and authentication information PW_G[1] for the first group channel is set and issued (first step S53).

After that, when the conditions for starting the second group conference are met based on an input operation to the operation unit 15 by at least one of the persons PS[3] to PS[5] (Y in step S17 for the second time), A second group channel including only persons PS[3] to PS[5] as constituent members is set (second step S32), and the recording of the meeting data of the second group channel in the recording area 52b starts at time _tS2 . is started (second step S34). After that, when at least one of the persons PS[3] to PS[5] performs an input operation to the operation unit 15 and the condition for ending the second group conference is established (Y in step S19 for the second time), At time _tE2 , the recording of the conference data for the second group channel ends (second step S52), and the authentication information PW_G[2] for the second group channel is set and issued (second step S53). .

Further, after that, when the conditions for ending the general conference are established (Y in step S16), the holding period of the general conference ends at time _tE0 , and the recording of the general channel conference data in the recording area 51 ends (step S21). . Then, authentication information PW_W for all channels is set and issued (step S22). In case α, the constituent members of the entire channel are persons PS[1] to PS[n] between times _tS0 and _tS1 , between times _tE1 and _tS2 , and between times _tE2 and _tE0 . Persons PS[3] to PS[n] between _tS1 and _tE1 , and persons PS[1], PS[2] and PS[6] to PS[n] between times _tS2 and _tE2 ] ("n≧6" is assumed in the case α).

Next, a flow of operations related to reproduction of conference data after recording of the conference data of all channels and the conference data of the first and second group channels according to case α is completed will be described. As described above, the playback device 10R (see FIG. 17) can be any one of the terminal devices 10[1] to 10[n], and can be different from any of the terminal devices 10[1] to 10[n]. , here, it is assumed that the playback device 10R is one of the terminal devices 10[1] to 10[n].

Referring to FIG. 22(a), the flow of operations for transmitting and reproducing conference data for all channels will be described. When the user of the playback device 10R inputs a transmission request operation requesting transmission of the conference data of the general channel together with the authentication information PW_W to the operation unit 15 of the playback device 10R, the terminal control unit 13 of the playback device 10R starts the conference of the general channel. A transmission request signal 610 , which is a signal requesting transmission of data and includes authentication information PW_W, is transmitted to the server device 30 . A user of the playback device 10R is assumed to be any member of the entire channel (that is, any of the persons PS[1] to PS[n]).

After the authentication processing unit 210 (see FIG. 8) completes the recording of the conference data of the general channel and the conference data of the first and second group channels according to the case α, the server device 30 receives the transmission request signal 610. Then, the authentication information PW_W included in the transmission request signal 610 is collated with the authentication information PW_W stored in the authentication information storage area (see step S23 in FIG. 18) and corresponding to the conference data of the general channel. Then, when the authentication information of both match each other, a matching OK signal 612 for the transmission request signal 610 is output to the reproduction transmission control section 220 . Although different from the situation shown in FIG. 22A, if the authentication information included in the transmission request signal 610 is different from the authentication information PW_W, the verification OK signal 612 is not output.

Upon receiving the matching OK signal 612 for the transmission request signal 610, the reproduction transmission control unit 220 transmits conference data of the entire channel to the reproduction device 10R. When the reproduction apparatus 10R receives the conference data of the entire channel, it reproduces the conference data of the entire channel in response to the input of the reproduction request operation to the operation unit 15 of the reproduction apparatus 10R or regardless of whether or not the reproduction request operation is input. do. In the reproduction of the conference data of all channels, the sound represented by the audio data AD_W is output from the speaker 18 of the reproduction device 10R, and in synchronization with this, the image represented by the image data VD_W is displayed on the display screen 14 of the reproduction device 10R. to be displayed. That is, the appearance of the general conference is reproduced on the reproduction device 10R. Further, in the reproduction of the conference data of the general channel, the additional data DD_W is displayed on the display screen 14 of the reproduction device 10R. The user of the playback device 10R can recognize additional information (general conference participant information, date and time information, etc.) regarding the general conference by viewing the additional data DD_W.

With reference to FIG. 22(b), the flow of transmission and playback operations of the conference data of the first group channel will be described. When the user of the playback device 10R inputs a transmission request operation requesting transmission of the conference data of the first group channel along with the authentication information PW_G[1] to the operation unit 15 of the playback device 10R, the terminal control unit 13 of the playback device 10R , a transmission request signal 620 requesting transmission of the conference data of the first group channel and including the authentication information PW_G[1] is transmitted to the server device 30 . As a user of the playback device 10R, one of the constituent members of the first group channel (that is, person PS[1] or PS[2]; see FIG. 21) is assumed.

After the authentication processing unit 210 (see FIG. 8) completes the recording of the conference data of the general channels and the conference data of the first and second group channels according to the case α, the server device 30 receives the transmission request signal 620. , the authentication information PW_G[1] included in the transmission request signal 620, and the authentication information stored in the authentication information storage area (see step S23 in FIG. 18) and corresponding to the conference data of the first group channel. Information PW_G[1] is collated, and if both authentication information match each other, collation OK signal 622 for transmission request signal 620 is output to reproduction transmission control section 220 . Although different from the situation shown in FIG. 22B, if the authentication information included in the transmission request signal 620 is different from the authentication information PW_G[1], the verification OK signal 622 is not output.

Upon receiving the matching OK signal 622 for the transmission request signal 620, the reproduction transmission control unit 220 transmits the conference data of the first group channel to the reproduction device 10R. When the playback device 10R receives the conference data of the first group channel, it responds to the input of the playback request operation to the operation unit 15 of the playback device 10R, or regardless of the presence or absence of the input of the playback request operation. Play meeting data. In the reproduction of the conference data of the first group channel, the sound represented by the audio data AD_G is output from the speaker 18 of the reproduction device 10R, and in synchronization with this, the image represented by the image data VD_G is displayed on the reproduction device 10R. displayed on the screen 14. However, the audio data AD_G and the image data VD_G here are the audio data AD_G and the image data VD_G in the conference data of the first group channel. Therefore, the appearance of the first group meeting is reproduced on the playback device 10R. Further, in reproducing the conference data of the first group channel, the additional data DD_G in the conference data of the first group channel is displayed on the display screen 14 of the reproduction device 10R. The user of the playback device 10R can recognize additional information (group conference participant information, date and time information, etc.) regarding the first group conference by viewing the additional data DD_G. Focusing on the first group channel, the operations involved in reproducing the conference data of the group channel have been described, but the same applies to the case of reproducing the conference data of other group channels.

Thus, in the conference system SYS, conference data can be recorded for each channel, and conference data can be reproduced for each channel. Therefore, the participants of the conference can easily and conveniently confirm the content of the conference at any timing after the conference ends.

At this time, authentication information is issued for each channel, and conference data is provided to the playback device 10R after authentication for each channel. Therefore, high safety can be provided. In particular, when a highly confidential group meeting is held, it should be avoided that the content of the group meeting is leaked to others. In this embodiment, since the authentication information is set independently for the group channel as well, the above situation can be reliably avoided.

Further, when the conference data is reproduced by the reproduction device 10R, the additional data (DD_W or DD_G) is displayed, so that it is possible to check the conference situation in detail including the additional information.

<<Second embodiment>>
A second embodiment will be described. In the second embodiment, the personal voice data acquisition unit 170 shown in FIG. 8 and the operation using it will be described.

The personal voice data acquisition unit 170 acquires, for each person, personal voice data individually representing the content of the speeches of the persons PS[1] to PS[n] during the general conference. Personal voice data for a person PS[i] is particularly referred to as personal voice data AD[i] (i is any natural number equal to or less than n). Personal voice data AD[1] to AD[n] are obtained by the personal voice data acquisition unit 170 . The personal voice data AD[i] represents the contents of the speech of the person PS[i] during the holding of the general conference.

The personal voice data acquisition unit 170 acquires personal voice data AD[i] based on the voice signal AS[i] (see FIG. 6) during the general conference. During the general conference, there are a period during which the person PS[i] speaks (hereinafter referred to as an utterance period) and a period during which the person PS[i] is silent (hereinafter referred to as a silence period). mixed. Silence intervals are also referred to as silence intervals. Acquisition unit 170 detects the speech period of person PS[i] based on the intensity, spectrum, etc. of audio signal AS[i]. Since the detection method of the speech period based on the voice signal is well known, the description of the detection method is omitted. During the general conference holding period, the acquisition unit 170 includes the voice signal AS[i] during the utterance period of the person PS[i] in the personal voice data AD[i], and the voice signal during the silence period of the person PS[i]. AS[i] is not included in personal audio data AD[i]. However, some of the voice signal AS[i] during the silence period of the person PS[i] may be included in the personal voice data AD[i]. In any case, the audio signal AS[i] in most of the silence period of the person PS[i] (part of the silence period of the person PS[i]) is not included in the personal audio data AD[i].

An example is given in FIG. The example of FIG. 23 is referred to as case β for convenience. As time progresses, the times t _S0 , t _A1 , t _A2 , t _A3 , t _A4 , t _A5 , t _A6 , t _E0 shall be visited in that order. In case β, the period 641 between times t _A1 and t _A2 , the period 642 between times t _A3 and t _A4 , and the period between times t _A5 and t _A6 in the general conference holding period between times t _S0 and t _E0 Only the period 643 of is detected as the utterance period of the person PS[1]. In this case, personal voice data acquisition section 170 acquires voice signal AS[1]_a, which is voice signal AS[1] in utterance period 641, and voice signal AS[1], which is voice signal AS[1] in utterance period 642. _b and the audio signal AS[1]_c, which is the audio signal AS[1] in the utterance period 643, are combined along the time series to acquire the audio signal as the personal audio data AD[1]. Personal voice data AD[2] and the like are also obtained in the same manner.

The personal voice data acquisition unit 170 creates and acquires personal voice data AD[1] to AD[n] during the general conference period or without delay after the general conference period ends. The recording control unit 150 records the created personal audio data AD[1] to AD[n] in the personal audio data recording area 53 in the storage device 50 (see FIG. 24). After that, the reproduction transmission control unit 220 can execute selective transmission processing for selectively transmitting any one of the personal audio data AD[1] to AD[n] to the reproduction device 10R. In the reproducing device 10R, the received personal audio data is reproduced (that is, the audio represented by the received personal audio data is output from the speaker 18).

As a result, for example, it is possible to respond to a desire to intensively check only the statements of a certain person in an electronic conference, which is highly convenient.

In the selective transmission process, any one of the personal audio data AD[1] to AD[n] is selectively transmitted to the reproduction device 10R in response to receiving a predetermined transmission request signal from the reproduction device 10R. At this time, the aforementioned authentication information may be used to control whether or not to transmit. This will be specifically described by taking the case α in FIG. 21 and the case β in FIG. 23 as examples. Now, of the speech segments 641 to 643 shown in FIG. 23, only the speech segment 641 is included in the period between times t _S1 and t _E1 (see FIG. 21) during which the first group conference is held. do.

With reference to FIGS. 25(a) and 25(b), the flow of transmission and reproduction operations for personal audio data AD[1] will be described. When the user of the reproducing device 10R inputs a transmission request operation for requesting transmission of the personal audio data AD[1] along with the authentication information PW_W to the operation unit 15 of the reproducing device 10R, as shown in FIG. terminal control unit 13 transmits to server device 30 a transmission request signal 660 which is a signal requesting transmission of personal voice data AD[1] and includes authentication information PW_W. A user of the playback device 10R is assumed to be any member of the entire channel (that is, any of the persons PS[1] to PS[n]).

When the server device 30 receives the transmission request signal 660, the authentication processing unit 210 (see FIG. 8) stores the authentication information PW_W included in the transmission request signal 660 and the authentication information storage area (see step S23 in FIG. 18). against each credential stored in . Here, since the authentication information included in the transmission request signal 660 matches each authentication information PW_W saved in the authentication information storage area, the matching OK signal 662 is output from the authentication processing unit 210 to the reproduction transmission control unit 220. .

Upon receiving the collation OK signal 662, the reproduction transmission control unit 220 transmits to the reproduction device 10R only the individual audio data AD[1] related to the entire channel. That is, the personal audio data AD[1]' including only the audio signals AS[1]_b and AS[1]_c in FIG. 23 is transmitted to the reproducing device 10R. This is because the authentication information PW_W is not given the playback authority for the electronic conference of the first group channel. When the reproduction device 10R receives the personal audio data AD[1]′, the reproduction device 10R reproduces the personal audio data AD[1]′ in response to the input of the reproduction request operation to the operation unit 15 of the reproduction device 10R or regardless of whether or not the reproduction request operation is input. [1]' is reproduced. In reproducing the individual audio data AD[1]', the audio represented by the individual audio data AD[1]' is output from the speaker 18 of the reproducing device 10R. At this time, if the image data VD_W is also received by the reproduction device 10R, the image represented by the image data VD_W is displayed on the display screen of the reproduction device 10R in synchronization with the reproduction of the personal audio data AD[1]'. 14.

On the other hand, when the user of the playback device 10R inputs a transmission request operation requesting transmission of the personal audio data AD[1] along with the authentication information PW_G[1] to the operation unit 15 of the playback device 10R, the operation shown in FIG. 25(b) is performed. As described above, the terminal control unit 13 of the reproducing device 10R transmits to the server device 30 a transmission request signal 670 which is a signal requesting transmission of the personal audio data AD[1] and which includes the authentication information PW_G[1]. As a user of the playback device 10R, one of the constituent members of the first group channel in the example of case α (that is, person PS[1] or PS[2]; see FIG. 21) is assumed.

When the server device 30 receives the transmission request signal 670, the authentication processing unit 210 (see FIG. 8) stores the authentication information PW_G[1] included in the transmission request signal 670 and the authentication information storage area (step in FIG. 18). (see S23)). Here, since the authentication information included in the transmission request signal 670 matches each authentication information PW_G[1] stored in the authentication information storage area, the verification OK signal 672 is sent from the authentication processing unit 210 to the reproduction transmission control unit 220. output.

Upon receiving the verification OK signal 672, the reproduction transmission control unit 220 transmits the entire personal audio data AD[1] to the reproduction device 10R. That is, personal audio data AD[1] including audio signals AS[1]_a, AS[1]_b and AS[1]_c in FIG. 23 is transmitted to the reproducing device 10R. When the reproduction device 10R receives the personal audio data AD[1], it reproduces the personal audio data AD[1] in response to the input of the reproduction request operation to the operation unit 15 of the reproduction device 10R or regardless of whether the reproduction request operation is input or not. 1] is played. In reproducing the individual audio data AD[1], the audio represented by the individual audio data AD[1] is output from the speaker 18 of the reproducing device 10R. At this time, if the image data VD_W and the image data VD_G for the first group channel are also received by the playback device 10R, then the image data VD_W or VD_G will be used in synchronization with the playback of the individual audio data AD[1]. The represented image is displayed on the display screen 14 of the playback device 10R. The same is true for other group channels.

If the authentication information included in the transmission request signal 660 is different from any of the authentication information PW_W, PW_G[1], and PW_G[2], the verification OK signal is not output, and none of the personal voice data is transmitted to the playback device. 10R is not sent. The same applies to the transmission request signal 670 . Although the flow of the transmission and reproduction operations for the personal audio data AD[1] has been described, the transmission and reproduction operations for the personal audio data AD[2] and the like are performed in the same flow as described above. It is also possible to request transmission of two or more pieces of personal audio data in one transmission request signal. In this case, two or more pieces of personal audio data are transmitted from the server device 30 to the reproducing device 10R.

In the case where no group conference description period is provided during the general conference holding period, or all the utterance periods of the person PS[1] belong to the non-holding period of the group conference (that is, the normal period in FIG. 9). In this case, the audio signals AS[1]_a, AS[1]_b and AS[1]_c in FIG. is transmitted to the reproducing device 10R, and the personal audio data AD[1] is reproduced by the reproducing device 10R.

<<Third embodiment>>
A third embodiment will be described. In the second embodiment, the personal audio data AD[i] may be an audio signal having a length corresponding to the general conference period. It is the signal AS[i] itself. In relation to this, the recording control unit 150 may record the audio signals AS[1] to AS[n] themselves individually in the recording device 50. FIG.

<<Fourth Embodiment>>
A fourth embodiment will be described. In the fourth embodiment, functions of the sound adjusting section 230 of FIG. 8 will be described. The sound adjustment unit 230 can execute sound adjustment processing for adjusting the reproduction volume or the reproduction sound quality in the reproduction device 10R when the conference data of the entire channel is reproduced in the reproduction device 10R. Sound adjustment processing may be performed for each electronic conference channel. That is, in the example of case α in FIG. The playback sound quality and the playback volume or playback sound quality when the conference data of the second group channel is played back may be individually adjusted.

The sound adjustment process according to the fourth embodiment will be described with attention paid to the example of FIG. 22(a). In the example of FIG. 22(a), upon receiving the matching OK signal 612 for the transmission request signal 610, the reproduction transmission control unit 220 transmits conference data of the entire channel to the reproduction device 10R. Prior to this transmission, the sound adjustment unit 230 reads the audio data AD_W of all channels from the recording device 50, and executes sound adjustment processing on the read audio data AD_W. After that, the audio data AD_W after the sound adjustment processing is transmitted to the reproduction device 10R as part of the conference data of all channels. Therefore, in the reproduction device 10R, the audio data AD_W after the sound adjustment processing is reproduced (output from the speaker 18).

Regarding the audio data AD_W, the method and contents of adjustment of the reproduction volume or reproduction quality in the sound adjustment process are arbitrary. For example, when the audio data AD_W after the sound adjustment processing is reproduced by the reproduction device 10R, the audio data AD_W is adjusted so that the average level or the maximum level of the reproduction volume from the speaker 18 becomes a predetermined appropriate level. Adjustment processing is performed. As a result, the reproduction volume is adjusted when the audio data AD_W (the first audio data representing the contents of utterances of each member of the entire channel) is reproduced by the reproduction device 10R. Further, for example, the sound adjustment unit 230 executes, as one of the sound adjustment processes, a compression process for compressing the audio data AD_W so that the amount of data per unit time of the audio data AD_W after the sound adjustment process is equal to or less than a predetermined amount. can. The reproduced sound quality is adjusted by adjusting the compression rate in this compression process. However, adjustment of the reproduced sound quality is optional, such as low-frequency enhancement or high-frequency enhancement of the audio data AD_W.

The sound adjustment processing according to the fourth embodiment will be described with attention paid to the example of FIG. 22(b). In the example of FIG. 22(b), upon receiving the verification OK signal 622 for the transmission request signal 620, the reproduction transmission control section 220 transmits the conference data of the first group channel to the reproduction device 10R. However, prior to this transmission, the sound adjustment unit 230 reads out the audio data AD_G of the first group channel from the recording device 50, and executes sound adjustment processing on the read audio data AD_G. After that, the audio data AD_G after the sound adjustment processing is transmitted to the reproducing device 10R as part of the conference data of the first group channel. Therefore, in the reproduction device 10R, the audio data AD_G after the sound adjustment processing is reproduced (output from the speaker 18).

Regarding the audio data AD_G, the method and contents of adjustment of the reproduction volume or reproduction quality in the sound adjustment process are arbitrary. For example, when the audio data AD_G after the sound adjustment processing is reproduced by the reproduction device 10R, the audio data AD_G is adjusted so that the average level or the maximum level of the reproduction volume from the speaker 18 becomes a predetermined appropriate level. Adjustment processing is performed. As a result, the reproduction volume is adjusted when the audio data AD_G (the second audio data representing the contents of the utterances of the constituent members of the first group channel) is reproduced by the reproduction device 10R. Further, for example, the sound adjustment unit 230 executes, as one of the sound adjustment processes, a compression process for compressing the audio data AD_G so that the amount of data per unit time of the audio data AD_G after the sound adjustment process is equal to or less than a predetermined amount. can. The reproduced sound quality is adjusted by adjusting the compression rate in this compression process. However, adjustment of the reproduced sound quality is optional, such as low-frequency enhancement or high-frequency enhancement of the audio data AD_G.

The sound adjustment processing described above makes it possible to reproduce the content of the conference in an easy-to-hear manner for each channel.

<<Fifth embodiment>>
A fifth embodiment will be described. In the fifth embodiment, an application technique related to the sound adjustment processing shown in the fourth embodiment will be described.

Consider the example of case α in FIG. In case α, the audio data AD_G of the first group channel corresponds to the synthesized signal of the audio signals AS[1] and AS[2] during the holding period of the first group meeting (that is, between times _tS1 and _tE1 ). Therefore, the signal component of the audio signal AS[1] and the signal component of the audio signal AS[2] are included. Here, depending on the sound pickup condition of the microphone 17 during the electronic conference, the signal strength of the output audio signal AS[1] of the terminal device 10[1] is relatively large, while the signal strength of the terminal device 10[2] is relatively high. It may also occur that the signal strength of the output audio signal AS[2] is relatively small. In such a case, when a simple synthesis of the audio signal AS[1] and the audio signal AS[2] is transmitted to the playback device 10R and played back, the utterance content of the person PS[2] is changed to that of the person PS[ 1], it may be difficult to hear. In order to avoid such a situation, the sound adjustment unit 230 according to the fifth embodiment, in the sound adjustment process, adjusts the person PS[1] when the audio data AD_G of the first group channel is reproduced by the reproduction device 10R. And the playback volume of the utterance content of PS[2] is adjusted for each person.

Focusing on case α in FIG. 21, the sound adjustment processing according to the fifth embodiment will be described more specifically. Here, the audio data AD_G of the i-th group channel is specifically referred to by the symbol "AD_G[i]". In case α, audio signals AS[1] and AS[2] between times _tS1 and _tE1 are included in audio data AD_G[1] and recorded in the recording area 52a.

In the example of FIG. 22(b), upon receiving the verification OK signal 622 for the transmission request signal 620, the reproduction transmission control section 220 transmits the conference data of the first group channel to the reproduction device 10R. However, prior to this transmission, the sound adjustment unit 230 reads the audio data AD_G[1] of the first group channel from the recording device 50, and executes sound adjustment processing on the read audio data AD_G[1]. For clarity of explanation, the sound data AD_G[1] before the sound adjustment processing is referred to by the symbol "AD_G[1]_BF", and the sound data AD_G[1] after the sound adjustment process is referred to by the symbol "AD_G[1] _AFT”. It is assumed that between times t _S1 and t _E1 , one or more utterance segments of person PS[1] exist, and one or more utterance segments of person PS[2] exist.

The sound adjustment unit 230 calculates the statistic value of the signal intensity of the audio signal AS[1] during the speech period of the person PS[1] between times t _S1 and t _E1 and the signal intensity of the person PS[2] between times t _S1 and t _E1 . ] and the signal intensity of the audio signal AS[2] during the utterance section of ], and volume adjustment processing for matching these two statistical values is defined as audio data AD_G[1]_BF to generate audio data AD_G[1]_AFT. The above statistics may be averages or maximums. In the example of FIG. 22(b), the conference data of the first group channel including the audio data AD_G[1]_AFT is transmitted to the reproducing device 10R and reproduced by the reproducing device 10R. Therefore, in the reproducing device 10R, the audio data AD_G[1] (that is, AD_G[1]_AFT) after sound adjustment processing is reproduced. At this time, the reproduction volume of the utterance content of the person PS[1] and the reproduction volume of the utterance content of the person PS[2] approximately match, making it easier to hear. In the sound adjustment processing for the audio data AD_G[1], the signal strength of the audio signals AS[1] and AS[2] read out from the recording device 50 are individually adjusted, and the utterances of the persons PS[1] and PS[2] are adjusted. Content playback volume can be adjusted individually (ie per person). The reproduction volume can be similarly adjusted for the audio data AD_G of the second group channel.

It is possible to similarly adjust the reproduction volume for the audio data AD_W of all channels. Here, for convenience of explanation, it is assumed that no group conference was held between times t _S0 and t _E0 (that is, no group channel was set), and the sound adjustment processing for the audio data AD_W will be explained. do. Under this assumption, audio signals AS[1] to AS[n] between times t _S0 and t _E0 are included in audio data AD_W and recorded in recording area 51 .

In the example of FIG. 22(a), upon receiving the matching OK signal 612 for the transmission request signal 610, the reproduction transmission control unit 220 transmits conference data of the entire channel to the reproduction device 10R. Prior to this transmission, the sound adjustment unit 230 reads the audio data AD_W of all channels from the recording device 50, and executes sound adjustment processing on the read audio data AD_W. For clarity of explanation, the sound data AD_W before the sound adjustment processing is referred to by the symbol "AD_W_BF", and the sound data AD_W after the sound adjustment process is referred to by the symbol "AD_W_AFT". It is assumed that between times t _S0 and t _E0 , there are one or more utterance intervals for each of person PS[1] to person PS[n].

The sound adjustment unit 230 calculates the statistic value of the signal strength of the audio signal AS[1] during the utterance period of the person PS[1] between times t _S0 and t _E0 and the signal intensity of the person PS[2] between times t _S0 and t _E0 . _{] ,} and . strength statistic value, and a volume adjustment process for matching the total n statistic values as a sound adjustment process to the audio data AD_W_BF between time t _S0 and t _E0 , thereby obtaining a sound data AD_W_BF at time t _S0 and _tE0 to generate audio data AD_W_AFT. The above statistics may be averages or maximums. In the example of FIG. 22(a), conference data of all channels including audio data _{AD_W_AFT} between times _tS0 and tE0 is transmitted to the reproducing device 10R and reproduced by the reproducing device 10R. Therefore, in the reproduction device 10R, the audio data AD_W (that is, AD_W_AFT) after sound adjustment processing is reproduced. At this time, the reproduction volumes of the utterances of the persons PS[1] to PS[n] are generally the same, making it easier to hear. In the sound adjustment processing for the audio data AD_W, the utterance contents of the persons PS[1] to PS[n] are reproduced through individual adjustment of the signal strength of the audio signals AS[1] to AS[n] read from the recording device 50. The volume can be adjusted individually (ie per person).

For convenience of explanation, the sound adjustment processing for the audio data AD_W has been described on the assumption that no group conference was held between times _tS0 and _tE0 , but the same applies to the case where a group conference is held. be. However, since the voice signals of the members of the group channel are not included in the voice data AD_W during the period of the group conference, the voice signals of the members of the group channel are not considered in the volume adjustment process for the voice data AD_W. Therefore, for example, for case α in FIG. 21, volume adjustment processing for the audio signal between times t _S1 and t _E1 is as follows. That is, the statistic value of the signal strength of the audio signal AS[3] during the utterance period of the person PS[3] between the times _tS1 and _tE1 and the utterance period of the person PS[4] between the times _tS1 and _tE1 , and the statistical value of the signal strength of the audio signal AS[n] during the utterance interval of the person PS[n] between times _tS1 and _tE1 , is applied to the audio data AD_W_BF between times t _S1 and t _E1 as sound adjustment processing to match the total (n−2) statistical values, thereby obtaining the sound data AD_W_BF at time t _S1 and t _E1 to generate audio data AD_W_AFT.

According to the sound adjustment processing (volume adjustment processing) according to the fifth embodiment, it is possible to reproduce the content of each person's speech in a manner that is easy to hear.

Note that the sound adjustment processing according to the fourth or fifth embodiment may be performed by the playback device 10R. In this case, the sound adjustment unit 230 described as being provided in the server device 30 may be provided in the reproduction device 10R. The sound adjusting unit 230 performs sound adjustment processing, and the audio data AD_W or AD_G after the sound adjustment processing may be reproduced using the speaker 18 .

<<Sixth Embodiment>>
A sixth embodiment will be described. Under certain conditions, the conference data of the group channel may be recorded not in the recording device 50 but in the terminal devices 10 of the members of the group channel.

For example, when "x=1" in the flowchart of FIG. At that time, it further confirms whether or not a predetermined confidentiality condition is met. When the members of the first group channel are persons PS[1] and PS[2], if necessary, the person PS[1] issues a concealment instruction to the terminal device 10[1] by operating the operation unit 15[1]. ], and when a confidentiality instruction is input to the terminal device 10[1], the confidentiality instruction is transmitted from the terminal device 10[1] to the server device 30. FIG. The confidentiality condition is established when the confidentiality instruction is transmitted to the server device 30 . Similarly, when the person PS[2] inputs a concealment instruction to the terminal device 10[2], the concealment condition is satisfied.

When the condition for starting the first group conference is satisfied, the server control unit 33 does not record the conference data of the first group channel in the recording device 50 if the confidentiality condition is also satisfied. Instead, the server control unit 33 sets the terminal devices 10 of one or more of the constituent members of the first group channel as transmission target terminals, and transmits the conference data of the first group channel to the transmission target terminals. do. If the members of the first group channel are persons PS[1] and PS[2], at least one of terminal devices 10[1] and 10[2] is set as a transmission target terminal. The transmission of the conference data of the first group channel to the transmission target terminal may be performed in real time during the electronic conference of the first group channel, or may be performed after a certain amount of delay. The terminal device 10 set as the transmission target terminal stores the received conference data of the first group channel in the non-volatile memory within the storage unit 12 . Although attention has been paid to the first group channel, the same is true for the other group channels.

Confidentiality can be enhanced by saving conference data related to top-secret content not in the recording device 50 but in the terminal devices 10 of persons belonging to the group channel.

<<Seventh Embodiment>>
A seventh embodiment will be described. In the seventh embodiment, modification techniques or supplementary matters applicable to each of the above-described embodiments will be described.

During the electronic conference, the terminal devices 10[1] to 10[n] may be distributed in various places. For example, some of the terminal devices 10[1] to 10[n] are located at the workplace of the corresponding person PS, and some of the terminal devices 10[1] to 10[n] are located at the home of the corresponding person PS. placed in Still another part of the terminal devices 10[1] to 10[n] may be placed in a vehicle driven by the corresponding person PS. In other words, the person PS[i] who is one of the persons PS[1] to PS[n] may participate in the electronic conference from the vehicle. In this case, the position information of the vehicle driven by the person PS[i] may be included in the additional data DD_W.

A conference system SYS for recording conference data during an electronic conference functions as an electronic conference recording system. 10[1] to 10[n].

The electronic conference reproduction system functions beneficially in the stage of reproducing the conference data after the end of the electronic conference holding period. The electronic conference playback system includes a server device 30, which is an example of an electronic conference management device, a recording device 50, and a playback device 10R. If any one of the terminal devices 10[1] to 10[n] is the playback device 10R, the electronic conference recording system and the electronic conference playback system are configured with common elements.

A specific program that defines arbitrary specific processing and specific operations to be implemented in the server device 30, the terminal device 10, or the playback device 10R is created, and the specific program is executed in the server device 30, the terminal device 10, or the playback device 10R. The specific processing and the specific operation may be realized by executing them in an arithmetic processing device provided in the . The terminal program PG1 stored in the storage unit 120 in FIG. 2 or the server program PG2 stored in the storage unit 32 in FIG. 3 are examples of the specific program.

The embodiments of the present invention can be appropriately modified in various ways within the scope of the technical idea indicated in the scope of claims. The above embodiments are merely examples of the embodiments of the present invention, and the meanings of the terms of the present invention and each constituent element are not limited to those described in the above embodiments. The specific numerical values given in the above description are merely examples and can of course be changed to various numerical values.

<<Appendix>>
A supplementary note is provided for the present invention.

An electronic conference management apparatus (30) according to one aspect of the present invention uses a plurality of terminal devices (10[1] to 10[n]) connected to each other via a network (70) to provide a plurality of persons (PS[1 ] ~ PS [n]) in an electronic conference management device used for conducting an electronic conference,
A first channel (whole channel) for a first person group that can include all of the plurality of persons, and a second channel (group channel) for a second person group that includes only part of the plurality of persons a channel setting unit (130) to be set; 2. A recording control unit (150) for individually recording conference data in a recording device (50), and a reproduction device (10R) for reproducing the content of the first electronic conference or the content of the second electronic conference. a transmission control unit for reproduction (220) capable of individually transmitting the first conference data and the second conference data to the reproduction device, wherein the reproduction device is any one of the plurality of terminal devices; or _a configuration different from any of the plurality of terminal devices (hereinafter referred to as configuration W1).

In the electronic conference management device according to configuration W1, the _first authentication information (PW_W) associated with the first channel and the second authentication information (for example, PW_G[1]) associated with the second channel are set. and the reproduction transmission control unit transmits a first transmission request signal ( 610), or in response to receiving a second transmission request signal (620) containing the second authentication information from the playback device. may be configured to transmit the _second conference data to the playback device (hereinafter referred to as configuration W2).

SYS conference system 10 terminal device 30 server device 50 recording device 70 network 110 participant information acquisition unit 120 conference period setting unit 130 channel setting unit 140 conference data generation unit 150 recording control unit 160 authentication information setting unit 170 personal voice data acquisition unit 210 Authentication processing unit 220 Playback transmission control unit 230 Sound adjustment unit

Claims (12)

In an electronic conference management device used for conducting an electronic conference between a plurality of persons using a plurality of terminal devices connected to each other through a network,
a channel setting unit that sets a first channel for a first person group that can include all of the plurality of persons and a second channel for a second person group that includes only a part of the plurality of persons;
a recording control unit for individually recording first conference data indicating the content of a first electronic conference on the first channel and second conference data indicating the content of a second electronic conference on the second channel in a recording device;
For reproduction capable of individually transmitting the first conference data and the second conference data to the reproduction device so that the reproduction device can reproduce the content of the first electronic conference or the content of the second electronic conference a transmission control unit,
The electronic conference management apparatus, wherein the playback device is any one of the plurality of terminal devices, or is different from any of the plurality of terminal devices. further comprising an authentication information setting unit that sets first authentication information associated with the first channel and second authentication information associated with the second channel;
After the first electronic conference and the second electronic conference are finished, the reproduction transmission control unit responds to reception of a first transmission request signal including the first authentication information from the reproduction device to perform the first conference. transmitting data to the reproducing device; or transmitting the second conference data to the reproducing device in response to receiving a second transmission request signal including the second authentication information from the reproducing device. Item 1. The electronic conference management device according to item 1. further comprising a personal voice data acquisition unit that acquires a plurality of personal voice data of the plurality of persons by acquiring, for each of the persons, personal voice data individually representing the utterance content of the plurality of persons;
3. The electronic conference management apparatus according to claim 1, wherein said transmission control unit for reproduction can selectively transmit any one of said plurality of personal voice data to said reproduction apparatus. The first conference data includes first audio data representing utterance contents of the first group of persons on the first channel, and the second conference data represents utterance contents of the second group of persons on the second channel. 2 contains audio data,
4. The electronic conference management device according to any one of claims 1 to 3, further comprising a sound adjustment unit that adjusts a reproduction volume or a reproduction sound quality when the first audio data or the second audio data is reproduced by the reproduction device. The electronic conference management device according to any one of the above. The sound adjustment unit is configured to be able to individually adjust the reproduction volume of the utterance content of the first person group when the first audio data is reproduced, or when the second audio data is reproduced 5. The electronic conference management apparatus according to claim 4, wherein the reproduction volume of the utterance contents of said second group of persons in said group can be individually adjusted. The first conference data includes first audio data representing the content of the speech of the first person group on the first channel, first image data, and first additional data for the first electronic conference,
the first image data is image data of a conference image displayed on each terminal device assigned to the first person group in the first electronic conference;
The transmission control unit for reproduction controls the reproduction so that the first additional data can be displayed on the display screen of the reproduction device when the first audio data and the first image data are reproduced by the reproduction device. 6. The electronic conference management device according to any one of claims 1 to 5, wherein said first conference data is transmitted to said playback device in response to a request from said device. the second conference data includes second audio data representing the utterance content of the second group of people on the second channel, second image data, and second additional data for the second electronic conference;
the second image data is image data of a conference image displayed on each terminal device assigned to the second person group in the second electronic conference;
The transmission control unit for reproduction controls the reproduction so that the second additional data can be displayed on the display screen of the reproduction device when the second audio data and the second image data are reproduced by the reproduction device. 7. The electronic conference management device according to claim 1, wherein said second conference data is transmitted to said playback device in response to a request from said device. The second electronic conference is held during a part of the holding period of the first electronic conference,
During the period during which the first electronic conference is held, the first group of persons is composed of all of the plurality of persons during the period in which the second electronic conference is not held, and the plurality of persons during the period during which the second electronic conference is held. 8. The electronic conference management apparatus according to claim 1, wherein said first group of persons is formed by excluding said second group of persons from said group of persons. an electronic conference management device according to any one of claims 1 to 8;
the recording device;
and the plurality of terminal devices. an electronic conference management device according to any one of claims 1 to 8;
the recording device;
and the reproducing device capable of reproducing the first conference data or the second conference data by receiving the first conference data or the second conference data. In an electronic conference management method used for conducting an electronic conference between a plurality of persons using a plurality of terminal devices connected to each other through a network,
a channel setting step of setting a first channel for a first person group that can include all of the plurality of persons and a second channel for a second person group that includes only a part of the plurality of persons;
a recording control step of individually recording, in a recording device, first conference data indicating content of a first electronic conference on the first channel and second conference data indicating content of a second electronic conference on the second channel;
For reproduction capable of individually transmitting the first conference data and the second conference data to the reproduction device so that the reproduction device can reproduce the content of the first electronic conference or the content of the second electronic conference a transmission control step;
The electronic conference management method, wherein the playback device is any one of the plurality of terminal devices, or is different from any of the plurality of terminal devices. A program for implementing the electronic conference management method according to claim 11 in an arithmetic processing device.

Images