JPH08307417A - Recorder and reproducer for electronic conference - Google Patents

Abstract

PURPOSE: To shorten the reproduction time by evading reproduction of such persons, silent parts or shared windows that are not designated by the users. CONSTITUTION: The instructions of reproduction are given to a voice recording file reading part 2102 and a shared window recording file reading part 2202 via a reproduction control part 2001. Thus the part 2102 reads a necessary voice packet out of a voice recording file store part 1111 and turns it into a mixed voice packet at a mixture/synthesization part 1107. Then the mixed voices are outputted through a voice output part 1108. On the other hand, the part 2202 reads a section out of a shared window recording file store part 1210 at a speed instructed by the part 2001. Then the shared window display data outputted from the part 2202 can be quickly reproduced or reproduced synchronously with the voices under reproduction via a branch part 1206 when the section is read out at a speed instructed by the part 2001 and the operation information on the shared window is outputted.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a recording apparatus and a reproducing apparatus for an electronic conference using computer terminals between multiple points.

[0002]

2. Description of the Related Art Using a computer terminal connected to a network such as a workstation (WS) and a personal computer (PC), voices, images and sharing are made between those who are locally located at their desks. Practical application of an electronic conference system for conducting a conference through a window or the like has been attempted. At this time, if the contents of the conference are recorded, the contents of this conference can be confirmed at a later date. In the conventional recording / reproducing system, H.221, which is a standard for multimedia multiplexing, is used to record and reproduce the image, sound, and operation contents of a shared window transmitted from the other party (Reference: Masahide Shinozaki and others: "Multimedia conference system R
Real-time recording / playback method in TP "Proceedings of the 47th National Convention of Information Processing Society of Japan 1E-4 (1993)).

[0003]

However, the above-mentioned conventional recording apparatus for electronic conference and its reproducing apparatus have the following problems to be solved. That is, in the case of a conference between multiple points, it was not possible to record all of the conference participants including myself by the above method. You can also record and record this kind of meeting as it is,
When they were accumulated, the recording results became enormous, and it was not easy to reread them or record the points. In addition, there is a problem that it is not easy to search for a target place.

[0004]

A recording device for an electronic conference according to the present invention is an electronic conference terminal for transmitting and receiving a voiced voice signal by an electronic conference participant and operation information of a shared window operated by the electronic conference participant. Is provided in the terminal, accepts audio signals classified by unit time from other electronic conference terminals, and identifies time information for time synchronization between the unit audio signals and the source of each unit audio signal. An audio recording file creation unit that creates an audio recording file to which the sender information is added, and an audio recording file storage unit that stores the audio recording file are provided. Further, it accepts operation information of shared windows segmented by unit time from other electronic conference terminals, and operates at least when there is a plurality of shared windows and operator information for identifying the operator who operated the shared window at that time. Shared window operation information including the shared window identifier for identifying the target and the operation content of the shared window is added with time information for time synchronization between the shared window operation information, A shared window recording file creation unit that creates a shared window recording file and a shared window recording file storage unit that stores the shared window recording file are provided.

Further, the electronic conference recording device of the present invention is provided in an electronic conference terminal for transmitting and receiving a voice signal by an electronic conference participant and operation information of a shared window operated by the electronic conference participant, and another electronic conference terminal. Accepts audio signals segmented by unit time from the conference terminal, selects only voiced audio signals, and transmits time information for time synchronization between each unit audio signal and each unit audio signal. An audio recording file creation unit that creates an audio recording file to which transmission source information for identifying the source is added, and an audio recording file storage unit that stores the audio recording file. Further, it accepts operation information of shared windows segmented by unit time from other electronic conference terminals, and operates at least when there is a plurality of shared windows and operator information for identifying the operator who operated the shared window at that time. Shared window operation information including the shared window identifier for identifying the target and the operation content of the shared window is added with time information for time synchronization between the shared window operation information, A shared window recording file creation unit that creates a shared window recording file and a shared window recording file storage unit that stores the shared window recording file are provided.

The reproducing apparatus of the electronic conference according to the present invention receives the audio signals divided for each unit time, and obtains time information for time synchronization between the unit audio signals and a transmission source of each unit audio signal. And a voice recording file accumulating unit for accumulating a voice recording file added with transmission source information for identifying. Further, the operation information of the shared window that is divided for each unit time is accepted, and at least the operator information for identifying the operator who operated the shared window at that time and the operation target when there are a plurality of shared windows. A shared window record file that stores shared window operation information that includes the shared window identifier to be identified and the operation content of the shared window, and time information for time synchronization between the shared window operation information is stored. And a shared window recording file storage unit. A playback instruction input unit for designating a playback range for playing the audio recording file and the shared window recording file, and a playback control for reading the audio recording file and the shared window recording file based on a signal from the playback instruction input unit. An audio recording file reading unit and an output unit, which are controlled by the control unit and the reproduction control unit, and select and read an audio signal of a specified transmission source from the audio recording files stored in the audio recording file storage unit, and a reproduction control A shared window recording file reading unit for reading the shared window recording file stored in the shared window recording file storage unit under the control of the unit, and a shared window display unit for displaying the shared window in time synchronization with the audio signal. Equipped with.

Note that the electronic conference reproducing apparatus of the present invention displays the shared window in time synchronization with the voice signal while the voice signal of the voiced portion is being reproduced by the voice output unit, and displays the silent portion more efficiently. It is preferable to play the shared window at high speed. Further, the reproducing apparatus of the electronic conference according to the present invention may include a recorded information display unit that issues a notification when reproducing a voice signal or a shared window of a specific transmission source designated by the reproduction instruction input unit.

[0008]

[Function] Electronic conference participants hold a conference while operating a shared window on each electronic terminal. The electronic conference terminal transmits a voice signal of a conference participant and operation information of the shared window to another electronic terminal. In order to compress the recording file and shorten the playback time when recording and playing the voice of multiple electronic conference participants including myself and the operation contents of the shared window, this device Play. (1) The voice is reproduced only in the voiced section of the voice of the designated person. (2) The playback of the shared window is synchronized with the voice in the section where the voice is played, and the playback of the shared window is fast-forwarded in the section where the voice is not played. The time information for synchronization is the time when each electronic terminal receives the voice signal of the conference participant and the operation information of the shared window, the time when the recording file is created, and the like. This may be the transmission time at the transmission source. Also, since it is only necessary to be synchronized in time,
The time information may be the elapsed time from the conference start time.

(3) If necessary, when the shared window operation of the designated person is reproduced, a sound, a flash or the like is emitted to notify the user. The transmission source information for designating a person may be the identification information of the conference participants if the conference participants of the transmission source are constant. If the operator of the shared window is the same as the conference participant, the operator information may be the identification information of the conference participant. The shared window may be singular or plural, and all conference participants can view it by each electronic terminal, and in principle, all can operate it. The reproduction range means a time range for reproduction and a reproduction target range. When limited to the voice of a certain participant, it is designated in various modes such as the range of the participant. When the audio signal is reproduced in synchronization with the shared window, it is preferable that the silent portion is also skipped in the shared window and not reproduced, but so-called fast-forward may also be used.

(4) The shared window operation includes not only inputting characters and drawings in the shared window, but also operation of the shared application body such as editing of a file displayed on the shared window.

[0011]

The present invention will be described in detail below with reference to the embodiments shown in the drawings. <Schematic Configuration> FIG. 1 shows a block diagram of an embodiment of a recording device for an electronic conference. Before explaining this figure, the outline of the electronic conference will be described with reference to FIG. FIG. 2 is a block diagram of each electronic circuit terminal and the electronic conference control device. As shown in the figure, each participant has an electronic conference terminal 1001 and an electronic conference control device 14 for controlling a shared window used during the conference and controlling the start / end of the conference. It is tied at 1000. An electronic conference is conducted using such a system. This electronic conference terminal 1001 is shown in FIG.
It is a concrete block diagram of.

[0012] This figure shows the structure of the communication part and the recording part of the voice and shared window inside the electronic conference terminal 1001. Note that FIG. 3 shows a detailed block diagram of the voice communication unit 1101, the voice recording unit 1109, the shared window communication unit 1201, and the shared window recording unit 1208 shown in FIG. In addition, FIG. 4 illustrates the configuration of the playback portion of the audio and shared windows inside the electronic conference terminal 1001.

In the electronic conference terminal 1001 of FIG. 1, a voice communication unit 1101, a voice recording unit 1109, a shared window communication unit 1201, a shared window recording unit 1208, a conference data receiving unit 1003, and a recording start / end input unit 100.
2 are provided. The recording start / end input unit 1002
It is composed of an instruction key and the like for the user to input recording start and recording end of the voice and the shared window. The conference data receiving unit 1003 includes a communication control circuit and the like for receiving conference data from the electronic conference control device 1004 (FIG. 2). The voice communication unit 1101 is a unit that performs voice communication with a partner electronic conference terminal. The voice recording unit 1109 is a unit that records its own voice and voice data received from the partner electronic conference terminal. The shared window communication unit 1201 is a unit that performs operation and display of the shared window and communication of shared window operation information via the electronic conference control device 1004. The shared window recording unit 1208 includes a storage device that records the received operation information of the shared window.

As shown in FIG. 3A, the voice communication unit 11
01 is a voice input unit 1102, a voice detecting unit 1103, a voice packet transmitting unit 1104, a voice packet receiving unit 110.
5, a FIFO (first-in first-out) buffer unit 1106, a mixing / synthesizing unit 1107, and an audio output unit 1108.

The voice input unit 1102 is a part including a microphone for inputting one's voice and the like. The voice detecting section 1103 divides the input voice data into certain lengths, and determines whether each voice data (hereinafter, voice packet) divided into the certain length has voice or no voice. , A voiced voice packet (hereinafter, voiced packet) is output. The voice packet transmitter 1104
This is a part for transmitting a voice packet to the other party's electronic conference terminal. The voice packet receiver is a part that receives voiced packets sent from the other party. FIFO buffer unit 1
Reference numeral 106 denotes a portion that temporarily stores the received voice packets for each transmission source and outputs the voice packets in the order of arrival from each source. The mixing / synthesizing unit 1107 is a unit that mixes and synthesizes the voices of a plurality of opponents into one voice. The voice output unit 1108 includes a speaker that outputs mixed and synthesized voices.

The audio recording unit 1109 shown in FIG. 1 comprises an audio recording file storage unit 1111 and an audio recording file creating unit 1110. Voice recording file creation unit 11
Reference numeral 10 is a portion for creating a file in which participant information, time recording, etc. are added to the encoded voice. The voice recording file storage unit 1111 is composed of a storage device or the like for storing voice recording files.

Shared window communication unit 1 shown in FIG. 3 (b)
Reference numeral 201 denotes an operation input unit 1202, a shared window operation information creation unit 1203, a shared window operation information transmission unit 12
04, shared window display data receiving unit 1205, branching unit 1206 and some shared window display units 120
7 (1) to 1207 (p).

The operation input section 1202 is a section in which the user inputs a drawing, characters, etc. into the shared window by using a keyboard, a mouse or the like. The shared window operation information creation unit 1203 is a part that creates operation information of the shared window based on an input from the user. The shared window operation information transmission unit 1204 is a part that transmits operation information of the shared window to the electronic conference control device 1004. The shared window display data receiving unit 1205 is a unit that receives shared window display data from the electronic conference control device 1004. The shared window display unit 1207 includes a display that displays the shared window. The branching unit 1206 is a unit that distributes the shared window display data sent from the electronic conference control device 1004 to the corresponding shared window display units 1207 (1) to 1207 (p).

The shared window recording unit 1208 shown in FIG.
The shared window recording file storage unit 1210 and the shared window recording file creation unit 1209 are configured. The shared window recording file creation unit 1209 is a part that adds time information and the like to the shared window display data and creates a file. Shared window recording file storage unit 1
Reference numeral 210 is a portion for accumulating the shared window recording file.

<Structure of Reproducing Section> FIG. 4 is a block diagram of an embodiment of the reproducing apparatus as described above. This shows the configuration of the recorded voice and the shared window reproduction portion inside the electronic conference terminal 1001. This reproduction part includes an audio reproduction part 2101 and a shared window reproduction part 22.
01, a reproduction control unit 2001 that controls the entire reproduction, a recording information display unit 2002 that displays the contents of a recording file and the like to the user, and a reproduction instruction input unit 2003 that the user inputs a reproduction method and the like.

The audio reproducing unit 2101 is a voice output unit 110.
8 and a mixing / synthesizing unit 1107, a voice recording file reading unit 2102, and a voice recording file storage unit 1111. The voice recording file storage unit 1111 is a unit for storing voice recording files. The audio recording file reading unit 2102 is a unit that controls reading audio data from the audio recording file storage unit 1111 based on an instruction from the reproduction control unit 2001. Mixing synthesis section 11
Reference numeral 07 is a part that mixes voice data of a plurality of people and combines them into one voice data. The voice output unit 1108 is
This is a part for outputting the mixed and synthesized voice.

The shared window reproducing section 2201 includes a branching section 1206 and a shared window recording file reading section 2
202, a shared window recording file storage unit 1210, and shared window display units 1207 (1) to (p). Shared window recording file storage unit 1210
Is a portion where the shared window recording files are accumulated. Shared window recording file reading unit 220
Reference numeral 2 is a portion for reading the shared window display data from the shared window recording file storage unit 1210 based on an instruction from the reproduction control unit 2001. The shared window display units 1207 (1) to 1207 (p) are each configured to display shared window display data.

<Voice Communication Operation> The apparatus having the above configuration operates as follows. The voice input unit 11 shown in FIG.
The user's voice input to 02 is the voice detection unit 1103.
Is input to The voice detecting section 1103 divides the input voice signal into packets each having a fixed length and determines whether the voice packet has voice or no voice. Here, only voiced voice packets (voiced packets) are output. The method of determining the voice in the voice detecting unit 1103 is, for example, to obtain the average of absolute values of the sample values inside the voice packet, and if the average of the absolute values is larger than the threshold value, the voice is detected.

A voice packet output from the voice detecting unit 1103 is converted into a voice packet transmitting unit 1104 and a voice recording file creating unit 1110 of the voice recording unit 1109 shown in FIG.
Is input to The voice packet transmitter 1104 transmits the input voice packet to the electronic conference terminal of each partner.
On the other hand, the voice packet sent from each terminal of the other party,
It is received by the voice packet receiving unit 1105 and input to the FIFO buffer unit 1106.

In the FIFO buffer unit 1106, the inputted packets are divided and stored temporarily for each other party, and the respective voice packets are outputted at the same cycle as the packetization cycle. However, when the voice of a certain transmission source is silent, if the voice packet is not received from the transmission source in the FIFO buffer unit 1106, the voice packet of the transmission source is not output. The voice packets output from the FIFO buffer unit 1106 are input to the mixing / synthesizing unit 1107 and the voice recording file creating unit 1110, respectively.

When voice packets from different points are input to the mixing and synthesizing unit 1107, the mixing and synthesizing unit 1107 mixes and synthesizes the packets and outputs a mixed and synthesized voice packet. This mixed synthesis method may be performed by adding the sample values of the respective voice packets. Mixed synthesis section 1
The mixed and synthesized voice packet output from 107 is input to the voice output unit 1108, and the mixed and synthesized voice is output from a speaker or the like.

<Voice Recording Operation> Next, the voice recording unit 110
First, the structure of the voice recording file will be described. FIG. 5 shows a structure explanatory diagram of the audio recording file. The entire file consists of a file header and multiple sections. The content of the file header contains information about conference participants, information about voice such as the length of a voice packet, and the like. A voice packet set that is continuous in time is divided and stored in each section at a certain time limit (for example, 1 second). This section consists of a section header and multiple subsections. The section header includes time information (time stamp), source information of voice packets contained in this section, and the like.

The subsection is a single packet containing voice packets received from different points at the same time. This subsection is composed of a subsection header and a voice packet, and the subsection header describes the source information of the voice packets contained in this subsection.

Next, a voice recording operation will be described.
In FIG. 1, when the user inputs a recording start instruction from the recording start / end input unit 1002, the voice recording file creation unit 1110 records the voiced packets including the input voice of itself as voice recording of the structure shown in FIG. Record in a file. Then, the created file is stored in the voice recording file storage unit 1111. Also, when the user inputs a recording end instruction using the recording start / end input unit 1002 or the conference ends, the audio recording file creation unit 111
0 ends recording of voice.

FIG. 7 shows a flow chart of voice recording operation. First, when recording is started in step S101,
In step S102, a file header is created based on the conference data and the like obtained from the electronic conference control device 1004.
When step S102 ends, the process proceeds to step S103.
In step S103, the variable p is initialized to 0. This variable p is used as a counter for the subsection. When step S103 ends, the process proceeds to step S104. In step S104, the voice recording file creation unit 1110
When a voice packet is input to any one of the points, the process proceeds to step S105. If not, the process proceeds to step S111.

In S105, it is checked whether the value of the variable p is 0. If P = 0, the process proceeds to step S106, and if not, the process proceeds to step S108. In step S106, the current time is measured. This current time is recorded as the time stamp of the section of the audio recording file shown in FIG. Upon completion of step S106, the process proceeds to step S107. In step S107, the creation of a new section is started. Here, step S106
The time stamp value of is written in the time stamp of the section header and the like. Step S10
When step 7 is completed, the process proceeds to step S108.

In step S108, step S104
A subsection is created by the voice packet input in. When step S108 ends, the process proceeds to step S109. In step S109, 1 is added to the value of the variable p. When step S109 ends, the process proceeds to step S110. In step S110, the present time is checked, and in step S11
It is checked whether the time elapsed from the time stamp measured in 6 exceeds the limit value (for example, 1 second). If it exceeds, the process proceeds to step S111. If not exceeded, the process proceeds to step S104.

When the process proceeds to step S111, step S11
At 1, it is checked whether the value of the variable p is 0. If p = 0, the process proceeds to step S104, and if not, the process proceeds to step S112. When the process proceeds to step S112, the work for ending the creation of the current section is performed at step S112. In step S112, the source of the voice packet in this section and the like are entered in this section header. When step S112 ends, the process proceeds to step S113. In step S113, the value of the variable p is set to 0. Upon completion of step S113, the process proceeds to step S104. Although not shown in the flowchart of FIG. 5, when the recording is ended or the conference is ended, if the variable p is 0, the process ends as it is, and if p is not 0, the process of step S112 is performed and then the process ends. The above is the operation for creating a voice recording file.

<Communication Operation of Shared Window> Next, referring to FIG.
The operation of the shared window communication unit 1201 shown in FIG. In FIG. 1, when an operation of inputting characters or the like from the user to the shared window is input to the operation input unit 1202 shown in FIG. 3B, the shared window operation information creation unit 1203 causes the operation content and operation. Shared window operation information including the identifier of the shared window and the like is created. Then, the shared window operation information creation unit 120
The shared window operation information created in 3 is input to the shared window operation information transmission unit 1204 and transmitted to the electronic conference control device 1004.

The electronic conference control device 1004 creates data (shared window display data) for displaying the operation in the shared window of each electronic conference terminal based on the window operation information sent from each electronic conference terminal,
Send to all electronic conference terminals. When the shared window display data is received from the shared window display data receiving unit 1205 of each electronic conference terminal 1001, this shared window display data is input to the branching unit 1206 and the shared window recording file creating unit 1209. The shared window display data input to the branching unit 1206 is input to the corresponding shared window display unit 1207 (k) among the shared window display units 1207 (1) to 1207 (p),
In the shared window display section (k), operation contents such as characters and drawings described in the input shared window display data are displayed in the shared window.

<Recording Operation of Shared Window> Now, the structure of the shared window recording file will be described. Figure 6
[Fig. 7] is a diagram for explaining the structure of a shared window recording file.
The entire file consists of a file header and multiple sections. The content of the file header includes information about conference participants and information about shared windows used in the conference. In the section, one shared window display data is time stamped. The shared window display data includes at least a shared window identifier indicating which shared window is displayed, an operator, and operation content information.

Next, the operation of creating this shared window recording file will be described. When the user inputs a recording start from the recording start / end input unit 1002 shown in FIG. 1, the shared window recording file creation unit 1209 creates a file having a structure as shown in FIG. 6 based on the input shared window operation information. Then, the created file is stored in the shared window recording file storage unit 1210. When the user inputs the end of recording from the recording start / end input unit 1002, or when the conference ends, the shared window recording file creation unit 1209 ends the recording of the shared window. FIG. 8 shows a flowchart of shared window recording showing the recording process.

First, when recording is started in step S201, a file header is created based on conference data and the like obtained from the electronic conference control device 1004 in step S202. When step S202 ends, the process proceeds to step S203. In step S203, if one piece of shared window display data is input to the shared window recording file creation unit 1209, the process proceeds to step S204. Step S2
If the data of the shared window is not input in 03, the processing of step S203 is continued until the data is input.

When the process proceeds to step S204, step S2
At 04, the current time is measured and stored as the time stamp for this section. When step S204 ends, the process proceeds to step S205. In step S205, a time stamped section is created in the shared window display data. When step S205 ends, the process returns to step S203. Although not shown in this flowchart, the recording processing of the shared window also ends as it is at the end of recording or when the conference ends.

<Playback of voice and shared window> Next,
The operation of reproducing the recording file of the voice and the shared window will be described. In FIG. 4, first, the contents of the headers of the audio recording file and the shared window recording file are read by the audio recording file reading unit 2102 and the shared window recording file reading unit 2202, respectively, and are displayed to the user through the recording information display unit 2002. Is displayed. The user sees the displayed contents and inputs a reproduction instruction such as a person who wants to reproduce and a reproduction start time and a reproduction end time to the reproduction control unit 2001 through the reproduction instruction input unit 2003.

When the user inputs a reproduction instruction to the reproduction control unit 2001, the reproduction control unit 2001 gives a read instruction to the audio recording file reading unit 2102 and the shared window recording file reading unit 2202. The voice recording file reading unit 2102 reads a voice packet of a necessary person from the file stored in the voice recording file storage unit 1111 based on the instruction from the reproduction control unit 2001, and inputs it to the mixing and synthesis unit 1107. The processing of the mixing and synthesizing unit 1107 is the same as the case of the communication described with reference to FIGS. The mixed voice packet output from the mixing / synthesizing unit 1107 is input to the voice output unit 1108, and the mixed voice is output.

Further, the shared window recording file reading unit 2202 is at a speed based on the instruction from the reproduction control unit 2001, and the shared window recording file storage unit 121.
Read a section from the file stored in 0. Then, the shared window recording file reading unit 2
The shared window display data output from 202 is input to the branching unit 1206. The processing subsequent to the branch unit 1206 is similar to the shared window control in the case of communication. By reading the section at a speed based on the instruction from the reproduction control unit 2001 and outputting the operation information of the shared window, fast-forward reproduction or reproduction in synchronization with the sound being reproduced can be performed. The process of reproducing the voice and the shared window will be described.

FIG. 9 is a flowchart of voice and shared window reproduction. When the processing is started in step S301, the headers of the recording files of the voice and the shared window are read out in step S302, and the recording file information such as the participant name, the shared window name and the recording time is displayed in the recording information display unit 2002. Is displayed. And step S
At 303, based on the display content of the recording information display unit 2002, the user inputs designation of the person (s) who want to reproduce the sound, the reproduction start time, the reproduction end time, and the like.

When there is an input from the user in step S303, the process proceeds to step S304. In step S304, the section closest to the reproduction start time designated by the user is searched from the audio recording file, and the read position of the audio recording file is moved to that section. This can be done by looking at the time stamp in the section header. Step S
Upon completion of 304, the process proceeds to step S305. Step S
At 305, a section including a voice packet of the person designated by the user is searched from the current read position of the voice recording file, and the read position of the voice recording file is moved to that section. This can be done by checking the sender information in the section header. Upon completion of step S305, the process proceeds to step S306.

In step S306, the shared window of the section up to the point where the time stamp value of the section of the current audio recording file is not exceeded is fast-forwarded and reproduced. The fast-forward reproduction is to execute the recorded contents of the shared window one after another without adjusting the reproduction time to the time stamp of the shared window recording file.
When step S306 is completed, steps S307 and S3
The processing of 08 is performed at the same time. In step S307, the voice packet of the designated person is read out from the current voice section of the voice recording file and reproduced. FIG. 10 shows a reproduction flowchart of the audio section. This figure is
This is a specific description of step S307 shown in FIG.

First, in step S307-1, the process moves to the first subsection of this section. When step S307-1 ends, the process proceeds to step S307-2.
In step S307-2, it is checked whether or not there is a voice packet of the designated person in this voice subsection. This can be done by checking the transmission source information in the audio subsection header. If there is, go to step S307-3,
If not, the process proceeds to step S307-4. Step S30
In 7-3, the voice packet of the designated person is extracted from the voice subsection, and mixed and synthesized by the mixing and synthesizing unit 1107 (FIG. 3) and output. Also, step S30
At 7-4, a silent voice packet having the same length as other voice packets is output. Reproducing this silent voice packet has the effect of filling in the blank time zones in the voice section.

Step S307-3 or step S3
When 07-4 is completed, the process proceeds to step S307-5. In step S307-5, it is checked whether this audio section has been read. If this voice section has been read, the process proceeds to step S305, and if not read, the process moves to the next voice subsection in step S307-6, and the process of step S307-2 is performed again. The above is the processing shown in step S307 of FIG. On the other hand, in step S308 shown in FIG. 9, reproduction processing of the shared window is performed in synchronization with the sound being reproduced. In Figure 11,
The flowchart of a shared window reproduction is shown. this is,
10 is a flowchart illustrating in detail the processing shown in step S308 of FIG. 9.

In FIG. 11, step S308-
In step 1, the time stamp value of the audio section currently being reproduced in step S307 is assigned to the variable d. Step S
Upon completion of 308-1, the process proceeds to step S308-2. In step S308-2, the section of the shared window recording file is read. When step S308-2 is completed, the process proceeds to step S308-3. In step S308-3, the value of the time stamp of this shared window section is assigned to the variable w. When step S308-3 is completed, the process proceeds to step S308-4. Step S308-4
Then, the difference value between w and d is substituted into d as in the following Expression (1). d = wd- (1) When step S308-4 is completed, step S308-5
Proceed to.

In step S308-5, the process is temporarily stopped for the time of d. When step S308-5 is completed, the process proceeds to step S308-6. In step S308-6, the shared window display data described in this shared window section is output to reproduce this portion of the shared window. In this way, step S308-5
After waiting for the time determined in step S308-6
The shared window can be played back in synchronization with the sound being played back by playing back.

Upon completion of step S308-6, the flow advances to step S308-7 to move to the next shared window section and perform the process of step S308-2 again. Exceptionally, steps S307-1 to S30
When the reproduction processing step S307 of the audio section is completed in the middle of the processing of 7-7, the processing of steps S307-1 to S307-7 is also completed and the process proceeds to step S305. The above is the processing of step S308 shown in FIG.

The operation shown in FIG. 9 ends the process when any one of the following conditions is satisfied. (1) The time stamp of the audio or shared window has passed the playback end time specified by the user. (2) The audio or shared window recording file has been read to the end. (3) The user inputs a playback end command. The above is the description of the reproduction processing of the voice and the shared window.

The present invention is not limited to the above embodiments. (1) In the embodiment, the description has been made by taking the voice communication in the multipoint-to-multipoint communication between the transmitting side and the receiving side as an example, but it is also applicable to the one-to-one communication, the one-to-multipoint communication, and the multipoint-to-one communication. is there. (2) In the embodiment, the case where the voice communication is only voiced data has been described, but the voice communication can be transmitted regardless of whether voice is present or not. FIG. 12 shows a block diagram of a main part of a modified example of the communication recording unit. In the figure, in the voice recording unit 1109, the voice detecting unit 1103 extracts voiced data before inputting to the voice recording file creating unit 1110. (3) Although the embodiment does not mention changing the setting of the reproducing method during reproduction, it is possible to change the person who wants to reproduce during the reproduction.

(4) In the embodiment, the reproduction of the shared window in the silent section is performed without opening the operation of each shared window. However, the reproduction of the shared window is performed for the purpose of making the reproduction easy to see. When it is desired to reduce the speed, each shared window operation may be opened for a certain period of time for reproduction. (5) In step S307-3 of FIG. 10 of the embodiment, a silent voice packet is inserted. However, instead of inserting the silent data, the voice may be output during the silent period. Also, instead of silent voice packets,
Data including background noise may be inserted. (6) If you also store image data that is synchronized with voice,
Images can be played in addition to voice and shared windows. In this case, since the image data in the silent section is not reproduced, there is an effect that the reproduction time can be shortened as compared with the reproduction of the image / sound / shared window realized by the conventional technique.

(7) Since the file in which the sound is recorded and the file in which the shared window is recorded are separate, it is possible to use only one of them and reproduce that much. (8) Before performing the mixed synthesis in the mixed synthesis unit 1107, the volume and the sound quality of each audio signal may be individually changed and then the mixed synthesis may be performed. (9) Although the communication path is a LAN in the embodiment, it can be applied to a communication network such as a public network. (10) When reproducing the shared window, if necessary, the operation may be displayed to the user through the recorded information display unit 2002 by sound or image. (11) In the embodiment, all recorded shared windows are reproduced, but only some shared windows may be reproduced. In this case, the shared window identifier of the shared window section is checked when the shared window is played back, and if the section is not required for playback, playback processing may not be executed.

[0055]

As described above, the recording apparatus and the reproducing apparatus for the electronic conference according to the present invention have the following effects. (1) Except for a part of a user's uninstructed person, a voice of a silent part, or a shared window not specified by the user, a part of the shared window is not reproduced, so that a time required for the reproduction can be short. (2) During audio playback, the shared window can also be played in synchronization with the audio. In addition, the playback of the shared window in the section in which the sound is not played is fast-forward playback, so that the time spent for playback can be shortened.

(3) Specifically, since the time information and the transmission source information are recorded together with the voice signal in the voice recording file, the voice signal can be selected and reproduced according to the designated transmission source. Further, since the audio signal and the shared window display data include time information, both can be reproduced in synchronization. (4) It becomes possible to efficiently record the contents of the electronic conference and perform the reproduction that is easy to use.

[Brief description of drawings]

FIG. 1 is a block diagram illustrating an embodiment of a recording device for an electronic conference.

FIG. 2 is a block diagram of each electronic conference terminal and electronic conference control device.

FIG. 3 is a block diagram of each unit of the recording apparatus.

FIG. 4 is a block diagram of an embodiment of a playback device.

FIG. 5 is a structural explanatory diagram of a voice recording file.

FIG. 6 is an explanatory diagram of a structure of a shared window recording file.

FIG. 7 is a flowchart of voice recording.

FIG. 8 is a flowchart of recording a shared window.

FIG. 9 is a flowchart of voice and shared window reproduction.

FIG. 10 is a reproduction flowchart of an audio section.

FIG. 11 is a flowchart of reproduction of a shared window.

FIG. 12 is a block diagram of a main part of a modified example of the communication recording unit.

[Explanation of symbols]

 1001 electronic conference terminal 1101 voice communication unit 1109 voice recording unit 1201 shared window communication unit 1208 shared window recording unit

Claims (7)

[Claims] 1. A teleconferencing terminal for transmitting and receiving a voiced voice signal from a teleconferencing participant and operation information of a shared window operated by the teleconferencing participant, and from the other teleconferencing terminals every unit time. A voice that accepts a divided voice signal and creates a voice recording file that adds time information for achieving time synchronization between each unit voice signal and source information that identifies the source of each unit voice signal The recording file creation unit, the audio recording file storage unit that stores this audio recording file, and the operation information of the shared window divided for each unit time from another electronic conference terminal are accepted, and at least the shared window is operated at that time. Operator information that identifies the operator, a shared window identifier that identifies the operation target when there are multiple shared windows, and the shared window A shared window recording file creation unit that creates a shared window recording file, in which time information for time synchronization between each shared window operation information is added to the shared window operation information including operation contents of the dough A recording apparatus for an electronic conference, comprising: a shared window recording file storage unit for storing a window recording file. 2. An electronic conference terminal for transmitting and receiving a voice signal by an electronic conference participant and operation information of a shared window operated by the electronic conference participant, which is separated from other electronic conference terminals for each unit time. Accepts voice signals, selects only voiced voice signals, and adds time information for time synchronization between unit voice signals and source information for identifying the source of each unit voice signal The audio recording file creation unit that creates the audio recording file, the audio recording file storage unit that stores the audio recording file, and the operation information of the shared window divided for each unit time from another electronic conference terminal, At least the operator information that identifies the operator who operated the shared window at that time, and the shared window that identifies the operation target when there are multiple shared windows A shared window recording file that creates a shared window recording file in which time information for time synchronization between the shared window operation information is added to the shared window operation information including the identifier and the operation content of the shared window An electronic conference recording device comprising: a creation unit and a shared window recording file storage unit that stores a shared window recording file. 3. Time information for receiving a voice signal segmented for each unit time and achieving time synchronization between the unit voice signals, and transmission source information for identifying a transmission source of each unit voice signal. A voice recording file storage unit that stores the added voice recording file, and accepts the operation information of the shared window divided for each unit time, and shares it with at least the operator information that identifies the operator who operated the shared window at that time. To synchronize the shared window operation information with the shared window operation information including the shared window identifier that identifies the operation target when there are multiple windows and the operation content of the shared window. A shared window recording file accumulating unit for accumulating a shared window recording file to which time information is added; A reproduction instruction input unit for specifying a reproduction range for reproducing the window recording file, and a reproduction control unit for controlling reading of the audio recording file and the shared window recording file based on a signal from the reproduction instruction input unit. An audio recording file reading unit controlled by the reproduction control unit to select and read an audio signal of a designated transmission source from the audio recording files stored in the audio recording file storage unit, and output an audio recording file An audio output unit for mixing and synthesizing and outputting audio signals from a plurality of transmission sources in time synchronization, and the shared window recording file stored in the shared window recording file storage unit under the control of the reproduction control unit. A shared window recording file reading unit for reading out, and this shared window are time-synchronized with the audio signal. An apparatus for reproducing an electronic conference, comprising: a shared window display unit for displaying the electronic conference. 4. The shared window according to claim 3, wherein the shared window is displayed in time synchronization with the audio signal during reproduction of the audio signal of the voiced portion by the audio output unit, and the silent portion is displayed at a higher speed. An electronic conference reproducing device characterized by reproducing. 5. The recorded information display unit according to claim 3, further comprising a recording information display unit for issuing a notification when a voice signal of a specific transmission source specified by the reproduction instruction input unit, a shared window, or both are reproduced. Playback device for electronic conference. 6. The reproduction apparatus for an electronic conference according to claim 3, which reproduces only a specific audio signal designated by the reproduction instruction input unit. 7. The reproduction apparatus for an electronic conference according to claim 3, wherein only the shared window instructed by the reproduction instruction input unit is reproduced.