JP2002109099A - System and device for recording data and video image/ voice, and computer readable recording medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To synchronously reproduce data and video images/voice by recording the data to be used for presentation in a conference or the like and the video images/voice for explaining the data in correspondence. SOLUTION: When a presenter operates a PC 1 and starts the presentation, a server 5 records the operation information. The presenter explains a selected slide (data) by a microphone 13 and a camera 11. Then, the question start operation by the microphone 23 and the camera 21, etc., of a listener is recorded. Each recorded operation information is made index information and respective indexes, the respective pieces of presentation information and the video image/ voice information of questions and answers are related to each other and stored in a data base 6. Also, an index file is prepared and a reader specifies the index from the index file.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to materials used in conferences, lectures, symposiums, seminars, etc. (hereinafter referred to as conferences) using computers, and images for explaining the materials. The present invention relates to a material and a video / audio recording system and apparatus suitable for use when recording in association with audio, and a computer-readable recording medium used in the apparatus.

[0002]

2. Description of the Related Art Conventionally, there has been known a conference system in which each attendee uses a PC to hold a conference via a network. In such a conferencing system, when a person who has not participated in the conference wants to know the state of the conference at a later date, or a person who has participated in the conference wants to know the situation during the conference for confirmation at a later date There is. In order to prepare for such a case, the conference system is provided with a recording system in which materials and video / audio used in the presentation to be held in the conference are stored and stored in a server or the like, and can be referred to when necessary. .

In a conventional recording system, materials created using a PC or the like are stored in a material server, and images and sounds obtained using a camera / microphone or the like are stored in a video server. Therefore, the user can acquire and refer to the material stored from the material server via the network, and can acquire video and audio from the video server and refer to it on the PC.

[0004]

However, in the conventional recording system, since the material server and the video server are separate, it is not possible to synchronize and display the material and the video / audio. Only reference or only video / audio could be performed. Some systems refer to both at the same time, but extra operations are required to associate the materials with the video and audio during the meeting to make it easier to search later,
In order to combine with voice, there is a problem that editing work of data saved after the meeting is required.

The present invention has been made to solve the above-mentioned problem, and has as its object to enable data to be recorded in association with video and audio.

[0006]

In order to achieve the above-mentioned object, in a material and video / audio recording system according to the present invention, material output means for outputting a material selected according to a user's selection operation First video / audio input means for inputting video / audio corresponding to the material; second video / audio input means for inputting video / audio based on the input operation; Detecting means for detecting
The selected material and the video / audio input from the first video / audio input means are stored in association with each other based on the detected selection operation information, and the selected material is associated with the detected input operation information. Storage means for storing the video / audio input from the second video / audio input means;
File creating means for creating an index file using the detected selection operation information and input operation information as an index and storing the index file in the storage means.

[0007] In the document and video / audio recording apparatus according to the present invention, a material selected according to a user's selection operation, a first video / audio corresponding to the material, and an input operation are used. Input means for inputting a second video / audio, detection means for detecting the selection operation and the input operation, the selected material and the first video / audio based on the detected selection operation information Storage means for storing video and audio input from the input means in association with each other and storing video and audio input from the second video and audio input means in correspondence with the detected input operation information; File creating means for creating an index file using the detected selection operation information and input operation information as an index and storing the index file in the storage means; Searching and presenting means for presenting a hex file to the viewer, said storage means from an index selected by the viewer on the basis of the presented index file, appropriate documentation and / or video and
Search means for transmitting voice to the viewer.

In the computer-readable recording medium according to the present invention, a material selected according to a user's selection operation, a first video / audio corresponding to the material, and a second material based on an input operation. An input process of inputting video / audio, a detection process of detecting the selection operation and the input operation, and associating the selected material with the first video / audio based on the detected selection operation information. Storage processing for storing the second video / audio in association with the detected input operation information, and creating an index file using the detected selection operation information and input operation information as an index. File creation processing, presentation processing for presenting the index file to the viewer in response to a browsing request of the viewer, and presentation processing for presenting the index file. Searching the stored information from the index selected by the viewer on the basis of,
A program for executing a search process for transmitting the relevant material and / or video / audio to the viewer is recorded.

[0009]

Embodiments of the present invention will be described below with reference to the drawings. First, the present embodiment will be schematically described. In many meetings and the like, a plurality of presentations are performed. Each presentation consists of a presentation part explained by the presenter based on materials (presentation materials) prepared in advance,
After that, it consists of a question and answer section where participants ask questions and the presenter answers. In addition, in the presentation part, explanations are generally given while materials are displayed as slides on each participant's PC screen, and slides are switched as the presentation progresses.

The material is a collection of slides (pages) to be presented, and the explanation voice is a flow of spoken words (utterances). Therefore, as shown in FIG. 1, each presented page is associated with an utterance made on the page by an index, and the material is combined with the explanatory sound or video to be recorded, so that synchronization is achieved during reproduction. Can be played. For that purpose, it is necessary to extract a part (cut point) serving as a delimiter of the content from the stored video / audio and attach the index. However, it is very difficult to analyze video and audio to find a cut point according to the content.

Therefore, in the present embodiment, attention is paid to the material (presentation material) used for the presentation and the progress based on the material, and based on the structure model of the presentation as shown in FIG. The following cut points that serve as breaks in the content are automatically extracted and used as indexes. At the beginning of the presentation At the time of switching slides At the beginning of the question In FIG. 2, for each presentation,
It is shown that presentations are performed by switching slides 1 to 2 to N, respectively, and that Q and Q are performed N times for each presentation.

Therefore, according to the present embodiment, it is possible to record the material in association with the video and audio, so that at the time of reproduction, by searching and selecting the part to be referred based on the index, the necessary Only the parts can be easily referenced. At that time, the material and the video / audio can be reproduced in synchronization. In addition, no special operation is required during the meeting, and no editing work after the meeting is required, because the materials, which are necessary for reproducing the video and audio, are associated with the video and audio.

In the conference system, a PC is provided for each participant, and the presenter operates his own PC, switches slides, and presents while presenting materials. . In this case, the start of the presentation and the switching of the slide are performed by a selection operation such as clicking a mouse. Also, when participants start asking questions, their PC
Operate the microphone and camera to start asking a question. Therefore, the start of the presentation, the slide switching, the start of the question, and the like can be automatically detected by the server 5 in FIG. 5 described later based on the operation of each PC.

FIG. 3 is a flowchart showing a procedure for detecting the cut point. In FIG. 3, the start of the presentation is detected and recorded (S1). The presenter explains the contents of the slide (S2). Next, it is determined whether the slide has been switched (S3), and when the slide has been switched, slide switching operation information is recorded (S4), and
Return to 2. If the slide (page) is not switched, it is determined whether there is a question (S5). If there is a question, a question start operation is recorded (S6), and the process returns to S2. If there is no question, it is determined whether the explanation has been completed for all slides (S7), and if not, the process returns to S2. If completed, it is determined whether all presentations have been completed. If not completed, the process returns to S1, and if completed, the process ends.

FIG. 4 is a block diagram showing a conference system including a material and video / audio recording system according to an embodiment of the present invention. In FIG. 4, PCs 1, 2, and 3 and cameras 11, 21, 31, and speakers 12, 22, 32, and PCs 1 and 2 are presented to a presenter of a presentation and other conference participants (here, listeners of the presentation).
Microphones 13, 23, 33, etc. are provided. These PCs, cameras, speakers, microphones, and the like are connected to a server 5 that controls the entire conference system via a network 4 such as the Internet. Note that the illustrated conference system may be a remote conference in which participants such as a presenter and an attendant are in a distant place to conduct a conference.

The server 5 constitutes an apparatus for recording material and video / audio according to the present invention, and comprises a processing unit 51 by a CPU and a storage unit 52 including a memory such as a ROM and a RAM. The processing unit 51 includes a communication processing unit 53, a recording processing unit 5,
4. An index file creation processing unit 55, an index file presentation processing unit 56, and a search processing unit 57. The server 5 has a database 6.

In the above configuration, the presenter prepares presentation materials in advance and stores them in the PC 1 as material output means according to the present invention. When the presenter operates PC1 to start the presentation, the presenter
A description will be given using the microphone 13 while switching slides by operating C1. Further, the presenter or the like is photographed by the camera 11 as necessary. These slide images,
The presentation information including the sound from the microphone 13 and the video from the camera 12 is sent to the server 5 together with the control information. Note that the camera 11 and the microphone 13 are the first image
Constituting voice input means.

The server 5 distributes the presentation information to each of the PCs 2 and 3 via the network 4 based on the control information. Therefore, presentation materials are displayed as a common screen on the PC screen of each listener, and explanation sounds are output from the speakers 22 and 32.

Further, various operation information including the operation of the presenter by the presenter during the conference to start the presentation and the operation of each listener to start the question is sent to the server 5. Server 5
Can be used as index information by detecting such operation information and recording it together with time information. For example, when the presentation is finished and the question and answer is made, the listener may be connected to the microphone 23 and the camera 21 of the PC 2, for example.
A question is asked after the operation of the (second video / audio input means) is started. The operation of starting the question is notified to the server 5. The database 6 stores the index information, the presentation information, and the question and answer information in association with each other.

For example, the following can be considered as the index information. (1) When the presentation starts or when the presenter or the material to be explained is switched (presenter name, material name, material number, etc.) (2) When the presenter switches slides (slide title, slide number, etc.) (3) When there is a question (name of the questioner, title and number of the slide used at that time, etc.)

The index information is recorded together with the time information, and is set as an index. Based on the index, an index file in which the material and the video / audio are associated with each other is created and stored in the database 6. In the index file, for example, information such as a title name, a slide number (page number), and video and audio time information of the description is described for each index.

Thereafter, the index file of the database 6 is searched, and a part required by the viewer is selected from the designated index, thereby obtaining a reference time and synchronizing the material with the video / audio. Thus, it is possible to obtain information equivalent to a situation during an actual meeting.

FIG. 5 is a block diagram showing the operation of taking out stored information from the database 6 and reproducing it on a PC. In FIG. 5, a viewer makes a browsing request to the server 5 via the network 4 using, for example, the PC 2. The server 5 presents the selection information based on the index file of the database 6 on the screen of the PC 2. The viewer selects an index of a part of the conference to be viewed from the presented index file. The server 5 extracts presentation information or question and answer information corresponding to the selected index from the database 6 and
To the PC 2 via the.

The viewer can know the state of the conference from the materials and images displayed on the screen of the PC 2 and the sound from the speaker 22. The screen may display slide images, camera images, and materials in separate windows in the screen as needed.

In the present embodiment, the case where the present invention is applied to a conference system has been described. However, the present invention is not limited to the conference system, but also stores a material and a combination of video and audio explaining the material. In addition, the present invention can be applied to all systems that perform synchronous playback.

Next, a computer-readable recording medium according to an embodiment of the present invention will be described. A memory such as a ROM in the storage unit 52 that stores a program for executing a process based on the above-described operation including the process of the flowchart in FIG.
A computer-readable recording medium according to the present invention is configured.

As the recording medium, a magneto-optical disk,
An optical disk, a semiconductor memory, a magnetic recording medium, or the like can be used, and these may be configured and used in a ROM, a RAM, a CD-ROM, a floppy (registered trademark) disk, a memory card, or the like.

The recording medium is a fixed medium such as a volatile memory such as a RAM in a computer system serving as a server or a client when a program is transmitted via a network such as the Internet or a communication line such as a telephone line. The one that holds the time program is also included.

The above program may be transmitted from a computer system storing the program in a storage device or the like to another computer system via a transmission medium or by a transmission wave in the transmission medium.
The transmission medium refers to a medium having a function of transmitting information, such as a network (communication network) such as the Internet or a communication line (communication line) such as a telephone line.

[0030] The program may be for realizing a part of the functions described above. Furthermore, what can realize the above-described function in combination with a program already recorded in the computer system, that is, a so-called difference file (difference program) may be used.

Therefore, when this recording medium is used in a system or apparatus different from the system or apparatus shown in FIGS. 4 and 5, and the computer of the system or apparatus executes the program stored in this recording medium,
Functions and effects equivalent to those described in the embodiment can be obtained, and the object of the present invention can be achieved.

[0032]

As described above, according to the present invention, when a conference or the like is held in a PC environment connected to a network, the stored materials can be recorded in association with video and audio. In that case, there is no need to perform extra operations during the meeting, and no special editing work is required after the meeting.

At the time of reproduction, the material and the video / audio can be referred to in synchronization by a simple operation of simply specifying the index. This allows the user to view and listen to a single meeting on the spot, as well as to view and listen to the meeting many times, thereby increasing the value of the meeting itself.

Further, not only the conference system but also the contents in which the material and the video / audio are combined can easily set an index, and it is possible to measure the labor saving of the contents creation.

[Brief description of the drawings]

FIG. 1 is a configuration diagram illustrating obtaining an index corresponding to a cut point of a material.

FIG. 2 is a configuration diagram showing a structural model of a presentation.

FIG. 3 is a flowchart showing a procedure for extracting a cut point.

FIG. 4 is a block diagram showing an embodiment of a conference system to which the present invention can be applied.

FIG. 5 is a block diagram illustrating an operation of browsing conference information in the conference system.

[Explanation of symbols]

 1, 2, 3 PC 4 Network 5 Server 51 Processing unit 52 Storage unit 53 Communication processing unit 54 Recording processing unit 55 Index file creation processing unit 56 Index file presentation processing unit 57 Search processing unit 6 Database

──────────────────────────────────────────────────続 き Continued on the front page (51) Int.Cl. ⁷ Identification symbol FI Theme coat ゛ (Reference) H04N 5/781 H04N 7/15 610 5/85 5/781 510L 7/15 610 (72) Inventor Masatoshi Yokomori 3-19-2 Nishi-Shinjuku, Shinjuku-ku, Tokyo F-term within Nippon Telegraph and Telephone Corporation (reference) 5B075 ND40 NK48 5C052 AA01 AA16 AC08 DD10 5C064 AA02 AC02 AC06 AC12 AC16

Claims (4)

[Claims] 1. A material output means for outputting a material selected in response to a selection operation of a user, and a first video / video for inputting a video / audio corresponding to the material.
Audio input means, and a second video / audio inputting video / audio based on the input operation.
Voice input means, detection means for detecting the selection operation and input operation, and the selected material and video / audio input from the first video / audio input means based on the detected selection operation information And storage means for storing the video / audio input from the second video / audio input means in association with the detected input operation information; and the detected selection operation information And a file creating means for creating an index file using the input operation information as an index and storing the index file in the storage means. 2. A presentation means for presenting the index file to the viewer in response to a browsing request of the viewer, and searching the storage means from an index selected by the viewer based on the presented index file. 2. The recording system for materials and video / audio according to claim 1, further comprising a search unit for transmitting the relevant materials and / or video / audio to the viewer. 3. An input means for inputting a material selected according to a user's selection operation, a first video / audio corresponding to the material, and a second video / audio based on the input operation; Detecting means for detecting the selection operation and the input operation; and making the selected material correspond to the video / audio input from the first video / audio input means based on the detected selection operation information. Storing means for storing the video and audio input from the second video and audio input means in association with the detected input operation information; and storing the detected selection operation information and input operation information File creation means for creating an index file as an index and storing the index file in the storage means; presentation means for presenting the index file to the viewer in response to a browsing request of the viewer; Search means for searching the storage means from the index selected by the viewer based on the indicated index file, and transmitting the corresponding material and / or video / audio to the viewer. Recorded materials and video and audio recording devices. 4. An input process for inputting a material selected according to a user's selection operation, a first video / audio corresponding to the material, and a second video / audio based on the input operation. A detection process for detecting the selection operation and the input operation; storing the selected material and the first video / audio in association with each other based on the detected selection operation information; A storage process for storing the second video / audio in association with the operation information; a file creation process for creating an index file using the detected selection operation information and input operation information as an index; A presentation process of presenting the index file to the viewer in accordance with: the index file selected by the viewer based on the presented index file; Find the product information, appropriate documentation and / or computer readable recording medium a program recorded for executing a search process of transmitting the video and audio to the viewer.