KR20020018907A - Realtime lecture recording system and method for recording a files thereof - Google Patents

Abstract

PURPOSE: A real time lecture recording system and a file recording method according to the device are provided to automatically record the image and voice of a lecturer and the contents of a lecture in real time. CONSTITUTION: A real time lecture recording system includes a converter(51,52,54) for converting the image and voice of a lecturer who is being photographed into a digital stream, a receiver for receiving the contents written on an electronic blackboard or lecture data provided by a data system in image data and detecting if the image data is varied or not, and a connection information generator for generating information that connects the point of time when the image data is varied with time information of the digital stream. The system further has a recorder for recording the digital stream and the image data in a recording medium, and a means(56) for constructing a file for providing the digital stream and the image data on-line through a network or Internet.

Description

Real time lecture recording system and method for recording files {Realtime lecture recording system and method for recording a files}

The present invention relates to a real-time lecture recording apparatus and a file recording method thereof, and more particularly, to a video / audio of a lecturer who is being presented and lectured for a long time using a video camera, a microphone, an electronic blackboard, a personal computer, and the like. The present invention relates to a Real Time Lecture Recording System (RLRS) capable of automatically recording lecture contents in real time, and a file recording method thereof.

Recently, according to the development and dissemination of various electronic devices, contents that have been presented and lectured for a long time in schools, academies, or seminars are recorded using video cameras, or written in the course of lectures by lecturers. One content can be easily printed using an electronic blackboard or the like.

Meanwhile, the presenter or lecturer prepares the lecture contents to be presented in advance as an electronic document file for presentation, and then presents them more efficiently through a large video screen by connecting a personal computer (PC) and a beam projector. The number of cases is increasing rapidly.

However, the lecture contents recorded by the video camera as described above, the lecture contents printed by the copyboard, and the electronic document files for presentations prepared in advance for use by connecting a personal computer and a beam projector are each separate electronic devices. Because they are independently recorded, printed, and created by, there is no correlation between them, and the content of these lectures can be delivered to multiple subjects, for example, to multiple subjects connected online through a network or the Internet. If you want to provide editing, experienced editing technicians must run the editing program on the computer and check the recorded contents of each lecture through the monitor, and manually edit them manually. There was a problem requiring technology.

Accordingly, the present invention has been created to solve the above problems, from the lecture video and audio taken and read by video cameras and microphones, writing image data printed by the copyboard, and personal computers Real-time lecture recording device for automatically recording the output electronic document data in real time, synchronized to the lecture video, which can be easily provided to a large number of lecturers connected online through the Internet or a network; To provide a file recording method accordingly, the purpose is.

1 shows a connection state between a real-time lecture recording device (RLRS) and electronic devices according to the present invention,

2 shows a detailed configuration of a real-time lecture recording apparatus according to the present invention,

3A and 3B illustrate a configuration of a file recording process and a management information file for synchronization in a real-time lecture recording apparatus according to the present invention.

4 illustrates an embodiment of a table of contents information extraction area according to the present invention;

5A and 5B show files managed by a real-time lecture recording apparatus according to the present invention,

6 illustrates a lecture screen provided from a real-time lecture recording apparatus according to the present invention.

※ Explanation of code for main part of drawing

100: video camera 200: microphone

300: copyboard 400: personal computer

500: real-time lecture recording device 600: beam projector

51: video signal processor 52: audio signal processor

53: Sync generator 54: Streaming media encoder

55: file register 56: file organizer

58,61: image file generation unit 59,62: image change detection unit

60: image conversion unit 63: table of contents information extraction unit

64: table of contents file generation unit 65: system control unit

The real-time lecture recording device according to the present invention for achieving the above object, in the lecture recording device for recording the lecture state, voice, writing content or lecture data of the lecturer, the image corresponding to the lecture mode of the lecturer being photographed Conversion means for converting speech into a digital stream; Receiving means for receiving the writing content received through the copyboard or lecture data data provided from the data device as image data, and detecting whether the image data changes; Linkage information generating means for generating information for associating a time point of change of the image data of the receiving means with visual information of the converted digital stream and recording the linkage information with each image data; Recording means for recording the digital stream and the image data on a recording medium; And means for constructing a file for providing the digital stream and the image data recorded on the recording medium online via a network or the Internet.

In addition, the real-time lecture recording apparatus according to the present invention, in the real-time lecture recording device for recording the lecture state, voice, written content or lecture data of the lecturer, the video and audio corresponding to the lecture state of the lecturer being photographed as a digital stream A first step of temporarily storing first reproduction time information recorded in the digital stream while being converted and recorded; And after the step 1, when the instructor receives the image data written on the electronic board, the temporarily stored first reproduction time information is associated with the received image data, and the reproduction time at the time of receiving the image data. Characterized in that it comprises two steps of temporarily storing the information,

In addition, the file recording method in the real-time lecture apparatus according to the present invention, the real-time lecture recording device for recording the lecture state, voice, written content or lecture data of the lecturer, the video and audio corresponding to the lecture state of the lecturer being photographed Converting the received lecture data into image data while converting and recording the data into a digital stream, and detecting whether the image data is changed; And at step of detecting the change of the image data, linking the reproduction time information recorded in the digital data stream with the image data.

Hereinafter, a preferred embodiment of a real-time lecture recording apparatus and a file recording method according to the present invention will be described in detail with reference to the accompanying drawings.

First, FIG. 1 illustrates a connection connection state between a real-time lecture recording device (RLRS) and electronic devices according to the present invention, and includes a video camera 100 for capturing a lecturer's lecture; A microphone 200 for recording a voice of an instructor; An electronic blackboard 400 which prints the contents of the written lectures as image data while the lecturer lectures; Personal computer 300 for outputting the electronic document file for the presentation prepared in advance for the lecture as video screen data; A beam projector (600) for displaying image screen data output from the personal computer on a large image screen; And real-time lecture recording device 500 for receiving the video, audio, image data and video screen data respectively output from the video camera, microphone, electronic blackboard and personal computer, can be used in connection, for example, For example, the copyboard 300 is connected to the real-time lecture recording apparatus 500 through a conventional 'RS232C' connector, and the personal computer 400 and the beam projector 600 are connected to a conventional 'VGA'. It is connected to the real-time lecture recording device 500 through a cable.

Accordingly, the real-time lecture recording device 500 receives the video signal of the lecturer output from the video camera 100, and the voice signal of the lecturer output from the microphone 200 to receive a digital A / V stream. In addition to the recording, the image screen data of the presentation electronic document file output from the personal computer 400 and the writing image data printed and output from the copyboard 300 are received and recorded as an image file, respectively. The recorded image files are synchronized on the basis of the presentation time stamp (PTS: Presentation Time Stamp) recorded in the packet of the digital A / V stream.

Meanwhile, the real-time lecture recording apparatus 500 extracts and converts a part of the video screen data output from the personal computer 300 into text data, generates and records a table of contents information file for the electronic document file, and The electronic document is synchronized with the digital A / V stream on the basis of the reproduction time information (PTS) corresponding to the output time of the image screen data, and finally, based on the reproduction time information (PTS) of the digital A / V stream. Since the image file corresponding to the file, the table of contents information, and the digital A / V stream are synchronized, the user can then use the table of contents information to quickly find and check the lecture contents that he / she wants. Hereinafter, the detailed configuration and operation of the real-time lecture recording apparatus 500 will be described in detail with reference to the accompanying drawings.

First, FIG. 2 illustrates a configuration of a real-time lecture recording apparatus according to the present invention. The real-time lecture recording apparatus 500 processes a video signal output from the video camera 100 and outputs the digital video data. A video signal processor 51; An audio signal processor 52 for processing a voice signal output from the microphone 200 and outputting the audio signal as digital audio data; A synchronization generator 53 for providing a synchronization clock; Encode the digital video data and audio data into a digital A / V stream, record the reproduction time information (PTS) generated by the synchronous clock into a packet of the digital A / V stream, and stream it over the Internet. A streaming media encoder 54 for generating and outputting a file in a format capable of being made, for example, Microsoft's '.asf' format; A first image file generation unit 58 for compressing the image data output from the copyboard 300 to generate an image file in '.jpeg' or '.png' format and output the image file; A first image change detector (59) for detecting a change in image data output from the copyboard and outputting an interrupt signal corresponding thereto; An image converter 60 for converting image screen data output from the personal computer 400 into image data; A second image file generator 61 for compressing the image data converted by the image converter 60 to generate an image file in '.jpeg' or '.png' format and output the image file; A second image change detection unit 62 for detecting a change in the image data converted by the image conversion unit 60 and outputting an interrupt signal corresponding thereto; A table of contents information extracting unit 63 for converting a part of the image data converted by the image converting unit 60 into text data and outputting the table of contents information; A table of contents file generator 64 generating and outputting the converted table of contents information as a file of '.txt' format; A file of '.asf' format generated and output from the streaming media encoder 54, an image file of '.jpeg' or '.png' format generated and output from the first image file generator 58, Image files of '.jpeg' or '.png' format generated and output from the second image file generator 61 and contents files of '.txt' format generated and output from the contents file generator 64 While performing a recording operation, the temporary management for synchronizing each image file and table of contents information with the digital A / V stream based on the reproduction time information (PTS) recorded in the digital A / V stream. A file recording unit 55 for generating and recording an information file; The management information temporarily recorded by the file recording unit 55 is recorded as the management information for managing and controlling the reproduction of the digital A / V stream in the '.asf' format file, A file constitution unit 56 which organizes the files into files for streaming over the Internet; In response to the interrupt signals output from the first and second image change detection units 59 and 62, the file recording unit 55 may be operated and controlled at the end of the recording operation. It is comprised including the system control part 65 to control.

On the other hand, in the real-time lecture recording device 500, the 'VGA' connector for the image screen data output from the personal computer 400 is input to the beam projector 600 is configured to include, A display unit (not shown) and a keyboard (not shown) are additionally configured to read and display the table of contents information recorded by the file recording unit 55 so that the user can edit it, or the user A separate interface unit (not shown) may be additionally configured to edit table of contents information through a personal computer.

Accordingly, the video signal output from the video camera 100 and the audio signal output from the microphone 200 are signal-processed by the video signal processing unit 51 and the audio signal processing unit 52, respectively, to perform digital processing. It is output as video data and audio data, encoded by the streaming media encoder unit 54, and then recorded as a digital A / V stream, thereby recording the lecture and voice of the lecturer in a file of '.asf' format. In this case, the streaming media encoder 54 reproduces the reproduction time information (PTS), that is, the information representing the time to be displayed after decoding the video data in the access unit, and the synchronization generation unit ( After generating on the basis of the synchronization clock provided from 53), as shown in FIG.

On the other hand, when the electronic document file for presentation presented by the instructor is displayed on a large screen using the personal computer 400 and the beam projector 600, the image conversion unit 59 uses a 'VGA' cable. The image screen data output from the personal computer 400 is converted into image data through the second image file generating unit 61. The large image is converted through the converted image data, that is, the beam projector 600. The image data corresponding to one page of the electronic document file displayed on the screen is generated and output as a compressed image file having an extension such as '.jpeg' or '.png'. In this case, the second image change detector 62 ) Detects a change in the converted image data, and outputs the corresponding interrupt signal to the system controller 65.

Accordingly, the system control unit 65 controls the file recording unit 55 in response to the interrupt signal, and the file recording unit 55 supplies reproduction time information (PTS) corresponding to the time point. As a reference, a temporary management information file for synchronizing the digital A / V stream with an image file is generated and recorded.

That is, as shown in FIGS. 3A and 3B, when the video screen data is output from the personal computer 400 while the lecturer's lecture and voice are recorded in the digital A / V stream, the file recording unit At 55, the reproduction time information PTS L corresponding to the time point t-pc1, the identification information ID recorded in the header of the image file, and the command argument for executing the program ( Argument) is created and recorded as temporary management information.

In the table of contents information extracting unit 63, a part of the image data converted by the image converting unit 60, for example, an image corresponding to one page of the electronic document file, as shown in FIG. The image data corresponding to the upper portion of the data is converted into text data, extracted, and output as table of contents information corresponding to the page, and the table of contents file generating unit 64 shows the table of contents information converted and output as shown in FIG. 3A. As described above, the file is generated and output to be sequentially recorded in a table of contents file of '.txt' format. In this case, the file recording unit 55 displays reproduction time information corresponding to the time point at which t-pc1 is converted and outputted. PTS L) and position information (PI: Position information) recorded with corresponding table of contents information are generated and recorded as temporary management information.

Therefore, in the temporary management information file generated by the file recording unit 55 and recorded, for example, 'Navigation.txt' file, the reproduction time information at the time when the image screen data is output from the personal computer 400 is referred to. In this way, the image file generated and recorded and management information for synchronizing the table of contents information are recorded.

On the other hand, when the instructor first prints out the contents written using the copyboard during the lecture, the image data output from the copyboard 300 through the 'RS232C' connector, the first image file generation unit 58 Is generated by compression into an image file, for example, an image file having an extension such as '.jpeg' or '.png', wherein the first image change detector 59 detects whether the image data is changed or not. Accordingly, the corresponding interrupt signal is output to the system control unit 65, and the system control unit 65 controls the file recording unit 55 in accordance with the interrupt signal.

Accordingly, in the file recording unit 55, as described above, the reproduction time information (PTS) recorded in the packet of the digital A / V stream and the image file generated and output by the first image file generation unit 58 are recorded. The identification information (ID) recorded in the header and the command argument for executing the program are generated and recorded as temporary management information. In this case, the file recording unit 55, as shown in FIG. As described above, while temporarily storing the reproduction time information (PTS M) selected and input at the time t-board1, the reproduction time information previously stored temporarily, that is, the first reproduction recorded in the digital A / V stream is recorded. The time information (PTS 1) is recorded in association with the identification information of the image file so that the image screen of the contents of the lecture written on the copyboard 300 is reproduced simultaneously with the appearance of the lecturer's lecture. At the time of reproduction The interstitial information (PTS M) is then recorded in association with the identification information of the image file generated at the time (t-board2) when the content written on the copyboard 300 is to be printed out again. You can check what you are writing on the copyboard before printing.

Therefore, temporarily generating and recording an image file corresponding to a lecture writing content, an image file corresponding to an electronic document, and a table of contents information to synchronize a digital A / V stream corresponding to lecture lecture video and audio. Done.

On the other hand, each of the files recorded by the file recording unit 55 is recorded in a temporary directory (Temp), for example, as shown in FIG. 5A, which is generated and recorded by the streaming media encoder unit 55. The digital A / V stream file may be recorded under an 'AV_n.asf' name having a '.asf' extension, and the writing image file generated and recorded by the first image file generating unit 61 may be ' and a plurality of image files having file names such as' Board_n.png 'and' Board_n + 1.png 'having a .png' extension, and are also generated and recorded by the second image file generating unit 61. The electronic document image file may be recorded as a plurality of image files having file names such as 'PC_n.png' and 'PC_n + 1.png' having a '.png' extension.

The table of contents file generated and recorded by the table of contents file generating unit 64 may be recorded under a 'Listinfo_n.txt' name having a '.txt' extension, and also generated and recorded by the file recording unit 55. The temporary management information file may be recorded under a 'Navigation_n.txt' name having a '.txt' extension. As described above, when the recording operation is terminated, the system control unit 65 informs the control signal of this. The file organizer 56 outputs the files recorded in the temporary directory to a plurality of subjects connected online through the Internet. The file is reconfigured into a file to be recorded so as to be recorded in a specific directory, for example, a 'Library n + 1' directory as shown in FIG. 5B.

That is, the file configuration unit 56 records the management information recorded in the temporarily stored management information file 'Navigation_n.txt' in the 'AV_n.asf' file generated by the streaming media encoder unit 54. Additional recording as management information in text format for managing and controlling the reproduction of digital A / V streams, and recording and storing the file in which the management information is additionally recorded in the 'Library n + 1' directory under the name 'AV_n.asf' Meanwhile, a plurality of image files 'Board_n.png', 'Board_n + 1.png', 'PC_n.png', and 'PC_n + 1.png' recorded in the temporary directory are moved to the 'Library n + 1' directory. Will be recorded.

In addition, the table of contents information file 'Listinfo_n.txt' recorded in the temporary directory is stored as a 'Listinfo_n.htm' file having a '.htm' extension by using html and programs provided by the system. A GUI (Graphic User Interface) and various codes necessary for services on the Internet are recorded to generate and record a file having a '.htm' extension, for example, a 'GUI_n.htm' file.

Therefore, by using the file configured as described above, as shown in FIG. 6, a plurality of personal computer screens connected and connected online via a network or the Internet can be displayed and output through four screen windows, respectively. In this case, video screens respectively displaying four screen windows are displayed on the screen in synchronization with the reproduction time information of the digital A / V stream as described above. In the case of selecting and specifying any one table of contents information, the electronic document image file stored in association with the confirmed reproduction time information is searched and confirmed on the management information of the reproduction time information (PTS) recorded in the contents information. The identification position of the digital A / V stream recorded with the reproduction time information The group Digital A / V navigation to the writing image files on the electronic board corresponding to the recording and playback of the stream, thereby avoiding self-teaching can be provided more quickly lectures corresponding to the contents information specified selection.

For reference, additional index or mark information for linkage between the table of contents information, an image file of an electronic document, a digital A / V stream, and a writing image file of an electronic blackboard may be additionally recorded. Likewise, the contents of the lecture corresponding to the table of contents information selected by the subject may be searched and played.

As mentioned above, preferred embodiments of the present invention are disclosed for the purpose of illustration, and those skilled in the art can improve and change various other embodiments within the spirit and technical scope of the present invention disclosed in the appended claims below. , Replacement or addition would be possible.

The real-time lecture recording apparatus and the file recording method according to the present invention configured as described above, the lecture video and audio taken and read by the video camera and microphone, the writing image data printed by the copyboard, In addition, it automatically synchronizes and records electronic document data for presentations output from personal computers in real time, providing them to multiple personal computers connected online through the Internet or a network, and automatically generates table of contents information about lecture contents. In addition, the present invention can be edited, and it is a very useful invention that enables the user to quickly search for and provide lecture contents corresponding to table of contents information that the lecturer arbitrarily selects.

Claims (9)

In the lecture recording device for recording the lecture state, voice, written content or lecture materials of the lecturer, Conversion means for converting a video and an audio corresponding to a lecture of a lecturer to be photographed into a digital stream; Receiving means for receiving the writing content received through the copyboard or lecture data data provided from the data device as image data, and detecting whether the image data changes; Linkage information generating means for generating information for associating a time point of change of the image data of the receiving means with visual information of the converted digital stream and recording the linkage information with each image data; Recording means for recording the digital stream and the image data on a recording medium; And And means for constructing a file for providing digital streams and image data recorded on the recording medium online via a network or the Internet. The method of claim 1, And the digital stream recorded by the recording means is recorded as a file in a streaming media format that can be streamed over a network or the Internet. The method of claim 1, The conversion means, A signal processor converting the captured image and analog voice into video and audio data; And And a streaming media encoder that encodes the video and audio data into a digital stream, and inserts and records reproduction time information for indicating a time to express the packet, which is an access unit of the digital stream. Lecture recorder. The method of claim 1, The linked information generating means, And a change point of the image data corresponding to the written content detected by the receiving means is related to the visual information of the digital stream corresponding to the change point previously detected. The method of claim 1, And converting means for extracting text information from image data of a partial region of the image data and converting the text data into the table of contents information. And the association information generating unit generates and records information for associating the extracted character information with the visual information of the converted digital stream. In the real-time lecture recording device to record the lecture state, voice, written content or lecture data of the lecturer, A first step of temporarily storing first reproduction time information recorded in the digital stream while converting and recording the video and audio corresponding to the lecture of the instructor to be photographed into a digital stream; And After the first step, when the instructor receives the image data written on the electronic board, the temporary stored first reproduction time information is associated with the received image data, and the reproduction time information at the time of receiving the image data. File recording method in a real-time lecture apparatus characterized in that it comprises a step of temporarily storing the. The method of claim 6, After the second step, when the instructor receives the image data newly written on the electronic blackboard, the time information stored temporarily in the second step is associated with the received image data and at the time of receiving the image data. File recording method in a real-time lecture apparatus characterized in that it further comprises three steps of temporarily storing the reproduction time information. In the real-time lecture recording device to record the lecture state, voice, written content or lecture data of the lecturer, Converting the received lecture data data into image data while converting and recording the video and audio corresponding to the lecture of the lecturer to be photographed into a digital stream, and detecting whether the image data is changed; And And a step of associating the reproduction time information recorded in the digital data stream with the image data at the time of detecting the change of the image data. The method of claim 8, When detecting the change of the converted image data, extracting character information from image data of a partial region of the image data and generating the table of contents information; And And associating the extracted table of contents information with the reproduction time information.