KR20020016509A - The multimedia electronic education system and the method thereof - Google Patents

Abstract

PURPOSE: A multimedia electronic education system and a method thereof are provided to execute lecture at real time, to record contents of lecture, and to edit the recorded contents. CONSTITUTION: The system comprises many client PCs(108) including an instructor(106) and students, a recording server(110) recording a lecture in real time, automatically converting the recorded data into a format used by a non-real time tele-program, an MDBM(Multimedia Data Broadcasting Module) server(102) interconnecting the client PCs and broadcasting the data exchanged during the lecture to the client PCs and the recording server, and a management server transmitting a correspondence course to the client PCs and the recording server and in charge of user authentication. The students record the lecture, store the recorded lecture in files, and edit and correct the files. During the lecture, the function for the right to speak, chatting using a voice and a text, and a screen share are offered to the students. The time to start, finish and maintain all events is predetermined to occur at a proper time.

Description

MULTIMEDIA ELECTRONIC EDUCATION SYSTEM AND THE METHOD THEREOF

The present invention relates to a learning system and method, and more particularly, to a multimedia electronic learning system and method that can solve the inconvenience of online education of the netizen through the appropriate combination of offline education and online education.

In the conventional multimedia electronic learning, the educational CD was produced and provided to the learner, thereby enabling the learner to learn by inserting the CD into the CD-ROM drive of the PC. In the case of a CD, since the storage capacity is large, it is useful to provide a moving image having a relatively large data size. However, the CD is not only hassle to be re-created when the latest information of the stored lessons is changed, and it is difficult to expect high learning effects and learning efficiency because it unilaterally delivers the learning contents to the learners. It was impossible to learn through direct exchange between teacher and learner like offline.

In addition, in recent years, the development of the Internet has provided online learning services, which can solve the difficulty of updating the latest information, which is a problem caused in the above case, but simply provides the contents of the lecture contents stored on the CD online. It was merely to allow learners to learn through the Internet.

The production of the learning content according to the prior art, while recording the voice in real time at the same time recording all events (including lecture means applied to the lecture screen, such as checks, underlines, reference material of important parts), such a method, In the case of using the event, if it fails to generate the event at the desired time, it is necessary to repeat the unnecessary process of synchronizing the sequence and time of event occurrence while repeating the same voice recording again.

In addition, if all the events including video are recorded while recording voice in real time, it is impossible to simultaneously input the events, so it is impossible to generate events at the same time. In the case of contents produced by the program recording in real time, There is no way to edit an event. If you input an event in non-real time, each data does not have a time value, so if the author wants to trigger a specific event at a desired time, you must fire it directly through the computer keyboard or mouse. When you want to trigger other events where you are located, each event does not have a time value that occurs or ends.Therefore, there is a limit to generating the event effect that the producer wants as well as the event that the producer wants. It was inconvenient to work with.

And, if you are recording and playing the progress in real time during a real-time teleconference, video training, or presentation, you can edit corrections such as mistakes in input of events or pronunciation errors of the presenter or participants during real-time lectures. Since it is not linked with the non-real-time editing program, the contents cannot be played as it is, and when a player attempts to randomly switch to a specific page while playing the produced contents of the lecture, the conventional player only switches pages. Since the voice data corresponding to the time of the switched page is not synchronized and keeps progressing, the voice data and the page contents are progressed separately.

The present invention has been made to solve the above problems, and an object of the present invention is to allow the contents of the lectures to be recorded and stored in real time and the stored contents can be edited in real time at the same time as the real-time lectures progress.

Another object of the present invention is to play content by setting a function such as giving voice for a question and answer during a lecture, chatting using voice and text, sharing a screen, and setting occurrence, end time, or retention time of all events applied to the content. To provide a multimedia electronic learning system and method that can occur when the time event is appropriate.

1 is a block diagram of peripheral devices required for the operation of multimedia e-learning according to the present invention.

2 is a diagram illustrating a role of a management server.

3A is a diagram illustrating a connection relationship between an MDBM server, a recording server, and each client.

3B is a diagram for explaining details of data exchanged with an MDBM server with each client and a recording server.

3C is a diagram illustrating in more detail the data details transmitted by the instructor I, the client C, and the specific client SC.

4 is a diagram illustrating a process in which data from a client side is transmitted to an MDBM server.

FIG. 5 is a diagram illustrating a process of broadcasting lecture contents in real time to a client side; FIG.

6 is a diagram illustrating a process of a recording server processing data received from an MDBM server and a management server.

7 illustrates an environment for a client to connect to an MDBM server.

8A illustrates a method of creating and editing an audio clip using a recorder of a non-real-time lecture production program, a method of inserting a video data file, and a process of storing a lecture file.

8B is a diagram for explaining a method of producing and providing a lecture in a download method.

8C is a diagram for explaining a method of producing and providing a lecture in a streaming method.

9 and 10 are diagrams showing screen configuration examples of a lecturer program and a student program of a real-time distance education program, respectively.

11 and 12 illustrate a recorder and a player of a non-real-time distance education program.

FIG. 13 illustrates the timeline window of FIG. 11 in more detail. FIG.

14 illustrates the event list of FIG. 11 in more detail.

FIG. 15 illustrates the event toolbar of FIG. 11 in more detail.

Fig. 16 is a diagram explaining an event input screen of a non-real-time program recorder.

Fig. 17 is a diagram showing an example of a voice editor used for voice editing in the present invention.

FIG. 18 illustrates a structure of a timetable array, an event data system, an occurrence event array and an end event array constituting the event data system, and each of the inputted events when the lecture contents are loaded in a program for non-real time playback. Drawing to explain the process.

19 is a diagram illustrating a process of managing occurrence and end times of each event by interworking a time table, an event list, and a timeline window;

20 is a flowchart illustrating a multimedia player algorithm according to the present invention.

※ Explanation of code about main part of drawing ※

100: management server 102: MDBM server

110: recording server

Multimedia electronic learning system according to the present invention to achieve the above object

Multiple client PCs including instructors and students; A recording server that records live lectures and automatically converts and stores them in a format that can be used by a non-real time remote program; An MDBM server connecting the plurality of client PCs to each other and broadcasting the data exchanged to all the client PCs and the recording server during the real-time lecture; And a management server that transmits the syllabus to the client PC and the recording server and is responsible for user authentication.

In addition, the multimedia e-learning method according to the present invention comprises the steps of preparing an event list while counting the lecture time in the lecturer to create a lecture file by using the recorder of the lecture production program associated with the lecture production; Generating a voice file together with counted lecture time information when a voice of an instructor is input; Storing the time of occurrence or termination of the event and the format of the event in the event list when an event is input; And synchronizing and separately storing the voice file and the event registered in the event list according to the lecture time information.

In relation to the playing of the lecture, loading the lecture file to check the total lecture time; Generating a time table array having a size corresponding to an entire lecture time; Retrieving the occurrence and end times of all events in the event list; After generating an event data system in a time table array corresponding to a time when an event occurs according to the occurrence and end time of all the events, storing the address of the system in the time table array, and then generating and ending event arrays in the event data system. Generating and storing corresponding occurrence and termination event addresses in the occurrence and termination event arrays; If there is an address of the event data system in the time table array corresponding to the lecture time while increasing the lecture time, the event is generated by loading the event of the corresponding event occurrence and end event addresses stored in the event data generation and end event array. Multimedia electronic learning method for playback characterized in that it comprises a step of terminating.

Hereinafter, with reference to the accompanying drawings will be described the present invention in more detail.

1 shows a peripheral device required for the operation of multimedia e-learning according to the present invention. A user accesses a management server, receives a user authentication, downloads a syllabus, and clicks a lecture room entry button to execute a client program to execute an MDBM server ( 100) and then all data transmitted from the user is sent to the Multimedia Data Broadcasting Module (MDBM) server 102. Each peripheral device such as a camera, monitor, keyboard, mouse, microphone, and speaker is connected to the peripheral controller 104. Is controlled by

For example, a client having a voice can capture his / her appearance during the real-time lecture through a camera and transmit it to the MDBM server 102. In addition, the client who has the right to speak can generate events as well as program control using the keyboard and mouse, capture the voice input through the microphone to the sound capture device, and send it to all clients through the MDBM server. The rest of the clients that do not have can listen to the voice of the client transmitted from the MDBM server through the speaker.

The MDBM server 102 serves to broadcast data exchanged to all client programs and recording servers during the real-time lecture as described in detail later.

FIG. 2 is a diagram illustrating the role of the management server. The lecture server stores a lecture slider image file, and also transmits the lecture (or instructional) slider image file required from the client 108 to the client PC when receiving the instruction of transferring the lecture (or instructional) slider image file required for the lecture. Transfer the lecture slider image file.

3A is a diagram illustrating a connection relationship between an MDBM server, a recording server, and each client.

The MDBM server 102 accepts in real time data transmitted by a client having a voice among clients (including a lecturer) attending a real-time lecture, and [and] a recording server 110 connected to all clients 108. It is responsible for broadcasting to.

The recording server 110 receives all broadcast data, and the instructor 106 selects a recording button to record a broadcast lecture when a recording signal is input through the MDBM server in a non-real-time distance education program. It automatically converts and saves into a usable format.

3B is a diagram for explaining details of data exchanged with MDBM server with each client and recording server.

For reference, each data type used below is as follows.

Abbreviation designation Data type I Instructor teacher C Clients All clients connected to the server except the instructor SC Specific Client Specific client S Server server RS Recording Server Recording server DI Data of instructor Instructor's Video / Video, Voice, Text, Events DC Data of Client Video / Video, Voice, Text, Events from Clients (Students) DIC Data / Instructor / Control Data Permission to speak, forced leave, message transfer, Time Data DCC Data / Client / Control Data Request for voice, note application, attendance, time data

The video / image data is only broadcasted to all clients and recording servers through the MDBM server, only the data of the instructor (I) and the client (C) who have been given a voice in the MDBM server.

Referring to FIG. 3B, data from the instructor I and all the clients C1... Cn connected to the MDBM server 102 are transmitted to the MDBM server 102, and the MDBM server 102 may be configured as follows. All received data DI, DC are broadcast to all clients C1... Cn and recording server 108 including instructor I. Therefore, the control signals transmitted by the instructor and other clients are also broadcasted, and the control data (DIC, DCC) of all clients including the instructor are broadcast only to recipients designated by each client through the MDBM server.

FIG. 3C is a diagram illustrating in detail the data details transmitted from the instructor (I), the client (C), and the specific client (SC), and all data generated in each case are via the MDBM server (S). Delivered.

Case 1 shows an example in which a specific client (SC) sends a voice request, a message, an O / X response to a question, and attendance check data to the instructor (I).

Case 2 shows an example in which a specific client SC transmits video, audio, event, and message data to another client C and an instructor I.

Case 3 shows an example in which the instructor I transmits a message, a video, a voice, an event, a voice deprivation, a permission to speak, and a forced leave data to a specific client SC.

Case 4 shows an example in which multiple clients (C) simultaneously transmit message, voice request, attendance check, and O / X response data to the instructor (I).

Case 5 is a case in which the instructor I issues a lecture recording start / stop command for the current lecture, and the recording server 108 starts or stops recording the lecture according to the instruction of the lecturer I.

Case 6 shows an example in which the instructor (I) transmits message, video, audio, and event data to all clients (C).

4 is a diagram illustrating a process in which data input through the client side, that is, the peripheral device controller 104 is transmitted to the MDBM server through the client program unit 112a.

Data received from the user is largely divided into image data, audio data, event object data, and control data. The data processing method and order are as follows.

For example, the image data received through the camera is automatically input to the data input time value after the image capture by the VFW (Video For Windows) is sent to the splitter, the splitter is a copy of the image captured by the VFW Is encoded by the H.263 + encoder in BMP format and sent to a multiplexer (hereinafter referred to as MUX), and the other is displayed in the client program's video window via the Windows video renderer. Thus, the client can check his captured image. Here, H.263 + is an international standard algorithm used to compress the video portion of a multimedia communication service for video conferencing, video, and telephone.

In addition, the voice data input through the sound card is sampled by the Wave In program and converted into PCM data, which is encoded by the G.723.1 encoder with the time value of the data input and transmitted to the MUX. . Here, G.723.1 refers to the international standard algorithm used for the compression of the voice part of multimedia communication service for video conferencing, video, telephone, etc.

In addition, event data is transmitted from the event data and control data input through the keyboard or the mouse to the MUX. At this time, the event data is transmitted to the MUX with the data input time value attached, and the control data is also attached with the data input time value. Is sent to the server.

The MUX extracts data having the same time value by searching the time values attached to the image, audio, and event data respectively inputted through the H.263 + encoder, the G.723.1 encoder, the keyboard, and the mouse. After enclosing the data, the original time value is attached again and sent to the MDBM server.

FIG. 5 is a diagram illustrating a process of broadcasting a lecture in real time to a client, and the MDBM server 102 transmits data received from the MUX to each client through the client program 112b. .

The video and audio data from the MDBM server 102 are demuxed in a demultiplexer (hereinafter referred to as DEMUX), and the attached time value is attached to each of the video and audio data again so that the H.263 + decoder and the G. 723.1 is decoded at the decoder. That is, the image data compressed by the H.263 + picture encoder is decoded by the H.263 + decoder, converted into BMP data, and then displayed as a video window through the video renderer. In addition, the voice data compressed by the G.723.1 voice encoder is decoded by the G.723.1 decoder, converted into PCM data, and then transmitted to the sound card via an audio renderer.

The event data is shown on the client PC along with the lecture slides (drafts) already downloaded from the management server 100 with the time value attached after being demuxed in DEMUX, and the control data transmitted from the MDBM server. Is delivered to the PC.

6 shows a process in which a recording server processes data received from an MDBM server and a management server.

The recording server 108 receives the lecture slide file from the management server 100 and broadcasts the contents of the lecture in real time from the MDBM server 102, wherein the data received from the MDBM server 102 is demuxed in DEMUX. The attached time values are then appended back to the picture and audio data respectively and decoded by the H.263 + decoder and the G.723.1 decoder, respectively. That is, picture data encoded with an H.263 + picture encoder is decoded by a H.263 + decoder and converted into BMP data, and voice data encoded with a G.723.1 voice encoder is decoded by a G.723.1 decoder and converted into PCM data. . Next, the BMP data and PCM data are converted into AVI files by the AVI file generator, and further converted into WMV files by the Windows Media Encoder.

On the other hand, the event data of the clients among the demuxed data, like other demuxed data, is reattached to the time value separated in the demuxing process, and is transferred to the ARF file along with the image lecture file previously received and stored from the management server. Stored.

Finally, the recording server 108 automatically stores WMV files and ARF files. The download version is a method of integrating and storing the WMV file and the ARF file, and the streaming version is a method of providing a WMV file with a large transmission capacity by streaming the WMV file and the ARF file separately. There are two ways to save.

FIG. 7 illustrates an environment in which a client having a real-time instructor or student program may access an MDBM server. The client may access an MDBM server using various connection environments such as a modem, an ISDN, a network, and an xDSL.

FIG. 8A illustrates a method of creating and editing an audio clip using a recorder of a non-real-time lecture production program, a method of inserting a video data file, and a process of storing a lecture file.

How to make an audio clip

In the case of audio (i.e. voice), an event can be recorded at the same time through the microphone while the voice is recorded simultaneously. The format is converted and automatically compressed. Here, the ADT voice file format is a self-contained voice compression format devised by the patent applicant, PoCsoft Co., Ltd., and is a voice compression in which a WAV file is converted by a voice file converter that performs encoding using a G.723.1 voice codec. File format used by non-real-time instructor and student programs. This voice format applicable to the present invention is not limited to the ADT file, and can be converted into an appropriate voice format by those skilled in the art.

You can also create audio clips using already recorded voice files. The audio file format used in the production is an ADT file format. If the previously recorded voice file is another format such as a WAV file, the voice file format is converted into an ADT voice format through a voice file converter.

This audio clip production method has the advantage that it is possible to use a pre-created voice data file without necessarily inputting a voice when producing a real-time lecture.

How to edit audio clips

The audio clip of the ADT file format produced as described above is edited and modified such as copying, moving, and deleting using a voice editor or a timeline window in a non-real-time instructor program.

How to insert a video data file

The video data file included in the lecture content can be played in the video window by inserting the file recorded in the file format supported by Windows Media Player through the 'Media file selection menu' or by clicking the 'Media event insertion menu' in the event toolbar. Can be inserted into the lecture slide through. In FIG. 8A, a video clip inserted through the media file selection menu is played through the video window of FIG. 9.

Course File Saving Process

The lecture file is divided into the download method and the streaming method. The lecture file creator can select and save the download method and the streaming method as desired.

FIG. 8B is a diagram illustrating a method of providing a lecture file produced by the download method in FIG. 8A. When the lecture file includes a media file, the media file is inserted into and attached to a lecture file in * .ARF format. When the client clicks the course file (* .ARF file format), the web server saves the course file on the client's PC from the DB server where the course file is stored. Next, the client plays the lecture file after the download is completed by executing a local player installed on the client PC.

FIG. 8C is a diagram illustrating a method of providing a lecture file produced by the streaming method in FIG. 8B, wherein the lecture file includes a streaming media file (eg, * .asf, * .wmv, * .wma). In this case, the media file is stored in a separate media server, and the remaining lecture data except the media file is stored in the DB server as a lecture file in * .ARF format. At this time, the lecture file stores the path of the streaming media file. When the client clicks the lecture file on the web server, the DB server that stores the lecture file stores the lecture file on the client's PC and plays the file in the local player or calls the OCX-type player in the web browser. After the player reads the storage path of the streaming media file from the lecture file, the player accesses the media server where the media file is stored, and the streaming service of the media file is performed.

9 and 10 show an example of the screen configuration (User Interface) of the real-time distance education program for students and real-time distance education program for students.

Real-time distance education program access

If an existing management system is established, first connect to the web server of the existing management system, go through the user authentication (teacher or student qualification), and then access the lecture management server. Lectures begin as student distance learning programs run.

If the existing management system is not established, it immediately accesses the real-time lecture management server, goes through the authentication process, and proceeds to the same process as above.

Real-time distance education program function

1) Video, voice data

When the lecture begins, the lecturer's voice is displayed on the video window of the student distance learning program along with the video screen of the lecturer currently in lecture [with current voice]. In the case where the student applies for the right to speak during the lecture, if the instructor grants the right to speak, the video window and the voice of the student who has been given the right to speak are output. If no camera is installed in the student's terminal, only the voice is output.

2) Chat function

Instructor distance education programs and student distance education programs both have text chat capabilities. If the instructor enters text in the chat input box and sends it, the message is delivered to all clients connected to the MDBM server. If the instructor enters text in the chat input box, the message is sent only to the instructor. You can choose to deliver the message to all clients you include.

3) Question and answer function

The question function is used when the student wants to ask the instructor during the real-time lecture, and the answer function is used when the instructor answers the student's question.

When the student inputs the question contents using the question function and presses transmit, the student is saved in the message box of the instructor through the MDBM server, and the instructor checks the contents in the question list box and uses the answer function for each question. You can answer and understand the situation of the question and the answer.

4) Request and grant of voice

The distance learning program for students has a voice application function that allows a student to apply for the right to speak to the instructor in real time, and the instructor distance education program has a function to grant and release the voice for the voice application. In the case of a student applying for a voice, the instructor distance education program can identify the speaker of the speaker in the list of students who attended the real-time lecture, and the instructor may give a voice to a specific applicant among the speaker of the speaker at any time. At this time, the video of the specific applicant granted the right to speak is displayed in the video window of all clients through the MDBM server and the audio is output. The instructor can switch back to the original instructor video and audio by releasing the voice.

5) Web sink function

While the lecture is in progress, the web browser function can be executed in the real-time instructor program and the student program, the site related to the contents of the lesson can be searched, and the client who has the voice can activate the web sync button while the web browser is running. When pressed, the URL is sent to all clients connecting to the MDBM server, allowing the same web page to be shared.

6) Question and answer function

The instructor can create and send quiz contents to students during the real-time lecture, and each student can send an answer through the answer function. At this time, the responses sent by each student can check what kind of answers they gave when checking the lecture attendees.

7) Lecture attendee check function

During the real-time lecture, the instructor can press the 'lecture attendee button' in the instructor distance education program to check the list of students who are currently attending the lecture, and check the quiz responses sent by the students.

8) Event input function

The current lecturer or student can insert an event into the current lecture course during the lecture in real time, and the input event is sent to all clients currently connected to the MDBM server.

9) Real-time lecture recording function

From the moment the instructor presses the record button, all data sent from the MDBM server to the recording server begins to be recorded in real time. The recorded data is stored in a data format (* .ARF) that can be used as it is in a non-real-time program, so that the recorded data can be modified and edited again in a non-real-time program and reproduced using a non-real-time player.

11 and 12 illustrate a recorder and a player of a non-real-time distance education program, respectively, wherein the recorder is an authoring program for creating and editing a distance education lecture content in a non-real-time environment, and the player plays back the content produced by the recorder. Program.

Referring to FIG. 11, the recorder includes a timeline window and an event list window for editing a playback time of an event used in a lecture, a recording tool for providing recording tools, an event toolbar for providing event editing tools, a main window screen, , Page tabs that display lecture pages.

Referring to FIG. 12, the player includes a lecture progress tool for controlling the progress of the lecture, a video window in which a video is played, a menu, and the like.

FIG. 13 is a view illustrating the timeline window of the recorder according to FIG. 11 in more detail. Details of the functions are as follows.

-Display how long each page is held for.

-You can delete, copy and move to the desired location by selecting an event with the mouse, and the changed contents are applied to the event list as it is.

-You can select the voice of the part you want to edit by deleting, copying, moving, etc. by specifying the area using the mouse.

-If you include an event in the desired time zone with voice data in the drag area, you can edit, delete, copy, and move the event simultaneously with the voice data, and the changed contents are applied to the event list as it is.

-When an event object in the timeline window is clicked once, in case of an event whose end time is set, a bar indicating the event holding time is displayed next to the event object.When the mouse is clicked on the bar, the holding time is automatically adjusted and changed. The end time of the event list window is automatically set according to the holding time.

FIG. 14 is an enlarged view of an event list window of the recorder of FIG. 11, and the detailed functions thereof are as follows.

The events that make up a lecture are classified into general events and media events as follows: General events include straight lines, free lines, arcs, rectangles, ellipses, text boxes, group boxes, pictures, OLE objects, and formulas. These include Windows media files, real media files, and flash files.

In addition, the order item indicates an input order of events, the type item indicates a type of event, a start time item indicates a time when an event occurs, and an end time item indicates a time when the corresponding event ends.

Event input method

To enter the event's occurrence time and end time, select the event that you want to occur or end while recording a lecture from the events already in the Event List window, and start the events listed in the Event List window. There is a way to enter the time and end time directly.

1) How to select an event yourself

When recording starts, the time is counted as the time bar moves by 1 second in the timeline window. At this time, select the desired event in the event list window and press the box indicating the event shape to select the time indicated by the time bar. Automatically entered as the event time.

Also, when there is an event that you want to end after the event holding time, when the time bar reaches the desired time When the button is pressed, the time indicated by the time bar is automatically entered as the end time of the selected event. Information on the occurrence time and end time of each event object that is changed while directly selecting an event is applied to the timeline window as soon as the change occurs.

2) How to enter the time directly

You can enter the time directly by clicking the occurrence time of the desired event in the event list window, and the event with the input time will occur at the corresponding time.

If you want the event to end at the desired time, you can enter the time directly by clicking the end time of the event, and the event with the end time entered will disappear from the page. In addition, information on the occurrence time and the end time of each event object that is changed while directly inputting the time is immediately applied to the timeline window as it is changed.

FIG. 15 is a view illustrating an event toolbar for selecting and inputting an event of a non-real time recorder according to FIG. 11, and the detailed functions thereof are as follows.

Event entry number

In the event input tool When the icon is activated, each time you input each event, the corresponding number is entered in the order of each event. These event numbers make it easy to find the desired event when there are many events.

Edit status

Of the event input tool You can switch between page editing mode and event editing mode by using the icon. The event editing mode is a mode for inputting an event. The event can be modified at any time.

The work done in the page edit mode is a mode for inputting the content of the page. The events input here are not given a time value. Thus, when content is loaded from a non real-time player, the events edited in the edit mode are invoked simultaneously with the time the page is loaded, regardless of time.

FIG. 16 illustrates a screen when an event is input by the recorder of FIG. 11, and the detailed functions thereof are as follows.

The objects at the current position

If you enter an event in non-real-time event editing mode, you can insert events to be applied on the page in advance. If you double-click the mouse right button, the items of the events included in the current location will be listed along with the event name. A window will appear. This takes into account the difficulty in moving or editing the location if the events overlap in similar locations. If a desired event name is selected from the event names included in the contents of the window with a mouse, the desired event is automatically selected to move, copy, delete, and the like.

FIG. 17 is a view showing an example of a voice editor used for voice editing in the present invention. There are two voice editing methods, a method of editing using a built-in voice editor and a method of directly editing in a timeline window.

How to use the voice editor

By using the voice editor as shown in FIG. 17, the desired voice data portion can be selected, copied, deleted, and moved. The original is placed at the top of the voice editor, and the portion to be modified is re-recorded at the bottom of the voice editor. In contrast, you can perform voice editing.

How to use the timeline window

If you want to edit only the voice, you can set the area you want to edit in the timeline window and select only the voice data part to edit, modify, delete, etc., which is included in the time corresponding to the voice data of the edited part. If you want to delete, copy, move, etc. the event at the same time, the event objects on the timeline window can be included in the voice edit area to edit them together with the voice data.

18 illustrates a process of synchronizing and playing each event inputted during a lecture.

The * .ARF file stores the total time of the lecture, the time when each event occurs, and the time when the event ends.When the player starts, the first time the entire lecture is read in seconds By creating a time table array corresponding to the size of the corresponding second unit, all data in the array is initialized to a null value.

Next, the time value of all event objects entered in the * .ARF file is read. At this time, when there is no event that occurs or ends, the data of the corresponding time table array is maintained at the initially set null value. In contrast, when there is a time when there is an event to occur or end, an event data system is automatically generated at that time, and the address of the generated event data system is stored in an array value in the time table array. The event data system consists of two arrays, ShowEvent and HideEvent. Among the events belonging to the time specified by the event data system, the event to be occurred is stored in the ShowEvent array, and the event to be terminated is stored in the HideEvent array. .

When all the time value of each event is completed and the configuration of event data system is completed, the time table is searched from 0 second to the end time. If the value in the time table array is Null, it moves to the next time and is not Null. Calls the event data system, and the ShowEvent and HideEvent arrays are retrieved to raise or terminate the event.

19 shows that a time table, an event list window, and a timeline window interoperate with each other to manage each event occurrence and end time.

20 is a flowchart illustrating a multimedia player algorithm according to the present invention.

First, the player is executed (S100), and the desired lecture file (* .ARF) is opened (S102).

The entire lecture time of the lecture file is checked (S104).

A time table array having a size corresponding to the entire lecture time is generated and all data in the time table array is set to null (S106).

The generation and end times of all pages and objects in the lecture file are retrieved (S108).

The event data system is generated at a time when an event to be generated or terminated next occurs (S110).

In step S112, a ShowEvent or HideEvent array is generated in the event data system generated at the time of occurrence or termination of the event and stores the address of the corresponding event.

Next, the current time CurTime is set to 0 (S114).

When clicking on any page, the occurrence time of the selected page is stored as the current time (CurTime).

Next, it is checked whether or not the value of the time table (current time) ((Time Table (CurTime)) is Null (S116). At this time, the value of the time table (current time) ((Time Table (CurTime)) If not null, the event data structure corresponding to the time table (CurTime) is called (S118), and all the addresses corresponding to the addresses stored in the ShowEvent array in the event data system are called. An event is generated (S120), all events corresponding to addresses stored in the HideEvent array in the event data system are terminated (S122), and the current time (CurTime) is increased by one (S124).

Next, it is checked whether the current time CurTime exceeds the entire lecture time (S126). If the current time (CurTime) exceeds the total lecture time, the lecture ends (S128), otherwise, steps S116 to S124 are repeated.

The present invention is not limited to the above description, and it is apparent that each system and step can be added or subtracted according to the contents of the lecture, the system environment, or the user's selection.

According to the present invention described above it can be expected the following effects.

First, record your voice in advance, save it as a WAV or ADT file, and then specify the voice file in the recorder before starting recording, and then start recording, instead of simultaneously recording the voice. It's much more efficient than its work.

Second, because it provides a way to modify or edit the event and voice data files input in real time, if you want to modify or edit the existing content, you can do partial editing work without having to re-create from scratch.

Third, by assigning a time value to occur or end in each event, the event occurs at the author's intended time. Therefore, the event occurrence time can be adjusted without the creator directly manipulating the content. After that time, you can use multiple events at similar locations by specifying the time of the next event.

Fourthly, double-clicking the right mouse button at the point where multiple events overlap to display the list of all the events at the point where the pointer is located improved the editing and editing method of the event.

Fifth, the homepage associated with each event can be linked, so if a user selects an event at any time while the content is running, the web browser is automatically executed and can move to the homepage address set by the producer in the event property.

Sixth, since all events including voice, video, and page constituting the content are synchronized and combined with the occurrence time and the end time value, any part of the content can be repeatedly played at any time using the time bar.

Seventh, during the real-time lecture, the recorded video, voice, event, and contents of the lecture syllabus are recorded and saved as they are, and reloaded in the non-real-time lecturer program to be modified and edited in the same manner as the existing non-real-time version contents modification method. Can be.

Claims (22)

Multiple client PCs including instructors and students; A recording server that records live lectures and automatically converts and stores them in a format that can be used by a non-real time remote program; An MDBM server connecting the plurality of client PCs to each other and broadcasting data exchanged during a real-time lecture to all client PCs and a recording server; And And a management server that transmits a syllabus to the client PC and the recording server and is responsible for user authentication. The method according to claim 1, The client PC, An image input unit (VFW) for automatically inputting a data input time value to a splitter after capturing image data input through a camera; A splitter unit for copying the captured image, one of which is transmitted to a MUX and the other of which is displayed as a video window of a client program through a window video renderer; A voice conversion unit for converting the voice data input through the sound card into another format after sampling the data; And And a mux to mux the captured image data, the converted voice data, and the event data input through a keyboard or a mouse to an MDBM server. The method according to claim 2, The MUX extracts data having the same time value by searching the time values attached to the respective input image, audio, and event data, merges the extracted data into one data, and attaches the original time value again. Multimedia e-learning system, characterized in that the transmission to the MDBM server. The method according to claim 2, The client PC, A DEMUX demuxing data transmitted from an MDBM server into the captured image data, converted audio data, and event data; An image output unit which displays the image data in a moving picture window; A voice output unit for transmitting the voice data to a sound card; And And a lecture output unit configured to display the event data on a client PC together with a lecture instruction downloaded from a management server. The method according to claim 4, And the DEMUX demuxes the original time value to the input image, audio, and event data, respectively. The method according to claim 1, When the recording server processes the data received from the MDBM server and the management server, The data received from the MDBM server is demuxed into image data, audio data and event data in DEMUX, and then the image data and audio data are merged and converted into a predetermined multimedia file for transmission, and the event data is stored in a management server. Multimedia e-learning system, characterized in that the received and stored in the lecture file and synchronized with the image lecture file. The multimedia e-learning system of claim 6, wherein the multimedia file and the lecture file are then merged into one file and stored in a separate storage medium. The multimedia e-learning system of claim 6, wherein the multimedia file and the lecture file are stored in a separate storage medium, wherein the lecture file includes information about an address where the multimedia file is stored. The multimedia e-learning system of claim 7, wherein the merged multimedia file and the lecture file are playable on a client PC. The method of claim 8, wherein the lecture file is playable on a client PC, and the client PC reads the multimedia storage address included in the separate lecture file and receives the multimedia file from the multimedia storage address. Multimedia electronic learning system. The instructor uses the recorder in the course creation program to create the course file. Preparing an event list while counting lecture times; Generating a voice file together with counted lecture time information when a voice of an instructor is input; Storing the time of occurrence or termination of the event and the format of the event in the event list when an event is input; And And synchronizing and storing the voice file and the event registered in the event list according to lecture time information. The method of claim 11, wherein the generating of the voice file comprises merging lecture time information with an already stored voice file. The multimedia learning method of claim 11, wherein the event generation time or end time is directly input by an instructor. The method of claim 11 wherein the event comprises a line, a circle, a box, an OLE object and a multimedia file. The method of claim 11, wherein the event list includes a plurality of event information at one occurrence or end time. The method of claim 15, wherein when the same occurrence or end time includes a plurality of event information, the plurality of event information further includes separate identification information, and the plurality of events at the same time according to the separate identification information. The information is distinguishable, and the multimedia learning method can display the corresponding event by selecting separate identification information. 17. The apparatus of claim 16, wherein the recorder provides a timeline window for editing the occurrence and end times of lectures and events, a recording tool for providing recording tools, an event list window for editing the occurrence and end times of each event, and event editing tools. And an event toolbar, and a main window screen on which lecture lectures and events are displayed. The multimedia learning method of claim 17, wherein the event occurrence time or the end time input to the event list window may be modified by adjusting an event occurrence and end time displayed in the timeline window. The multimedia learning method of claim 18, wherein an event occurrence and end time displayed in the timeline window and an event occurrence and end time input to the event window are interlocked with each other. Loading a lecture file to check the entire lecture time; Generating a time table array having a size corresponding to an entire lecture time; Retrieving the occurrence and end times of all events in the event list; After generating an event data system in a time table array corresponding to a time when an event occurs according to the occurrence and end time of all the events, storing the address of the system in the time table array, and then generating and ending event arrays in the event data system. Generating and storing corresponding occurrence and termination event addresses in the occurrence and termination event arrays; If there is an address of the event data system in the time table array corresponding to the lecture time while increasing the lecture time, the event is loaded by loading an event of the corresponding event occurrence and end event addresses stored in the event event array and the end event array in the event data system. Generating or terminating the multimedia electronic learning method. 21. The method of claim 20, wherein all of the time table arrays corresponding to the time without an event are designated as Null. 21. The method of claim 20, further comprising playing the voice file according to an increased lecture time.