KR100386036B1 - System for Editing a Digital Video in TCP/IP Networks and controlling method therefore - Google Patents

Abstract

The present invention provides a client computer for outputting a nonlinear editing control signal by streaming only digital data having a predetermined buffer capacity through the Internet or an intranet, and optionally selecting file data according to a digital video data transmission request signal input from the client computer. Provided is a digital video editing system on a TCP / IP network consisting of an editing server computer that transmits over the Internet or an intranet and nonlinearly edits a digital video data file in accordance with a nonlinear editing control signal input from a client computer.

The present invention executes nonlinear editing using the TCP / IP protocol on a low specification client computer for digital video such as MPEG-1 and MPEG-2 stored in a high specification server computer of a client / server method. By editing the digital video data using a low-end client computer, it maximizes the editability of the digital video and non-linear editing of the digital video signal even with a relatively low-cost device. The functionality of the system can also be significantly improved.

Description

System for Editing a Digital Video in TCP / IP Networks and controlling method therefore}

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a digital video editing system and a control method thereof over a TCP / IP network, and more particularly to digital video such as MPEG-1 and MPEG-2 stored in a high specification server computer of a client / server method. (Iii) A digital video editing system on a TCP / IP network for performing nonlinear editing using the TCP / IP protocol in a client computer of the specification and a control method thereof.

In general, nonlinear editing in a nonlinear editing system is a process of processing basic effects such as cutting, copying, and pasting video data and processing special effects by accessing arbitrary portions of digital video data stored on a computer hard disk. This is a series of processes for generating new digital video data. In addition, such a conventional nonlinear editing system targets uncompressed video data in AVI format.

By the way, such a nonlinear editing system is currently being used commercially many products. For example, Adobe's Premiere, which performs nonlinear editing in software, has been developed and commercialized. Softimage's Digital Studio and Avid's MCXPress, which target data in M-JPEG format, are widely used.

In addition, the non-linear editing system of the digital video provides a function of accessing an arbitrary screen and various video editing functions such as copy, cut, and paste in software, but the size of the input and edited digital video. Is so large that it is difficult to store and transmit it. In recent years, video data in MJPEG format has been improved.

The conventional digital video nonlinear editing apparatus as described above can easily provide various editing functions without loss of image quality because the input video stream is independently compressed in JPEG format, but the MJPEG itself as a result of editing has a low compression ratio (3: 1- 15: 1), which is not suitable for transmission through a communication network, and even a video compressed nonlinear editing system CVEPS (A Compressed Video Editing and Parsing System) targeting MPEG is based on JAVA. The execution speed was very slow, and it was inefficient because it was used after receiving all the videos from the client side, and there was a problem that only MPEG videos could be edited.

Thus, the present invention was invented to solve the above problems,

The present invention relates to a digital video editing apparatus and a method of controlling the same over a TCP / IP network. In particular, the present invention relates to digital video such as MPEG-1 and MPEG-2 stored in a high mute server computer of a client / server method. (Iii) Nonlinear editing is performed on the client computer of the specification using the TCP / IP protocol, thereby editing digital video data without any hardware using the low specification client computer. It is an object of the present invention to provide a digital video editing system and a control method thereof on a TCP / IP network that maximizes.

Another method of the present invention provides a digital video editing system over a TCP / IP network and a method of controlling the same, which makes it possible to nonlinearly edit digital video signals even with relatively low cost devices. To provide.

In order to achieve the above object, the present invention provides a client computer for outputting a nonlinear editing control signal by streaming only digital data having a predetermined buffer capacity through the Internet or an intranet, and according to a digital video data transmission request signal input from the client computer. Provide a digital video editing system on a TCP / IP network consisting of an editing server computer that transmits the selected file data via the Internet or an intranet and nonlinearly edits the digital video data file in accordance with a nonlinear editing control signal input from a client computer. do.

In order to achieve the above object, the present invention provides a non-linear editing system consisting of a server and a client computer, in which a client computer does not completely receive and use digital video data to be edited, but streams it by a certain amount of buffer on the monitor of the client computer. In order to perform an effective quick clip editing according to the editing control signal input from the client computer and to display the corresponding file to be displayed, a scene change point is automatically detected, indexed into a representative frame, and the indexed information is transmitted to the client computer. Non-linear editing information execution step; and editing a digital video using the control data received from the client computer by the editing server computer. It provides a control method of the system.

1 illustrates the structure of an inventive editing system in a client / server environment.

2 is a flowchart of the present invention.

3 is an explanatory diagram for explaining an example of an editing menu screen of the present invention;

4A is a diagram illustrating the structure of a message received at a server side.

4B illustrates an embodiment of a message received for editing on the server side.

Fig. 4C is a diagram for explaining the concept of editing processing on the server side.

5 is a diagram illustrating types of messages transmitted from a server side;

6 is a diagram illustrating the structure of a video clip message transmitted from a server side.

<Detailed Description of Codes>

1: internet 2: client computer

3: Edit server computer 4: Input device

5: central processing unit 6: hard disk

7: network card 8: communication unit

9: monitor 10: decoder

11: indexer 12: editor

13: encoder 14: hard disk

15: network card 16: communication unit

17: Hard disk for editing

Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.

As shown in FIG. 1, the digital video editing system of the present invention is a client computer (2) for streaming only digital data having a certain buffer capacity through the Internet or an intranet (1) to output a nonlinear editing control signal, and the client computer ( In accordance with the digital video data transmission request signal input from 2), the selected arbitrary file data is transmitted via the Internet or an intranet (1), and the digital video data file is nonlinear according to the nonlinear editing control signal input from the client computer (2). It consists of an editing server computer 3 for editing.

The client computer 3 then buffers any digital video file in accordance with an input device section 4 for inputting a non-linear edit control command of the user and a non-linear edit control command input from the input device section 4. A central processing unit (5) which receives only as much as the streaming method and outputs a non-linear editing control signal for the digital video signal of the selected file and controls the client computer (2) as a whole, and the central processing unit (5) And a network card 7 for converting communication signals inputted and outputted to the central processing unit 5 into system signals. It is provided. In addition, one end of the network card (7) of the client computer (2) is provided with a communication device unit (8) connected to the Internet or intranet (1) for transmitting and receiving various communication signals, the client computer (2) One end of the monitor 9 is connected to display various video screens.

Here, the input device unit 4 generally includes a keyboard, a mouse, and the like.

On the other hand, the editing server computer 3 has a decoder 10 for decoding the digital video data inputted and outputted in real time for image processing, and an indexer 11 for indexing the video data for editing the digital video data in units of clips. An editor 12 for performing basic editing and special effects editing of the digital video data, an encoder 13 for encoding and transmitting the digital video data generated as a result of the edited digital video to a client; (12) or a hard disk (14) for storing data calculated by the decoder (10) and used as an application program and data storage space for various editing, and newly edited digital video encoded by the encoder (13). A network card 15 for converting data into an external communication signal is provided.

In addition, one end of the network card 15 of the editing server computer 3 is provided with a communication device unit 16 connected to the Internet or intranet 1 to transmit and receive various communication signals. At one end of 3), an editing hard disk 17 used as a storage space for digital video editing data is provided.

Here, in the hard disk 6 of the client computer 2, application software for connecting to and editing the editing server computer 3 is stored.

Next, a control method applied to the system of the present invention as described above will be described.

In the control method of the present invention, as shown in FIG. 2, first, in the initial state S1, the process proceeds to the setting determination step S2, and it is determined whether an editing command of an arbitrary file has been input from the current user to the client computer. . If it is determined during the editing command setting determination step S2 that the editing command is not input by the user, the process proceeds to the general function execution step S3 to execute a general function such as a document processing set by the user. However, if it is determined during the editing command setting determination step (S2) that if an editing command is input from the user, the display proceeds to the editing menu screen displaying step (S4) and displays an editing menu screen for editing the digital video file on the monitor. Let's do it. After the editing menu screen display step (S4), the process proceeds to the editing file setting determination step (S5), and it is determined whether the user sets a file desired for non-linear editing within a predetermined time from among the files stored in the editing server computer (3). . At this time, as a result of the determination in the editing file setting determination step (S5), if the user does not set the file for editing within a predetermined time, the process returns to the previous step (S5) and repeats the loop.

However, if it is determined during the edit file setting determination step (S5) that the user has set a file for editing within a predetermined time, the process proceeds to the edit file transfer step (S6) and the client computer 2 sets the file to be edited by the user. Is read out from the editing server computer 3 in a streaming manner and displayed on the monitor editing menu screen. After the edit file transfer step (S6), the file open determination step (S7) proceeds to determine whether or not the edit server computer 3 has transmitted the file open control signal from the client computer (2). At this time, if the file open control signal is transmitted from the client computer 2 as a result of the determination in the file open determination step (S7), the process proceeds to the file open execution step (S8) and the file open control signal of the client computer (2). Accordingly, the editing server computer 3 opens the file on the client computer 2 via the Internet or displays a list of files created. However, if the file open control signal is not transmitted from the client computer 2 as a result of the determination during the file open determination step (S7), the process proceeds to the scene change message detection determination step (S9) and the scene from the current client computer (2). The editing server computer 3 determines whether the changeover detection control signal has been input. When the scene change detection control signal is input from the client computer 2 as a result of the determination during the scene change message detection determination step S9, the editing server computer 3 proceeds to the scene change detection execution step S10. The scene change point is detected from the currently edited edit file. Further, after the scene change detection execution step (S10), the process proceeds to the index information generation step (S11), and the editing server computer 3 generates index information of the corresponding edit file set according to the edit control signal of the current client computer 2. The editing server computer 3 executes the video clip of the edited file according to the edit control signal to the client computer 2, and then proceeds to the video clip transmission step (S12). (2) It is displayed on.

On the other hand, if it is determined during the scene change message detection determining step S9 that the scene change detection control signal is not input from the client computer 2, the process proceeds to the switching effect setting decision step S13 and the current client computer 2 is present. The editing server computer 3 determines whether a control signal for setting a transition effect has been transmitted to the corresponding editing file set from the above. When the switch effect setting control signal is transmitted from the client computer 2 to the edit server computer 3 as a result of the determination in the switch effect setting determination step S13, the flow goes to the switch effect execution step S14. (3) executes the switching effect on the edited file set in accordance with the switching effect control signal of the current client computer 2; After the transition effect execution step S14, the process proceeds to the special effect setting determination step S15 to determine whether a control signal for setting a special effect is transmitted to the corresponding editing target file set from the client computer 2 at present. At this time, when the special effect setting control signal is transmitted from the client computer 2 to the editing server computer 3 as a result of the determination in the special effect setting determination step S15, the process goes to the special effect execution step S16. (3) executes the special effect on the corresponding edit file currently set according to the special effect control signal of the client computer 2; On the other hand, when the switching effect setting control signal is not transmitted from the client computer 2 to the editing server computer 3 as a result of the determination in the switching effect setting determination step S13, the process goes to the special effect setting determination step S15. . Then, after the special effect execution step (S16) proceeds to the video generation and transmission step (S17) and the editing server computer 3 generates a video of the current editing file that has been processed special effects and then the corresponding information via the Internet Transfer to computer 2.

In other words, when a user wants to non-linearly edit a file containing a digital video of his or her desire, when the user inputs an edit control command to the client computer 2 of the present invention through the input device unit 4, the client computer 2 The central processing unit (5) recognizes and executes the application software stored in the hard disk (6). Then, on the monitor 9 of the client computer 2, an editing menu screen, i.e., a graphic editing menu screen for a graphic user interface (GUI), is displayed as shown in FIG.

Here, referring to FIG. 3, the edit menu screen, the indicator 220 indicates how far the source file is streamed. As a control button for the source file, source file playback (285), source file pause (286), source file stop (287), source file first (288), source file last (289) Displayed as button contents.

In addition, the tracker 240 in the edit menu screen to randomly access at a specific time of the source file, the parsing button 270 automatically detects the scene change point in the video file in order to conveniently edit the source file logical Create a movie clip.

In addition, the edit effect window content 280 of the edit menu screen shows a list of transition effects and special effects, and when a corresponding item is clicked, the respective effect feature pages are displayed.

In addition, the edit progress indicator 246 of the edit menu screen indicates the progress of the editing of the server computer, and when the completion is completed, the video data is streamed from the edit server computer 3 to be streamed from the streaming progress indicator 225. The situation may be displayed and the video file may be played in the target window 215.

The control buttons for the target window are composed of the contents of the playback 290, pause 291, stop 292, first return 293, and last go 294 of the edited video file, respectively. do.

In addition, the play time indicator 236 of the edit menu screen indicates the time at which the edited video file is played, and the total time indicator 237 shows the total time of the edited video. The edit result list window 260 is a window showing a list of source files to be edited and special effects and characteristics.

For example, in the editing menu screen displayed on the screen of the monitor 9 of the client computer 2, an IP address 275 of the editing server computer 3 for editing a file using a mouse of the input device unit 4 is edited. Select () and connect the file to which the user wants nonlinear editing to the file open (284) message on the edit menu screen, then the central processing unit of the client computer (2). (5) recognizes this and accesses the editing server computer 3 via the Internet card or the intranet 1 via the network card 7 and the communication device section 8 and requests the transfer of the corresponding file. Then, the editing server computer 3 searches the hard disk 14 for a list of video files in a specific directory to be inputted by the TCP / IP protocol and retrieves the corresponding files from the network card 15 and the communication device unit. (16) is displayed on the editing menu screen of the monitor 9 of the client computer 2 via the Internet (1).

Then, when the user double-clicks the corresponding file set by the user displayed on the monitor 9, for example, the central processing unit 5 recognizes this and streams the corresponding video file by a predetermined buffer capacity. Open on the screen.

At this time, the user opens the file in the same manner as opening the file on his client computer 2, but in reality the user of the files stored in the hard disk 14 or the editing hard disk 17 of the editing server computer 3 Is to select a random file from the list.

Here, the read video file is displayed on the client computer through the Internet or the intranet 1 in a streaming format.

On the other hand, the user performs non-linear editing of the file on the edit menu screen shown in FIG. 3, wherein the edit server computer 3 is an integer type and a string type as shown in FIG. 4A transmitted by the client computer 2 Receives a control message in the form of a variable, determines the control message, and executes editing according to the control signal.

4A shows a structure of a message list for editing in the editing server computer 3.

A is the clip ID indicating the order to edit,

B (i) represents the file path of the source data to be edited, and C represents the name of the source data to be edited,

D denotes a start time indicating a time at which editing starts from source data, and E denotes an end time of editing from source data.

In addition to the basic editing, it indicates which special effect editing is performed, and G and H respectively indicate the start coordinates of the upper left and the end coordinates of the lower right for the point where the effect will occur in the mosaic and the like.

For example, when a user selects an arbitrary file on the editing menu screen of the client computer 2, the central processing unit 5 of the client computer 2 recognizes this and controls the control with the editing server computer 3. Send a message signal. Then, the editing server computer 3 generates a directory and file lists and transmits them to the client computer 2 when a file setting message signal is received from the input control message.

When the central processing unit 5 of the client computer 2 selects any file from the file list received from the editing server computer 3 and transmits a file open message, the editing server computer 3 is shown in Fig. 4A. Initializes a video file executed by a structure as shown in FIG.

In addition, when the user clicks on the scene change detection for editing a video in the corresponding file on the editing menu screen of the client computer 2, the central processing unit 5 recognizes this and outputs the scene change detection message control signal to the editing server computer ( 3) to send. The editing server computer 3 then performs a scene change detection on the initialized file to generate a logical video clip, generate a representative frame and time of the clip, and transmit it to the client computer 2.

The frame represented here is the first frame in the clip.

4B illustrates an embodiment in which a table for editing is edited on an editing server computer using the above-described structure.

As described above, the order of editing is determined using the clip ID, the video file is read using the file path and name, the editing is performed from the start time to the end time according to each ID, and the type of effect Apply different effects accordingly.

On the other hand, when the editing server computer 3 receives the edit message in the form of a list from the central processing unit 5 of the client computer 2, the editing server computer 3 sorts the items of the list to assist the editing effects such as switching effects and special effects. As shown in 4c, a new video file is generated.

Here, FIG. 5 shows the types of messages that the server sends to the clients.

J is a video file to be streamed, K (i) is a directory and file name of the file, L is a structure variable for indicating a message type of what message is currently being transmitted, and a video clip at the client.

6 is a structure of a structure variable for representing the video clip.

N (i, j, k) represents the RGB value of the representative frame, and O represents the time of the representative frame.

As described above, the present invention uses the TCP / IP protocol in a low specification client computer for digital video such as MPEG-1 and MPEG-2 stored in a high specification server computer of a client / server method. By performing nonlinear editing, the digital video data can be edited without any hardware using a low specification client computer, thereby maximizing the editability of the digital video.

According to the present invention, since the digital video signal can be nonlinearly edited even with a relatively low cost device, the functionality of the nonlinear system can be significantly improved.

Claims (4)

A client computer that streams digital data of a certain buffer capacity only through the Internet or an intranet to output a nonlinear edit control signal, and optionally selects file data selected according to a digital video data transmission request signal input from the client computer. A digital video editing system on a TCP / IP network, comprising: an editing server computer that transmits through and nonlinearly edits a digital video data file in accordance with a nonlinear editing control signal input from a client computer. The digital video editing apparatus of claim 1, wherein the editing server computer includes a decoder for real time decoding of digital video data inputted and outputted in real time, an indexer for indexing video data for editing the digital video data on a clip basis, and the digital video. An editor for performing basic editing and special effects editing of data, and an encoder for encoding and transmitting the digital video data generated as a result of the edited digital video to a client are provided. Editing system. The method of claim 1, wherein the structure of the message list to be edited by the editing server computer is A, which is a clip ID indicating the order of editing, B (i) indicating a file path of the source data to be edited, and the source data to be edited. Effects such as the name C, the start time D indicating the time at which editing is to be started from the source data, the E indicating the end time of editing from the source data, the F indicating what special effect editing is to be performed in addition to the basic editing, and the effect of each mosaic. Digital video editing system on a TCP / IP network, characterized in that it consists of G and H representing the start coordinates in the upper left and the end coordinates in the lower right for the point at which is to occur. In the nonlinear editing system consisting of a server and a client computer, the client computer does not completely receive and use digital video data to be edited, but displays the corresponding file streamed by a predetermined amount of buffer and displayed on the monitor of the client computer. Nonlinear editing information execution step of automatically detecting scene change points, indexing into representative frames, and transmitting the indexed information to the client computer in order to perform an effective quick clip-based editing according to the edit control signal input from the computer; And a video editing step in which the server computer edits the digital video by using control data received from the client computer.