JP2010287979A - Image editing device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a mechanism which can transfer in a time as short as possible a perfect package image which is a result of cut editing at an imaging site and can perform re-editing based on the perfect package image transmitted as necessary. <P>SOLUTION: An image editing device 100 has an input portion 109 inputting at least one image data and editing information used when image is cut from the image data to be edited, a rendering portion 105 generating editing image data which is image data edited based on the editing information, a management information preparing portion 107 generating management information associating low resolution image data including the editing information, whose content is the same as that of the image data, and whose compression rate is different from that of the image data with the editing image data, and a recording medium control portion 108 outputting the editing image data, the low resolution image data, and the management information. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to a video editing apparatus that records, reproduces, and edits video.

  Conventionally, broadcast program production is performed by recording video on a tape using a camera recorder, editing the video recorded on the tape with a special effect while dubbing the video on a VTR, and editing the edited video, so-called completion. An editing method called linear editing was used to write the packet back to the tape. 2. Description of the Related Art In recent years, an editing method called nonlinear editing has been established in which video captured with a tape is taken into a hard disk and converted into a file, which is edited with a personal computer (PC). In non-linear editing, editing is performed by creating an image of editing (editing information) displayed on the GUI using a mouse or the like. After the editing is completed, the editing result is recorded (rendered) in one file based on the editing information, and a complete packet is created.

  Bring a non-linear editing device (non-linear editing machine) to the shooting site, perform editing that only cuts out the necessary part of the video, so-called cut editing, and then return to the broadcast station and add special effects, etc. A workflow to complete editing is also being used. With the recent development of network infrastructure, it has become possible to send filed video data from a shooting site to a broadcasting station using a network protocol such as FTP (File Transfer Protocol RFC959). On the broadcast station side that received the sent file, the station staff can write scenarios and add video effects before the on-site staff returns, thus eliminating waiting time and improving work efficiency. Can do.

  However, even though the network infrastructure has been improved, it is still unrealistic to send all shot images, and measures to reduce the network transfer time are necessary. In Patent Document 1, in a system comprising a server that manages high-resolution video and a client that receives the download and edits the video, the server downloads the high-resolution video managed by the server instead of the low-resolution video, and the client Discloses a method for reducing the time required for downloading by reducing the amount of data flowing through the network by performing editing based on the low-resolution video. As an application of the present invention, the transfer time can be shortened by lowering the resolution of the video when transferring the video from the field to the broadcasting station, that is, by lowering the bit rate.

JP 2001-45279 A

  However, the low-resolution video can be used when editing information is created, but cannot be used as it is for transmission or the like.

  An object of the present invention is to provide a video editing apparatus capable of re-editing video data edited as necessary, as well as creating a video having a quality that can be transmitted as it is.

  The video editing apparatus of the present invention includes an input unit that inputs at least one video data and editing information that is used when the video is cut out from the video data and edited, and editing by editing the video data based on the editing information A rendering unit that generates video data; a management information generation unit that generates management information that associates the edited video data with low-resolution video data that includes the editing information and has the same contents as the video data but different compression rates; An output unit that outputs the edited video data, the low-resolution video data, and the management information.

  According to the present invention, edited video data that can be sent out can be created and the edited video data can be re-edited by the above configuration.

The block diagram which shows the structure of the video editing apparatus in one embodiment of this invention The block diagram which shows the structure of the rendering part in one embodiment of this invention The block diagram which shows the structure of the reference low-resolution video recording part in one embodiment of this invention The figure which shows the directory structure of the clip in one embodiment of this invention The figure which shows the management information file of the clip in one embodiment of this invention The flowchart which shows operation | movement of the video editing apparatus in one embodiment of this invention. The figure which shows the edit information in one embodiment of this invention The figure which shows the management information file of the edited clip in one embodiment of this invention The figure which shows the directory structure of the edited clip in one embodiment of this invention The block diagram which shows the structure of the video editing apparatus in other embodiment of this invention. The flowchart which shows operation | movement of the video editing apparatus in other embodiment of this invention. The figure which shows the edit information in other embodiment of this invention

  Hereinafter, an embodiment will be described in detail with reference to the drawings.

(Embodiment 1)
(1. Configuration)
(1-1. Configuration of video editing apparatus)
FIG. 1 shows the configuration of video editing apparatus 100 according to the first embodiment. The video editing apparatus 100 includes a complete packet creation unit 102, an input unit 109, and a recording medium control unit 108.

  The input unit 109 is an input unit to which edit information 101 is input. The input unit 109 receives file format editing information 101.

  The complete packet creation unit 102 reads out video data stored in the recording medium 103 based on the input editing information 101 and performs rendering processing. The complete packet creation unit 102 creates management information of the edited video data, and stores it in the recording medium 104 together with the edited video data.

  The complete packet creation unit 102 includes a rendering unit 105, a reference low-resolution video recording unit 106, and a management information creation unit 107. The rendering unit 105 reads out the high resolution video data recorded on the recording medium 103 via the recording medium control unit 108, and performs a rendering process of the high resolution video data. The reference low-resolution video recording unit 106 records the low-resolution video data on the recording medium 104. The management information creation unit 107 generates management information of video data recorded on the recording medium 104. Details of the management information will be described later.

  The recording medium control unit 108 is a control unit that controls reading and writing of data from the recording medium 103 and the recording medium 104.

  The recording medium 103 and the recording medium 104 are recording media on which video data is recorded, and are a semiconductor memory card, a hard disk, a DVD (Digital Versatile Disc), a BD (Blu-ray Disc), or the like. The recording medium 103 and the recording medium 104 may be built in the video editing apparatus 100 or may be detachable.

  FIG. 2 shows details of the rendering unit 105. The rendering unit 105 includes a file reading unit 201, a decoding unit 202, an encoding unit 203, and a file writing unit 204. The file reading unit 201 reads out the high resolution video file 205 on the recording medium 103 via the recording medium control unit 108 and extracts necessary video from the high resolution video file 205 based on the editing information 101. The decoding unit 202 decodes (decodes) the high resolution video file 205 read by the file reading unit 201. The encoding unit 203 encodes (encodes) the decoded video. The encoding unit 203 generates video data having the same resolution as the original high-resolution video data. The encoding unit 203 may create low-resolution video data with an increased compression rate in addition to video data having the same resolution as the original video data. The file writing unit 204 generates an edited high-resolution video file 206 in the file format of the created high-resolution video data, and records it on the recording medium 104 via the recording medium control unit 108. When the encoding unit 203 creates low-resolution video data, the file writing unit 204 generates an edited low-resolution video file 207 in the low-resolution video data as a file format, and via the recording medium control unit 108, Recording is performed on the recording medium 104.

  FIG. 3 shows details of the reference low-resolution video recording unit 106. The reference low-resolution video recording unit 106 includes a file reading unit 301, a resolution conversion unit 302, and a file writing unit 303. The file reading unit 301 reads the video data on the recording medium 103 via the recording medium control unit 108. The file reading unit 301 confirms whether or not the low resolution video file 304 corresponding to the high resolution video file 205 exists on the recording medium 103 via the recording medium control unit 108. The file reading unit 301 reads the low resolution video file 304 when it exists, and reads the high resolution video file 205 when the low resolution video file 304 does not exist. When the video data read by the file reading unit 301 is a low resolution video file 304, the resolution conversion unit 302 outputs the file without performing any processing. When the video data read by the file reading unit 301 is the high-resolution video file 205, the resolution conversion unit 302 converts the compression rate of the video data making up the high-resolution video file, so that the low-resolution video with a higher compression rate is obtained. Create video data and output in file format. The file writing unit 303 records the file output from the resolution conversion unit 302 as a low resolution video file 305 on the recording medium 104 via the recording medium control unit 108.

(1-2. Structure of data on recording medium)
The structure of data stored on the recording medium 103 and the recording medium 104 will be described. A lump of data recorded with metadata associated with video is called a clip. A clip is created when a photographic tape is digitized with a non-linear editing machine.

  FIG. 4 shows a directory structure when three clips (Clip A, Clip B, Clip C) are recorded on one recording medium. A clip is composed of management information (XML file), high-resolution video (extension is high), and low-resolution video (extension is low), and these files are arranged under the Clips directory. High resolution video is compressed at a high bit rate, and low resolution video is compressed at a low bit rate. In the first embodiment, the encoding method is not particularly limited. Files that make up the same clip have the same file name and differ only in extension. For example, a clip whose clip name is ClipA is ClipA. xml (management information), ClipA. high (high resolution video) and ClipA. low (low resolution video).

  In the first embodiment, a case where a high-resolution video and a low-resolution video corresponding to the high-resolution video exist will be described. However, only a high-resolution video may exist and a low-resolution video may not exist.

  FIG. 5 shows ClipA.ClipA management information. xml is illustrated. This file is an XML format file. The root element is ClipContent, which indicates that this file is clip management information. The Name attribute indicates the name of the clip, and the Duration attribute indicates the length (number of frames) of the clip. The Video element is information related to the high resolution video, and the BitRate attribute represents the bit rate of the high resolution video. The Proxy element is information related to the low-resolution video, and the BitRate attribute represents the bit rate of the low-resolution video. FIG. 2 shows that 100 Mbits / second high-resolution video and 1 Mbits / second low-resolution video are stored.

  In the first embodiment, a description will be given of a mode in which the management information is an XML format file, but the management information is not limited to the XML format and may be in other formats.

(1-3. Correspondence with Configuration of Present Invention)
The video editing apparatus 100 is an example of a video editing apparatus according to the present invention. The configuration including the input unit 109, the file reading unit 201, and the recording medium control unit 108 is an example of the input unit of the present invention. The rendering unit 105 is an example of a rendering unit of the present invention. The management information creation unit 107 is an example of a management information generation unit according to the present invention. The configuration including the rendering unit 105, the reference low-resolution video recording unit 106, the management information creation unit 107, and the recording medium control unit 108 is an example of the output unit of the present invention. The resolution conversion unit 302 is an example of a low resolution generation unit of the present invention.

(2. Operation)
(2-1. Operation of video editing device)
The operation of the video editing apparatus 100 will be described using the flowchart of FIG. The editor inputs editing information 101 to the input unit 109 of the video editing apparatus 100 (step 601). The rendering unit 105 of the complete package creation unit 102 reads the high resolution video file 205 to be edited described in the editing information 101 from the recording medium 103 via the recording medium control unit 108 (step 602).

  In the first embodiment, the video editing apparatus 100 will be described with respect to a mode in which the high resolution video file 205 to be edited is read from the recording medium 103. For example, the high resolution video file 205 together with the editing information 101 is input to the input unit. 109 may be input.

  Details of the rendering process performed by the rendering unit 105 will be described with reference to FIG. In FIG. 7, editing information 101 shows an example of editing video by combining necessary portions of three clips (Clip A, Clip B, and Clip C). The editing information is information in which which parts of a clip are combined and edited in time series, and is composed of events. An event manages a clip being referred to, a use start position of the clip, and a length of a used portion. Event 701 indicates that 30 frames from the 16th frame of Clip A, Event 702 indicates that 40 frames from the 11th frame of Clip B, and event 703 indicates that 20 frames from the 6th frame of Clip C are used. The editing information includes these three events, ie, event 701, event 702, and event 703 arranged in time series.

  Since the file reading unit 201 knows that it is only necessary to start reading from the 16th frame of ClipA from the event 701 of the editing information 101, it seeks to the position of the 16th frame of the high-resolution video file 205 (ClipA.high) of ClipA. And start reading the data. The decoding unit 202 decodes (decodes) the encoded high-resolution video. The encoding unit 203 encodes (encodes) the video decoded by the decoding unit 202. The file writing unit 204 writes the encoded data into the edited high resolution video file 206. These four processes are repeated for ClipA for 30 frames, and then for ClipB from the 11th frame to 40 frames and from ClipC for the 6th frame to 20 frames. For example, if the name of the clip to be created is ClipD, the file writing unit 204 converts 90 (= 30 + 40 + 20) frames of the encoded data into ClipD. Write high. In this way, the rendering unit 105 creates the edited high resolution video file 206 (step 603).

  The rendering unit 105 creates an edited low resolution video file 207 simultaneously with the creation of the edited high resolution video file 206. The operations of the file reading unit 201 and the decoding unit 202 are the same as the creation of the edited high-resolution video file 206. The encoding unit 203 performs encoding with a higher compression rate and outputs the result to the file writing unit 204. The file writing unit 204 converts the encoded data as an edited low-resolution video file 207 into ClipD. Write to low (step S603).

  In the first embodiment, the video editing apparatus 100 will describe a mode in which the edited low-resolution file 207 is created together with the edited high-resolution video file 206, but the edited low-resolution file 207 is not created. May be.

  The reference low-resolution video recording unit 106 of the video editing apparatus 100 records the low-resolution video file 305 on the recording medium 104 (step 604). Since the editing information 101 refers to ClipA, ClipB, and ClipC, the low-resolution video of these three clips is copied. The clip A low-resolution video file (ClipA.low) stored in the recording medium 103 is read by the file reading unit 301, and is transferred to the recording medium 104 by the file writing unit 303 via the recording medium control unit 108. A low resolution video file 305 (ClipA.low) having the same file name as the resolution video file 304 is written out. Similarly, for ClipB and ClipC, ClipB. low, ClipC. The low file is copied.

  In the first embodiment, the case where the low resolution video file 304 exists in the recording medium 103 has been described. However, when the low resolution video file 304 does not exist, the high resolution video file read by the file reading unit 301 is described. The resolution conversion unit 302 performs conversion of the compression rate 205 to generate low-resolution video data with a higher compression rate, and the file writing unit 303 writes the low-resolution video file 304 in the form of the low-resolution video file 304.

  The management information creation unit 107 of the video editing apparatus 100 generates management information regarding the edited high-resolution video file 206, the edited low-resolution video file 207, and the low-resolution video file 305 recorded on the recording medium 104. Is recorded via the recording medium control unit 108 (step 605). The structure of the management information generated by the management information creation unit 107 is shown in FIG. The management information creation unit 107 creates an XML file 801 as management information. Similar to the XML file in FIG. 5, information is written below the ClipContent element. As described above, the Name attribute, Duration attribute, Video element, and Proxy element respectively represent the clip name, length, high-resolution video information, and low-resolution video information. The management information creation unit 107 adds an Edit element to describe the editing information shown in FIG. 7 as other information. The Edit element has one or a plurality of Event elements, and information corresponding to the event described in FIG. 7 is described in the Event element. The Clip attribute indicates the referenced clip, the Offset attribute indicates the use start position of the referenced clip, and the Duration attribute indicates the length (number of frames) used. The Event element in FIG. 8 includes an event 701 (refer to a section of Clip A from 16 to 30 frames), an event 702 (refer to a section of Clip B from 11 to 40 frames), and an event 703 (Clip C 6) from the top. (Refer to the section of 20 frames from the above), indicating that this clip was created from event 701, event 702, and event 703, and holding low-resolution video of ClipA, ClipB, and ClipC Represents.

  FIG. 9 shows the directory structure of the created clip (ClipD). Clip management information (ClipD.xml), high-resolution video (ClipD.high), and low-resolution video (ClipD.low) are stored under the Clips directory as in FIG. The low resolution video of each event is stored in the ClipD directory under the same file name (ClipA.low, ClipB.low, ClipC.low) as the low resolution video of the reference destination clip.

  In the first embodiment, the low-resolution video file 305 of the rendering clip has the same length as the low-resolution video file 304 of the reference destination clip. However, a part of the use period of the reference destination clip is included. It may be a video.

  In the first embodiment, high-resolution video is compressed data, but non-compressed data may be used. In addition, although the bit rate of high-resolution video is 100 Mbits / second and the bit rate of low-resolution video is 1 Mbits / second, the bit rate is not limited.

  As described above, the video editing apparatus 100 according to the first embodiment includes not only editing information but also a low-resolution video file before editing in the management information of the edited high-resolution video file. In addition, when the edited high-resolution video file is re-edited, the low-resolution video file is deleted for the part deleted by editing. Can be referenced and re-edited.

(Embodiment 2)
(3. Configuration)
(3-1. Configuration of video editing apparatus)
In the second embodiment, the edited high-resolution video file 206, the low-resolution video file 305, and the management information 801 described in the first embodiment are recorded on the recording medium 104, and the video editing apparatus 1000 that edits the video data. Will be described. FIG. 10 shows the configuration of video editing apparatus 1000 according to the second embodiment. The video editing apparatus 1000 includes an editing information interpretation unit 1001, an editing unit 1002, a playback unit 1003, and a recording medium control unit 1007. The video editing apparatus 1000 outputs video data to an external monitor 1008. In the second embodiment, a mode in which the monitor 1008 is provided outside will be described. However, the monitor 1008 may be integrated with the video editing apparatus 1000.

  The editing information interpretation unit 1001 reads the management information of the clip recorded on the recording medium 104 via the recording medium control unit 1007, and extracts the editing information 101 in the management information. The editing unit 1002 changes the editing information 101 according to the editing operation of the editor when performing re-editing. The playback unit 1003 reads a file via the recording medium control unit 1007, decodes the read video data, and outputs the video data to the monitor 1008. The playback unit 1003 includes a file reading unit 1004, a decoding unit 1005, and an image output unit 1006. The recording medium control unit 1007 is a control unit that controls reading and writing of data from the recording medium 104.

(3-2. Correspondence with Configuration of Present Invention)
The video editing apparatus 1000 is an example of a video editing apparatus according to the present invention. The configuration including the editing information interpretation unit 1001, the file reading unit 1004, and the recording medium control unit 1007 is an example of the input unit of the present invention. The editing unit 1002 is an example of the editing unit of the present invention. The playback unit 1003 is an example of a playback unit of the present invention.

(4. Operation)
(4-1. Operation of video editing device)
The operation of the video editing apparatus 1000 according to the second embodiment will be described. First, the operation in the case of reproducing the video data recorded on the recording medium 104 without re-editing will be described. In the video editing apparatus 1000, the playback unit 1003 reads the edited high-resolution video file 206 (ClipD.high) recorded on the recording medium 104 by the file reading unit 1004, and is encoded by the decoding unit 1005. The data is decoded, and the decoded video data is displayed on the monitor 1008 by the image output unit 1006.

  Next, an operation of re-editing the edited high-resolution video file 206 (clip ClipD) using the video editing apparatus 1000 and reproducing it will be described. The editing information interpretation unit 1001 reads the clip management information 801 (ClipD.xml) on the recording medium 104 via the recording medium control unit 1007, reads the Edit element on the management information 801, and the event 701 in FIG. The editing information 101 composed of three events 702 and 703 is restored. The editor uses the editing unit 1002 to perform video editing such as changing the reference position and exchanging events based on the editing information 101. In FIG. 12, the boundary between the event 701 and the event 702 is shifted five frames forward, the event 1201 (refer to the section of Clip A from 16 to 25 frames), the event 1202 (refer to the section of Clip B from 6 to 45 frames), the event The editing information 1203 is shown.

  An operation in which the video editing apparatus 1000 outputs the video edited as shown in FIG. 12 to the monitor 1008 will be described with reference to the flowchart of FIG.

  The video editing apparatus 1000 sets the number of frames to 1 as the number of frames initialization process (step 1101). As the reference destination specifying process, the video editing apparatus 1000 specifies information of “the 16th frame of Clip A”, which is the reference destination of the first frame of the editing information (step 1102). The video editing apparatus 1000 determines whether or not a frame corresponding to “the 16th frame of Clip A” is held in the edited high-resolution video file 206 (ClipD.high) (step 1103). The Edit element of ClipD management information 801 (ClipD.xml) shows that the frame corresponding to “the 16th frame of ClipA” is the first frame of the edited high-resolution video file 206 (ClipD.high). It is determined that the resolution video is held.

  The file reading unit 1004 reads the first frame data of the edited high-resolution video file 206 (ClipD.high) (step 1104). The decoding unit 1005 decodes the read high-resolution video data (step 1105), and outputs the decoded image to the monitor 1008 (step 1106). The video editing apparatus 1000 determines whether the playback position is at the end of the editing information 101 (step 1107). Since the total length of the editing information 101 is 90 frames, the video editing apparatus 1000 determines that it is not the end when the number of frames is 1. The video editing apparatus 1000 increments the frame number from 1 to 2 as the frame number increment process (step 1108). The video editing apparatus 1000 repeats the processes from the reference destination specifying process (step 1102) to the frame number increment process (step 1108) from the first frame to the 25th frame.

  Reproduction when no high-resolution video exists will be described by taking the 26th frame as an example. In the reference destination specifying process, the video editing apparatus 1000 specifies the information “the sixth frame of Clip B”, which is the reference destination of the 26th frame (step 1102). The video editing apparatus 1000 refers to the ClipD management information 801 (ClipD.xml) from the Edit element of the ClipD management information 801 (ClipD.xml), ClipD refers to the 11th to 50th frames of ClipB, and the 6th frame It is determined that there is no video corresponding to the edited high-resolution video file 206 (ClipD.high) (step 1103). The file reading unit 1104 reads data corresponding to the sixth frame of the ClipB low-resolution video file 305 (ClipB.low) from the information “ClipB sixth frame” (step 1109). The decoding unit 1105 decodes the read low-resolution video data (step 1105), and outputs the decoded video to the monitor 1008 (step 1106). The video editing apparatus 1000 repeats the processes from the reference destination specifying process 1102 to the frame number increment process 1108 for five frames from the 26th frame to the 30th frame. Therefore, the video editing apparatus 1000 outputs a low-resolution video for 5 frames from the 26th frame to the 30th frame, and outputs a high-resolution video otherwise. In this way, the video editing apparatus 1000 can re-edit the rendered video while checking the video.

  In the second embodiment, cut editing has been described as an example. However, even when a special effect such as mosaic or transition is applied, a special effect video is added to the clip management information 801. Similar processing can be performed.

  The playback unit 1003 has been described with respect to a mode in which the edited high-resolution video file 206 and the low-resolution video file 305 are combined and played back. However, when image quality is not required, the playback unit 1003 uses only the low-resolution video file 305 for video. May be played.

  In the first and second embodiments, the reading and writing of the clip is performed from the recording medium. However, the clip may be read on the network and written on the network using FTP or the like.

  It is useful as a video editing device that transfers video at high speed and edits at the transfer destination.

100, 1000 Video editing device 102 Complete packet creation unit 103, 104 Recording medium 105 Rendering unit 106 Referenced low-resolution video recording unit 107 Management information creation unit 108, 1007 Recording medium control unit 201, 301, 1004 File reading unit 202, 1005 Decoding unit 203 Encoding unit 204, 303 File writing unit 302 Resolution conversion unit 1001 Editing information interpretation unit 1002 Editing unit 1003 Playback unit 1006 Output unit 1008 Monitor

Claims (5)

An input unit for inputting at least one video data and editing information used when the video is cut out from the video data and edited;
A rendering unit that generates edited video data obtained by editing the video data based on the editing information;
A management information generating unit that includes the editing information and generates management information that associates the edited video data with low-resolution video data having the same content as the video data but having a different compression rate;
An output unit for outputting the edited video data, the low-resolution video data, and the management information;
A video editing apparatus comprising: The video editing apparatus according to claim 1, wherein the input unit receives the low-resolution video data. A low resolution generation unit that generates the low resolution video data based on the video data;
The video editing apparatus according to claim 1, further comprising: The rendering unit
Generating low-resolution edited video data having the same contents as the edited video data but different compression rates;
The management information generation unit
The video editing apparatus according to claim 1, wherein management information that associates the edited video data, the low-resolution edited video data, and the low-resolution edited video data is generated. Edited video data obtained by editing at least one video data based on editing information; low-resolution video data having the same content as the video data but having a different compression ratio; the edited video data including the editing information and the low-resolution video data An input unit for inputting management information to associate
An editorial department that accepts editing operations;
Based on the editing operation received by the editing unit and the management information, a playback unit that reads out and outputs a corresponding portion of the edited video data or the low-resolution video data;
A video editing apparatus comprising:

Images