JP2002300523A - Device and method for producing contents - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a content producing device which reproduces the last play list of a hierarchy structure by using a distributed play list generated in an other distributed place and produces the content of an arbitrary format, based on the play list. SOLUTION: Two computer terminals 67 and 68 read and decode sub- materials from an intraframe server 71 and display a video, based on obtained vide data on a monitor. An operator controls the intraframe server 71 via the computer terminal, views and confirms the video displayed on the monitor, while the intraframe server 71 is caused to perform a desired operation (reproduction, rewinding or fast-forwarding) and generates EPL. EPL has identification information for specifying the material used for editing and outputting, and a format declaration statement for defining the format of a part of the material.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a content production apparatus and method, and more particularly to a content production apparatus and method for producing content using a plurality of video and / or audio materials.

[0002]

2. Description of the Related Art Moving picture editing began with splicers and cements for movie films, but in video editing, the era of electronic editing by dubbing has continued for a long time after the dawn of dermato + scissors + splicing tape.

[0003] Non-linear editors, which have become popular over the last decade or so, can be said to be on an extension of that. That is, while viewing images obtained from the media, they are mainly connected by dubbing, image processing is performed as necessary, and the edited result is again stored in the media. Years have been followed.

However, such a traditional method has the following problems. First, image quality is degraded due to repeated data compression and decompression. In the era of analog editing, repeated dubbing caused deterioration in image quality in electronic editing, but it should have been almost completely eliminated in the era of baseband digital. However, with the recent spread of image compression technology,
The problem of image quality was to recur. This is because data compression and decompression are repeated. As a countermeasure, there are compromises such as lowering the compression ratio or shortening the compression unit, but it is uneconomical in many aspects such as media cost and communication time, and image quality degradation is completely eliminated. Not necessarily. Even without data compression, image quality degradation and uneconomical effects are caused by repetitive processing of so-called special effects such as image enlargement / reduction, pixel shift, and synthesis.

[0005] The next problem is that in the conventional editing, only a single image format can be handled. Image formats such as NTSC were devised and unified with a focus on receivers and radio wave allocation. However, these days HDVS and PC
It is rather common to use multiple image formats, such as the window above. The fact that only a single format can be handled has been a great problem both in collecting materials and providing complete packages. Moreover,
Especially on a computer, users can create windows with arbitrary specifications, so it is not possible to select a format from the available formats.

[0006] The next problem is that in the conventional editing, materials have to be temporarily stored at hand and then used. At the time of editing, a time code is used to specify a target image. However, it merely indicates a position in one volume, and it is basically impossible to specify a medium. Although a method of specifying the media by a reel number or the like is also used, it is limited to a local operation range. Therefore, the material must be stored once and used beforehand, which requires labor and cost. Similarly, special effects, title insertion, and the like also depend on the model, and processing that is not compatible with the device at hand is impossible. Therefore, the editing result must be recorded on the medium at hand.

[0007] Although not all of the above problems can be solved, in recent years, an EDL (Edit Decision L
ist), and a system for automatically performing electronic editing according to a program described in the EDL has been adopted.

By the way, in the EDL, items which are not compatible with each other, such as special effects, are described, and the system is limited. In addition, there is a need to change tapes, etc., and often relies on manual labor. The point of difficulty in flexibility is that it is troublesome to correct a complete packet. For example, even if one frame is inserted before the first frame, it is necessary to re-edit or dub the entire volume.

As described above, the current editing system has many aspects that are uneconomical and inefficient even at present, but there is one aspect that the advantages of the network cannot be enjoyed further.
If you stick to the status quo, there is a high risk that it will become a backward system that has been left behind by the times. Each issue is organically intertwined, so even taking partial measures will cause new problems, and the complexity will increase in cascade, so the current editing system will not be used anymore It is possible.

[0010]

SUMMARY OF THE INVENTION The present invention has been made in view of the above circumstances, and reproduces a final hierarchically structured edit list by using a distributed edit list created at another distributed location. Based on this edit list, while preventing data quality deterioration, supporting multi-format data, and without having to temporarily store and use materials at hand, it is possible to further process compatibility, and to allow content of any format to be used. It is an object of the present invention to provide a content production apparatus and method capable of producing.

[0011]

SUMMARY OF THE INVENTION A content producing apparatus according to the present invention has been made in view of the above-mentioned circumstances, and has been developed in a distributed location created by using a plurality of video and / or audio materials. Edit list creating means for creating a final hierarchically structured edit list using an edit list by integrated optimization, and the distributed edit list using the edit list created by the edit list creating means and the corresponding material. A distributed edit list creating means for creating, and content forming means for forming content in an arbitrary format based on the edit list created by the edit list creating means, wherein the edit list and / or the distributed edit list include: Identification information for identifying the material used for editing and a format declaration statement that defines the format of at least some of the material To.

This content production apparatus uses a distributed edit list created by a distributed edit list creating means at another distributed place, and creates a final hierarchically structured edit list in the edit list creating means by integrated optimization. Content forming means forms content in an arbitrary format based on the edit list.
Alternatively, the distributed editing list describes identification information for specifying a material used for editing, and a format declaration statement defining a format of at least a part of the material. In order to solve the above-mentioned problems, the content production method according to the present invention edits a final hierarchical structure using a distributed editing list created in another distributed place using a plurality of video and / or audio materials. An edit list creating step of creating a list by integrated optimization, a distributed edit list creating step of creating the distributed edit list using the edit list created in the edit list creating step and the corresponding material,
A content forming step of forming a content in an arbitrary format based on the edit list created by the edit list creating means. The edit list and / or the distributed edit list specify a material used for editing. And a format declaration statement that defines the format of at least some of the materials.

In this content production method, an edit list creation step is finally performed by using a distributed edit list created by a distributed edit list creation step at another distribution place using a plurality of video and / or audio materials. An edit list having a hierarchical structure is created by integrated optimization, and a content of an arbitrary format is formed on the basis of the edit list in a content forming step. The reference edit list and / or the distributed edit list include edit lists used for editing. The identification information for specifying the material to be used and a format declaration statement that defines the format of at least a part of the material are described.

[0014]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, embodiments of a content producing apparatus and method according to the present invention will be described with reference to the drawings. In this embodiment, the editing procedure list (Edit
This is a content production system that distributes and creates a Procedure List (EPL) by a plurality of groups existing in several places and produces content. In the editing work using the EPL, since the material is not directly processed, the work can be performed in a distributed manner by a plurality of groups existing in several places.

FIG. 1 shows an overall configuration diagram of a content production system 60. The material editing group 66, the editing result storage / retrieval group 74, and the editing result use group 82 each constitute a LAN, and these LANs are connected to form a first editing group unit. The computer graphic processing group 93, the closed caption processing group 102, and the local station 111 also constitute LANs, and these LANs are connected to form a second editing group unit.

In the content production system 60, a material file 64 composed of video and / or sound recorded by a video camera 61 is edited by a first editing group unit via an external network 63 such as the Internet. Provided to group 66.

First, a first editing group unit is constructed.
The material editing group 66 will be described. The material editing group 66 is located in the gate 65 and the gates 89 and 73, and has two computer terminals 67 and 68, a material server (O) 69, and a decoder / encoder (D) 70.
, An intraframe server (I) 71 for offline editing, and an EPL server (E) 72.
The intra-frame server corresponds to a sub-material server 14 shown in FIG.

The operator of the material editing group 66 uses the computer terminal 67 or 68 to
4 is downloaded from a storage location via the external network 63 or from the video camera 61 and stored in the material server 69 and the intraframe server 71.

As described above, the intra-frame server 71 stores the compressed sub-material. That is, the material stored in the material file 64 is decoded by the decoder / encoder 70, and then subjected to a thinning process and the like, and further encoded into a high-compression sub-material, and the sub-material is stored in the intraframe server 71. .

The above two computer terminals 67 and 68
Functions as an editing terminal to be described later, reads and decodes sub-materials from the intra-frame server 71, and displays a video based on the obtained video data on a monitor. At this time, the operator controls the intra-frame server 71 via the computer terminal,
While causing the intra-frame server 71 to execute a desired operation (playback, rewind, fast-forward, etc.), the EPL is created by visually checking the video displayed on the monitor. This EP
L has identification information for specifying a material used for editing and an output, and a format declaration statement defining a format of at least a part of the material. Here, the created EPL is stored in the EPL server 72. This E
The EPL stored in the PL server 72 is read for division of labor by another group constituting the first editing group unit or by each group constituting the second editing group unit.

Next, the edit result storage search group 74 will be described. This edit result storage search group 74
Inside the gates 73 and 81, there are two computer terminals 75 and 76, a material server (O) 77, a decoder / encoder (D) 78, an intraframe server (I) 79 for offline editing, and an EPL. And a server (E) 80.

The editing result storage / retrieval group 74 takes out the EPL from the EPL server 72, stores it in the EPL server 80, performs editing based on the stored EPL, creates and stores temporary content. As a result, the content forming system 60 is capable of storing necessary editing results as materials. Also, EP
L and editing results can be searched.

Next, the editing result utilization group 82 will be described. This editing result utilization group 82
1, two computer terminals 83 and 84, a material server (O) 85, an EPL server (E) 86, a decoder / switcher / effector 87 for transmission, and a decoder / switcher / effector 88 for media. Consists of

The editing result utilization group 82
Retrieves the EPL from the EPL server 72 and
The content server 8 stores the content based on the stored EPL in the PL server 86 by using the computer terminals 83 and 84 corresponding to the editing control unit 20 in FIG.
5 is created using the materials and the like stored in the transmission decoder 5, switcher, switcher, and the like corresponding to the editing execution unit 32 in FIG.
It is transmitted from the effector 87 or the media decoder / switcher / effector 88 or distributed as a medium.

Next, the second editing group will be described.
The second editing group unit is connected to the first editing group unit via an external network 90 connected to the gates 89 and 92, and can transmit EPL bidirectionally in the form of a program folder 91. it can.

The computer graphic processing group 93, the closed caption processing group 102, and the local station 111, which constitute the second editing group section,
This is a group that distributes the creation of.

First, the computer graphic processing group 93 will be described. The computer graphic processing group 93 includes two computer terminals 94 and 95, a material server (O) 96, a decoder / encoder (D) 97, an intraframe server (I) 98 for offline editing, and an EPL server (E). ) 99
And computer graphic server (CG) 100
Consists of The intra-frame server 98 corresponds to the sub-material server 14 shown in FIG.

Computer Graphics Processing Group 9
The operator No. 3 downloads the EPL from the EPL server 72 of the material editing group 66 by storing it in a program folder and storing it in the EPL server 99. In the intra-frame server 98, a material used when performing computer graphic processing is stored as a highly compressed material by the decoder / encoder 97. Then, the computer terminal 94 or 95 uses the computer graphic server (CG) 100 to add C to the sub-material read from the intra-frame server 98.
While editing with G processing, display it on the monitor and
Create PL. Here, the created EPL is stored in the EPL server 99 and at the same time is stored in the program folder, and the EPL server 7 of the material editing group 66 is stored.
Sent to 2.

Next, the closed caption processing group 102 will be described. The closed caption processing group 102 includes two computer terminals 103 and 104, a material server (O) 105, a decoder / encoder (D) 106, an intraframe server (I) 107 for offline editing, and an EPL server (E ) 108 and a closed caption server (C
C) 109.

Closed caption processing group 10
The second operator stores the EPL from the EPL server 72 of the material editing group 66 in a program folder, downloads it, and stores it in the EPL server 108. In the intra-frame server 107, a material used when performing closed caption processing is stored as a highly compressed material by the decoder / encoder 105.
Then, the computer terminal 103 or 104 uses the closed caption server (CC) 109 to edit the sub-material read from the intra-frame server 107 while performing CC processing, and displays the edited sub-material on a monitor to create an EPL. Here, the created EPL
Is stored in the program folder at the same time as being stored in the EPL server 108, and the E
It is sent to the PL server 72.

Next, the local station 111 will be described. The local station 111 has two computer terminals 112 and 113
, A material server (O) 114, a decoder / encoder (D) 115, an intraframe server (I) 116 for offline editing, and an EPL server (E) 11
7 and a local unique information (DI) server 118.

The operator of the local station 111 downloads the EPL from the EPL server 72 of the material editing group 66 by storing it in a program folder and stores it in the EPL server 117. Intraframe server 116
Is stored as a high-compression material by the decoder / encoder 115. Then, the computer terminal 112 or 113 uses the local unique information (DI) server 118 to perform the unique editing on the sub-material read out from the intra-frame server 116 while displaying it on the monitor to create an EPL. Here, the created EPL is stored in the EPL server 11.
8 and at the same time, it is stored in a program folder and sent to the EPL server 72 of the material editing group 66.

Finally, in the material editing group 66, each EPL in the EPL server 72 is managed, and each EPL is managed.
L is integrated and optimized. Edit result storage / search group 7
4. In the editing result utilization group 82, the EPL integrated and optimized by the material editing group 66 is used.

As described above, in the content production system shown in FIG. 1, the UMID for specifying the material used for editing and the output image, the UTD for specifying the processing method, and the input A scan format for specifying the format of the material and the output image is described in the EPL. For this reason, at the time of editing,
, It is possible to operate without transmitting heavy image data. Also, by getting the material each time,
Copyright protection and billing become possible. Also, if the processing method is ID
The editing environment (capacity of equipment) does not matter. Also, copyright protection and billing of the processing method itself can be performed. In addition, input materials can be freely selected. Also, outputs in multiple formats can be obtained simultaneously. In addition, since the operation of creating an EPL proceeds with low image quality, there is no need to select a place or an environment. Further, in the editing work, since the material is not directly processed, the work is simultaneously carried out by a distributed group by a division of labor system.

Next, a specific example of an EPL creating section for creating each EPL included in the material editing group 66, the computer graphic processing group 93, the closed caption processing group 102, and the local station 111 in the content production system 60, and the EPL A specific example of a content forming unit that produces content from the EPL created by the creating unit will be described with reference to FIG. 2 as a content forming device.

The content forming apparatus 1 includes an EPL creating section 10 for creating the EPL, an edit control section 20 for generating an edit control signal based on the EPL, and a content forming section 30 for forming content in a predetermined format. Consisting of

The content forming apparatus 1 is supplied with a plurality of video and / or audio materials. For example, FIG.
A material file 64 composed of video and / or audio recorded by the video camera 61 shown in FIG. 1 is input to an input terminal IN via an external network 63 such as the Internet.
Is supplied to the EPL creating unit 10 and the content forming unit 30 from the server.

The EPL creation unit 10 decodes the above-mentioned material by the decoder 11, thins out the material by, for example, the down converter 12, and JPEG (Joint Photograph) by the encoder 13.
ic Experts Group (JPEG) method or the like, and is compressed into a highly-compressed sub-material and stored in the sub-material server 14. The sub-material server 14 is an AV server having a recording / reproducing unit having a disk array configuration, sequentially takes in high-compression sub-materials to be input, converts them into a file, and stores the file in a designated address position of the recording / reproducing unit.

The high-compression sub-material of each file stored in the sub-material server 14 is divided into a plurality of (here, three) editing terminals 15, 16, 17 connected to the sub-material server 14. Supplied to
Used to create EPL.

Editing terminals 15, 16, 1
Reference numeral 7 denotes a main part of the EPL creating unit 10, which reads out and decodes the high-compression sub-material, and displays an image based on the obtained material data on a monitor. At this time, the operator controls the sub-material server 14 via the editing terminal, and allows the sub-material server 14 to perform a desired operation (playback, rewind, fast forward, etc.) and visually observe the video displayed on the monitor. Confirm and create EPL. The EPL has identification information for specifying a material used for editing and a format declaration statement that defines a format of at least a part of the material.

Hereinafter, an EP created by the EPL creating section 10 will be described.
L will be described. In the EPL, identification information for specifying a material used for editing is described. The material identification information is a globally unique identification code, and is called a material identification code (Material ID; UMID). Further, in the EPL, an identification code for identifying a material processing method, that is, an identification code for indicating an image processing method, is defined in accordance with the identification code system. The identification code for identifying the processing method of this material is also a globally unique identification code, and is called a process (Process) ID or a unique transform ID (UTID). UT
The processing such as fade, mix, and super processing can be identified by the ID. The EPL also describes metadata related to output. This is the ID of the edited result by EPL
And includes the UMID. The EPL also describes a time code (TC) indicating, for example, the start and end points of editing in time.

Further, the EPL describes a format declaration statement that defines the format of at least a part of the material. This format declaration statement includes the image format of the input video material and / or the image format of the edited output. For this reason, the content formed by the content forming apparatus 1 has a format declared by the format declaration statement. If a format is declared by a format declaration statement, contents of any format can be formed.

The range of time described in one EPL file is frame at the minimum and infinite at the maximum. The order of description follows the processing, and the description can be made so that a plurality of processes are executed simultaneously. This is a “verilo
It is similar to the g ”language, so you can think of it as a base. However, since verilog has no concept of link, global, or struct, it cannot be used.

The EPL basically has no variables. There are no four arithmetic operations or function statements, and only command statements (processing and control).
The delivery of image data is not specified in the syntax. The output of the upper line will only be input below.

Hereinafter, a specific example of the EPL will be described. This is for editing an external SD picture (525i picture) in black and white, inserting it into the enclosed picture as a reminiscence scene, and adding a title. 3 and 4 show examples of description of the EPL. 3 and 4 show the same EPL description example. FIG. 3 is a simplified example, and FIG. 4 is a detailed one. FIG. 5 shows an image diagram of the execution of the EPL. FIG. 6 schematically shows an image formed after editing.

First, the EPL description examples of FIGS. 3 and 4 will be described. "Epl" in the underlined part (1-1) of the first line is
The following parentheses () indicate that the EPL unit is indicated, and define the image to be output. The underlined part (1-2) in the same row, that is, “umid” is identification information of the output image, and is a globally unique identification code UMID.
It is. Specifically, as shown in FIG. 4, “02232203_8
It is a long code like "24504F1_0800468A92000201", which is truly globally unique. The underlined parts (1-3) and (1-4) in the same line indicate the start and end points of the editing, and here, the time code of the start frame and the time code of the end frame are described. The start point is "00: 00: 00.00" and the end point is "00:
01: 00.02 ". The underlined part (1-5) in the same line is the scan format scan_format, which is a type of the format declaration statement described above. Here, the output video format is shown. “# 1080i” is a video format of an HD image. The underlined part (1-6) of the same line, that is, "} {"
Together with the underlined "}" in the line, {}
Indicates that image processing is listed within the range enclosed by. The image processing here follows the signal flow.

The underlined part (2-1) on the second line, that is, "so
"urce" means a designation process of designating an input material in parentheses that follow. Um of underlined part (2-2) in the same parenthesis
id is an image ID, and specifically, “22083102” shown in FIG.
_95440497_0800468A62000232 ". That is, the material is specified using the globally unique UMID. The underlined part (2-3) in the same line indicates the time code of the start frame. When it is omitted as shown in FIG. 3, it indicates from the top. “# Embedded.mpg” in the underlined part (2-4) in the same line indicates the acquisition source of the material, that is, the place where the material is stored. "# 1080i" in the underlined part (2-5) in the same line is the scan format scan
_format, which is a type of the format declaration statement described above. Here, the video format of the input material is shown. Therefore, the image format of the input material can be specified. Underlined parts (2-1) to (2)
According to the description of -5), the input material can be read from the material storage unit 40 of FIG. 5 connected to the network.

Next, "fork" in the underlined part (3-1) on the third line in FIG. 3 is replaced with "join" in the underlined part (22-1) on the 22nd line.
And a plurality is processed in parallel with respect to the input 1, and the outputs are collectively added by the join. In FIG.
This is a process performed in a range between 1 and the adder 42,
This indicates that a plurality of inputs 1 from the material storage unit 40 are processed in parallel, and the adders 42 collectively add them. The contents of the processing are as shown in the fourth and fifth lines.

"@" In the underlined part (4-1) in the fourth line indicates that the cutout position is designated on the time base on the input side by the number in parentheses. The start point is shown in the same underlined part (4-2) in parentheses. Here, “02: 10: 00.00” on the input side time axis is shown.
The underlined “put” in the same line (4-3) is shown in parentheses
The pasting position of the portion cut out from the input material is specified on the time axis on the output side. Here, as shown in the underlined portions (4-4) and (4-5) in the same parenthesis in (), "0"
"0: 05.00" to "00: 25.00".
This is a process of pasting the input material 43 (shown in FIG. 5) from the cutout position specified on the time axis on the input side as the main part cut 1 from “00: 05.00” to “00: 25.00” on the output side.

The underscore (@) in the fifth line (5-1) also indicates that the cutout position is specified on the input side time axis by the number in parentheses that follows. The underlined part (5-2) in the parentheses is "02: 10: 2" based on the time axis on the input side.
0.00 "is indicated. "Put" underlined (5-3)
This also indicates that, in the parentheses that follow, the pasting position of the portion cut out from the input material is specified on the time axis on the output side. Here, as shown in the underlined parts (5-4) and (5-5), it is shown that the output side is pasted from "00: 35.00" to "01: 00.02". This means that the input material 44 (shown in FIG. 5) from the cutout position specified on the time axis on the input side is used as the main part cut 2 from “00: 35.00” on the output side to “01: 00.02”.
It is the process of pasting to.

Next, "{" in the underlined part (6-1) on the sixth line
Is paired with "}" in the underlined part (11-1) on the eleventh line, and indicates that a plurality of processes are sequentially executed in an input / output one-to-one manner from the upper line within the enclosed range. This corresponds to the processing 45 shown in FIG.

Next, "sour" in the underlined part (7-1) of the seventh line
With "ce", the input material is specified in the parentheses that follow. ()
The underlined (7-2) umid in the same box is “2208” shown in FIG.
3102_95440497_0800468A62000232 ". “06: 54: 32.10” in the underlined part (7-3) in the same line indicates the time code of the start frame. Underlined (7-
“Url” in 4) indicates a source of the material, that is, a place where the material is stored. Specifically, as shown in FIG. 4, it is “ftp://43.14.61.62/source/”. "# 525i" underlined in the same line (7-5) is the scan format sca
n_format, which is a type of the format declaration statement described above. This shows the video format of the input material.
Therefore, the image format of the input material can be specified. According to the description of the underlined parts (7-1) to (7-5) on the seventh line, the input material having the video format "# 525i" in the processing 45 shown in FIG.
6 and can be specified to be stored in the material storage unit 47 of FIG. The underlined part (7-6) in the same line indicates to which scene this source is used. here,"//
recollect "and specify that it is a reminiscence scene.

Next, "tran" of the underlined part (8-1) on the eighth line
"sform" indicates that image processing is specified in the parentheses that follow. “Utid” in the underlined part (8-2) in the same line indicates the processing I
D, a globally unique image processing code (Tran
sform ID (UTID) is described. Specifically, FIG.
, "12000000000090001". “Url” in the underlined part (8-3) in the same line indicates the acquisition destination of the processing method, that is, the place where the processing method is stored. Specifically, as shown in FIG. 4, "ftp://43.14.61.62/exec
/ ". “Upconv525to1080” in the underlined part (8-4) in the same line is a common name of the processing, and when it cannot be obtained from the acquisition source, the substitute processing is enabled. Here, the video format is changed from 525 lines to 108
Represents the process of up-conversion to 0 line. "# 1080i" in the underlined section (8-5) in the same row is the scan format
scan_format, which is a type of format declaration statement described above. The output video format is shown.
Therefore, the output image format can be specified. If it is the same as the input video format, it can be omitted. Underlined parts (8-1) to (8-
According to the description of 5), in the process 45 shown in FIG.
The input material having the video format “# 525i” stored in the material storage unit 47 of FIG.
The process for up-conversion by the up-conversion unit 48 can be specified as “i”.

Next, "tran" in the underlined part (9-1) of the ninth line
Specify image processing in () with "sform". As a specific example of “utid” in the underlined part (9-2) in the same row, there is “120000000001F0001” as shown in FIG. Underlined (9
The “url” of -3) indicates the location where the processing method is stored. Specifically, as shown in FIG.
//43.14.61.62/exec/ ". "" Monochrome "" underlined in the same line (9-4) is a common name for processing. Here, a process of converting an image up-converted to 1080 lines into black and white is shown. Here, the description of “# 1080i” in the underlined section (8-5) in the previous line is omitted. If it is the same as the input, it can be omitted. According to the description of the underlined parts (9-1) to (9-4) on the ninth line, FIG.
In the processing 45 shown in (1), the image up-converted to the video format “# 1080i” by the up-conversion unit 48 is converted to a monochrome image by the monochrome processing unit 49.

Next, in the "put" of the underlined part (10-1) on the tenth line, the pasting position of the black and white image is designated by the time axis on the output side in parentheses (). ()
In -2) and (10-3), the process of pasting from "00: 25.00" to "00: 35.00" on the output side is specified. It is a pasting of the recollection scene shown in FIG.

Next, "{" in the underlined part (12-1) on the twelfth line is paired with "}" in the underlined part (21-1) on the twenty-first line. One to one indicates that a plurality of processes are sequentially executed from the upper row. This corresponds to the processing 51 shown in FIG.

Next, the input source is designated in the parentheses () following “source” in the underlined part (13-1) on the thirteenth line. The underlined (13-2) umid in parentheses is a long code such as "00000000_8244041D_0800468A940000522" shown in FIG. "0" in the underlined section (13-3) of the bank
"0: 00: 00.00" indicates the time code of the start frame. “Url” in the underlined part (13-4) in the same line is the acquisition destination of the image, and specifically, as shown in FIG. 4, “ftp: //43.14.6
1.62 / source / *. Jpg ". Underlined section (13-5)
“# 1080i” indicates the video format of the input material. Therefore, the image format of the input material can be specified. The underlined parts (13-1) to (1
According to the description of 3-5), the input material having the video format “# 1080i” in the process 51 shown in FIG. 5 is read out via the network 52, and the material storage unit 5 shown in FIG.
3 can be specified. (13-
6) shows what scene this source is used for. Here, it is "// title" and specifies that it is used for the title.

Next, "fork" in the underlined part (14-1) of the 14th line is replaced with "join" in the underlined part (20-1) of the 20th line.
And a plurality is processed in parallel with respect to the input 1, and the outputs are collectively added by the join. In FIG. 5, the material read from the material storage unit 53 is processed by two systems and is added by the adder 57. The processing contents of the two systems are as follows.

First, in the “put” of the underlined part (15-1) on the fifteenth line, in the following parentheses (), the pasting position of the title material 54 read from the material storage unit 53 is set to the time on the output side. Specify by axis. In the same underlined sections (15-2) and (15-3) in parentheses (), "00: 00.00" to "00:04.
“00” specifies the pasting process.

Next, "{" in the underlined part (16-1) on the 16th line is paired with "}" in the underlined part (19-1) on the 19th line. One to one indicates that a plurality of processes are sequentially executed from the upper row. This corresponds to the upper half of the processing 51 shown in FIG.

The "transf" in the underlined part (17-1) of the 17th line
"orm" specifies image processing in parentheses that follow. "Utid" in the underlined part (17-2) in the same line is specifically shown in FIG.
, It is “1200000000080001”. “Url” in the underlined part (17-3) in the same line is, specifically, “ftp://43.14.61.62/exec/” as shown in FIG. “Fadeout” in the underlined part (17-4) in the same line represents a fade-out process. In the underlined part (17-5) in the same row, the output video format is omitted. Since it is the same as the input video format, it can be omitted. Underlined (17-
“1.0” in 6) is a unique factor, which lists unique set values required for the processing. According to the description of the underlined parts (17-1) to (17-6) on the 17th line, the input material of “# 1080i” supplied from the material storage unit 53 in the processing 51 shown in FIG. Processing unit 5
In step 5, the fade-out process can be specified.

Next, in the "put" of the underlined part (18-1) of the 18th line, the pasting position of the processing output 56 from the fade-out processing unit 55 is indicated by the time axis on the output side in (). specify. (18-2) and (1)
In 8-3), from "00: 04.00" on the output side to "00: 05.00"
The process for pasting is specified.

Then, the title material 54 is added by the adder 57.
+ Fade-out processing output 56 is added, and the added output is supplied to the adder 42. As shown in FIG. 6, the adder 42 inserts the main part cut 1 following the title to be faded out, and outputs the edited result in which the main part cut 2 is inserted across the black and white reminiscence scene.

Next, the syntax in the lower part of FIG. 4 will be described. “Format” in the underlined part (25-1) designates an image format by following {}. Underlined (25-2) "1001/60000" and underlined (25-3) "Capturing
interval (long / long) [s] ”(parameter), or“ 1080 / 59.94i ”in the underlined part (26-1),
The image format is specified by “// Name of format (char)” in -2).

The "format" in the underlined part (27-1)
Also, specify the image format with {} that follows. Underlined (27-2) "1001/60000" and underlined (27-
3) "Capturing interval (long / long) [s]" (parameter) or underlined (28-1) "480 / 59.94
i "" and "// Name of format (cha
The image format is designated by “r)” in the same manner as described above.

The EPL shown in FIG. 4 is underlined (29-
The details of the enclosed image data are defined in “image” of 1). The underlined part (29-2) in () indicates the number of bytes of the binary part. Here, it is (bit + 7) * 8/8. The underlined part (29-3) is the name in the file, which is "embedded" here. Underlined (29-4) "bi
"nary data ..." specifies the data body.

The specific example of the EPL has been described above.
EPLs are usually interpreted as strings.
reter). Editing and the like are performed with the character string unchanged. When compiling, it is not defined in this format because it is a code unique to the device. When compressing for storage etc., use normal lossless compression (zip, lha huffma
n etc.).

The UMID is SMPTE330M basic UMID 3
2Bytes. Universal level
l) and Instance (Instance) may be omitted, and only the material number (Material number) 16Bytes may be used. The output image is generated in the execution process, but is regarded as material generation in EPL generation, and is added there.

The notation is hexadecimal, and an underscore (underscore '_') can be arbitrarily inserted for visual observation. When enclosed in parentheses (), it indicates the processed image, not the material itself. Source (source or tran
The argument of sform) distinguishes where at the beginning of the string.
If the UMID is registered in the database in advance, the acquisition source can be omitted.

The time code TC is a general time code:
Minutes: seconds.Frame allows you to omit unnecessary upper digits. The input side describes only the IN point TC, and the output side describes both the IN / OUT TC. On the output side, the insertion position is described with put (), but if omitted, it will be valid for the whole volume indicated by epl (). The input side describes the extraction position using the argument in source () or @ (). When performing cut editing, it is necessary to describe both input and output TCs. Input side T
C can be omitted when it is not necessary to specify only the effects or the like.

The image data transferred from the top to the bottom row is R /
G / B / tl or Y / Pb / Pr / tl. For example, Y color difference 4: 2:
If it is 2, Y tl Pb Pr Y tl is repeated from the upper left pixel. Also, when passing through a path narrower than the total bit width specified by format {}, stuff with LSB first.

The transmittance tl (translucent) is given for each Y,
Normal images have the value 0 (opaque). This tl is used only in the middle and is not included in the normal epl () output.

The data format of the input image is determined by the file extension. It can be omitted. For example, epl is EPL file
Is shown. Eiv indicates EPLL Intermediate Video.
Ybr indicates Y / Pb / Pr. Rgb is Red / Green / B
Indicates lue. Jpg indicates JPEGwp. Also, mpg is MPEG1
Is shown.

As described above, there are various data formats of the input image, but the above and the entire MPEG2 profile are standardly supported. Non-standard compression is tr
Describe decompression processing with ansfrom (). The above eiv is uncompressed up to tl with format {} header. This eiv occurs when plug () is executed without being canceled by optimize. Normally, the server manages the file based on the UMID standard, and does not write the file name on the EPL. Therefore,
To describe the extension, use wild card '*'.

Since the output image is supplied only to the monitor or the encoder for broadcasting, the output image is only uncompressed. However, the last line of epl () {} has transform ()
To define the compression.

Next, the format of the video scan format to be placed on the EPL will be described.

Detailed specifications are described one by one in consideration of future and general versatility. In other words, at the same time as "NTSC"
480, 60 / 1.001, colorimetry, ...

However, even in the future, the concept of a pixel and a frame is always maintained in a raster. That is, the video format of the present invention is a generalized expression of the raster video format.

When a format {} statement is placed on the EPL, an ASCII character string is used as shown in the following example. When placing on a video signal, the specified data type binary 128 bytes is inserted for each clip. -Capturing interval ... Indicates the time of one frame at the time of shooting. long / long [s]-Shutter speed ... Indicates the shutter speed at the time of shooting. float [s]-Shutter timing ... Indicates the time when the shutter was opened. float [s]-Display interval ... Indicates the time of one frame during display. long / long [s]-RGB on chromaticity ... Indicates the coordinates of the three primary colors RGB and white on the chromaticity diagram. fixed x 2x 4 • Matrix coefficients ... Indicates the conversion matrix to Y / Pb / Pr. fixed x 9 • Gamma code… Indicates the gamma conversion symbol. char / Interlace code ... Indicates the interlace symbol.
char / padding ... Adjust the number of bytes. char x 4-Picture size ... Indicates the number of effective pixels in the vertical and horizontal directions. short *
short / Active size: Indicates the range excluding solid black. short
* short ・ Clean aperture… Indicates the range that guarantees image quality. sh
ort * short-Pixel aspect ratio ... Indicates the aspect ratio of each pixel. float ・ Luminance offset ... Indicates the position where luminance starts.
float x 2 · Chrominance offset ... Indicates the position where the color difference starts. float x 2 · Luminance pitch… Indicates the thinning out of luminance pixels. c
har x 2 · Chrominance pitch… Indicates the thinning out of pixels for color difference.
char x 2-Bit width ... Indicates the data bit width of Y / Pb / Pr / tl. char x 4 • Y range… Indicates the values of 100% white and 0% black. sho
rt x 2 • Other range… Indicates the maximum and minimum values other than luminance.
short x 2-Name of format ... Indicates the common name of the format. ch
ar x 16 where long is 4 bytes bytes, short is 2 bytes bytes, ch
ar is unsigned in 1 byte byte
teger. fixed is 2 bytes fixed point, 0x7fff = 1
Is considered. 0x0001 ≒ 0.00003. Also, float is a positive value for all items, but it is a normal 4 bytes IBM floating point.

The transmittance tl is used only for the intermediate processing and is not included in the normal epl () execution output signal. Gamma can be represented by coefficients (0.018, 4.5, 1.099, 0.45, 0.099) as in other cases, but the actual operation is a conversion table. The color difference is
Either 2's comp or offset binary is allowed, and it is expressed by the range range.

FIG. 7 shows a specific example. This is (1080/5
9.95i). Detailed description is omitted.

Now, return to FIG. The EPL created at the editing terminals 15, 16, 17 is the EPL
It is stored in the storage unit 18. The EPL stored in the EPL storage unit 18 is read out by the editing control unit 20. The edit control unit 20 generates an edit control signal based on the EPL, and supplies the edit control signal to the content forming unit 30.

[0097] The content forming section 30 is
The content of the predetermined format is formed from the material based on the editing control signal supplied from the. The input material is supplied to the content forming unit 30 through the input terminal IN as described above.

The content forming section 30 stores the input material in the source material server 31. Raw material server 3
Reference numeral 1 denotes a recording / reproducing unit having a disk array configuration and an AV server. Simultaneously fetches a plurality of designated video / audio data from among the supplied original materials, converts them into files, and designates them as files to be designated in the recording / reproducing unit. At the specified address location.

The original material server 31 reads out the stored original material of each file based on the edit control signal supplied from the edit control unit 20 and supplies it to the edit execution unit 32 connected to the original material server 31. .

[0086] A plurality of editing execution units 32 (here, 2
), A switcher & effector 35, which is a main part of the editing execution unit 32, and an encoder 36. The original material decoded by each of the decoders 33 and 34 is processed by a switcher & effector 35 based on an edit control signal supplied from the edit control unit 20.
After the editing process, the data is supplied to the encoder 36.
The encoder 36 encodes the edited edit data in a format based on the edit control signal supplied from the edit control unit 20 and then outputs the encoded data to the output terminal O.
Supply to UT.

In the editing execution section 32, when two original material outputs are simultaneously supplied from the decoders 33 and 34, the switcher & effector 35 performs A / B roll editing, that is, switching editing using two signals, When performing insertion editing or superimposition editing, editing processing is performed in real time using the two original material outputs that are input. In addition, when one source material output is given from the decoder 33 or 34, the switcher & effector 35 reads out two necessary source materials in time order when performing A / B roll editing, and inputs the two source materials first. The original material is temporarily stored in an internal buffer, and a non-real-time editing process is performed by using the subsequently input original material and the previously accumulated original material.

As described above, the content forming apparatus 1 shown in FIG. 2 uses the UMID for specifying the material used for editing and the output, and the UMID for specifying the processing method.
The EID describes the TID, as well as the scan format for specifying the input material and the output format.
For this reason, at the time of editing execution, since the material can be acquired by the ID, it is possible to operate without transmitting heavy image data. In addition, by acquiring the material each time, copyright protection and charging can be performed. Further, since the processing method can be cited by ID, the editing environment (capacity of the equipment) is not selected. Also, copyright protection and billing of the processing method itself can be performed. In addition, input materials can be freely selected. Also, outputs in multiple formats can be obtained simultaneously. In addition, since the operation of creating an EPL proceeds with low image quality, there is no need to select a place or an environment.

The EPL creation unit 10 inside the content forming apparatus 1 prevents the quality of the image data from deteriorating, supports the multi-format image data, and uses the material temporarily without storing it. Further, an edit list for forming the content is created so as to make the processing compatible.

Next, another specific example of the division of labor of the EPL editing work will be described with reference to FIGS. After roughly editing the interview recording raw material and creating EPL (1),
EPL (2-a) for cut editing, EPL for mosaic editing
(2-b), EPL (2-c) of Japanese subtitles and EPL (2-d) of English subtitles are created in parallel, and finally, optimized EPL (3) is created and executed.
(Output of a complete package video signal). In this example, format {} and individual processes with similar expressions are omitted.

FIG. 8 is a functional block diagram of the content production system 120 that divides the EPL editing work. A material composed of video and / or audio captured by the video camera 121 is roughly edited by a logging unit (rough editing unit) 122 to create an EPL (1). Using this EPL (1),
The cutting editing unit 123, the mosaic editing unit 124, the subtitle Japanese editing unit 125, and the subtitle English editing unit 126 proceed in parallel with each other to edit the EPL (2-a) for the cut editing and the EPL (2) for the mosaic editing. −
b), EPL with Japanese subtitles (2-c), EP with English subtitles
Create L (2-d). Of course, the rough editing unit 122,
The cutting editing unit 123, the mosaic editing unit 124, the subtitle Japanese editing unit 125, and the subtitle English editing unit 126 have the same configuration and functions as those of the EPL creating unit 10 shown in FIG.

Then, the Japanese and English integration / optimization unit 1
27 etc. are EPLs (2-a), (2-
b), (2-c) and (2-d) are integrated and optimized, and E
PL (3) is generated. The Japanese / English integration / optimization unit 127 and the like also have the function of the edit control unit 20 shown in FIG. The EPL (3) is sent to the edit execution unit 128 that actually edits.

The editing execution unit 128 has the same configuration functions as those of the content forming unit 30 shown in FIG.
Since the material from the video camera 121 is stored in the internal server, editing can be performed using the EPL (3).

FIG. 9 shows a rough edit EPL (1) created by the rough edit unit 122. UMID "12345608_2345046
7_0800468A88000021 "specifies the output. The start and end points of the editing are described by the time code of the start frame and the time code of the end frame. Here, the start point is "00: 00: 00.00" and the end point is "00:00
0: 01: 03.12 ". The video format of this output can be specified by the description “# 1080i”.

Next, the UMID "29543202_234504C0_0800
468A72000098 '' to identify the input material,
le: //43.14.61.62/source/ "specifies that input material of video format"# 1080i "is read.

Next, a pair of “fork” and “join” indicates that five parallel processes are performed on the input 1 and the outputs are collectively added by the join. First, in the first process, the material along with the interviewer from the time axis "10: 00: 00.12" on the input side is converted from "00: 00.00" to "00: 03.0" on the output side.
"0". The second process is to paste the material from the time axis "10: 01: 05.23" on the input side to the time axis "00: 03.00" to "00: 20.13" on the output side. is there. In the third process, the material when talking from the input side time axis "10: 02: 54.11"
It is pasted from the time axis "00: 20.13" on the output side to "00: 40.09". The fourth process is to paste the background image of the speaker's head from the time axis "10: 05: 18.19" on the input side to the time axis "00: 40.09" to "00: 43.10" on the output side. is there. The fifth process is based on the time axis “10: 0” on the input side.
7: 33.03 is pasted from the time axis "00: 43.10" to "01: 03.12" on the output side.

FIG. 10 shows an EPL (2-a) for cut editing created by the cutting editing unit 123. U
With MID "00521209_234504A3_0800468A89000128",
Specify the output, and specify the start and end points of editing as "00: 00: 0
0.00 "and" 00: 00: 45.00 ". The output video format can also be specified by the description “# 1080i”.

Next, the UMID "12345608_23450467_0800
468A88000021 "specifies that the input material of the video format"# 1080i "is to be extracted from the storage location" file: //43.14.61.62/source/ ".

Then, using the above input material, the following 5
Make one cut edit. First, in the first process, the material from the time axis “00: 00: 00.07” on the input side is converted to the time axis “0” on the output side.
Paste from "0: 00.00" to "00: 23.04". In the second process, the material from the time axis “00: 00: 32.23” on the input side is pasted on the time axis “00: 23.04” to “00: 28.17” on the output side. In the third process, the time axis “00:00:
Paste the material from "40.09" to the time axis "00: 28.17" to "00: 31.18" on the output side. In the fourth process, the material from the time axis “00: 00: 44.12” on the input side is pasted on the time axis “00: 31.18” to “00: 37.29” on the output side.
In the fifth process, the material from the input-side time axis “00: 00: 52.21” is converted from the output-side time axis “00: 37.29” to “00: 45.00”.
Paste by. These five cut edits are added together.

The "fork" and "joi"
n ”followed by“ jack (mosaic) ”and“ jack
(Super) ". “Jack” indicates a receiving position from “child EPL” at the time of optimization by the integration / optimization unit 127. (Mosaic) and (sup
er) is a temporary ID given by the user. Here, (mosaic) is used because it indicates the position where the EPL created by the mosaic editing performed by the mosaic editing unit 124 is received. In addition, (super) is used because it indicates the position to receive the EPL created by the Japanese subtitle editing performed by the Japanese subtitle editing unit 125. After optimization, "jack (mo
saic) ”and“ jack (super) ”disappear.

FIG. 11 shows a mosaic editing EPL (2-b) created by the mosaic editing section 124. UM
With the ID “21341109_23450411_0800468A9B000032”, the output is specified, and the editing start and end points are set to “00: 00: 00.0
0 "and" 00: 01: 03.12 ". Also, the video format of the output video can be specified by the description “# 1080i”.

Next, the UMID "12345608_23450467_0800
468A88000021 "specifies that the input material of the video format"# 1080i "is to be extracted from the storage location" file: //43.14.61.62/source/ ".

Then, using the above input material, the following 2
Perform one mosaic edit. First, the first mosaic editing,
Processing ID (UTID) of "12000000000C0004" stored in storage location "ftp://43.14.61.62/exec/"
Using the image processing specified in, the same video format as the input material, “# 1080i”, and setting values of “= 384 × 232 + 880 + 128”. The editing result obtained by this mosaic editing is pasted from the start point “00: 03.00” to the end point “00: 40.09”. The second mosaic edit is the storage location "ftp: // 4
`` 12000000000C '' stored in `` 3.14.61.62/exec/ ''
Using the image processing specified by the processing ID (UTID) of “0004”, the video format “# 1
080i ”with the setting value of“ = 400x256 + 864 + 96 ”.
The editing result obtained by this mosaic editing is the starting point "00: 4
3.00 ”to the end point“ 01: 03.12 ”. These two
Two mosaic edits are added together.

"Fork" and "joi"
After the description “n”, there is a description “plug (mosaic)”. “Plug” indicates a transfer position to “parent EPL” at the time of optimization by the integration / optimization unit 127. “(Mosaic)” is a temporary ID given by the user. After optimizing, "plug (mosai
c) "disappears.

FIG. 12 shows the subtitle Japanese editor 12
EPL (2-c) for editing Japanese subtitles created in 5
It is. UMID `` 12221109_234504FB_0800468AC10003
41), specify the output, and specify the start and end points of the edit.
"00: 00: 00.00" and "00: 01: 03.12".
The output video format can also be specified by the description “# 1080i”.

Next, the UMID "12345608_23450467_0800
468A88000021 "specifies that the input material of the video format"# 1080i "is to be extracted from the storage location" file: //43.14.61.62/source/ ".

The following editing is performed using the input material. First, the storage location "ftp://43.14.61.62/exec
Using the processing method specified by the processing ID (UTID) of “1200000000130081” stored in “/”, the subtitle “Men in an airplane” in the video format “# 1080i” similar to the input material create. The result of this subtitle creation is pasted from the start point “00: 00.00” to the end point “00: 10.00”. Next, the storage location "ftp:
//43.14.61.62/exec/ '', `` 120000000
Using the processing method specified by the processing ID (UTID) of “0120081”, the Japanese subtitle “I just lost my mind and took off” in the same video format “# 1080i” as the input material was started. From the point "00: 01.00" to the end point "00: 0
4.02 ". Next, using the same processing method and the same video format, stored in the same storage location, the Japanese subtitle "Woke up on the southern island", starting at "00: 04.12"
From the end point "00: 07.29". Then, paste some Japanese subtitles into the image, and finally, using the same processing method and the same video format, stored in the same storage location, saying, Is superimposed from the start point "01: 00.12" to the end point "01: 03.12". These edits are added together.

As described above, “plug (super)” described after “fork” and “join” that enclose the above processing is “parent” during optimization by the integration / optimization unit 127 at the time of optimization. It indicates the delivery position to the "EPL".

FIG. 13 shows the subtitle English editor 12
6 shows an EPL (2-d) of English subtitle editing created in 6. This EPL is an English version of the EPL of Japanese subtitle editing described with reference to FIG. Although the subtitle and the ID of the translation process are different, they have substantially the same contents, and thus the description is omitted here.

In FIG. 14, the Japanese language integration / optimization unit 127 sends EPLs (2-a), (2-
b), EPL created by integrating and optimizing (2-c)
(3) is shown. This is an EPL obtained by integrating and optimizing cut editing, mosaic editing, and Japanese subtitle editing described with reference to FIGS. Detailed description is omitted.

In addition, by integrating and optimizing the EPLs (2-a), (2-b), and (2-d) in the English integration / optimization unit 128, a similar English version can be generated. , Omitted here.

In the above example, since the two-stage cut editing has been performed, the seam of the temporary editing is not reconnected in the main editing, and there is a portion that is utilized as it is, so that the number of editing points when the two are integrated is increased. .

Here, the material, the titler, and the effector are all obtained from the same server. Moreover, although not specified, the same LAN as the device that performs the editing is used.
Has been placed. Although operationally secure, it is expected that it will be more likely to be obtained from distant servers.

For reference, integration / optimization is based on NT
An example of conversion for SC is shown in FIG. The input source video format is “# 1080i”, but NTSC
The format of processing and output is
"# 525ii". Therefore, when this is integrated, E
The one with “down converter” at the end of PL (3) is generated. If the processing order is clear, plug (),
No connection by jack () is required.

As described above, the content forming system 120 shown in FIG. 8 can divide the EPL editing work. In the editing work, since the material is not directly processed, the work can be simultaneously performed in a division of labor system. In the EPL created by each editing unit, the format of the input material and output video is specified by the scan format. Therefore, the input material can be freely selected. Also, output videos in a plurality of formats can be obtained simultaneously.

As a specific example of editing at a remote location, a content forming system 130 as shown in FIG. 16 can be configured in addition to the system shown in FIG. A material composed of video and / or audio captured by the video camera 131 is compressed by the low-rate encoder 132 and sent to the editing unit 135 via the mobile phone 133 or the Internet 134 as sub-material. In the editing unit 135,
While executing the sub-material in a desired operation (playback, rewind, fast-forward, etc.), an EPL is created by visually checking the video displayed on the monitor. The EPL has identification information for specifying a material or an output image used for editing and a format declaration statement that defines a format of at least a part of the material. Then, the generated EPL is sent to the mobile phone 136 or the Internet 137 for editing by the editing unit 140.
Send to The material from the video camera 131 is also sent to the editing execution unit 140 via the hand carry of the video tape 138 or the Internet 139. And since the edit execution part 140 stores the said material in an internal server, it can edit using said EPL.

The description so far has described the UMID for specifying the material and output used for editing, the UTD for specifying the processing method, and the scan format for specifying the input material and the format of the output video. It was explained that the problem was solved by the description in the EPL.

However, as a conventional problem, there is also a problem relating to deterioration of image quality. For example, cut editing to connect several cuts (video scenes) to video recorded by a video camera, and telop editing to superimpose telop characters, and then compress the data before broadcasting the completed video And expansion are repeated, and the image quality is degraded. This specific example will be described with reference to the processing transition diagram of FIG. First, an image captured by the video camera 150 is a bit rate reduction (Bit Rate reduction).
The data is compressed in a reduction (BRR) encoding (enc) process 151 and recorded on a video tape as a video material 152. When performing cut editing on the video material 152, the compressed video material is temporarily expanded by a decoding (dec) process 153, and then edited (Edi).
t1) Edit the cut in 154. The video material that has been cut and edited is compressed again by the encoding process 155 and then recorded on a video tape as a video material 156. Next, when performing telop editing on the video material 156, the compressed video material is decoded again (de-
c) After decompression by processing 157, edit processing (Edit2)
At 158, the telop is superimposed. The video material that has been subjected to telop editing is re-encoded,
After being compressed at 59, it is recorded on a video tape as a video material 160. The video material 160 is converted into a broadcast NTSC format in accordance with the broadcast date.
The signal is subjected to SC encoding 152 and transmitted as a television broadcast wave from, for example, a terrestrial antenna 163.
In this series of processing, the video material is subjected to compression processing four times. The extension process is performed three times. Here, the image quality deteriorates.

The content forming apparatus is effective for solving the problem of image quality deterioration. FIG. 18 shows a specific example thereof. This specific example is a video camera 1
The material consisting of the video and / or audio taken at 70
Bit Rate Reduction (Bit Rate Reduction:
The image data is compressed in a BRR (encode) process 171 and recorded on a video tape as a video material 172. This video material 172 is sent to the EPL creation processing 173.

The EPL creation processing 173 performs cut editing and telop editing by generating an EPL. When performing cut editing on the video material 172, the compressed video material is temporarily decoded (dec) processing 174.
Then, cut editing is performed in the editing process (Edit1) 175. This cut editing is performed by creating an EPL. The telop editing is performed by the telop editing process 177 using the EPL created by the cut editing process 175. Specifically, the telop editing process 177 creates an EPL for telop editing while monitoring the material decoded by the decoder 176.

The EP created in the EPL creation process 173
L is sent to the edit execution process 179. Edit execution processing 1
The material decoded by the decoding process 178 is also supplied to 79. Then, the edit execution process 179
The material is subjected to cut editing and telop editing according to the EPL, and sends the edited result to the NTSC encoding process 180. Then, in the NTSC encoding process 180, the data in the NTSC format is transmitted as a television broadcast wave from, for example, a terrestrial antenna 181. In this series of processing, only the compression processing has been performed twice on the video material. Also, the decoding process is substantially performed only once.

Therefore, the content forming system shown in FIG. 18 can suppress the deterioration of the image quality more than the conventional system shown in FIG. That is, compression and decompression are not repeated during editing as in the past, so that image quality can be maintained.

Further, the content forming apparatus, for example, converts a common program into two systems having different formats.
The image quality can be maintained even when broadcasting Simulcast. The simulcast broadcasting will be described with reference to FIGS. 19 and 20.

FIG. 19 shows a conventional system for performing simulcast broadcasting in both the NTSC format and the HDTV format. The simulcast broadcasting system 190 includes a “1080i” high-definition format video read from the video tape 191 and a “525i” NT video read from the video tape 192.
Upconverter 19 for SC format video
3. Editing process 194 using the video “1080i” by step 3
I do. The editing process 194 is performed in the “1080i” format to generate an output video in a high definition format.
Then, one of them is transmitted as a broadcast wave from the antenna 195 for high vision. On the other hand, for NTSC, the image converted to 525i by down conversion
7 is transmitted as a broadcast wave.

Therefore, in this system 190, "525
i) NTSC format video once up-converted to “1080i”, then edited with “1080i”
The "1080i" output is again down-converted to "525i" for NTSC use. Editing processing for NTSC video is also performed at "1080i", and is set to "525i" before broadcasting.

On the other hand, according to the simulcast broadcasting system 200 shown in FIG. 20 to which the above-mentioned content forming apparatus is applied, the picture quality of NTSC video is not degraded. That is, when the editing execution unit 203 and the editing execution unit 204 execute editing based on the EPL created by the EPL creation unit 10 shown in FIG. ("525i") can be generated without repeating up-conversion and down-conversion.

The video format conversion from the HD image (1080i) to the SD image (525i) and from the SD image to the HD image, which is performed by the editing execution unit 203 or 204 of the system 200, will be described with reference to FIG.

In FIG. 21, the input video signal is
It is stored in the field memory 211 and the field memory 212 in order. The motion detector 210 detects motion from a field image given a difference on the time axis by the two field memories 211 and 212. The result of the motion detection by the motion detecting unit 210, that is, the frame / field tap selection signal indicating that the frame image has moved / the field image has moved is supplied to the transversal vertical filter 213. Is done. The transversal vertical filter 213 is
The frame / frame image is added to the field image given a time difference by the two field memories 211 and 212.
Vertical filter processing is performed based on the tap selection signal of the field. The filter output of the vertical filter 213 is supplied to a transversal horizontal filter 214.
The horizontal filter 214 performs horizontal filtering on the output of the vertical filter. The horizontal filter output of the horizontal filter 214 is supplied to the image enhancer 215.

The image enhancer 215 emphasizes the high frequency component of the output of the horizontal filter. The enhanced output from the image enhancer 215 is output to the image signal converter 2
16. The image signal conversion unit 216 has a Y / Pb
/ Pr signal is converted to an RGB signal. The RGB signals are supplied to the inverse gamma correction unit 217, and are subjected to inverse gamma correction. This inverse gamma correction output is supplied to a color conversion unit (color remetry conversion unit) 218.
The colorimetry conversion unit 218 performs a color conversion process on the inverse gamma correction output. The output of the color conversion processing is supplied to the gamma correction unit 219.

The gamma correction section 219 performs gamma correction processing on the color conversion processing output, and supplies the output to the image signal conversion section 220. The image signal converter 220 converts the RGB signals into Y /
Convert to Pb / Pr signal. This Y / Pb / Pr signal becomes the output video signal.

Therefore, in the configuration shown in FIG. 21, image quality conversion processing section 216 or image quality conversion processing section 220
By changing the conversion processing and the like in the above, it is possible to cope with down conversion processing or up conversion processing.

[0132]

As described above, the content production apparatus according to the present invention uses the distributed edit list created by the distributed edit list creating means at another distributed place, and the edit list creating means generates the final hierarchically structured edit list. The content is created by integrated optimization, and the content forming means forms the content of an arbitrary format based on the edit list. The edit list and / or the distributed edit list include a material for specifying a material used for editing. Since identification information and a format declaration statement that defines the format of at least some of the materials are described, it is compatible with multi-format data, and the compatibility of processing is further improved without using and temporarily storing materials. If possible, content in any format can be produced.

[0133] Further, the content production method according to the present invention provides a method for creating an edit list by using a distributed edit list created by a distributed edit list creating process at another distributed place using a plurality of video and / or audio materials. The process creates a final hierarchically structured edit list by integrated optimization, and forms a content in an arbitrary format based on the edit list in the content forming process. Since it describes identification information for identifying the material used for editing and a format declaration statement that defines the format of at least some of the materials, it is compatible with multi-format data and You can create content in any format without having to use it once and make it possible to further process compatibility.

[Brief description of the drawings]

FIG. 1 is a diagram showing an overall configuration of a content production system according to an embodiment of the present invention.

FIG. 2 is a block diagram illustrating a configuration of a content forming apparatus.

FIG. 3 is a diagram illustrating a description example of an EPL.

FIG. 4 is a diagram showing a description example of an EPL.

FIG. 5 is a diagram showing an execution image of EPL.

FIG. 6 is a diagram schematically showing an image formed after editing using the EPL.

[Fig. 7] Video scan format (video scan for
FIG. 4 is a diagram showing a specific example of mat).

FIG. 8 is a diagram illustrating a content forming system that performs division of labor of editing by EPL.

FIG. 9 is a diagram showing a rough edit EPL (1) created by a rough edit unit of the content forming system of FIG. 8;

FIG. 10 is a diagram showing a cut editing EPL (2-a) created by a cut editing unit of the content forming system of FIG. 8;

11 is a mosaic editing EPL (2-b) created by the mosaic editing unit of the content forming system of FIG.
FIG.

FIG. 12 is a Japanese subtitle editing EPL (2-) created by the Japanese subtitle editing unit of the content forming system of FIG. 8;
It is a figure showing c).

13 is an English subtitle editing EPL (2-d) created by the English subtitle editing unit of the content forming system of FIG. 8;
FIG.

FIG. 14 is a diagram showing an optimized EPL (3) created by the Japanese language integration / optimization unit of the content forming system of FIG. 8;

FIG. 15 EP converted from NTSC for integration and optimization
FIG.

FIG. 16 is a diagram showing another specific example of performing editing work at a remote place.

FIG. 17 is a diagram for explaining a problem of image quality deterioration occurring from recording to broadcasting.

FIG. 18 is a diagram showing a specific example of the content forming apparatus and method of the present invention for solving the above-described image quality deterioration.

FIG. 19 is a configuration diagram of a conventional system that performs simulcast broadcasting in both the NTSC format and the Hi-Vision format.

FIG. 20 is a configuration diagram of a simulcast broadcasting system to which the content forming apparatus and method of the present invention are applied.

FIG. 21 is a diagram for explaining video format conversion.

[Explanation of symbols]

1 content production system, 61 video cameras, 6
3 Internet, 64 material files, 66 material editing group, 74 editing result storage / search group, 8
2 Editing result utilization group, 93 Computer graphic processing group, 102 Closed caption processing group, 111 Local stations

 ──────────────────────────────────────────────────続 き Continuing from the front page (72) Inventor Mitsutoshi Makai 6-7-35 Kita-Shinagawa, Shinagawa-ku, Tokyo Inside Sony Corporation (72) Inventor Masataka Muko 6-7-35 Kita-Shinagawa, Shinagawa-ku, Tokyo Sony Corporation F term (reference) 5C053 FA14 GA11 GB05 GB36

Claims (10)

[Claims] An edit list creating means for creating a final hierarchically structured edit list by integrated optimization using a distributed edit list created at another distributed location using a plurality of video and / or audio materials. A distributed edit list creating means for creating the distributed edit list using the edit list created by the edit list creating means and the corresponding material; and the edit list finally created by the edit list creating means And content forming means for forming a content in an arbitrary format based on the editing list and / or the distributed editing list, wherein identification information of a globally unique same system for specifying a material used for editing, A content declaration device for defining a format of at least a part of the material. 2. The editing list created by the editing list creating means and / or the distributed editing list created by the distributed editing list creating means is stored as a file in a program holder and transmitted via a network. The content production device according to claim 1, wherein: 3. The content production apparatus according to claim 1, further comprising a plurality of said distributed editing list creating means. 4. A content production apparatus according to claim 1, further comprising a content storage / retrieval means for storing / retrieving a content of a predetermined format created based on said edit list created by said edit list creation means. . 5. The content producing apparatus according to claim 1, wherein an identification code for identifying a material processing method is determined based on the globally unique identification information of the same system. 6. The content production apparatus according to claim 1, wherein the format declaration statement includes an image format of an input video material and / or an image format of an edited output. 7. The image format according to claim 6, wherein the image format is a scan format including at least items of one frame time at the time of shooting, the number of effective pixels in the vertical and horizontal directions of the image, and the aspect ratio of each pixel. Content production equipment. 8. The method according to claim 1, wherein when the edit list is created, a sub material obtained by highly compressing the material is used.
Content production device as described. 9. The acquisition source of the material is specified by any of a path enclosed in the editing list or the distributed editing list, a path in an editing system, and an address of an external server via a network. 1. The content production device according to 1. 10. An edit list creating step of creating a final hierarchically structured edit list by integrated optimization using a distributed edit list created at another distributed location using a plurality of video and / or audio materials. A distributed edit list creating step of creating the distributed edit list using the edit list created in the edit list creating step and the material corresponding thereto, based on the edit list created by the edit list creating means A content forming step of forming content in an arbitrary format, wherein the edit list and / or the distributed edit list include globally unique identification information for identifying a material used for editing, and at least one of And a format declaration statement for defining a format of the material of the part.