JP2001177776A - Method and device for contents production - Google Patents

Abstract

PROBLEM TO BE SOLVED: To improve the work efficiency of production and verification of multimedia contents. SOLUTION: Packet sequence information indicating which mediums stored in a storage device 24 should be multiplexed and which sequence they should be multiplexed in is generated and is stored in the storage device 24. When a medium already stored in the storage device 24 will be replaced, operation for replacement is performed on the side of an operation input part 35 for verification of a contents reproducing part 28, and a control part 34 instructs a multiplexing sequence control part 22 of an encoding/virtual multiplexing part 15, and thus an object pointer of packet sequence information is changed. When a new file which is not stored in the storage device 24 will be replaced with, data of the new file is additionally stored in the storage device 24, and the object pointer is changed.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a content producing method and a content producing method for producing and verifying multimedia contents in which video information and audio information for digital broadcasting and additional information related thereto are integrated, for example. Related to the device.

[0002]

2. Description of the Related Art Authoring systems as shown in FIGS. 8 and 9 are conventionally known as content production apparatuses for creating and verifying multimedia contents for digital broadcasting. FIG. 8 shows a configuration for processing from encoding to multiplexing, in which video information, audio information and additional data (captions, service information, position information of each data, etc.) are respectively encoded by a video encoding unit 1 and an audio encoding unit. The encoded data is encoded by the unit 2 and the additional data encoding unit 3 to generate video encoded stream data, audio encoded stream data, and additional data encoded stream data. Next, each of the stream data is packetized by the packetizers 4, 5, and 6, and the information created by the multiplexing additional information generator 7 and indicating the multiplexing situation is added. Next, each of the packet data is time-division multiplexed on a packet basis by the multiplexing unit 8 to generate multiplexed stream data.

In order to verify such multiplexed stream data, a reproducing apparatus as shown in FIG. 9 is used. FIG. 9 shows a configuration for processing from demultiplexing to content reproduction. First, the multiplexed stream data is separated into video coded stream data, additional data coded stream data, and audio coded stream data by the separation unit 9. Next, each of the stream data is decoded into video information, additional data, and audio information by the video decoding unit 10, the additional data decoding unit 11, and the audio decoding unit 12, respectively. The video information and the additional data are displayed on the video display unit 13 and the audio information is output from the audio output unit 14 so that the content creator can view or hear the reproduced output, and receive the audio data during the content broadcast. By performing the operation performed by the side, the multiplexed bit string is reproduced while emulating the receiving system, and the verification is performed.

[0004]

However, in the above-mentioned conventional method, the verification can be performed by reproducing the multiplexed bit string while emulating the receiving system.
In the case where video information is replaced with another during the playback verification and then played back and verified, or when only the necessary part after the replacement is played with particular emphasis and verified, it is necessary to reconstruct the stream. After replacing a part of the video, all of the video must be captured, encoded, and multiplexed again, which causes a problem that the work time for producing the content becomes long.

The present invention has been made in view of the above-described problems of the related art, and has as its object to provide a content production method and a content production apparatus capable of improving work efficiency in producing and verifying multimedia contents.

[0006]

According to the present invention, in order to achieve the above object, video information, audio information and additional information are packetized, and the order of time-division multiplexing of each packet can be changed. That is, according to the present invention, video information, audio information and additional information related thereto are packetized, each packet is time-division multiplexed, and the original information is separated from the multiplexed packet to obtain the video information, audio information. In the content production method for reproducing information and additional information in a verifiable manner, the video information, the audio information and the additional information are packetized, and the order of time-division multiplexing of each packet is set to be changeable. And the time division multiplexing of the additional information is performed in the order set by the setting means.

Further, according to the present invention, a first computer for packetizing video information, audio information and additional information related thereto, time-division multiplexing each packet, and transmitting the multiplexed data via a network. And a second computer that separates the multiplexed data and verifiably reproduces the video information, audio information, and additional information,
The first computer stores the video information, the audio information, the additional information, and the reading position thereof, and stores the reading order in a changeable manner. The second computer can change the reading order. Is provided.

[0008]

Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 is a block diagram showing an embodiment of a content production apparatus that implements a content production method according to the present invention. FIG. 2 is a flowchart for explaining multiplexed information generation processing of the content production apparatus of FIG.
FIG. 4 is an explanatory diagram showing packet order information created by the processing of FIG. 2, FIG. 4 is a flowchart for explaining packet generation and sending-out processing of the content production apparatus of FIG. 1, and FIG. 5 shows the packet generation processing of FIG. FIG. 6 is a flowchart for explaining the packet extracting process of FIG. 5 in detail.

Referring to FIG. 1, the content production apparatus includes an encoding / virtual multiplexing unit 15, an application creation support unit 25, an operation input unit 26, and a content reproduction unit 28. The encoding / virtual multiplexing unit 15 and the content reproduction unit 28 are both constituted by a computer, and are connected to each other via a network 27. In the encoding / virtual multiplexing unit 15, video data, audio data, and additional data are encoded by the video encoding unit 16, the audio encoding unit 17, and the additional data creating unit 18, respectively. Saved and stored. Then, at the time of verification, as described later, the data is stored in the storage device 24,
Each of the stored code data is read out in an order based on the control of the multiplexing order control unit 22 and is read out by the packetizing unit 1.
9, 20, and 21, each packet data is time-division multiplexed, and the multiplexed data is
3. Transferred to the content reproduction unit 28 via the network 27. At the time of packetization in each of the packetizers 19, 20, and 21, a header sent from the multiplexing order controller 22 is added.

In the content reproducing section 28, after the multiplexed data transferred through the network 27 is received through the transport buffer 29, the multiplex / demultiplex section 3
Separated by 0. Next, each of the encoded data of video and audio is decoded by the decoding device 31, and the decoded audio data is applied to the TV monitor 36 via the audio output unit 32, and the decoded video data is output to the video output unit 31. It is applied to the TV monitor 36 via 33. The additional data separated by the demultiplexing unit 30 is transmitted to the control unit 34.
The video data in the additional data is decoded by the control unit 34 and applied to the TV monitor 36.

[0011] Also, as described later, content is created,
In the case of verification, the verification operation input unit 35 of the content reproduction unit 28 performs an operation in which the user packetizes video information, audio information, and additional information and changes the order of time-division multiplexing of each packet. In this case, the control unit 34 of the content reproduction unit 28 notifies the multiplexing order control unit 22 of the encoding / virtual multiplexing unit 15 of this order via the network 27.

In the case of creating content in such a configuration, first, a user (content creator) creates a scenario of a program, prepares necessary video material data and audio material data based on the scenario, and Encoding is performed by the video encoding unit 16 and the audio encoding unit 17, each encoded stream data is generated, and stored and stored in the storage device 24. In addition, if there is additional data to be presented to the viewer in connection therewith, it is created and prepared by the additional data creating unit 18, the application creating support unit 25, and the operation input unit 26, and is stored in the storage device 24. save.

Next, the process proceeds to information creation for performing virtual multiplexing processing shown in FIG. First, in step S1, "program specification information" relating to the content is created. Here, the “program specification information” is information necessary for reproducing the stream data actually multiplexed and broadcast on the receiving side, and information indicating which media is multiplexed, This is information for notifying the receiving side of the multiplexing status. This information includes ISO / I
PSI (Prog) defined in the EC13818-1 standard
ram Specific Information) is known. This PS
In I, information specifying stream data included in the program content and information indicating where the information is located in the multiplexed stream are created. The created "program specification information" is similarly stored and stored in the storage device 24 as stream data.

In the following step S2, as shown in FIG. 3, which media (Object) and file (fi
le)) is created, and the packet order information a indicating the order of multiplexing is created, and this is stored and stored in the storage device 24.
The packet order information a is composed of file list information b and object information c, and the object information c is stored in the storage device 24 for each object (file), its file name, attribute and read position (pointer). rd-ptr). The file list information “b” is a “pointer to each object” arranged according to the order of packetization of the objects constituting the content to be created and verified.
It consists of. This pointer is the object information c
Read position of each object in the pointer (pointer rd-ptr)
Is shown.

Next, content creation and verification processing will be described with reference to FIGS. First, in FIG. 4, when the content creator performs an operation for starting the reproduction verification of the content via the verification operation input unit 35 of the content reproduction unit 28, the encoding / virtual multiplexing unit 15 generates a packet. (Step S3), and then send out the packet (Step S4). Hereinafter, this process is repeated until the end of the stream data or until the verification operation input unit 33 of the content reproduction unit 28 is stopped by a user operation (step S5).

In the packet generation processing in step S3, as shown in detail in FIG. 5, which stream is to be packetized is determined based on the packet order information a shown in FIG. 3 (step S6), and then stored in the storage device 24. Then, data necessary for packetization is extracted from each of the stored encoded data (step S7).

Referring to FIG. 6, the process of extracting packet data in steps S6 and S7 will be described in more detail. First, the packet order n is initialized to n = 1 (step S11), then the n-th packet information of the packet order information a is obtained (step S12), and then the packet order n is incremented by one (step S13).
Next, a pointer in the file list information b is obtained from the packet information read in step S12 (step S1).
4) Then, the pointer rd-ptr in the object information c indicated by the pointer is obtained (step S15). Next, data for one packet is read based on the pointer rd-ptr (step S16), and then the data for one packet is packetized and output (step S1).
7).

Next, the pointer rd in the object information c
-ptr is updated (step S18), and the following step S19
Then, if the reading of the file is not completed or the end of the file is not the end due to the user's stop command, the process directly proceeds to step S8 shown in FIG. 5, while if the end of the file is reached, it is notified that the file has been read to the end (step S2).
0), and then proceed to step S8 shown in FIG.

In step S8 shown in FIG. 5, a packet header of the data is generated, and the read pointer of the read data is updated by one packet (step S9).
Next, the information of the packet header is updated (step S1).
0). Then, when reading the encoded data of the next packet, the process returns to step S6, and the process is performed from the position indicated by the read pointer.

Here, when replacing a video file, for example, which is already stored and stored in the storage device 24, the operation is performed on the verification operation input unit 35 side of the content reproduction unit 28 in step S6. When the control unit 34 instructs the multiplexing order control unit 22 of the encoding / virtual multiplexing unit 15, the object pointer of the file list information b shown in FIG. 3 only needs to be replaced as shown in FIG. When replacing a new file that has not been stored and stored in the storage device 24, the new replaced file and its data are added to the storage device 24, stored and stored, and the object pointer of the file list information b is replaced. Just need.

[0021]

As described above, according to the present invention, since the video information, audio information and additional information are packetized and the order of time-division multiplexing of each packet can be changed, the video information is replaced with another. , Replay and verify,
In the case where only the necessary part after replacement is played back and verified with particular emphasis, the capture, encoding, and multiplexing processing of all the video parts after replacement has been performed to reconstruct the stream. You do n’t have to do it again,
Work efficiency when producing and verifying multimedia content can be improved.

[Brief description of the drawings]

FIG. 1 is a block diagram showing an embodiment of a content production apparatus for implementing a content production method according to the present invention.

FIG. 2 is a flowchart for explaining multiplexed information creation processing of the content production device in FIG. 1;

FIG. 3 is an explanatory diagram showing packet order information created by the processing of FIG. 2;

FIG. 4 is a flowchart for explaining packet generation and transmission processing of the content production device of FIG. 1;

FIG. 5 is a flowchart for explaining the packet generation processing of FIG. 3 in detail;

FIG. 6 is a flowchart for explaining in detail the packet extracting process of FIG. 5;

FIG. 7 is an explanatory diagram showing packet order information created by the processing of FIG. 6;

FIG. 8 is a block diagram showing a multiplexing device of a conventional authoring system.

FIG. 9 is a block diagram showing a conventional reproducing / verifying apparatus of an authoring system.

[Explanation of symbols]

Reference Signs List 15 encoding / virtual multiplexing unit (first computer) 19 to 21 packetizing unit 22 multiplexing order control unit (constituting order setting means with control unit 34 and verification operation input unit 35) 24 storage device 28 contents Reproduction unit (second computer) 30 Demultiplexing unit 31 Decoding device 34 Control unit 35 Verification operation input unit

 ──────────────────────────────────────────────────続 き Continued on front page F term (reference) 5C025 AA01 AA09 AA10 5C063 AB05 AB07 AC01 AC05 CA23 CA29 DA07 5K028 AA00 EE03 KK01 KK03 KK32 LL02 MM04 SS23 5K030 GA17 HB01 HB02 HB21 HB28 JA01 JT04 LD07

Claims (2)

[Claims] 1. Packetization of video information, audio information and related additional information, time-division multiplexing of each packet, and separation of original information from the multiplexed packet to obtain the video information, audio information and In the content production method for reproducing the additional information in a verifiable manner, the video information, the audio information, and the additional information are packetized, and the order of time-division multiplexing of each packet is set to be changeable. A content production method, wherein the time division multiplexing of information is performed in an order set by the setting means. 2. A first computer for packetizing video information, audio information and additional information related thereto and time-division multiplexing each packet, and transmitting the multiplexed data via a network, and the multiplexed data. And a second computer for reproducing the video information, the audio information, and the additional information in a verifiable manner, wherein the first computer stores the video information, the audio information, the additional information, and a reading position thereof. And the second computer can change the reading order, and the second computer can change the reading order.