JP5046997B2 - Data processing apparatus, program, and storage medium - Google Patents

Description

  The present invention relates to a data processing apparatus, a program, and a storage medium, and more particularly to a technique suitable for use in dividing moving image data.

  2. Description of the Related Art Conventionally, a system that compresses and encodes moving image data and records the data on a memory card or an optical disk, or reproduces the recorded moving image data, or a system that transmits moving image data between devices is known. . As a standard for encoding moving image data and audio data in this way, in recent years, the MPEG system is generally used. As a method for transmitting data encoded by the MPEG method, the MPEG transport stream (MPEG-TS) method is generally used. For example, in terrestrial digital broadcasting, image data and audio data of a broadcast program are encoded by the MPEG system, and these are converted into MPEG-TS and transmitted.

  In MPEG-TS, system data for extracting moving image data and audio data from a transport stream (TS) is multiplexed in addition to elementary streams (hereinafter referred to as ES) such as moving image data and audio data. Each data is divided into packets made up of a predetermined amount of data called TS packets, multiplexed and transmitted in units of TS packets. A packet ID (hereinafter referred to as PID) is added to each TS packet, including a system information packet in which system data is stored.

  As system data, there are a program map table (hereinafter referred to as PMT) describing PIDs storing moving image data and audio data, and a program association table (hereinafter referred to as PAT) describing PIDs storing PMTs. . The PID PID is defined as a predetermined value.

  In addition to PMT and PAT, there is a selection information table (hereinafter, SIT) as system data. The SIT stores information related to the peak rate of encoded video data, and in the case of AVCHD, “Partial_transport_stream_descriptor ()” is stored. Further, in this “Partial_transport_stream_descriptor ()”, information relating to buffer control of the video stream such as “peak_rate” is stored.

  When decoding moving image data and audio data multiplexed in MPEG-TS, first, PAT is detected from MPEG-TS. Next, it is necessary to detect the PMT based on the detected PAT and identify the PID of video (moving image data) and audio (sound data) from the PMT. Then, the video packet and the audio packet are extracted from the video packet ID and the audio packet ID, and are decoded.

  On the other hand, MPEG-TS is sometimes recorded on a recording medium and then edited. When MPEG-TS is divided at an arbitrary packet position in the stream, PAT and PMT are not always arranged at the head of the divided second half. Therefore, it is not always possible to decode data from the beginning of the divided position, and there is a problem that decoding can only be performed from a video / audio packet after the position where the PMT located behind the PAT exists.

  Therefore, in order to solve such a problem, for example, in Patent Document 1, it is possible to continuously reproduce divided MPEG-TSs in the input order by generating a private packet and an overlap. Techniques to do this are disclosed.

JP 2003-235008 A

  In general, a counter called “continuity_counter” that is incremented every time a packet having the same packet ID is generated is arranged in the header of the TS. When the method described in Patent Document 1 is used, a packet having the same packet ID as a packet added to the head of the subsequent TS is searched in order from the head of the latter half portion after the division. Then, it is necessary to determine “continuity_counter” of the packet to be added to the head from “continuity_counter” of the found packet. When the frequency of the added packet is low, the search process takes a lot of time, and there is a problem that the responsiveness is lowered.

  In view of the above-described problems, an object of the present invention is to enable decoding to be easily performed while decoding from a specified division position.

The data processing apparatus of the present invention is composed of a plurality of first packets including encoded moving image data and a plurality of second packets including identification information for identifying the first packet, An apparatus for processing a stream in which a second packet is multiplexed at a predetermined period, a designation means for designating a position for dividing the stream, a position designated by the designation means, Splitting means for determining a split position that is a position before the position specified by the specifying means based on a data rate and the predetermined period, and splitting the stream at the determined split position; It is characterized by that.

The program of the present invention comprises a plurality of first packets each including encoded moving image data and a plurality of second packets including identification information for identifying the first packets, A program for operating a computer as a device for processing a stream in which two packets are multiplexed at a predetermined cycle, the step of designating a position for dividing the stream, and the designated position; Determining a division position that is a position before the designated position based on the data rate of the stream and the predetermined period, and dividing the stream at the determined division position; The computer is executed.

  The storage medium of the present invention stores the program described above.

  According to the present invention, when division of moving image data is instructed at a desired position, decoding can be performed from the desired position, and video can be displayed from a desired PTS. Further, it is possible to easily divide when performing the dividing process.

(First embodiment)
Hereinafter, embodiments of the present invention will be described with reference to the drawings.
FIG. 1 shows a moving image data format for reproduction by the data processing apparatus of the present embodiment, which is composed of two types of management information and moving image data. The moving image data is obtained by converting moving images to H.264. After being encoded by the H.264 / MPEG4-AVC system, it is multiplexed into a transport stream (hereinafter referred to as TS). A program association table (hereinafter referred to as PAT) and a program map table (hereinafter referred to as PMT) are arranged every 100 msec, and a selection information table (hereinafter referred to as SIT) is arranged every 1 sec. In the present embodiment, the upper limit bit rate is 18 Mbps.

  The management information stores Total information including information of display start timing (PTSstart) and display end timing (PTSend), and I picture information of moving image data. In the I picture information, information about the Presentation Time Stamp (hereinafter referred to as PTS) of all the I pictures in the moving image data and the storage start packet number (hereinafter referred to as TSN) of the I picture is stored. On the other hand, in addition to information on PTSstart and PTSend, Total information stores information on the total TS number of moving image data (TStotal) and the bit rate of moving image data (TRRmax: TRRmax ≦ 18 Mbps). .

  FIG. 2 is a block diagram illustrating a configuration example of the data processing apparatus according to the present embodiment. The data processing device 200 includes a display unit 201, a video decoding unit 202, a demultiplexer 203, a recording medium control unit 204, a recording medium 205, a ROM 206, a RAM 207, a processor 208, a bus 209, and an operation unit. 210.

  The display unit 201 is a display unit such as a liquid crystal monitor, and displays the video output from the video decoding unit 202. The video decoding unit 202 is connected to the H.264. This is a decoder for H.264 / MPEG4-AVC. The video decoding unit 202 stores the H.264 stored in the RAM 207 based on Descriptor information described later. H.264 / MPEG4-AVC packetized elementary stream (hereinafter referred to as PES) packets are decomposed into elementary streams (hereinafter referred to as ES) and decoded. Then, from the PTS that starts output set by the processor 208 to the PTS that ends output is output to the display unit 201 as an image. The video decoding unit 202 manages the PTS of the picture being output.

  The demultiplexer 203 acquires the PAT and SIT from the TS stored in the RAM 207, acquires the PID of the PMT from the acquired PAT, and acquires the PMT. Further, the PID of the video packet is acquired from the PMT, the video packet is collected based on the acquired PID, the header portion of the TS is removed, and the PES packet is packetized. Then, the data is output to the RAM 207. Also, the demultiplexer 203 acquires and analyzes descriptor information about the stream from the PMT and SIT, and sends information about the video to the video decoding unit 202.

  The recording medium control unit 204 takes out data from the recording medium 205 and outputs it to the RAM 207. The recording medium 205 is a recording medium such as a hard disk, an optical disk, or a magneto-optical disk. The ROM 206 stores a program for the processor 208 and the like. The RAM 207 includes TS, H. H.264 / MPEG4-AVC PES packets, ES, management information, and the like are temporarily stored. Further, it is also used as a work memory for a program operating on the processor 208.

  The processor 208 controls the entire system based on a program stored in the ROM 206. A bus 209 is a bus connecting each block in the system. The operation unit 210 is a user interface, for example, and is used to send an instruction to reproduce or edit data recorded on the recording medium 205.

  Next, the reproduction operation in the data processing apparatus of this embodiment will be described. When the user receives a reproduction instruction from the operation unit 210, the processor 208 drives the recording medium control unit 204 to read management information from the recording medium 205, and inputs and stores it on the RAM 207. Then, the processor 208 performs analysis, and acquires information about the display start timing (PTSstart), the display end timing (PTSend), and the total number of TSs (TStotal) from the management information.

  Next, it sets to the video decoding part 202 based on the acquired information of PTSstart and PTSend. Then, the recording medium control unit 204 reads TS-format moving image data for TStotal packets from the beginning, and temporarily stores it in the RAM 207. In addition, reading of moving image data is started, and the demultiplexer 203 once packetizes the TS temporarily stored in the RAM 207 into PES packets, and then the video decoding unit 202 separates the ES.

  Next, the video decoding unit 202 decodes the ES based on the Decode Time Stamp (hereinafter referred to as DTS) of the PES header, and outputs the pictures included in PTSstart to PTSend to the display unit 201 based on the PTS. At this time, the video decoding unit 202 holds the PTS of the picture output to the display unit 201 so that the PTS of the display picture can be acquired from the processor 208.

  Next, an editing operation in the data processing apparatus of this embodiment will be described with reference to FIG. In the editing operation of the data processing apparatus of the present embodiment, moving image data is divided at an arbitrary I picture, and the divided first half is deleted. FIG. 3 is a flowchart illustrating an example of a division operation procedure under the control of the processor 208.

  First, in step S301, when an editing instruction is received from the operation unit 210 during the reproduction operation, the process is started. In step S302, the processor 208 acquires the PTS of the picture output from the video decoding unit 202 to the display unit 201. Next, in step S303, the I picture information in the management information stored on the RAM 207 is referred to, and the I picture having the smallest PTS (hereinafter referred to as PTSm) located behind the PTS of the display picture is divided into frames. Is temporarily set.

Next, in step S304, the processor 208 functions as a designation unit, acquires the storage start position (TSN) of the I picture temporarily set as the divided frame from the management information, and designates it as the temporary start end TSNm (division designation position). . In step S305, information about the bit rate TRRmax (18 Mbps in this embodiment) is acquired as the data rate from the management information. Next, in step S306, the worst packet number TSN (PAT, PMT) necessary for obtaining the PAT and PMT is multiplied by the following formula to calculate.
TSN (PAT, PMT) = TRRmax x (100msec (PAT generation cycle) + 100msec (PMT generation cycle))

Next, in step S307, similarly to step S306, the worst packet number TSN (SIT) necessary for obtaining SIT is multiplied by the following formula to calculate.
TSN (SIT) = TRRmax x 1 sec (SIT generation cycle)

  Next, in step S308, the processor 208 functions as a dividing unit, compares TSN (PAT, PMT) and TSN (SIT) calculated in steps S306 and S307, and sets the larger one as the corrected packet number TSN (rev). decide. In the present embodiment, since the generation period of SIT is 10 times the generation period of PAT or PMT, TSN (SIT) is set as TSN (rev).

  Next, in step S309, it is determined whether or not the correction packet number TSN (rev), which is a correction amount, is in an applicable range. That is, it is determined whether or not the value obtained by subtracting TSN (rev) from TSNm becomes 0 or a negative value. As a result of this determination, if the range is applicable, the division position does not come before or at the beginning of the moving image data, and the process proceeds to step S310. In step S310, the portion from the beginning of the moving image data to the (TSNm-TSN (rev)) packet is deleted.

  On the other hand, if the result of the determination in step S309 is that the range is not adaptable, the division position will be at the beginning of the moving image data or before the beginning, so that the divided deletion of the moving image data is abandoned, and the process proceeds to step S311. move on. In step S311, the management information display start timing (PTSstart) is overwritten with the PTS of the I picture that is the divided frame in order to prohibit reproduction and display before the divided frame. In step S312, the editing process ends.

  As described above, when reading from the head of the divided moving image data, it is possible to obtain moving image data that can surely acquire PAT, PMT, and SIT before acquiring the display start picture. Thereby, a video can be displayed from a PTS desired by the user.

  In addition, the division position is set before the I picture temporarily set as the divided frame by the number of worst packets for acquiring the PAT, PMT, and SIT regardless of the division designated position designated by the user. For this reason, it is possible to easily perform the division process without unnecessary processing.

  In the present embodiment, PSI (Program Specific Information) / SI (Service Information) information necessary for decoding and display as identification information has been described as PAT, PMT, and SIT. However, PSI / SI information other than PAT, PMT, and SIT may be used. In the present embodiment, the bit rate information of the moving image data is obtained from the total information. However, the bit rate information of the moving image data is obtained from a different area from the total information, or the upper limit bit rate predetermined in the recording format is set. It may be used.

(Other embodiments according to the present invention)
Each means constituting the data processing apparatus and each step of the data processing method in the embodiment of the present invention described above can be realized by operating a program stored in a RAM or ROM of a computer. This program and a computer-readable storage medium storing the program are included in the present invention.

  In addition, the present invention can be implemented as, for example, a system, apparatus, method, program, storage medium, or the like. Specifically, the present invention may be applied to a system including a plurality of devices. The present invention may be applied to an apparatus composed of one device.

  The present invention includes a case where a software program (in the embodiment, a program corresponding to the flowchart shown in FIG. 3) for realizing the functions of the above-described embodiments is directly or remotely supplied to a system or apparatus. This includes the case where the system or the computer of the apparatus is also achieved by reading and executing the supplied program code.

  Accordingly, since the functions of the present invention are implemented by computer, the program code installed in the computer also implements the present invention. In other words, the present invention includes a computer program itself for realizing the functional processing of the present invention.

  In that case, as long as it has the function of a program, it may be in the form of object code, a program executed by an interpreter, script data supplied to the OS, and the like.

  Examples of the storage medium for supplying the program include a flexible disk, a hard disk, an optical disk, and a magneto-optical disk. Further, there are MO, CD-ROM, CD-R, CD-RW, magnetic tape, nonvolatile memory card, ROM, DVD (DVD-ROM, DVD-R) and the like.

  As another program supply method, there is a method of connecting to a homepage on the Internet using a browser of a client computer. It can also be supplied by downloading the computer program itself of the present invention or a compressed file including an automatic installation function from a homepage to a storage medium such as a hard disk.

  It can also be realized by dividing the program code constituting the program of the present invention into a plurality of files and downloading each file from a different homepage. That is, a WWW server that allows a plurality of users to download a program file for realizing the functional processing of the present invention on a computer is also included in the present invention.

  As another method, the program of the present invention is encrypted, stored in a storage medium such as a CD-ROM, distributed to users, and encrypted from a homepage via the Internet to users who have cleared predetermined conditions. Download the key information to be solved. It is also possible to execute the encrypted program by using the key information and install the program on a computer.

  Further, the functions of the above-described embodiments are realized by the computer executing the read program. Furthermore, based on the instructions of the program, an OS or the like running on the computer performs part or all of the actual processing, and the functions of the above-described embodiments can be realized by the processing.

  As another method, a program read from a storage medium is first written in a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer. Then, based on the instructions of the program, the CPU or the like provided in the function expansion board or function expansion unit performs part or all of the actual processing, and the functions of the above-described embodiments are also realized by the processing.

It is a figure which shows an example of the moving image data format in embodiment of this invention. It is a block diagram which shows the structural example of the data processor in embodiment of this invention. It is a flowchart which shows an example of the edit process procedure in embodiment of this invention.

Explanation of symbols

200 Data Processing Device 201 Display Unit 202 Video Decoding Unit 203 Demultiplexer 204 Recording Medium Control Unit 205 Recording Medium 206 ROM
207 RAM
208 processor 209 bus 210 operation unit

Claims (8)

A plurality of first packets including encoded moving image data and a plurality of second packets including identification information for identifying the first packet, and the second packet is a predetermined cycle An apparatus for processing a stream multiplexed by:
A designation means for designating a position for dividing the stream;
Based on the position designated by the designation means, the data rate of the stream, and the predetermined period , a division position that is a position before the position designated by the designation means is determined, and the determined division A data processing apparatus comprising: a dividing unit that divides the stream at a position.   2. The division unit according to claim 1, wherein the division unit determines the division position by correcting the position designated by the designation unit based on a data rate of the stream and the predetermined period. Data processing device. A plurality of first packets including encoded moving image data and a plurality of second packets including identification information for identifying the first packet, and the second packet is a predetermined cycle An apparatus for processing a stream multiplexed by:
A designation means for designating a position for dividing the stream;
A dividing unit that determines a division position of the stream based on the position designated by the designation unit, the data rate of the stream, and the predetermined period, and divides the stream at the decided division position; With
The dividing unit calculates a correction amount by multiplying the data rate of the stream by the predetermined period, and sets a position before the position specified by the specifying unit by the calculated correction amount as the division position. features and to Lud over data processing device to determine a.   4. The stream according to claim 1, wherein the stream is an MPEG transport stream, and the second packet is a packet including a program association table and a packet including a program map table. Data processing device. Reproduction means for reproducing the stream and management information including information on the reproduction start position of the stream from a recording medium;
Changing means for changing the management information recorded on the recording medium,
5. The change unit according to claim 1, wherein the change unit changes the reproduction start position in the management information corresponding to the stream after the division after the division position according to the designated position. A data processing apparatus according to claim 1. A plurality of third packets including information related to the peak rate of the moving image data are multiplexed in the stream at a period different from the predetermined period, and the dividing unit includes the data rate of the stream and the predetermined period. The larger one of the first correction amount obtained based on the above and the second correction amount obtained based on the data rate of the stream and the period in which the third packet is multiplexed is selected. 2. The data processing apparatus according to claim 1, wherein a position that is a predetermined amount before the position specified by the specifying means is determined as the division position . Each of the plurality of first packets including encoded video data and a plurality of second packets including identification information for identifying the first packet, wherein the second packet is a predetermined packet A program for operating a computer as a device for processing a stream multiplexed in a cycle,
Designating a position for dividing the stream;
Based on the designated position, the data rate of the stream, and the predetermined period , a division position that is a position before the designated position is determined, and the stream is determined at the determined division position. A program for causing the computer to execute the step of dividing the program.   A computer-readable storage medium storing the program according to claim 7.

Images