JP2003078877A - Image processor - Google Patents

Abstract

PROBLEM TO BE SOLVED: To prevent a noise from being generated in an image at special reproduction. SOLUTION: An input means 20a receives a transport stream. A detection means 20b detects it when a packet including image information with a different kind exists in packets configuring the transport stream received from the input means 20a. When the detection means 20 detects a plurality of packets with the different kind, a division means 20d divides the packet into a plurality of packets. A recording means 20d records the packets divided by the division means 20c. A reproduction means 20e reads the packets recorded by the recording means 20d in a prescribed sequence to realize special reproduction.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image processing apparatus, and more particularly to an image processing apparatus for inputting a transport stream composed of a plurality of packets and subjecting an image contained therein to predetermined processing. Regarding

[0002]

2. Description of the Related Art MPEG is used in digital television broadcasting.
Broadcasting is performed using a (Moving Picture Experts Group) II transport stream (hereinafter referred to as TS) or a signal compliant with this (such as DSS-TS manufactured by DirecTV (trademark) in the US).

The receiving device sends such a received signal to the NTS.
C (National Television Standards Committee) and other video signals are converted and output, and VCR (Video
Cassette Recorder) and PVR (Personal Video Record)
er: An image recording device for personal use, which generally means a video storage device using a hard disk).

By the way, in the receiving device, it is necessary to perform special reproduction such as high-speed reproduction for searching for a desired portion and reverse reproduction for confirming movement. For example, the VCR is not suitable for skip-reading of arbitrary data, but buffering the data, and because the PVR has a high transfer rate, it can perform special reproduction by reading a necessary packet group at high speed.

A DVD (Digital Ve
In the rsatile disk, data is stored by the MPEGII program stream (PS). In the case of a DVD, it is necessary to clarify the starting point for starting image reproduction, so an intra picture that can be immediately decoded (hereinafter referred to as I-
It is guaranteed that the stream starts from "(pic.)", and various measures are taken to perform special reproduction while referring to the index to the next image data.

[0006] In TS which is a broadcasting medium, the starting point is not specified in particular, and PES (Pa
cketized Elementary Stream) is only guaranteed to start and the timing of starting the picture is not guaranteed. Also, due to the characteristics of the broadcast media that sequentially visualizes the stream, information for special reproduction is not included in the stream.

When storing the TS data received as broadcast, it is possible to know which picture starts in each packet by detecting and analyzing the picture start code from the stream, and based on this information. If the image data is input to the decoder in the required image order, the reproduction can be performed in any order.

At this time, although the TS packet is input to the decoder, there is no guarantee that the packet is composed of only the necessary picture data, and the previous or next picture data may be mixed. If this mixed data is decoded as it is, the continuity of the preceding and following data is lost, and it becomes impossible to decode or the image is disturbed. Therefore, if the decoder can be instructed whether this mixed data is unnecessary and the decoder can skip the unnecessary data by such an instruction, such a problem can be prevented.

FIG. 12 shows a conventional MPEG reproducing apparatus.
As shown in this figure, the conventional MPEG reproducing apparatus includes a packet data cutout unit 10a, a packet control unit 10b,
Also, a TS decoder 10 including a descrambler 10c, a video decoder 11, a television receiver 12, a storage device 13, and a TS (Transport Stre
am) analysis unit 14, packet decomposition unit 15, special playback ES
It is composed of an (Elementary Stream) generation unit 16 and a repacketization unit 17.

Here, the packet data cutout unit 10a
Performs a process of cutting out image data from the input TS packet with reference to the analysis result of the packet control unit 10b.

The packet control unit 10b analyzes the header of the TS packet and determines the type of data and the presence or absence of scramble. The descrambler 10c performs a process for canceling the scramble process if the image data is scrambled.

The video decoder 11 converts the image data output from the descrambler 10c into an NTSC signal and outputs it. The television receiver 12 displays and outputs the NTSC signal output from the video decoder 11.

The storage device 13 is, for example, an HDD (Hard D
The TS packet output from the descrambler 10c is recorded. T
The S analysis unit 14 sequentially analyzes the TS read from the storage device 13 to obtain the start point of the image data.

The packet disassembling unit 15 disassembles a plurality of picture data in the TS packet so as to include only a single picture data.
The special reproduction ES generation unit 16 generates special reproduction ES by rearranging or thinning out the picture data output from the packet decomposition unit 15 as necessary.

The repacketizing unit 17 converts the ES packet into T
It is converted again into an S packet and input again into the TS decoder 10. Next, the operation of the above conventional example will be described.

When a TS packet is input, the packet controller 10b of the TS decoder 10 causes the TS packet PI
The type of data is determined by D (Packet Identification), whether a new PES packet is started is determined by the payload bit, and it is determined whether the stream is scrambled by the DES flag.

The packet data cutout unit 10a cuts out TS packet image data according to the analysis result of the packet control unit 10b. The descrambler 10c performs descramble processing on the picture data cut out by the packet cutout unit 10a when the packet control unit 10b determines that the scramble is applied.

The storage device 13 sequentially stores the TS packets descrambled as needed. TS
The analysis unit 14 detects the picture start code included in the TS, and if the picture data is included before it, the analysis unit 14 determines that the packet includes a plurality of picture data, Notice.

The packet disassembling unit 15 disassembles a packet containing a plurality of picture data for each picture and outputs it. For example, in the case of high speed reproduction, the special reproduction ES generation unit 16 thins out B-pics and outputs the thinned out B-pics.

The repacketizing unit 17 converts the ES packet output from the special reproduction ES generating unit 16 into a TS packet and outputs it. The TS packet output from the repacketizing unit 17 is supplied to the video decoder 11 via the TS decoder 10, converted into an NTSC signal there, and then supplied to the television receiver 12.

As a result, for example, the image data stored in the storage device 13 can be reproduced at high speed or in reverse. FIG. 13 is a diagram showing another configuration example of a conventional MPEG reproducing apparatus.

The example of this figure is shown in Japanese Patent Application No. 2000-35711.
8 are described. In the example of this figure, a packet data cutout unit 30a, a packet control unit 30b, a descrambler & index generation unit 30c, and
It is composed of a TS decoder 30 configured by the discontinuity detection processing unit 30d, a video decoder 40, a television receiver 41, a storage device 42, and a packet processing unit 43.

Here, the packet data cutout unit 30a
Performs a process of cutting out image data from the input TS packet with reference to the analysis result of the packet control unit 30b.

The packet controller 30b analyzes the header of the TS packet and determines the type of data and the presence / absence of scramble. Descrambler & index generator 30
When the image data has been scrambled, c performs processing for canceling the scramble, detects the picture start code, and generates and outputs an index indicating the position.

When it is indicated that the TS packet contains discontinuous data, the discontinuity detection processing unit 30d detects this and notifies the video decoder 40 of this. The video decoder 40 converts the image data output from the discontinuity detection processing unit 30d into an NTSC signal, and when discontinuous data is included, temporarily stops the decoding process for the data.

The television receiver 41 displays and outputs the NTSC signal output from the video decoder 40. The storage device 42 is composed of, for example, an HDD or the like, and records the TS packet output from the descrambler & index generation unit 30c.

The packet processing unit 43 refers to the index stored in the storage device 42, reads the TS packets in a predetermined order, and inserts information indicating that when the packets include discontinuous data. And output.

Next, the operation of the above conventional example will be described. When a TS packet is input, the packet control unit 30b of the TS decoder 30 determines the data type based on the PID of the TS packet, and a new P based on the payload bit.
It is determined whether the ES packet starts, and whether the stream is scrambled by the DES flag.

The packet data cutout unit 30a cuts out the image data from the TS packet according to the determination result of the packet control unit 30b. The descrambler & index generation unit 30c performs descramble processing on the image data cut out by the packet cutout unit 30a when the packet control unit 30b determines that the scramble is performed. When the picture start code is detected, the information indicating the position is recorded as index information in the storage device 42 together with the TS packet.

The storage device 42 sequentially records the TS packet and index output from the descrambler & index generator 30c. Packet processing unit 43
Refers to the index stored in the storage device 42, detects the beginning of the picture data, reads the TS packet in units of picture data, and, for example, in the case of high-speed reproduction, thins out B-pic and outputs it. To do. When the TS packet contains discontinuous data,
That is, when the TS packet includes unnecessary data, the information indicating that is inserted and output.

The TS packet output from the packet processing unit 43 is supplied to the discontinuity detection processing unit 30d via the packet data cutout unit 30a and the descrambler & index generation unit 30c.

The discontinuity detection processing unit 30d, when information indicating that the TS packet contains discontinuous image data is inserted by the packet processing unit 43,
This is notified to the video decoder 40.

The video decoder 40 converts the TS packet output from the discontinuity detection processing unit 30d into an NTSC signal and outputs the NTSC signal, and also inserts information indicating that the TS packet contains discontinuous picture data. In that case, decoding of the packet is stopped for the subsequent picture data.

The television receiver 41 displays and outputs the NTSC signal output from the video decoder 40. According to the conventional example described above, the image data stored in the storage device 42 can be reproduced at high speed or in reverse as in the case of FIG.

[0035]

However, in the conventional example shown in FIG. 12, the TS analysis unit 14 and the packet disassembly unit 15 are provided.
Therefore, it is necessary to analyze the TS packet in real time and perform processing such as disassembling, so that there is a problem that smooth special reproduction is difficult.

Further, in the conventional example shown in FIG. 13, in order to notify the video decoder 40 that discontinuous picture data is included, special information not defined in the MPEG standard is inserted. However, there is a problem that it can be played back only by a specific decoder.

The present invention has been made in view of the above circumstances, and noise or image disturbance is generated even in special reproduction such as high speed reproduction or reverse reproduction in an MPEG transport stream. An object of the present invention is to provide an image processing device that is smooth and has universality without any occurrence.

[0038]

In order to solve the above-mentioned problems, the present invention inputs a transport stream composed of a plurality of packets, as shown in FIG. 1, with respect to an image contained therein. Image processing device 2 for performing predetermined processing
0, of the input means 20a for inputting the transport stream and the packets forming the transport stream input from the input means 20a,
When there is a packet containing different types of image information, a detecting means 20b for detecting this and the detecting means 20
When it is detected by b that a plurality of packets are included, the image processing apparatus 20 is provided which includes a dividing unit 20c that divides the packet into a plurality of packets.

Here, the input means 20a inputs the transport stream. The detection unit 20b detects a packet, which is included in the transport stream input from the input unit 20a, and includes a packet including different types of image information, when the packet includes the image information. Dividing means 20
When the detecting unit 20b detects that the packet includes a plurality of packets, the packet c is divided into a plurality of packets.

[0040]

BEST MODE FOR CARRYING OUT THE INVENTION Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 is a principle diagram for explaining the operation principle of the present invention. As shown in this figure, the image processing apparatus 20 of the present invention includes an input unit 20a, a detection unit 20b, a dividing unit 20c, a recording unit 20d, and a reproducing unit 20.
It is composed of e.

Here, the input means 20a inputs a transport stream composed of a plurality of packets. The detection means 20b, out of the packets forming the transport stream input from the input means 20a,
If there is a packet containing different types of image information, this is detected.

When the detecting means 20b detects a packet containing a plurality of images, the dividing means 20c divides the packet into a plurality of packets. The recording unit 20d records the packet divided by the dividing unit 20c and the normal packet.

The reproducing means 20e reads the packets recorded in the recording means 20d in a predetermined order and executes special reproduction. Next, the operation of the above principle diagram will be described.

Now, it is assumed that the first to fourth packets are input to the image processing apparatus 20, as shown in FIG. The first packet contains only I-pic, and the second packet contains both I-pic and B-pic. Furthermore, the third and fourth packets contain only B-pics.

The input means 20a inputs these first to fourth packets and supplies them to the detection means 20b. The detection unit 20b detects a packet including different types of image information among the packets supplied from the input unit 20a, if any. In the present example, since the second packet includes both I-pic and B-pic, the detecting means 20b detects this as the corresponding packet.

When the detecting means 20b detects that a plurality of packets are included, the dividing means 20c divides the packet into a plurality of packets. In the present example, since the second packet includes two types of images, I-pic and B-pic, the dividing means 20c divides the second packet into the 2a packet and the 2b packet. To do. As a method of division, for example, the second
A duplicate of the packet is created, the duplicate source is the second packet, and the duplicate destination is the second packet. And the second
For packet a, zero stuffing is performed on the area including B-pic, and the second b
The zero stuffing is performed on the area including the I-pic. By doing so, the packet can be divided for each image.

The recording means 20d sequentially stores the packets divided by the dividing means 20c. At this time, an index is generated and stored in order to facilitate the data reading process during reproduction.

The reproducing means 20e refers to the index recorded in the recording means 20d and reads out necessary packets in a predetermined order to execute special reproduction such as high speed reproduction and reverse reproduction. For example, in case of high speed playback,
It can be realized by skipping B-pic and reproducing.
At this time, since all the packets include only a single type of image, it is possible to prevent noise even when the packets are skipped and reproduced.

As described above, according to the image processing apparatus 20 of the present invention, for a packet including a plurality of types of images, the packet is generated by dividing each image, so that the special reproduction is performed. It is possible to prevent the generation of problematic noise.

Next, an embodiment of the present invention will be described. FIG. 2 is a diagram showing a configuration example of the embodiment of the present invention. As shown in this figure, the embodiment of the present invention is
It is composed of a decoder 60, a video decoder 70, a television receiver 71, a storage device 72, and a packet processing unit 73.

Here, the TS decoder 60 includes a packet data cutout unit 60a, a packet control unit 60b, a descrambler & PES length replacement unit 60c, a copy control processing unit 60d, a first packet buffer unit 60e, and a second packet buffer unit. 60 f and a selection packet output unit 60 g, which inputs TS packets, performs descrambling processing as necessary, and
When a single packet contains a plurality of types of images, it is divided and output to the storage device 72.

Here, the packet data cutout unit 60a
Performs a process of cutting out image data from the input TS packet with reference to the analysis result of the packet control unit 60b.

The packet control unit 60b analyzes the header of the TS packet and determines the type of data and the presence or absence of scramble. Descrambler & PES long replacement part 60
When the image data has been scrambled, the c performs a process of canceling the scramble process, a process of replacing the PES data length, and a process of detecting the start code.

The copy control processing unit 60d executes control for copying a packet to the first packet buffer unit 60e and the second packet buffer unit 60f, and
Perform the process of extracting the index.

The first packet buffer section 60e stores the first packet when dividing the packet. Second
The packet buffer unit 60f stores the second packet when the packet is divided, and stores the normal packet when the packet is not divided.

The selected packet output unit 60g selects a packet stored in either the first packet buffer unit 60e or the second packet buffer unit 60f and outputs it to the storage device 72.

The storage device 72 is composed of, for example, an HDD or the like, and sequentially records the packets output from the TS decoder 60. When performing trick play, the packet processing unit 73 reads out the packets stored in the storage device 72 in a predetermined order by referring to the index, and
It is supplied to the S decoder 60.

The video decoder 70 is the TS decoder 60.
The packet output from is converted into an NTSC signal and supplied to the television receiver 71. The television receiver 71 displays and outputs the NTSC signal output from the video decoder 70.

Next, the operation of the above embodiment will be described. When a TS packet is input, the packet control unit 60b determines the data type from the PID of the TS packet, determines whether a new PES packet starts with the payl bit, and scrambles the stream with the DES flag. It is determined whether or not, and the determination result is notified to the packet data cutout unit 60a.

The packet data cutout unit 60a cuts out a packet from the TS according to the information notified from the packet control unit 60b and supplies it to the descrambler & PES length replacement unit 60c.

Descrambler & PES long replacement section 6
0c performs descramble processing when descramble processing is necessary. In addition, it is determined whether or not the packet includes a plurality of types of images, and if a plurality of types of images are included, the copy control processing unit 60d is notified to divide the images.

Here, in a normal packet, a sequence header code or a group of picture code (GO) is used.
P) may be inserted before the picture start code, but the descrambler & PES length replacement unit 6
0c collectively treats these as a picture start code, and also a PES header code and P following this.
Except for this, the ES header body is not the picture data body, and if there is data before the picture start code, it is determined that the packet contains a plurality of different types of images.

More specifically, the descrambler & PES
When the long replacement unit 60c detects a start code beginning with 00-00-01-xx from the descrambled TS packet data, if xx = 00, the code is a picture start code. If different image data exists before that, the start position information is saved because the packet is divided from the first data of the start code. As a method of determining whether or not the previous image data exists, when there is a PES start code, the data for the PES header is ignored and the start code (excluding the slice start code) is used.
If the packet starts from, it can be determined that the previous image does not exist. Note that xx = B3 (sequence header) and xx = B8 (GOP) are also the starting points of packet division and are the same image information as the subsequent picture start code, so the picture start code is for the new image. It is not judged as the start.

Further, as will be described later, the descrambler & PES length replacing section 60c stores the picture start code stored in the previous packet when the picture start code is divided and stored in two packets. Since the data length increases when is deleted by zero stuffing, the PES length is replaced.

When the copy control processing unit 60d is notified by the descrambler & PES length replacing unit 60c that the packet includes a plurality of different images, the copy control processing unit 60d, as shown in FIG. (See A)) is copied to the first packet buffer unit 60e and the second packet buffer unit 60f.

Then, the first packet buffer unit 60e
3B, as shown in FIG. 3 (B), pic. Zero stuffing is performed on h and actual data P-pic.

On the other hand, for the second packet buffer unit 60f, as shown in FIG.
Perform zero stuffing on pic. In addition,
Even if 0 is inserted before the start code of the TS, there is no particular problem as a data stream. Therefore, even if the packet is divided by such a method, no problem occurs in the subsequent block.

Next, when the packet is divided, the selected packet output unit 60g first reads the packet from the first packet buffer unit 60e and supplies it to the storage device 72, and then the second packet. The packet is read from the buffer unit 60f and supplied to the storage device 72 for storage. If the packet is not divided, the packet is stored in the second packet buffer unit 60f, and is read out and supplied to the storage device 72 for storage.

The copy control processing unit 60d generates a serial number for the packet, generates data indicating the type of image data stored in the packet, and supplies this to the storage device 72 as an index. The packet and the index are associated with each other and stored in the storage device 72.

The packet processing unit 73 refers to the index stored in the storage device 72, reads out the packets in a predetermined order and supplies them to the TS decoder 60, thereby executing special reproduction.

FIG. 4 is a diagram for explaining a specific example of trick play. Generally, in TS, data is stored in packets of 188 bytes. When PES data such as video data and no adaptation field exists, the packet has a TS header of 4 bytes and a P header.
It consists of 184 bytes of ES data.

FIG. 4A is a diagram showing an example of the input packet. In this example, the I-pic is stored in the first half of the first to fourth packets and the fifth packet, and the B-pi is stored in the latter half of the fifth packet and the first half of the sixth packet.
c is stored. Hereinafter, B-pic, P-pic,
B-pic, B-pic, and P-pic are stored in the sixth to seventeenth packets, respectively, as shown in the figure.

FIG. 4B is a diagram showing an example in which the packet shown in FIG. 4A is stored in the storage device 72 after undergoing the dividing process. In the example shown in FIG. 4A, the fifth
Since two types of packets, I-pic and B-pic, are stored in this packet, the fifth packet is divided into a 5a packet and a 5b packet and stored. Further, the sixth packet is also divided into a sixth packet and a sixth packet. Similarly,
The thirteenth, fourteenth, and seventeenth packets will also be divided into two.

It should be noted that the storage device 72 stores I-pics from the first packet to the fifth packet,
The copy control processing unit 60d stores an index such that B-pics are stored from the packet of b to the packet of 6a.

FIG. 4C shows a packet output mode from the packet processing unit 73 in the case of high speed reproduction. In this example, among the packet groups shown in FIG.
B-pic is omitted. In this way, B-pic
By omitting and outputting, it is possible to achieve triple speed reproduction in this example. That is, in general, in MPEG, I-pic is used.
Since two B-pics are inserted between P-pics, the B-pics can be omitted to achieve triple speed reproduction. For this 3 × speed reproduction,
The packets may be read out in the order of a, 8b to 11th, and 14b to 17a and supplied to the TS decoder. Since there is no other picture data between the 5bth to 8ath packets and the sequential reproduction of each picture is a basic function of the MPEG decoder, the B-pic is omitted in this way. Even in this case, the image can be reproduced normally.

FIG. 5 is a diagram for explaining the outline of the operation for reverse reproduction. FIG. 5A is a diagram showing an example of the input stream. In this example, one rectangle stores one type of image (I-pic, B-pic, etc.).

First, consider the case of performing high speed reverse reproduction. Since P-pic has difference data with I-pic, and the next P-pic has difference data with the previous P-pic, in order to reproduce I17 and then P14, I2 , P5, P8, P11, P14 are sent, and it is necessary to display P14 next to I17 without displaying I2 to P11.

Similarly, I2, P5, P8 and P11 are sent and the next P11 is sent, I2, P5 and P8 are sent and P8 is sent to I
2, P5 is fed, P5 is fed, I2 is fed, and I2 is sequentially displayed. Here, when displaying P11, P1 is actually
Since P11 is held as the reference image when 4 is displayed, P2 is not necessary even if I2, P5, P8 and P11 are sent again.
Since 11 can be displayed, P8 and P5 can be displayed at the time of P11 written with a dotted line, and I2 can be displayed before the last five image data.

In order to realize such a reverse reproduction, a sequencer for displaying correctly in this sequence may be prepared in the packet processing unit 73. In the low-speed reproduction, it is necessary to smoothly perform the backward reproduction by displaying the B-pic as well. In the case of the B-pic, the I-pic or P-pi which is the reference image before and after is displayed for the display.
It is necessary to decode c. Send I2-P14 first to display B13, display P14, and P11
Is left as the reference image, then B13 is sent, P11 or P14 is referred to, B13 is displayed, B12 is sent, and P1 is sent.
B12 is displayed with reference to 1 or P14. As in the case of the high-speed reverse reproduction described above, the image of the dotted line portion can be held, so that transmission can be omitted and decoding can be performed at high speed due to the configuration of the sequencer.

The packet processing unit 7 is operated as described above.
The packet read by 3 is TS decoder 60
Is supplied to the video decoder 70 via the
After being converted into a C signal, it is displayed by the television receiver 71.

As described above, in the embodiment of the present invention, since the TS packet always has the data of one picture, a simple index is prepared so that the high speed reproduction and the reverse reproduction can be performed only by rearranging the packets. Special playback such as is possible.

As the reproduction processing, since the normal MPEG processing (excluding the display skip at the time of reverse reproduction) is performed,
It can be played back by a general MPEG decoder, and even if a recording device configuration without a decoder is adopted for cost reduction, basic high-speed playback or I-pic reverse playback can be performed using any decoder device. It will be possible.

Further, when the same decoder is used,
There is no need to provide a hardware mechanism for special playback,
In addition, the external processing of the recording or playback management system becomes easy,
The cost can be reduced.

In the above embodiments, the case where the picture start code is completely stored in one packet has been described as an example, but the picture start code may extend over two packets. Therefore, a coping method in such a case will be described below.

The picture start code is composed of 4 bytes, and if it extends over a packet, the code cannot be discriminated until a subsequent packet is read, which makes processing difficult. The picture start code is a start code that appears next to the last slice. The sequence header may be read before that to identify the last slice, and the start code that appears after that may be processed. As described above, this start code is the sequence header and GO.
Includes P and picture start code.

For example, as shown in FIGS. 6A and 6B, a picture start code (00-00-01-0)
0) is divided and stored in the preceding and following packets, the adaptation field and slice
-N (see FIG. 6C), a packet including an adaptation field and a picture start code (FIG. 6D), and a packet including an adaptation field, a header, and a picture body (see FIG. 6E). )) Can be considered.

However, in such a method, as shown in FIG.
When the packet shown in (C) is generated, slice-N
Needs to be moved to the end of the packet and an adaptation field needs to be generated, resulting in a large amount of processing.

Therefore, as shown in FIG. 7 (A), when the third byte of the picture start code exists in the first packet, as shown in FIG. 7 (B), the last "01" Is converted to “00”, these 3 bytes are treated as zero stuffing, and the second image can be stored in the subsequent packet by adding the insufficient bytes to the subsequent packet.

In this case, the data amount of the subsequent packet increases, but as shown in FIG. 8 (B), a packet including only the adaptation field and the picture start code is generated, and as shown in FIG. 8 (C). In Fig. 8
If a packet is generated by converting the picture start code portion of the packet of (A) into an adaptation field, the packet can be divided with a small processing amount.

In this method, although it is 1 to 3 bytes,
Since the amount of data increases, it becomes necessary to rewrite the PES data length (after the PES start code). In addition,
As mentioned above, this function is used for descrambler & PE.
The S-long replacement unit 60c executes this. However, in the TS, the data length is defined as indefinite when the PES data length = 0, and when the PES data length is given, this is set to 0.
A TS having a normal PES data length can be obtained by converting the TS into a TS.

Further, as shown in FIG. 9A, when the picture start code is divided into packets,
Subsequent packets have adaptation fields,
If there is unnecessary data here (usually, if the adaptation field control is 00h, including PCR and then invalid data), for example, if the previous packet has a 3-byte header, As shown in FIG. 9B, the adaptation data length may be shortened by 3 bytes and all picture start codes “00-00-01-00” may be inserted.

When deleting other than PCR, the lower 4 bits of the adaptation field control (OP
CR, SPLICING POINT, PRIVATE
DATA, ADAPTATION EXTENSIO
It is defined as "invalid data" by converting the bit indicating the presence of N) into "0", so the number of bytes of the additional header may be subtracted from the length of the adaptation part.

If "00" is present in only 1 byte in the previous packet and the adaptation length of the subsequent packet is "0", it is naturally possible to eliminate the adaptation and add the necessary "00". Is.

According to the above-described embodiments, even when the picture start code is stored in two packets, the image can be normally reproduced specially and the image processing apparatus It is possible to reduce the processing amount.

Next, another embodiment of the packet dividing method will be described. In the above-described embodiment, unnecessary data is deleted by zero stuffing to divide the packet as shown in FIG. 3, but unnecessary data is added by adding an adaptation field as shown in FIG. Can be deleted and the packet can be divided.

That is, as shown in FIG. 10 (B), the data of the first picture in the first packet is stored at the end of the packet, and the empty area is an adaptation field defined as non-video data of TS. For the second packet, as shown in FIG. 10C, the original packet (see FIG. 10A) may be copied to divide the packet by using B-pic as an adaptation field. It is possible.

Specifically, when a packet is divided by such a method, valid data from the TS header to the start position of the start code is copied to the end of the second packet buffer section 60f shown in FIG. In order to invalidate the data before the start code on the first packet buffer unit 60e, the adaptation valid bit in the TS header is rewritten to "1", and the invalid data length (adaption length) is set to the fifth byte. "00" in 6 bytes
Write (code indicating that there is no valid adaptation data).

Similarly, in order to invalidate the non-writing section on the second packet buffer section 60f, "00" is written in the adaptation valid bit on the TS header, the data length of the fifth byte, and the sixth byte.

When the data length stored in the second packet buffer unit 60f is 1 byte, the valid data in the first packet buffer unit 60e becomes 183 bytes, and the data starts from the 6th byte. Since the data length of 5 bytes is "00", "00" indicating the attribute of the adaptation part must not be written in the 6th byte.

By the way, when the original packet has an adaptation part in advance, the fifth byte of the sixth byte
Since the PCR data of the bit indicates the valid data transmission, the PC which holds this bit on the first packet buffer unit 60e and is stored in the 7th to 12th bytes
Do not rewrite R data.

In the TS header, c indicating the continuity of packets is shown.
In this method, which has a c (Continuity Counter) and involves packet insertion, the value of cc is set to 1 each time a packet is written.
It is necessary to rewrite the normal cc value incremented by 1 in each packet buffer. This cc value is held for each video stream, and when processing a plurality of video streams, it is necessary to hold the cc value for each video stream and apply it for each video stream. .

When the packet is divided, since the data of the first half of the packet is placed on the second packet buffer section 60f by the above-mentioned processing, the data stored in the second packet buffer section 60f is processed first. Storage device 72
Then, the data in the first packet buffer unit 60e may be sent to the storage device 72.

According to the above method, it is not necessary to rewrite the adaptation field (the first 2 bytes need to be rewritten because of length and data information, but after that, it becomes invalid data), so the rewriting information amount is reduced. As a result, the processing amount can be reduced. Further, if the first picture of the second packet is used as an adaptation field, the second picture is in the latter half of the packet, so that data movement is unnecessary and the processing amount can be further reduced.

Next, a flow chart for realizing the functions of the above embodiments will be described. FIG. 11 is a flowchart for realizing the functions of the above embodiments. When this flow chart is started, the following steps are performed.

Step S10: The packet data cutout unit 60a inputs the packet. Step S11: The copy control processing unit 60d determines whether or not the code remaining information is stored in step S23, which will be described later, and if it is stored, the step S2
4. If not, proceed to step S12.

Step S12: Descrambler & PE
The S-length replacement unit 60c detects a picture start code.

Step S13: Descrambler & PE
If the picture start code can be detected, the S-length replacing unit 60c proceeds to step S14, and otherwise proceeds to step S19.

Step S14: Copy control processing unit 60d
Performs a process of combining the first packet from the first half of the packet.

Step S15: Selected packet output unit 60
The g acquires the first packet combined in step S14 from the first packet buffer unit 60e and outputs it to the storage device 72.

Step S16: Copy control processing unit 60d
Inserts an adaptation field into the packet copied to the second packet buffer unit 60f to combine the second packet.

Step S17: Selected packet output unit 60
g acquires the second packet from the second packet buffer unit 60f and outputs it to the storage device 72.

Step S18: Copy control processing unit 60d
Outputs the index to the storage device 72.

Step S19: Descrambler & PE
The S-length replacing unit 60c determines whether or not the picture start code can only be detected halfway and cannot be determined. If the determination is not possible, the processing proceeds to step S21. Otherwise, the processing proceeds to step S20. move on.

Step S20: Selected packet output unit 60
g outputs the packet stored in the second packet buffer unit 60f to the storage device 72.

Step S21: Selected packet output unit 60
g outputs the packet stored in the second packet buffer unit 60f to the storage device 72.

Step S22: Copy control processing unit 60d
Converts the picture start code to "00-00-00" when the picture start code is "00-00-01".

Step S23: Copy control processing unit 60d
Saves the remaining code information. Step S24: The descrambler & PES long replacement unit 60c detects a picture start code.

Step S25: Descrambler & PE
If the S-length replacing unit 60c detects a picture start code, the process proceeds to step S26, and if not, the process proceeds to step S27.

Step S26: Copy control processing unit 60d
Outputs the index information to the storage device 72. Step S27: The copy control processing unit 60d determines whether or not there is an adaptation field, and if it exists, the process proceeds to step S32, and otherwise proceeds to step S28.

Step S28: Copy control processing unit 60d
Generates a packet including the start code in the first packet buffer unit 60e.

Step S29: Selected packet output unit 60
g acquires the first packet from the first packet buffer unit 60 e and outputs it to the storage device 72.

Step S30: Copy control processing unit 60d
By copying the packet to the second packet buffer unit 60f and inserting the adaptation field,
Generate a second packet.

Step S31: Selected packet output unit 60
g acquires the second packet from the second packet buffer unit 60f and outputs it to the storage device 72.

Step S32: Copy control processing unit 60d
Corrects the adaptation field of the packet stored in the second packet buffer unit 60f and adds the picture start code.

Step S33: Selected packet output unit 60
g acquires the packet to which the picture start code is added from the second packet buffer unit 60f and outputs it to the storage device 72.

According to the above processing, the function executed in the embodiment shown in FIG. 2 can be realized. In the embodiment shown in FIG. 2, only the descrambled code is stored. However, the system LSI may include a descrambler for another input, and the same scramble code may be stored. May be scrambled or may be scrambled by another method as a measure against copy guard, and in that case, it may be required to re-scramble and save.

However, in such a case, the packet output from the selected packet output section 60g will be re-scrambled. Even in such a case, the index information and the packet number will not be used. Correspondence is not lost, so you can scramble without problems.

Further, in the above embodiments, the MPEGII
Although the method has been described as an example, it goes without saying that the present invention is not limited to such a case. In short, it is applicable as long as it is a method in which different types of images may be stored in a single packet.

Further, in the above embodiments, the case where the image is specially reproduced by the hardware as shown in FIG. 2 has been described as an example, but the above processing functions can be realized by a computer. it can.

In that case, a program describing the processing contents of the functions that the image processing apparatus should have is provided. By executing the program on a computer, the above processing functions are realized on the computer. The program describing the processing content can be recorded in a computer-readable recording medium. Computer-readable recording media include magnetic recording devices, optical disks, magneto-optical recording media, semiconductor memories, and the like. The magnetic recording device includes a hard disk device (HDD), a flexible disk (FD), a magnetic tape, and the like. Optical discs include DVD (Digital Versatile Disk) and DVD-
RAM (Random Access Memory), CD-ROM (Compact
Disk Read Only Memory), CD-R (Recordable) / R
There is W (ReWritable). The magneto-optical recording medium has an MO
(Magneto-Optical disk).

In order to put the program into the market, for example, a DVD or a CD-ROM in which the program is recorded
Portable recording media such as. It is also possible to store the program in the storage device of the server computer and transfer the program from the server computer to another computer via the network.

The computer executing the program stores, for example, the program recorded in the portable recording medium or the program transferred from the server computer in its own storage device. Then, the computer reads the program from its own storage device and executes processing according to the program. The computer can also read the program directly from the portable recording medium and execute processing according to the program. In addition, the computer can also sequentially execute processing according to the received program each time the program is transferred from the server computer.

(Supplementary Note 1) An input for inputting a transport stream composed of a plurality of packets, and for inputting the transport stream in an image processing apparatus for performing a predetermined process on an image included therein. Means, detecting means for detecting a packet containing different types of image information among the packets forming the transport stream input from the input means, and a plurality of packets by the detecting means. An image processing apparatus comprising: a dividing unit that divides the packet into a plurality of packets when it is detected that the packet is included.

(Supplementary Note 2) Recording means for recording the packets divided by the dividing means and normal packets, and reproducing means for reading and reproducing the packets recorded in the recording means in a predetermined order are further included. The image processing device according to appendix 1, further comprising.

(Additional remark 3) The dividing unit divides the packet by generating a duplicate of the packet and converting information relating to an unnecessary image in each packet into an adaptation field. Image processing device.

(Supplementary Note 4) The supplementary means divides the packet by generating a duplicate of the packet and zero-stuffing the information portion relating to the unnecessary image in each packet. Image processing device.

(Supplementary Note 5) When the picture start code indicating the start of an image is included in two packets by being divided, the dividing means performs zero stuffing on the picture start code portion of the preceding packet. The packet of the picture start code and the adaptation field is inserted after the preceding packet, and the picture start code part of the following packet is converted into the adaptation field and output. Image processing device.

(Supplementary Note 6) When the picture start code indicating the start of an image is divided into two packets and included, the dividing means performs zero stuffing on the picture start code portion of the preceding packet. The image processing apparatus according to appendix 1, wherein when the rear packet includes an adaptation field, the portion is degenerated and a picture start code is inserted in an area generated by the degeneration. .

(Supplementary Note 7) In an image processing method for inputting a transport stream composed of a plurality of packets and performing a predetermined process on an image contained therein, an input for inputting the transport stream. Step, a detection step of detecting a packet containing different types of image information among the packets forming the transport stream input in the input step, and a plurality of packets by the detection step. And a dividing step of dividing the packet into a plurality of packets when it is detected that the packet is included in the image reproducing method.

(Supplementary Note 8) In a program that causes a computer to realize a function of inputting a transport stream composed of a plurality of packets and performing a predetermined process on an image included therein,
An input unit for inputting the transport stream, a detection unit for detecting a packet including different types of image information among the packets forming the transport stream input from the input unit, if any.
A program which, when the detecting means detects that a plurality of packets are included, causes the packet to function as a dividing means for dividing the packet into a plurality of packets.

[0141]

As described above, according to the present invention, a transport stream composed of a plurality of packets is input, and an image processing apparatus that performs a predetermined process on an image contained therein is used as a transport stream. The input means for inputting the port stream, the detecting means for detecting a packet containing different types of image information among the packets forming the transport stream input from the input means, and the detecting means. When it is detected that a plurality of packets are included, a dividing unit that divides the packet into a plurality of packets is provided, so that special playback without noise can be easily realized. Will be possible.

[Brief description of drawings]

FIG. 1 is a principle diagram illustrating an operation principle of the present invention.

FIG. 2 is a configuration example of an embodiment of the present invention.

FIG. 3 is a diagram showing an example of packet division in the embodiment shown in FIG.

FIG. 4 is a diagram illustrating an example of packet division and an example of trick play in the embodiment shown in FIG.

FIG. 5 is a diagram illustrating an outline of an operation when reverse reproduction is performed in the embodiment shown in FIG.

FIG. 6 is a diagram illustrating an example of an operation when data in which a picture start code spans two packets is input in the embodiment shown in FIG. 2;

FIG. 7 is a diagram illustrating an example of processing for a packet in which the first 3 bytes of a picture start code are stored.

FIG. 8 is a diagram illustrating an example of processing for a packet following FIG. 7.

FIG. 9 is a diagram illustrating an example of processing for a packet following FIG.

FIG. 10 is a diagram illustrating another packet division method.

FIG. 11 is a diagram for explaining a flowchart executed in the embodiment of the present invention shown in FIG.

FIG. 12 is a diagram showing a configuration example of a conventional MPEG playback device.

FIG. 13 is a diagram showing another configuration example of a conventional MPEG playback device.

[Explanation of symbols]

20 Image processing device 20a input means 20b detection means 20c dividing means 20d recording means 20e reproduction means 60 TS decoder 60a Packet data cutout unit 60b Packet control unit 60c descrambler & PES long replacement section 60d Copy control processing unit 60e First packet buffer unit 60f Second packet buffer unit 60g Select packet output unit 70 Video Decoder 71 television receiver 72 storage device 73 Packet Processor

Continued front page    F term (reference) 5C053 FA22 FA23 GB38 HA24 KA03                       KA24 LA07                 5C059 MA00 RB02 RB10 RC01 SS17                       TA00 TB00 TC00 TD11 UA05                       UA32 UA38                 5D044 AB07 BC01 CC04 FG24 GK11                 5K028 AA04 EE03 KK32

Claims (5)

[Claims] 1. An image processing apparatus for inputting a transport stream composed of a plurality of packets and performing a predetermined process on an image contained therein, comprising: input means for inputting the transport stream. Among the packets forming the transport stream input from the input means, if there is a packet containing different types of image information, a detection means for detecting this and a plurality of packets are included by the detection means. When it is detected that the packet is detected, the image processing device comprising: a dividing unit that divides the packet into a plurality of packets. 2. The recording medium further comprises: recording means for recording the packets divided by the dividing means and normal packets; and reproducing means for reading and reproducing the packets recorded in the recording means in a predetermined order. The image processing apparatus according to claim 1, wherein: 3. The image according to claim 1, wherein the dividing unit divides the packet by generating a duplicate of the packet and converting information regarding an unnecessary image in each packet into an adaptation field. Processing equipment. 4. The packet dividing unit according to claim 1, wherein the dividing unit divides the packet by generating a duplicate of the packet and zero-stuffing an information portion relating to an unnecessary image in each packet. Image processing device. 5. When the picture start code indicating the start of an image is included in two packets in a divided manner, the dividing means performs zero stuffing on the picture start code portion of the preceding packet. ,
2. The image processing according to claim 1, wherein a packet including a picture start code and an adaptation field is inserted after the preceding packet, and a picture start code portion of the succeeding packet is converted into an adaptation field and output. apparatus.