JPH08275111A - Encoding/decoding system for image information - Google Patents

Abstract

PURPOSE: To reduce waste in sub video data in terms of display space and display time. CONSTITUTION: A sub video packet is encoded by using packet header information PH including a time stamp expressing a reproduction start time of the sub video packet, sub video information 32 for the sub video image and including picture element data PXD compressed by a prescribed method, display control sequence information 33 including one display control sequence DCSQT or over to control the display order of the sub video image through the use of the sub video information 32, and sub video header information SPUH including the size of the sub video image packet and the location of the display control sequence information 33. The content of the encoded sub video packet is decoded at reproduction and displayed based on the display control sequence DCSQT.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an improvement in a system for encoding and decoding image information such as sub-pictures which are reproduced simultaneously with a main picture.

The present invention also relates to a data recording method and a recording medium for recording sub-video data supplied together with video data and simultaneously reproduced on a recording medium such as an optical disk.

[0003]

2. Description of the Related Art Sub-pictures superimposed on a main picture, such as images displayed as movie subtitles or TV volume setting values, can be roughly divided into two types: a character code method and a bitmap data method. Has been done.

[0004]

The character code system is a method in which a character such as a character or a pattern which is registered and prepared in advance is held in a character recording area of a character generator, and the code assigned to the character is stored in the character generator. This is given to display a desired character.

This system requires special hardware such as a character generator, but since a code is given to display the character, the bit map data of the character is sent as it is to the display system to display the sub-picture. , The amount of data to be sent to the display system can be small. However, since only characters that have been registered and prepared in advance can be displayed, the display application of the sub-picture by this method is limited.

On the other hand, in the case of the bitmap data system,
Since the bitmap data of the sub-picture is sent to the display system as it is, the dedicated hardware for generating the sub-picture from the code is not required. In addition, since the shape of the sub-picture that can be displayed is not limited, the display application of the sub-picture is expanded.

However, in this method, the color data of the sub-picture, the color data of the sub-picture contour necessary when superimposing the sub-picture on the main picture, and the superimposing mixture ratio data of the main picture and the sub-picture. Must be provided for each pixel, and the amount of data to be sent to the display system becomes enormous.

Further, generally, in the bitmap data method, data relating to all the pixels of the display screen (hereinafter referred to as a frame) is sent to the display system regardless of the size of the sub-picture, so that the display space is limited. There is a lot of useless data (see FIG. 50).

In both the character code system and the bit map data system, even if the shape of the sub-picture being displayed does not change, the sub-picture data is basically given every display frame period. This must be continued, and there is a lot of wasted data in terms of display time (see FIG. 51).

The present invention has been made to solve the above-mentioned problems, and can significantly reduce the waste of display space and the waste of display time of sub-picture data, and further, the freedom of sub-picture expression. It is an object of the present invention to provide an image information encoding / decoding system which is excellent and can secure a wide range of sub-picture use applications.

[0011]

In order to achieve the above object, according to the first invention, a data recording method of packetizing main video data and sub video data which can be simultaneously reproduced in a predetermined unit and recording them in a recording medium. In at least the packet header information (PH) including the reproduction start time of the sub-picture data packet expressed using the reference time, the sub-picture data (PXD) which is the display content of the sub-picture, and the sub-picture data. One or more display control sequence information (DCSQ) indicating a control procedure for displaying the sub-picture using
T) and sub-picture header information (SPUH) including the size of the sub-picture data packet and the recording position of the display control sequence information make up the sub-picture packet.

In the second invention, sub-picture data for a plurality of channels that can be simultaneously reproduced together with the main picture data is packetized in a predetermined unit, and a plurality of data packets of a channel selected from the plurality of channels are packetized. In a data recording method for recording as a sub-picture data block on a recording medium, at least packet header information (PH) including a reproduction start time of the sub-picture data packet expressed using a reference time, and a sub-picture display. The sub-picture data (PXD) which is the content, one or more display control sequence information (DCSQT) indicating a control procedure for displaying the sub-picture using the sub-picture data, the size of the sub-picture data packet, and The sub-picture header information (SPUH) including the recording position of the display control sequence information and the sub-picture part Configure Tsu bets; and reproduction time of the sub-picture data packets in the packet header information (PTS) is recorded only to the top of the sub-picture data packets of the sub-picture data block.

According to a third invention, in the first or second invention, at least the display start time and the display end time of the sub-picture, the recording position of the sub-picture data to be displayed, and the recording position are recorded at this recording position. Display control information group for the sub-picture data and the display control sequence information (see FIG. 3).
3 DCSQ).

In a fourth aspect based on the third aspect, the display start time and display end time of the sub-picture are defined by relative time from the reproduction start time of the sub-picture data packet.

In the fifth aspect of the invention, as the display control information of the third aspect of the invention, the control for starting the display of the sub-picture data is performed based on the display start time included in the display control sequence information. Display start control information (Fig. 3
4 STADSP) is recorded.

In the sixth aspect of the invention, as the display control information of the third aspect of the invention, the control for terminating the display of the sub-picture data is performed based on the display end time included in the display control sequence information. Display end control information (Fig. 3
4 STPDSP) is recorded.

In the seventh invention, as the display control information of the third invention, color setting information (SETCOLOR in FIG. 34) for setting a color for each pixel type of the sub-picture data.
Is recorded.

In the eighth invention, as the display control information of the third invention, mixture ratio setting information (SETCONTR in FIG. 34) for setting a mixture ratio of the sub-picture data with respect to the main picture for each pixel type. Is recorded.

In the ninth invention, as the display control information of the third invention, display area setting information (SE in FIG. 34) for setting a display area of the sub-picture data on the main picture.
TDAREA) is recorded.

In the tenth invention, as the display control information of the third invention, use range setting information for setting a range to be used for display in the sub-picture data (S in FIG. 34).
ETDSPXA) is recorded.

In the eleventh invention, as the display control information of the third invention, a color change of each pixel type of the sub-picture data and a mixture ratio of the sub-picture data to the main picture for each pixel type. Color / mixing ratio change setting information (CHGCOLCO in FIG. 34) for setting changes in pixel units.
N) is recorded.

In the twelfth invention, as the display control information of the third invention, display control end setting information (CMD in FIG. 34) for setting the end of the display control of the sub-picture data.
END) is recorded.

In the thirteenth invention, in the recording medium in which the sub-picture data which can be simultaneously reproduced together with the main picture data is packetized and recorded in a predetermined unit, the recorded data packet uses at least the reference time. Packet header information (PH) including the reproduction start time of the expressed sub-picture data packet, sub-picture data (PXD) which is the display content of the sub-picture, and for displaying the sub-picture using this sub-picture data And one or more pieces of display control sequence information (DCSQT) indicating the control procedure of (1), and sub-picture header information (SPUH) including the size of the sub-picture data packet and the recording position of the display control sequence information.

In the fourteenth invention, sub-picture data for a plurality of channels that can be simultaneously reproduced together with the main picture data is packetized in a predetermined unit, and a plurality of data packets of a channel selected from the plurality of channels. In a recording medium in which is recorded as one sub-picture data block, the recorded data packet includes packet header information (PH) including at least a reproduction start time of the sub-picture data packet expressed using a reference time. Sub-picture data (PXD) which is the display content of the sub-picture, and one or more display control sequence information (DCSQT) indicating a control procedure for displaying the sub-picture using the sub-picture data.
And sub-picture header information (SPUH) including the size of the sub-picture data packet and the recording position of the display control sequence information, and the reproduction time (PT) of the sub-picture data packet in the packet header information.
S) is recorded only for the first sub-picture data packet in the sub-picture data block.

According to the present invention, use of one or more pieces of display control sequence information (DCSQT) can significantly reduce display space waste and display time waste of the sub-picture data, and at the same time as the bit map data method. The freedom of sub-picture expression can be obtained, and a wide range of sub-picture applications can be secured.

That is, according to the present invention, use range setting information (SETDSPXA) for setting a range to be used for display in the sub-picture data is provided, and data other than the use range is not displayed, so that one frame is displayed. It is possible to significantly reduce display space waste of the data amount that occurs when all the data is sent to the display system.

Further, in the present invention, the color setting information (SETCOLOR) and the mixture ratio setting information (SETCONTR) for each pixel type such as the pattern pixel, the trimming, and the background of the sub-picture data are provided, and the sub-picture display data is sub-picture data. By providing only the shape information of the video image, it is possible to guarantee the same sub-video shape representation with a smaller amount of data, as compared with the conventional method in which the color information and the mixing ratio information are provided for each pixel.

Further, according to the present invention, the color / mixing ratio change setting information for setting the change of the color of the sub-picture data for each pixel type and the change of the mixture ratio of the sub-picture data for the main image for each pixel type in pixel units. Since (CHGCOLCON) is provided, the dynamic display of the sub-picture can be realized with the same accuracy as that of the conventional bitmap data method and with a smaller data amount than the bitmap data method.

It is rare that the color information of each sub-picture changes in each pixel, and there is no fear that the data amount of the color / mixing ratio change setting information itself becomes excessive.

Further, according to the present invention, even if the color of the sub-picture image changes, the sub-picture can be displayed over the display time of a plurality of frames using the same sub-picture data as long as the shape does not change. Therefore, it is possible to significantly reduce the waste of display time of the sub-picture data as compared with the conventional method in which the sub-picture data must be continuously supplied to the display system at the frame cycle regardless of the color / shape change.

[0031]

DESCRIPTION OF THE PREFERRED EMBODIMENTS An image information encoding / decoding system according to an embodiment of the present invention will be described below with reference to the drawings. In order to avoid duplicate explanation,
Common reference numerals are used for parts that are functionally common to a plurality of drawings.

1 to 59 are views for explaining an image information encoding / decoding system according to an embodiment of the present invention.

FIG. 1 schematically shows a recording data structure of an optical disc OD as an example of an information holding medium to which the present invention can be applied.

This optical disk OD has, for example, about 5 per side.
A double-sided bonded disc with a storage capacity of G bytes,
A large number of recording tracks are arranged between the lead-in area on the inner side of the disc and the lead-out area on the outer side of the disc. Each track is composed of a large number of logical sectors, and various information (appropriately compressed digital data) is stored in each sector.

FIG. 2 exemplifies the data structure of a video file recorded on the optical disc OD of FIG.

As shown in FIG. 2, this video file includes file management information 1 and video data 2. The video data 2 includes a video data block, an audio data block, a sub-video data block, and information (DS) necessary for controlling reproduction of these data.
I: Disk Search Information). Each block is divided into packets each having a constant data size for each data type, for example. The video data block, audio data block, and sub-picture data block are reproduced in synchronization with each other based on the DSI arranged immediately before these block groups.

That is, a system area for storing system data used in the disk OD, a volume management information area, and a plurality of file areas are formed in the aggregate of the plurality of logical sectors in FIG.

Of the plurality of file areas, for example, file 1 has main video information (VIDEO in the figure) and sub-video information (S in the figure) having auxiliary contents to the main video.
UB-PICTURE), audio information (AUDI in the figure)
O), reproduction information (PLAYBACK INF in the figure)
O. ) Etc. are included.

FIG. 3 shows an example of the logical structure of a pack of encoded (run-length compressed) sub-picture information in the data structure shown in FIG.

As shown in the upper part of FIG. 3, one pack of sub-picture information included in the video data is composed of, for example, 2048 bytes (2 kB). This one pack of sub-picture information includes one or more sub-picture packets after the header of the first pack. The first sub-picture packet includes run-length compressed sub-picture data (SP DATA1) after the header of the packet. Similarly,
The second sub-picture packet includes run-length compressed sub-picture data (SP DA) after the header of the packet.
TA2) is included.

A plurality of such sub-picture data (SP D
A sub-picture unit header 31 is attached to a sub-picture data unit 30 that is a collection of one unit (one unit) of run-length compression of ATA1, SP DATA2, ... After this sub-picture unit header 31, 1
Video data for a unit (for example, 1 of 2D display screen)
Pixel data 32 obtained by run-length compression of horizontal line data) and a table 33 containing display control sequence information of each sub-picture pack follow.

In other words, the run length compressed data 30 for one unit is the sub-picture data portion (SP DATA1, SP DATA2, ...) Of one or more sub-picture packets.
It is formed of a group of. The sub-picture data unit 30 includes a sub-picture unit header SPUH31 in which various parameters for sub-picture display are recorded, and display data (compressed pixel data) PX including run-length codes.
D32 and display control sequence table DCSQT33
It consists of and.

FIG. 4 illustrates a part of the contents of the sub-picture unit header 31 of the run-length compressed data 30 for one unit illustrated in FIG. 3 (see FIG. 31 for other parts of the SPUH31). . Here, the data of the sub-picture (for example, the subtitle corresponding to the scene of the movie of the main picture) that is recorded / transmitted (communicated) together with the main picture (for example, the picture body of the movie) will be described.

As shown in FIG. 4, the sub-picture unit header SPUH31 has sub-picture pixel data (display data).
32 start address SPDD ADR and pixel data 32
End address SPED ADR and T of pixel data 32
The display size on the V screen, that is, the display start position and display range (width and height) SPDSZ, and the recording start position SPDCSQTA of the display control sequence table 33 in the sub-picture data packet are recorded.

In some cases, SPUH31
Background color SPCHI specified by the system, sub-picture color SPCINFO specified by the system, and palette color number SPADJINF of the emphasis color specified by the system
O and modification information SPMOD of the sub-picture pixel data 32,
Mixing ratio SPC of sub-picture (SP) to main picture (MP)
The ONT, the start timing of the sub-picture (corresponding to the frame number of the main picture) SPDST, and the start addresses SPLine1 to SPlineN of the decoded data for each line may be recorded.

In the preferred embodiment of the present invention, the start addresses SPLine1 to SPlineN of the decoded data for each line are not included in the SPUH31 but are provided for each of a plurality of sub-picture fields.

More specifically, in the sub-picture unit header SPUH31, as shown in FIG. 4, various parameters (SPDDADR, etc.) having the following contents are recorded: (1) Following this header Start address information (SPDD ADR: relative address from the beginning of the header) of display data (sub-picture pixel data); (2) End address information (SPEDA) of this display data
DR: Relative address from the beginning of the header); (3) Information (SP) indicating the display start position and display range (width and height) of this display data on the monitor screen.
(4) Recording start position information (display control sequence table start address SPDCSQTA of sub-picture) of the display control sequence table 33 in the packet.

Also, in one of various possible embodiments of the present invention, the sub-picture unit header SPUH31.
May include the following: (5) Information (SPCH) indicating the background color (number of 16-color palette set in story information table or display control sequence table) specified by the system.
I) and; (6) Information (SPC) indicating the sub-picture color designated by the system (number of 16-color palette set in story information table or display control sequence table)
(INFO) and; (7) Information (SPAJ) indicating the sub-picture emphasis color designated by the system (color palette number set in the story information table or display control sequence table)
(8) Sub-picture image mode information (SPMOD) designated by the system and indicating a non-interlaced field mode or interlaced frame mode, etc. (the pixel data to be compressed is composed of various numbers of bits) In this case, the number of bits of pixel data can be specified by the contents of this mode information.): (9) Information (SPCONT) indicating the mixture ratio of the sub-picture and the main picture designated by the system; (10) ) Information (SPDST) indicating the display start timing of the sub video by the frame number of the main video (for example, the I picture frame number of MPEG); (11) Start of encoded data of the first line to the Nth line of the sub video Information (SPlin1 to SPlin) indicating an address (relative address from the beginning of the sub-picture unit header)
N).

The information SPCONT indicating the mixing ratio of the sub-picture and the main picture is, for example, (system setting value) /
16 or (system setting value) / 255 represents the mixture ratio of the sub-picture, and (16-setting value) / 16 or (255
-Set value) / 255 represents the mixing ratio of the main image.

In the sub-picture unit header 31 (or each sub-picture field), the start address (SPLine1 to SPlineN) of the decoded data for each line.
Exists. Therefore, the decoding start line is specified by the microcomputer (MPU or CP) on the decoder side.
U) or the like makes it possible to realize scrolling of only the sub-picture on the display screen.
(This scroll will be described later with reference to FIG. 21.) By the way, according to the embodiment of the present invention, the sub-picture unit header 31 corresponds to how the sub-picture corresponds to the TV field / frame of the NTSC system. It is possible to record a field / frame mode (SPMOD) indicating whether to perform.

Normally, bit "0" is written in this field / frame mode recording section (SPMOD). On the decoder side receiving such a sub-picture data unit 30, it is determined by the bit “0” that the frame mode (non-interlace mode) is set,
The received code data is decoded line by line. Then, the decoded image as illustrated in the lower left of FIG. 8 is output from the decoder and displayed on a display screen such as a monitor or a television (TV).

On the other hand, when the bit "1" is written in the field / frame mode recording section (SPMOD), the decoder side determines that the field mode (interlace mode) is set. In this case, after the coded data is decoded line by line, the same data is continuously output for two lines as illustrated in the lower right part of FIG. Then, a screen corresponding to the interlaced mode of the TV is obtained. As a result, the image quality becomes rougher than in the frame mode (non-interlace mode), but it is possible to display an image with the same amount of data as in the frame mode and twice as much.

The pixel data (run length data) 32 of the sub-picture shown in FIG. 3 or FIG. 4 is based on any of the run length compression rules 1 to 6 or the run length compression rules 11 to 15 shown in FIG. 5 or 6. Depending on what is applied
The data length of one unit (variable length) is determined. Then, encoding (run length compression) and decoding (run length expansion) are performed with a fixed data length.

Rules 1 to 6 in FIG. 5 are used when the pixel data to be compressed has a multi-bit structure (here, 2 bits), and rules 11 to 15 in FIG. 6 are pixel data to be compressed having a 1-bit structure. Is used when

Which of the run length compression rules 1 to 6 or the run length compression rules 11 to 15 is used is the content of the parameter SPMOD in the sub-picture unit header 31 (see near the center of the table in the lower part of FIG. 4). (Bit width flag etc.). For example, if the bit width flag of the parameter SPMOD is "1", the run-length compression target pixel data is 2-bit data, and rules 1 to 6 in FIG. 5 are used. On the other hand, when the bit width flag of the parameter SPMOD is "0", the run-length compression target pixel data is 1-bit data, and the rules 11 to 15 in FIG. 6 are used.

When the pixel data can have a 1, 2, 3 or 4 bit configuration, four types of compression rule groups A, B, C and D are prepared corresponding to these bit configuration values. Suppose In this case, the parameter SPMOD
Is used as a 2-bit flag, 1-bit pixel data that uses rule group A is specified by flag “00”, 2-bit pixel data that uses rule group B is specified by flag “01”, and rule is set by flag “10”. The 3-bit pixel data using the group C can be specified, and the 4-bit pixel data using the rule group D can be specified by the flag “11”. Here, the rules 11 to 15 of FIG. 6 can be used for the compression rule group A, and the compression rule B
The rules 1 to 6 in FIG. The compression rule groups C and D are obtained by appropriately changing the coding header, the number of continuous pixels, the constituent bit value of pixel data and the number of rules in FIG.

FIG. 5 shows a case where the sub-picture pixel data (run length data) 32 portion illustrated in FIG. 4 is composed of a plurality of bits (here, 2 bits) of pixel data.
The run length compression rules 1 to 6 adopted in the encoding method according to the embodiment of the present invention will be described.

Further, FIG. 9 shows that when the sub-picture pixel data (run length data) 32 part illustrated in FIG. 4 is composed of 2-bit pixel data, the above compression rules 1 to
It is a figure for demonstrating 6 concretely.

According to the rule 1 shown in the first column of FIG. 5, when 1 to 3 identical pixels continue, 4-bit data constitutes one data unit of encoding (run length compression). In this case, the first 2 bits represent the number of continuous pixels, and the subsequent 2 bits represent pixel data (pixel color information, etc.).

For example, the first compressed data unit CU01 of the uncompressed video data PXD shown in the upper part of FIG.
Two pieces of 2-bit pixel data d0, d1 = (0000) b
Is included (b indicates that it is binary). In this example, two pieces of the same 2-bit pixel data (00) b continue (continue).

In this case, as shown in the lower part of FIG. 9, d0 and d1 = (1000) b are obtained by connecting the 2-bit display (10) b of the continuation number "2" and the content (00) b of the pixel data. ,
It becomes the data unit CU01 * of the compressed video data PXD.

In other words, according to Rule 1, the data unit C
(0000) b of U01 is (1) of the data unit CU01 *.
000) b. In this example, compression of a substantial bit length is not obtained, but for example, the same pixel (00)
If CU01 = (000000) b in which three b are consecutive, CU01 * = (1100) b after compression, which is 2
A bit compression effect is obtained.

According to Rule 2 shown in the second column of FIG. 5, when 4 to 15 identical pixels continue, one unit of encoded data is constituted by 8-bit data. In this case, the first 2 bits represent a coding header indicating that it is based on Rule 2, followed by 4
Bits represent the number of continuous pixels, and the subsequent 2 bits represent pixel data.

For example, the second compressed data unit CU02 of the uncompressed video data PXD shown in the upper part of FIG.
Is five pieces of 2-bit pixel data d2, d3, d4, d
5, d6 = (0101010101) b is included.
In this example, the same 2-bit pixel data (01) b is 5
It is continuous (continuous).

In this case, as shown in the lower part of FIG. 9, the coding header (00) b, the 4-bit display (0101) b of the continuation number "5", and the content (01) b of the pixel data are connected. d2-d6 = (00010101) b becomes the data unit CU02 * of the compressed video data PXD.

In other words, according to rule 2, the data unit C
(021010101) b (10-bit length) of U02
Is (00010101) b (8 in the data unit CU02 *
Bit length). In this example, the effective bit length compression is only 2 bits from 10 bits to 8 bits, but when the number of continuations is 15 (30 bits length because 15 01s in CU02 are consecutive), this is 8 bits. Compressed data (CU02 * = 00111101) of
A compression effect of 22 bits is obtained with respect to 30 bits.
That is, the bit compression effect based on rule 2 is larger than that based on rule 1. However, Rule 1 is also required to support run-length compression of fine images with high resolution.

According to Rule 3 shown in the third column of FIG. 5, if 16 to 63 identical pixels continue, 12-bit data constitutes one unit of encoded data. In this case, the first 4 bits represent the coding header indicating that it is based on Rule 3, the subsequent 6 bits represent the number of continuous pixels, and the subsequent 2 bits represent the pixel data.

For example, the third compressed data unit CU03 of the video data PXD before compression shown in the upper part of FIG.
Is 16 pieces of 2-bit pixel data d7 to d22 = (10
1010 ... 1010) b is included. In this example, 16 pieces of the same 2-bit pixel data (10) b continue (continue).

In this case, as shown in the lower part of FIG. 9, the coded header (0000) b, the 6-bit display (010000) b of the continuation number "16", and the content (10) b of the pixel data.
D7 to d22 = (000000100001)
0) b is a data unit CU of the compressed video data PXD
It becomes 03 *.

In other words, the data unit C according to Rule 3
(101010 ......... 1010) b (32-bit length) of U03 is (000001000) of the data unit CU03 *.
010) b (12-bit length). In this example, the substantial bit length compression is 20 bits from 32 bits to 12 bits, but the number of continuations is, for example, 63 (CU0
In the case of 126 bits, since 10 of 3 are 63 consecutive, this is 12 bits of compressed data (CU03 * = 00).
0011111110), a compression effect of 114 bits can be obtained with respect to 126 bits. That is, the bit compression effect based on rule 3 is larger than that based on rule 2.

According to the rule 4 shown in the fourth column of FIG. 5, if 64 to 255 identical pixels continue, 16-bit data constitutes one unit of encoded data. In this case, the first 6 bits represent a coding header indicating that it is based on rule 4,
The subsequent 8 bits represent the number of continuous pixels, and the subsequent 2 bits represent pixel data.

For example, the fourth compressed data unit CU04 of the video data PXD before compression shown in the upper part of FIG.
Is 69 2-bit pixel data d23 to d91 = (1
11111 ... 1111) b is included. In this example, 69 pieces of the same 2-bit pixel data (11) b continue (continue).

In this case, as shown in the lower part of FIG. 9, the encoded header (000000) b, the 8-bit display (00100101) b of the continuation number "69", and the content (11) b of the pixel data are connected. d23 to d91 = (000000
0010010111) b is the compressed video data PX
It becomes the data unit CU04 * of D.

In other words, according to Rule 4, the data unit C
(111111 ......... 1111) b (138 bit length) of U04 is (00000000) of the data unit CU04 *.
10010111) b (16-bit length).
In this example, the substantial bit length compression amount is 122 bits from 138 bits to 16 bits, but the number of continuations is, for example, 255 (since 11 of CU01 are 255 consecutive, 51
In the case of 0 bit length), this becomes 16-bit compressed data (CU04 * = 00000011111111111), and a compression effect of 494 bits is obtained for 510 bits. That is, the bit compression effect based on Rule 4 is
Greater than that of Rule 3.

According to the rule 5 shown in the fifth column of FIG. 5, when the same pixel continues from the switching point of the encoded data unit to the end of the line, 16-bit data constitutes one unit of encoded data. In this case, the first 14 bits represent the coding header indicating that it is based on Rule 5, and the subsequent 2 bits represent the pixel data.

For example, the fifth compressed data unit CU05 of the video data PXD before compression shown in the upper part of FIG.
Is one or more 2-bit pixel data d92 to dn = (0
000000 ... 0000) b is included. In this example, a finite number of the same 2-bit pixel data (00) b are continuous (continuous), but in the rule 5, the number of continuous pixels may be one or more.

In this case, as shown in the lower part of FIG. 9, the coding header (0000000000000000) b and the content (00) b of the pixel data are connected to each other, d92 to dn = (0
000000000000) b is the data unit CU05 * of the compressed video data PXD.

In other words, according to rule 5, the data unit C
(000000 ......... 0000) b (unspecified bit length) of U05 is (00000000) of the data unit CU05 *.
00000000) b (16-bit length).
In rule 5, the number of continuous same pixels up to the line end is 16
A compression effect can be obtained if the bit length or more.

According to Rule 6 shown in the sixth column of FIG. 5, the length of the compressed data PXD for one line is not an integral multiple of 8 bits when one pixel line in which the data to be encoded is lined up is finished (ie, In the case of non-byte alignment), 4-bit dummy data is added so that the compressed data PXD for one line becomes a byte unit (that is, byte aligned).

For example, the data units CU01 * to CU05 * of the compressed video data PXD shown in the lower part of FIG.
The total bit length of is always an integral multiple of 4 bits, but is not necessarily an integral multiple of 8 bits.

For example, data units CU01 * to CU05
If the total bit length of * is 1020 bits and there is a shortage of 4 bits for byte alignment, as shown in the lower part of FIG. 9, 4-bit dummy data CU06 * =
Byte-aligned 1024-bit data unit CU0 by adding (0000) b to the end of 1024 bits
Outputs 1 * to CU06 *.

The 2-bit pixel data is not always 4
The type of pixel color is not limited to that displayed. For example, the pixel data (00) b represents the background pixel of the sub-picture,
Pixel data (01) b represents a sub-picture pattern pixel,
Pixel data (10) b represents the first emphasized pixel of the sub-picture,
The pixel data (11) b may represent the second emphasized pixel of the sub-picture.

If the number of bits constituting the pixel data is larger, another type of sub-picture pixel can be designated. For example, when the pixel data is composed of 3-bit (000) b to (111) b, a maximum of eight types of pixel colors + in the sub-picture data to be run-length encoded / decoded +
It becomes possible to specify the pixel type (enhancement effect).

FIG. 6 is used in an encoding method according to another embodiment of the present invention when the sub-picture pixel data (run length data) 32 portion illustrated in FIG. 4 is composed of 1-bit pixel data. The run length compression rules 11 to 15 will be described.

According to the rule 11 shown in the first column of FIG. 6, when 1 to 7 identical pixels continue, one data unit of encoding (run length compression) is constituted by 4-bit data. In this case, the first 3 bits represent the number of consecutive pixels, and the subsequent 1 bit represents pixel data (pixel type information, etc.). For example, if the 1-bit pixel data is "0", it indicates the background pixel of the sub-picture, and if it is "1", it indicates the pattern pixel of the sub-picture.

According to the rule 12 shown in the second column of FIG. 6, when 8 to 15 identical pixels continue, one unit of encoded data is formed by 8-bit data. In this case, the first 3 bits represent a coding header (for example, 000) indicating that it is based on rule 12, the subsequent 4 bits represent the number of continuous pixels, and the subsequent 1 bit represents pixel data.

According to the rule 13 shown in the third column of FIG. 6, if 16 to 127 identical pixels continue, 12-bit data constitutes one unit of encoded data. In this case, the first 4
A bit represents a coded header (for example, 0000) indicating that it is based on Rule 13, the following 7 bits represent the number of continuous pixels, and the subsequent 1 bit represents pixel data.

According to the rule 14 shown in the fourth column of FIG. 6, when the same pixel continues from the switching point of the encoded data unit to the end of the line, one unit of encoded data is constituted by 8-bit data. In this case, the first 7 bits are rule 1
A coded header that indicates that it is based on 4 (for example, 0000
000), and the subsequent 1 bit represents pixel data.

According to rule 15 shown in the fifth column of FIG. 6, the length of the compressed data PXD for one line is not an integral multiple of 8 bits at the time when one pixel line in which the data to be encoded is lined up is finished (that is, In the case of non-byte alignment), 4-bit dummy data is added so that the compressed data PXD for one line becomes a byte unit (that is, byte aligned).

Next, the image encoding method (encoding method using run-length compression encoding) will be specifically described with reference to FIG.

FIG. 7 shows that the pixel data forming the sub-picture pixel data (run length data) 32 illustrated in FIG.
For example, it is composed of the 1st to 9th lines and 2
Pixels having bit configurations (having a maximum of four types of contents) are lined up, and character patterns "A" and "B" are represented by 2-bit pixels on each line. In this case, how the pixel data of each line is encoded (run length compression) will be specifically described.

As illustrated in the upper part of FIG. 7, the source image is composed of three types (up to four types) of pixel data. That is, the 2-bit image data (00) b indicates the pixel color of the background of the sub-picture, the 2-bit image data (01) b indicates the pixel colors of the characters "A" and "B" in the sub-picture, The emphasized pixel color for the sub-picture characters "A" and "B" is indicated by the 2-bit image data (10) b.

When the original image including the characters "A" and "B" is scanned by a scanner or the like, these character patterns are read pixel by pixel from left to right for each scanning line. The video data thus read is input to an encoder (200 in the embodiment shown in FIG. 10 described later) that performs run-length compression according to the present invention.

This encoder uses the rule 1 described in FIG.
~ Microcomputer (MPU or C that runs software that executes run-length compression based on Rule 6)
PU). This encoder software will be described later with reference to the flowcharts of FIGS. 13 and 14.

The encoding process for run-length compressing the sequential bit strings of the character patterns "A" and "B" read in pixel units will be described below.

In the example of FIG. 7, it is assumed that the source image has three pixel colors. Therefore, the video data to be encoded (sequential bit strings of the character patterns "A" and "B") has the background pixel color. “•” is set to 2-bit pixel data (0
0) b, the character pixel color “#” is represented by 2-bit pixel data (01) b, and the emphasized pixel color “o” is represented by 2-bit pixel data (10) b. This pixel data (00,
The number of bits (= 01, etc.) (= 2) is sometimes called the pixel width.

For the sake of simplicity, in the example of FIG. 7, the display width of the encoding target video data (sub-video data) is 16 pixels, and the number of scanning lines (display height) is 9 lines.

First, the pixel data (sub-picture data) obtained from the scanner is once converted into a run length value before compression by the microcomputer.

That is, taking the first line in the upper part of FIG. 7 as an example, three consecutive images "..." are converted into (. * 3) and one subsequent "o" is converted into (o * 1), one subsequent “#” is converted to (# * 1), one subsequent “o” is converted to (o * 1), and the subsequent triple image “• .. "is converted to (. * 3), one subsequent" o "is converted to (o * 1), and the four consecutive images"##
## "is converted to (## 4), and one" o "after that is converted.
Is converted to (o * 1), and the last single "・" is (・ *
Converted to 1).

As a result, as shown in the middle part of FIG. 7, the run length data before compression of the first line is ". * 3 / o *".
1 / # * 1 / o * 1 / ・ * 3 / o * 1 / # * 4 / o * 1
/ ・ * 1 ”. This data is composed of a combination of image information such as a character pixel color and the number of consecutive pixels indicating the number of consecutive pixels.

Similarly, the pixel data strings on the 2nd to 9th lines in the upper part of FIG. 7 become the pre-compression run length data strings as shown on the 2nd to 9th lines in the middle part of FIG.

Here, paying attention to the data of the first line, the compression rule 1 of FIG. 5 is applied because three background pixel colors "." Continue from the start of the line. As a result, the first "..." on the first line, ie, (* 3)
Is 2 bits (11) representing "3" and the background pixel color "."
Is encoded as (1100) in combination with (00).

Since the next data on the first line has one "o", rule 1 is still applied. As a result, the next [o] on the first line, that is, (o * 1), represents 2
It is encoded into (0110) which is a combination of the bit (01) and (10) representing the emphasized pixel color “o”.

Further, since the next data has one "#", the rule 1 is applied. As a result, the next [#] on the first line, that is, (# * 1), is a combination of 2 bits (01) representing "1" and (01) representing the character pixel color "#" into (0101). Encoded. (The part related to # is shown surrounded by broken lines in the middle part and the lower part of FIG. 7.) Similarly, (o * 1) is encoded into (0110), and (. * 3) is (1100). Encoded to (o
* 1) is encoded as (0110).

Since the data after the first line has four "#" s, the compression rule 2 of FIG. 5 is applied. As a result, this [#] on the first line, that is, (# * 4), is a 2-bit header (00) indicating that rule 2 has been applied.
And 4 bits (0100) representing the number of continuous pixels “4”,
Combined with (01), which represents the character pixel color "#" (0
0001001). (The part related to # is shown surrounded by a broken line.) Since the data after the first line is one "o", rule 1 is applied. As a result, this [o], that is, (o * 1) is a combination of 2 bits (01) representing "1" and (10) representing the emphasized pixel color "o" (011).
0) is encoded.

Since the last data on the first line has one ".", Rule 1 is applied. As a result, this [•], that is, (• * 1), is a combination of 2 bits (01) representing “1” and (00) representing the background pixel color “•” (01).
00) is encoded.

As described above, the pre-compression run length data of the first line "* 3 / o * 1 / # * 1 / o * 1 /
* 3 / o * 1 / # * 4 / o * 1 / * 1 ”is (11
00) (0110) (0101) (0110) (110
0) (0110) (00010001) (0110)
The run length compression is performed as in (0100), and the encoding of the first line ends.

In the same manner, the encoding proceeds up to the 8th line. In the ninth line, all the one lines are occupied by the same background pixel color ".". In this case,
The compression rule 5 is applied. As a result, the pre-compression run length data “· * 16” on the 9th line indicates that the same background pixel color “·” continues to the line end 1
4-bit header (0000000000000000)
And 2-bit pixel data (0
16 bit (0000000) in combination with
It is encoded to (000000000000).

The encoding based on the above rule 5 is
It is also applied when the data to be compressed starts in the middle of the line and continues to the end of the line.

FIG. 10 explains the flow from mass production to reproduction on the user side of a high density optical disc having image information (31 + 32 + 33 in FIG. 3) encoded according to the present invention; and encoded according to the present invention. Broadcast / cable distribution of image information to users /
It is a block diagram explaining the flow up to reception / reproduction in the subscriber.

When the pre-compression run length data as shown in the middle part of FIG. 7 is input to the encoder 200 of FIG. 10, the encoder 200 is input by software processing based on the compression rules 1 to 6 of FIG. 5, for example. The run data is run length compressed (encoded).

When data having a logical structure as shown in FIG. 2 is recorded on the optical disc OD as shown in FIG.
The run length compression processing (encoding processing) by the encoder 200 of 0 is performed on the sub-picture data of FIG.

Various data necessary for completing the optical disc OD is also input to the encoder 200 of FIG. These data are, for example, MPEG (Mortion).
The digital data is compressed according to the standard of Picture Expert Group) and the compressed digital data is laser cutting machine 202.
Or sent to modulator / transmitter 210.

In the laser cutting machine 202, MPEG compressed data from the encoder 200 is cut on a mother disk (not shown) to manufacture the optical disk master 204.

Mass production equipment for high density optical disc 20
In 6, the master information is transferred to a laser light reflection film on a polycarbonate substrate having a thickness of 0.6 mm, using the master 204 as a template. A large amount of two polycarbonate substrates to which different master information is transferred are stuck together to form a 1.2-mm-thick double-sided optical disc (or a single-sided read double-sided disc).

The laminated high-density optical disc OD mass-produced by the equipment 206 is distributed to various markets and reaches the user's hand.

The distributed disc OD is reproduced by the reproducing device 300 of the user. The device 300 includes a decoder 101 that restores the data encoded by the encoder 200 to the original information. The information decoded by the decoder 101 is sent to, for example, the monitor TV of the user and visualized. In this way, the end user can watch the original video information from the mass-distributed discs OD.

On the other hand, the compression information sent from the encoder 200 to the modulator / transmitter 210 is modulated according to a predetermined standard and then sent. For example, compressed video information from encoder 200 is satellite broadcast (212) along with corresponding audio information. Alternatively, the compressed video information from encoder 200 is cable transmitted (212) with the corresponding audio information.

The compressed video / audio information broadcast or cable-transmitted is received by the receiver / demodulator 400 of the user or subscriber. The receiver / demodulator 400 includes a decoder 101 that restores the data encoded by the encoder 200 to the original information. Decoder 101
The information decoded by, for example, the user's monitor TV
Sent to and visualized. In this way, the end user can watch the original video information from the compressed video information broadcast or cable transmitted.

FIG. 11 is a block diagram showing an embodiment (non-interlaced specification) of decoder hardware for executing image decoding (run length expansion) according to the present invention. Run length compressed sub-picture data SP
Decoder 1 for decoding D (corresponding to data 32 in FIG. 3)
01 (see FIG. 10) can be configured as in FIG.

A sub-picture data decoder for run-length expanding a signal containing run-length compressed pixel data in the format shown in FIG. 4 will be described below with reference to FIG.

As shown in FIG. 11, the sub-picture decoder 101 uses the data I / I to which the sub-picture data SPD is input.
O102 and memory 10 for storing sub-picture data SPD
8; a memory control unit 105 for controlling the read / write operation of the memory 108; a continuous code length of 1 unit (1 block) from run information of code data (run length compressed pixel data) read from the memory 108 A continuation code length detection unit 106 that detects (encoding header) and outputs the division information of the continuation code length; and a code data cutout that extracts one block of code data according to the information from the continuation code length detection unit 106. A dividing section 103; a signal which is output from the code data dividing section 103 and which shows run information of one compression unit, and a continuous code length detecting section 1.
Data bit "0" that is output from 06
A signal indicating the number of consecutive "0" bits (period signal), which indicates how many consecutive blocks from the beginning of the code data for one block
And a run length setting unit 107 that calculates the number of continuous pixels of one block from these signals; pixel color information from the code data dividing unit 103 and a period signal output from the run length setting unit 107 , Pixel color output unit 104 (Fast-in / Fast-out type) that outputs color information only during that period
And; sub-picture data SPD read from the memory 108
A microcomputer 112 that reads the header data (see FIG. 4) therein and performs various processing settings and controls based on the read data; an address control unit 109 that controls a read / write address of the memory 108; a line for which run information does not exist A pixel-deficiency color setting unit 111 whose color information is set by the microcomputer 112;
The display valid permission unit 110 determines the display area when the sub-picture is displayed on the V screen or the like.

As mentioned in the description of FIGS. 53 to 57, the system timer 120 and the buffer 121 are connected to the MPU 112 of the decoder 101.

To explain the above description in another way,
It looks like this: That is, as shown in FIG. 11, the run-length compressed sub-picture data SPD has the data I /
It is sent to the bus inside the decoder 101 via O102. The data SPD sent to the bus is sent to the memory 108 via the memory control unit 105 and stored therein. Further, the internal bus of the decoder 101 is connected to the code data dividing unit 103, the continuation code length detecting unit 106, and the microcomputer (MPU or CPU) 112.

The sub-picture unit header 31 of the sub-picture data read from the memory 108 is read by the microcomputer 112. Microcomputer 1
Reference numeral 12 sets the decoding start address (SPDDADR) in the address control unit 109 from the read header 31 based on various parameters shown in FIG. Information about display height (SPDSZ) is set, and the code data segmentation unit 10
The display width (the number of dots on the line) of the sub-picture is set to 3. The various information that has been set is for each part (109, 110, 10
It is saved in the internal register of 3). After that, various information stored in the register is stored in the microcomputer 112.
Will be accessible by.

The address control unit 109 accesses the memory 108 via the memory control unit 105 based on the decoding start address (SPDDADR) set in the register to start reading the sub-picture data to be decoded. The sub-picture data read from the memory 108 in this way is given to the code data cutout unit 103 and the continuation code length detection unit 106.

Run length compressed sub-picture data SP
The coded header of D (2 to 14 bits in rules 2 to 5 of FIG. 5) is detected by the continuous code length detection unit 106, and the number of continuous pixels of the same pixel data in the data SPD is determined by the continuous code length detection unit 106. Run length setting unit 1 based on signal
Detected by 07.

That is, the continuation code length detecting unit 106
The encoded header (see FIG. 5) is detected by counting the number of “0” bits of the data read from the memory 108. The detecting unit 106 causes the code data dividing unit 103 to divide the information SEP. I
NFO. give.

The code data segmentation unit 103 receives the segmentation information SEP. INFO. Accordingly, the number of continuous pixels (run information) is set in the run length setting unit 107, and the pixel data (SEPARATED DATA; pixel color in this case) is set in the FIFO type pixel color output unit 104. At that time, the code data dividing unit 103 counts the number of pixels of the sub-picture data and compares the pixel count value with the display width of the sub-picture (the number of pixels in one line).

If byte-alignment is not completed at the time when the decoding for one line is completed (that is, the data bit length for one line is not a multiple of 8), the code data dividing unit 103 determines the end 4 on that line. The bit data is regarded as dummy data added at the time of encoding and is truncated.

The run length setting unit 107, based on the number of continuous pixels (run information), the pixel dot clock (DOTCLK), and the horizontal / vertical synchronization signal (H-SYNC / V-SYNC), outputs the pixel color output unit 104. A signal (PERIOD SIGNAL) for outputting pixel data. Then, the pixel color output unit 104 displays the decoded pixel data from the code data segmentation unit 103 while the pixel data output signal (PERIOD SIGNAL) is active (that is, during the period in which the same pixel color is output). Output as data.

At this time, if the decoding start line is changed by an instruction from the microcomputer 112, there may be a line without run information. In that case, the insufficient pixel color setting unit 111 supplies the preset insufficient pixel color data (COLOR INFO.) To the pixel color output unit 104. Then, while the line data having no run information is given to the code data dividing unit 103, the pixel color output unit 104 causes the insufficient pixel color setting unit 111.
To output the insufficient pixel color data (COLOR INFO.).

That is, in the case of the decoder 101 shown in FIG. 11, if there is no image data in the input sub-picture data SPD, the microcomputer 112 sets the insufficient pixel color information in the insufficient pixel color setting section 111. It has become.

A display enable signal for deciding at which position on the monitor screen (not shown) to display the decoded sub-picture is sent to the pixel color output section 104 by the horizontal / vertical synchronization of the sub-picture image. It is given from a display validating unit (Display Activator) 110 in synchronization with the signal. Further, a color switching signal is sent from the permitting unit 110 to the output unit 104 based on the color information instruction from the microcomputer 112.

The address control unit 109, after the processing setting by the microcomputer 112,
Address data and various timing signals are sent to the continuation code length detecting unit 106, the code data dividing unit 103, and the run length setting unit 107.

When a pack of sub-picture data SPD is fetched via the data I / O unit 102 and stored in the memory 108, the contents of the pack header of this data SPD (decoding start address, decoding end address, display) The starting position, display width, display height, etc.) are read by the microcomputer 112. The microcomputer 112 sets the decode start address, the decode end address, the display start position, the display width, the display height, etc. in the display validity permission section 110 based on the read content.
At this time, the number of bits of the compressed pixel data (here, the pixel data is 2 bits) is shown in FIG.
The sub-picture unit header 31 can be determined based on the contents of the sub-picture unit header 31.

The operation of the decoder 101 of FIG. 11 will be described below in the case where the compressed pixel data has a 2-bit structure (the usage rule is rules 1 to 6 of FIG. 5).

When the decode start address is set by the microcomputer 112, the address controller 1
09 sends the corresponding address data to the memory control unit 105 and also sends a read start signal to the continuation code length detection unit 106.

The continuation code length detection unit 106 sends a read signal to the memory control unit 105 in response to the sent read start signal to send encoded data (compressed sub-picture data 3
2) Read in. Then, in this detection unit 106,
It is checked whether all the upper 2 bits of the read data are "0".

If they are not "0", it is determined that the block length of the compression unit is 4 bits (see Rule 1 in FIG. 5).

If they (upper 2 bits) are "0", the following 2 bits (upper 4 bits) are checked. If they are not “0”, it is determined that the block length of the compression unit is 8 bits (see Rule 2 in FIG. 5).

If they (upper 4 bits) are "0", the following 2 bits (upper 6 bits) are checked. If they are not "0", it is determined that the block length of the compression unit is 12 bits (see Rule 3 in FIG. 5).

If they (upper 6 bits) are "0", the following 8 bits (upper 14 bits) are checked. If they are not "0", it is determined that the block length of the compression unit is 16 bits (Rule 4 in FIG. 5).
reference).

If these (upper 14 bits) are "0", it is determined that the block length of the compression unit is 16 bits and that the same pixel data continues until the line end (Rule 5 in FIG. 5). reference).

If the bit number of the pixel data read up to the line end is an integral multiple of 8, leave it as it is, and
If it is not an integral multiple of, it is determined that 4-bit dummy data is required at the end of the read data in order to realize byte alignment (see Rule 6 in FIG. 5).

The code data segmentation unit 103 determines whether the memory 1 has the memory 1 based on the determination result by the continuation code length detection unit 106.
One block (one compression unit) of the sub-picture data 32 is extracted from 08. Then, in the dividing unit 103, the extracted data for one block is divided into the number of continuous pixels and pixel data (color information of pixels, etc.). The separated data of the number of continuous pixels (RUN INFO.) Is sent to the run length setting unit 107, and the separated pixel data (SEPARATED DATA) is output to the pixel color output unit 10.
Sent to 4.

On the other hand, the display validity permission unit 110 receives the display start position information received from the microcomputer 112,
A pixel dot clock (PIXEL-DOT) supplied from the outside of the device according to the display width information and the display height information.
CLK), the horizontal synchronizing signal (H-SYNC) and the vertical synchronizing signal (V-SYNC), a display permission signal (enable signal) designating a sub-picture display period is generated.
This display permission signal is output to the run length setting unit 107.

The run length setting unit 107 outputs a signal output from the continuation code length detecting unit 106, which indicates whether or not the current block data continues up to the line end, and a signal from the code data dividing unit 103. Continuous pixel data (R
UN INFO. ) And are sent. Run length setting unit 107
Determines the number of pixel dots covered by the block being decoded, based on the signal from the detection unit 106 and the data from the segmentation unit 103, and during the period corresponding to this dot number,
It is configured to output a display permission signal (output enable signal) to the pixel color output unit 104.

The pixel color output unit 104 includes a run length setting unit 10
7 is enabled during the period signal reception, and during that period, the pixel color information received from the code data dividing unit 103 is set to the pixel dot clock (PIXEL-DOT CL
In synchronism with K), the decoded display data is sent to a display device (not shown) or the like. That is, the same display data as the number of continuous pixel pattern dots in the block being decoded is output from the pixel color output unit 104.

If the continuous code length detecting unit 106 determines that the encoded data is the same pixel color data until the line end, the continuous code length 1 is sent to the code data dividing unit 103.
A 6-bit signal is output, and a signal indicating that the same pixel color data is output up to the line end is output to the run length setting unit 107.

When the run length setting unit 107 receives the above-mentioned signal from the detection unit 106, the pixel color is set so that the color information of the coded data keeps the enabled state until the horizontal synchronizing signal H-SYNC becomes inactive. The output enable signal (period signal) is output to the output unit 104.

When the microcomputer 112 changes the decode start line in order to scroll the display contents of the sub-picture, there is no data line to be used for decoding in the preset display area (that is, the decode line). Shortage).

To deal with such a case, the decoder 101 of FIG. 11 prepares pixel color data for filling the insufficient lines in advance. Then, when the line shortage is actually detected, the display mode of the insufficient pixel color data is switched to. Specifically, when the data end signal is given from the address control unit 109 to the display valid permission unit 110, the permission unit 110 sends a color switching signal (COLOR SW SIGNAL) to the pixel color output unit 104. In response to this switching signal, the pixel color output unit 104 switches the decode output of the pixel color data from the code data to the decode output of the color information (COLOR INFO.) From the insufficient pixel color setting unit 110. This switching state is maintained during the display period of the insufficient line (DISPLAY ENABLE = active).

When the line shortage occurs, the decoding process operation can be stopped during that period instead of using the insufficient pixel color data.

Specifically, for example, when a data end signal is input from the address control unit 109 to the display valid permission unit 110, the permission unit 110 outputs to the pixel color output unit 104 a color switching signal designating display stop. do it. Then, the pixel color output unit 104 stops displaying the sub-picture while the display stop designation color switching signal is active.

FIG. 8 shows two examples of how the character pattern “A” is decoded in the pixel data (sub-picture data) encoded in the example of FIG. 7 (non-interlaced display and interlaced display). To explain.

The decoder 101 of FIG. 11 can be used when decoding compressed data as shown in the upper part of FIG. 8 into non-interlaced display data as shown in the lower left part of FIG.

On the other hand, when the compressed data as shown in the upper part of FIG. 8 is decoded into the interlaced display data as shown in the lower right part of FIG. 8, a line doubler (for example, an odd field) for scanning the same pixel line twice is used. Line # 10 having the same content as the line # 1 of No. 1 is rescanned in the even field; switching in V-SYNC unit)
Will be required.

Further, in the case of non-interlaced display with an image display amount equivalent to that of interlaced display, another in doubler (for example, line # 10 having the same contents as line # 1 in the lower right part of FIG. 8 is continued to line # 1). H-SY
Switching of NC unit) is required.

FIG. 12 is a block diagram for explaining an embodiment (interlace specification) of decoder hardware having the line doubler function. Decoder 1 of FIG.
01 can also be configured by the decoder having the configuration of FIG.

In the configuration of FIG. 12, the microcomputer 112 detects the generation timing of the odd field and the even field of the interlaced display based on the horizontal / vertical synchronizing signal of the sub-picture.

When the odd field is detected, the microcomputer 112 gives the mode signal to the selection signal generator 118, which indicates "currently is an odd field". Then, the selection signal generation unit 118 outputs a signal for selecting the decoded data from the decoder 101 to the selector 115. Then, lines # 1 to # of the odd field
9 pixel data (see the lower right part of FIG. 8)
From 1 through the selector 115, it is sent to the outside as a video output. At this time, the pixel data of the lines # 1 to # 9 of these odd fields are temporarily stored in the line memory 11
Stored in 4.

When it is detected that the field has moved to an even field, the microcomputer 112 causes the selection signal generation section 11
8 is given a mode signal indicating "currently even field". Then, the signal stored in the line memory 114 is output from the selection signal generation unit 118 to the selector 115. Then, the pixel data of lines # 10 to # 18 of the even field (see the lower right part of FIG. 8)
From the line memory 114 via the selector 115,
It is sent to the outside as video output.

Thus, lines # 1 to # 1 of the odd field
The sub-picture image of # 9 (character "A" in the example of FIG. 8) and the sub-picture images of lines # 10 to # 18 of the even field (FIG. 8).
Character “A”) is combined to realize interlaced display.

By the way, the sub-picture unit header 31 of the sub-picture data shown in FIG. 4 is provided with a parameter bit (SPMOD) indicating the frame display mode / field display mode of the TV screen.

In the case of non-interlaced display with the same image display amount as interlaced display, for example, the following is performed.

The microcomputer 112 shown in FIG.
When the sub-picture unit header 31 is read, whether the mode is the interlace mode (active “1”) or the non-interlace mode based on the setting value of the parameter SPMOD (active = “1”; inactive = “0”) ( Inactive “0”) can be determined.

In the configuration of FIG. 12, the parameter SPM
When OD is active = 1, the microcomputer 112 detects that the interlace mode is set, and sends a mode signal indicating the interlace mode to the selection signal generator 118. The generation unit 1 that receives this mode signal
18 gives a switching signal to the selector 115 every time the horizontal synchronizing signal H-SYNC is generated. Then, the selector 115
Switches alternately between the decode output of the current field (DECODED DATA) from the sub-picture decoder 101 and the decode output of the current field temporarily stored in the line memory 114 each time the horizontal synchronization signal H-SYNC is generated. Send video output to external TV etc.

As described above, the current decoded data and the decoded data in the line memory 114 are H-SY.
When switched and output for each NC, an image having a density twice as high as the original image (decoded data) (horizontal scanning lines twice) is displayed on the TV screen in the interlaced mode.

In the sub-picture decoder 101 having such a configuration, the bit data that is sequentially input is counted one bit at a time from the beginning of the decoded data unit block, instead of being decoded after the data is read for one line. While being read, 2 to 16 bits are read and decoded. In this case, the bit length of one unit of decoded data (4 bits, 8 bits, 12 bits, 16 bits, etc.)
Is detected just before decoding. Then, in the detected data length unit, the compressed pixel data is restored (reproduced) in real time into, for example, three types of pixels (“·”, “o”, and “#” in the example of FIG. 7). go.

For example, in decoding pixel data encoded according to rules 1 to 6 in FIG. 5, the sub-picture decoder 101 is provided with a bit counter and a relatively small capacity data buffer (line memory 114, etc.). Good. In other words, the sub-picture decoder 101
The circuit configuration of can be made relatively simple, and the entire apparatus including this encoder can be miniaturized.

That is, the encoder of the present invention does not require a large code table in the decoder as in the conventional MH encoding method, and does not need to read data twice at the time of encoding as in the arithmetic encoding method. . further,
The decoder of the present invention does not require relatively complicated hardware such as a multiplier, and can be implemented by adding a simple circuit such as a counter and a small capacity buffer.

According to the present invention, run length compression / compression of various types of pixel data (up to four types in the 2-bit configuration) is performed.
Encoding and its run length expansion / decoding
It can be realized with a relatively simple configuration.

FIG. 13 is a flow chart for explaining the software executed by the encoder (200) of FIG. 10 for executing the image encoding (run length compression) according to the embodiment of the present invention. is there.

A series of encoding processes based on the run length compression rules 1 to 6 shown in FIG. 5 is performed by the encoder 2 shown in FIG.
This is executed as a software process by a microcomputer inside 00. The entire encoding process by the encoder 200 can be performed according to the flow of FIG. 13, and the run length compression of the pixel data in the sub-picture data can be performed according to the flow of FIG.
(Here, the display control sequence table DCS of FIG.
The encoding of QT33 will not be touched upon. DCSQT
The encoding of the 33rd part will be described later with reference to FIG. In this case, when the number of lines and the number of dots of the image data are designated by key input or the like (step ST801), the computer inside the encoder 200 prepares the header area of the sub-picture data and sets the line count number to " 0 ”
Are initialized (step ST802).

When the pixel patterns are sequentially input pixel by pixel, the computer in the encoder 200 acquires the pixel data for the first pixel (here, 2 bits), saves the pixel data, and stores the pixel data. Count "1"
And the dot count number is set to "1" (step ST803).

Subsequently, the internal computer of the encoder 200 acquires the pixel data (2 bits) of the next pixel pattern, and compares it with the pixel data that has been input and is being stored (step ST804).

As a result of this comparison, if the pixel data are not equal (NO in step ST805), the encoding conversion process 1 is performed (step ST806) and the current pixel data is saved (step ST807). Then, the pixel count number is incremented by +1 and the dot count number is also incremented by +1 correspondingly (step ST808).

As a result of the comparison in step ST804, if the pixel data are the same (YES in step ST805), the encode conversion process 1 in step ST806 is skipped and the process proceeds to step ST808.

After the pixel count number and the dot count number are incremented (step ST808), the internal computer of the encoder 200 checks whether the pixel line currently being encoded is the end (step ST809). If the line end (step ST8
09), and the encoding conversion process 2 is performed (step ST810). If it is not the line end (NO in step ST809), the process returns to step ST804, and the processes of steps ST804 to ST808 are repeated.

Upon completion of the encode conversion process 2 in step ST810, the computer inside the encoder 200 is
It is checked whether the encoded bit string is an integer multiple of 8 bits (byte aligned) (step ST811A). If it is not byte-aligned (NO in step ST811A), 4-bit dummy data (0000) is added to the end of the encoded bit string (step ST811B). If the bit string after the dummy addition process or after the encoding is byte-aligned (YES in step ST811A), the line counter (general-purpose register in the microcomputer) of the computer in the encoder is incremented by +1 (step ST812).

After the line counter is incremented, if the final line has not been reached (NO in step ST813), the process returns to step ST803, and step ST803.
~ The process of step ST812 is repeated.

If the final line is reached after the line counter is incremented (YES in step ST813), the encoding process (run length compression of the bit string of the 2-bit pixel data in this case) ends.

FIG. 14 shows the encoding conversion process 1 of FIG.
It is a flowchart explaining an example of the content of.

In the encoding conversion process 1 (step ST806) of FIG. 13, since it is assumed that the pixel data to be encoded has a 2-bit width, the run length compression rules 1 to 6 of FIG. 5 are applied.

In accordance with these rules 1 to 6, the pixel count number is 0 (step ST901), the pixel count number is 1 to 3 (step ST902), or the pixel count number is 4 to 15 ( Step ST903) or the pixel count number is 16 to 63 (step ST90).
4), the pixel count number is 64 to 255 (step ST905), the pixel count value indicates the line end (step ST906), or the pixel count number is 256 or more (step ST907). The decision is made by computer software.

The internal computer of the encoder 200 is
Based on the above determination result, the number of bits of the run field (one unit length of pixel data of the same type) is determined (steps ST908 to ST913), and after the sub-picture unit header 31, the area for the number of run fields bits Secure. The number of continuous pixels is output to the run field thus secured, pixel data is output to the pixel field, and a storage device (not shown) inside the encoder 200 is provided.
Is recorded (step ST914).

FIG. 15 is a flow chart for explaining the software executed by the microcomputer 112 of FIG. 11 or FIG. 12 for executing the image decoding (run length expansion) according to the embodiment of the present invention. Is. (Here, the decoding of the display control sequence table DCSQT33 of FIG. 3 is not mentioned. The decoding of the DCSQT33 portion will be described later with reference to FIGS. 54 to 57.) Further, FIG. 16 is the software of FIG. 6 is a flowchart illustrating an example of the contents of a decoding step (ST1005) used in.

That is, the microcomputer 112
Reads the first header 31 portion of the run-length compressed sub-picture data (pixel data has a 2-bit structure) and analyzes the content (see FIG. 4). Then, the number of lines and the number of dots of the data to be decoded are designated based on the content of the analyzed header. When the number of lines and the number of dots are designated (step ST1
001), the line count number and the dot count number are initialized to “0” (step ST1002 to step ST1003).

The microcomputer 112 sequentially takes in the data bit string following the sub-picture unit header 31, and counts the number of dots and the number of dot counts. Then, the number of dots is subtracted from the number of dots to calculate the number of continuous pixels (step ST1004).

When the number of continuous pixels is calculated in this way, the microcomputer 112 executes a decoding process according to the value of the number of continuous pixels (step ST1005).

After the decoding processing in step ST1005,
The microcomputer 112 adds the dot count number and the continuous pixel number, and sets this as a new dot count number (step ST1006).

Then, the microcomputer 112 sequentially takes in the data and executes the decoding process of step ST1005. When the accumulated dot count number matches the initially set line end number (line end position), one line The decoding process for the data is ended (YES in step ST1007).

Next, if the decoded data is byte-aligned (YES in step ST1008A), dummy data is removed (step ST1008B).
Then, the line count number is incremented by +1 (step ST1009), and the processes of steps ST1002 to ST1009 are repeated until the final line is reached (NO in step ST1010). When the final line is reached (YES in step ST1010), the decoding ends.

Decoding processing step ST100 in FIG.
The processing contents of No. 5 are as shown in FIG. 16, for example.

In this process, two bits are acquired from the beginning, and the weaving for determining whether or not the bit is "0" is repeated (steps ST1101 to ST110).
9). As a result, the run length compression rules 1 to 6 in FIG.
The number of continuous pixels corresponding to, that is, the number of consecutive runs is determined (step ST1110 to step ST1113).

After the number of continuous runs is determined, the 2 bits read subsequently after that are set as a pixel pattern (pixel data; pixel color information) (step ST111).
4).

When pixel data (pixel color information) is determined,
The index parameter “i” is set to 0 (step ST
1115) until the parameter "i" matches the number of consecutive runs (step ST1116), the 2-bit pixel pattern is output (step ST1117), and the parameter "i" is incremented by +1 (step ST111).
8) Then, the output of one unit of the same pixel data is finished, and the decoding process is finished.

As described above, according to this sub-picture data decoding method, the sub-picture data decoding processing is a simple process of only a few bit determination process, a data block dividing process, and a data bit counting process. I'm done. For this reason, a large-scale code table used in the conventional MH encoding method or the like is not required, and the process / structure for decoding the encoded bit data into the original pixel information becomes simple.

In the above embodiment, the code bit length for one unit of the same pixel can be determined by reading the maximum 16-bit bit data at the time of data decoding, but the code bit length is not limited to this. Not done. For example, this code bit length may be 32 bits or 64 bits. However, as the bit length increases, a data buffer with a large capacity is required.

In the above embodiment, the pixel data (pixel color information) is color information of three colors selected from a color palette of 16 colors, for example.
Primary colors (red component R, green component G, blue component B; or luminance signal component Y, chroma red signal component Cr, chroma blue signal component Cb
Each of the amplitude information can be represented by 2-bit pixel data. That is, the pixel data is not limited to the specific type of color information.

FIG. 17 shows a modification of FIG. Figure 11
In FIG. 17, the operation of cutting out the header by the microcomputer 112 is performed by software. However, in FIG. 17, the operation of cutting out the header is performed by hardware inside the decoder 101.

That is, as shown in FIG. 17, the run-length compressed sub-picture data SPD is the data I / O1.
It is sent to the bus inside the decoder 101 via 02. The data SPD sent to the bus is sent to the memory 108 via the memory control unit 105 and stored therein. Further, the internal bus of the decoder 101 is connected to the code data cutout unit 103, the continuation code length detection unit 106, and a header cutout unit 113 connected to a microcomputer (MPU or CPU) 112.

The sub-picture unit header 31 of the sub-picture data read out from the memory 108 has the header cutout section 113.
Read by. The cutout unit 113 sends the decoding start address (SPDD) from the read header 31 to the address control unit 109 based on various parameters shown in FIG.
(ADR) is set, information (SPDSZ) about the display start position, the display width, and the display height of the sub-picture is set in the display valid permission section 110, and the display width (on the line) of the sub-picture is set in the code data dividing section 103. Set the number of dots. The set various information is stored in the internal register of each unit (109, 110, 103). After that, various information stored in the register is
It can be accessed by the microcomputer 112.

The address control unit 109 accesses the memory 108 via the memory control unit 105 based on the decoding start address (SPDDADR) set in the register to start reading the sub-picture data to be decoded. The sub-picture data read from the memory 108 in this way is given to the code data cutout unit 103 and the continuation code length detection unit 106.

Run-length compressed sub-picture data SP
The coded header of D (2 to 14 bits in rules 2 to 5 of FIG. 5) is detected by the continuous code length detection unit 106, and the number of continuous pixels of the same pixel data in the data SPD is determined by the continuous code length detection unit 106. Run length setting unit 1 based on signal
Detected by 07.

A decoding method different from the decoding method described with reference to FIGS. 15 and 16 will be described below with reference to FIGS. 17 to 21.

FIG. 18 is a flow chart for explaining the first half of the image decoding (run length expansion) processing according to another embodiment of the present invention.

When decoding is started, each block in the decoder 101 shown in FIG. 17 is initialized (register clear, counter reset, etc.). After that, the sub-picture unit header 31 is read, and its contents (various parameters in FIG. 4) are set in the internal register of the header dividing section 113 (step ST1200).

The header 3 is stored in the register of the header dividing section 113.
When the various parameters 1 are set, the status in which the reading of the header 31 is completed is notified to the microcomputer 112 (step ST1201).

Upon receiving the header read end status, the microcomputer 112 designates a decoding start line (eg SPLine1 in FIG. 4) and notifies the header cutting section 113 of the start line (step ST12).
02).

When the header dividing unit 113 receives the notification of the designated decoding start line, the header dividing unit 113 determines, based on various parameters of the header 31 set in its own register,
Address of the specified decode start line (SP in Fig. 4
DDADR) and decoding end address (SP of FIG. 4
EDADR; an address that is shifted by one line relative to the start line address) is set in the address control unit 109, and the display start position, display width, and display height (SPDSZ of FIG. 4) of the decoded sub-picture are displayed valid. Permission section 11
The display width value (LNEPIX; the number of pixels for one line included in SPDSZ, which is not shown in FIG. 4) is set to 0 in the code data dividing unit 103 (step ST1203).

The address control unit 109 sends the decode address to the memory control unit 105. Then, the data to be decoded (compressed sub-picture data SPD) is
From the memory 108 via the memory control unit 105, the encoded data segmentation unit 103 and the continuation code length detection unit 106 are provided.
Is read out. At that time, the read data is set in the internal register of each of the dividing unit 103 and the detecting unit 106 in units of bytes (step ST120).
4).

The continuation code length detecting unit 106 uses the memory 10
The number of "0" bits of the data read from 8 is counted, and the coded header corresponding to any one of rules 1 to 5 of FIG. 5 is detected from the count value (step S
T1205). Details of this encoded header detection are shown in FIG.
Will be described later with reference to.

The continuation code length detecting unit 106 determines, according to the detected value of the encoded header, the segment information SEP. INFO. Is generated (step ST1206).

For example, if the count value of the "0" bit of the data read from the memory 108 is zero, the segment information SEP. INFO. Is generated, and if this count value is 2, the segment information SEP. IN
FO. Is generated, and if this count value is 4, the segment information SEP. INFO. Is generated, and if this count value is 6, the segment information SEP. INFO.
Is generated, and if the count value is 14, the segment information SEP. INFO. Is generated. The segment information SEP. INFO. Is transferred to the encoded data segmentation unit 103.

The coded data segmentation unit 103 receives segmentation information SEP. INFO. In accordance with the contents of the above, the continuous pixel number (PIXCNT; run information) is set in the run length setting unit 107, and 2-bit pixel data (pixel color data; sub-picture data packet) following the continuous pixel number data is separated. Data) is set in the pixel color output unit 104. At this time,
Inside the dividing unit 103, the current count value NOWPIX of a pixel counter (not shown) is set to the continuous pixel number PIXCNT.
Is incremented by (step ST120
7).

FIG. 19 shows the latter half (FIG. 18) of the image decoding (run length extension) processing according to another embodiment of the present invention.
14 is a flowchart for explaining (from node A onward).

In the preceding step ST1203, the coded data segmentation unit 103 receives from the header segmentation unit 113,
The pixel data number (dot number) LNEPIX for one line corresponding to the display width of the sub-picture is notified. In the encoded data segmentation unit 103, the value NO of the internal pixel counter
Number of pixel data for one line notified of WPIX LNEP
It is checked whether or not it exceeds IX (step ST1208).

At this step, the pixel counter value N
When OWPIX is equal to or more than the number of pixel data for one line LNEPIX (NO in step ST1208), 1
The internal register of the dividing unit 103 in which the byte data has been set is cleared, and the pixel counter value NOWPIX
Becomes zero (step ST1209). At this time, if byte-aligned, 4-bit data is truncated. Pixel counter value NOWPI
When X is smaller than the pixel data number LNEPIX for one line (YES in step ST1208), the dividing unit 103
The internal register of is not cleared and remains as it is.

The run length setting unit 107 determines the preceding step ST.
The continuous pixel number PIXCNT (run information) set in 1207, the dot clock DOTCLK that determines the pixel dot transfer rate, and the horizontal and vertical synchronization signals H-SYNC and V-SYNC that synchronize the sub-image with the display screen of the main image. From this, a display period signal (PERIOD SIGNAL) for outputting the pixel data set in the pixel color output unit 104 for a necessary period is generated. The generated display period signal is provided to the pixel color output unit 104 (step ST1210).

The pixel color output unit 104 includes a run length setting unit 10
While the display period signal is given from 7, the cut data (for example, pixel data indicating the pixel color) set in the preceding step ST1207 is output as the decoded sub video display data (step ST121).
1).

The sub-picture display data thus output is
After that, it is appropriately combined with the image of the main video in a circuit part (not shown) and displayed on a TV monitor (not shown).

After the pixel data output process of step ST1211, if the decoded data is not completed, the process returns to step ST1204 of FIG. 18 (NO in step ST1212). Whether or not the decoded data has ended can be determined by whether or not the data up to the end address (SPEDADR) of the sub-picture display data set by the header cutout unit 113 has been processed by the encoded data cutout unit 103.

When the data decoding is completed (YES in step ST1212), it is checked whether or not the display permission signal (DISPLAY ENABLE) from the display valid permission section 110 is active. Display validation unit 11
0 is a data end signal (DA
Until TA END SIGNAL is sent,
The display permission signal in the active state (for example, high level) is generated.

If the display permission signal is active, it is determined that the display period is still in spite of the completion of the data decoding (YES in step ST1213).
In this case, the display validity permitting unit 110 uses the run length setting unit 10
7 and the pixel color output unit 104 to send a color switching signal (step ST1214).

At this time, the pixel color output unit 104 receives the insufficient pixel color data from the insufficient pixel color setting unit 111. The pixel color output unit 104 that receives the color switching signal from the display valid permission unit 110 switches the pixel color data to be output to the insufficient pixel color data from the insufficient pixel color setting unit 111 (step ST1215). Then, while the display permission signal is active (step ST1213 to step ST1).
(Loop of 215), during the display period of the sub-picture in which the decoded data does not exist, the sub-pixel display area is filled with the insufficient pixel color provided by the insufficient pixel color setting unit 111.

If the display permission signal is inactive, it is determined that the display period of the decoded sub-picture has ended (NO in step ST1213). Then, the display validity enabling unit 110 transfers the end status indicating that the sub-picture decoding for one frame is completed to the microcomputer 112 (step ST1216). Thus, the sub-picture decoding process for one screen (one frame) is completed.

FIG. 20 is a flow chart for explaining an example of the contents of the encoded header detection step (ST1205) of FIG. This encoded header detection process is shown in FIG.
(Or FIG. 11), the continuation code length detection unit 106
Be executed.

First, the continuation code length detection unit 106 is initialized, and its internal status counter (STSCNT).
Is set to zero (step ST1301). After that, the contents of the subsequent 2 bits of the data read by the detection unit 106 from the memory 108 in byte units are checked. If the content of these 2 bits is "00" (YES in step ST1302), the counter STSCNT is set to 1
Is incremented by one (step ST1303). If the checked 2 bits do not reach the end of 1 byte read by the detection unit 106 (step ST
No of 1304), and the contents of the subsequent 2 bits are checked. If the content of these two bits is "00" (YES in step ST1302), the counter STSCNT is further incremented by one (step ST130).
3).

Step ST1302 to step ST13
As a result of repeating the loop of 04, step ST1302
When the subsequent 2 bits checked in step 1 have reached the end of 1 byte read by the detection unit 106 (YES in step ST1304), the encoded header of FIG. 5 is larger than 6 bits. In this case, the memory 108
Next, the next data byte is read from the detection unit 106 (step ST1305), and the status counter STSCN is read.
T is set to "4" (step ST1307).
At the same time, one byte of the same data is also read into the encoded data segmentation unit 103.

Status counter STSCNT is "4".
After being set to or in the preceding step ST130
The content of 2 bits checked in 2 is "00"
If not (NO in step ST1302), the contents of the status counter STSCNT are confirmed, and the contents are shown in FIG.
Is output as the content of the encoded header of (step ST
1307).

That is, the status counter STSCN
If T = “0”, the coding header indicating rule 1 in FIG. 5 is detected, and if the status counter STSCNT = “1”, the coding header indicating rule 2 in FIG. 5 is detected, and the status counter STSCNT = If it is "2", the coding header showing rule 3 of FIG. 5 is detected, and if the status counter STSCNT = "3", the coding header showing rule 4 of FIG. 5 is detected and the status counter STSC is detected.
If NT = “4”, the coding header indicating Rule 5 of FIG. 5 (when the same pixel data continues until the end of the line) is detected.

FIG. 21 is a flow chart for explaining how the image decoding process of the present invention is performed when the decoded image is scrolled.

First, the decoder 10 shown in FIG. 11 or FIG.
Each block inside 1 is initialized, and a line counter LINCNT (not shown) is cleared to zero (step ST
1401). Next, the microcomputer 112 (see FIG.
1) or the header dividing section 113 (FIG. 17) receives the header read end status transmitted in step ST1201 of FIG. 18 (step ST1402).

The contents of the line counter LINCNT (initially zero) are transferred to the microcomputer 112 (FIG. 11) or the header dividing section 113 (FIG. 17) (step ST1403). The microcomputer 112 or the header dividing section 113 receives the end status of one frame (one screen) (step ST12).
06) is checked (step ST14)
04).

If the received status is not the end status of one frame (NO in step ST1405),
Wait until this end status comes. If the received status is the end status of one frame (YES in step ST1405), the line counter LINCN
T is incremented by 1 (step ST140
6).

Incremented line counter LI
If the content of NCNT has not reached the end of the line (NO in step ST1407), the decoding process of FIGS. 15 to 16 or the decoding process of FIGS. 18 to 19 is restarted (step ST1408), and step ST140.
Return to 3. This decoding iteration loop (step ST1
By repeating steps 403 to ST1408, the run-length compressed sub-picture is scrolled while being decoded.

On the other hand, when the content of the incremented line counter LINCNT reaches the end of the line (YES in step ST1407), the decoding process of the sub-picture data accompanied by scrolling ends.

FIG. 22 is an encoding based on the present invention (encoding of SPUH + PXD + DCSQT of FIG. 3).
FIG. 3 is a block diagram illustrating an outline of an optical disc recording / reproducing apparatus in which a decoding process (SPUH + PXD + DCSQT decoding) is performed.

In FIG. 22, the optical disk player 30
0 is basically a conventional optical disk reproducing device (compact disk player or laser disk player)
It has the same structure as. However, the optical disc player 300 before decoding the run-length-compressed image information from the inserted optical disc OD (the image information containing the run-length-compressed sub-picture data according to the present invention is recorded). It can output digital signals (digital signals that have been encoded). Since the encoded digital signal is compressed, the required transmission bandwidth may be smaller than that in the case of transmitting uncompressed data.

The compressed digital signal from the optical disk player 300 is sent on air via the modulator / transmitter 210 or sent to the communication cable.

The compressed digital signal which is on-air or the compressed digital signal which is transmitted by the cable is received by the receiver / demodulator 400 of the receiver or the cable subscriber. The receiver 400 includes a decoder 101 having a structure as shown in FIG. 11 or 17, for example. The decoder 101 of the receiver 400 decodes the compressed digital signal received and demodulated, and outputs the image information including the original sub-picture data before being encoded.

In the configuration of FIG. 22, if the transmission / reception transmission system has an average bit rate of about 5 Mbit / sec or more, high quality multimedia video / audio information can be broadcast.

FIG. 23 is a block diagram for explaining a case where image information encoded according to the present invention is transmitted and received between arbitrary two computer users via a communication network (Internet or the like).

A user # 1 having self-information # 1 managed by a host computer (not shown) owns a personal computer 5001, and this personal computer 5001 includes various input / output devices 5011 and various external storage devices 5021. It is connected. An encoder and a decoder according to the present invention are incorporated in an internal slot (not shown) of the personal computer 5001 and a modem card 5031 having a function necessary for communication is attached.

Similarly, a user # having another self-information #N
N owns a personal computer 500N,
Various input / output devices 501N and various external storage devices 502N are connected to the personal computer 500N. In addition, this personal computer 50
An encoder and a decoder according to the present invention are incorporated in an internal slot (not shown) of 0N, and a modem card 503N having a function necessary for communication is attached.

Now, a user # 1 is a computer 50.
It is assumed that the user operates 01 to communicate with the computer 500N of another user #N via the line 600 such as the Internet. In this case, both the user # 1 and the user #N have the modem cards 5031 and 503N in which the encoder and the decoder are incorporated, so that the image data compressed efficiently by the present invention can be exchanged in a short time.

FIG. 24 shows image information encoded according to the present invention (SPUH + PXD + DCSQT in FIG. 3).
Recorded on the optical disc OD and recorded information (SPUH
2 shows an outline of a recording / reproducing apparatus for decoding + PXD + DCSQT) based on the present invention.

The encoder 200 of FIG. 24 performs the same encoding process as that of the encoder 200 of FIG. 10 (see FIGS.
4) is executed by software or hardware (including firmware or wired logic circuit).

A recording signal including sub-picture data encoded by the encoder 200 and the like is, for example, (2,7) RLL modulated in the modulator / laser driver 702. The modulated recording signal is sent from the laser driver 702 to the high power laser diode of the optical head 704. A pattern corresponding to the recording signal is written on the magneto-optical recording disk or the phase change optical disk OD by the recording laser from the optical head 704.

The information written on the disc OD is read by the laser pickup of the optical head 706, demodulated by the demodulator / error correction unit 708, and subjected to error correction processing as necessary. The demodulated and error-corrected signal is subjected to various data processing in the audio / video data processing unit 710 to reproduce the information before recording.

The data processing section 710 includes a decoding processing section corresponding to the decoder 101 shown in FIG. This decoding processing unit executes decoding processing (expansion of compressed sub-picture data) corresponding to FIGS. 15 to 16.

FIG. 25 exemplifies a state in which the encoder according to the present invention is integrated into an IC together with its peripheral circuits.

FIG. 26 exemplifies a state in which the decoder according to the present invention is integrated into an IC together with its peripheral circuits.

FIG. 27 exemplifies a state in which the encoder and the decoder according to the present invention are integrated into an IC together with their peripheral circuits.

That is, the encoder or decoder based on the present invention can be integrated into an IC together with necessary peripheral circuits, and this IC can be incorporated into various devices to implement the present invention.

The data line on which the bit string of the compressed data (PXD) as shown in FIG. 9 is normally arranged is configured to include the image information for one horizontal scanning line of the TV display screen. . However, this data line may be configured to include image information of a plurality of horizontal scanning lines of the TV screen, or image information of all horizontal scanning lines of one screen of the TV screen (that is, one frame). It can also be configured to include.

The subject of data encoding based on the compression rule of the present invention is the sub-picture data (3 to
It is not limited to the four color information). The pixel data portion forming the sub-picture data may be multi-bited and various information may be packed therein. For example, if the pixel data is composed of 8 bits per pixel, a color image of 256 colors (in addition to the main image) can be transmitted only by the sub-image.

The sub-picture data shown in FIG. 2 or 3 is composed of a plurality of channels as shown in FIG. The sub-picture data block is composed of a plurality of sub-picture data packets of a channel arbitrarily selected from these plural channels. The sub-picture here has information such as characters or figures, is reproduced at the same time as the video data and audio data, and is superimposed and displayed on the reproduction screen of the video data.

FIG. 29 shows the data structure of the sub-picture packet. As shown in FIG. 29, the sub-picture packet data includes a packet header 3, a sub-picture header 31, sub-picture data 32, and a display control sequence table 33.

In the packet header 3, the time when the playback system should start the display control of the sub video data block is the presentation time stamp (PTS; Presenter).
tionTime Stamp). However, as shown in FIG. 28, this PTS is recorded only in the header 3 of the head sub-picture data packet in each sub-picture data block (Y, W).

FIG. 30 shows a serial arrangement state (n, n + 1) of sub-picture units (see 30 in FIG. 3) formed of one or more sub-picture packets, and one unit (n + 1) of them.
Time stamp PTS described in the packet header of
And the state of display control of the unit (n + 1) corresponding to this PTS (clearing the display of the previous sub-picture and designating the display control sequence of the sub-picture to be displayed from now on).

The sub-picture header 31 contains the size of the sub-picture data packet (SPCSZ of 2 bytes) and the recording start position (2) of the display control sequence table 33 in the packet.
Byte SPDCSQTA) is recorded.

In the display control sequence table 33, a sub-picture display control time stamp (SPDCTS; Sub-Picture Digest) indicating the display start time / display end time of the video data.
splay Control Time Stamp) and the recording position (SPNDCSQA; Sub-) of the sub-picture data (PXD) 32 to be displayed.
Picture Next Display Control Sequence Address)
And a sub-picture data display control command (COMMAN
D) and display control sequence information (D
One or more CSQTs (Display Control Sequence Tables) are recorded.

Here, the time stamp PTS in the packet header 3 is relative to the reference time (SCR; System Clock Reference) during reproduction of the entire file, such as the reproduction start time at the beginning of the file (FIG. 2). It is regulated by time. On the other hand, each time stamp SPDCTS in the display control sequence table 33 is
It is defined by the relative time from TS.

Next, the time stamp PTS processing of the sub-picture data packet in the reproduction system will be described. Here, it is assumed that this PTS processing is executed in the sub-picture processor (for example, MPU 112 in FIG. 11 and its peripheral circuits) in the reproduction system.

FIG. 52 is a diagram for explaining how the buffering state of the sub-picture data block changes depending on the sub-picture channel having the time stamp PTS when sub-picture data is decoded.

(1) The sub-picture processor (FIG. 11, FIG. 17, etc.) is a sub-picture data packet of a channel selected in advance from sub-picture data packets sent from the outside (optical disk, broadcasting station, etc.). Decode
Check if there is a PTS in the packet.

For example, when a PTS exists as shown in channel * 4f in FIG. 52, the PTS is separated from the packet header 3. After that, for example, as shown in FIG. 28, PTS is added to the head of the sub-picture data.
The sub-picture data with the header is buffered (stored) in the sub-picture buffer (for example, the buffer 121 in FIG. 11).

The graph of FIG. 52 exemplifies how the buffering amount in the sub-picture buffer 121 is accumulated as the sub-picture data packets of the PTS-added channel * 4f are buffered.

(2) After the system reset, the sub-picture processor is in the vertical blanking period immediately after receiving the first packet including the PTS (switching from one display screen frame / field to the next display screen frame / field). During the replacement period), the PTS is fetched and the fetched PTS is compared with the count value of the reference time counter STC. The reference time counter STC is a counter (for example, a part of the timer 120 in FIG. 11) in the sub-picture processor that measures the elapsed time from the reference time SCR during the reproduction of the entire file, such as the reproduction start time at the beginning of the file. Composed.

(3) As a result of the comparison between PTS and STC, if STC is larger than PTS, the sub-picture data is immediately displayed. On the other hand, if STC is smaller than PTS, no processing is performed. This comparison is
It is executed again during the next vertical blanking period.

(4) When the processing of the sub-picture data is started, the first sub-picture display control time stamp SPDCTS recorded in the display control sequence table 33 in the sub-picture data packet in the same vertical blanking period is set. ,
Sub-reference time counter (sub-ST) in sub-picture processor
It is compared with the count value of C). The sub-STC is composed of a sub-reference time counter (for example, the other part of the timer 120 in FIG. 11) in the sub-picture processor that measures the elapsed time from the reproduction start time of the sub-picture data block. Therefore, in this sub-STC, all the bits are cleared to "0" every time the display is switched to the next (subsequent) sub-picture data block, and then the increment (time count) is started again.

(5) As a result of the comparison between the sub-STC and the sub-picture display control time stamp SPDCTS, the sub-STC is S
If it is larger than PDCTS, the control data (DCSQT; for example, DCSQT0 in FIG. 29) of the top display control sequence of the display control sequence table 33 is immediately executed, and the sub-picture display process is started.

(6) Once the display process is started, the PTS added to the head packet of the sub-picture data block next to the sub-picture data block currently displayed is read in every vertical blanking period. The read PTS is compared with the count value of the reference time counter STC.

If STC is larger than PTS as a result of this comparison, the channel pointer of FIG. 29 is set to the address value of the PTS of the next sub-picture data block, and the sub-picture data block to be processed is switched to the next one. To be
For example, taking FIG. 28 as an example, the sub-picture data block Y is switched to the next sub-picture data block W by changing the setting of the channel pointer. At this point, the data of the sub-picture data block Y is no longer needed, so that an empty area having the size of the data block Y is created in the sub-picture buffer (for example, memory 108 in FIG. 11). Therefore, the sub-picture data packet can be newly transferred to this empty area.

Thus, from the size of the sub-picture data block (for example, block W in FIG. 28) and its switching time (the switching time from block Y to block W), the buffering state of the sub-picture data packet (FIG. 52). (Reference) can be uniquely defined in advance at the time of encoding the sub-picture data (of the block W). Therefore, when video / audio / sub-picture packets are serially transferred, bitstreams of bitstreams that do not cause overflow or underflow in the buffers of the respective decoder units (in the case of the sub-picture decoder, the other memory 108 in FIG. 11) Can be generated.

As a result of the comparison between PTS and STC, if STC is not larger than PTS, the sub-picture data block is not switched and the display control sequence table pointer (DCSQT pointer in FIG. 29) indicates the next display. It is set to the address value of the control sequence table DCSQT. Then, the sub-picture display control time stamp SP of the next DCSQT in the current sub-picture data packet
DCTS and sub-STC are compared. Based on the comparison result, it is determined whether to execute the next DCSQT. This operation will be described later in detail.

[0280] Note that the last D in the sub-picture data packet
CSQT is the next display control sequence table DCSQ.
Since it points itself to T, the DCSQT process of (5) above is basically unchanged.

(7) In normal reproduction, the above (4),
The processes of (5) and (6) are repeated.

In the process (6), when the PTS of the next sub-picture data block is read, the PTS of that PTS is read.
The value of the channel pointer (see FIG. 29) that indicates the packet size in the current sub-picture data block (SPC
SZ) is used.

Similarly, the display control sequence table 33
Sub-picture display control time stamp S of the next DCSQT in the
The value of the DCSQT pointer indicating the PDCTS is the size information of the DCSQT described in the table 33 (address SPND of the next sub-picture display control sequence).
CSQTA).

Next, sub-picture header 31, sub-picture data 3
2 and the display control sequence table 33 will be described in detail.

FIG. 31 shows the sub-picture unit header (SPU
H) 31 shows the structure. Sub-picture unit header SPUH
Includes the size (SPDSZ) of the sub-picture data packet and recording start position information of the display control sequence table 33 in the packet (sub-picture display control sequence table start address SPDCSQTA; relative address pointer of DCSQ).

The sub-picture display control sequence table SPDCSQ indicated by the address SPDCSQTA.
As shown in FIG. 32, the content of T is composed of a plurality of display control sequences DCSQ1 to DCSQn.

In addition, each display control sequence DCSQ (1
~ N) are sub-picture display control time stamps SPDCTS indicating the sub-picture display control start time, as shown in FIG.
And the address SP indicating the position of the next display control sequence
NDCSQA and one or more sub-picture display control commands SP
It includes DCCMD.

The sub-picture data 32 is composed of a collection of data areas (PXD areas) that correspond to the individual sub-picture data packets on a one-to-one basis.

Until the sub-picture data block is switched, the sub-picture pixel data PXD at an arbitrary address in the same data area can be read. By this, it is not fixed to one sub-picture display image,
Arbitrary sub-picture display (for example, sub-picture scroll display)
Becomes possible. This arbitrary address is a command for setting the display start address of the sub-picture data (pixel data PXD) (SETDSPX in the command table of FIG. 34).
It is set by A).

FIG. 43 shows the bit configuration of the command SETDSPXA for setting the display start address of the sub-picture pixel data in the command set shown in FIG. The significance of the structure of this command will be described below.

When the line data sizes of the sub-picture lines included in the sub-picture data 32 are different, the start address of the next line can be discriminated only after decoding the immediately preceding line data. Therefore, if the image data is arranged in the order of the line numbers as in the conventional case, it becomes very difficult to read the sub-picture pixel data (PXD) from the buffer (memory 108) while skipping one line in the interlace mode. .

Therefore, as shown in FIG. 58, the sub-picture data 32 is recorded separately in the top field area 61 and the bottom field area 62 for each data area corresponding to each sub-picture data packet. ing. In the interlaced mode, a top field start address area 63 and a bottom field start address area 64 are provided in the command SETDSPXA so that the two top addresses of the top field and the bottom field can be set.

In the non-interlaced mode, only one field of sub-picture data is recorded, and the same address is recorded in two areas, the top field start address area 63 and the bottom field start address area 64. You can leave it.

FIG. 59 shows the display control sequence table 3
3 shows a specific example. As described above, one display control sequence information (D
The sub-picture display control time stamp (SP
DCTS) and sub video data recording position (SPNDCS
QA) followed by multiple display control commands (COMMAN
(D3, COMMAND4, etc.) and various parameter data set by the command are arranged. An end command (end code) indicating the end of display control is added at the end.

Next, the processing procedure of the display control sequence table 33 will be described.

(1) First, the time stamp (SPDCTS) recorded in the first DCSQT (DCSQT0 in FIG. 29) of the display control sequence table 33 is the sub-STC of the sub-picture processor (for example, timer 1 in FIG. 11).
20 functions).

(2) As a result of the comparison, if the sub-STC is larger than the time stamp SPDCTS, all the display control commands CO in the display control sequence table 33.
MMAND is executed until the display control end command CMDEND (FIG. 34) appears.

(3) After the display control is started, the sub-picture display control time stamp SPDCTS and the sub-ST recorded in the next display control sequence table DCSQT are set at regular intervals (for example, every vertical blanking period).
Whether to update to the next DCSQT by comparing with C (that is, to change the DCSQT pointer in FIG. 29 to the next DCSQT).
Whether to move to T) is determined.

Here, the display control sequence table 33
Since the time stamp SPDCTS in is recorded at the relative time after the PTS is updated (that is, after the sub-picture data block is updated), it is necessary to rewrite SPDCTS even if the PTS of the sub-picture data packet changes. There is no. Therefore, the same display control sequence table DCSQT can be used even when the same sub-picture data 32 is displayed at a plurality of different times. That is, the display control sequence table DCSQT can be made relocatable.

Next, details of the sub-picture display control command will be described. FIG. 34 shows the sub-picture display control command S
A list of PDCCMD is shown. The main sub-picture display control commands are as follows.

(1) Command STADSP for Setting Display Start Timing of Sub-Video Pixel Data FIG. 37 shows the structure of this command STADSP. This is a command for executing the display start control of the sub-picture data 32. That is, when a certain DCSQT is switched to a DCSQT including this command STADSP, the display of the sub-picture data 32 is D including this command.
It will start from the time indicated by the time stamp SPDCTS of CSQT.

Sub-picture processor (for example, MPU in FIG. 11)
112) decodes this command, and (when this command is accessed, the D to which this command belongs
Immediately (because the time indicated by SPDCTS of CSQT has passed), the enable bit of the display control system inside the sub-picture processor is immediately activated.

(2) Command STPDSP for setting display end timing of sub-picture pixel data FIG. 38 shows the structure of this command STPDSP. This is a command for executing the display end control of the sub-picture data 32. The sub-picture processor immediately decodes this command (since the time indicated by the SPDCTS of the DCSQT to which this command belongs is past at the time of accessing this command), the enable bit of the display control system inside the sub-picture processor is immediately transmitted. To the active state.

(3) Command SETCOLOR for setting color code of sub-picture pixel data FIG. 39 shows the structure of this command SETCOLOR. This is a command for setting the color code of the sub-picture pixel data. This command causes the sub-picture to be a pattern pixel such as a character or a pattern, an emphasis pixel such as a border of the pattern pixel, and a background pixel which is a pixel in the area other than the pattern pixel and the emphasis pixel in the area where the sub-picture is displayed. Color information can be set separately for and.

The sub-picture processor, as shown in FIG.
A color register 1210 that can set a color code by this command SETCOLOR is incorporated. Register 1
Once the color code is set, the 210 holds this color code data until it is reset by the same command. Color data according to the pixel type indicated by the sub-picture data 32 (for example, the type specified by the 2-bit pixel data in FIG. 5) is selected from the color register 1210 (SEL0).
To be done.

The sub-picture processor also includes a change color data register 1220 set by a command (CHGCOLCON) for setting color change and contrast change of sub-picture pixel data. This register 122
When the data output selected from 0 (SEL0) is active, the selection output from the register 1220 is selected (SEL1) with priority over the selection output from the register 1210, and the selection result is set as color data. Is output.

(4) Command SETCONTR for setting contrast of sub-picture pixel data with respect to main picture FIG. 41 shows the structure of this command SETCONTR. This is similar to the command SETCOLOR in FIG.
It is a command for setting contrast data instead of the color code data for the four types of pixels illustrated in FIG.

(5) Command SETDAREA for setting display area of sub-picture pixel data on main picture FIG. 42 shows the structure of this command SETDAREA. This is a command for designating the position where the sub-picture pixel data 32 is displayed.

(6) Command SETDSPXA for setting the display start address of sub-picture pixel data FIG. 43 shows the structure of this command SETDSPXA. This is a command for setting the display start address of the sub-picture pixel data 32.

(7) Command CHGCOLCON for setting color code of sub-picture pixel data and switching of contrast of sub-picture pixel data with respect to main picture FIG. 44 shows the configuration of this command CHGCOLCON. This is a command for changing the color code of the sub-picture pixel data 32 and the contrast of the sub-picture pixel data 32 with respect to the main picture during display.

This command CHGCOLCON is shown in FIG.
4, the pixel control data size (extended field size) and the pixel control data (PCD) are included.

The command table of FIG. 34 includes the command FSTADSP for forcibly setting the display start timing of the sub-picture pixel data (see FIG. 36) and the sub-picture display control in addition to the above-mentioned commands. Command CMDEND (see FIG. 45) to execute.

FIGS. 35, 46 and 47 are diagrams for explaining the structure of the pixel control data PCD. As shown in FIG. 35, the pixel control data PCD is the line control information LC.
INF, pixel control information PCINF, and an end code indicating the end of pixel control data.

As shown in FIG. 46, the line control information LCINF is composed of a change (change) start line number, a change number (change point), and a change (change) end line number (or continuous line number). ing. In other words, the contour correction color, sub-picture color, and contrast control of the sub-picture with respect to the main picture are started from which line on the display frame, and how many times the contour-correction color, sub-picture color, and contrast are changed on those lines. The line control information LCINF indicates to which line the changes (or changes) and the changes (changes) common to them continue.

The pixel control information PCINF is the pixel position for changing (changing) the contour correction color, the sub-picture color, and the contrast on the line indicated by the line control information LCINF, and the contour correction after the change (change). Change (change) such as color, sub-picture color, and contrast
The contents and are shown.

Pixel control data PCD composed of this line control information LCINF and pixel control information PCINF is
The required number is set for the sub-picture display frame.

Pixel display data P set for an image of a sub-picture display frame as shown in FIG. 48, for example.
The CD becomes as shown in FIG.

That is, in this specific example, since the line where the change (change) has started is "line 4",
The change (change) start line number is "4", and the position where the pixel is changed (change) is "position A", "position B",
Since there are three positions "Position C", the number of pixel changes (the number of pixel change points) is "3", and since the common change state of this pixel continues to "Line 11", the number of continuous lines is "7".

Further, since the pixel change state of "line 12" is different from that before, and the next "line 13" has no pixel change, the change start line number is set to "12",
Another line control information LCINF having the number of change points of “2” and the number of continuous lines of “1” is set.

Furthermore, "line 14" includes pixel changes at four locations, and the next "line 15" has no pixel changes.
Change start line number is "14" and change point number is "4"
Then, another line control information LCINF having the number of continuous lines set to "1" is set. Finally, the end code is set.

Next, the procedure of display control using the line control information LCINF and the pixel control information PCINF will be described.

(1) Display control of the sub-picture is performed by the display control sequence table 33 (DCSQT1 to DCSQ in FIG. 29).
Control command (COMMAND1 to) included in TN)
Is repeatedly performed for each sub-picture display field. The contents of this control command are shown in the table of the sub-picture display control command SPDCCMD in FIG.

Which display control sequence (DCSQT1 to DCSQT1
Whether the DCSQTN) command (various commands in FIG. 34) is executed is determined by the DCSQT pointer in FIG.

(2) Each of the display control commands (STADSP, STPDSP, SETCOLOR, shown in FIG. 34).
SETCONTR, SETDAREA, SETDSPX
Various parameters set by A, CHGCOLCON, etc.) are held in the internal register of the sub-picture processor (for example, MPU 112 in FIG. 11) during the decoding of the sub-picture information unless rewritten by the same command. However, all the various parameters held in this internal register except for some parameters (LCINF, PCINF) when the sub-picture data block is switched (for example, when switching from block Y to block W in FIG. 28). Cleared.

The parameters (LCINF, PCINF) of the pixel control data PCD shown in FIG. 35 remain unchanged until the command CHGCOLCON shown in FIG. 34 is re-executed.
It is designed to be held in 12 internal registers.

(3) In the highlight mode, the parameter LCIN set by the system MPU 112 is set.
The display control is performed by F and PCINF, and LCINF and PCINF of the sub-picture channel data are ignored. These set parameters are reset by the system MPU 112 again during the highlight mode, or the normal mode is set and the L in the sub-picture data is set.
Until CINF and PCINF are reset, MP
It is held inside U and the sub-picture display by those parameters is continued.

(4) The display area is set by lines and dots having numbers designated by start and end in both the horizontal and vertical directions. Therefore, when only one line is displayed, the display start line and the display end line have the same number. If not displayed, the display is stopped by the display end command.

FIG. 53 is a flow chart for explaining an example of a method for generating the sub-picture unit 30 as shown in FIG.

As a sub-picture, for example, video (main picture)
When a subtitle and / or image corresponding to the dialogue is used, the dialogue subtitle / image is converted into bitmap data (step ST10). When creating this bitmap data, it is necessary to determine in which area of the video screen the subtitle portion should be displayed. Therefore, the display control command SETDAREA
Parameters (see FIG. 34) are determined (step S).
T12).

When the display position (spatial parameter) of the sub-picture is determined, the pixel data PXD forming the sub-picture is encoded (the whole main picture is not encoded; details of this PXD encoding are shown in FIG. 5 to 14 and described elsewhere). At that time, the color of the subtitle (sub-picture), the background color of the subtitle area, and the mixture ratio of the subtitle color / background color to the video main picture are determined. Therefore, the display control commands SETCOLOR and SETC
The parameters of ONTR (see FIG. 34) are determined (step ST14).

Next, the timing at which the created bitmap data should be displayed is determined according to the dialogue of the video. This timing is determined by the sub-picture time stamp PTS
Performed by. At that time, the maximum limit time of the time stamp PTS and the display control commands STADSP, STP
Each parameter (temporal parameter) of the DSP and CHGCOLCON (see FIG. 34) is determined (step ST16).

Here, the sub-picture time stamp PTS is
It is finally determined from the consumption model of the target decoder buffer of the MPEG2 system layer. here,
The time when the display of subtitles starts is the sub-picture time stamp P.
Determined as the maximum time limit for TS.

Display control commands STADSP and ST
The PDSP is recorded as a relative time from the sub-picture time stamp PTS. Therefore, commands STADSP and STPDSP cannot be determined until PTS is determined. Therefore, in this embodiment, the absolute time is set in advance, and after the absolute time of the PTS is set, the relative value thereof is set.

When it is desired to change the display color or the display area of the created subtitle spatially and temporally, the parameter of the command CHGCOLCON based on the change is determined.

When the display position (spatial parameter) and display timing (temporal parameter) of the sub-picture are (tentatively) determined, the sub-picture display control sequence table DCS.
The content of QT (DCSQ) is created (step ST1).
8). Specifically, the display control sequence table DCS
The value of the display control start time SPDCTS (see FIG. 33) of Q is the effective time of the display control command STADSP (display start timing) and the display control command STPDSP.
It is determined based on the effective time of (display end timing).

By combining the created pixel data PXD32 and the display control sequence table DCSQT33, the size of the sub-picture data unit 30 (see FIG. 3) can be determined. Therefore, based on the size, the parameter SPDSZ of the sub-picture unit header SPUH31
(Sub-picture size; see Fig. 31) and SPDCSQTA
(Start Address of Display Control Sequence Table; FIG. 31
(See reference), and the sub-picture unit header SPUH31 is created. After that, SPUH31, PXD32 and DCS
A sub-picture unit for one subtitle is created by combining with QT33 (step ST20).

If the size of the created sub-picture unit 30 exceeds a predetermined value (2048 bytes or 2 kbytes) (YES in step ST22), the packet is divided into a plurality of packets in units of 2 kbytes (step ST24). In this case, the time stamp PTS is recorded only in the first packet of the sub-picture unit 30 (step ST2).
6).

If the size of the created sub-picture unit 30 is within the predetermined value (2 kbytes) (step ST
22 No) Only one packet is generated (step S
T23), the time stamp PTS is recorded at the beginning of the packet (step ST26).

One or more packets thus created are packed and combined with video and other packs to obtain 1
A book data stream is completed (step ST2)
8). At this time, the arrangement order of each pack is determined based on the sequence recording code SRC and the sub-picture time stamp PTS from the consumption model of the target decoder buffer of the MPEG2 system layer. First time here P
TS is fixed, and as a result, each parameter (SP
DCTS etc.) will be finally decided.

FIG. 54 is a flow chart for explaining an example of a procedure for carrying out parallel processing of pack decomposition and decoding of the sub-picture data stream generated according to the processing procedure of FIG.

First, the decoding system reads the ID of the stream to be transferred, and only the selected sub-picture pack (separated from the data stream) is sub-picture decoder (for example, the sub-picture of FIG. 11 or FIG. 17). The data is transferred to the decoder 101) (step ST40).

When the first pack transfer is performed, the index parameter "i" is set to "1" (step ST42), and the first sub-picture pack is decomposed (step ST44; described later with reference to FIG. 55). ) Is executed.

The decomposed pack (including the compressed sub-picture data PXD as shown in the lower part of FIG. 9) is temporarily stored in the sub-picture buffer (memory 108 in FIG. 11 or FIG. 17) (step ST46), and the index is stored. The parameter "i" is incremented by 1 (step ST5
0).

If there is the incremented i-th pack, that is, if the pack decomposed in step ST44 is not the final pack (NO in step ST52), the incremented i-th sub-picture pack is decomposed (step ST44). ) Is executed.

The decomposed i-th sub-picture pack (here, the second pack) is temporarily stored in the sub-picture buffer (memory 108) similarly to the first decomposed pack (step ST46), and the index parameter is set. "I"
Is further incremented by 1 (step ST5
0).

As described above, a plurality of sub-picture packs are continuously decomposed while incrementing the index parameter "i" (step ST44) and stored in the sub-picture buffer (memory 108) (step ST4).
6).

If there is no i-th pack that is continuously incremented, that is, if the pack decomposed in step ST44 is the final pack (step S
(YES at T52), the sub-picture pack decomposition process of the stream to be decoded ends.

Sub-picture pack disassembly processing (step ST
44 to ST52) are continuously executed, the sub-picture packs temporarily stored in the sub-picture buffer (memory 108) are decoded independently and in parallel with the sub-picture pack decomposition processing. .

That is, the index parameter "j"
Is set to "1" (step ST60), the operation for reading the first sub-picture pack from the sub-picture buffer (memory 108) is started (step ST62). At this point, if the first sub-picture pack is not yet stored in the memory 108 (NO in step ST63; step S63).
Until the pack data to be read is stored in the memory 108 (when the process of T46 is not yet performed), the decoding process is performed in an empty loop of the pack read operation (step ST6).
2 to ST63) are executed.

If the first sub-picture pack is stored in the memory 108 (YES in step ST63), the sub-picture pack is read and decoded (step ST64; a specific example of the decoding processing is shown in FIGS. This will be described later with reference to FIG. 57).

Results of this decoding processing (including uncompressed sub-picture data PXD as shown in the upper part of FIG. 9)
Is sent from the sub-picture decoder 101 in FIG. 11 or FIG. 17 to the display system (not shown) during the decoding process, and the sub-picture corresponding to the decoded data is displayed.

If the display control end command (CMDEND in FIG. 34) is not executed in the above decoding processing (NO in step ST66), the index parameter "j" is incremented by 1 (step ST6).
7).

If the incremented j-th pack (here, the second pack) exists in the memory 108, the pack is read from the memory 108 and decoded (step ST64). The decoded jth sub-picture pack (here, the second pack) is sent to the display system similarly to the first decoded pack, and the index parameter “j” is further incremented by 1 (step ST67). ).

As described above, the index parameter "j" is incremented (step ST6).
7) One or more sub-picture packs stored in the memory 108 are continuously decoded (step ST64), and the sub-picture image display corresponding to the decoded sub-picture data (PXD) is executed.

If the display control end command (CMDEND in FIG. 34) is executed in the above decoding process (YES in step ST66), the sub-picture buffer (memory 10).
The decoding process of the sub-picture data in 8) is completed.

The above decoding process (steps ST62-
ST64) is repeated unless end command CMDEND is executed (NO in step ST66). In this embodiment, the decoding process is performed by the end command CMDEN.
The process is ended by executing D (YES in step ST66).

FIG. 55 is a flow chart for explaining an example of the pack disassembling process of FIG. Sub video decoder 10
1 skips the pack header (see FIG. 3) from the transferred pack to obtain a packet (step ST4).
42). If the time stamp PTS does not exist in this packet (NO in step ST444), the packet header (P
H) is deleted and only the sub-picture unit data (PXD) is stored in the buffer (eg, 121) of the sub-picture decoder (step ST446).

If the packet has the time stamp PTS (YES in step ST444), only the PTS is extracted from the packet header (PH), and the extracted PTS is connected to the sub-picture unit data (30).
It is stored in the buffer 121 of the sub-picture decoder 101 (step ST448).

FIG. 56 is a flow chart for explaining an example of the sub-picture decoding process of FIG. The sub-picture decoder 101 compares the time SCR of the system timer 120 with the time stamp PTS stored in the buffer 121 (step ST640). If they match (YES in step ST642), the sub-picture unit (30)
The decoding process of is started. In this decoding process, for example, the compressed data PXD shown in the lower part of FIG.
The process of returning to the non-compressed data PXD shown in the upper part of FIG. 16 has already been described with reference to FIGS.

In this decoding process, each command of the display control sequence DCSQ is executed. That is,
The command SETDAREA sets the display position and display area of the sub-picture, the command SETCOLOR sets the display color of the sub-picture, and the command SETCONT
The contrast of the sub-picture with respect to the video main picture is set by R (step ST644).

Then, the display start timing command ST
After executing ADSP, another display control sequence DCS
Until the display end timing command STPDSP is executed in Q, the run length compressed pixel data PXD (32) is decoded while performing the display control based on the switching command CHGCOLCON (step ST646).

The above processing steps ST644 and ST646 are skipped when the time SCR of the system timer 120 and the time stamp PTS stored in the buffer 121 do not match (NO in step ST642).

FIG. 57 is a flow chart for explaining an example of a method of decoding the data stream generated according to the procedure of FIG. In the processing of FIG. 54, the sub-picture pack decomposition and the sub-picture decoding are time-independent parallel processing, but in the processing of FIG. 57, the sub-picture pack decomposition and the sub-picture decoding are temporally linked. It is parallel processing. That is, in FIG. 57, it is assumed that the sub-picture pack decomposition processing and the sub-picture decoding processing proceed simultaneously at the same pace.

In the process of FIG. 57, the decoding system first reads the ID of the stream to be transferred, and extracts only the selected sub-picture pack (separated from the data stream) into the sub-picture decoder (FIG. 11 or Transfer to the sub-picture decoder 101 in FIG. 17 (step S)
T40).

When the first pack transfer is performed, the index parameter "i" is set to "1" (step ST42), and the first sub-picture pack decomposition process (step ST44) is executed.

The decomposed pack is temporarily stored in the sub-picture buffer (memory 108) (step ST46).
After that, the index parameter “i” is set to the index parameter “j” (step ST48),
The index parameter “i” is incremented by 1 (step ST50).

If the incremented i-th pack exists, that is, if the pack decomposed in step ST44 is not the final pack (NO in step ST52), the incremented i-th sub-picture pack is decomposed (step ST44). ) Is executed.

The decomposed i-th sub-picture pack (here, the second pack) is temporarily stored in the sub-picture buffer (memory 108) similarly to the first decomposed pack (step ST46), and the index parameter is set. "I"
Is further incremented by 1 (step ST5
0).

As described above, a plurality of sub-picture packs are continuously decomposed while incrementing the index parameter "i" (step ST44) and stored in the sub-picture buffer (memory 108) (step ST4).
6).

If there is no i-th pack that is continuously incremented, that is, if the pack decomposed in step ST44 is the final pack (step S
(YES at T52), the sub-picture pack decomposition process of the stream to be decoded ends.

[0371] The sub-picture pack decomposition process (step ST
44 to ST52) are continuously executed, the sub-picture packs temporarily stored in the sub-picture buffer (memory 108) are decoded in parallel with the sub-picture pack decomposition processing.

That is, the index parameter "j"
When the index parameter “i = 1” is set to (step ST48), the j = 1st sub-picture pack is read from the memory 108 (step ST62), and j =
The first sub-picture pack is decoded (step ST64).

During the decoding process (step ST64) of this j = 1st sub-picture pack, 1 is set in step ST50.
The i = 2nd sub-picture pack that has been incremented by one is decomposed (step ST44) in parallel.

The above decoding process (steps ST62-
ST64) is repeated unless end command CMDEND is executed (NO in step ST66). The decoding process ends when the end command CMDEND is executed (YES in step ST66).

[0375]

As described above, according to the present invention, display space waste and display time waste of sub-picture data can be significantly reduced, and a sub-picture representation similar to that of the bit map data system can be achieved. Freedom can be achieved and a wide range of sub-picture applications can be secured.

That is, according to the present invention, the use range setting information for setting the range to be used for display in the sub-picture data is provided, and the data other than the use range is not displayed so that one frame is displayed. It is possible to significantly reduce display space waste of the data amount that occurs when all the data is sent to the display system.

Further, according to the present invention, color setting information for each pixel type such as pattern pixels, trimming, background, etc. of sub-picture data and sub-picture mixture ratio setting information are provided, and the shape of the sub-picture image is used as sub-picture display data. By providing only the information, it is possible to guarantee the sub-image shape expression similar to the conventional method in which the color information and the mixing ratio information are provided for each pixel with a smaller amount of data.

Further, according to the present invention, the color / mixing ratio change setting is performed in order to set the change of the color for each pixel type of the sub-picture data and the change of the mixing ratio for each pixel type of the sub-picture data with respect to the main picture in pixel units. Since the information is provided, the dynamic display of the sub-picture can be realized with the same accuracy as that of the conventional bitmap data method and with a smaller data amount than that of the bitmap data method.

It is rare that the color information of each sub-picture changes in each pixel, and there is no fear that the data amount of the color / mixing ratio change setting information itself becomes excessive.

Furthermore, in the present invention, even if the color of the sub-picture image changes, the sub-picture can be displayed over a plurality of frame times using the same sub-picture data as long as the shape does not change. Therefore, it is possible to significantly reduce the waste of the display time of the sub-picture data, as compared with the conventional method in which the sub-picture data must be continuously supplied to the display system at the frame cycle regardless of the color / shape change. .

[Brief description of drawings]

FIG. 1 is a diagram schematically showing a recording data structure of an optical disc as an example of an information holding medium to which the present invention can be applied.

FIG. 2 is a diagram illustrating a logical structure of data recorded on the optical disc of FIG.

3 is a diagram exemplifying a logical structure of a sub-picture pack to be encoded (run length compression, addition of a display control sequence table, etc.) among the data structures illustrated in FIG. 2;

FIG. 4 is a diagram exemplifying the contents of a sub-picture data portion of the sub-picture pack illustrated in FIG. 3 to which the encoding method according to the embodiment of the present invention is applied.

FIG. 5 is a compression adopted by the encoding method according to the embodiment of the present invention when the pixel data forming the sub-picture data portion illustrated in FIG. 4 is formed of a plurality of bits (here, 2 bits). The figure explaining rule 1-6.

FIG. 6 illustrates compression rules 11 to 15 used in an encoding method according to another embodiment of the present invention when pixel data forming the sub-picture data portion illustrated in FIG. 4 is formed of 1 bit. Figure to do.

FIG. 7 is a diagram in which pixel data configuring the sub-picture data portion illustrated in FIG. 4 is configured of, for example, first to ninth lines, and 2-bit configuration pixels (up to four types) are arranged on each line, A specific description will be given of how the pixel data of each line is encoded (run-length compressed) when the character patterns “A” and “B” are expressed by the 2-bit pixels on each line. Fig.

8A and 8B are diagrams illustrating two examples (non-interlaced display and interlaced display) of how the character pattern "A" is decoded in the pixel data (sub-picture data) encoded in the example of FIG. .

9 illustrates compression rules 1 to 6 used in the encoding method according to the embodiment of the present invention when pixel data forming the sub-picture data portion illustrated in FIG. 4 is formed of 2 bits. FIG.

FIG. 10 illustrates the flow from mass production to reproduction on the user side of a high-density optical disc having image information encoded according to the present invention; from broadcasting / cable distribution of image information encoded according to the present invention. The block diagram explaining the flow to a user / subscriber's reception / playback.

FIG. 11 is a block diagram illustrating an embodiment (non-interlaced specification) of decoder hardware that executes image decoding (run length extension, etc.) according to the present invention.

FIG. 12 is a block diagram illustrating another embodiment (interlace specification) of decoder hardware that executes image decoding (run length extension part) according to the present invention.

FIG. 13 is a diagram for performing image encoding (run-length compression part) according to the embodiment of the present invention,
FIG. 11 is a flow chart diagram illustrating software executed by the encoder (200) of FIG. 10, for example.

14 is a flowchart illustrating an example of contents of an encoding step (ST806) used by the software of FIG.

FIG. 15 is a flowchart for explaining the software executed by the MPU (112) of FIG. 11 or 12 for executing the image decoding (run-length extension part) according to the embodiment of the present invention. Fig.

16 is a flowchart diagram illustrating an example of the contents of a decoding step (ST1005) used in the software of FIG.

FIG. 17 is a block diagram illustrating another embodiment of decoder hardware for performing image decoding (run length extension, etc.) according to the present invention.

FIG. 18 is a flowchart diagram for explaining the first half of the image decoding (run length extension part) processing according to another embodiment of the present invention.

FIG. 19 is a flowchart diagram for explaining the latter half of the image decoding (run length extension portion) processing according to another embodiment of the present invention.

FIG. 20 is a step of detecting the encoded header of FIG. 18 (ST1
205) is a flow chart for explaining an example of the contents of (205).

FIG. 21 is a flowchart showing how the image decoding process of the present invention is performed when the decoded image is scrolled.

FIG. 22: Compressed data reproduced from a high density optical disc having image information encoded according to the present invention is directly broadcast or cable distributed, and the compressed data broadcast or cable distributed is decoded by the user or subscriber side. The block diagram explaining a case.

FIG. 23 is a block diagram illustrating a case where image information encoded according to the present invention is transmitted and received between arbitrary two computer users via a communication network (Internet or the like).

FIG. 24 is a block diagram illustrating an outline of an optical disc recording / reproducing device that performs encoding and decoding according to the present invention.

FIG. 25 is a diagram exemplifying a state in which an encoder according to the present invention is integrated into an IC.

FIG. 26 is a diagram exemplifying a state in which a decoder according to the present invention is integrated into an IC.

FIG. 27 is a diagram exemplifying a state in which an encoder and a decoder according to the present invention are integrated.

FIG. 28 is a diagram illustrating the position of a time stamp (PTS) in a sub-picture data block.

FIG. 29 is a diagram illustrating a data structure of a sub-picture packet.

FIG. 30 is a diagram exemplifying a correspondence relationship between sub-picture units arranged in series and a time stamp (PTS) and a display control sequence (DCSQ) described in the packet header of one of the sub-picture units.

FIG. 31 shows a sub-picture unit header (S
Of the parameters included in PUH), the sub-picture size and the start address (DC) of the display control sequence table
The figure explaining the relative address pointer of SQ.

FIG. 32 is a sub-picture display control sequence table (SPD
The figure explaining the structure of CSQT).

FIG. 33 is a diagram for explaining the contents of each parameter (DCSQ) that constitutes the table (SPDCSQT) of FIG. 32.

FIG. 34 is a sub-picture display control command (SPDCCM
The figure explaining the content of D).

FIG. 35 is a diagram for explaining the content of pixel control data (PCD).

36 is a diagram showing a command set illustrated in FIG.
The figure explaining the bit structure of the command FSTADSP which forcibly sets the display start timing of the pixel data of a subvideo.

37 is a diagram showing a command set illustrated in FIG.
The figure explaining the bit structure of command STADSP which sets the display start timing of the pixel data of a subvideo.

38 is a diagram showing a command set illustrated in FIG.
The figure explaining the bit structure of the command STPDSP which sets the display end timing of the pixel data of a subvideo.

FIG. 39 is a block diagram showing an example of the command set shown in FIG.
The figure explaining the bit structure of command SETCOLOR which sets the color code of the pixel data of a subpicture.

FIG. 40 is a diagram illustrating an example of color data processing inside a sub-picture data processor (for example, the decoder 101 in FIG. 11).

FIG. 41 is a block diagram showing the command set illustrated in FIG.
The figure explaining the bit structure of the command SETCONTR which sets the contrast between a subpicture and a main picture.

42 is a diagram showing the command set illustrated in FIG.
Command S to set the display area of sub-picture pixel data
The figure explaining the bit structure of ETDAREA.

FIG. 43 is a block diagram showing an example of the command set shown in FIG.
The figure explaining the bit structure of the command SETDSPXA which sets the display start address of sub-picture pixel data.

FIG. 44 is a block diagram showing an example of the command set shown in FIG.
The figure explaining the bit structure of command CHGCOLCON which switches the color and contrast of sub-picture pixel data.

FIG. 45 is a block diagram showing an example of the command set illustrated in FIG.
The figure explaining the bit structure of command CMDEND which ends the display control of a subpicture.

FIG. 46 is a block diagram of the pixel control data (PC
FIG. 6 is a diagram illustrating a bit configuration of line control information LCINF of a pixel line among parameters of D).

FIG. 47 is a block diagram of the pixel control data (PC
FIG. 6 is a diagram illustrating a bit configuration of pixel control information PCINF among parameters of D).

FIG. 48 is a diagram illustrating a specific example of a sub-picture display frame.

FIG. 49 is a diagram for specifically explaining what the contents of each parameter of the pixel control data (PCD) in FIG. 35 will be when the sub-picture display frame is as shown in FIG. 48.

FIG. 50 is a diagram for explaining a problem when sub-picture is bitmap data processed without using the present invention.

FIG. 51 is a view for further explaining the problem when processing a sub-picture without using the present invention.

FIG. 52 is a diagram for explaining how the buffering state of a sub-picture data block changes according to a sub-picture channel having a time stamp (PTS) when sub-picture data is decoded according to the present invention.

FIG. 53 is a flow chart for explaining an example of the sub-picture encoding processing procedure of the present invention, focusing on the processing of the display control sequence (DCSQ).

54 is a flow chart diagram illustrating an example of a procedure for performing parallel processing of pack decomposition and decoding of the sub-picture data stream encoded by the processing procedure of FIG. 53.

55 is a flowchart showing an example of the pack disassembling process shown in FIG. 54.

56 is a flowchart diagram illustrating an example of sub-picture decoding processing in FIG. 54.

FIG. 57 is a flowchart diagram illustrating another example of a parallel processing of pack decomposition and decoding of the sub-picture data stream encoded by the processing procedure of FIG. 53.

FIG. 58 is a diagram illustrating a method of recording sub-picture data (PXD) when the sub-picture display mode is the interlace mode.

FIG. 59 is a diagram showing a specific example of a display control sequence table in the packet shown in FIG. 29.

[Explanation of symbols]

1 ... File management information; 2 ... Video data; PH ... Packet header; 30 ... Sub-picture unit; 31 ... Sub-picture unit header SPUH; 32 ... Sub-picture pixel data PX
D; 33 ... Display control sequence table DCSQT; 1
01 ... Decoder; 102 ... Data I / O; 103 ... Encoded data dividing section; 104 ... Pixel color output section (FIFO type); 105 ... Memory control section; 106 ... Continuation code length detection section; 107 ... Run length setting Part; 108 ... Memory; 109
... Address control unit; 110 ... Display validity permission unit; 111 ...
Insufficient pixel color setting unit; 112 ... Microcomputer (M
PU or CPU); 113 ... Header division part; 114 ...
Line memory; 115 ... Selector; 118 ... Select signal generation unit; 120 ... System timer; 121 ... Buffer memory; 1210 ... Color register; 1220 ... Change color register; 200 ... Encoder; 202 ... Laser cutting device; 204 ... Optical disc master; 206 ... Two-sheet laminated high-density optical disk mass production facility; 202-206 ... Recording device; 210 ... Modulator / transmitter; 212 ... Broadcast unit / cable output unit; 300 ... Disc player (playback device);
00 ... Receiver / demodulator (reproducing device); 5001 (500
N) ... Personal computer; 5011 (501N)
Input / output devices 5021 (502N) External storage devices 5031 (503N) Encoder / decoder and modem 702 Modulator / laser driver 704
Optical head (recording laser); 706 ... Optical head (reading laser / laser pickup); 708 ... Demodulator / error correction unit; 710 ... Audio / video data processing unit (including sub-picture data decoding processing unit); OD ... Two high-density optical discs (recording media).

 ─────────────────────────────────────────────────── ─── Continuation of the front page (72) Inventor Hideki Mimura 70 Yanagimachi, Saiwai-ku, Kawasaki-shi, Kanagawa Toshiba Yanagimachi factory

Claims (71)

[Claims] 1. A reproduction start time of the sub-picture data packet expressed by using at least a reference time, in which sub-picture data that can be reproduced simultaneously with the main picture data is packetized in a predetermined unit and recorded in a recording medium. Including packet header information, sub-picture data that is the display content of the sub-picture, one or more display control sequence information indicating a control procedure for displaying the sub-picture using the sub-picture data, and the sub-picture. A data recording method, characterized in that the sub-picture packet is composed of sub-picture header information including a size of a data packet and a recording position of the display control sequence information. 2. A sub-picture data packet which can be reproduced simultaneously with the main picture data is packetized in a predetermined unit and recorded on a recording medium, and at least a reproduction start time of the sub-picture data packet expressed using a reference time. Including packet header information, sub-picture data that is the display content of the sub-picture, one or more display control sequence information indicating a control procedure for displaying the sub-picture using the sub-picture data, and the sub-picture. The sub-picture header information including the size of the data packet and the recording position of the display control sequence information constitutes the sub-picture packet; and the reproduction time of the sub-picture data packet in the packet header information is set to the sub-picture data. A data recording method characterized in that recording is performed only for the first sub-video data packet in a video data block. 3. The display control sequence information includes at least a display start time and a display end time of a sub-picture, a recording position of the sub-picture data to be displayed, and a display for the sub-picture data recorded at this recording position. The data recording method according to claim 1 or 2, comprising a control information group. 4. The data recording method according to claim 3, wherein the display start time and the display end time of the sub-picture are defined by relative time from the reproduction start time of the sub-picture data packet. . 5. As the display control information, display start control information for performing control for starting display of the sub-picture data based on the display start time included in the display control sequence information is recorded. The data recording method according to claim 3, wherein: 6. The display control information is recorded as display end control information for performing control such that display of the sub-picture data ends based on the display end time included in the display control sequence information. The data recording method according to claim 3, wherein: 7. The data recording method according to claim 3, wherein as the display control information, color setting information for setting a color for each pixel type of the sub-picture data is recorded. 8. The mixture ratio setting information for setting a mixture ratio for each pixel type of the sub-picture data with respect to the main picture is recorded as the display control information. Data recording method. 9. The data recording method according to claim 3, wherein display area setting information for setting a display area of the sub-picture data on the main picture is recorded as the display control information. . 10. The data recording method according to claim 3, wherein use range setting information for setting a range to be used for display in the sub-picture data is recorded as the display control information. . 11. The display control information includes a change in color of each sub-picture data for each pixel type and a change in a mixing ratio of each sub-picture data with respect to the main video for each pixel type.
4. The data recording method according to claim 3, wherein color / mixing ratio change setting information for setting in pixel units is recorded. 12. The data recording method according to claim 3, wherein display control end setting information for setting an end of display control of the sub-picture data is recorded as the display control information. 13. The sub-picture data, which can be reproduced simultaneously with the main picture data, is packetized and recorded in a predetermined unit, and the recorded data packet is represented by using at least a reference time. Packet header information including a reproduction start time of a data packet, sub-picture data that is the display content of the sub-picture, and one or more display control sequences indicating a control procedure for displaying the sub-picture using the sub-picture data. A recording medium comprising information and sub-picture header information including a size of the sub-picture data packet and a recording position of the display control sequence information. 14. The sub-picture data that can be simultaneously reproduced together with the main picture data is recorded in a packet in a predetermined unit, and the recorded data packet is at least the reference time. Packet header information including a reproduction start time of a data packet, sub-picture data that is the display content of the sub-picture, and one or more display control sequences indicating a control procedure for displaying the sub-picture using the sub-picture data. Information and sub-picture header information including the size of the sub-picture data packet and the recording position of the display control sequence information, and the reproduction time of the sub-picture data packet in the packet header information is the sub-picture data packet. A recording medium characterized in that it is recorded only for the first sub-picture data packet in the picture data block. 15. A sub-picture that is reproducible together with a main picture is packetized in a predetermined unit, packet header information including a time stamp representing a reproduction start time of a packet of the sub-picture; And sub-picture information including pixel data compressed by a predetermined method; and one or more display control sequences for controlling the order in which the sub-pictures are displayed using the sub-picture information. A method for encoding image information, characterized in that the sub-picture packet is encoded using display control sequence information including: sub-picture header information including a size of the sub-picture packet and a location of the display control sequence information. . 16. A sub-picture which is reproducible together with a main picture is packetized in a predetermined unit to pack a plurality of packetized image information, wherein: a) the first packet of the image data pack is:
Encoding is performed using the following: packet header information including a time stamp representing the reproduction start time of the packet of the sub-picture, pixel data that composes the sub-picture and is compressed by a predetermined method. Sub video information including, display control sequence information including one or more display control sequences for controlling an order of displaying the sub video using the sub video information, and size of the sub video packet and the display Sub-picture header information including location of control sequence information; b) Encode the second and subsequent packets of the image data pack using the following: Configure the sub-picture by a predetermined method. Sub-picture information including compressed pixel data, and controlling the order of displaying the sub-pictures using the sub-picture information Display control sequence information including one or more display control sequences, and sub-picture header information including a size of the sub-picture packet and a location of the display control sequence information. 17. The display control sequence information is specified by time data specifying a display start / end time of the sub-picture; address data specifying a position of the sub-picture to be displayed; and address data specified by the address data. 17. The encoding method according to claim 15, further comprising a display control command group for the sub-image to be displayed at different positions. 18. One frame of the sub-picture information is composed of a single field or two fields of a top field and a bottom field; when performing interlaced display of the sub-picture information, one frame of the sub-picture information is displayed.
A frame portion is separately arranged in each of the top field and the bottom field; when performing non-interlaced display of the sub-picture information, one frame of the sub-picture information is arranged in the single field. The encoding method according to claim 15 or 16. 19. The encoding method according to claim 17, wherein the time data is defined by a relative time with respect to a reproduction start time of the sub-picture packet. 20. A display start control for controlling a display control command in the display control command group to start displaying the sub-picture information based on the time data included in the display control sequence information. 18. The encoding method according to claim 17, wherein the encoding method includes information. 21. A display end control for performing control such that a display control command in the display control command group ends display of the sub-picture information based on the time data included in the display control sequence information. 18. The encoding method according to claim 17, wherein the encoding method includes information. 22. The encode according to claim 17, wherein the display control command in the display control command group includes pixel color setting information for setting a color of a pixel forming the sub-picture information. Method. 23. The encode according to claim 17, wherein the display control command in the display control command group includes contrast setting information for setting a mixing ratio of the main video and the sub video. Method. 24. The display control command in the display control command group includes sub-picture display area setting information for setting a display area of the sub-picture on the display area of the main picture. Item 17. The encoding method according to Item 17. 25. A display control command in the display control command group includes sub-picture use range setting information for setting a position used for displaying the content of the sub-picture on the display area of the sub-picture. 18. The encoding method according to claim 17, wherein: 26. A display control command in the display control command group changes the change of at least one of a color of a pixel forming the sub-picture information and a contrast of the sub-picture with respect to the main picture by the sub-picture. 18. The encoding method according to claim 17, further comprising color / contrast switching control information for setting in units of pixels forming video information. 27. The encoding method according to claim 17, wherein the display control command in the display control command group includes a display control end command for instructing the end of display control of the sub-picture. 28. Information for packetizing sub video reproducible together with the main video in a predetermined unit is held, and packet header information including a time stamp expressing a reproduction start time of the packet of the sub video. Sub-picture header information including the size of the sub-picture packet; sub-picture information that constitutes the sub-picture and includes pixel data compressed by a predetermined method; and the sub-picture information using the sub-picture information. A recording medium for image information, characterized in that display control sequence information including one or more display control sequences for controlling the order of displaying images is recorded. 29. A sub-picture that can be reproduced together with the main picture is packetized in a predetermined unit, and a plurality of pieces of packetized image information are held as a pack, and a) the top of the image data pack is stored. Regarding the packet, packet header information including a time stamp representing the reproduction start time of the packet of the sub-picture; sub-picture header information including the size of the sub-picture packet; Sub-picture information including pixel data compressed by the above method; and display control sequence information including one or more display control sequences for controlling the order of displaying the sub-pictures using the sub-picture information. B) for the second and subsequent packets of the image data pack, sub-picture header information including the size of the sub-picture packet Sub-picture information that constitutes the sub-picture and includes pixel data compressed by a predetermined method; and one or more for controlling the order in which the sub-picture is displayed using the sub-picture information A recording medium for image information, characterized in that display control sequence information including the above display control sequence is recorded. 30. Packetizing sub video that can be played back together with a main video in a predetermined unit, wherein packet header information including a time stamp representing a reproduction start time of a packet of the sub video is created; Creating sub-picture header information including packet size and location of the display control sequence information; creating sub-picture information that constitutes the sub-picture and includes pixel data compressed by a predetermined method; For controlling the order of displaying the sub-pictures using the sub-picture information,
A method for encoding image information, characterized in that display control sequence information including one or more display control sequences is created. 31. A sub-picture which is reproducible together with a main picture is packetized in a predetermined unit to pack a plurality of packetized image information, wherein: a) the first packet of the image data pack is:
Encoding is performed as follows: packet header information including a time stamp representing the reproduction start time of the sub-picture packet is created, and a sub-picture header including the size of the sub-picture packet and the location of the display control sequence information. Information is created, sub-picture information that composes the sub-picture and includes pixel data compressed by a predetermined method is created, and the order in which the sub-picture is displayed is controlled using the sub-picture information. Display control sequence information including one or more display control sequences for performing the following: b) The second and subsequent packets of the image data pack are encoded as follows: the sub-picture packet Sub-picture header information including the size of the sub-picture header and the location of the display control sequence information, One or more for creating sub-picture information that constitutes an image and includes pixel data compressed by a predetermined method, and controlling the order of displaying the sub-picture using the sub-picture information. Display control sequence information including the above display control sequence is created. 32. A sub-picture that can be reproduced together with the main picture is packetized in a predetermined unit, wherein the contents of the sub-picture are converted into bitmap data; a display area of the sub-picture on the display area of the main picture is displayed. Creating the set spatial parameter; creating pixel data by compressing the contents of the sub-picture converted into bitmap data by a predetermined method; specifying the display start timing and the display end timing of the sub-picture Creating a temporal parameter; creating one or more display control sequence tables for controlling the order of displaying the sub-pictures; a sub-comprising a packet size of the sub-picture and a location of the display control sequence table A video unit header is created, and the compressed pixel data and the compressed pixel data are added to the sub video unit header. A sub-picture unit is created by adding the display control sequence table; if the size of the created sub-picture unit is greater than or equal to a predetermined value, the created sub-picture unit is packetized; A packet or a sub-picture unit having a size within the predetermined value is recorded with a time stamp representing the reproduction start time of the sub-picture; the packet of the sub-picture unit in which the time stamp is recorded, or the time stamp is recorded. A method for encoding image information, characterized in that the packed sub-picture unit is packed and the data of the packed sub-picture unit is streamed together with other data. 33. A sub-picture which is reproducible together with the main picture is packetized in a predetermined unit, wherein the contents of the sub-picture are converted into bitmap data; a display area of the sub-picture on the display area of the main picture. Create the set spatial parameter; encode the contents of the sub-picture converted into bitmap data by a predetermined method to create compressed pixel data; display start timing and display end timing of the sub-picture Creating one or more display control sequence tables for controlling the order in which the sub-pictures are displayed; packet size of the sub-pictures and the display control sequence table Create a sub-picture unit header containing the location, and in this sub-picture unit header the compressed pixel The addition of over data and the display control sequence table, to create a sub-picture unit; size of sub-picture unit which is created packetizes the sub-picture units created if more than a predetermined value;
A packet of a sub-picture unit having a size equal to or larger than the predetermined value,
Alternatively, a time stamp expressing the reproduction start time of the sub video is recorded in the sub video unit having a size within the predetermined value; the packet of the sub video unit in which the time stamp is recorded, or the time stamp is recorded. Packing a sub-picture unit, streaming the data of the packed sub-picture unit together with other data; separating the data of the packed sub-picture unit from the streamed data; separating the sub-picture Disassembling a pack of video units; extracting the time stamp if the time stamp is recorded in the disassembled pack; comparing the time indicated by a predetermined system timer with the content of the extracted time stamp, When both match, the contents of one or more of the display control sequence tables Zui and the compressed pixel data and decompressing, the encoding / decoding system of the image information and generates the sub-picture before being encoded. 34. A time stamp representing a reproduction start time of a sub-picture which is bit-mapped and packetized, and 1 for controlling an order of displaying the sub-picture.
Or more display control sequence table, pixel data obtained by compressing the bitmap data of the sub-picture,
A sub-picture unit including a sub-picture unit header including a size of a packet of the sub-picture and a location of the display control sequence table is decoded to decode a data stream in which a plurality of sub-picture units are packed. Data of sub-picture unit is separated; pack of the separated sub-picture unit is decomposed; if the time stamp is recorded in the decomposed pack, this time stamp is extracted; and a predetermined system timer indicates The time is compared to the content of the extracted time stamp, and when they match, the compressed pixel data is decompressed and encoded based on the content of one or more of the display control sequence tables. Image information decoupling characterized by generating the sub-picture before Method. 35. A device for packetizing a sub-image reproducible together with a main image in a predetermined unit, and means for generating packet header information including a time stamp representing a reproduction start time of the packet of the sub-image;
Means for generating sub-picture information that constitutes the sub-picture and includes pixel data compressed by a predetermined method; for controlling the order of displaying the sub-picture using the sub-picture information, Means for generating display control sequence information including one or more display control sequences; sub-picture header information including a size of the sub-picture packet and a location of the display control sequence information, the compressed pixel data, Means for generating each unit of the sub-picture packet using the one or more display control sequences; and an image information encoding apparatus. 36. An encoding device for packetizing a sub-image reproducible together with a main image in a predetermined unit to pack a plurality of packetized image information, the encoding device comprising the following means: a) For the first packet of the image data pack,
First means for encoding using the following: packet header information including a time stamp representing the reproduction start time of the packet of the sub-picture, constituting the sub-picture, compressed by a predetermined method Sub-picture information including pixel data, display control sequence information including one or more display control sequences for controlling an order of displaying the sub-pictures using the sub-picture information, and size of the sub-picture packet And sub-picture header information including the location of the display control sequence information; b) Second means for encoding the second and subsequent packets of the image data pack using the following:
Sub-picture information that constitutes the sub-picture and includes pixel data compressed by a predetermined method, and one or more for controlling the order in which the sub-picture is displayed using the sub-picture information. Display control sequence information including a display control sequence, and sub-picture header information including a size of the sub-picture packet and a location of the display control sequence information. 37. In a sub-video which is reproducible together with a main video, is packetized in a predetermined unit, packet header information including a time stamp representing a reproduction start time of a packet of the sub-video; And sub-picture information including pixel data compressed by a predetermined method; and one or more display control sequences for controlling the order in which the sub-pictures are displayed using the sub-picture information. The sub-video packet is encoded using display control sequence information including; sub-video header information including the size of the sub-video packet and the location of the display control sequence information; and a data stream of the encoded sub-video packet is broadcast. An image information broadcasting system characterized by: 38. A broadcasting system for packetizing a sub video reproducible together with a main video in a predetermined unit and packing a plurality of packetized image information, characterized in that: a) the image data For the first packet of the pack,
Encoding is performed using the following: packet header information including a time stamp representing the reproduction start time of the packet of the sub-picture, pixel data that composes the sub-picture and is compressed by a predetermined method. Sub video information including, display control sequence information including one or more display control sequences for controlling an order of displaying the sub video using the sub video information, and size of the sub video packet and the display Sub-picture header information including location of control sequence information; b) Encode the second and subsequent packets of the image data pack using the following: Configure the sub-picture by a predetermined method. Sub-picture information including compressed pixel data, and controlling the order of displaying the sub-pictures using the sub-picture information Display control sequence information including one or more display control sequences, sub-picture header information including a size of the sub-picture packet and a location of the display control sequence information, and C) a data stream of encoded sub-picture packets. To broadcast. 39. A sub-picture that can be reproduced together with the main picture is packetized in a predetermined unit, and means for converting the contents of the sub-picture into bitmap data;
Means for creating a spatial parameter for setting the display area of the sub-picture on the display area of the main picture; and creating pixel data by compressing the contents of the sub-picture converted into bitmap data by a predetermined method. Means for creating a temporal parameter for specifying the display start timing and the display end timing of the sub-picture; and one or more display control sequence tables for controlling the order of displaying the sub-pictures. Creating means for creating a sub-picture unit header including the size of the sub-picture packet and the location of the display control sequence table, and adding the compressed pixel data and the display control sequence table to the sub-picture unit header By this means, means for creating a sub-picture unit; created sub-picture unit Means for packetizing the created sub-picture unit if the size is equal to or larger than a predetermined value; reproduction of the sub-picture in a packet of the sub-picture unit having a size not smaller than the predetermined value, or to a sub-picture unit having a size not larger than the predetermined value Means for recording a time stamp representing the start time; packet of the sub-picture unit in which the time stamp is recorded, or sub-picture unit in which the time stamp is recorded, and data of the packed sub-picture unit And a means for converting the stream into a stream together with other data; and an image information encoding apparatus. 40. A sub-picture that can be reproduced together with the main picture is packetized in a predetermined unit, and means for converting the content of the sub-picture into bitmap data.
Means for creating a spatial parameter for setting the display area of the sub-picture on the display area of the main picture; and creating pixel data by compressing the contents of the sub-picture converted into bitmap data by a predetermined method. Means for creating a temporal parameter for specifying the display start timing and the display end timing of the sub-picture; and one or more display control sequence tables for controlling the order of displaying the sub-pictures. Creating means for creating a sub-picture unit header including the size of the sub-picture packet and the location of the display control sequence table, and adding the compressed pixel data and the display control sequence table to the sub-picture unit header By this means, means for creating a sub-picture unit; created sub-picture unit Means for packetizing the created sub-picture unit if the size is equal to or larger than a predetermined value; reproduction of the sub-picture in a packet of the sub-picture unit having a size not smaller than the predetermined value, or to a sub-picture unit having a size not larger than the predetermined value Means for recording a time stamp representing the start time; packet of the sub-picture unit in which the time stamp is recorded, or sub-picture unit in which the time stamp is recorded, and data of the packed sub-picture unit Means for streaming together with other data; means for separating the data of the packed sub-picture unit from the streamed data; means for disassembling the pack of the separated sub-picture unit; If the time stamp is recorded in the selected pack, extract this time stamp. And the time indicated by a predetermined system timer is compared with the contents of the extracted time stamp, and when the two match, the compressed data is compressed based on one or more contents of the display control sequence table. Means for decompressing pixel data to generate the sub-picture before being encoded; and a device for encoding / decoding image information. 41. A time stamp representing a reproduction start time of a sub-picture that is bit-mapped and packetized, and 1 for controlling an order of displaying the sub-picture.
Or a sub-picture unit including a display control sequence table or more, pixel data obtained by compressing and encoding the bitmap data of the sub-picture, and a sub-picture unit header including the size of the sub-picture packet and the location of the display control sequence table. Decoding a data stream in which a plurality of video units are packed, means for separating data of the packed sub-picture unit from the data stream; means for disassembling a pack of the separated sub-picture units A means for extracting the time stamp if the time stamp is recorded in the disassembled pack; a time indicated by a predetermined system timer is compared with the content of the extracted time stamp, and when both match And one or more of the above display control sequences A unit for expanding the compressed pixel data based on the contents of the stable to generate the sub-picture before being encoded; 42. A sub-picture which is reproducible together with the main picture is packetized in a predetermined unit, and means for converting the content of the sub-picture into bitmap data.
Means for creating a spatial parameter for setting the display area of the sub-picture on the display area of the main picture; and creating pixel data by compressing the contents of the sub-picture converted into bitmap data by a predetermined method. Means for creating a temporal parameter for specifying the display start timing and the display end timing of the sub-picture; and one or more display control sequence tables for controlling the order of displaying the sub-pictures. Creating means for creating a sub-picture unit header including the size of the sub-picture packet and the location of the display control sequence table, and adding the compressed pixel data and the display control sequence table to the sub-picture unit header By this means, means for creating a sub-picture unit; created sub-picture unit Means for packetizing the created sub-picture unit if the size is equal to or larger than a predetermined value; reproduction of the sub-picture in a packet of the sub-picture unit having a size not smaller than the predetermined value, or to a sub-picture unit having a size not larger than the predetermined value Means for recording a time stamp representing the start time; packet of the sub-picture unit in which the time stamp is recorded, or sub-picture unit in which the time stamp is recorded, and data of the packed sub-picture unit A recording device comprising: a means for streaming the stream together with other data; a means for recording information including the streamed sub-picture unit pack on a recording medium. 43. A time stamp representing a reproduction start time of a sub-picture which is bit-mapped and packetized, and 1 for controlling an order of displaying the sub-picture.
Or more display control sequence table, pixel data obtained by compressing the bitmap data of the sub-picture,
The content of the data stream is reproduced from a recording medium on which a data stream in which a plurality of sub-picture units including a sub-picture unit header including the size of the sub-picture packet and the location of the display control sequence table is recorded is recorded. A means for separating the data of the packed sub-picture unit from the data stream; a means for disassembling the pack of the separated sub-picture unit; a time stamp being recorded on the decomposed pack Means for extracting this time stamp; comparing the time indicated by a predetermined system timer with the content of the extracted time stamp, and when both match, one or more display control sequence tables Decompress the compressed pixel data based on the contents of And a means for generating the sub-picture before being encoded. 44. A sub-picture that is reproducible together with the main picture is packetized in a predetermined unit, and packet header information including a time stamp representing a reproduction start time of the packet of the sub-picture; And sub-picture information including pixel data compressed by a predetermined method; and one or more display controls for controlling the order in which the sub-pictures are displayed using the sub-picture information. Encoding the sub-picture packet using display control sequence information including a sequence; sub-picture header information including a size of the sub-picture packet and a location of the display control sequence information; A compressed data identification step of identifying a data block of one compression unit;
An encoding header corresponding to the same number of consecutive pixel data in the data block of compression unit, continuous pixel number data indicating the number of consecutive same pixel data, and data indicating the same pixel data itself in the data block of one compression unit. And a compressed data generating step of generating a compressed unit data block; 45. A time stamp representing a reproduction start time of a sub-picture which is bit-mapped and packetized, and 1 for controlling an order of displaying the sub-picture.
Or more display control sequence table, pixel data obtained by compressing the bitmap data of the sub-picture,
A sub-picture unit including a sub-picture unit header including a size of a packet of the sub-picture and a location of the display control sequence table is decoded for decoding a plurality of packed data streams. The data of the separated sub-picture unit is separated; the pack of the separated sub-picture unit is decomposed; if the time stamp is recorded in the decomposed pack, this time stamp is extracted; a predetermined system timer Is compared with the content of the extracted time stamp, and when the two match, the compressed pixel data is expanded based on the content of one or more of the display control sequence tables, In generating the sub-picture before being encoded, the compressed An encoding header extraction step of extracting an encoding header from a data block of one compression unit of the raw data; and data of one compression unit based on the content of the encoding header extracted in the encoding header extraction step A continuous pixel number extracting step of extracting continuous pixel number data from the block; an encoded header extracted in the encoding header extracting step and a continuous pixel number extracting step from the data block of one compression unit Pixel data determination step of determining the content of the pixel data before compression that has constituted the data block of one compression unit based on the remainder obtained by subtracting the continuous pixel number data; and determined by the pixel data determination step. The bit data of the content is extracted in the continuous pixel number extraction step. A pixel pattern restoration step of arranging by the bit length indicated by the continuous pixel count data to restore the pixel pattern before compression in the one compression unit; 46. A sub-picture which is reproducible together with a main picture is packetized in a predetermined unit, packet header information including a time stamp representing a reproduction start time of a packet of the sub-picture; and the sub-picture. And sub-picture information including pixel data compressed by a predetermined method; and one or more display control sequences for controlling the order in which the sub-pictures are displayed using the sub-picture information. Display control sequence information including; display control start time information included in the display control sequence, address information of a subsequent display control sequence,
And encoding the sub-picture packet using one or more display control commands; sub-picture header information including the size of the sub-picture packet and the location of the display control sequence information. Method. 47. A sub-video that is reproducible together with the main video is packetized in a predetermined unit, and packet header information including a time stamp representing a reproduction start time of the packet of the sub-video; And sub-picture information including pixel data compressed by a predetermined method; and one or more display control sequences for controlling the order in which the sub-pictures are displayed using the sub-picture information. Display control sequence information including; sub-picture header information including the size of the sub-picture packet and the location of the display control sequence information; sub-picture size information and start address information of the display control sequence included in the sub-picture header information And ;; are used to encode the sub-picture packet, and the image information encoding method is characterized. 48. A sub-video that is reproducible together with the main video is packetized in a predetermined unit, and packet header information including a time stamp representing a reproduction start time of the packet of the sub-video; And sub-picture information including pixel data compressed by a predetermined method; and one or more display control sequences for controlling the order in which the sub-pictures are displayed using the sub-picture information. Display control sequence information including; display control start time information included in the display control sequence, address information of a subsequent display control sequence,
And one or more display control commands; sub-picture header information including the size of the sub-picture packet and the location of the display control sequence information; start of sub-picture size information and display control sequence included in the sub-picture header information An image information encoding method, characterized in that the sub-picture packet is encoded using address information and. 49. The one or more display control commands include a command for setting a display start timing of a pixel corresponding to the pixel data, a command for setting a display end timing of a pixel corresponding to the pixel data, and the pixel The encoding method according to claim 46, further comprising a command for setting a display area of a pixel corresponding to data and a command for setting a display start address of a pixel corresponding to the pixel data. 50. The encoding method according to claim 49, wherein the one or more display control commands further include a command for setting a color code of the pixel data. 51. The one or more display control commands further include a command to set a contrast of the pixel data with respect to the main image.
The encoding method described in 0. 52. The one or more display control commands further include a command for setting switching of at least one of a color code of the pixel data and a contrast of the pixel data with respect to the main image. Encoding method described in. 53. A packet header, which is reproducible together with a main image and packetizes an interlaced sub-image in a predetermined unit, including a time stamp representing a reproduction start time of a packet of the sub-image. Information; first sub-picture information which constitutes a top field of one picture frame for displaying the sub-picture and includes pixel data compressed by a predetermined method; and one picture for displaying the sub-picture Second sub-picture information that constitutes a bottom field of the frame and includes pixel data compressed by the predetermined method; and displays the sub-picture using the first and second sub-picture information. Display control sequence information including one or more display control sequences for controlling order; included in the display control sequence, Display control start time information, address information of a subsequent display control sequence, and one or more display control commands; included in the display control command and setting a display start address of a pixel of the top field; A second command included in the display control command for setting the display start address of the pixel of the bottom field; and a sub-picture including the size of the sub-picture packet and the location of the display control sequence information. An image information encoding method, characterized in that the sub-picture packet is encoded using header information. 54. In the packetization of a sub-picture reproducible together with the main picture in a predetermined unit, packet header information including a time stamp representing a reproduction start time of the packet of the sub-picture; and the sub-picture. And sub-picture information including pixel data compressed by a predetermined method; and one or more display control sequences for controlling the order in which the sub-pictures are displayed using the sub-picture information. Display control sequence information including; pixel control data for controlling at least one of color and contrast while a sub-picture corresponding to the compressed pixel data is displayed; size of the sub-picture packet and the display control sequence Encoding the sub-picture packet using sub-picture header information including the location of the information; Encoding method of the image information to be. 55. The sub-picture is displayed in a sub-picture frame composed of a plurality of lines, and the pixel control data is a line of the plurality of lines of the sub-picture frame in which color or contrast of the pixel data changes. And line control information indicating the position of a pixel where a change in color or contrast occurs in a line of the sub-picture frame indicated by the line control information.
4. The encoding method according to 4. 56. A means for packetizing a sub-picture reproducible together with the main picture in a predetermined unit and then communicating the packetized information, and means for converting the content of the sub-picture into bitmap data.
Means for creating a spatial parameter for setting the display area of the sub-picture on the display area for the main picture; means for creating data obtained by compressing the content of the sub-picture converted into bitmap data by a predetermined method Means for creating a temporal parameter for specifying a display start timing and a display end timing of the sub-picture; and one or more display control sequence tables for controlling the order of displaying the sub-picture Creating a sub-picture unit header including the packet size of the sub-picture and the location of the display control sequence table, and adding the compressed data and the display control sequence table to the sub-picture unit header. , Means for creating a sub-picture unit; size of the created sub-picture unit Means for packetizing the created sub-picture unit if the value is equal to or more than a predetermined value; a packet of the sub-picture unit having a size not less than the predetermined value, or a sub-picture unit having a size not more than the predetermined value, the reproduction start time of the sub-picture Means for recording a time stamp expressing the above; or a packet of the sub-picture unit in which the time stamp is recorded, or a sub-picture unit in which the time stamp is recorded, is packed, and the data of the packed sub-picture unit is Means for streaming together with the data of; stream transmitting data for transmitting the streamed data; receiving means for receiving the streamed data transmitted by the transmitting means; streamed data received by the receiving means Means for separating the data of the packed sub-picture unit from the; Means for disassembling the pack of the sub-picture unit that has been decomposed; means for extracting the time stamp if the time stamp is recorded in the decomposed pack; and a time indicated by a predetermined system timer for the extracted time. The contents of the stamp are compared with each other, and when they match each other, the compressed data is expanded based on the contents of the one or more display control sequence tables to generate the sub-picture before being encoded. An image information transmission / reception system, comprising: 57. A method for packetizing sub-information that can be reproduced together with main information in a predetermined unit and then communicating the packetized information, wherein the content of the sub-information is compressed by a predetermined method to create data. Means for creating a temporal parameter for specifying the display start timing and display end timing of the sub information; and one or more display control sequence tables for controlling the order of displaying the sub information Creating a sub-information unit header including the packet size of the sub-information and the location of the display control sequence table, and adding the compressed data and the display control sequence table to the sub-information unit header. , A means for creating a sub-information unit; a size of the created sub-information unit Means for packetizing the created sub-information unit if the value is equal to or more than a predetermined value; start of reproduction of the sub-information in a packet of the sub-information unit having a size not less than the predetermined value or a sub-information unit having a size not more than the predetermined value Means for recording a time stamp representing time; packet of the sub information unit recorded with the time stamp, or the sub information unit recorded with the time stamp is packed, and data of the packed sub information unit is packed. Streaming means; Sending means for sending the streamed data; Receiving means for receiving the streamed data sent by the sending means; The pack from the streamed data received by the receiving means Means for separating the data of the divided sub-information unit; said separated sub-information unit A means for disassembling the packet pack; a means for extracting the time stamp if the time stamp is recorded in the decomposed pack; and a time indicated by a predetermined system timer as the content of the extracted time stamp. Means for comparing and, when they match, decompressing the compressed data based on one or more contents of the display control sequence table to generate the sub-information before being encoded; An information transmission / reception system comprising: 58. A packet header information including a time stamp representing a use start time of a packet of the sub information, wherein the sub information usable together with the main information is packetized in a predetermined unit; and the sub information is configured. Compression information including data compressed by a predetermined method; and control sequence information including one or more control sequences for controlling the order of using the sub-information by using the compression information. And a sub-information header information including a size of the sub-information packet and a location of the control sequence information; and the sub-information packet is encoded. 59. A packet header information including a time stamp representing a use start time of a packet of the sub information, wherein the sub information usable together with the main information is packetized in a predetermined unit; and the sub information is configured. And processing sequence information including data processed by a predetermined method; control sequence information including one or more control sequences for controlling the order in which the sub information is used by using the processing information. And a sub-information header information including a size of the sub-information packet and a location of the control sequence information; and the sub-information packet is encoded. 60. A sub-information which can be used together with the main information is packetized in a predetermined unit and a plurality of packetized information is packed. A) As for the head packet of the information pack, Encode using: packet header information including a time stamp representing the use start time of the packet of the sub-information, compression information including data that constitutes the sub-information and is compressed by a predetermined method, Control sequence information including one or more control sequences for controlling an order of using the sub information with compressed information, and a sub information header including a size of the sub information packet and a location of the control sequence information. Information; b) For the second and subsequent packets of the information pack,
Encode using the following: compression information that composes the sub-information and that includes data compressed by a predetermined method, to control the order in which the sub-information is used using the compression information , Control sequence information including one or more control sequences, and sub-information header information including a size of the sub-information packet and a location of the control sequence information. 61. A sub-information usable in combination with the main information is packetized in a predetermined unit to pack a plurality of packetized information, wherein a) the head packet of the information pack is: Encoding using: packet header information including a time stamp representing the use start time of the packet of the sub-information, processing information including the data that constitutes the sub-information and is processed by a predetermined method, Control sequence information including one or more control sequences for controlling an order of using the sub information with processing information, and a sub information header including a size of the sub information packet and a location of the control sequence information. Information; b) For the second and subsequent packets of the information pack,
Encode using the following: processing information that composes the sub-information and includes data processed in a predetermined manner, to control the order in which the sub-information is used using the processing information , Control sequence information including one or more control sequences, and sub-information header information including a size of the sub-information packet and a location of the control sequence information. 62. Information for packetizing sub-information usable in combination with the main information in a predetermined unit is held, and packet header information including a time stamp expressing a use start time of the packet of the sub-information. Sub-information header information including the size of the sub-information packet; compression information including the data that constitutes the sub-information and is compressed by a predetermined method; and uses the sub-information by using the compression information. An information recording medium, on which control sequence information including one or more control sequences for controlling the order of recording is recorded. 63. Information for packetizing sub-information that can be used together with main information in a predetermined unit is held, and packet header information including a time stamp representing a use start time of a packet of the sub-information. Sub-information header information including the size of the sub-information packet; processing information including the data that constitutes the sub-information and processed by a predetermined method; and uses the sub-information by using the processing information. An information recording medium, on which control sequence information including one or more control sequences for controlling the order of recording is recorded. 64. In a method of packetizing sub information usable with main information in a predetermined unit, a spatial parameter for setting a use area of the sub information on a use area of the main information is created; The content of the sub-information is encoded by a predetermined method to create compressed data; temporal parameters for specifying the use start timing and the use end timing of the sub-information are created; the order of using the sub-information Creating one or more control sequence tables for controlling a sub-information unit header, the sub-information unit header including a size of a packet of the sub-information and a location of the control sequence table; A sub-information unit is created by adding the data and the control sequence table described above; If the size of the sub-information unit is equal to or larger than a predetermined value, the created sub-information unit is packetized; the sub-information unit having a size equal to or larger than the predetermined value or the sub-information unit having a size within the predetermined value is added to the sub-information. A time stamp representing the start time of use of the sub information unit in which the time stamp is recorded, or the sub information unit in which the time stamp is recorded is packed, and the data of the packed sub information unit is packed. With the other data; separating the packed sub-information unit data from the streamed data; decomposing the separated sub-information unit pack; If recorded, extract this time stamp; a predetermined system timer indicates Time is compared with the content of the extracted time stamp, and when they match, the compressed data is decompressed and encoded based on the content of one or more of the control sequence tables. An encoding / decoding system for information, characterized in that said sub-information before is generated. 65. In a method of packetizing sub information usable together with main information in a predetermined unit, a spatial parameter for setting a use area of the sub information on a use area of the main information is created; To create data in which the contents of the sub information are encoded by a predetermined method; to create a temporal parameter for specifying the use start timing and the use end timing of the sub information; to control the order of using the sub information Creating one or more control sequence tables of; a sub information unit header containing the size of the packet of said sub information and the location of said control sequence table, and in this sub information unit header said decoded data and said Creating a sub-information unit by adding a control sequence table; If the size of the information unit is greater than or equal to a predetermined value, the created sub-information unit is packetized; use of the sub-information in a packet of the sub-information unit having a size greater than or equal to the predetermined value or in a sub-information unit having a size within the predetermined value A time stamp expressing a start time is recorded; a packet of the sub information unit recorded with the time stamp or the sub information unit recorded with the time stamp is packed, and the data of the packed sub information unit is The data of the packed sub information unit is separated from the streamed data; the pack of the separated sub information unit is decomposed; the time stamp is recorded in the decomposed pack. If so, extract this timestamp; the time indicated by the given system timer Is compared with the content of the extracted time stamp, and when they match each other, the encoded data is decoded based on the content of one or more of the control sequence tables, before being encoded. An information encoding / decoding system characterized by generating the sub-information. 66. A packet header information including a time stamp representing a use start time of a packet of the sub information, wherein the sub information usable together with the main information is packetized in a predetermined unit; and the sub information is configured. Compression information including data compressed by a predetermined method; and control sequence information including one or more control sequences for controlling the order of using the sub-information by using the compression information. And; sub-information header information including the size of the sub-information packet and the location of the control sequence information; and encoding the sub-information packet and broadcasting a data stream of the encoded sub-information packet. Information broadcasting system. 67. In the sub-packetizing of sub-information usable together with the main information in a predetermined unit, packet header information including a time stamp representing a use start time of the packet of the sub-information; And processing sequence information including data processed by a predetermined method; control sequence information including one or more control sequences for controlling the order in which the sub information is used by using the processing information. And; sub-information header information including the size of the sub-information packet and the location of the control sequence information; and encoding the sub-information packet and broadcasting a data stream of the encoded sub-information packet. Information broadcasting system. 68. A time stamp representing the use start time of packetized information, one or more control sequence tables for controlling the order in which the packetized information is used, and at least the packetized information. A data stream in which a plurality of information units, each of which includes compression-encoded data and an information unit header including a packet size of the packetization information and a location of the control sequence table, is decoded. Means for separating the data of the packed information unit from; means for disassembling the separated pack of information units; if the time stamp is recorded in the decomposed pack, this time stamp is extracted Means to do; predetermined system ties Is compared with the content of the extracted time stamp, and when both match, the compressed encoded data is decompressed and encoded based on the content of one or more of the control sequence tables. Decoding means for decoding the contents of the packetized information before being processed. 69. A time stamp representing the use start time of packetized information, one or more control sequence tables for controlling the order in which the packetized information is used, and at least the packetized information. Decoding a data stream in which a plurality of information units including partially encoded data and an information unit header including a packet size of the packetization information and a location of the control sequence table are decoded, wherein: Means for separating the data of the packed information unit; means for disassembling the separated information unit pack; and if the time stamp is recorded in the disassembled pack, this time stamp is extracted. Means and; predetermined system timer Time is compared with the content of the extracted time stamp, and when both match, the encoded data is decoded and encoded based on the content of one or more control sequence tables. Means for generating the contents of the previous packetization information; and the decoding device. 70. A sub-information packetized in a predetermined unit that can be used together with the main information, and then the packetized information is communicated. A means for creating data by compressing the contents of the sub-information by a predetermined method. Means for creating a temporal parameter for specifying a use start timing and a use end timing of the sub information; and one or more control sequence tables for controlling the order of using the sub information A sub information unit header including a size of the packet of the sub information and a location of the control sequence table, and adding the compressed data and the control sequence table to the sub information unit header, Means to create units;
Means for packetizing the created sub-information unit if the size of the created sub-information unit is greater than or equal to a predetermined value; a packet of the sub-information unit having a size equal to or greater than the predetermined value, or a sub-information unit having a size within the predetermined value Means for recording a time stamp expressing the start time of use of the sub information; and a packet of the sub information unit recorded with the time stamp or the sub information unit recorded with the time stamp is packed and packed. Means for streaming data of the sub-information unit which has been converted; transmission means for transmitting the streamed data; receiving means for receiving the streamed data transmitted by the transmitting means; received by the receiving means A method of separating the data of the packed sub-information unit from the streamed data A means for disassembling the separated pack of sub-information units; a means for extracting the time stamp if the time stamp is recorded in the disassembled pack; and a time indicated by a predetermined system timer, The contents of the extracted time stamp are compared, and when they match each other, the compressed data is decompressed based on the contents of the one or more control sequence tables, and the sub data before being encoded is decompressed. An information transmission / reception system comprising: means for generating information. 71. A sub-information which can be used together with the main information is packetized in a predetermined unit and then the packetized information is communicated. A means for creating data by encoding the content of the sub-information in a predetermined method. Means for creating a temporal parameter for specifying a use start timing and a use end timing of the sub information; and one or more control sequence tables for controlling the order of using the sub information A sub information unit header including a size of the packet of the sub information and a location of the control sequence table, and adding the compressed data and the control sequence table to the sub information unit header, Means for creating units; the size of the created sub-information unit is Means for packetizing the created sub-information unit if the value is greater than or equal to the value; Means for recording the expressed time stamp; packet of the sub information unit recorded with the time stamp, or pack the sub information unit recorded with the time stamp, and stream data of the packed sub information unit Means for transmitting the streamed data, receiving means for receiving the streamed data transmitted by the transmitting means, and packed from the streamed data received by the receiving means Means for separating the data of the separated sub-information unit; Means for disassembling the clock; means for extracting the time stamp if the time stamp is recorded in the decomposed pack; and comparing the time indicated by a predetermined system timer with the content of the extracted time stamp. And a means for decoding the encoded data based on the contents of one or more of the control sequence table to generate the sub-information before being encoded, when both match. An information transmission / reception system characterized by the above.