JPH08241068A - Information recording medium, device and method for decoding bit map data - Google Patents

Abstract

PURPOSE: To deal with captions of various character kinds and plural languages without using a character ROM. CONSTITUTION: A data type code for identifying caption information from other information exists in an identification part 504 of an AV file 510 on an information recording medium. Further, a user data part 505 consists of the basic data 530 consisting of the display time information of the storing caption and the size information/positional information to be displayed of the caption, the gradation data 533 consisting of two sets of filter/quantization information according to the pattern data and the fringe data and color information (containing a mixture ratio) and a caption compression data 534 being the main body of the caption information compressing the bit map data.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an information recording medium for displaying a bit map pattern such as characters and graphics in synchronization with an image or a sound, a bit map data decoding device, and a bit map data decoding method. Is.

[0002]

2. Description of the Related Art Conventionally, as a method of displaying text (subtitles) on a display screen, closed caption (Cl
There is an osed Caption). The closed caption method was developed in the United States, and its purpose is to display characters (US language) in synchronization with images and sounds for people who are deaf or who do not speak US native language.

Closed caption signals are included in TV broadcasting, video, laser discs, etc.
It is in the line 21 for each field of the SC signal and is decoded by the decoder to obtain data. The obtained data consists of a character-based character string indicating the text (subtitle) body and control codes such as display format, position, and color. Then, the decoder expands the text (subtitle) on the memory while referring to the character ROM having the control code and the shape information of the embedded character, and performs overlay processing synchronized with the image from the memory and displays it on the screen. .

[0004]

However, the above structure has the following problems.

The character ROM has a plurality of binary bit map data in which the number of dots of width and height is fixed (for example, bit map data of 7 * 13 dots is 256).
Have one). Therefore, the area around the font body is a rectangular area of any color, and the image cannot be displayed. The size of the rows and columns of characters to be displayed is also predetermined (for example, 3
2 * 8 lines).

In the closed caption system: A) Since the above character ROM is used, (1) it is necessary to have a ROM. (2) Since the number of fonts is fixed by the ROM capacity, it is not possible to display the typeface size of many fonts and the characters of many languages (a huge amount of capacity is required even in Japanese only). (3) Since the width and height of the font are fixed, the spacing between characters peculiar to the alphabet cannot be adjusted and the character size cannot be made variable. I have a problem. B) Since text (subtitles) is included in the line 21 of each field in the NTSC signal, (1) In order to have text (subtitles) in multiple languages, it is necessary to have an area to put that information in, but put it in the NTSC signal. Therefore, I cannot have texts (subtitles) in multiple languages. (2) Even text (subtitles) having the same content is required for each field. I have a problem. C) Regarding display, (1) The image around the font is largely masked. (2) Since the font is a binary expression, expressions such as borders cannot be made. Also, it is not possible to express gradations in the font and border areas. I have a problem.

In view of the above problems, the present invention: A) Text (subtitles) without using a character ROM
By holding the compressed bitmap data on the medium and expanding the compressed bitmap data, various texts such as typeface sizes of many fonts, characters of many languages, and arbitrary graphics ( It can handle subtitles) and the hardware does not increase. B) Since the compressed bitmap data is controlled, the amount of information on the medium can be reduced and the text (subtitles) in multiple languages can be held. C) By generating the edging and gradation, and controlling the mixing ratio of the generated text (subtitle) and the image, natural gradation display can be performed without masking the peripheral portion of the font. You can also express according to the scene. With features such as
An information recording medium, a bitmap data decoding device, and a bit map decoding method are provided.

[0008]

In order to solve the above-mentioned problems, the information recording medium of the present invention has the above-mentioned compressed data in addition to compressed data obtained by compressing bitmap data in which each pixel has a binary value or more. The value of each pixel of the expanded bitmap data that is expanded is changed by the filter information, and the obtained value is quantized by the quantization information to generate the gradation bitmap data having more multivalued values. It has filter information and quantization information for

Alternatively, the information recording medium expands the compressed data by adding the compressed data obtained by compressing the bitmap data in which each pixel has a value of three or more values, and at least the bitmap data indicating the pattern data and the border data. With the bitmap data shown, the value of each pixel of each bitmap data is changed by the filter information, the obtained value is quantized by the quantization information, and the quantization result is merged,
In order to generate gradation bit map data having more multivalued values, it has at least the filter information of the pattern data and the border data and the quantization information.

Alternatively, the information recording medium expands the compressed data in addition to a plurality of compressed data obtained by compressing bitmap data in which each pixel has a binary value indicating at least pattern data and edging data. Obtaining the bitmap data indicating the pattern data and the bitmap data indicating the border data, changing the value of each pixel of each bitmap data by the filter information, quantizing the obtained value by the quantization information, and quantizing In order to merge gradation results and generate gradation bit map data having more multivalued values, it has at least filter information of pattern data and border data and quantization information.

Further, the bit map data decoding device applies to the decompressed bit map data obtained by decompressing the compressed data,
A gradation means for generating gradation bitmap data having more multivalued values is provided by changing the value of each pixel with filter information and quantizing the obtained value with quantization information. It is characterized by.

Alternatively, the bit map data decoding apparatus expands the compressed data, and at least with respect to the bit map data indicating the pattern data and the bit map data indicating the edging data, obtains the value of each pixel of each bit map data. In order to change the value obtained by changing the filter information and quantizing the obtained value with the quantization information, at least each gradation means for the pattern data and the edging data and the quantization result are merged to obtain a multivalued value. And a merging unit for generating the gradation bit map data.

Further, the bit map data decoding method uses the expanded bit map data obtained by expanding the compressed data,
A gradation step for generating gradation bitmap data having more multivalued values is provided by changing the value of each pixel with filter information and quantizing the obtained value with quantization information. It is characterized by.

Alternatively, the bit map data decoding method expands the compressed data, and at least for the bit map data indicating the pattern data and the bit map data indicating the border data, the value of each pixel of each bit map data is calculated. In order to quantize the obtained value with the quantization information by changing it with the filter information, at least each gradation step for the pattern data and the edging data, and the quantization result are merged to obtain a multi-valued value. And a merging step for generating the gradation bit map data.

[0015]

The present invention has the above-mentioned configuration. A) Text (subtitles) without using a character ROM
Bitmap data that is wholly compressed is stored on the medium, and by expanding and gradation this compressed bitmap data, many font typeface sizes, many language characters, arbitrary graphics, etc. It can handle various texts (subtitles) and does not increase the hardware. B) Since the compressed bitmap data is controlled, the amount of information on the medium can be reduced and the text (subtitles) in multiple languages can be held. C) By generating the edging and gradation, and controlling the mixing ratio of the generated text (subtitle) and the image, natural gradation display can be performed without masking the peripheral portion of the font. You can also express according to the scene.

[0016]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An information recording medium according to the present invention, a bitmap data decoding device and a bitmap data decoding method using this information recording medium will be described below with reference to the drawings.

First, a first embodiment of the information recording medium will be described.
FIG. 1 shows an information recording medium 500 according to the first embodiment of the present invention.
Shows the area configuration of. The information recording medium 500 has a data structure for controlling in file units. In FIG. 1, a large number of concentric or spiral tracks are formed on a disc-shaped information recording medium 500. Each track is divided into a large number of sectors 501 composed of a header section in which address data and the like are recorded and a data section in which, for example, 2048-byte user data is recorded, and both the header section and the data section record information. It is preformatted when the medium is manufactured.

In the information recording medium 500, a file recording area 502 is allocated on the track from the outer circumference, and a file management area 503 is allocated on the track from the inner circumference. In the file recording area 502, a large number of AV files 510 including variable length compressed image information are recorded. Each AV file 51 is stored in the file management area 503.
The control information 520 of 0 is recorded. Then, the volume name, the number of recorded AV files, and the like are recorded at the head of the file control information 520, and subsequently, a large number of file entries 52 corresponding to each AV file 510 on a one-to-one basis.
1 is recorded. Also, each file entry 521
Is composed of file attribute information such as the file name and file position of the corresponding AV file, and the file size.

The sector 501 is composed of a header section and a data section. Address information of the sector 501, such as ID0 and ID1, is multiplexed and recorded in the header portion.

Next, a configuration example of the AV file 510 according to the first embodiment of the present invention will be described with reference to FIG. Each AV file 510 is composed of a plurality of compressed image information, a collection of audio information and text information (subtitle information) synchronized with the compressed image information, and initial control information such as reference time information necessary for synchronization. . Image information, audio information,
The text information (subtitle information) includes a sector 501.

The data structure of the data portion of the sector 501 will be described. The data section includes an identification section 504, a user data section 505, and an error correction code section 506.

The error correction code unit 506 includes an identification unit 50.
In order to protect the data of 4 and the user data section 505 from an error on the recording medium, an error correction code using, for example, a Reed-Solomon code is recorded. User data section 5
In 05, various element data such as image information, audio information synchronized with the image information, and text information (subtitle information) displayed simultaneously with the image information are recorded. Then, in the identification unit 504, a data type code for identifying whether the content of the user data is any of image information / audio information / text information (caption information) is recorded.

When padding data is added to the latter half of the user data part, the valid data length indicating the length of the element data recorded in the fixed length user data part 505 is also recorded in the identification part 504 except for the padding data. It

The user data section 505 in the case of text information (caption information) will be described in detail below.

In the case of subtitle information, the user data section 505
Consists of basic data 530, gradation data 531 and compressed subtitle data 532 which is the compressed subtitle information body. The basic data 530 and the gradation data 531 are called attribute data.

The basic data 530 includes a channel number indicating which channel and language the subtitle is in, display time information of the start time and end time for displaying the stored subtitle, and a bit map of the subtitle. Area M ×
It consists of N dot size information (M, N) and (Xs, Ys) position information indicating at which position in the entire display area the subtitle is displayed.

The gradation data 531 is a filter, a quantization, and a filter corresponding to the type of caption (character / graphics) to be displayed.
It consists of a set of color information (including the mixing ratio).

The compressed subtitle data 532 is compressed by, for example, run length conversion and MH (Modified Huffman) coding.

Since the data length of the closed caption compressed data differs for each closed caption to be displayed according to the size and compression ratio of the closed caption, the effective data length indicating the length of the element data recorded in the user data part 505 is stored in the identification part 504. Will be recorded.

In this embodiment, the subtitle compression data 532 compresses bitmap data in which each pixel has a binary value.
The gradation data 531 has only one set of filter information / quantization information. Gradation bitmap data having more multi-valued values by changing the value of each pixel of expanded bitmap data obtained by expanding compressed subtitle data with filter information and quantizing the obtained value with quantization information. Can be generated. Color information is given to each quantized gradation and displayed.

Although the caption information has been described above, the image information and audio information also have start times.

Note that the subtitle compression data is binary valued bitmap data, but ternary or more values may be compressed.

Next, a second embodiment of the information recording medium will be shown.
With reference to FIG. 3, the user data portion 505 in the case of the text information (caption information) of the second embodiment of the present invention is different from the first embodiment in gradation data 533 and caption compression data 534. Will be described in detail.

The gradation data 533 is composed of two sets of filter information / quantization information and color information (including a mixing ratio).

The subtitle compression data 534 compresses bitmap data in which each pixel has a ternary value. Then, the gradation data 533 has two sets of filter information and quantization information.
The caption compression data is expanded to obtain the bitmap data indicating the pattern data and the bitmap data indicating the border data, the value of each pixel of each bitmap data is changed by the filter information, and the obtained value is quantized. It is possible to quantize with the quantization information and merge the quantization results to generate gradation bitmap data having more multivalued values. Color information is given to each quantized gradation and displayed.

The device / method may have a part of the two sets of filter information / quantization information. For example, if the apparatus / method side is provided with the filter information / quantization information of the edging data, the configuration becomes the same as that of the first embodiment of the information recording medium. Further, the apparatus / method may have other than the quantization information of the pattern data.

Note that the caption compression data is obtained by compressing ternary value bitmap data, but it may be compressed quaternary or higher value bitmap data.

Next, a third embodiment of the information recording medium will be shown.
With reference to FIG. 4A, regarding the user data portion 505 in the case of the text information (caption information) of the third embodiment of the present invention, the gradation data 535 and the caption compression which are different from those of the third embodiment. The data 536 will be described in detail.

The gradation data 535 is composed of two sets of filter information / quantization information and color information (including a mixing ratio).

As the subtitle compression data 536, two types of bit map data, in which each pixel has a binary value, of pattern data and border data, are compressed. And the gradation data 535
Has two sets of filter information and quantization information. Each subtitle compressed data is decompressed to obtain the bitmap data indicating the pattern data and the bitmap data indicating the edging data, and the value of each pixel of each bitmap data is changed by the filter information, and the obtained value Can be quantized with quantization information, and the quantization results can be merged to generate gradation bitmap data having more multivalued values. Color information is given to each quantized gradation and displayed.

A third embodiment of another information recording medium will be shown. With reference to FIG. 4B, the gradation data 53, which is the difference from the second embodiment in the user data portion 505 in the case of the text information (caption information) of the third embodiment of the present invention.
7, 539 and the subtitle compression data 538, 540 will be described in detail. In FIG. 4B, it is assumed that text information (caption information) is divided into a plurality of sectors.

The gradation data 537 is composed of filter information / quantization information of pattern data and color information (including mixture ratio). The gradation data 539 is composed of filter information / quantization information of edging data and color information (including a mixing ratio). The color information has the same thing.

The subtitle compression data 538 compresses the bit map data of the pattern data in which each pixel has a binary value. Further, the closed caption data 540 compresses the bit-mapped data of the border data, in which each pixel has a binary value.
Each subtitle compressed data is decompressed to obtain the bitmap data indicating the pattern data and the bitmap data indicating the edging data, and the value of each pixel of each bitmap data is changed by the filter information, and the obtained value Can be quantized with quantization information, and the quantization results can be merged to generate gradation bitmap data having more multivalued values. Color information is given to each quantized gradation and displayed.

The color information may be stored in one place as basic data. Further, in FIGS. 4A and 4B, a part of the two sets of filter information / quantization information may be held on the device / method side.

There may be two or more types of compressed subtitle data and filter information / quantization information.

Next, a fourth embodiment of the information recording medium will be shown.
With reference to FIG. 5, regarding the user data portion 505 in the case of the text information (caption information) of the fourth exemplary embodiment of the present invention, the gradation data 541 which is different from that of FIG. 4A of the third exemplary embodiment. The subtitle compression data 542 will be described in detail.

The gradation data 541 includes filter information / quantization information of pattern data and color information (including a mixing ratio). There is no filter information / quantization information / information color (including mixture ratio) of the edging data.

The subtitle compression data 542 is obtained by compressing the bitmap data of the pattern data, in which each pixel has a binary value, and the compression of the border data of the border data, in which each pixel has a binary value. Consists of. Each subtitle compressed data is decompressed to obtain the bit map data indicating the pattern data and the bit map data indicating the edging data, and the value of each pixel of the bit map data of the pattern data is changed by the filter information. The value can be quantized with the quantization information, and the border data and the quantization result can be merged to generate the gradation bitmap data having more multivalued values. Color information is given to each quantized gradation and displayed.

In the first to fourth embodiments, the table size of the filter / quantization / color information (including the mixing ratio) which is the gradation data may be variable or fixed. If it is variable, it is necessary to have each table size.

It is possible to include the enlargement ratio as the attribute data. The expansion rate is information for expanding each bit information in the X and Y directions when performing MH decoding.

Further, the position information is (Xs, Ys), the size information is (M, N), and Xe = Xs + M, Ye = Y.
Considering s + N, a set of (Xs, Ys, Xe, Ye) may be used.

The start time / end time, which is the display time information, may be divided and arranged separately. Start time is T
The information of (Ts, ΔT) may be obtained by considering ΔS = Te−Ts, where s and Te are Te.

The contents of the attribute data are in no particular order,
The order of display time, size, position, filter, quantization, and color information may change.

Although an example in which there is one channel of text information (caption information) for each sector has been shown, a plurality of channels of text information (caption information) may be present in one sector.

Although the text information (subtitle information) is described in units of one sector for the sake of explanation, it may extend over a plurality of sectors. In this case, it is necessary to have, as attribute data, identification information indicating that the data spans a plurality of sectors.

If the content of the filter / quantization / color information (including the mixing ratio) is the same as the text information (caption information) immediately before and after, the filter / quantization / color is set for each text information (caption information). In order to reduce the processing of giving information (including the mixing ratio) to the decoding device, the flag information immediately before and immediately after may be added to the attribute data.

Functions such as fade-in / fade-out / flushing can be realized by gradually changing the filter / quantization / color information (including the mixing ratio) of the gradation data with the same subtitle compression data. (For example, in the case of fade-in, the mixing ratio may be changed from transparent to opaque for each quantization level).

Note that part of the contents of the basic data / gradation data may be provided to the device / method side.

The decoding method and the decoding device will be described below. A first embodiment of the decoding method and the decoding device will be described with reference to FIGS. The information recording medium is shown in FIG.
The configuration is as follows.

FIG. 6 shows a configuration example of the decoding method and the decoding device. In FIG. 6, 10 is an information recording medium that stores image information, audio information, subtitle information, and the like, 11 is an information recording medium control unit that controls reading of the information recording medium, and 12
Is user operation information for the decoding device, and 13 is a decoder main control unit that controls the decoder based on the operation information, and is assumed to be composed of a microprocessor or the like. Reference numeral 14 is a system decoder unit that separates the information read from the information recording medium into image information, audio information, and caption information, and distributes them to each decoder. Reference numeral 15 synchronizes the image information, audio information, and caption information with time. A reference clock control unit for controlling the reference clock for outputting the update time information,
Reference numeral 16 denotes an image information decoder unit that decodes image information,
As a result, image display data is output. Reference numeral 17 denotes a caption information decoder unit that decodes caption information, and as a result, outputs caption composite data. Reference numeral 18 denotes a voice information decoder unit that decodes voice information, and as a result, outputs output voice data. Reference numeral 19 is a display combination that provides display timing control information such as HSYNC and VSYNC to the subtitle information decoder unit 17 / image information decoder unit 16 and synthesizes image display data and subtitle synthesis data based on the mixing ratio data in the subtitle frame memory. Reference numeral 20 denotes a display unit for displaying display data which is combined data, for example, C
It is an RT device. Reference numeral 21 is an audio output unit that outputs the output audio data, and is, for example, a speaker.

The information stored in the information recording medium 10 is used for synchronizing file control information, image information, subtitle information, audio information for managing the data storage position of the information recording medium 10 and the like. Information including initial control information such as reference time information necessary for the above. The image information, caption information, and audio information are compressed information. For example, the image information and audio information are compressed by the MPEG method, which is an international standardization method, and the caption information is used by a facsimile in which bitmap data of the caption to be displayed is used. It is assumed that the information is compressed by the MH code or the like. Further, the audio information and the subtitle information are information of a plurality of channels such as multilingual support such as Japanese and English, and are selectable by a user operation.

Bit map data for expressing subtitles (characters / graphics) is called pattern data, and bitmap data for masking background image data around the subtitles (characters / graphics). Shall be called border data.

The basic operation of the decoding apparatus of the present invention will be described below with reference to FIG. By the user operation, the user's operation information 12 is instructed as audio “channel number setting”, subtitle “channel number setting”, and operation information as to which file is “played”. Based on the user operation information 12, the decoder main control unit 13 sets the channel numbers to be reproduced in the subtitle information decoder unit 17 and the audio information decoder unit 18, and instructs the information recording medium control unit 11 to reproduce the disc. Read the file control information in the disk. Furthermore, the decoder main controller 13
The file position information is read from the corresponding file entry in the file control information, and further, the data of the information recording medium designated by the user is read based on the file position information.

The data read out through the information recording medium control unit 11 is sorted by the system decoder unit 14 into image information, caption information, audio information and initial control information. The image information is the image information decoder unit 16 and the caption information is caption. The information decoder unit 17, the audio information is transferred to the audio information decoder unit 18, and the initial control information is transferred to the decoder main control unit 13. The decoder main control unit 13 sets, in the reference clock control unit 15, reference time information which is one of the initial control information and serves as a reference for the reproduction time of the image information / caption information / audio information. The reference clock control unit 15 sets reference time information as an initial value,
This is counted up at predetermined clock intervals and sequentially updated, and the updated time information obtained as a result is given to the image information decoder unit 16, the subtitle information decoder unit 17, and the audio information decoder unit 18. The image information decoder unit 16 decodes the image information from the system decoder unit 14, obtains the image display data, compares the update time information with the display start time in the image information, and if they match, a display combining unit 19 described later. The image display data is output at the timing of the display timing control information. The subtitle information decoder unit 17 decodes the subtitle bitmap data of the set channel number before the display time of the subtitle information to generate pattern data and border data, and further mix ratio data with image information. Since the added caption display data is generated, the update time information and the display time information in the basic data are compared, and during the display period, the caption composite data is output at the timing of the display timing control information from the display combining unit 19 described later. is there. Decoding processing is not performed for subtitle information of other channel numbers. The decoded image display data and caption display data are combined by the display combining unit 19 based on the mixing ratio data, and displayed on the display 20 as display data. The audio information decoder unit 18 decodes the audio information of the set channel number, obtains the output audio data, compares the update time information with the display start time in the audio information, and if they match, outputs the output audio data. Output to the audio output 20.

With the decoding configuration as described above, it is possible to reproduce the audio information which is temporally synchronized with the composite image of the image information and the subtitle information.

Further, regarding the decoding processing of the subtitle information of the present invention, FIG. 7, FIG. 8, FIG. 9, FIG. 10, FIG.
This will be described in detail with reference to FIG.

FIG. 7 shows the subtitle information decoder unit 1 shown in FIG.
7 is a detailed block diagram of FIG. In FIG. 7, 101 is operation information (channel number in FIG. 6) from the user for the subtitle decoding process, 102 is subtitle information including subtitle compressed data and attribute data of the subtitle bitmap, and 103 outputs decoded data. Sometimes, the update time information that serves as a time reference, and 104 is the display timing control information from the display combining unit 19 described above. Reference numeral 106 denotes a caption decoding control unit, and filter information, quantization information, color information, size information, position information, display time information, storage address information, and update time information in the user data portion of the caption information are codes described below. Decoding section 108 / filter section 110 / quantization section 111
-CLUT unit 112-Subtitle frame memory control unit 113
, And the compressed subtitle data is set in the decoding buffer memory 107, which will be described later, to control the subtitle decoding process. Reference numeral 107 denotes a decoding buffer memory that temporarily stores caption compressed data for performing caption decoding processing.
Reference numeral 8 is a code decoding unit for performing code decoding processing of compressed subtitle data,
A pattern data reproducing unit 109 reproduces the bitmap data from the code decoding unit 108 to obtain subtitle expansion data.
Reference numeral 10 is a filter unit that performs a filtering process on the subtitle decompression data, and 111 is a quantization unit that quantizes the filter result data. As a result, subtitle gradation data is generated. Reference numeral 112 is a CL for allocating color information (including mixing ratio data with image display data) to subtitle gradation data.
UT (Color Lookup Table: Color Lo
ok Up Table) part, and as a result, generates caption display data. Reference numeral 114 denotes a subtitle frame memory that temporarily stores subtitle display data to which color information (including mixing ratio data with image display data) is assigned, and 113 obtains size information, position information, and time information that are basic data of subtitle information. Further, the subtitle frame memory control unit controls the display of the subtitle synthesis data in the subtitle frame memory based on the display timing control information from the display synthesis unit 19 described above and takes out the subtitle synthesis data.

The constituent parts of the code decoding part 108 and the pattern data reproducing part 109 are called an expansion part, and the constituent parts of the filter part 110 and the quantizing part 111 are called a gradation part.

Hereinafter, each of the decoding processes will be described in order. First, the extension unit will be described.

FIG. 8 is a diagram showing the decoding process of the decompression unit (code decoding unit 108 and pattern data reproducing unit 109) in FIG. 7, and FIG. 9 shows an example of the Huffman coding table used for decoding. It is a figure.

In FIG. 8, (a) shows the encoded data string for one line of compressed subtitle data in the code decoding section, (b) the reproduced bit string, and (c) shows the expanded subtitle data.
In FIG. 8, a subtitle in a rectangular area having a size of 55 × 16 pixels is expressed as bitmap data, and the encoding processing is performed for each line of the rectangular area during compression. The closed caption data of the closed caption information is a collection of encoded data strings as shown in FIG. 8A, and the encoded data string is decoded with reference to the encoding table shown in FIG. In the present embodiment, as a prerequisite for the decoding process, the leftmost data of the original subtitle is background data, not pattern data. Further, it is assumed that the background data and the pattern data are always generated alternately, and the encoding process is performed without adding the identification data. Further, in the reverse run length processing, the line end (EOL) is performed line by line.
It shall have the encoded data of.

The decoding process in the pattern data reproducing section will be described below. For example, FIG.
Encoded data string "000" of "1" and "0" shown in (a)
0111001 "is decoded bit by bit by performing matching processing with the coding table of Fig. 9. In this case," run length = 28 "is decoded. Similar decoding is performed on the subsequent coded data string and" run "is performed. Decoding is performed with length = 3 "and" run length = 24 ". The decoding result is as shown in FIG.
28 pixels, pattern data = 3 pixels, background data = 24
Continuing with pixels, the line length is reached and the line ends.
Similarly, FIG. 8C shows the result of decoding all the subtitle compressed data. In this way, the subtitle decompression data of the rectangular area can be obtained from the subtitle compression data.

A method for mapping the tree structure of a code used in a facsimile or the like to a memory to speed up the code decoding process of compressed subtitle data (reference: Takahiko Fukibuki, "Images for FAX, OA"). It is obvious that "Signal processing" can be applied to the Nikkan Kogyo Shimbun.

Next, the gradation unit (filter unit 110 and quantization unit 111) will be described. FIG. 10 shows the filter unit 11.
It is the figure which showed the example of the coefficient matrix of the filter used by the filter process of 0.

The subtitle decompressed data is filtered by the filter section 110 so as to generate border data and perform gradation processing. An example of the coefficient matrix of the filter is shown in FIG. This filter is a filter that performs "blurring" processing on the edge of the subtitle pattern data. As a result, the pattern data gradation processing is performed, and if non-zero pixels are included, the pattern data itself becomes a thick line. Processing and edging data generation.

FIG. 11 is a diagram showing the gradation unit (filter unit / quantization unit). In FIG. 11, (a)
The subtitle decompression data (pattern data) is shown in (b), and the subtitle gradation data after the filtering process and the quantization process are shown in (b). For simplification of explanation, it is assumed that a value of 8 is assigned to the pattern data and a value of 0 is assigned to the background data. After filtering, the value is set to 129 levels of 0 to 128, and after quantization, 0 to 4 is assigned. The value of 5 levels.

The filter processing and the quantization processing will be described below. When the "blur" processing filter shown in FIG. 10 is applied to the pattern data shown in FIG. 11A,
(B) It is possible to obtain data in which the center of the pattern data shown in FIG. In the quantization process for assigning color information to the filter result,
It is divided into K1, K2, M1, M2, and M3 regions shown in FIG. The area division is the quantization table, that is, FIG.

FIG. 12 is a diagram showing an example of a quantization table used in the quantization processing on the data after the filter processing in the quantization unit 111. The correspondence between the quantized value in FIG. 12 and the area in FIG. 11 is that the K1 area in FIG.
The K2 region has a quantized value of 3, the M1 region has a quantized value of 2, the M2 region has a quantized value of 1, and the M3 region has a quantized value of 0.

With the above processing, the subtitle gradation data can be generated from the subtitle decompression data. Next, the CLUT unit 112 that generates caption display data (caption composite data in the display compositing unit 19) from caption gradation data will be described.

FIG. 13 is a diagram showing an example of a CLUT that assigns color information to the quantization result. In FIG. 13, Y is a luminance level, Cr and Cb are color difference levels, and the mixing ratio data α (α is a numerical value from 0 to 100) indicates a mixing ratio with the image display data. The display ratio of the image display data is high. When this is expressed by an equation where A is image display data, B is subtitle composite data, and C is display data, C = A × α / 100 + B × (1−α / 100) (Equation 1). That is, the quantized value 0 indicates that only the image display data is displayed, and the subtitle composite data is not displayed.
The quantized value 1 is displayed in a mixed display of half and half, and the quantized values 2 to 4 are displayed.
Does not display the image display data, but displays the subtitle composite data with the color information represented by Y, Cr, and Cb.
The quantized value 2 indicates the color information of the border, the quantized value 3 indicates the half-brightness color information of the pattern data, and the quantized value 4 indicates the color information of the pattern data itself. That is, as shown in FIG. 11, the data portion of the skirt field after the filter processing (in the figure, the area portion of M1 and M2, which is a portion that is less than about half the peak value of the value after the filter processing) is edged data. Further, the portion of the border data is further divided into a portion where the image display data is mixed and displayed and a portion where only the border data is displayed. This allows
It is possible to generate border data around the pattern data and reduce flicker that may occur between the border data and the image data. In addition, the data area (K1, K
2) is used as pattern data, and in order to perform gradation processing on the pattern data portion, the pattern data is displayed in the area K1 and the pattern data with reduced brightness is displayed in the area K2, that is, the peripheral area of K1. To do. As a result, the pattern data having gradation is displayed, and it is possible to reduce flicker that may occur in subtitle display.

As described above, by assigning color information to the subtitle gradation data in the CLUT unit 112, subtitle display data including a border can be obtained. The subtitle display data having 1-byte information of each of Y, Cr, Cb, and α converted by the CLUT unit 112 is transferred to the subtitle frame memory control unit 1.
It is temporarily stored in the subtitle frame memory 114 via 13.

Next, the display synthesizing section 19 for storing the subtitle display data and displaying the subtitle synthesizing data will be described.

The subtitle display data stored in the subtitle frame memory 114 is displayed based on the display control timing information from the display synthesizing unit 19 and the position information and display time information from the subtitle decoding control unit 106.
In, the reading of the subtitle composite data from the subtitle frame memory 114 is controlled and the subtitle composite data is output to the display synthesizing unit 19. The display combining unit 19 combines the image data and the caption display data from the caption frame memory control unit 113 according to the mixing ratio data α according to the above-described (Equation 1), and outputs it as display data.

It is assumed that the subtitle frame memory 114 has a memory capacity capable of storing Y, Cr, Cb and the mixing ratio data α corresponding to the pixels as color information of at least the number of pixels of subtitles. That is, it has a configuration capable of supporting the case where subtitle information is displayed in the entire area on the display screen.

Next, a concrete configuration example of the subtitle frame memory control unit 113 will be described. FIG. 14 shows a configuration example of the first subtitle frame memory control unit 113. In FIG. 14, reference numeral 150 denotes storage address information for storing subtitle display data in the subtitle frame memory 114, which is set by the subtitle decoding control unit 106. Reference numeral 151 is information from the subtitle decoding unit 106, position information and size information on the screen at the time of displaying subtitle display data, display time information and update time information, 152 is subtitle display data from the CLUT unit, and 153 is display timing. The control information is timing information for reading the subtitle display data stored in the subtitle frame memory 114. Reference numeral 154 is subtitle composite data for composite display, 155 is input / output data of the subtitle frame memory 114, 156 is a write / read address to the subtitle frame memory 114, and 158 is start time / end time and update time information of display time information. During the display period, the display area of the caption display data on the display screen of the caption display data is determined based on the position information / size information when the caption display data is displayed, and the detection data is detected at the timing of the display timing control information 153. Is a curtain display area detection unit for outputting in a display state. If it is not the display period, the detection data is output in the non-display state. 157 is a subtitle frame memory 114
It is an address generation unit that generates an address for the subtitle frame memory corresponding to each subtitle display data stored in, and holds the storage address information 150. First, CLU
When storing the subtitle display data 152 from the T section 112 in the subtitle frame memory 114, the storage address information 15
Subtitle frame memory 156 with 0 as write address
Output to. Further, when the detection data from the subtitle display area detection unit 158 is in a display state (caption display is performed), the storage address information is output to the subtitle frame memory 156 as a read address. 159 is a subtitle display area detection unit 15
When the detection data from 8 is in the display state, the mixing ratio data α in the subtitle frame memory 114 is output, and in the non-displaying state, the mixing ratio data α is not output, and the image data is displayed. A data mask control unit that outputs the value of α as 100, and 160 is an input / output buffer for the data of the subtitle frame memory.

The display processing of the subtitle display data will be described below with reference to FIG. Storage position information of subtitle display data in subtitle frame memory 114 and subtitle frame memory 11
For the free area information in 4, the subtitle decoding control unit 1
06 manages. The subtitle decoding control unit 106 calculates a required memory amount from the size information, and sequentially determines the storage address information on the subtitle frame memory 114 based on this memory amount. Then, a set of position information on the screen at the time of display, end time information, memory amount, and storage address information is managed. The update time information is compared with a plurality of end time information, and if they match, the amount of memory from the corresponding storage address can be used as a free area, and at the same time this group is deleted. CLU
The storage address information 150 in the subtitle frame memory 114 of the subtitle display data output from the T unit 112 and the display time information and the screen position information 151 at the time of display are already the address generation unit 157 for the subtitle frame memory and the subtitle display area detection unit. It is assumed that the update time information is set to 158.
1 shall be continuously supplied. The subtitle display data is output from the CLUT unit 112 at a time to be displayed, that is, at a time earlier than the display time information.

Subtitle frame memory address generator 15
7 designates a write address in the subtitle frame memory 114, and the subtitle display data 152 from the CLUT unit 112
Is stored in the subtitle frame memory 114 via the input / output buffer 160.

Since the update time information has not reached the display time information of the subtitle display data, the subtitle display area detecting unit 158 outputs the non-display state of the detected data. At this time, the subtitle frame memory address generation unit 157 controls so as not to output the read address for displaying the subtitle display data to the subtitle frame memory. Further, in the data mask control unit 159, since the detection data of the subtitle display area detection unit 158 is in the non-display state, the mixing ratio data α is not output and is not displayed.

When the update time information reaches the display time information of the subtitle display data, the subtitle display area detecting unit 158 puts the detection data in the display state. At this time, the subtitle frame memory address generation unit 157 outputs the read address, and the data mask control unit 159 sets the output of the mixture ratio data α. By this control, a read address from the subtitle frame memory address generation unit 157 to the subtitle frame memory 114 corresponding to the display area is generated, and the corresponding subtitle data is read. The data mask control unit 159 outputs the mixing ratio data α, reads the subtitle display data from the subtitle frame memory 114, and outputs it as subtitle composite data 154.

When the update time information reaches the display end time of the subtitle display data, the subtitle display area detecting unit 158 again becomes the non-display state, and the subtitle frame address generating unit 1
57, the read address is not output, and the data mask control unit 159 does not output the mixture ratio data α.
The subtitle display data is not output as subtitle composite data and disappears from the display screen. Furthermore, subtitle decoding control unit 1
In 06, the area of the subtitle frame memory 114 in which the subtitle display data is stored is set as an empty area and is set as an area for storing the next subtitle display data.

Next, the subtitle decoding procedure (step) will be described in detail with reference to FIG. 16 which shows the operation along the flow of time and the processing flowchart of FIG. In the following description, it is assumed that, as the user operation, English (channel number 2) is selected as the reproduced sound and Japanese (channel number 1) is selected as the reproduced subtitle, and the reproduction operation is performed. The operation will be specifically described with reference to FIG. In the figure, the caption information is "Japanese A".
And "Japanese B" indicate that the display time is "A + 3" to "A + 6", and "Japanese C" is the display time "A +".
7 ”to [A + 9” are displayed, and the decoding processing of the caption information is performed as the decoding processing A, the decoding processing B, and the decoding processing C before their display times. There is. In the present embodiment, the time for decoding one subtitle compressed data is within 1 unit time.

(S401) The subtitle decoding control unit 106 determines whether the subtitle information from the system decoder unit 14 is a channel number to be reproduced. That is, since Japanese subtitle reproduction is instructed here, in the case of English subtitle compressed data, the process proceeds to (S408) and the subtitle compressed data is discarded. If it is Japanese subtitle compressed data, the following processing procedure (S402) is performed.

(S402) From the display time information of the start time and end time, which is the basic data of the compressed subtitle data, the update time information, and the time required for the decoding process, it is determined whether the decoding process can be ended at the time to be displayed. If the decryption processing can be completed before the display start time, the next processing procedure (S403)
I do.

That is, in FIG. 16, "Japanese A"
And "Japanese B" from "A + 3" to "A +"
In order to display at the time "6", when the unit time before the decoding time, that is, when the compressed subtitle data does not arrive at the subtitle information decoder unit 17 at the time "A + 5", the process proceeds to the processing procedure (S406). The compressed subtitle data is discarded, and when it arrives, the decoding process can be completed in time for the start time, so the following processing procedure (S403) is performed.

(S403) At the time of starting decoding, it is determined whether or not there is a memory capacity in the caption frame memory 114 capable of storing the caption display data obtained by the decoding process.

If there is no memory area for storing the caption display data obtained by the decoding process, the decoding process of the caption compressed data is not started in the processing procedure of (S407),
The decoding process is awaited until the memory area in the subtitle frame memory 114 can be stored. That is, the display time of the subtitle display data in the subtitle frame memory 114 has already passed, the subtitle display data becomes invalid, the storable memory area in the subtitle frame memory 114 increases, and the subtitle display data to be decoded is stored. It will be monitored until the available area is obtained.

If there is a memory area for storing the subtitle display data to be decoded in the subtitle frame memory 114, the following processing procedure (S404) is performed.

(S404) Attribute data of subtitle information is set in each processing unit. For example, the filter coefficient is the filter unit 1
10, the quantization table is the quantization unit 111, C of the color information.
The LUT data is stored in the CLUT unit 112, and the size information / position information / display time information is stored in the subtitle frame memory control unit 11.
Set to 3.

(S405) Based on the attribute data to each processing section, the compressed subtitle data is transferred to the code decoding section 108, and decoding is started. The subtitle decoded data includes the pattern data reproducing unit 109, the filter unit 110, the quantizing unit 111, and the CLUT.
The subtitle display data is stored in the subtitle frame memory 114 via the unit 112 and the subtitle frame memory control unit 113. The subtitle frame memory control unit 113 outputs the subtitle display data in the subtitle frame memory as display combined data when the display time is reached by the processing procedure shown in the description of the first and second configuration examples described above. ,
After the display time, the subtitle display data is controlled so as not to be output as subtitle composite data.

With the above procedure, one subtitle compressed data can be decoded in the first embodiment shown in FIG. The processing of compressed subtitle data follows the same processing flow again and performs decoding processing. In the present embodiment, for the decoding process of "Japanese C" in FIG. 16, if the caption frame memory 114 has a capacity for storing the decoded subtitle display data, "Japanese A", "Japanese" Even though "B" is displayed, the subtitle frame memory 11
If there is a capacity for storing the decoded caption display data in 4, the decoding process can be performed and the caption can be displayed at the set start time.

Although the decoding according to the present invention can be realized by the above-described configuration and processing procedure, the subtitles to be displayed in the subtitle frame memory address generation unit 157 of the first configuration example of the subtitle frame memory control unit 113. The data mask section 159 is unnecessary by controlling only the area including the display data so as to always have the display address.

Next, the speed-up circuit of the filter section 110 in this embodiment will be briefly described with reference to FIG. In this example of the speed-up circuit, it is assumed that all the values of the filter coefficient matrix are represented by powers of two. In addition, in this embodiment, 9 × 9 filter processing is performed, and the maximum horizontal length of the subtitle expansion data is 720 pixels.

FIG. 17A shows a shift register for 720 × 9 lines for performing a 9 × 9 filter operation, and the subtitle decompression data is 7 in the line direction from the upper right end of the figure.
Extend to 20 dots and enter. 9x at the left end
For the subtitle expansion data of 9, get the bit data,
The addition data in the row direction for 9 pixels is obtained. FIG. 17
The detail of the addition data operation unit in the row direction for the 9 pixels is shown in (b). In FIG. 17B, a shift register that shifts pixels, an addition that adds a shifter for setting a power value of 2 by shifting each pixel instead of multiplying the pixel value by the value of the filter coefficient, and the result thereof Composed of vessels. Each shifter has a register capable of setting the shift value, and the filter coefficient value is set by replacing it with a power of 2. The shifter values are added by the adder to obtain the addition result in the row direction. A 9 × 9 filter result can be obtained by further adding the row totals by the column adder.

Further, even when the decoded bitmap data is less than 720 pixels by making the input to the shift register possible from any position,
A configuration in which pixels are input without expanding to 720 pixels can also be realized.

With such a configuration, the filter processing can be realized at a speed almost equal to the display processing.
Further, the quantization processing following this processing is a quantization table ROM whose address is the data of the filter processing result, and the processing of the CLUT unit which follows this processing is the ROM of the CLUT whose output value is the quantization ROM. These processes can be pipelined. Also, regarding the code decoding process, by using the speed-up method, the code decoding is performed with the clock of the coded bit number at the maximum, and the run length is also the maximum line length of the screen in the pattern data reproducing unit 109. It is clear that the digitization process can be realized at the same speed as the display process.

Further, by using a microprocessor included in the subtitle decoding control unit 106, the decoder main control unit 13, the subtitle frame memory control unit 113, or the like,
The present invention can also be realized by performing a part or all of the code decoding process, the reverse run length process, the filter process, the quantization process, and the color information setting process.

Although the filter processing of the above-described embodiment has been described as a power of 2, any value may be used and the hardware scale increases, but it goes without saying that high-speed processing is possible.

In the first embodiment, as the attribute data included in the subtitle information 102, which is set in each processing block from the subtitle decoding control unit 106, the pattern data reproducing unit 109 has an enlargement ratio. Can be set. For example, if the double enlargement is set, when the pattern data is reproduced, the run length is doubled in the horizontal direction from the value obtained in the encoding table and reproduced, and the same length of the same line is reproduced twice in the vertical direction. It can be realized by playing.

Further, the quantizing unit 111 and the CLUT unit 11
2, the filter unit 110 has a quantization table value, CL
There are UT data values and filter coefficient matrix values. For example, depending on the setting of the gradation data, in the filter unit 110, the quantization unit 111, and the CLUT unit 112, it is possible to change the size of the border width. For example, in order to make the border width wider, in the present embodiment, the quantizer 111 sets the filter output value with the quantized value 0 to 0 to 3, and the filter output value with the quantized value 1 to 4 to 7. However, if only the filter output value 0 is set to the quantized value 0 and only the filter output value 1 is set to the quantized value 1, the quantized value 2, that is, the area for displaying the border data color can be enlarged. it can. Further, by setting the mixture ratio data α of the quantized value 1 and the quantized value 0 to 0 in the value of the CLUT data, the border data color can be expanded. Of course, the border width can also be increased by increasing the size of the coefficient matrix of the filter.

The coefficient matrix of the filter is shown in FIG.
When a filter in which the weighting position of the coefficient matrix is changed as shown in FIG. 8 is used, the edging becomes uneven as shown in FIG. 19 (b), and the conventional edging shown in FIG. Compared with subtitles, the effect of so-called "jumping out" subtitles can also be produced.

Not only is the value of the filter coefficient of the gradation data, the value of the quantization table, and the value of the CLUT data stored in advance in the information recording medium as described above used, but also based on the user operation information 12. , Decoding main controller 13
Alternatively, in the subtitle decoding control unit 106, the gradation data is converted according to a preset rule, for example, the mixing ratio data α of the CLUT information is changed from 0 to 100 at a time interval of about 1 second. By doing so, it is possible to fade out the subtitle information, and conversely 100
By changing from 0 to 0, fade-in processing or the like is possible in the decoding method and apparatus of the present invention.

Although the case where the compressed subtitle data takes a binary value has been described, the compressed subtitle data may take a ternary value or more.

A decompression unit for taking a ternary value will be described.
20, (a) is an encoded data string for one line of compressed subtitle data, (b) is a reproduced bit string,
Subtitle expansion data is shown in (c). In FIG. 20, a subtitle in a rectangular area having a size of 55 × 16 pixels is expressed as ternary bitmap data, and the rectangular area is encoded in units of one line at the time of compression. The closed caption data of the closed caption information is a collection of encoded data strings as shown in FIG. 20A, and the encoded data strings are decoded with reference to the encoding table shown in FIG. In this embodiment, a ternary area (background data, border data, and pattern data) is provided at the beginning of each encoded data obtained by encoding the run length.
Encoding processing is performed by adding identification data for identifying the.

As shown in FIG. 20 (a), the coded data indicating one run length of the coded data string is the identification data (for identifying the underlined background data, border data and pattern data). 00 = background data, 01 = bordering data, 10 = pattern data) and encoded data indicating the run length. With such a configuration, the compression processing of the run length of three or more values is performed. As in the first embodiment, the result of decompressing the compressed subtitle data for one line based on the encoding table of FIG. 9 is shown in FIG.
(B). Further, FIG. 20C shows the result of expanding the entire subtitle information. By expanding the encoded data as shown in FIG. 20 (c), it is possible to obtain the expanded caption data that expresses three values (background data value, border data value, pattern data value).

Further, a pixel having pattern data is set to a value of "16", for example, a pixel having no pattern data but only edging data is set to "1" data, and other pixel data is "0". Is set and processed by the filter unit 110. Since the coefficient matrix of the filter does not need to generate the edging data by the filter processing, the coefficient matrix of 3 × 3 can be used as in the third embodiment.

Next, a second embodiment of a decoding method and a decoding device for compressed subtitle data of three or more values will be described with reference to FIGS. 21 to 23. The information recording medium has the structure shown in FIG.

Except for the configurations of the decompression unit and the gradation unit (including the merge processing unit), this is the same as the first embodiment, so only the decompression unit and the gradation unit will be described.

In FIG. 21, 200 is reproduction data, 2 is
Reference numeral 01 is a code decoding unit, 202 is quantized data output to the CLUT unit 112, 203 is a pattern data reproducing unit, 2
Reference numeral 04 is a filter unit that performs a filter process on the pattern data, 205 is a quantization unit that performs a quantization process on the filter process result, 206 is a border data generation unit that generates border data from the decoded data, and 207 is the A filter unit for filtering the border data, 20
Reference numeral 8 denotes a quantizer that performs a quantization process on the filter processing result, and reference numeral 209 denotes a merge processor that merges the quantization process results. It is assumed that the merging processing unit 209 is configured to be able to shift the merging position of the edging data and the pattern data when merging the edging data and the pattern data.

In the first embodiment, the pattern data is decompressed from the binary or more compressed subtitle data, and the edging data is simultaneously generated by performing the filtering process and the quantizing process.
In this embodiment, the pattern data and the edging data are generated from the reproduction data 200 of the compressed subtitle data of three or more values.

The operation of the expansion unit of the second embodiment will be described.
The decompression unit of the second embodiment is characterized in that it decompresses pattern data and border data, respectively.

In FIG. 22, (a) is an encoded data string for one line of subtitle compressed data in the code decoding section, (b)
The reproduced bit sequence is shown in (c), and the subtitle decompression data is shown in (c). In FIG. 22, a subtitle in a rectangular area having a size of 55 × 16 pixels is represented as ternary bitmap data,
Encoding processing is performed for each line of the rectangular area during compression. The closed caption compressed data of the closed caption information is a collection of encoded data strings as shown in FIG. 22A, and the encoded data string is decoded with reference to the encoding table shown in FIG. In the present embodiment, coding processing is performed in which identification data for identifying a ternary region (background data, edging data, and pattern data) is added to each head of coded data obtained by coding run lengths. .

As shown in FIG. 22A, the coded data indicating one run length of the coded data string is the identification data (for identifying the underlined background data, border data and pattern data). 00 = background data, 01 = bordering data, 10 = pattern data) and encoded data indicating the run length. With such a configuration, the compression processing of the run length of three or more values is performed. The border data is expanded by the border data generation unit 206 by decompressing the border data as data indicated by identification data “01” and “10” and decompressing the background data as data indicated by identification data “00”. In addition, the expansion of the pattern data in the pattern data reproducing unit is performed by identifying the pattern data as identification data
The data indicated by "0" and the background data are identified by "0".
The data is decompressed as data indicated by 0 "and identification data" 01 ". The result of decompressing the compressed subtitle data for one line based on the encoding table of FIG. 22C shows the result of expanding the entire caption information.By extending the encoded data as shown in FIG. It is possible to obtain subtitle decompression data expressing the border data) and binary pattern data (background data and pattern data).

FIG. 23 is a diagram for explaining the gradation unit (filtering process and quantizing process for each of pattern data and border data).

The edging data obtained by the edging data generation unit 206 is subjected to the filtering process and the quantization process of the filter result in the same manner as the pattern data, and as shown in FIG. It is possible to obtain border data that can be mixed with image data quantized in a region. The obtained edging data is filtered by the filter unit 207. The coefficient matrix of the filter is shown in FIG.
A 3 × 3 filter as shown in (e) is used. For simplification of explanation, 4 for pattern data and border data.
The value of 0 is assigned to the background data, the value is 9 levels of 0 to 8 after filtering, and 0 after quantization.
Set to 5 level value of ~ 4. FIG. 23C shows the generated edging data, and FIG. 23D shows the data after the filter processing. As shown in the drawing, the quantization processing in which the quantized value 2, the quantized value 1, and the quantized value 0 of the CLUT data shown in FIG. 13 is obtained in the areas M1, M2, and M3 from the data after the filtering processing of the edging data. I do.

Further, the pattern data is obtained by the pattern data reproducing unit 203, and the filter unit 204 performs the filtering process for performing the gradation process on the pattern data. The coefficient matrix of the filter at this time does not include the generation of the edging data like the filter of the first embodiment, and a 3 × 3 matrix as shown in FIG. 23E is sufficient. The filter result obtained by the filter unit 204 is quantized by the quantization unit 205 to generate gradation display data of the pattern data. This processing is the gradation processing of the pattern data shown in FIG. 23, in which the K1 and K2 regions are quantized so that the quantized values 4 and 3 of the CLUT data shown in FIG. 13 are obtained. The area K3 in FIG. 23 is a data area that is not treated as pattern data.

The pattern data and the edging data thus obtained are merged by the merge processing unit 209. In the merge processing unit 209, the quantization value 4 or the quantization value 3 corresponding to the pattern data display is set to the pixel having the pattern data, and the quantization value corresponding to the border data is set to the pixel having no pattern data. The value 2, the quantized value 1, and the quantized value 0 are set. As a result of the processing of the merge processing unit 209, it is possible to obtain the quantized value including the subtitle pattern data and the border data, as in the first embodiment.

As described above, according to this embodiment, it is not necessary to prepare a large-sized coefficient matrix in the second embodiment as compared with the first embodiment, and the hardware scale can be reduced.

In the second embodiment, the pattern data reproducing unit 2 is used as the attribute data set in each processing block.
03, the enlargement ratio can be set in the border data generation unit 206, as in the first embodiment. At the time of reproducing the pattern data, the same processing as that in the first embodiment is performed. For example, in the processing of doubling, the run length is doubled in the horizontal direction by the value obtained in the encoding table and reproduced. In the vertical direction, enlargement processing can be performed by playing the same line twice.
When the edging data is generated, the run length obtained for the edging is doubled in the horizontal direction to be reproduced, and the same line is reproduced twice in the vertical direction so that the double-enlarged data of the edging can be obtained. Generation can be realized.

Further, as the edging position displacement information, the merging processing unit 209 shifts the merging position, that is, the edging data and the pattern data are merged in a normal order during the merging processing. By such processing, FIG.
As shown in FIG. 9 (b), for example, by shifting the pattern data position from the center, the "pop-out" caption described in the first embodiment can be similarly realized.

The filter units 204 and 207 are the first
It is clear that a high-speed circuit can be realized by using the shift register, shifter, and adder for three lines, which have the same constituent elements as those in FIG.

Next, a third embodiment of the decoding method and the decoding device for a plurality of binary compressed subtitle data will be described with reference to FIG. The information recording medium has the configuration shown in FIG. 4 (a) or 4 (b).

In the second embodiment, the pattern data and the edging data are generated from the reproduction data 200 of the compressed subtitle data of three or more values, but in the third embodiment, the reproduction data of a plurality of binary compressed subtitle data. From 200, pattern data and border data are sequentially generated.

Since the operation is the same as that of the second embodiment except for the operation of the decompression unit, only the decompression unit will be described with reference to FIG.

The decompression unit for taking a plurality of binary values will be described. In this case, the pattern data and the edging data, which are the reproduction data of the plurality of binary compressed subtitle data, are sequentially code-decoded to generate the pattern data and the edging data, respectively.

In FIG. 24, (a) shows an encoded data string (pattern data) of one line of caption compressed data in the code decoding section, (b) shows a reproduced bit string (pattern data), and (c) shows The subtitle decompression data (pattern data) is shown. Further, in (d), a coded data string for one line of the compressed subtitle data in the code decoding unit (rimming data),
(E) Reproduced bit string (rimming data), (f)
Shows the subtitle decompression data (outline data).

In FIG. 24, a subtitle in a rectangular area having a size of 55 × 16 pixels is represented as a plurality of binary bit map data, and the encoding processing is performed for each line of the rectangular area at the time of compression. . The closed caption data of the closed caption information is a group of encoded data strings as shown in FIG. 24 (a) or (d), and the encoded data string is decoded with reference to the encoding table shown in FIG. . At the time of the decoding process, for example, the coded data string “0000111001100” of “1” and “0” shown in FIG. 24A is subjected to the matching process with the coding table of FIG. In this case, it is decoded as "run length = 28". Similar decoding is performed on the subsequent coded data string to decode "run length = 3" and "run length = 24". The decoding result is as shown in FIG. 24B, where background data = 28 pixels, pattern data = 3.
Pixels and background data = 24 pixels continue, and since the line length has been reached, the line ends. Similarly, FIG. 24 (c) shows the result of decoding all the subtitle compressed data. In this way, the pattern data of the rectangular area can be obtained from the compressed subtitle data.

Then, "1" and "" shown in FIG.
The encoded data string "00001101010" of 0 "is set to 1
Each bit is decoded by performing matching processing with the coding table of FIG. In this case, it is decoded as "run length = 26". The same decoding is performed on the subsequent encoded data string, and "run length =
6 "and" run length = 23 "are decoded. The decoding result is shown in FIG.
As shown in (e), the background data = 26 pixels, the edging data = 6 pixels, the background data = 23 pixels, and the line length is reached. Similarly, FIG. 24 (f) shows the result of decoding all the subtitle compressed data.
In this way, it is possible to obtain the border data of the rectangular area from the compressed subtitle data.

Next, a fourth embodiment of the decoding method and the decoding device for a plurality of binary compressed subtitle data will be described with reference to FIGS. 25 and 26. The information recording medium has the structure shown in FIG.

Except for the configuration of the gradation unit (including the merge processing unit), it is the same as the second embodiment, so only the gradation unit will be described.

In FIG. 25, 300 is reproduction data and 3
Reference numeral 01 is a code decoding unit, 302 is quantized data output to the CLUT unit 112, 303 is a pattern data reproducing unit, 3
Reference numeral 04 is a filter unit for performing a filtering process on the pattern data, 305 is a quantizing unit for performing a quantization process on the filter processing result, 306 is a edging data generation unit for generating edging data from the decoded data, and 307 is a edging It is a merge processing unit that merges the quantization processing results of data and pattern data. It is assumed that the merge processing unit 307 is configured to be able to shift the merge position of the border data and the pattern data when the border data and the pattern data are merged.

The fourth embodiment is similar to the third embodiment in that
The pattern data and the edging data are sequentially generated from the reproduction data 300 of the compressed subtitle data of a plurality of values, but the case where the filter / quantization information has only the pattern data is shown.

The operation of the gradation unit of the fourth embodiment will be described. The gradation unit of the fourth embodiment is characterized in that only the pattern data is gradation-converted.

FIG. 26 is a diagram for explaining the gradation unit (pattern data filter processing and quantization processing).

FIG. 26 (c) shows the generated edging data. As shown in the figure, the border data area is shown in FIG.
Quantization value 2 of the CLUT data shown in (2) is quantized so that the background portion has a quantized value of 0.

Further, the pattern data is obtained by the pattern data reproducing unit 303, and the filter unit 304 performs the filtering process for performing the gradation process on the pattern data. The coefficient matrix of the filter at this time does not include the generation of the edging data like the filter of the first embodiment, and a 3 × 3 matrix as shown in FIG. 23E is sufficient. The filter result obtained by the filter unit 304 is quantized by the quantization unit 305 to generate gradation display data of the pattern data. This processing is the gradation processing of the pattern data shown in FIG. 26, in which the K1 and K2 regions are quantized so that the quantized values 4 and 3 of the CLUT data shown in FIG. 13 are obtained. The area K3 in FIG. 26 is a data area that is not treated as pattern data.

The pattern data and the edging data thus obtained are merged by the merge processing unit 307. In the merge processing unit 307, the quantization value 4 or the quantization value 3 corresponding to the pattern data display is set to the pixel having the pattern data, and the quantization value corresponding to the border data is set to the pixel having no pattern data. A value of 2 and a quantized value of 0 are set. As a result of the processing of the merge processing unit 307, it is possible to obtain the quantized value including the subtitle pattern data and the border data, as in the first embodiment.

As described above, according to the present embodiment, the fourth embodiment does not need to have the filter / quantization information of the edging data as compared with the third embodiment.

In the decoding device and the decoding method described above, after the color information and the mixing ratio data after the processing of the CLUT unit are obtained, the display mode is temporarily stored in the subtitle frame memory as subtitle display data. As I explained, C
The CLUT has a frame memory that temporarily stores data before the processing of the LUT unit, that is, after the quantization processing, for example, 4-bit data, and simultaneously outputs the display timing control information and reads out the 4-bit data after the quantization. The present invention can also be implemented with a configuration in which subtitle synthesis data is obtained by converting color information and mixing ratio information corresponding to the quantized data in the sub-unit.

[0149]

As described above, the information recording medium of the present invention is
In addition to the compressed data obtained by compressing the bitmap data in which each pixel has a binary value or more, the value of each pixel of the expanded bitmap data obtained by expanding the compressed data is changed by the filter information, and the obtained value is quantized. By quantizing with quantization information,
It has filter information and quantization information for generating gradation bitmap data having more multivalued values.

Alternatively, the information recording medium expands the compressed data in addition to the compressed data obtained by compressing the bitmap data in which each pixel has a value of three or more values, and at least the bitmap data indicating the pattern data and the border data. With the bitmap data shown, the value of each pixel of each bitmap data is changed by the filter information, the obtained value is quantized by the quantization information, and the quantization result is merged,
In order to generate gradation bit map data having more multivalued values, it has at least the filter information of the pattern data and the border data and the quantization information.

Alternatively, the information recording medium expands the compressed data in addition to a plurality of compressed data obtained by compressing bitmap data in which each pixel has a binary value indicating at least the pattern data and the edging data. Obtaining the bitmap data indicating the pattern data and the bitmap data indicating the border data, changing the value of each pixel of each bitmap data by the filter information, quantizing the obtained value by the quantization information, and quantizing In order to merge gradation results and generate gradation bit map data having more multivalued values, it has at least filter information of pattern data and border data and quantization information.

Further, the bit map data decoding device, for the decompressed bit map data obtained by decompressing the compressed data,
A gradation means for generating gradation bitmap data having more multivalued values is provided by changing the value of each pixel with filter information and quantizing the obtained value with quantization information. It is characterized by.

Alternatively, the bitmap data decoding device expands the compressed data, and at least with respect to the bitmap data indicating the pattern data and the bitmap data indicating the edging data, obtains the value of each pixel of each bitmap data. In order to change the value obtained by changing the filter information and quantizing the obtained value with the quantization information, at least each gradation means for the pattern data and the edging data and the quantization result are merged to obtain a multivalued value. And a merging unit for generating the gradation bit map data.

The bit map data decoding method uses the expanded bit map data obtained by expanding the compressed data,
A gradation step for generating gradation bitmap data having more multivalued values is provided by changing the value of each pixel with filter information and quantizing the obtained value with quantization information. It is characterized by.

Alternatively, the bit map data decoding method expands the compressed data, and at least for the bit map data indicating the pattern data and the bit map data indicating the border data, the value of each pixel of each bit map data is calculated. In order to quantize the obtained value with the quantization information by changing it with the filter information, at least each gradation step for the pattern data and the edging data, and the quantization result are merged to obtain a multi-valued value. And a merging step for generating the gradation bit map data.

With the above configuration, A) text (subtitles) without using a character ROM
Bitmap data that is wholly compressed is stored on the medium, and by expanding and gradation this compressed bitmap data, many font typeface sizes, many language characters, arbitrary graphics, etc. It can handle various texts (subtitles) and does not increase the hardware. B) Since the compressed bitmap data is controlled, the amount of information on the medium can be reduced and the text (subtitles) in multiple languages can be held. C) By generating the edging and gradation, and controlling the mixing ratio of the generated text (subtitle) and the image, natural gradation display can be performed without masking the peripheral portion of the font. You can also express according to the scene.

[Brief description of drawings]

FIG. 1 is an area configuration diagram of an information recording medium in an embodiment of the information recording medium of the present invention.

FIG. 2 is a data structure diagram of text information (caption information) in the first embodiment of the information recording medium of the present invention.

FIG. 3 is a data structure diagram of text information (caption information) in the second embodiment of the information recording medium of the present invention.

FIG. 4 is a data structure diagram of text information (caption information) in the third embodiment of the information recording medium of the present invention.

FIG. 5 is a data structure diagram of text information (caption information) in the fourth embodiment of the information recording medium of the present invention.

FIG. 6 is a block diagram of a decoding method and a decoding device according to an embodiment of a decoding device / system of the present invention.

FIG. 7 is a block diagram of a caption information decoder unit of a first embodiment of a decoding device / system according to the present invention.

FIG. 8 is an explanatory diagram of a decompression unit of the first embodiment of the decoding device / system of the present invention.

FIG. 9 is a diagram showing an example of a Huffman coding table of an embodiment of the decoding device / system of the present invention.

FIG. 10 is a diagram showing an example of a coefficient matrix of a filter of an embodiment of a decoding device / system of the present invention.

FIG. 11 is an explanatory diagram of a gradation unit of the first embodiment of the decoding device / system of the present invention.

FIG. 12 is a diagram for explaining a quantization table of an embodiment of a decoding device / system of the present invention.

FIG. 13 is a CLU of an embodiment of the decoding device / system of the present invention.
Figure for explaining T

FIG. 14 is a configuration diagram of a subtitle frame memory control unit of an embodiment of a decoding device / system of the present invention.

FIG. 15 is a flowchart of the decoding processing procedure of the embodiment of the decoding apparatus / system of the present invention.

FIG. 16 is an explanatory diagram of the operation along the flow of time of the embodiment of the decoding apparatus / system of the present invention.

FIG. 17 is a speed-up circuit diagram of a filter unit according to an embodiment of a decoding device / system of the present invention.

FIG. 18 is a diagram for explaining the coefficient matrix of the filter of the embodiment of the decoding device / system of the present invention.

FIG. 19 is a diagram for explaining a result of a filter according to the embodiment of the decoding apparatus / system of the present invention.

FIG. 20 is an explanatory diagram of a decompression unit of the first embodiment of the decoding device / system of the present invention.

FIG. 21 is a configuration diagram of a decompression unit / gradation unit according to a second embodiment of the decoding device / system of the present invention.

FIG. 22 is an explanatory diagram of a decompression unit of the second embodiment of the decoding device / system of the present invention.

FIG. 23 is an explanatory diagram of a gradation unit of a second embodiment of the decoding device / system of the present invention.

FIG. 24 is an explanatory diagram of a decompression unit of the third embodiment of the decoding device / system of the present invention.

FIG. 25 is a block diagram of a decompression unit / gradation unit of a fourth embodiment of the decoding device / system of the present invention.

FIG. 26 is an explanatory diagram of a gradation unit of a fourth embodiment of the decoding device / system of the present invention.

[Explanation of symbols]

10,500 Information recording medium 501 Sector 502 File recording area 503 File management area 504 Identification section 505 User data section 506 Error correction code section 510 AV file 520 File control information 521 File entry 530 Basic data 531, 533, 535, 537, 539 , 541 Gradation data 532, 534, 536, 538, 540, 542 Subtitle compression data 11 Information recording medium control unit 12 User operation information 13 Decoder main control unit 14 System decoder 15 Reference clock control unit 16 Image information decoder 17 Subtitle information Decoder 18 Audio information decoder 19 Display synthesis unit 20 Display unit 21 Audio output unit 101 Operation information 102 Subtitle information 103 Update time information 104 Display timing control information 106 Subtitle decoding Control unit 107 Decoding buffer memory 108 Code decoding unit 109 Pattern data reproduction unit 110 Filter unit 111 Quantization unit 112 CLUT unit 113 Subtitle frame memory control unit 114 Subtitle frame memory 153 Display timing control information 154 Subtitle composite data 155, 156 Subtitle frame Memory 157 Subtitle frame memory address generation unit 158 Subtitle display area detection unit 159 Data mask control unit 160 Input / output buffer 200 Playback data 201 Code decoding unit 202 Quantized data 203 Pattern data playback unit 204, 207 Filter unit 205, 208 Quantization Part 206 Border data generation part 209 Merge processing part 300 Reproduction data 301 Code decoding part 302 Quantization data 303 Pattern data reproduction part 304 Filter part 30 Quantization unit 306 border data generation unit 307 merge processing unit

─────────────────────────────────────────────────── ─── Continuation of the front page (51) Int.Cl. ⁶ Identification number Internal reference number FI Technical display location H04N 7/03 H04N 7/13 Z 7/035 7/24 (72) Inventor Hideshi Ishihara Kadoma Osaka Prefecture 1006 Kadoma, Oita-shi Matsushita Electric Industrial Co., Ltd.

Claims (13)

[Claims] 1. In addition to compressed data obtained by compressing bitmap data in which each pixel has a binary value or more, the value of each pixel in decompressed bitmap data obtained by decompressing the compressed data is changed by filter information and obtained. An information recording medium having filter information and quantization information for generating gradation bit map data having more multivalued values by quantizing the obtained value with the quantization information. 2. In addition to compressed data obtained by compressing bitmap data in which each pixel has a ternary value or more, the compressed data is expanded, and bitmap data indicating at least pattern data and bitmap data indicating edging data. Then, the value of each pixel of each bitmap data is changed by the filter information, the obtained value is quantized by the quantization information, the quantization results are merged, and the value having a multivalued value is obtained. To generate the modulated bitmap data,
An information recording medium having at least filter information of pattern data and border data and quantization information. 3. In addition to a plurality of compressed data obtained by compressing bitmap data in which each pixel has a binary value indicating at least pattern data and edging data, the compressed data is expanded to show at least pattern data. Obtaining the bitmap data and the bitmap data indicating the border data, changing the value of each pixel of each bitmap data with the filter information, quantizing the obtained value with the quantization information, and merging the quantization results. Then, in order to generate the gradation bitmap data having more multivalued values,
An information recording medium having at least filter information of pattern data and border data and quantization information. 4. In addition to compressed data obtained by compressing bitmap data in which each pixel has a value of three or more, the compressed data is expanded and at least bitmap data showing pattern data and bitmap data showing edging data. Then, the value of each pixel of each bitmap data is changed by the filter information, the obtained value is quantized by the quantization information, the quantization results are merged, and the value having a multivalued value is obtained. To generate the modulated bitmap data,
An information recording medium having filter information and quantization information only for pattern data. 5. In addition to a plurality of compressed data obtained by compressing bit map data in which each pixel has a binary value showing at least pattern data and edging data, the compressed data is expanded to show at least pattern data. Obtaining the bitmap data and the bitmap data indicating the border data, changing the value of each pixel of each bitmap data with the filter information, quantizing the obtained value with the quantization information, and merging the quantization results. Then, in order to generate gradation bit map data having more multivalued values, an information recording medium having filter information and quantization information of only pattern data. 6. A multivalued value is obtained by changing the value of each pixel with filter information and dequantizing the obtained value with quantization information for decompressed bitmap data obtained by decompressing compressed data. A bitmap data decoding device, characterized by comprising gradation means for generating the gradation bit map data. 7. The compressed data is expanded and at least for the bitmap data indicating the pattern data and the bitmap data indicating the edging data, the value of each pixel of each bitmap data is changed by the filter information to obtain In order to quantize the obtained value with the quantization information, at least each gradation means for the pattern data and the edging data, and the quantization result are merged, and the gradation bitmap data having a multi-valued value. And a merging unit for generating the bit map data decoding device. 8. Decompressing compressed data, changing at least each pixel value of the bitmap data of the pattern data by filter information for at least the bitmap data indicating the pattern data and the bitmap data indicating the edging data, Pattern data gradation means that quantizes the obtained values with quantization information, and merges the bitmap data indicating the edging data and the quantization result to generate gradation bitmap data having more multivalued values. A bitmap data decoding device comprising: a merging unit for generating. 9. The compressed data is expanded, and at least for the bitmap data indicating the pattern data and the bitmap data indicating the edging data, the value of each pixel of the bitmap data of the pattern data is changed by filter information, The pattern data gradation means for quantizing the obtained value with the quantization information and the value of each pixel of the bitmap data other than the pattern data are changed by the predetermined filter information, and the obtained value is changed in advance. Each gradation means for quantizing with the determined quantization information, and merge means for merging the quantization results to generate gradation bitmap data having more multivalued values. A bitmap data decoding device characterized by the above. 10. With respect to decompressed bitmap data obtained by decompressing compressed data, the value of each pixel is changed by filter information, and the obtained value is quantized by quantization information to obtain a more multivalued value. A bitmap data decoding method, comprising: a gradation step of generating gradation gradation bitmap data. 11. The compressed data is expanded, and at least for the bitmap data indicating the pattern data and the bitmap data indicating the edging data, the value of each pixel of each bitmap data is changed by the filter information to obtain In order to quantize the obtained value with the quantization information, each gradation step for at least the pattern data and the edging data and the quantization result are merged, and the gradation bitmap data having a multi-valued value. And a merge step for generating the bit map data decoding method. 12. The compressed data is expanded, and at least for the bitmap data indicating the pattern data and the bitmap data indicating the edging data, the value of each pixel of the bitmap data of the pattern data is changed by filter information, The pattern data gradation step of quantizing the obtained value with the quantization information and the bitmap data indicating the edging data and the quantization result are merged to generate the gradation bitmap data having more multivalued values. And a merge step for generating the bitmap data decoding method. 13. Decompressing compressed data, and changing at least the value of each pixel of bitmap data of pattern data by filter information for at least bitmap data indicating pattern data and bitmap data indicating edging data, Pattern data gradation step of quantizing the obtained value with the quantization information, and the value of each pixel of the bitmap data other than the pattern data is changed by the predetermined filter information, and the obtained value is changed in advance. Each gradation step that is quantized by the determined quantization information, and a merge step that merges the quantization results to generate gradation bitmap data having more multivalued values A bit map data decoding method characterized by the above.