JPH11234586A - Sub video image display - Google Patents

Abstract

PROBLEM TO BE SOLVED: To allow a viewer to easily watch sub video data by dividing a display area of the sub video data into blocks at a prescribed position and providing an prescribed amount of offset to data denoting a display position for each block so as to move the display position of the subs video data. SOLUTION: A lower part detection circuit 33 detects a higher part and a lower part of a luminance signal level from data from a sub video image processing circuit based on a threshold level, while size detection circuits 34, 35 are used to obtain sizes in X and Y directions from position information of the lower part, and a memory control circuit 41 writes the sizes in a memory 43 linked with the sub video data. Simultaneously an offset generating circuit 44 adds an offset in the X and Y directions to a block size for each block and writes the result in a memory 43 as moving display data, and a display are detection circuit 46 writes the display position data in the memory 43 based on a display control command. Data read in a prescribed timing are fed to a mixer circuit and the display position is revised depending on the detection result of the presence of closed caption data.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a reproducing system for reproducing a recording medium such as a DVD on which video data, sub-video data, audio data and the like are recorded, and in particular, to an improved display form of the sub-video on a screen. About what you did.

[0002]

2. Description of the Related Art As is well known, in recent years, not only audio data but also video data can be compressed and recorded on an optical disk having a diameter of 12 cm, for example, the same as an audio CD (Compact Disk). I have. As this kind of optical disk, for example, a CD-ROM (Read Only Memory)
Are widely used in a wide range of fields from education to karaoke.

[0003] Recently, an amount of main video data corresponding to about two hours of a movie has been recorded on an optical disk having the same diameter as a CD.
Eight types of audio data and 32 types of sub-picture data representing subtitles and the like are recorded, and during reproduction, audio and subtitles in a desired language can be freely selected and reproduced.
An optical disk called VD has also been developed. In this DVD, for example, a DVD-ROM or DVD-ROM
Development for use as a RAM (Random Access Memory) or the like is also being promoted.

FIG. 14 shows a D for reproducing such a DVD.
3 shows the structure of the VD playback device 11. That is, DV
The data recorded on the optical disc 12 which is D is read by the disc driver 13 and the demodulation / error correction circuit 1
After demodulation processing and error correction processing etc. are performed by 4,
It is supplied to the system decoder 15.

The system decoder 15 separates input data into main video, sub-video and audio data,
MPEG (Moving Picture Image Codin)
g Experts Group) Decoding processing is performed. The main video data is subjected to predetermined main video processing by the main video processing circuit 16, and the sub video data is processed by the sub video processing circuit 17.
Then, a control process for sub-picture run-length expansion processing and display is performed.

Then, the main video data output from the main video processing circuit 16 and the sub video data output from the sub video processing circuit 17 are mixed at a predetermined ratio by a mixing circuit 18, After being converted into an analog signal, it is supplied to a television receiver 20 externally attached to the DVD reproducing device 11, where an image in which subtitles by sub-video data are superimposed and displayed on the main video is obtained.

The audio data output from the system decoder 15 is subjected to a predetermined audio decoding process by an audio decoder 21 and is converted into an analog signal by an audio output circuit 22. The supplied sound is supplied to the speaker 23 and driven.

The operation of the DVD reproducing device 11 is as follows.
The system is generally controlled by a system CPU (Central Processing Unit) 24. That is, the system CPU 24 is connected to the disk driver 13 and the system decoder 15 and the main video processing circuit 1.
6, the sub-video processing circuit 17, the mixing circuit 18, the audio decoder 21 and the like are connected via a control bus 25.

On the other hand, a code signal called closed caption data is superimposed on lines 21 and 284 of the main video data. The closed caption data is converted into character characters by a closed caption decoder 20a built in the television receiver 20, and is used, for example, to display dialogue, screen conditions, and the like on the main video and display subtitles. I have.

[0010]

The subtitle display position based on the sub-picture data and the subtitle display position based on the closed caption data are not set in consideration of each other. In the case of reproduction, as shown in FIG. 15, the caption based on the sub-picture data and the caption based on the closed caption data overlap with each other, causing a problem that the caption becomes difficult to see.

In particular, in this case, the closed caption data is closed by a closed caption decoder 20a built in the television receiver 20.
Since the subtitle is displayed at an arbitrary position on the screen, the subtitle based on the sub-video data is displayed with priority. That is, the caption based on the sub-picture data is hidden by the caption based on the closed caption data, and is difficult to see.

Therefore, the present invention has been made in view of the above circumstances, and provides an extremely excellent sub-picture display which can easily move the display position of a display image such as a caption based on sub-picture data to make it easier to see. It is intended to provide a device.

[0013]

SUMMARY OF THE INVENTION A sub-picture display device according to the present invention is intended for an apparatus which superimposes a display image by sub-picture data on a main picture display screen by main picture data. Then, the display area of the sub-picture data is divided into a plurality of areas, and a discriminating means for discriminating the presence or absence of a display image in each area, and a break of the display image by the sub-picture data is detected based on a discrimination result of the discriminating means. Detecting means for dividing the display area of the sub-picture data in block units by the detected breaks, and offset generating means for giving a predetermined amount of offset to the data indicating the display position for each block divided by the detecting means Is provided.

According to the above configuration, the display area of the sub-picture data is divided into blocks divided by the breaks of the display image, and a predetermined amount of offset is given to the data indicating the display position for each block. With this configuration, even when the display image based on the sub-video data and the display image based on the closed caption data overlap, the display position of the display image based on the sub-video data can be easily moved to make it easier to see.

[0015]

Embodiments of the present invention will be described below in detail with reference to the drawings. That is, in FIG. 1, the same parts as those in FIG. 14 are denoted by the same reference numerals, and the sub-picture data output from the sub-picture processing circuit 17 is supplied to the mixing circuit through the sub-picture display position changing circuit 26. 18.

The sub-picture display position changing circuit 26, which will be described later in detail, changes the subtitle display area to be moved in the display position, which is formed by the inputted sub-picture data, in the vertical and horizontal continuity. By determining the presence / absence, the block is divided into blocks in units of characters. The display position is changed by giving a predetermined amount of offset in the horizontal and vertical directions of the display position for each block.

The video data output from the mixing circuit 18 is output to the closed caption data detection circuit 2.
7 to detect whether or not closed caption data is included, and the detection result is supplied to the sub-video display position changing circuit 26. The movement of the subtitle display position by the sub-picture data is realized by the user operating the remote controller 28 to request the system CPU 24.

Here, FIG. 2 schematically shows a technique for changing the subtitle display position based on the sub-picture data by the sub-picture display position changing circuit 26. That is, based on the data indicating the start position and the end position of the subtitle display area by the sub-video data,
The data is recorded in the field memory 29 and the second field memory 30.

When the sub-picture data is read from the first field memory 29 and the second field memory 30, the display control circuit 31 divides the subtitle into blocks in units of characters, and starts and ends the blocks for each block. The display position is changed by giving horizontal and vertical offsets to the data indicating the position.

The data indicating the start position and the end position of the subtitle display area based on the sub-picture data is shown in FIG.
As shown in (1), a display control command (SP_DCCMD: Display Control Co) included in a display control sequence (SP_DCSQ: Display Control Sequence) in a sub-picture unit (SPU: Sub-Picture Unit), which is one unit of sub-picture data.
mmand), SET_DAREA (Sets Display Area of Pixe
l Data).

There are the following two means for dividing the subtitle display area into blocks for each character. First, the first means
As shown in FIG. 4, the entire subtitle display area is divided into a plurality of areas [in the illustrated case, 14 in the X (horizontal) direction × 8 in the Y (vertical) direction = 112].
Pieces), and each area is divided into a peak portion having a higher level than a luminance signal level of arbitrary display data from a luminance signal level of display data after the run-length decoding of the sub-video data, and an arbitrary peak portion. Is divided into a valley portion having a lower level as compared with the luminance signal level of the display data.

Then, the position in the X direction where all the areas continuous in the Y direction are valleys is determined as a break in the X direction,
The size between the cuts is defined as the size of the character block in the X direction. Similarly, a position in the Y direction in which all areas continuous in the X direction are valleys is determined to be a character break in the Y direction, and the space between the breaks is defined as the size of the character block in the Y direction. I have decided.

In this case, the luminance signal level of arbitrary display data indicates a white level generally used for subtitles, and is assumed to be 200 in decimal. The maximum value of the luminance signal in the DVD standard, that is, the white peak is 235.

Next, the second means is to set each area as a mountain portion from the level of the mixture ratio (for example, A (h: hexadecimal) or more) of the main video data and the sub video data in the entire subtitle display area. It is divided into valleys, and the position in the X direction where all areas continuous in the Y direction are valleys is determined to be a break between characters in the X direction.
The block size is determined by determining the position in the Y direction where all the regions continuous in the direction are valleys as the breaks in the character in the Y direction.

FIGS. 5 and 6 show an operation of detecting the block size of each subtitle character unit and moving the display position by dividing the entire subtitle display area into a peak portion and a valley portion. It is a flowchart shown. First,
When started (step S1), it is detected in step S2 whether closed caption data is included in line 21 or line 284 of the main video data.

The detection of the closed caption data is performed by using a threshold of 50 IRE at the analog level or 100 ± 10 at the digital level (100 IRE: the white peak is set to the digital value 235, and 0IRE: the black level is set to the digital value 16). The determination is made based on whether or not data having a level exceeding this threshold value exists in line 21 or 284 of the main video data.

If the closed caption data is not detected (NO), the process is terminated as it is (step S18). If the closed caption data is detected (YES), the display control of the sub-picture data is performed at step S3. The subtitle display area described in SET_DAREA in the command (SP_DCCMD) is detected, and step S4
Then, the sub-picture data in the display area is recorded in a memory (not shown).

Then, in step S5, the subtitle display area is determined to have a peak portion and a valley portion from the luminance signal level of the sub-picture data or the mixing ratio level of the sub-picture data and the main picture data. In this determination, the luminance signal level of the sub-picture data is 200 (white peak is 235), or the mixing ratio level between the sub-picture data and the main picture data is A (h) [the maximum value F (h)]. Data that exceeds the threshold value is a peak, and data that does not exceed the threshold value is a valley.

Then, in step S6, valley portions are detected in the Y direction and the X direction in the caption display area.
Then, first, in step S7, it is determined whether or not all regions on the same line in the Y direction are valleys. Y
If all the regions on the same line in the direction are not valleys (NO), the process returns to the step S6, and 1 is set in the X direction.
The line is moved, and a valley portion on the same line in the Y direction is detected again.

If it is determined that all regions on the same line in the Y direction are valleys (YES), the line is regarded as a break between characters in the X direction, and
In step S8, the distance between the line of the previously detected X-direction character break and the line of the currently detected X-direction character break, that is, the block size in the X direction, is calculated. Find the value.

Then, in step S10, step S8
The block size in the X direction determined in step S9 is
1/2 of the average value of the block size in the X direction obtained by
It is determined whether or not this is the case. If it is not equal to or larger than 1/2 (NO), it is determined in step S11 whether or not a block whose size in the X direction is equal to or smaller than 1/2 of the average value is continuously obtained at least twice. If yes (YES), in step S12, the continuous size of each block whose size in the X direction is not more than の of the average value is regarded as a block size for one character, and collected.

Further, based on the detection result of the valley in the X direction in the subtitle display area in step S6, step S6 is executed.
At 13, it is determined whether all regions on the same line in the X direction are valleys. If all the regions on the same line in the X direction are not valleys (NO), the process returns to step S6, moves one line in the Y direction, and again detects a valley portion on the same line in the X direction. It is.

If it is determined that all the regions on the same line in the X direction are valleys (YES), the line is regarded as a break between characters in the Y direction. The distance between the line of the character cut in the Y direction and the line of the character cut in the Y direction detected this time, that is, the block size in the Y direction is obtained.

When it is determined in step S10 that the size in the X direction is equal to or more than の of the average value (YE
S), in step S11, the size in the X direction is 1 / the average value.
If it is determined that no more than two blocks have not been obtained two or more consecutive times (NO), and steps S12 and S1
After 4, the block size for one character is determined in step S15.

Then, in step S16, the data indicating the start position and the end position are given to the data indicating the start position and the end position in the X direction and the Y direction, respectively, according to the block size, and are written in the memory. The subtitle is displayed in the frame with the subtitles moved,
The process is ended (step S18).

FIG. 7 shows details of the sub-picture display position changing circuit 26 for realizing the above operation. That is, the luminance signal level of the sub-picture data supplied to the input terminal 32 or the mixture ratio level between the sub-picture data and the main picture data is supplied to the valley detection circuit 33,
A peak and a valley are detected based on the above-described threshold.

Then, from the position information (X coordinate, Y coordinate) of the valley portion detected by the valley detection circuit 33, the X direction size detection circuit 34 calculates the distance Xk between the breaks in the X direction. Further, the position information (X coordinate, Y
From the coordinates), the Y-direction size detection circuit 35 determines the distance Yk between the cuts in the Y direction.

Here, the X-direction size Xk obtained by the X-direction size detection circuit 34 simply detects a break in the X direction, but some characters have a break between the left and right. Therefore, the average value of the X-direction size is obtained by the average value calculation circuit 36, and the half value calculation circuit 37
, The comparison circuit 38 calculates the X-direction size X obtained by the X-direction size detection circuit 34.
k and 1 / of the average value output from the 1/2 calculation circuit 37.
Compare with 2.

Then, the size Xk in the X direction is 1 / the average value.
If it is shorter than 2, the two-block size adding circuit 39
The selector 40 is controlled to derive a value obtained by adding the X-direction sizes of two consecutive blocks according to the following formula. When the X-direction size Xk is longer than 平均 of the average value, X
Selector 4 so that direction size Xk is derived as it is.
0 is controlled.

The X-direction size output from the selector 40 and the Y-direction size output from the Y-direction size detection circuit 35 are determined by the memory control circuit 41 by the memory control circuit 41.
The data is linked to the decoded sub-picture data supplied to the input terminal 42 and written into the memory 43.

At this time, X output from selector 40
The offset generation circuit 44 adds an X-direction and a Y-direction offset to the block size for each block by the offset generation circuit 44 to the direction size and the Y direction size output from the Y direction size detection circuit 35, and stores the data as display data for movement. 4
3 is written.

Further, based on the SET_DAREA in the display control command (SP_DCCMD) supplied to the input terminal 45, the display area detection circuit 46 creates display position data and writes it in the memory 43. The display position data and the sub-picture data written in the memory 43 in this manner are read out at a predetermined display timing by the display control circuit 47 and then supplied to the mixing circuit 18 via the output terminal 48. .

FIG. 8 shows an example of subtitle display position change by the offset. That is, as shown in FIG. 8A, a horizontally long caption display in which the display start position in the X direction is Xa and the display start position in the Y direction is Ya, and Y in the X direction.
By giving an offset (arbitrary value: user can set) to a and giving an offset (arbitrary value: user can set) to Xa in the Y direction, as shown in FIG. It is possible to convert the display into a portrait display.

In this case, in the X direction, a uniform offset is added to every block, but in the Y direction, the first block is Xa ± offset and the second block is Xa ± offset in the first block size Yk1. The display is performed one after another such that the offset is added.

For this reason, as shown in FIG. 9A, the caption based on the sub-picture data overlaps with the caption based on the closed caption data, and the subtitle based on the sub-picture data is hidden by the caption based on the closed caption data, making it difficult to see. In this case, as shown in FIG. 11B, by moving the display position of the subtitle by the sub-picture data, both subtitles can be easily viewed without overlapping.

FIG. 10 shows a modification of the embodiment shown in FIG. 1, in which a television receiver 20 and a speaker 23 are integrated in a DVD reproducing apparatus 11. . In this case, the television receiver 2
0 can also be controlled by the system CPU 24 via the control bus 25. For this reason, by controlling the closed caption decoder 20a, it is possible to move the display position of the caption based on the closed caption data.

At this time, the user can select via the remote controller 28 which of the subtitle display position by the sub-picture data and the subtitle display position by the closed caption data is to be moved.

Next, another example for dividing a subtitle display area by sub-picture data into blocks in units of characters will be described. That is, as shown in FIG. 11, the entire subtitle display area includes a plurality (in the illustrated case, 28 in the X direction × 1 in the Y direction).
(2 = 336) regions, and each region is compared with the luminance signal level of any display data from the luminance signal level of the display data after the run-length decoding processing of the sub-picture data, and the peak is higher than the peak signal level. And a valley portion having a lower level as compared with the luminance signal level of arbitrary display data.

Then, an area in which all areas continuous in the Y direction are valleys is detected. This area is a part indicated by reference numerals a, b, c, d, e, and f in FIG. And
Of these six areas a to f, the area where the continuous amount in the X direction is the smallest (that is, in this example, the areas c and f and the minimum value is “1”) is detected, and the continuous amount in the X direction is the minimum. Areas that are twice or more the value “1” (that is, areas a and b and areas d and e in this example) are determined to be character breaks in the X direction. In this case, it is determined that the areas c and f having the minimum value “1” are, for example, the intervals adjacent to the bias of the character.

FIG. 12 is a flow chart showing the operation of detecting the block size of the subtitle in character units and moving the display position. First, in step S19,
Each region in the subtitle display area based on the sub-picture data is divided into a peak portion and a valley portion, and in step S20, an area in which the valley portion continues in the Y direction is detected.

When an area in which the valley portion continues in the Y direction is detected (YES), the minimum value of the continuation amount of the area in the X direction is obtained in step S21, and in step S22, the valley portion is determined. Are detected in an area where is continuous in the Y direction, where the continuous amount in the X direction is twice or more the minimum value. In this case, if the corresponding portion is not detected (NO), the process returns to step S20. If a corresponding part is detected in step S22 (YES), the part is determined in step S23 as a character break.

On the other hand, if an area in which the valley portion continues in the Y direction is detected in step S20 (YES),
In step S24, a continuous value of the peak portion in the X direction is obtained. Then, in step S25, the block size to be moved is determined by adding the size of the cut obtained in step S23 and the continuous value of the mountain obtained in step S24.

Then, in step S26, data indicating the start position and the end position according to the block size is
The offsets in the X and Y directions are given and written to the memory 43, and in step S27, the display is performed with the subtitles moved in the next frame.

FIG. 13 shows a modification of the sub-picture display position changing circuit 26 for realizing the above operation. That is, if the same parts as those in FIG. 7 are denoted by the same reference numerals, the position information of the valleys detected by the valley detection circuit 33 indicates that the valleys are continuous in the Y direction by the Y-direction valley continuity detection circuit 49. The X-direction valley continuous value detection circuit 50 detects the continuous value in the X direction of the area.

As for the detected continuous values in the X direction, the minimum value detecting circuit 51 detects the minimum value of the continuous values in the X direction. Then, the detected minimum value is multiplied by the double multiplier 5
After being doubled by 2, the comparison circuit 53 compares the value with the continuous value in the X direction detected by the continuous value detection circuit 50 in the X direction. When the continuous value in the X direction is larger than twice the minimum value, the comparison circuit 53 determines that the character is a break, and outputs the position information to the offset generation circuit 44.

On the other hand, the luminance signal level of the sub-picture data supplied to the input terminal 32 or the mixing ratio level between the sub-picture data and the main picture data is determined by the X-direction mountain continuity detecting circuit 5.
4 to detect the continuity of the peaks in the X direction.
The detection result is added by the addition circuit 55 to the output of the double multiplication circuit 52 and output to the offset generation circuit 44. It should be noted that the present invention is not limited to the above-described embodiment, and can be variously modified and implemented without departing from the scope of the invention.

[0057]

As described in detail above, according to the present invention,
Provided is an extremely excellent sub-video display device capable of moving a display position of a display image such as a caption based on sub-video data to make it easier to see a display image based on closed caption data and a display image based on sub-video data. Can be.

[Brief description of the drawings]

FIG. 1 is a block diagram showing an embodiment of a sub-picture display device according to the present invention.

FIG. 2 is an exemplary view for explaining a schematic operation of changing a subtitle display position in the embodiment.

FIG. 3 is an exemplary view for explaining a data structure of sub-picture data in the embodiment.

FIG. 4 is an exemplary view for explaining means for dividing a subtitle display area based on the sub-picture data into blocks in units of characters;

FIG. 5 is a flowchart illustrating an operation of changing the display position by dividing the subtitle display area into blocks in units of characters.

FIG. 6 is a flowchart for explaining an operation of dividing the subtitle display area into blocks in units of characters and changing a display position.

FIG. 7 is a block diagram showing an example of details of a sub-picture display position changing circuit according to the embodiment;

FIG. 8 is a view for explaining an example of changing a subtitle display position by the sub-picture display position changing circuit.

FIG. 9 is a diagram illustrating an example in which the display position of a subtitle is changed so that two types of subtitles do not overlap.

FIG. 10 is a block diagram showing a modification of the embodiment.

FIG. 11 is a diagram for explaining another example of a unit that divides a subtitle display area based on the sub-picture data into units of characters.

FIG. 12 is a flowchart illustrating an operation of changing the display position by dividing the subtitle display area into blocks in units of characters.

FIG. 13 is a block diagram showing another example of the details of the sub-picture display position changing circuit in the embodiment.

FIG. 14 is a block diagram showing a conventional DVD reproducing apparatus.

FIG. 15 is a view for explaining a problem in the conventional device.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 11 ... DVD reproducing apparatus, 12 ... Optical disk, 13 ... Disk driver, 14 ... Demodulation / error correction circuit, 15 ... System decoder, 16 ... Main video processing circuit, 17 ... Sub video processing circuit, 18 ... Mixing circuit, 19 ... Video Output circuit, 20: TV receiver, 21: Audio decoder, 22: Audio output circuit, 23: Speaker, 24: System CPU, 25: Control bus, 26: Sub-picture display position change circuit, 27: Closed caption data detection Circuits, 28 remote controller, 29, first field memory, 30, second field memory, 31, display control circuit, 32, input terminal, 33, valley detection circuit, 34, X direction size detection circuit, 35, Y direction Size detection circuit, 36: average value calculation circuit, 37: 1/2 calculation circuit, 38: comparison circuit, 39 ... 2 block size addition circuit, 40 ... selector, 41 ... memory control circuit, 42 ... input terminal, 43 ... memory, 44 ... offset generation circuit, 45 ... input terminal, 46 ... display area detection circuit, 47 ... display control circuit, 48: output terminal, 49: Y direction valley continuity detection circuit, 50: X direction valley continuity detection circuit, 51: minimum value detection circuit, 52: double multiplier circuit, 53: comparison circuit, 54: X direction valley continuity Sex detection circuit, 55 addition circuit.

Claims (7)

[Claims] 1. A main video display screen based on main video data,
In a sub-picture display device that superimposes and displays a display image by sub-picture data, the display area of the sub-picture data is divided into a plurality of areas,
Discriminating means for discriminating the presence or absence of a display image in each area; and, based on the discrimination result of the discriminating means, a break in the display image based on the sub-picture data is detected. A sub-picture display, comprising: a detecting means for dividing the data into blocks; and an offset generating means for giving a predetermined amount of offset to data indicating the display position for each block divided by the detecting means. apparatus. 2. The method according to claim 1, wherein the determining means compares the luminance signal level of the sub-picture data with a reference level for each of the regions to determine the presence or absence of a display image in each of the regions. The sub-picture display device according to claim 1. 3. The method according to claim 1, wherein the determining unit compares a mixing ratio of the main video data and the sub-video data with a reference value for each of the regions to determine whether or not there is a display image in each of the regions. 2. The sub-picture display device according to claim 1, wherein: 4. The method according to claim 1, wherein the detecting means determines, as one block size, a length of a plurality of continuous blocks in which the length between the detected breaks is shorter than the average value. 4. The sub-picture display device according to claim 2, wherein 5. The sub-picture according to claim 2, wherein the detecting means divides the display area of the sub-picture data into blocks based on a break having a width twice or more a minimum value. Display device. 6. The determining means divides a display area of the sub-picture data into a plurality of areas divided by an X direction and a Y direction orthogonal to the X direction. Is determined to be a break in the Y direction when it is determined that there is no display image, and is determined to be a break in the X direction when all the regions in the Y direction are determined to have no display image. The sub-picture display device according to claim 1. 7. The sub-picture display device according to claim 1, wherein said offset generating means gives an offset to coordinate data indicating a display position of a block divided by said detecting means.