JP2002335496A - Controller for sub picture display magnification - Google Patents

Abstract

PROBLEM TO BE SOLVED: To properly carry out a processing of data of a sub picture with respect to highlight. SOLUTION: A sub video decoder 18 decodes pixel data subjected to run length compression for a top field and a bottom field to provide an output for each field. A sub video image processing section 21 applies processing such as magnification and reduction to a decode output on the basis of control of a system control section 15. The system control section monitors management information of highlight and also monitors a setting state for the sub picture processing, uses the processing of sub picture as ordinary processing when the highlight is displayed with respect to main video image depending on the monitor result of highlight management information or permits the sub picture processing for no highlight display.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a sub-picture effective for reproducing a sub-picture recorded on a digital versatile disk (DVD) based on the DVD video standard and performing processing such as enlargement and reduction. The present invention relates to a display magnification conversion method and apparatus.

[0002]

2. Description of the Related Art In the DVD video standard, separately from main video data, video data for sub-pictures such as subtitles, so-called "sub-pictures", can be recorded in an independent manner.

In the structure of the sub-picture data, a top field and a bottom field are defined in consideration of reproduction by an interlace method. The sub-picture data is recorded as bitmap data.

[0004] The reproducing apparatus can read the bitmap data from the disk, decode the data, output the data for each field, and combine the decoded data with the decoded main video.

A technique relating to sub-picture data is described in, for example, US Pat. No. 5,758,007.

[0006] Furthermore, a DVD-compliant playback device can display menus such as video titles and buttons for selecting items such as games. In this case, a highlight display is performed. The highlight display is performed based on the highlight information. Highlight technology, for example, USP
6,067,400.

The display of the sub-picture and the display of the highlight are assembled and displayed on a screen. However, the sub-picture display and the highlight display have different data and control data as their sources, and also have different data storage methods.

[0008]

By the way, in order to meet the demands described below, a reproducing apparatus may be required to have a function of performing a magnification conversion on a sub-picture independent of a main picture. .

1. PAL for titles recorded in NTSC format
A request to watch a title recorded on a PAL system or on a NTSC display.

[0010] 2. A request to change the subtitle display magnification.

Conventionally, there are various techniques for enlarging video data at the data stage. Basically,
There is a technique for performing line interpolation using upper and lower scanning lines to perform enlargement. However, this technique has not been applied to enlarge a sub-picture in a DVD playback device.

A problem arises when the sub-picture (characters, symbols, etc.) is displayed together with highlights when the sub-picture is enlarged. Regarding sub-pictures, enlargement processing etc. can be performed independently, but the highlight is completely different in the control method,
This information is output together with the main video. For this reason, when a sub-picture is enlarged, characters by this sub-picture,
Symbols and the like may run off the highlighted area.

In view of the above, the present invention is capable of performing processing such as good enlargement and reduction in a state conforming to the data form of a sub-picture, and adaptively controlling the enlargement processing for highlights. It is an object of the present invention to provide a sub-picture display magnification conversion method and apparatus capable of performing the following.

[0014]

SUMMARY OF THE INVENTION In order to achieve the above object, the present invention provides a means for monitoring highlight management information, a means for monitoring a setting state of sub-picture processing, and a method for managing highlights. According to the monitoring result of the information, when a highlight for the main video is displayed, the processing of the sub-picture is regarded as a normal processing.
Means for permitting processing of the sub-picture.

[0015]

Embodiments of the present invention will be described below with reference to the drawings.

FIG. 1 shows a schematic configuration of a disk reproducing apparatus to which the present invention is applied. DVD video disc 1
1 is rotationally driven and controlled by the disk drive unit 12. The signal recorded on the disk 11 is optically read by the signal reproducing unit 13 and converted into an electric signal. The signal reproducing unit 13 demodulates the reproduced high-frequency signal according to the DVD standard, and then performs error correction.

The reproduced information is input to an audio (A), video (V), and sub-picture (SP) information separation unit 14, and is separated into audio packets, video packets, and sub-picture packets.

In the reproduced information, the management information is
The data is taken into the system control unit 15. Management information is DVD
This is information defined by the standard, and includes title information, attribute information, program chain information, and the like.

An audio packet is input to the coder 16 and decoded by audio, and a video packet is input to the video decoder 17 and decoded. Then, the sub-picture packet is input to the sub-picture decoder 18 and decoded.

The sub-picture decoder 18 outputs data of a top field and a bottom field. The data of the top field and the bottom field are selected by the switch 19 and stored in the frame buffer 20. The output of the frame buffer 20 is input to the sub-picture processing unit 21 and undergoes processing such as enlargement or reduction.

The output of the sub-video processing unit 21 is combined with the main video output from the video decoder 17 to
It is input to the synthesizing unit 22. The operation unit 23 is for inputting operation signals for instructing play, stop, enlargement and reduction processing of sub-pictures, and the like of the playback device. The output of the operation unit 23 is input to the system control unit 15, and the contents are analyzed. The system control unit 15 sets operation start, stop, data processing timing, processing content, and the like of each block according to the analysis result of the operation input.

FIGS. 2A and 2B are diagrams for explaining the basic operation of the main part of the device of the present invention.

In the apparatus of the present invention, the top field and the bottom field data output from the sub-picture decoder 18 are alternately accumulated in the frame buffer 20 as shown in FIG. The circles indicate pixel data. It is assumed that a picture is formed by the white circle and the black circle.

In the apparatus of the present invention, after combining the data of the top field and the data of the bottom field, enlargement or reduction processing is performed. FIG. 2B shows an arrangement state of pixels output from the sub-picture processing unit 21 when the enlargement process is performed. In this case, it is equivalent to the data of the same address (corresponding to horizontal scanning) of the frame buffer 20 being read twice.

FIG. 2C shows a state without employing the present invention, that is, a top field output from the decoder 18 and
An example is shown in which the data of the bottom field is used twice each without being combined. As can be seen by comparing the edge portions shown by dotted lines in FIG. 2B and FIG. 2C, the edges of the picture in FIG. 2B are smooth.

That is, it is understood that the edges of the picture become smoother when the top field and the bottom field are combined first and then the enlargement process is performed as in the present invention.

FIG. 3 shows the format of recording information in the DVD video standard.

A video file (video object set) has a hierarchical structure. One file is composed of a plurality of video objects (VOBs) and one VOB.
Is composed of a plurality of video object units (VOBUs), and one VOBU is composed of a plurality of packs. A plurality of packs include a control pack (certified as a navigation pack on DVD-ROM and an RDI pack on DVD-RAM), a video (V) pack, an audio (A) pack,
There is a sub-picture (SP) pack.

The navigation pack includes the number of streams,
It has angle switching information and the like. The RDI pack is a real-time data information pack (RDI_P
CK).

The pack includes information indicating a start time at which the first field of the VOBU to which the VOBU belongs is reproduced, information indicating the recording time of the VOBU, and manufacturer information (MNF).
I) and the like. It also includes display control information (DCI) and copy control information (CCI). The display control information indicates aspect ratio information, subtitle mode information, and film camera mode information.

The V-pack is obtained by compressing video data according to the MPEG2 system, and includes a pack header, a packet header, and a video data portion. The A-pack is used when the audio data is, for example, linear PCM or MPEG,
Alternatively, it is processed by a method such as AC3, and includes a pack header, a packet header, and an audio data part.

When the above-mentioned sub-picture packs are assembled,
A sub-picture unit as shown in FIG. 4 is constructed.
The sub-picture unit includes a sub-picture unit header (SPUH), pixel data, and a sub-picture display control sequence table. The sub-picture unit header describes the size of the sub-picture unit, the head address of the display control sequence table, and the like. Pixel data for the top field and for the bottom field are separately present. The sub-picture display control sequence table includes a display start time and a display sequence command, and can determine a display position of a sub-picture on a screen, a display color, and the like.

Next, the highlight display function will be described. FIGS. 5A to 5D show a disassembled screen in which, for example, a part 1 of a movie is to be selected based on highlight information during DVD video playback. FIG. 5 (A)
This shows a state in which only the main image has been extracted, and the main image 101 is displayed on the screen 100. FIG. 5B shows a state in which only the sub-picture 102 has been extracted, and a sub-picture for selecting either part 1 or part 2 is displayed. FIG. 5C shows a state where the highlight 103 is displayed. The shaded portion is the highlight 103. FIG. 5D shows a composite of the above images.
This is the image actually displayed. When the user, for example, sees FIG.
When the execute button (or the play button) is operated by the remote controller in the state as shown in (D), the reproduction of the part 1 is started.

FIGS. 6A to 6C show recording locations of control data for displaying highlights. As shown in FIG. 6A, the highlight information is described in a picture control information packet (PCI_PKT) in the navigation pack (NV_PCK). Fig. 6 (B)
Indicates the contents of PCU_PKT, and PCI general information (PCI_G
I), non-seamless angle information (NSMI_AGLI), highlight information (HLI), and recording information (RECI).

The PCI_GI contains the logical block number (recording position) of the NV_PCK to which this information belongs, the category of the VOBU, the VOBU
(Information indicating whether a user operation is possible) is included. NSMI_AGLI describes the address of the VOBU to be shifted to next when there is an operation input such as angle switching from the user. HLI has
Information such as the state of highlight (the presence / absence of highlight, whether the highlight is the same as the highlight in the preceding VOBU) and the start time and end time of highlight are described. In the RECI, the recording date, copyright information, country code, and the like are described according to each stream information.

Since the present invention relates to highlighting, FIG. 6C shows details of the highlight information.

The highlight information includes general highlight information, a button / color information table, and a button information table. The highlight general information indicates the state of the highlight (HLI_SS), the start time of the highlight information (HLI_S_PTM), and the end time of the highlight information (HLI_S_PTM).
_E_PTM), indicating the end time of button selection (BTN_SL_E_PT
M), represents the button mode (BTN_MD), represents the button offset number (BTN_OFN), represents the number of number selection buttons (NSI_BTN_Ns), forced selection button number (FOSI_BTNN),
Information such as a forced determination button number (FOAC_BTNN) is described.

HLI_SS is 00 if there is no valid highlight, the highlight exists and the HLI of the preceding VOBU
Is described in the form of 01 if it is the same as that of the previous VOBU, 10 if it is different from the HLI of the preceding VOBU, and 11 if it is the same as that of the preceding VOBU except for BTN_CMD.

HLI_S_PTM is described in the form of highlight start time information at which highlight information is valid.
HLI_E_PTM is described with highlight start time information at which highlight information becomes invalid. As a result, a highlight region is determined as shown in FIG. The time information is compared with a system time clock that counts a reference time in the playback device.
As a result, synchronization of the entire system is obtained.

BTN_SL_E_PTM is used to indicate the end time of the button selection valid period in highlight. This is used, for example, to correspond to the display time of the sub-picture. BTN_MD describes the number of button groups and the display type of each button group. The display type is information such as normal (4: 3) and wide (16: 9).

As described above, the highlight is displayed based on management information completely different from the case of displaying the sub-picture. Therefore, in a case where a highlight is superimposed on a sub-picture, if only the sub-picture is processed and enlarged, the sub-picture is shifted from the highlight or the display position of the sub-sub picture does not match the position of the highlight. .

Therefore, the system according to the present invention is provided with a means for restricting the processing of the sub-picture only to the case without highlight display.

FIG. 7 shows an operation flow of the sub-picture processing control unit in the system control unit 15. The system control unit 15 checks whether sub-image processing is set (steps A1 and A2).
The highlight information in the navigation pack (NV_PCK) is checked (step A3). If the processing of the sub-picture is not instructed, the normal processing is performed (step A
5). If processing is instructed, HLI_
It is determined whether SS is 00 (step A3).
00 means that there is no highlight. In this case, the processing is executed (step A
4). However, if HLI_SS is not 00, there is a highlight. In such a case, if the processing is performed, the above-described problem occurs. Therefore, in this case, normal processing is executed in step A5.

In the above description, it has been described that the sub-picture data is read from a DVD video which is an optical disc. However, the present invention is not limited to this, and the sub-picture data may be data captured via communication means. Further, it is needless to say that the data may be obtained not only from a disk but also from a storage medium such as a semiconductor.

Furthermore, in the above description, an example is shown in which the sub-picture is doubled, but the present invention is not limited to this. The enlargement ratio may be larger, or may include a function of reducing the size. Further, the aspect ratio of the enlargement may be changed.

In the above description, an example has been described in which the sub-picture magnification control is turned off when there is a highlight, and the sub-picture magnification control is turned on when there is no highlight. However, the present invention is not limited to this, and the present invention includes a case where the sub-picture magnification control is turned on when a highlight exists. For example, there is a case where a user owns only a television receiver dedicated to the NTSC system even though a movie main video is recorded on a disc in the PAL system. In this case, the playback signal is
There is a case where a video signal is taken into a television receiver through a TSC system converter (a conversion processor from 576 lines to 480 lines). In such a case, the sub-picture is reduced in the vertical direction together with the main video. In such a case, the subtitle characters may be crushed and difficult to see. Therefore, in the present invention, while watching the main movie, the sub-picture enlargement control is turned off so that the subtitles can be easily viewed, and when a button (highlight) is displayed on the screen in a menu or the like, the balance with the main video is adjusted. Considering this, the enlargement control may be turned on.

That is, the gist of the present invention resides in that the display magnification of the sub-picture can be controlled in accordance with the highlight information.

[0048]

As described above, according to the present invention,
The processing of processing the data of the sub-picture for the highlight can be appropriately executed.

[Brief description of the drawings]

FIG. 1 is a configuration diagram showing one embodiment of the present invention.

FIG. 2 is an explanatory diagram for explaining an operation of a main part of the present invention.

FIG. 3 is an explanatory diagram showing a hierarchical structure of a DVD standard content.

FIG. 4 is an explanatory diagram of a data structure of a sub-picture unit.

FIG. 5 is an explanatory diagram for explaining a highlight function from a screen.

FIG. 6 is an explanatory diagram of highlight information included in a navigation pack.

FIG. 7 is a flowchart illustrating a characteristic operation of the present invention.

[Explanation of symbols]

11 DVD video disk, 12 disk drive unit, 13 signal reproduction unit, 14 audio (A), video (V), sub-picture (SP) information separation unit, 15 system control unit, 16 audio coder , 17 ... video decoder, 18 ... sub-picture decoder, 19 ... switch, 2
0: frame buffer, 21: sub-picture processing unit, 22
... Synthesis unit, 23 ... Operation unit

Claims (4)

[Claims] An apparatus for independently decoding a main picture and a sub-picture, comprising: means for monitoring highlight management information; means for monitoring setting conditions of sub-picture processing; Means for controlling display magnification processing of the sub-picture according to the monitoring result. 2. A sub-picture decoder that decodes sub-picture data constructed from run-length-compressed pixel data for a top field and a bottom field; A sub-picture processing means for performing display magnification processing, a means for monitoring highlight management information, a means for monitoring the setting status of the processing of the sub-picture, and a monitoring result of the highlight management information, A control device for controlling a sub-picture display magnification, comprising: control means for controlling the processing of the sub-picture. 3. The sub-picture data input to the sub-picture decoder is data from means for reading and outputting information from an optical recording medium.
A control device for a display magnification of a sub-picture described in the above. 4. The apparatus according to claim 2, wherein the sub-picture data input to the sub-picture decoder is data captured via a communication unit.