JPH11234622A - Input processing method and system for video data and recording medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To add/insert data such as characters to a recording medium freely. SOLUTION: A disk reproduction device during reproduction commanded by an operation section 201 reproduces a disk and a display device 1002 displays a main video image and while an insertion area of a sub video image is displayed, the sub video image is inserted through the operation section 201. Then compression data for the sub video image are recorded on the disk.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

The present invention is effective when employed in, for example, a digital video disk recording and reproducing apparatus.
The present invention relates to a video data input / recording / playback apparatus.

[0002]

2. Description of the Related Art In recent years, high-density recording digital video discs have been developed. Video information such as movies, subtitles of the movies (a plurality of language subtitles can be recorded and prepared) are recorded on the video discs. (A plurality of languages can be recorded and prepared). As a digital video disk, a disk capable of writing and erasing information by an optical means using laser light has been developed.

[0003]

When a disc capable of recording and reproducing information has been developed as described above, a recording and reproducing apparatus capable of rewriting data such as the above-described subtitles and additionally recording data is demanded. You.

It is an object of the present invention to provide a video data input processing method and apparatus and a recording medium in which data such as characters can be freely added and inserted.

[0005]

In order to achieve the above object, the present invention provides compressed data obtained by compressing pixel data of a sub-picture serving as a sub-picture for superimposing on a main picture by a predetermined compression method. In the case of constructing a sub-picture data unit of a predetermined format for recording on a recording medium, pixel data of a plurality of sub-pictures as a minimum unit are prepared in advance in the form of the compressed data, and these The sub-picture data unit is constructed by selecting and / or combining compressed data.

[0006] When the sub-picture data unit is packed and recorded on the recording medium, it is recorded in an area preset on the recording medium. Further, the predetermined compression method is a run-length compression method.

In order to achieve the above object, the apparatus of the present invention mixes a main picture pack having compressed main picture data and a sub-picture pack having run-length compressed sub-picture data. A row of the sub-picture packs includes a recording medium that also includes display sequence control data for displaying the sub-pictures, and a free space provided on the recording medium and for recording the sub-picture packs. When,
Selecting means for selecting run-length data corresponding to each character prepared in advance in the memory for writing the sub-picture pack including arbitrary sub-picture data in the free space, Writing means for performing predetermined processing on the run-length compressed data, arranging the data in the sub-picture pack, and writing the sub-picture pack in the free space.

[0008] By the above means, the user can freely record and reproduce the desired sub-picture in association with the main picture, and the field of use can be expanded.

[0009]

Embodiments of the present invention will be described below with reference to the drawings.

First, an outline of a recording / reproducing apparatus to which the present invention is applied will be described. In FIG. 1, an optical disk (DVD)
100 is mounted on a turntable (not shown),
It is clamped by a clamper and driven to rotate by a motor 101. Now, assuming that the playback mode is set, the information recorded on the optical disc 100 is
Will be picked up by The pickup unit 102
Movement control in the disk radial direction by the servo unit 103,
Focus control and tracking control are performed. The servo unit 103 also sends a control signal to the disk motor drive unit 104 to rotate the motor 101 (that is, the optical disk 1).
00).

The pickup section 102 also has a signal recording function, and includes a head for outputting a recording laser beam as an optical head.

The output of the pickup unit 102 during reproduction is
The signal is input to demodulation / error correction section 105 and demodulated. The demodulated data demodulated here is input to the reproduction processing unit 1001, where the main video, the sub-video data, and the audio data are decoded. A plurality of streams exist as sub-picture data, and the user can select one of the streams through the operation unit 201 and the system control unit 200. Also, a plurality of streams exist in the audio data.
1. Any stream can be selected through the system control unit 200.

The reproduced main video and sub video data are displayed on a display unit 1002, and the reproduced audio signal is output from an audio output unit (speaker) 1003.

The above-mentioned apparatus is provided with a predetermined area of the optical disc 100 via an operation section 201, a system control section 200, a sub-picture recording processing section 2001, a modulation / error correction code adding section 2002, and a pickup section 102. The sub-video data can be recorded in the sub video data.

FIG. 2 shows an example of a situation when the apparatus is operated to record sub-picture data. A disk for which recording is permitted is loaded into the recording / reproducing device 10, and
For example, when the recording mode is set, a still image is displayed at the position of the video to be recorded, and the area for recording the sub
02 is indicated on the screen. For example, an instruction is given by a dotted frame and blinking by a cursor. In the example shown in the figure, “CAT” and “M” are assigned to the input permission areas 11, 12, and 13, respectively.
An example in which "OON" and "STAR" are input is shown.

When it is desired to record the sub-picture data by inputting in this way, a recording instruction is issued through the operation unit 201, so that "CAT" data is recorded as sub-picture data corresponding to the cat pattern. , "MOON" data is recorded as sub-picture data corresponding to the moon pattern, and "STAR" data is recorded as sub-picture data corresponding to the star pattern.

When the disc recorded as described above is normally reproduced, a display as shown in FIG. 2 can be obtained.

FIG. 3 shows an example of the configuration of the sub-picture data recording processing section 2001.

The sub-picture data recording processing unit 2001 operates in response to a command from the system control unit 200. In order to receive the command, the status of the sub-picture data recording processing unit 2001 is passed to the system control unit 200. For this purpose, an input data processing and checking unit 2111 is provided.

Further, a memory 2112 for storing sub-picture data in a run-length compressed form is provided. This memory 2
When the sub-video data 112 is read by the nomination from the system control unit 200 via the input data processing and checking unit 2111, the sub-video data
(Pixel data) is input to the alignment unit 2113. Here, for example, the data is read from the memory 2112 and accumulated for each data unit to be displayed in one line period.

For example, assuming that sub-picture data is input to the area 11 shown in FIG. 2, the memory 2112 supplies pixel data (run-length compressed) for obtaining “CAT” in the area 11. ) Are read from the memory 2112 and aligned. When data is input due to improper operation or when the memory 21
If the number of characters read from the number 12 is large, the input data processing and checking unit 2111 checks, and performs a warning sound and / or display.

Next, the sub-picture data compiled by the PXD alignment section 2113 is
4 and is formatted into a predetermined sub-picture data unit. This sub-picture data unit is
For example, a unit in the form set in the DVD standard is formatted so as to be convenient for decoding. For example, in the sub-picture data unit, control data for displaying the sub-picture is prepared and recorded on a recording medium from the beginning, and only a part for recording compressed data for obtaining pixel data is set as an empty area. I have.

Further, a sub-picture data unit generator 211
4. The sub-picture data unit constructed in
The data is sent to 115 and packed for data transfer and recording. And after each pack is packed,
Input to the modulation / error correction code adding unit 2002,
The data is modulated and added with an error correction code, supplied to the pickup unit 102, and recorded in a preset area of the disc 100.

Each of the above-mentioned packs is decoded by the decoder and displayed on the display 1002, so that the user can confirm the input characters. Display 10
In 02, characters must be displayed,
Although display sequence control data is required, since the display sequence control data has a predetermined area for arranging characters, the display sequence control data is also predetermined and can be recorded on a disc. is there. Alternatively, the display sequence control data may be automatically generated in the sub-picture data recording processing unit 2001 and added to the sub-picture data unit.

FIG. 4 shows an example of data stored in the memory 2112. The memory 2112 stores pixel data of characters A, B, C,..., Z as run-length compressed data in advance, and stores them for the top field and the bottom field. In the figure, on the memory 2112, the PXD for the top field of the character "A" is indicated as an address <TADA>, the PXD for the bottom field of the character "A" is indicated as an address <BADA>, and the PXD for the top field of the character "B" is indicated. Address <TAD
B>, the PXD for the bottom field of the character “B” is shown as an address <BADB>, the PXD for the top field of the character “C” is an address <TADC>, and the PXD for the bottom field of the character “C” is an address <BADC>. Is shown.

When the character "A" is designated from the operation unit 201, this is interpreted by the system control unit 200, and designation data corresponding to the character "A" is given to the input data processing and checking unit 2111. Then, the input data processing and checking unit 2111 outputs the previous address <TADA>, <BADA>, and stores the run-length compressed data for the character “A” in the memory 211.
2 and can be provided to the alignment unit 2113. The sorting unit 2113 sorts the run-length compressed data of each character so as to correspond to the character string.

As described above, when the user inputs characters in the area 11, the characters "C", "A", and "T" are specified one after another. In this case, when performing the character display, perform an operation of changing the control data to be controlled on the display,
If necessary, the display control contents (color code, contrast information between the main image and the sub-image, display position, color and contrast) can be additionally corrected.

As described above, the run-length compressed data of each character is joined to create a PXD. Then, based on the created run-length data, the sub-picture unit size (SPU_SZ) and the sub-picture display sequence table start address (SP_DCS)
QT_SA) and the like, a sub-picture unit header (SPUH) is also created, and a sub-picture data unit for each display line is generated.

The sub-picture unit size (S
PU_SZ), sub-picture display sequence table start address (SP_DCSQT_S)
A), the sub-picture unit header (SPUH) and the sub-picture data unit will be described in more detail later.

The above-mentioned input situation is determined by, for example,
10 (FIG. 1), the sub-picture data unit can be decoded in the reproduction processing unit 1001 and displayed on the display unit 1002.

The user checks the contents of the display and decides whether to record or not. When not recording, the created data is discarded when the insertion mode is released. When recording, the packed data is recorded in a predetermined free area.

FIG. 5 shows an example in which the elements of the sub-picture data are stored in the memory 21.
12 is a diagram for explaining a decoding process in the case where run-length compressed data is read out from the memory 12 and is arranged, decoded by the reproduction processing unit in FIG. 1, and displayed on a display.

In FIG. 5A, when the user inputs characters in the area 11, the characters "C", "A", and "T" are specified one after another. Now, it is assumed that the display size of the pixel data of one character represented by the run-length compressed data is predetermined and is 10 dots in the horizontal direction and 8 lines in the vertical direction. In this case, it is assumed that the character display mode in the horizontal direction (horizontal direction) is selected.

First, the start address of each field of the run-length compressed data of the character selected by the user is stored. Assuming that “C”, “A”, and “T” are successively selected, as a top field, an address <TADC
>, <TADA>, and <TADT> are temporarily stored in the data control register in order, and address addresses <BADC>, <BADA>, <BAD> are stored as bottom fields.
T> are temporarily stored in the data control register in order.

Next, decoding starts at the address <TADC> at a location (* 1) that becomes a display area on the display, and when decoding of 10-dot data is completed (* 2), the next Holds the address <TADC_NEXT> of the data to be decoded in the data control register, and starts decoding from the data at the address <TADA>.

As described above, when decoding each run-length compressed data, every time decoding of 10 dots of pixel data is performed, the next address for the character is held, and the data of the address of the next character is stored. Perform decoding. Then, decoding is performed from the data of the address <TADT> of the last character, and when pixel data for 10 dots is obtained (* 3), decoding of the line is terminated.

When the display area for the next horizontal display effective period is reached (* 4), the value <TADC_NEXT that has been held previously is retained.
> Decoding. When the decoding of the data for 10 dots is completed, the address of the data for "C" to start decoding next is held as before, and the decoding is started from the data for the next character "A". To start. The address for this is the address previously held.

Similar decoding is performed for the bottom field. When the decoding is performed in this manner and the run-length data is stored in the display memory in the order of decoding for each field while performing the above-described processing during the period of 8 lines, horizontal display data "CAT" can be obtained.

In the above example, characters "CAT" are displayed side by side (horizontally).
As shown in (B), it can be set so that the images can be displayed side by side in the vertical direction (vertical direction).

The start address of each field of the run length data for each character selected by the user is stored. For example, for the top field address <TADC
>, <TADA>, <TADT>, and addresses for the bottom field are addresses <BADC>, <BADA>, <BADT
> In the data control register.

The address <* at the location (* 1) that becomes the display area
The data is decoded in the order of TADC>, <TADA>, and <TADT>. When the display data is stored in the display memory in the order of decoding for each field while performing the above processing for a period of 24 lines, this becomes the data for displaying the character "CAT" in the vertical direction.

As described above, in this apparatus, a minimum of run-length-compressed data is prepared in the memory, and the user selects necessary data from this data, so that the sub-picture data is stored in the memory. Obtainable.

In the above example, the data stored in the memory 2112 is an alphabetical example. However, the present invention is not limited to this, and any character may be used. Further, symbols or marks other than characters may be used.

For example, as shown in FIG. 6, Japanese characters may be prepared by run-length compression and stored in a memory.

FIG. 7 shows a sub-picture data unit generation unit 2
The format of the sub-picture data unit constructed at 114 and the manner in which the sub-picture data unit is packed by the packing unit 2115 are shown.

As shown in FIG. 7A, the sub-picture data unit 310 includes a sub-picture unit header (S) in which various parameters for displaying a sub-picture are recorded.
PUH) 311, display data (compressed pixel data; PXD) 312 composed of a run-length code, and a display control sequence table (DCSQT) 313. In the pixel data PXD portion, data for one horizontal line period of a two-dimensional display screen can be arranged.

FIG. 7B shows a state in which the above-mentioned sub-picture data unit is divided, and a pack header and a packet header are added to the divided data. The data to which the header is added is called a sub-picture (SP) pack. This sub-picture pack is defined as 2048 bytes.

The sub-picture pack packed as described above is recorded in a predetermined area of the disc as shown in FIG.

As described above, according to the present invention, pixel data of a sub-picture serving as a sub-picture for superimposing on a main picture is compressed data by a predetermined compression method, and a predetermined data for recording on a recording medium. When the sub-picture data unit is constructed in a sub-picture data unit of the format, pixel data of a sub-picture which is a plurality of minimum units (characters, graphics, etc.) is prepared in advance in the form of the compressed data, and these compressed data are selected and / or The sub-picture data unit is constructed by combining them. And
When the sub-picture data unit is packed and recorded on a recording medium, it is recorded in an area set in advance on the recording medium.

As a predetermined compression method, a run-length compression method is employed. When pixel data of a sub-picture is prepared in advance in the form of compressed data, it is stored in a memory. Since the compressed data is prepared, the data amount is reduced, and the memory capacity can be reduced.

When the compressed data corresponding to the pixel data of the sub-picture of the minimum unit is constructed as the sub-picture data unit, when the compressed data is decoded, the compression of the decoded pixel data of each sub-picture should be performed on the same line. By connecting the data, a sub-picture data unit corresponding to one line is constructed. With this method, a sub-picture data unit can be efficiently obtained with a small amount of data.

Then, in order to construct a sub-picture data unit corresponding to the one line, when the compressed data of those which should be on the same line are connected, this data amount is managed by the sub-picture data unit. Sub-picture data unit size (SPU_
SZ), start address (SP_DCSQT_SA) of the display control sequence table of the sub-picture data unit
(To be described with reference to FIG. 25) is used as the reference data amount.

When the sub-picture data unit is constructed, at least a command (FIG. 32) for controlling the display start and end timings, the contrast, and the display area when displaying the sub-picture is included in advance. . This can save the trouble of the construction process, and does not require a complicated processing circuit. This is because the start and end timings of the display of the sub-picture are determined when the area to which the sub-picture is to be input is selected in the insertion mode, so that the system control unit 200 prepares the sub-picture data unit generation unit 2114. Will be. The contrast command or the like is easily set as a reference value in advance. This display control sequence may be recorded in advance on a part of the disk on which the sub-picture is to be recorded, or the system control unit 200 may generate display control sequence data relating to the insertion area in the sub-picture insertion mode. Means may be provided.
At this time, a request to automatically add a sub-picture ID or to attach an ID is made on the display. It is more convenient for the user to design such that the ID for designating the inserted sub-picture for reproduction and display is automatically added.

The command may be variable within a limit. This makes it possible to obtain contrast, display position adjustment, and the like according to the user's preference.

In the above-described apparatus, when the ID of the sub-picture is designated and the mode is set to the erasing mode, the data in the area where the sub-picture is recorded on the disc can be deleted.
Also in this erasing process, since the writing area is determined in advance, the area can be easily searched.
After erasing, it is also possible to newly write a sub-picture pack.

Next, the format of a digital video disk to which the present invention is applied will be described.

Next, an optical disk reproducing apparatus and an optical disk format to which the present invention is applied will be described.

The recording data structure of an optical disk will be described as an example of the information storage medium according to the present invention. This optical disk is a double-sided bonded disk having a storage capacity of, for example, about 5 GB on one side, and a number of recording tracks are arranged between a lead-in area on the inner peripheral side of the disk and a lead-out area on the outer peripheral side of the disk. ing. Each track is composed of a number of logical sectors, and various information (digital data appropriately compressed) is stored in each sector.
Is stored.

FIG. 8 shows the volume space of the optical disk.

As shown in FIG. 8, the volume space includes a volume and file configuration zone, a DVD video zone, and other zones. The UDF bridge configuration is described in the volume and file configuration zone, and the data of the UDF bridge configuration can be read even by a computer of a predetermined standard. The DVD video zone is a video manager (V
MG) and a video title set (VTS). The video manager (VMG) and the video title set (VTS) are each composed of a plurality of files. The video manager (VMG) is information for controlling a video title set (VTS).

FIG. 9 shows a video manager (VMG).
And the structure of a video title set (VTS).

The video manager (VMG) includes a video manager information (VMGI) as control data for controlling a video title set and the like, and a video object set (VMGM) as data for menu display. VOBS). Video Manager Information for Backup (V
MGI).

The video title set (VTS) is controlled
Video title set information as data
(VTSI) and data for menu display
Video object set (VMGM VOBS)
Video object set for displaying video.
Video for the title of the video title set.
Object Set (VTSTT VOBS)
You. Video title set inflation for backup
It also has formation (VTSI).

Further, a video object set for displaying images (VTSTT) VOBS) is composed of a plurality of cells. Each cell (Cel)
1) is assigned a cell ID number.

FIG. 10 hierarchically shows the relationship between the video object set (VOBS) and the cell (Cell) and the contents of the cell (Cell). DVD
When the playback processing is performed, video breaks (scene changes, angle changes, story changes, etc.) and special playback are performed in units of cells (Cells) or video object units (VOBs) that are lower layers.
U).

Video Object Set (VOBS)
First, one or more video objects (VO
B IDN1 to VOB IDNi).
In addition, one video object has one or more cells (C IDN1 to C IDNj). Further, one cell is composed of one or a plurality of video object units (VOBU). One video object unit (VOBU) is composed of one navigation pack (NV
PCK), one or more audio packs (A
PCK), one or more video packs (V PC
K) One or more sub-picture packs (SP
PCK).

Here, in the disk according to the present invention, a free area for a sub-picture pack is set, and data can be written in this area as described above.

Navigation Pack (NV PCK)
Are mainly used as control data for controlling the reproduction and display of data in the video object unit to which it belongs, and control data for performing data search of the video object unit.

The video pack (V PCK) is main video information and is compressed according to a standard such as MPEG. Sub picture pack (SP PCK) is basically sub-picture information having auxiliary contents for the main video. For example, movie subtitles, scenarios, etc., using run-length compression technology. Audio Pack (A
PCK) is audio information.

FIG. 11 shows a video object (VO
The relationship between B) and the cell is extracted and shown. FIG.
The example shown in (A) is a block arrangement in which one title (for example, a movie scene) is continuous, and cells in the block are continuously reproduced. In contrast, FIG.
0 (B) shows an example of cell arrangement when a multi-scene is recorded. That is, a standard is defined for DVDs that allow simultaneous recording of events that can be recorded at different angles. For example, in the case of a baseball movie, an image of the entire stadium shot from behind the backnet and an image of the referee's face zoomed in are acquired at the same time, each image is divided into multiple units, and these are interleaved. And record it on the track. The example in FIG. 10B shows an example in which two scenes are divided into units, and each unit is interleaved. If such a disc plays,
Either one of the units is separately acquired and reproduced. Which scene is to be selected is determined by the operation of the user, or when a priority is given and there is no user selection, the one with the higher priority is reproduced.

FIG. 12 shows a program chain (PG
C) shows an example in which the reproduction order of the above cells (Cells) is controlled.

As a program chain (PGC),
Various program chains (PGC # 1, PG # 1) are set so that the reproduction order of the data cells can be variously set.
C # 2, PGC # 3...) Are prepared. Therefore, the order of cell reproduction is set by selecting a program chain.

An example is shown in which programs # 1 to #n described as program chain information (PGCI) are executed. The program shown is a video object set (VOBS) #
The contents after s are specified in order.

FIG. 13 shows a video title set (VT
S) shows a video title set information (VTSI). Video title set program chain information table (VTS) in video title set information (VTSI) PGCIT) is described. Therefore, when a video object set (VOBS) in one video title set (VTS) is played,
This video title set program chain information table (VTS A program chain selected by the user from a plurality of program chains presented in (PGCIT) is used.

In the VTSI, the following data is described in addition to the above.

VTSI MAT: a management table of video title set information, which describes what information exists in the video title set, and describes a start address and an end address of each information.

VTS PTT SRPT: Video title set Part of title search pointer table, in which title entry points and the like are described.

VTSM PGCI UT: a video title set menu program chain information unit table in which a chain for reproducing a video title set menu described in various languages is described. Therefore, it is possible to confirm from the menu what kind of video title set is described, and what kind of style of playback order is described.

VTS TMAPT: Video title set time map table, in which information on the recording position of the VOBU managed in the program chain is described.

VTSM C ADT: video title set menu cell This is an address table in which the start and end addresses of the cells constituting the video title set menu are described.

VTSM VOBU ADMAP: video title set menu video object unit address map, in which VTS describes the start address of the video object unit for menu C ADT: video title set cell address table in which the start and end addresses of the cells constituting the video title set body are described.

VTS VOBU ADMAP: Video title set video object unit address map, in which the start address of the video object unit of the title body is described.

In the reproducing apparatus, when a program chain is selected, the reproduction order of the cells is set by the program chain. For playback, the NV included in the video object unit is used. PCK is referenced. NV The PCK has information for controlling display contents and display timing, and information for data search. Therefore, this NV V based on the information in the PCK table The PCK is taken out and decoded.
Also, other packs are taken out and decoded,
In that case, A of the language specified by the user
PCK, SP The removal of the PCK is performed.

FIG. 14 shows a configuration example of one pack and a packet.

One pack is composed of a pack header and a packet. A pack start code, a system clock reference (SCR), and the like are described in the pack header. The pack start code is a code indicating the start of a pack, and includes a system clock reference (S
CR) is information indicating the location time in the reproduction elapsed time for the entire apparatus. The length of one pack is 2048 bytes, and is defined and recorded as one logical block on the optical disk.

One packet is composed of a packet header and video data, audio data, sub-picture data, or navigation data. The packet header of the packet may be provided with stuffing. Padding may be provided in the data portion of the packet.

FIG. 15 shows that the NV The PCK is extracted and shown.

NV PCK basically controls display images.
Picture control information to control
(PCI) packet and the same video object
Data Search Information (DSI)
With packets. Each packet has a packet header and
Stream ID, followed by the data
Is described. Each packet header has a stream I
D is described and NV Indicates that this is a PCK,
The Ream ID identifies PCI and DSI.
You. Each packet header contains a packet start code.
, Stream ID, and packet length are described.
Data is described.

The PCI packet is navigation data for changing the display content in synchronization with the reproduction of the video data in the video object unit (VOBU) to which the packet belongs.

The PCI packet contains the general information PC
I General Information (PCI GI),
Non-seamless angle information (NSML
ANGLI) and highlight information (HL)
I) and recording information that is recorded information
(RECI) is described.

FIG. 16 shows reproduction control general information (PCI G
I) is shown.

PCI The GI has a general description of this PCI.
It is information and the following information is described. This na
Logical block number that is the address of the navigation pack
Bar (NV PCK LBN), managed by this PCI
Indicates the attributes of the video object unit (VOBU)
Video object unit category (VOBU_
CAT), a video object managed by this PCI
Information such as user operation prohibition information during the unit display period
User operation control (VOBU) U
OP CTL), display of video object units
Indicates start time (VOBU S PTM), Video of
Indicates the end time of the display of the project unit (VOBU
E PTM). VOBU S Finger by PTM
The first video specified is the I-picture in the MPEG standard.
Char. Furthermore, the video object unit
Video object indicating the duration of the last video in the video
Unit Sequence End Presenter
Im (VOBU SE E PTM) or the first in a cell
Cell display indicating elapsed display time relative to video frame
Lapse time (C ElTM) and the like are also described.

The NSM described in the PCI
L ANGLI indicates the address of the destination (destination) at the time of an angle change. That is, the video object also has images captured from different angles. Then, when the user specifies to display an image at an angle different from the currently displayed angle, the address of the VOBU to be shifted to the next reproduction is described.

The HLI is information for designating a specific area in a screen in a rectangular shape, and changing the luminance of this area, the color of a sub-picture displayed here, and the like. This information includes the Highlights General Information (H
L GI), a button color information table (BTN) for allowing the user to make a button selection for color selection. COLIT) and a button information table (BTNIT) for select buttons
Is described.

RECI is video, audio, and sub-picture information recorded in the video object unit, and describes what data is to be decoded. For example, there are a country code, a copyright holder code, a recording date, and the like.

The DSI packet is navigation data for executing a search for a video object unit.

The DSI packet contains DS which is general information.
I General Information (DSI GI)
And seamless playback information (S
ML PBI), seamless angle information
(SML AGLI), video object unit
Information (VOBU) SRI), synchronization information
Information (SYNCI).

As shown in FIG. The GI describes the following information.

NV Indicates the PCK decoding start reference time
NV which is the system clock reference PCK
SCR, NV Indicates the PCK logical address (NV P
CK LBN), this NV Video object to which PCK belongs
Indicates the end address of the project unit (VOBU E
A) is described. Furthermore, decode first
Of the first reference picture (I-picture) for
Address (VOBU 1STREF EA) First deco
Second reference picture (P picture) for loading
End address (VOBU) 2NDREF EA)
A third reference picture (P picture) for decoding first
Char) end address (VOBU) 3RDREF E
A) is described. Furthermore, this DSI belongs to
ID number of the VOB (VOBU VOB IDN)
ID number (VOBU) of the cell to which this DSI belongs C
IDN), relative to the first video frame in the cell
Cell Elapse Time (C ELTM)
Is also described.

As shown in FIG. The following information is described in the PBI.

The VOBU to which this DSI belongs is
Unit (ILVU) or video
Pre-unit (PR
EU) video object unit sea
Muress category (VOBU SML CAT), Inter
Indicates the ending address of the moved unit (ILVU
EA), start address of next interleaved unit
(ILVU SA), the next interleaved unit
(ILVU) SZ), Video object
(VOB) indicates the video display start time (VOB).
OB V S PTM), Video Object (VOB)
Indicates the video display end time in the (VOB) V E
PTM), audio in video object (VOB)
Indicates the video stop time (VOB A STP PT
M), audio in video objects (VOB)
Indicates the gap length (VOB A GAP LEN) etc.
is there.

As shown in FIG. 19, seamless angle information (SML AGLI) describes the following information.

The address and size (SML) of the next interleave unit to be shifted at each angle
AGL Cn DSTA) (n = 1 to 9). This information is referenced when the angle changes.

As shown in FIG. 20, VOBU search information (VOBU) The following information is described as (SRI).

This information describes the start address of the VOBU that is (0.5 × n) seconds before and after the start time of the current video object unit (VOBU). That is, the start addresses of VOBUs from +1 to +20, +60, +120 and +240 as forward addresses (FWDINn) and the flag indicating that a video pack exists in the unit are described as forward addresses (FWDINn) based on the VOBU including the DSI. Have been.
The start address is described by the number of logical sectors relative to the first logical sector of the VOBU. By using this information, the VOBU to be reproduced can be freely selected.

As shown in FIG. 21, synchronization information (SYNC)
Describes the addresses of sub-pictures and audio data to be reproduced in synchronization with the reproduction start time of the VOBU video data including the DSI. Address is NV containing DSI The start position of the target pack is indicated by the number of logical sectors relative to the PCK.
When there are a plurality of audio streams (up to eight), the synchronization information is described by the number. When there are a plurality of sub-pictures (up to 32), synchronization information is described by the number of sub-pictures.

The above description has been made for video, audio, NV
This is an explanation of the pack structure of data, sub-pictures, and the like.

Here, the respective aggregates of each pack will be described.

FIG. 22 shows the relationship between a video object unit (VOBU) and video packs in this unit. Video data in a VOBU is composed of one or more GOPs. The encoded video data conforms to, for example, ISO / IEC13818-2. A VOBU GOP is composed of an I picture and a B picture, and this data sequence is divided into a video pack.

FIG. 23 shows the relationship between audio streams and audio packs. Audio streams include linear PCM, Dolby AC-3, MP
There is data such as EG.

FIG. 24 illustrates the logical structure of a pack of encoded (run-length compressed) sub-pictures.

As shown in the upper part of FIG. 24, one pack (SP) of sub-pictures (sub-pictures) included in video data
PCK) is composed of, for example, 2048 bytes (2 kB). One pack of a sub-picture includes a packet header and sub-picture data after a head pack header. The pack header contains a reference time (SCR; System Clock) through reproduction of the entire file.
Reference) information, which has a predetermined relationship with the time of the system timer, and has an SCR of the same time information.
Each sub-picture packet to which is added is compiled and transferred to a decoder described later.

The first sub-picture packet includes run-length compressed sub-picture data together with a sub-picture unit header (SPUH) described later, after the packet header. Similarly, the second sub-picture packet includes run-length compressed sub-picture data after the packet header.

A sub-picture data unit 310 is obtained by collecting such a plurality of sub-picture data for one unit (one unit) of run-length compression. The sub-picture data unit 310 is provided with a sub-picture unit header 311. After the sub-picture unit header 311, pixel data 312 obtained by performing run-length compression of video data of one unit (for example, data of one horizontal line of a two-dimensional display screen) and display control sequence information of each sub-picture pack are included. A table 313 is included.

That is, the sub-picture data unit 31
0 is a sub-picture unit header (SPUH) 3 in which various parameters for displaying a sub-picture are recorded.
11, display data (compressed pixel data; PXD) 312 composed of run-length codes, and a display control sequence table (DCSQT) 313.

FIG. 25 illustrates a part of the contents of the sub-picture unit header 311 in the run-length compressed data 310 for one unit illustrated in FIG.

The sub-picture unit header (SPU
H) 311 includes a display size of the pixel data (PXD) 312 on the TV screen, that is, a display start position and a display range (width and height) (SPDSZ; 2 bytes), and a display control sequence in the sub-picture data packet. The recording start address (SP DCSQT SA;
2 bytes).

More specifically, as shown in FIG. 25, parameters having the following contents are recorded in the sub-picture unit header (SPUH) 311.

(1) Information (SPDSZ) indicating the display start position and display range (width and height) of this display data on the monitor screen; (2) Recording start position information of the display control sequence table 33 in the packet (Sub picture display control sequence table start address SP DCSQT SA).

FIG. 26 shows the data structure of the sub-picture unit again.

The sub-picture unit is composed of a plurality of sub-picture packets. That is, one pack of the sub-picture information included in the video data is composed of, for example, 2048 bytes (2 kB), and one pack of the sub-picture information includes, after the first pack header,
It contains one or more sub-picture packets. The pack header is provided with time (SCR; System Clock Reference) information serving as a reference throughout the reproduction of the entire file, and a packet in the sub-picture pack to which the SCR of the same time information is added is sent to a decoder described later. It is to be transferred.

In the packet header of the above-mentioned packet,
The time at which the playback system should start controlling the display of the sub-picture data unit is recorded as a presentation time stamp (PTS). However, as shown in FIG. 27, this PTS is recorded in correspondence with only the header of the first sub-picture data packet in each sub-picture data unit (Y, W). In the PTS, in a plurality of sub-picture data units reproduced with reference to a predetermined reproduction time SCR, values along the reproduction order are described for each sub-picture data unit.

FIG. 28 shows a serial arrangement state (n, n + 1) of sub-picture units composed of one or more sub-picture packets, and a presentation time stamp (PTS) described in a packet header of one of the units (n + 1). ) And the progress of the display control of the unit (n + 1) corresponding to this (PTS). That is, the relationship between the processing time of the PTS, the display clear period of the sub-picture unit (n), and the display start time of the sub-picture unit (n + 1) to be displayed from now on is shown.

As shown in FIG. 29, the sub-picture unit header (SPUH) 311 contains the size of the sub-picture unit (2-byte SPUH). SZ) and the recording start address (2-byte SP) of the display control sequence table 33 in the packet. DCSQT SA) are recorded.

SPU The SZ describes the size of one unit by the number of bytes, and the maximum size is 53248 bytes. SP DCSQT SA is a display control sequence table (SP) based on the relative number of bytes from the first byte of the unit. DCSQT) is described.

As shown in FIG. 30, the display control sequence
Table (SP DCSQT) 313 includes one or more
Sub-picture display sequence (SP DCSQ0, S
P DCSQ1, ... SP DCSQn) are described in the order of execution.
Have been. Display control sequence table (SP DCS
QT) 313 is during the valid period of the sub-picture unit
To start / stop the display of sub-pictures and change the attributes
Display sequence information to be displayed.

FIG. 31 shows the sub-picture display control sequence (SP DCSQ). This SP The following contents are described as parameters of DCSQ.

The sub picture display control start time (SP) indicating the time when the execution of the video data display control is started
DCSQ STM; Sub-Picture Display Control S
equence Start Time) and the next sub-picture display control sequence (SP Address (SP) representing the destination of description of DCSQ NXT DCSQ SA; Addres of Next
SP DCSQ) and a sub-picture data display control command (SP COMMAND; Sub-Picture Display Cont
rol Command) (SP COMMAND1, SP CO
MMAND2, SP COMMAND3,...) Are recorded.

Here, the packet header (FIGS. 26 and 27)
Presentation timestamp PT
S is, for example, the playback start time at the beginning of the file.
Reference time (SCR;
It is specified by relative time from System Clock Reference. As described above, the SCR is described in the pack header provided before the packet header.

Further, the sub-picture display control time (SP) which sets the display control sequence execution start time is set. D
CSQ (STM) is defined by a relative time (relative PTM) from the PTS described in the packet header.

Therefore, (SP DCSQ STM)
And the count value of the sub-timer are compared. If the count value of the sub-timer is greater than the display control sequence time, the display state of the output data decoded by the decoding means is controlled according to the sequence control data.

Actually, (SP DCSQ With respect to a video frame displayed first after the execution start time described as (STM) is described, control for display is started for a sub-picture represented in the video frame. Display control sequence time (SP
DCSQ "0000h" is described in STM). The value of the execution start time is equal to or longer than the PTS described in the sub-picture packet header, and is 0 or a positive integer. Based on the display control start time, one (SP) When the command in the DCSQ is executed, the next designated (SP DCS
The execution process is started when the command in Q) reaches the display control start time.

SP NXT DCSQ SA is indicated by a relative number of bytes from the first sub-picture unit,
Next SP It shows the DCSQ address. Next SP
If there is no DCSQ, this SP DCSQ
Is the relative number of bytes from the first byte of the relevant sub-picture unit, and the first SP The start address of DCSQ is described. SP DCCMDn describes one or more display control sequences.

FIG. 32 shows a display control command (SP) for performing display control. DCCMD).

The display control command (SP DCCMD) includes an instruction (FSTA) for setting a compulsory display start timing of pixel data. DSP), an instruction to set the display start timing of the pixel data (STA) DSP),
Command to set the display end timing of pixel data (S
TP DSP), instruction to set color code of pixel data (SET COLOR), an instruction to set the contrast between the pixel data and the main image (SET CONT
R), an instruction to set a display area for pixel data (SE)
T DAREA), an instruction to set the display start address of the pixel data (SET DSPXA), an instruction (C) for setting a change control of color and contrast of pixel data
HG COLCON), a command to end the display control (C
MD END). The respective codes and extension fields are as follows as shown in the figure.

That is, a forced display start timing command (FSTA) The code of the DSP is 00h and the extension field is 0 bytes. When this instruction is described, the forced display of the sub-picture unit having this code is executed regardless of the display state of the sub-picture.

Display start timing instruction (STA) DS
The code of P) is 00h, and the extension field is 0 bytes. This command is a display start command for the sub-picture unit. This command is ignored when the display of the sub-picture is turned off.

Display stop timing command (STP DS
The code of P) is 02h, and the extension field is 0 bytes. This command is a sub-picture unit display stop command. The sub-picture can be redisplayed by the previous display start command.

A color code setting instruction (SET COLO
The code of R) is 03h, and the extension field is 2 bytes. This command is a command for determining the color of each pixel of the pixel data, and is described in the extension field by a pallet code. The second pallet code for each pixel
Each palette code is described for an enhancement pixel (4 bits), a first enhancement pixel (4 bits), a pattern pixel (4 bits), and a background pixel (4 bits).

Here, this instruction (SET COLOR)
Is not present in the sub-picture unit,
The last used one before that is maintained and this instruction is used. This instruction is specified at the beginning of each line.

The contrast setting command (SET CONT
The code of R) is 04h, and the extension field is 2 bytes. This command is a command for setting a mixing ratio between the pixel data and the main image, and is described in the extension field by contrast designation data. The contrast designation data of the pixel includes a second emphasized pixel (4 bits), a first emphasized pixel (4 bits), a pattern pixel (4 bits),
Since there is a background pixel (4 bits), contrast designation data k for each pixel is described.

The contrast of the main image is (16-k) / 1
6, the contrast of the sub-picture is k / 16. 16 is a gradation. The value may be "0", in which case the sub-picture does not appear on the screen even though it exists. If the value is not “0”, k is treated as (value + 1).

Here, this instruction (SET CONTR)
Is not present in the sub-picture unit,
The last used one before that is maintained and this instruction is used. This instruction is specified at the beginning of each line.

Display area setting command (SET DARE
The code of A) is 05h, and the extension field is 6 bytes. This command is a command for setting a display area of square pixel data on the screen. In this instruction:
The start position (10 bits) and end position (10 bits) of the X-axis coordinates on the screen, and the start position (10 bits) and end position (10 bits) of the Y-axis coordinates are described. The remaining bits of the 6 bytes and the reservation are reserved. The value at the start position of the X-axis coordinate is subtracted from the value at the end position of the X-axis coordinate, and +1
Should be the same as the number of display pixels on one line. The origin of the Y-axis coordinate is line number 0. The origin of the X-axis coordinate is also 0. On the screen, it corresponds to the upper left corner. The Y-axis coordinate value is 2 to 479 (525 lines / 60 Hz
TV) or 2-574 (625 lines / 50H
z in the case of TV), whereby a sub-picture line is specified, and the X-axis coordinate value describes a value of 0 to 719, thereby specifying a pixel number.

Here, this instruction (SET DAREA)
Is not present in the sub-picture unit,
The instruction included in the last sub-picture unit sent earlier is used as it is.

Display start address setting instruction (SET DS
PXA) is 06h, and the extension field is 4 bytes. This command is a command indicating the first address of the image data to be displayed. The first addresses of the odd field (16 bits) and the even field (16 bits) are described by the relative number of bytes from the head of the sub-picture unit. The first of the position indicated by this address
Pixel data indicates a run-length compression code including the first pixel at the left end of the line.

Here, this instruction (SET DSPXA)
Is not present in the sub-picture unit,
The instruction included in the last sub-picture unit sent earlier is used as it is.

Color and contrast change control command (C
HG The code of (COLON) is 07h, and the extension field is (pixel control data size + 2 bytes).
(CMD The code of END) is FFh, and the extension byte is 0 byte.

FIG. 33 shows the above (CHG COLON)
Pixel control data (PXC) described in the extension field of
D; Pixel Control Data).

The PXCD is data for controlling the color and contrast of the pixel displayed as a sub-picture during the display period. The instruction described in the PXCD is a sub picture display control start time (SP DCSQ
It is performed for each video frame from the first video frame after the STM is described, and is performed until the next new PXCD is set. The old PXCD is canceled when the new PXCD is updated.

The line control information (LN) shown in FIG. CT
LI (Line Control Information) designates a line on which sub picture change control is performed. A plurality of lines on which the same conversion control is performed can be designated. The pixel control information (PX CTLI; Pixcel Control I
nformation) describes the designated position on the line where the change control is performed. One or more pixel control information (PX CT
LI) can designate a plurality of positions on a line where conversion control is performed.

As the end code of the pixel control data (PXCD), (0FFFFFFFh) is LN CTLI is described. P such that only this end code exists
When XCD arrives, (CHG COLON) means the end of the instruction itself.

Referring to FIG. 34, each of the above instructions will be further described.

LN The CTLI is composed of 4 bytes. The line number (10 bits) at which the change of the sub-picture starts, the number of changes (4 bits), and the end line number (1)
0 bit). The change start line number is the line number at which the change of the pixel control content starts, and is described by the line number of the sub-picture. The end line number is a line number at which the control state based on the pixel control content is stopped, and is also described by the line number of the sub-picture. The number of changes is
This is the number of change positions, and the pixel control information (PX
CTLI) number. The line numbers at this time are naturally 2 to 479 (when the television system is 525 lines / 60 Hz) or 2 to 574 (when the television system is 625 lines / 50 Hz).

Next, one pixel control information (PX CTL
I) is composed of 6 bytes and describes a change start pixel number (10 bits) and control information for changing the color and contrast of each pixel following the pixel.

A palette code for a pixel is for a second emphasized pixel (4 bits), for a first emphasized pixel (4 bits),
For pattern pixels (4 bits), for background pixels (4 bits)
Each pallet code is described. Also, the contrast designation data for the second emphasized pixel (4 bits), the first emphasized pixel (4 bits), the pattern pixel (4 bits), and the background pixel (4 bits) are described as the contrast designation data for the pixel. Have been.

The above change start pixel numbers are described by the pixel numbers in the display order. When this is zero, SET CO
LOR and SET CONTR is ignored. A color pallet code is described as the color control information, and the contrast designation data is described as the contrast control information as described above.

When no change is requested in each of the above control information, the same code as the initial value is described.
The initial value is a color code and contrast control data specified from the beginning to be used for the sub-picture unit.

Next, a method of compressing a sub-picture will be described.

FIG. 35 shows run-length compression rules 1 to 6 when pixel data (run-length data) of a sub-picture is created. According to this rule, the data length (variable length) of one unit of the unit is determined. Then, encoding (run-length compression) and decoding (run-length decompression) are performed with the determined data length.

FIG. 36 shows run-length compression rule 1 used in the encoding method according to one embodiment when the preceding sub-picture pixel data (run-length data) 312 is composed of 2-bit pixel data. ~ 6
It is to explain.

According to rule 1 shown in the first column of FIG. 33, when one to three identical pixels continue, one unit of encoded (run-length compressed) data is constituted by 4-bit data. In this case, the first two bits represent the number of continuous pixels, and the following two bits represent pixel data (such as pixel color information).

For example, the first compressed data unit CU01 of the video data PXD before compression shown in the upper part of FIG.
Are two 2-bit pixel data d0, d1 = (000
0) b (b is binary). In this example, the same 2-bit pixel data (00)
b is continuous (continuous).

In this case, as shown in the lower part of FIG. 36, d0, d1 = (1000) b obtained by connecting the 2-bit display (10) b of the continuation number "2" and the content (00) b of the pixel data.
Is the data unit CU01 * of the compressed video data PXD.
Becomes

In other words, according to rule 1, the data unit C
(0000) b of U01 is (1) of data unit CU01 *.
000) b. In this example, no substantial bit length compression is obtained, but for example, the same pixel (00)
If b is three consecutive CU01 = (000000) b, CU01 * = (1100) b after compression, and 2
A bit compression effect is obtained.

According to rule 2 shown in the second column of FIG. 35, when 4 to 15 identical pixels continue, one unit of encoded data is constituted by 8-bit data. In this case, the first two bits are represented by an encoding header indicating that it is based on rule 2, the subsequent four bits represent the number of continuous pixels, and the subsequent two bits represent pixel data.

For example, the second compressed data unit CU02 of the video data PXD before compression shown in the upper part of FIG.
Are five 2-bit pixel data d2, d3, d4, d
5, d6 = (0101010101) b.
In this example, the same 2-bit pixel data (01) b is 5
It is continuous (continuous).

In this case, as shown in the lower part of FIG. 36, the encoded header (00) b, the 4-bit display (0101) b of the continuation number "5", and the content (01) b of the pixel data are connected. d2 to d6 = (00010101) b are the data units CU02 * of the compressed video data PXD.

In other words, according to rule 2, the data unit C
(0101010101) b of U02 (10-bit length)
Is (00010101) b (8) of the data unit CU02 *.
(Bit length). In this example, the effective bit length compression amount is only 2 bits from 10 bits to 8 bits. However, when the number of continuations is, for example, 15 (a 30-bit length in which 15 01s of CU02 are continuous), this is 8 bits. It becomes compressed data (CU02 * = 00111101),
A 22-bit compression effect is obtained for the bits. That is, the bit compression effect based on Rule 2 is greater than that of Rule 1. However, rule 1 is also required to support run-length compression of a fine image with high resolution.

According to rule 3 shown in the third column of FIG. 35, when 16 to 63 identical pixels continue, one unit of encoded data is constituted by 12-bit data. In this case, the first 4 bits represent an encoded header indicating that the rule is based on rule 3,
The next 6 bits indicate the number of continuous pixels, and the subsequent 2 bits indicate pixel data.

For example, the third compressed data unit CU03 of the video data PXD before compression shown in the upper part of FIG.
Are 16 2-bit pixel data d7 to d22 = (10
1010... 1010) b. In this example, 16 pieces of the same 2-bit pixel data (10) b are continuous (continuous).

In this case, as shown in the lower part of FIG. 36, the encoded header (0000) b, the 6-bit display (010000) b of the continuation number “16”, and the content of the pixel data (10)
b and d7 to d22 = (0000000100001)
0) b is the data unit CU of the compressed video data PXD
03 *.

In other words, according to rule 3, data unit C
(101010... 1010) b (32-bit length) of U03 is (000000001000) of the data unit CU03 *.
010) b (12-bit length). In this example, the substantial bit length compression amount is 20 bits from 32 bits to 12 bits, but the continuation number is, for example, 63 (CU0
In the case of 63 consecutive 10s of 3 and a length of 126 bits, this is 12-bit compressed data (CU03 * = 00).
0011111110), and a compression effect of 114 bits can be obtained for 126 bits. That is, the bit compression effect based on Rule 3 is greater than that of Rule 2.

According to rule 4 shown in the fourth column of FIG. 35, when 64 to 255 identical pixels continue, one unit of encoded data is constituted by 16-bit data. In this case, the first 6
A bit indicates an encoding header indicating that the rule is based on rule 4, the subsequent 8 bits indicate the number of continuous pixels, and the subsequent 2 bits indicate pixel data.

For example, the fourth compressed data unit CU04 of the video data PXD before compression shown in the upper part of FIG.
Are 69 2-bit pixel data d23 to d91 = (1
11111... 1111) b. In this example, 69 pieces of the same 2-bit pixel data (11) b are continuous (continuous).

In this case, as shown in the lower part of FIG. 35, the encoded header (000000) b and the continuation number “69” of 8
D23 to d91 that connect the bit display (00100101) b and the content (11) b of the pixel data = (000000)
0010010111) b is the compressed video data PX
D data unit CU04 *.

In other words, according to rule 4, data unit C
(111111... 1111) b (138-bit length) of U04 is (00000000) of data unit CU04 *.
10010111) converted to b (16-bit length).
In this example, the substantial bit length compression amount is 122 bits from 138 bits to 16 bits, but the continuation number is, for example, 255 (because 11 of CU01 continue 255, 51
In the case of (0-bit length), this becomes 16-bit compressed data (CU04 * = 000001111111111), and a 494-bit compression effect is obtained for 510 bits. That is, the bit compression effect based on Rule 4 is
Larger than that of Rule 3.

According to rule 5 shown in the fifth column of FIG. 35, when the same pixel continues from the switching point of the encoded data unit to the end of the line, one unit of the encoded data is constituted by 16-bit data. In this case, the first 14 bits represent an encoded header indicating that the data is based on rule 5, and the following 2 bits represent pixel data.

For example, the fifth compressed data unit CU05 of the video data PXD before compression shown in the upper part of FIG.
Is one or more 2-bit pixel data d92 to dn = (0
00000... 0000) b. In this example, the same two-bit pixel data (00) b is continuous (continuous) in a finite number. However, in rule 5, the number of continuous pixels may be one or more.

In this case, as shown in the lower part of FIG. 36, d92 to dn = connecting the encoded header (00000000000000) b and the contents (00) b of the pixel data
(000000000000000000) b is the data unit CU05 * of the compressed video data PXD.

In other words, according to rule 5, the data unit C
(00000000 ... 0000) b (unspecified bit length) of U05 is (00000000) of data unit CU05 *.
00000000) b (16 bits long).
In rule 5, the same pixel continuation number up to the line end is 16
With a bit length or more, a compression effect can be obtained.

According to rule 6 shown in the sixth column of FIG. 35, when one pixel line in which data to be encoded is arranged ends, the length of one line of compressed data PXD is not an integral multiple of 8 bits (ie, When the data is not byte-aligned, 4-bit dummy data is added so that the compressed data PXD for one line is in units of bytes (that is, byte-aligned).

For example, data units CU01 * to CU05 of compressed video data PXD shown in the lower part of FIG.
The total bit length of * is always an integral multiple of 4 bits, but is not necessarily an integral multiple of 8 bits.

For example, data units CU01 * to CU05
If the total bit length of * is 1020 bits and 4 bits are insufficient for byte alignment, as shown at the bottom of FIG. 35, 4-bit dummy data CU06 * =
(0000) b is added to the end of the 1,020 bits to generate a byte-aligned 1024-bit data unit CU0.
1 * to CU06 * are output.

Note that the last 2-bit pixel data of one unit does not necessarily indicate four types of pixel colors. Pixel data (00) b means a background pixel of the sub-picture, pixel data (01) b means a pattern pixel of the sub-picture, pixel data (10) b means a first emphasized pixel of the sub-picture, Pixel data (1
1) b may mean the second emphasized pixel of the sub-picture.

In this way, depending on the contents of the 2-bit pixel data, the run-length data can be selected from background pixels, sub-picture pattern pixels, sub-picture first emphasized pixels, and sub-picture second emphasized pixels. Can be determined.

If the number of constituent bits of the pixel data is larger, another type of sub-picture pixel can be specified. For example, pixel data is 3-bit (000) b to (11)
1) When composed of b, up to eight types of pixel colors + pixel types (enhancement effect) can be specified in sub-picture data to be run-length encoded / decoded. Next, a reproducing apparatus for reading and processing the recorded information on the optical disk will be described.

In FIG. 37, an optical disk (DV
D) 100 is placed on a turntable (not shown), clamped by a clamper, and driven to rotate by a motor 101. Now, assuming that the playback mode is set, information recorded on the optical disc 100 is transferred to the pickup unit 1.
02 is picked up. Pickup unit 102
Are controlled by the servo unit 103 for movement control, focus control, and tracking control in the radial direction of the disk. The servo unit 103 also sends a control signal to the disk motor drive unit 104 to control the rotation of the motor 101 (that is, the optical disk 100).

The output of pickup section 102 is input to demodulation / error correction section 105 and demodulated. The demodulated data demodulated here is input to the demultiplexer 107 via the buffer 106. The demodulated data is input to the DSU decoder 109 via the input buffer 108. The buffer 110 is connected to the DSI decoder 109. The decoded DSI (data search information) is sent to the system control unit 200. The demodulated data is sent to the system control unit 200 via the system buffer 111. The data taken into the system control unit 200 through the system buffer 111 includes, for example, management information.

In the demultiplexer 107, separation processing of each pack is performed.

The video pack (V) extracted from the demultiplexer 107 PCK) is input to the video decoder 123 via the buffer 121 and is decoded. The buffer 124 is connected to the video decoder 123. The video signal output from the video decoder 123 is input to the synthesizer 125.

Also, it is taken out from the demultiplexer 107.
Sub-picture pack (SP PCK) is a buffer
126 to the sub-picture decoder 127
And decoded. To the sub-picture decoder 127
Is connected to a buffer 128. Sub-picture
The sub-picture output from the coder 127 is
125. This allows the synthesizer 125 to
Sub-picture is superimposed on video signal
A signal is obtained and provided to the display.

The audio pack (A) extracted from the demultiplexer 107 PCK) is buffer 12
9 and is input to the audio decoder 130 and decoded. The audio decoder 130 has a buffer 1
31 are connected. The output of the audio decoder 130 is supplied to a speaker.

The PCI pack extracted from the demultiplexer 107 is input to the PCI decoder 133 via the buffer 132 and is decoded. The buffer 134 is connected to the PCI decoder 133. PC
The output of the I decoder 133 is the highlight information (HLI)
It is input to the processing unit 135.

The demultiplexer 107 separates and derives main video information, sub-picture (caption and text) information, audio information, control information, and the like. In other words, this is because sub-picture (caption and character) information, audio information, management information, control information, and the like are recorded on the optical disc 100 in correspondence with video information.

In this case, various languages can be selected as subtitle information and subtitle information, and audio information, which are selected under the control of the system control unit 200. For the system control unit 200,
An operation input by a user is provided through the operation unit 201.

Therefore, the video decoder 123 for decoding the main video information performs a decoding process corresponding to the type of the display device. For example, the main video information is NTSC, PA
L, SECAM, wide screen, etc. are converted. The audio information of the stream specified by the user is input to the audio decoder 130 and decoded. As for the sub-picture, the sub-picture data of the stream designated by the user is input to the sub-picture decoder 127 and decoded.

Next, the normal reproducing operation of the above-mentioned reproducing apparatus will be described.

FIG. 36 is a flowchart when the reproducing operation is started. When the power is turned on, the system control unit 200 starts up a ROM program provided in advance, drives the disk motor 104, and
Data reading is started (step S1). First I
The data of the volume and the file structure part is read in accordance with SO-9660 or the like. The read data is temporarily stored in the memory of the system control unit 200.
Accordingly, the system control unit 200 grasps the type of data on the optical disc, the recording position, and the like.

The system control unit 200 controls the pickup unit 102 and the like to control the video manager (V
MG) and its manager information (VM
GI). The VMGI includes a video manager management table (VMGI Since various kinds of management information relating to recording signals such as MAT) are recorded, it is possible to display what information is recorded on the disc in a menu format based on the management information (step). S2, S3). Then, it waits for a designation from the user (step S4). This designation is, for example, a designation of a video title set.

When a designation is made by an operation input from the user, reproduction of the designated video title set is started (step S5). If there is no designation from the user even after the lapse of the predetermined time, a predetermined video title set is reproduced (step S6). When the reproduction is completed, the process proceeds to an end step (steps S7 and S7).
8).

FIG. 39 is a flowchart further showing the operation when a video title set is designated.

When a video title set is designated, control data (video title set information VTSI) of the title set is read (step S11). As described above, this includes information on the program chain (PGC) and a menu for selecting the program chain. Therefore, the system control unit 200 can recognize the control information of the video title set (step S12). The user looks at the menu screen and selects a program chain (step S13). In this case, the program chain may be automatically determined without the menu screen. When the program chain is determined by the selection, the reproduction order of the cells is determined according to the selected program chain, and the reproduction is executed (step S14). When the program chain is automatically determined, or when the selection information of the program chain is not input within a predetermined time, the reproduction is performed in a predetermined cell reproduction order (step S15).

Next, the operation when the fast forward reproduction (fast forward FF) mode is set will be described.

Normally, one GOP is reproduced in about 0.5 seconds. To achieve the 10 × speed, video data at positions separated by 10 GOPs can be realized by successively reproducing for 0.5 seconds. For this purpose, it is necessary to know the address of the video object located away from the currently reproduced video object unit.

Therefore, for this purpose, VOBU search information (VOBU) SRI) is utilized. That is, the current V
From the PCI packet included in the OBU, the start address of the VOBU to be reproduced next is read and jumped to that address. By repeating these operations, fast-forward playback is realized. By this processing, when there is a transition from a cell to another cell, the management status of the program chain is also updated.

FIG. 40 shows a sub-picture decoding section.

In FIG. 40, the sub picture pack
(SP PCK) is stored in the memory 21 via the buffer 126.
3 is taken. The pack identification is described in the packet header.
This is performed by the described stream ID. Designated strike
The stream ID (sub-stream ID) responds to user operation.
Sub-picture decoder via system controller
Input to the control unit 211 and stored in a register
I have.

[0209] Of the packets fetched into the buffer 126, the designated stream ID and the input substream I
The packet where D matches is targeted for capture. Then, the count value of the reference time of the main system timer 54 is supplied to the sub-picture decoder control unit 211 and compared with the system clock reference (SCR) of the packet captured in the buffer 126. The count value of the main system timer 54 is compared with the value of the SCR, and a packet having the same SCR is stored in the memory 213 for unit construction. By the above processing, the memory 213
Stores one or more sub-picture units (see FIG. 24). Memory 213
When the sub-picture unit is constructed, the decoding process based on the PTS is managed.

[0210] The sub-picture unit header (SPUH) included in the sub-picture unit is referred to by the sub-picture decoder control unit 211, and the size and address are recognized. As a result, the run-length-compressed data (PXD) is sent to the run-length decoder 214, and the display control sequence table (SP DCSQ
T) is sent to the sequence control unit 216.

Here, the presentation time stamp (PTS) is compared with the count value of the main system timer 54. If the count value of the main system timer 54 is larger than the presentation time stamp (PTS), the run time of the data unit is determined. Length decoding and output processing are performed. The decoded output data is stored in the buffer 2 under the control of the sequence control unit 216.
15. Output via the output control unit 218 and displayed.

That is, the run length data (PXD)
Are decoded by the run-length decoder 214. This decoding process is performed according to the rules described above. The decoded pixel data is stored in the buffer memory 2
15 and waits for the output timing.

On the other hand, included in the sub-picture unit
Display control sequence table (SP SCQT)
It is input to the cans control unit 216 and analyzed. Sequence
The control unit 216 includes a plurality of control units for holding various control commands.
Register 217. In the sequence control unit 216
Is the pixel to be output next according to the register command
What color and / or contrast are set for
Decide what to force. This determination signal is output to the output control unit 21.
8 given. The sequence control unit 216 also
Of pixel data stored in memory 215
Also, a timing signal and an address are given.

In the output control unit 218, the buffer memory 2
15 for the pixel data from
The color code and / or the contrast data are added in accordance with the command from No. 6 and output. This output sub-picture is superimposed on the main video.

As described above, regarding the display of a sub-picture, the presentation time stamp (PTS) included in the sub-picture unit and the system timer 5
A timing signal is obtained from the comparator 53 when the output of the comparator 4 has a predetermined relationship. The decode processing of the run-length data is started based on this timing signal.

The display control of the sub-picture is executed or a standby state is realized according to the timing signal from the comparator 63. Sub time stamp extraction unit 64
Is the SP stored in the sequence control unit 216. D
This is a register for holding CSQ start time data. The comparator 63 stores the output data from the subsystem timer 61 and each SP. DCSQ start time data is compared one after another,
When they match, a timing signal is output. The subsystem timer 61 is cleared, for example, for each line.

In the case where display control is performed, the use of the above-described commands will be further described.

In display control, the command SET D
AREA sets the display position and display area of the sub-picture, and the command SET The display color of the sub-picture is set by COLOR, and the command SET CO
The contrast of the sub-picture with respect to the main video is basically set by the NTR. These are basic commands.

Then, the display start timing command STA
After executing the DSP, another display control sequence DCSQ
To end display instruction STP Until the DSP is executed, the color and contrast switching command CHG is displayed during the display. While performing display control based on COLCON,
The decoding of the run-length compressed pixel data PXD is performed.

The sequence control unit 216 receives the command SE
T The display position and display area of the sub-picture are set by DAREA, and the command SET The display color of the sub-picture is set by COLOR, and the command SET C
The contrast of the sub-picture with respect to the main picture is basically set by the ONTR. Then, the display start timing instruction STA After executing the DSP, the display end timing instruction STP is executed in another display control sequence DCSQ. DS
Until P is executed, during display, the color and contrast switching command CHG Performs display control based on COLCON.

In the above description, the data length of the pixel data is stored in the memory 2112 in the encoding process for recording the run-length compressed data on the disc and the decoding process for displaying the run-length compressed data when reproduced from the disc. The information has been described as being recorded faithfully.

However, the present invention is not limited to this, and the information stored in the memory may be modified so that the character size is set to be different when displayed and recorded. This setting is easy. Since the run-length compressed data is compressed according to the run-length compression rule, pixel data can be obtained by decoding the compressed data. Here, in the pixel data, since the number of pixels in the horizontal direction is limited to a predetermined number, interpolation data is inserted between the pixel data in order to double the width, for example.
Therefore, the number of continuous pixels changes. That is, by changing the value of the number of continuous pixels of the run-length compressed data created based on the compression rule, the size of the character at the time of decoding can be enlarged or reduced. or,
In order to change the size of a character in the vertical direction, it is possible to double the size in the vertical direction by decoding twice using the sub-picture data unit of the same line in the next line. In the case of reduction, the sub-picture data unit of each line is skipped, for example, one line at a time, and the resulting data is packed and recorded. This processing is performed by the sub-picture data recording processing unit 200.
1 is realized.

As for the compression rule, a description has been given of the general run-length compression of sub-picture data. However, if one pixel is 1 or 0 in the sub-picture data shown in FIG.
If the horizontal direction of one character is 10 dots, the maximum length of one line of one character is 10
Because of the number of bits, most characters are run-length compressed according to rule 1 or 2.

[0224]

As described above, according to the present invention,
A user can freely insert sub-picture data into a predetermined area.

[Brief description of the drawings]

FIG. 1 is a diagram showing an embodiment of the present invention.

FIG. 2 is a diagram showing an example of a use state of the device according to the present invention.

FIG. 3 is a diagram showing a configuration example of a main part according to the apparatus of the present invention.

FIG. 4 is a view showing an example of data stored in a memory shown in FIG. 2;

FIG. 5 is a view showing an example of character display shown for explaining a data input operation of the device according to the present invention.

FIG. 6 is a diagram showing another example of data stored in a memory according to the present invention.

FIG. 7 is a diagram shown to explain the operation procedure of the device of the present invention.

FIG. 8 is an explanatory diagram of a volume space which is a logical format recorded on an optical disc.

FIG. 9 is an explanatory view showing the structure of a video manager (VMG) and a video title set (VTS) in the volume space.

FIG. 10 shows the video object set (VOBS)
Between a cell and a cell, and furthermore, a cell
FIG.

FIG. 11 is an explanatory diagram showing the relationship between video objects and cells.

FIG. 12 is an explanatory diagram showing an example in which the reproduction order of cells is controlled by a program chain (PGC).

FIG. 13 is an explanatory diagram of a video title set information (VTSI) in a video title set (VTS).

FIG. 14 is a diagram showing a configuration example of one pack and a packet.

FIG. 15 shows a navigation pack (NV). FIG.

FIG. 16 is an explanatory diagram of general information of picture control information (PCI).

FIG. 17 is an explanatory diagram of general information of data search information (DCI).

FIG. 18 is an explanatory diagram of seamless reproduction information.

FIG. 19 is an explanatory diagram of seamless angle information.

FIG. 20 is an explanatory diagram of address information showing the inside of data search information in more detail;

FIG. 21 is an explanatory diagram of synchronization information.

FIG. 22 is an explanatory diagram of a video object unit.

FIG. 23 is an explanatory diagram of an audio stream.

FIG. 24 is an explanatory diagram of a sub-picture unit.

FIG. 25 is an explanatory diagram of a sub-picture unit.

FIG. 26 is an explanatory diagram of a sub-picture unit.

FIG. 27 is an explanatory diagram showing a continuous configuration of sub-picture units.

FIG. 28 is an explanatory diagram showing display timing of a sub-picture unit.

FIG. 29 is an explanatory diagram showing a header configuration of a sub-picture unit.

FIG. 30 is an explanatory diagram of a sub-picture display control sequence table.

FIG. 31 is an explanatory view of a sub-picture display control sequence table.

FIG. 32 is an explanatory diagram of a sub-picture display control command.

FIG. 33 is an explanatory diagram of a sub-picture display control command.

FIG. 34 is an explanatory diagram of the contents of a sub-picture display control command.

FIG. 35 is an explanatory diagram of a run-length compression rule.

FIG. 36 is an explanatory diagram showing an example of run-length compressed data.

FIG. 37 is an explanatory diagram of a configuration of a reproducing apparatus according to the present invention.

FIG. 38 is a flowchart showing a menu playback operation of the playback device.

FIG. 39 is a flowchart showing a title reproducing operation of the reproducing apparatus.

FIG. 40 is a diagram showing a configuration of a sub-picture decoder of the playback device.

[Explanation of symbols]

100: optical disk, 101: disk motor, 1
02: pickup unit, 103: servo unit, 104: disk motor drive unit, 105: demodulation / error correction unit, 2
00: system control unit, 201: operation unit, 1001: reproduction processing unit, 1002: display unit, 1003: audio output unit (speaker), 2001: sub-picture data recording processing unit, 2
002: Modulation / error correction code addition unit.

Claims (17)

[Claims] 1. Sub-picture data of a predetermined format for recording pixel data of a sub-picture, which is a sub-picture for superimposing on a main picture, by a predetermined compression method, and for recording on a recording medium In the case of constructing the sub-picture data unit, pixel data of a plurality of sub-pictures, which are minimum units, are prepared in advance in the form of the compressed data, and the compressed picture data is selected and / or combined to construct the sub-picture data unit. A video data input processing method characterized by the above. 2. The video data according to claim 1, wherein when the sub-video data unit is packed and recorded on the recording medium, the sub-video data unit is recorded in an area set in advance on the recording medium. Input processing method. 3. A video data input processing method according to claim 1, wherein said predetermined compression method is a run-length compression method. 4. The video data input processing method according to claim 3, wherein when preparing the pixel data of the sub-picture in the form of the compressed data in advance, the pixel data is stored in a memory. 5. When the compressed data corresponding to the pixel data of the minimum unit sub-picture is constructed as the sub-picture data unit, when the compressed data is decoded, the decoded pixel data of each sub-picture is placed on the same line. 5. A sub-picture data unit corresponding to one line by connecting compressed data to be formed.
Input method of the described video data. 6. When constructing a corresponding sub-picture data unit on said one line, when connecting compressed data of those which should be on the same line, this data amount is managed in said sub-picture data unit. Sub-picture data unit size (SPY_S) to be included as information
6. The video data input processing method according to claim 5, wherein a reference data amount for generating a start address (SP_DCSQT_SA) of a display control sequence table of the sub video data unit is set. 7. When the sub-picture data unit is constructed, it is required that at least commands for controlling display start and end timings, contrast, and a display area when displaying a sub-picture are included in advance. 9. The input data processing method according to claim 8, wherein: 8. The video data input processing method according to claim 7, wherein said command is variable within a limit. 9. Sub-picture data of a predetermined format for recording pixel data of a sub-picture serving as a sub-picture for superimposing on a main picture by a predetermined compression method and recording on a recording medium. In a device constructed in a unit, a storage unit that previously prepares pixel data of a plurality of sub-pictures serving as a minimum unit in the form of the compressed data; And a means for packing the sub-picture data unit and recording it in an area preset on the recording medium. 10. The video data processing apparatus according to claim 9, wherein the predetermined compression method is a run-length compression method. 11. A means for constructing compressed data corresponding to pixel data of a sub-picture of the minimum unit as the sub-picture data unit, wherein, when the compressed data is decoded, the decoded pixel data of each sub-picture is in the same line 11. The video data processing apparatus according to claim 10, wherein the video data processing unit is means for constructing a sub video data unit corresponding to one line by connecting the compressed data to be obtained. 12. A main video pack having compressed main video data and a sub-video pack having run-length-compressed sub-video data are mixed and arranged. A recording medium that also includes display sequence control data for displaying the sub-picture; a free area provided on the recording medium for recording the sub-picture pack; and an arbitrary sub-picture data in the free area. Selecting means for selecting run-length data corresponding to each character prepared in advance in a memory in order to write the sub-picture pack including: a predetermined process for the run-length compressed data selected by the selecting means And writing means for arranging the sub-picture pack in the empty area, and arranging the sub-picture pack in the free space. Input device. 13. The video data input device according to claim 12, wherein said writing means performs predetermined modulation by adding an error correction code to said sub-video pack. 14. The sub-picture pack according to claim 1, wherein the sub-picture pack is inputted to a reproduction processing unit and decoded, and a sub-picture based on the decoding result is displayed on a display.
3. The video data input device according to 3. 15. A main video pack having compressed main video data, a sub video pack having run-length compressed sub video data, and control used for picking up the main video pack and the sub video pack. A control pack including information is mixed and recorded, and in a unit in which the sub-picture packs are collected according to a predetermined rule, display sequence control data used for displaying the sub-picture is included. A recording medium characterized in that an area for newly recording sub-picture compressed data is a free area. 16. The recording medium according to claim 15, wherein the video packs constituting the unit including the empty area have the same ID meaning the same stream. 17. The data recorded in the empty area,
17. The recording medium according to claim 16, wherein erasure change is possible.