JP2000023082A - Information recording and reproducing device for multiplex television broadcast - Google Patents

Abstract

PROBLEM TO BE SOLVED: To record and reproduce character code data which are superimposed on a vertical blanking period in a teletext broadcast such as closed captions by packing those code data as the subsidiary video information. SOLUTION: Receiving a reproducing instruction, an MPU 12 decides an address where the contents of the management area of an optical disk 11 out of a disk drive part 19 via a data processor part 18 and then reproduced. Then the MPU 12 sends the address decided for the data to be reproduced and a read instruction to the part 19. The part 19 reads the sector data out of the disk 11 in response to the received instruction, and the part 18 corrects the errors of the data and converts the data into the packed data to output them to a decoding part 14. The 14 receives the packed data via a separating part 27 and turns them into a packet.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an information recording / reproducing apparatus compatible with multiplex television broadcasting such as text multiplex broadcasting and audio multiplex broadcasting.

[0002]

2. Description of the Related Art As is well known, in recent years, a read-only DVD system compatible with a moving image for reproducing an optical disk on which data such as video and audio data is recorded has been widely used.
ser Disk), Video CD (Compact Disk), etc.
It is commonly used for movie software and karaoke.

[0003] At present, MPEG (Moving Picture Image Coding) internationally standardized for compression of video data.
Experts Group) A DVD standard has been proposed which employs two systems and employs an AC-3 audio compression system for compressing audio data.

According to the DVD standard, MPEG2 is used for moving picture compression and AC is used for audio in accordance with the MPEG2 system layer.
-3 audio and MPEG audio support,
Further, sub-picture data obtained by run-length-compressing bitmap data for subtitles and control data (navigation pack) for special reproduction such as fast forward and rewind are added.

[0005] Also, sub-picture data such as subtitle information of a movie and bilingual sounds are packed as SP (Sub Picture) packs and audio packs, respectively, and support special reproduction and multilingual reproduction. ing.

[0006] However, since the current DVD system is a reproduction-only device, this DVD standard is not considered at present for a general home recording / reproduction device. Therefore,
Consider a DVD recording / reproducing system for recording and reproducing TV (Television) broadcast for general household use.

[0007] For example, when recording and reproducing a text multiplex broadcast such as a closed caption, the character code data is transmitted in a superimposed manner using a vertical blanking period.
However, the MPEG compression method of the current DVD standard does not support signals superimposed during the vertical blanking period, so that there is a problem that character code data superimposed during the vertical blanking period cannot be recorded and reproduced.

[0008] Also, consider the case of recording and reproducing a bilingual broadcast or an audio multiplex broadcast with sub-audio such as commentary audio for a physically handicapped person. In audio multiplex broadcasting, a sub audio signal and a control signal are multiplexed on an audio carrier in addition to a main audio signal, and are demodulated into two audio signals by an audio multiplex demodulation circuit during reception. The control signal automatically switches and displays the multiplex mode, and also switches between the main and sub audio under external control.

However, when recording such a broadcast with sub-audio, it is possible to record in the state of the main / sub-audio settings from the outside at the time of recording. Inconvenience such that switching operation of main / sub sound cannot be performed, such as switching of sound.

[0010]

As described above, since the current DVD system is a reproduction-only device, it is possible to reproduce software that supports special reproduction and multilingual reproduction, but it can be used for general household recording and reproduction devices. As not considered. When a conventional DVD recording / reproducing system records and reproduces a character multiplex broadcast such as a closed caption, the character code data is superimposed and sent using a vertical blanking period. Does not correspond to a signal superimposed in the vertical blanking period, so that there is a problem that character code data superimposed in the vertical blanking period cannot be recorded and reproduced.

[0011] When recording and reproducing a bilingual broadcast or an audio multiplex broadcast with sub-audio such as commentary audio for a physically handicapped person, the recording is performed in a state where the main and sub-audio are set externally at the time of recording. However, there is an inconvenience that the main / sub sound switching operation such as language switching which is a special function of the DVD cannot be performed during reproduction.

Therefore, the present invention has been made in consideration of the above circumstances, and is recorded by packing character code data superimposed in a vertical blanking period in teletext broadcasting such as closed captioning as sub-picture information. It is an object of the present invention to provide an information recording / reproducing apparatus capable of recording / reproducing on a medium and capable of multiplex television broadcasting.

[0013] The present invention also provides a method of reproducing sub-audio such as bilingual broadcasting and commentary audio for a physically handicapped person by packing the sub-audio as sub-audio information as a separate stream from the main audio and recording the same on a recording medium. It is an object of the present invention to provide an extremely good information recording / reproducing apparatus compatible with multiplex television broadcasting, in which the main / sub audio can be freely switched at times.

[0014]

SUMMARY OF THE INVENTION An information recording / reproducing apparatus for multiplex television broadcasting according to the present invention is intended for receiving a television broadcast signal and recording / reproducing the information on a recording medium. A recording means for converting the multiplexed character code data into sub-picture data and recording it on a recording medium is provided.

According to the above arrangement, character code data superimposed during the vertical blanking period in teletext broadcasting such as closed captioning is packed as sub-picture information. As a result, recording and reproduction on a recording medium can be performed.

An information recording / reproducing apparatus for multiplex television broadcasting according to the present invention is intended for an apparatus for receiving a television broadcast signal and recording / reproducing the information on a recording medium. The audio data is divided into audio streams different from the main audio data, and recording means for separately packing each audio stream and recording it on a recording medium is provided.

According to the above-described configuration, for example, sub-audio such as bilingual broadcasting or commentary audio for a physically handicapped person is packed as sub-audio information as a stream different from the main audio and recorded on a recording medium. As a result, the main / sub sound can be switched freely during reproduction.

[0018]

Embodiments of the present invention will be described below in detail with reference to the drawings. That is, FIG.
Shows a recording / reproducing apparatus for writing and reading data to and from the optical disk 11 on which main video data, audio data and sub-video data can be rewritten.

This recording / reproducing apparatus uses an MPU (Microproce
ssing Unit) 12, encoding unit 13, decoding unit 1
4, an A / V (Audio / Video) input unit 15, a TV tuner 16, an STC (System Time Counter) 17, a data processor unit 18, a disk drive unit 19, and an A / V output unit 20.

The encoding unit 13 has an A / D (Analog / D)
(igital) conversion unit 21, video encoder 22, audio encoder 23, SP encoder 24, mixing unit 25, and formatter unit 26.

The decoding section 14 includes a separating section 27, a video decoder 28, an SP decoder 29, and an audio decoder 3.
0, video processor 31 and D / A (Digital / Anal
ogue) conversion units 32 and 33.

The data processing includes two processes, a recording process and a reproducing process.
There is a street. First, data processing at the time of recording is as follows. That is, when the MPU 12 receives the recording command,
The disk drive unit 19 reads management data from the optical disk 11 and determines an area on the optical disk 11 where data is to be written.

Next, the MPU 12 writes the determined data write area in the management area of the optical disk 11, sets the write start address in the disk drive unit 19, and prepares to record data.

Next, the MPU 12 resets the time to the STC 17. Here, the STC 17 is a system timer for performing recording and reproduction based on this value. Further, the MPU 12 performs other settings.

The data flow is as follows. First,
Data input from the A / V input unit 15 or the TV tuner 16 is digitized by the A / D conversion unit 21, and the video signal is supplied to the video encoder 22 and the audio signal is supplied to the audio encoder 23. In addition, a closed caption signal obtained from the TV tuner 16 or character code data (text data) of teletext broadcasting or the like
Is input to the SP encoder 24.

The video encoder 22 and the audio encoder 23 compress the video signal and the audio signal, respectively, into packets, and send them to the mixing unit 25 (however,
Each packet is 2, 2 per pack when packed.
048 bytes, and packetized).

The SP encoder 24 performs the following processing. As shown in FIG. 2, the SP encoder 24 includes a teletext decoder 34, a character generator & kanji ROM (Read Only Memory) unit 35, a frame memory unit 36, and an SP encoder unit 37.

The character code data superimposed during the vertical blanking period such as teletext broadcasting is input from the TV tuner 16 to the teletext decoder 34. In the teletext decoder 34, since the sent character code data is text data (JIS code data and the like), the character code data is converted into bitmap (BMP) data (font data) by the character generator & kanji ROM 35, The data is expanded in the frame memory unit 36.

After one frame has been developed by the frame memory unit 36, a one-frame writing end signal and the value of a reproduction start time PTS (Presentation Time Stamp) are sent to the SP encoder unit 37. After receiving the one frame write end signal, the SP encoder unit 37 reads the signal one line at a time, performs run-length compression processing, packetizes it, and sends it to the mixing unit 25.

Here, each of the encoders 22, 23, 24
Is the PT of each packet according to the output value of STC17.
S and DTS (Decoding Time Stamp) are determined and recorded as needed.

The mixing section 25 packs the input packet data into GOPs (Group Of Picturs).
e) Mix every time and send to the formatter unit 26. In the formatter unit 26, NV (Navigatio)
n) Add a pack and output it to the data processor unit 18.

The data processor unit 26 attaches ECC (Error Correcting Code) groups to the disk drive unit 19 as ECC (Error Correcting Code) groups for every 16 sectors, and records the data on the optical disk 11. However, one sector matches one pack.

When the recording is completed, the address data of each NV pack is recorded in the data portion for fast-forward or rewind in each NV pack, and after the recording is completed, necessary information is recorded in the management area and the recording operation is completed. I do.

However, the MPU 12 is connected to the data processor 18 via a bus line in order to read and write a file management area and the like.

FIG. 3 shows the details of the audio encoder 23, and the description will be given later.

Next, the data processing at the time of reproduction is as follows. First, upon receiving a reproduction command, the MPU 12 reads the contents of the management area of the optical disk 11 from the disk drive unit 19 via the data processor unit 18 and determines an address to be reproduced. After that, the MPU 12 sends the previously determined address of the data to be reproduced and the read command to the disk drive unit 19.

The disk drive section 19 reads sector data from the optical disk 11 in accordance with the transmitted instruction, performs error correction in the data processor section 18, converts the data into pack data, and outputs the pack data to the decoding section 14.

In the decoding unit 14, the input pack data is received by the separation unit 27, packetized, and video packet data (MPEG video data) is transferred to the video decoder 28 according to the purpose of the data, and the audio packet data Is transferred to the audio decoder 30,
The SP packet data is transferred to the SP decoder 29. The NV pack is stored in an internal memory for processing by the MPU 12, so that the MPU 12 can access the NV pack at any time.

Each packet data has a PTS at the start of transfer.
Is loaded on the STC17 (PTS in the NV pack is
The PU 12 sets the STC 17 or the video decoder 28 automatically sets the PTS of the video data to the STC 17.
), And then each of the decoders 28, 29, 30
Is synchronized with the value of the PTS in the packet data (PTS
And a reproduction process (comparing with the output value of the STC 17).

As described above, the character information superimposed during the vertical blanking period of the television signal, such as closed caption or text multiplex broadcasting, is recorded in the SP pack as sub-video information, so that the television A video with character information can be displayed on the screen.

Here, the closed caption will be described with reference to FIG. The contents of the closed caption format are shown below. Closed captioning systems use standard NTSC (National Televis)
The character code data is superimposed as a coded composite signal during the blanking period of field 21 (fields 1 and 2 in the extended mode) and line 21 of the video signal.

2 bytes per frame (4 bytes in extended mode)
Byte), which is a mixture of control codes and data codes that define the behavior of the decoder.

In normal caption data, caption modes (POPON, PAINTON, ROLLLU) are used.
P), a code indicating a TEXT mode, a preamble-address-code indicating an address of a display position, a character color, and the like, followed by a data code indicating a character. In addition to this,
Control codes such as display memory erasure, non-display memory erasure, flip memory code, and cursor control, backspace, flash on, line feed, and deletion until the end of the line, which control start / end, are inserted as necessary. .

FIG. 5 shows a basic configuration of the closed caption decoder. C supplied to the input terminal 41
C (Closed Caption) data is transmitted to the CC code decoder 4
After being decoded by 2, the data is written to one of the two memories 43 and 44. And two memories 43,
One of the data 44 is selected by the selector 45 and is displayed on the display.

In PAINTON mode, the decoder
Read memory (display memory) 43 or 44
, Data is written. For example, since the data is written to the memory 43 and behaves as read from the memory 43, the decoded data is immediately displayed.

In the POPON mode, data is written to the unread memory (non-display memory) 43 or 44 (for example, writing to the memory 43 and reading from the memory 44). Then, the read / write memory 4 is written by the flip memory code.
By switching between 3 and 44, the contents of the data written so far (the contents written in the memory 43 in this case) are displayed at once, and the subsequent data writing is performed in the memory 44.
Will be performed. The display is white, green, blue, cyan, red, yellow, and magenta characters on an opaque black background color.

In the POPON mode, line feed, backspace, and deletion until the end of the line do not affect the position of the cursor. In the PAINTON mode, the line feed does not affect the position of the cursor (these codes are ignored).

FIG. 6 shows the setting of the display area.
The display area is 15 rows (Row 1 to Row 15) × 32 columns (0 to 31 columns) and is not necessarily adjacent at the same time. Up to four lines can be displayed. The outer frame indicates the area of the effective screen of the display, and is 480 lines vertically and 719 pixels horizontally.

FIG. 7A shows transmission of a control signal for closed caption data. Each control signal consists of a pair of 1 byte, and is always transmitted to line 21 of the first field, and is transmitted twice repeatedly for correct reception. FIG. 7B shows the state shown in FIG.
5 is a display example when a control signal like this is transmitted. In this example, line 14 is ABCDE and line 15 is
An example in which FGHIJK is displayed in a row is shown.

FIG. 7A is briefly described as follows. First, "14 20""1420"
As a result, a caption data loading start instruction is executed. Next, an instruction to switch the memories 43 and 44 is executed by “142F” and “142F”. Next, “14 52” and “14 52” determine that the display start position is 14 rows and 4 columns.

The next data 41, 42, 43, 44, 45
Corresponds to the letters A, B, C, D, E. Next data 0
0 indicates that the control data comes next, and the next “147
2 ”“ 1472 ”means that the display start position is 15 rows and 4 columns.
49, 4A and 4B correspond to the characters F, G, H, I, J and K.

As control codes in the closed caption system, there are three different types of controls for specifying the format, position, attribute, and character display. These are the preamble address code, Mid-Row code, and Miscellaneous control code.

FIG. 8 shows a preamble address code, FIG. 9 shows a Mid-Row code, and FIG.
Indicates the ous control code. 11 and 12 show typical character codes. Further, in the closed caption system, information of the closed caption display start position can be recognized from the preamble address code.

Next, an outline of the DVD system will be described. FIG. 13 shows a video file structure in the DVD standard. This has a hierarchical structure, and one video object set (VOBS) is composed of one or a plurality of video objects (VOB_IDN1 to VOB).
_IDNi). In addition, one video object includes one or more cells (C_IDN1).
To C_IDNj). Further, one cell is constituted by one or a plurality of video object units (VOBU).

One video object unit is composed of one navigation pack (NV_PCK),
One or more audio packs (A_PCK), 1
One or a plurality of video packs (V_PCK) and one or a plurality of sub-victure packs (SP_PCK). Each pack is composed of one or more packets and a pack header. This pack is the minimum unit for performing data transfer processing. The minimum unit for performing logical processing is a cell.

FIG. 14 shows a configuration example of one pack and a packet. One pack includes a pack header and a packet. A pack start code, a system clock reference SCR, and the like are described in the pack header. The pack start code is a code indicating the start of a pack, and includes a system clock reference S
CR is information indicating the location time in the reproduction elapsed time for the entire apparatus. The length of one pack is 2,048 bytes, and is defined and recorded as one logical block on the optical disk.

One packet includes a packet header and
It is composed of video data, audio data, sub-picture data, or navigation data. The packet header of the packet may be provided with stuffing. In the data part of the packet,
Padding may be provided.

FIG. 15 shows a packed logical structure of an encoded (run-length compressed) sub-picture. FIG.
5, a video object (VOB)
Is composed of, for example, 2,048 bytes (2 k bytes). One pack of sub-pictures includes a packet header and sub-picture data after the head pack header.

Time (SCR) information serving as a reference through reproduction of the entire file is added to the pack header, and has a predetermined relationship with the time of the system timer.
Each sub-picture pack to which the SCR of the same time information is added is collected and transferred to the decoder.

In the first sub-picture pack, a sub-picture unit header (S
PUH) together with run-length compressed sub-picture data. Similarly, the second sub-picture packet includes run-length compressed sub-picture data after the packet header.

A sub-picture data unit is obtained by collecting a plurality of such sub-picture data for one unit included in one VOBU of run-length compression. The sub-picture data unit is provided with a sub-picture unit header (SPUH). After this sub-picture unit header (SPUH), video data for one unit (for example, data for one screen of a two-dimensional display screen)
Is followed by a table containing the run-length compressed pixel data and the display control sequence information of each sub-picture pack.

That is, the sub-picture data unit includes a sub-picture unit header (SPUH) in which various parameters for displaying a sub-picture are recorded,
It is composed of display data (PXD) composed of run-length codes and a display control sequence table (DCSQT).

FIG. 16 illustrates a part of the contents of the sub-picture unit header (SPUH) in the run-length compressed data of one unit illustrated in FIG.
The size of the sub-picture unit (SPU) and the recording start address of the display control sequence table in the sub-picture data packet are recorded in the sub-picture unit header (SPUH).

FIG. 17 shows the data structure of the sub-picture unit again. The sub-picture unit is composed of a plurality of sub-picture packets. That is, one pack of the sub-picture information included in the A / V file is composed of, for example, 2,048 bytes (2 kbytes), and one pack of the sub-picture information is composed of one sub-picture packet after the head pack header. Contains.

In the header of the above-mentioned packet, the time at which the playback system should start the display control of the sub-picture data unit or the presentation time stamp P
Recorded as TS. However, this PTS is recorded only in the header of the first sub-picture data packet in each sub-picture data unit (Y, W), as shown in FIG. This PTS
In a plurality of sub-picture data units reproduced with reference to a predetermined reproduction time (STC), values along the reproduction order are described for the sub-picture units.

FIG. 19 shows the serial arrangement state (n, n + 1) of sub-picture units composed of one or more sub-picture packets, the PTS described in the packet header of one unit (n + 1), and the PTS And the progress state of the display control of the unit (n + 1) corresponding to. That is, the relationship between the processing time of the PTS, the display clear period of the sub-picture unit (n), and the display start time of the sub-picture unit (n + 1) to be displayed from now on is shown.

As shown in FIG. 20, the sub-picture unit header (SPUH) includes the size (SPU_SZ) of the sub-picture unit and the recording start address (SP_DCSQ) of the display control sequence table in the packet.
T_SA).

As shown in FIG. 21, one or more sub-picture display sequences (SP_DCSQ0, SP_D) are stored in the display control sequence table (SP_DCSQT).
, SP_DCSQn) are described in the order of execution. Display control sequence table (SP_DCS
QT) is display control sequence information for starting / stopping the display of the sub-picture and changing the attribute during the valid period of the sub-picture unit.

FIG. 22 shows one content of the sub-picture display control sequence (SP_DCSQ). This sub-picture display control sequence (SP_D
The following contents are described as parameters of CSQ).

The sub picture display control start time (SP) indicating the time when the execution of the video data display control is started
_DCSQ_STM), an address (SP_NXT_DCSQ_SA) indicating the destination of the next sub-picture display control sequence (SP_DCSQ), and a display control command (SP_DCCMD1, SP_SP) for the sub-picture data.
_DCCMD2,...) Are recorded.

The sub-picture display control start time (SP_) which sets the display control sequence execution start time
DCSQ_STM) is defined by a relative time (relative PTM) from the PTS described in the packet header.

Therefore, the sub-picture display control start time (SP_DCSQ_STM) is compared with the count value of the sub-timer which has started counting when the presentation time stamp (PTS) of the sub-picture unit (SPU) matches the STC 17,
If the count value of the sub-timer is equal to or greater than the sub-picture display control start time (SP_DCSQ_STM), the display state of the output data decoded by the decoding means is controlled according to the sequence control data.

Actually, for the first displayed video frame after the execution start time, which is the sub-picture display control start time (SP_DCSQ_STM), is described, for the sub-picture represented in the video frame, Control for display is started.

For example, the sub-picture display control start time (SP_DCSQ_STM) to be executed includes:
"0000h" is described. The value of the execution start time is the value of P described in the sub-picture packet header.
When it is equal to TS, it is "0", and when it is more than that, it takes a positive value.

Based on this display control start time, one sub-picture display control sequence (SP_DCSQ)
Is executed, the next specified sub-picture display control sequence (SP_DCSQ)
The execution processing is started when the command in the command reaches the display control start time. For example, it is possible to perform control such that the colors of displayed subtitles are sequentially changed.

The SP_NXT_DCSQ_SA is represented by the relative number of bytes from the first sub-picture unit, and the next sub-picture display control sequence (SP_NXT_DCSQ_SA)
DCSQ). If the next sub-picture display control sequence (SP_DCSQ) does not exist, the first sub-picture display control sequence (SP_DCSQ) is represented by the relative number of bytes from the first byte of the corresponding sub-picture unit. SP_DCSQ) is described.

The sub-picture data display control command (SP_DCCMDn) describes one or more display control sequences.

FIG. 23 shows one content of a display control command (SP_DCCMD) for performing display control. The contents of the display control command (SP_DCCMD) include an instruction (FSTA_DSP) for setting a forced display start timing of pixel data, an instruction (STA_DSP) for setting a display start timing of pixel data,
Command to set the display end timing of pixel data (S
TP_DSP), a command to set the color code of the pixel data (SET_COLOR), a command to set the contrast between the pixel data display area and the main image (SET_CONTR), and a command to set the pixel data display area (SET SET_DAREA) and an instruction (SET_DSP) for setting a display start address of pixel data.
XA), a command (CHG_COLCON) for setting the control for changing the color and contrast of the pixel data, and a command (CMD_END) for terminating the display control.

The respective codes and extension fields are as follows, as shown in FIG. That is, the code of the compulsory display start timing command (FSTA_DSP) is 00h, and the extension field is 0 bytes. When this command is described, the forced display of the sub-picture unit having this code is executed regardless of the on / off state of the display state of the sub-picture.

Display start timing instruction (STA_DS)
The code of P) is 01h, and the extension field is 0 bytes. This command is a display start command of the sub-picture unit, and is ignored when the display of the sub-picture is in the off state. The code of the display end timing command (STP_DSP) is 02h, and the extension field is 0 bytes. This command is a display stop command of the sub-picture unit, and the sub-picture can be displayed again by the previous display start command.

A color code setting instruction (SET_COLO
The code of R) is 03h, and the extension field is 2 bytes. This command is a command for determining the color of each pixel of the pixel data, and is described in the extension field by a pallet code. Also, the palette code for each pixel is for the second emphasized pixel (4 bits) and for the first emphasized pixel (4 bits).
Bit), pattern pixels (4 bits), and background pixels (4 bits).

Here, this instruction (SET_COLOR)
Is not present in the sub-picture unit,
The last used one before that is maintained and this instruction is used. This instruction is specified at the beginning of each line.

A contrast setting command (SET_CONT)
The code of R) is 04h, and the extension field is 2 bytes. This command is a command for setting a mixture ratio between the pixel data and the main image. Here, if this command does not exist in the sub-picture unit, the last one used before that is maintained, and this command is used. This instruction is specified at the beginning of each line.

Display area setting command (SET_DARE)
The code of A) is 05h, and the extension field is 6 bytes. This command is a command for setting a display area of square pixel data on the screen. This instruction describes the start position (10 bits) and end position (10 bits) of the X-axis coordinates on the screen, and the start position (10 bits) and end position (10 bits) of the Y-axis coordinates.

The remaining bits of the six bytes are reserved. The origin of the Y-axis coordinate is line number 0.
The origin of the X-axis coordinate is also 0. On the screen, it corresponds to the upper left corner.

The Y axis coordinate value is 2 to 479 (525 lines / 6
0-Hz TV) or 2-574 (625 lines /
In the case of a 50 Hz TV), a sub-picture line is specified, and a value of 0 to 719 is described as the X-axis coordinate value, thereby specifying a pixel number.

Here, this instruction (SET_DAREA)
Is not present in the sub-picture unit,
The instruction included in the last sub-picture unit sent earlier is used as it is.

Display start address setting instruction (SET_DS
PXA) is 06h, and the extension field is 4
Bytes. This command is a command indicating the first address of the image data to be displayed. The first addresses of the odd field (16 bits) and the even field (16 bits) are described by the relative number of bytes from the head of the sub-picture unit. The first of the position indicated by this address
Pixel data indicates a run-length compression code including the first pixel at the left end of the line.

Here, this instruction (SET_DSPXA)
Is not present in the sub-picture unit,
The instruction included in the last sub-picture unit sent earlier is used as it is.

Color and contrast change control command (C
HG_COLCON) is 07h, and the extension field is pixel control data size + 2 bytes. The code of the display control end command (CMD_END) is FF
h, and the extension field is 0 bytes.

Next, FIG. 24 shows the pixel control data (PXCD: Pixel) described in the extension field of the color and contrast change control command (CHG_COLCON).
Control Data).

This pixel control data (PXCD) is data for controlling the color and contrast of the pixel displayed as a sub-picture during the display period. The command described in the pixel control data (PXCD) is based on the sub-picture display control start time (SP_DCSQ_ST).
M) is performed on each video frame from the first video frame after the description, and the next new pixel control data (P
XCD) is set. When the new pixel control data (PXCD) is updated, the existing pixel control data (PXCD) is canceled.

The line control information (LN) shown in FIG.
_CTLI: Line Control Information) specifies a line on which sub-picture change control is performed. A plurality of lines on which similar change control is performed can be designated. Also, the pixel control information (PX) shown in FIG.
_CTLI: Pixel Control Information) describes a designated position on a line where the change control is performed. 1
One or more pieces of pixel control information (PX_CTLI) can specify a plurality of positions on a line on which change control is performed.

As the end code of the pixel control data (PXCD), 0FFFFFFFFh is the line control information (LN_
CTLI). When the pixel control data (PXCD) in which only this end code exists, the color and contrast change control command (CHG_
COLCON) itself.

Each instruction will be further described with reference to FIGS. 25 (a) and 25 (b). Line control information (LN_CTL
I) is composed of 4 bytes and includes a line number (10 bits) at which a change of a sub-picture starts, a change number (4 bits),
Then, the end line number (10 bits) is described.

The change start line number is the line number at which the change of the pixel control content starts, and is described by the line number of the sub-picture. The end line number is a line number at which the control state based on the pixel control content is stopped, and is also described by the line number of the sub-picture.

Further, the number of changes is the number of change positions,
It will be equal to the number of pixel control information (PX_CTLI) in the group. Naturally, the line number at this time is 2 to 479 (the TV system is 525 lines / 60H
z), or 2 to 574 (the TV system is 62
5/50 Hz).

Next, one pixel control information (PX_CTL)
I) is composed of 6 bytes and describes a change start pixel number (10 bits) and control information for changing the color and contrast of each pixel following the pixel.

As a pallet code for pixels, the second
Each palette code is described for an enhancement pixel (4 bits), a first enhancement pixel (4 bits), a pattern pixel (4 bits), and a background pixel (4 bits). In addition, as the contrast designation data for the pixel, the second
Contrast designation data for an emphasized pixel (4 bits), a first emphasized pixel (4 bits), a pattern pixel (4 bits), and a background pixel (4 bits) are described.

The above change start pixel numbers are described by the pixel numbers in the display order. When this is 0, the color code setting command (SET_COLOR) and the contrast setting command (SET_CONTR) are ignored. As the color control information, a color pallet code is described, and as the contrast control information, the contrast designation data is described as described above.

In each of the above control information, if no change is requested, the same code as the initial value is described. The initial value is a color code and contrast control data specified from the beginning to be used for the sub-picture unit.

Next, an example of a sub-picture compression method will be described. FIG. 26 shows run-length compression rules 1 to 6 when pixel data (run-length data) of a sub-picture is created. According to this rule, the data length (variable length) of one unit of the unit is determined. Then, encoding (run-length compression) and decoding (run-length decompression) are performed with the determined data length.

FIG. 26 shows run-length compression rules 1 to 4 adopted in the encoding method according to the embodiment when the preceding sub-picture pixel data (run-length data) portion is composed of 2-bit pixel data. 6 is explained. According to rule 1 shown in the first column of FIG. 26, when one to three identical pixels continue, one unit of encoded (run-length compressed) data is constituted by 4-bit data. In this case, the first two bits indicate the number of continuous pixels.
Bits represent pixel data (such as pixel color information).

For example, the first compressed data unit CU01 of the video data (PXD) before compression shown in FIG.
Are two 2-bit pixel data d0, d1 = (000
0) b (b is binary). In this example, the same 2-bit pixel data (00)
b is continuous (continuous).

In this case, as shown in FIG. 27B, d0, d1 = (1000) b obtained by connecting the 2-bit display (10) b of the continuation number "2" and the content (00) b of the pixel data.
Is the data unit CU0 of the compressed video data (PXD).
1 *.

In other words, according to rule 1, data unit C
(0000) b of U01 is (1) of data unit CU01 *.
000) b. In this example, although substantial compression of the bit length has not been obtained, for example, the same pixel (00)
If b is three consecutive CU01 = (000000) b, CU01 * = (1100) b after compression, and 2
A bit compression effect is obtained.

According to rule 2 shown in the second column of FIG. 26, when 4 to 15 identical pixels continue, one unit of encoded data is constituted by 8-bit data. In this case, the first two bits are represented by an encoding header indicating that it is based on rule 2, the next four bits represent the number of continuous pixels, and the subsequent two bits represent pixel data.

For example, the second compressed data unit CU0 of the video data (PXD) before compression shown in FIG.
2 is five 2-bit pixel data d2, d3, d4, d
5, d6 = (0101010101) b.
In this example, the same 2-bit pixel data (01) b is 5
Are consecutive.

In this case, as shown in FIG. 27 (b), the encoded header (00) b, the 4-bit display (0101) b of the continuation number "5", and the content (01) b of the pixel data are The connected d2 to d6 = (00010101) b is the data unit CU02 * of the compressed video data (PXD).

In other words, according to rule 2, the data unit C
(0101010101) b of U02 (10-bit length)
Is (00010101) b of the data unit CU02 *
(8-bit length). In this example, the effective bit length compression amount is only 2 bits from 10 bits to 8 bits, but the continuation number is, for example, 15 (01 of CU02 is 15 bits).
In the case of a continuous 30-bit length), this becomes 8-bit compressed data (CU02 * = 00111101) b, and a compression effect of as much as 22 bits can be obtained for 30 bits. That is, the bit compression effect based on Rule 2 is greater than that of Rule 1. However, Rule 1 is also required to support run-length compression of fine images with high resolution.

According to rule 3 shown in the third column of FIG. 26, when 16 to 63 identical pixels continue, one unit of encoded data is constituted by 12-bit data. In this case, the first four bits are represented by an encoding header indicating that the data is based on Rule 3, the following six bits represent the number of continuous pixels, and the subsequent two bits represent pixel data.

For example, the third compressed data unit CU0 of the video data (PXD) before compression shown in FIG.
3 is 16 2-bit pixel data d7 to d22 = (1
01010 ... 1010) b. In this example, 16 identical 2-bit pixel data (01) b are continuous.

In this case, as shown in FIG. 27 (b), an encoded header (0000) b, a 6-bit representation (010000) b of continuation number "16", and the contents of pixel data (0
1) d7 to d22 connected to b = (000010001000)
010) b is the data unit CU03 * of the compressed video data (PXD).

In other words, according to rule 3, data unit C
(101010... 1010) b (32-bit length) of U03 is (000010001000) of the data unit CU03 *.
010) b (12-bit length). In this example, the substantial bit length compression amount is 20 bits from 32 bits to 12 bits, but the continuation number is, for example, 63 (CU
In the case of 63 consecutive 10s of 03, which is 126 bits long, this is 12-bit compressed data (CU03 * = 0)
00011111110) b, and a compression effect of as much as 114 bits can be obtained for 126 bits. That is, the bit compression effect based on Rule 3 is greater than that of Rule 2.

Next, the determination of the display time for one screen will be described based on the example shown in FIG. In this example, the character ABCDE is on the 14th line, and the character FGH is on the 15th line.
An example in which IJK is displayed on the screen is shown.

That is, as shown in FIG.
After a caption data loading start command is sent by “4 20” or “14 20”, “14 2”
A command to switch the display memories 43 and 44 is transmitted by F "and" 142F ", and then the display start position is determined to be 14 rows and 4 columns by" 1452 "and" 1452 ".

Then, the next data 41, 42, 43, 4
4, 45 correspond to the characters A, B, C, D, E. The next data 00 indicates that the control data comes next, and the next “14 72” and “14 72” indicate that the display start position is 15
It means that there are four rows and four columns. Subsequently, data 46,
47, 48, 49, 4A and 4B are characters F, G, H,
Corresponds to I, J, K.

Then, "142C""142C"
Deletes the previous contents of the display memories 43 and 44,
“142F” “142F” allows the display memory 43,
Forty-four switching commands are sent, and one-screen display is started. At this moment, the time counted by the STC 17 is defined as PTS, and this is the display start time.

Immediately thereafter, run-length compression is started. After that, “14” after the data 00 continues.
2C "and" 142C ", the display memories 43 and 44 are erased, and the display processing for one screen is completed.At this moment, the display end time is determined.

While writing to the memories 43 and 44, the character code data is converted into BMP data by the character broadcast decoder 34 via the character generator & kanji ROM 35, and is expanded in the frame memory 36.
After the completion of one frame expansion (after the display memory 43, 44 switching command), the SP encoder unit 37 reads out each line and performs run-length compression.

Then, the previously determined display start time PTS
Is set in the packet header, and the display control start time (SP_DCSQ # 0_STM) of the pixel data in the sub-picture display control sequence (SP_DCSQ)
Is set to a value obtained by subtracting the PTS from the display start time, and the display control end time (SP_DCSQ # 1_S
TM) Time from display start to display end (that is, display end time minus PTS value of display start time)
Is set and recorded in the sub-picture unit.

Since the value of the above PTS is added,
Thus, at the time of reproduction, a sub-video signal synchronized with the main video and main audio can be reproduced.

Next, a case where the display range is determined will be described. As described above, the display position can be recognized by the preamble address code in the closed caption. For example, the closed caption instruction “14
52 14 52 41 ”. This is because the display position of the character A (code 41) is 14 lines 4
Means a column.

As described above, the display area has a font size per character of 16 pixels × 2.
6 lines, and 15 lines (Row 1 to Ro)
w 15) × 32 rows (0 to 31 columns).

That is, in the case of this example, [display start X
X = 104 + (4-1) × 16 = 152 pixels, where X = coordinate of left side of closed caption display area + (display column−1) × number of pixels per character], and [display end X Coordinate = X coordinate on the left side of the closed caption display area + display column × number of pixels per character−1], and X = 104 + 4 × 16−1 = 167 pixels, and [display start Y coordinate = closed caption display] Y coordinate above the area + (display line−1) × number of lines per character], and Y = 45 + (14−1) × 26 = 383 lines, and [display end Y coordinate = closed caption display area , Y = 45 + 14 × 26−1 = 408 lines.

That is, the X and Y coordinate information at each of the display start position and the display end position is stored in the display control sequence table (SP_DCS) in the sub-picture pack.
Q) of the display control command (SP_DCCMD) in (S)
ET_DAREA).

Next, a case where a character is given a color attribute will be described. In the DVD format, (VTS_PGCI) in the video title set program chain information table (VTS_PGCIT) in the video title set information (VTSI) in one video title set (VTS)
In the PGC sub-picture palette (PGC_SP_PLT) in the program chain general information (PGC_GI), a color palette actually used as a color is set.

The display control sequence table (SP) in the sub-picture pack is
_DCSQ) within the display control command (SP_DCCM)
D) (SET_COLOR) has a color attribute set. In the closed caption system, when a character is given a color attribute, the setting is performed by a Mid-Row code as a control code.

Here, as an example, let us consider a case where it is desired to make display characters red. As described above, the color of the displayed characters in the closed caption is white, green,
Since the colors are determined to be blue, cyan, red, yellow, and magenta, first, the PGC sub-picture palette (PGC_SP_P
LT), for example, a color palette of 16 colors as shown in FIG. 28 is set.

Then, the instruction "11" for changing the display character to red as a closed caption control code is executed.
When "28" and "11 28" are sent, a code indicating red is set to (SET_COLOR) based on this code.

Next, taking a closed caption as an example, an example of display control according to this embodiment will be summarized. FIG.
FIG. 29B shows a screen display example when the closed caption data as shown in FIG. 9A is received. In this example, red character ABCDE is displayed on one screen.
In the fourth line and the fourth column, the yellow character FGHIJK is placed in the fifteenth line,
This is an example of display in the fourth column.

First, before taking in data, a color palette of 16 colors is set in the PGC sub-picture palette (PGC_SP_PLT). After the caption data loading start command is sent by the closed caption data “14 20” and “14 20”, the display memory 4 is sent by “142F” and “142F”.
3,44 switching commands are sent, and then “112”
8 "" 1128 "determines that the character display is red.

Next, the data "1452""145"
By 2 ", it is determined that the display start position is 14 rows and 4 columns. When this is converted into X and Y coordinates on the screen,
It looks like this:

That is, [display start X coordinate = left X coordinate of closed caption display area + (display column−
1) × number of pixels per character], and X = 104 + (4-1) × 16 = 152 pixels, and [display start Y coordinate = Y coordinate above closed caption display area + (display line−1) ) × the number of lines per character], and Y = 45 + (14−1) × 26 = 383 lines. That is, the X and Y coordinate information of the display start position is:
(152 pixels, 383 lines).

The next data 41, 42, 43, 44, 45
Corresponds to the letters A, B, C, D, E. Next data 0
0 indicates that the control data comes next, and it is determined by the next data “112A” and “112A” that the character display is yellow. Next "14 72""14
72 "means that the display start position is 15 rows and 4 columns. Then, data 46, 47, 48 and 4
9, 4A and 4B correspond to the characters F, G, H, I, J and K.

Thus, the display end position is set to 15 lines, 9 lines.
Determined as a column. When this is converted into X, Y coordinates on the screen, X = 104 + 9 × 16−, [display end X coordinate = X coordinate on left of closed caption display area + display column × number of pixels per character−1]. 1 = 247 pixels, and Y = 45 + 15 × 26−1 = 443 lines [display end Y coordinate = Y coordinate above closed caption display area + display line × number of lines per character−1]. . Thus, the X and Y coordinate information of the display start position is (247 pixels, 443 lines).

Here, (S) in the display control sequence table (SP_DCSQ) in the sub-picture pack
In (SET_COLOR) in (P_DCCMD), the previously determined red character is assigned and set as the pattern pixel color, and the yellow character is assigned and set as the highlight pixel color. The contrast is set to 100%.

The display control sequence table (SP
_DCSQ) in (SP_DCCMD) within (SE
T_DAREA), the display start position X, Y coordinate information (1
52 pixels, 383 lines) and display end position X, Y
The coordinate information (247 pixels, 443 lines) is set.

Then, "142C""142C"
Deletes the previous contents of the display memories 43 and 44,
“142F” “142F” allows the display memory 43,
Forty-four switching commands are sent, and preparation for starting one-screen display is completed. At this moment, the time counted by the STC 17 is defined as PTS, and this is the display start time.

Immediately thereafter, run-length compression is started. After that, “14” after the data 00 continues.
2C "and" 142C ", an instruction to erase the display memories 43 and 44 is issued, and the display processing for one screen is completed.At this moment, the display end time is determined.

During writing to the memories 43 and 44, the character code data is converted into BMP data by the character broadcast decoder 34 via the character generator & kanji ROM 35, and is expanded in the frame memory 36.
After one frame has been expanded (after the display memory 43, 44 switching command), the SP encoder 37 reads out the data for each line, performs run-length compression, and records it as PXD data in the sub-picture unit. That is, the character AB
CDE is used as pattern pixel data, and character FGH
Run-length compression is performed using IJK as emphasized pixel data.

Next, the value of the previously determined display start time PTS is set in the packet header, and the display control start time (SP_DCSQ_ST) is set as the display control sequence # 0.
M) is set to 0, the time from the start of display to the end of display is set as the display control sequence # 1 within the display control end time (SP_DCSQ_STM), and recorded in the sub-picture unit. After the sub-picture unit is completed, it is packed and recorded on the optical disk 11.

The display control sequence in this example is shown in FIGS. 30 (a), 30 (b) and 30 (c).

Here, in the case of closed captions in teletext, English subtitles are used. In Japanese text multiplex broadcasting, Japanese subtitles are provided. in this way,
The type of language differs depending on the teletext system. Therefore, a language code can be assigned according to each teletext system.

The language code is DVD-VIDE.
In the O standard, as shown in FIG. 32, it is recorded in VTSI. At this time, the recording format is as shown in FIGS.
As shown in FIG. For example, in the case of closed caption, the language code is “En” and the language code extension is “01h”. In the case of Japanese text multiplex broadcasting, the language code is "Ja" and the language code extension is "01h".

Next, the audio encoder 23 shown in FIG. 3 will be described. The L (left) channel audio signal and the R (right) channel audio signal input from the TV tuner 16 are digitized by A / D converters 21 a and 21 b and supplied to the audio encoder 23. Further, the TV tuner 16 outputs to the audio encoder 23 a signal for determining whether or not the TV broadcast is a bilingual broadcast.

The audio encoder 23 records the L and R channel audio signals as one stream as normal stereo audio pack data in accordance with the discrimination signal when the broadcast is not bilingual. In the case of bilingual broadcasting, it is recorded as monaural audio pack data as two streams.

Here, setting of a language code in the case of, for example, bilingual broadcasting will be described. (VSI) in the video title set information management table (VTSI_MAT) in the video title set information (VTSI) in the video title set (VTS)
TS_AST_ATRT) is, as shown in FIG. 31A, 8 bytes for each stream, a total of 8 streams (64 bytes), and (VTS_AST_ATR) for each stream.
T) is configured as shown in FIG.

In the case of bilingual broadcasting, the sub-audio Japanese
0 stream and English of main voice as # 1 stream, and the specific code in (VTS_AST_ATRT) of each stream is set to ISO (International Organizer).
Set each language code shown in “Action for Standardization” -639.

For example, (VTS_AST) of stream # 0
_ATRT) to the specific code in Japanese "J
The code corresponding to "a" is set, and the code corresponding to English "En" is set to the specific code in (VTS_AST_ATRT) of stream # 1.

In the case of a commentary voice for a physically handicapped person, the language code extension is "02h".

As described above, the secondary audio, such as the bilingual broadcast and the commentary audio for the physically handicapped, is divided into an audio stream different from the main audio, and the two audio streams are separately converted into audio packs to reproduce the audio. At times, it is possible to reproduce a moving image with sound that enables language switching.

The present invention is not limited to the above-described embodiment, and can be implemented with various modifications without departing from the scope of the invention.

[0154]

As described in detail above, according to the present invention,
Extremely good multiplex television broadcasting support that can be recorded and reproduced on a recording medium by packing character code data superimposed during the vertical blanking period in text multiplex broadcasting such as closed captioning as sub-picture information Can be provided.

Further, according to the present invention, a sub-audio such as a bilingual broadcast or a commentary audio for a physically handicapped person is packed as a sub-audio information as a stream different from the main audio and recorded on a recording medium. In addition, it is possible to provide an extremely excellent information recording / reproducing apparatus compatible with multiplex television broadcasting, in which the main / sub sound can be freely switched during reproduction.

[Brief description of the drawings]

FIG. 1 is a block diagram showing an embodiment of the present invention.

FIG. 2 is a block diagram showing details of an SP encoder according to the embodiment;

FIG. 3 is a block diagram showing details of an audio encoder according to the embodiment;

FIG. 4 is a diagram showing a transmission format of closed caption data.

FIG. 5 is a block diagram showing a decoder of closed caption data.

FIG. 6 is a diagram showing a display screen area of closed caption data.

FIG. 7 is a diagram showing a transmission data example of closed caption data and a display example thereof.

FIG. 8 is a diagram showing an example of a preamble address code of a closed caption system.

FIG. 9 is a diagram showing an example of a closed caption type Mid-Row code.

FIG. 10 is a diagram showing an example of a closed caption type control code.

FIG. 11 is a diagram showing an example of a closed caption type character code.

FIG. 12 is a diagram showing an example of a closed caption type character code.

FIG. 13 is a diagram showing a hierarchical structure of a video object set (VOBS).

FIG. 14 is a diagram showing a configuration example of one pack and a packet.

FIG. 15 is a diagram illustrating a sub-picture unit.

FIG. 16 is a diagram illustrating a sub-picture unit.

FIG. 17 is a diagram illustrating a sub-picture unit.

FIG. 18 is a diagram illustrating a continuous configuration of sub-picture units.

FIG. 19 is a view for explaining display timing of a sub-picture unit.

FIG. 20 is a diagram showing a header configuration of a sub-picture unit.

FIG. 21 is a view for explaining a sub-picture display control sequence table.

FIG. 22 is a view for explaining a sub-picture display control sequence table.

FIG. 23 is a view for explaining a sub-picture display control command.

FIG. 24 is a view for explaining a sub-picture display control command.

FIG. 25 is a view for explaining the contents of a sub-picture display control command.

FIG. 26 is a view for explaining a run-length compression rule;

FIG. 27 is a diagram showing an example of run-length compressed data.

FIG. 28 is a view showing an example of set values of a color palette of 16 colors.

FIG. 29 is a diagram showing a transmission data example of closed caption data and a display example thereof.

FIG. 30 is a view for explaining the contents of a sub-picture display control sequence.

FIG. 31 is a view for explaining an audio stream;

FIG. 32 is an exemplary view for explaining a language code of the DVD-VIDEO standard.

FIG. 33 is a view for explaining the recording format of the same language code.

FIG. 34 is a view for explaining a recording format of the same language code.

FIG. 35 is a view for explaining a recording format of the same language code.

FIG. 36 is a view for explaining the recording format of the language code;

[Explanation of symbols]

 11: Optical disk, 12: MPU, 13: Encoding unit, 14: Decoding unit, 15: A / V input unit, 16: TV tuner, 17: STC, 18: Data processor unit, 19: Disk drive unit, 20: A / V output unit, 21 A / D conversion unit, 22 video encoder, 23 audio encoder, 24 SP encoder, 25 mixing unit, 26 formatter unit, 27 separation unit, 28 video decoder, 29 ... SP decoder, 30 audio decoder, 31 video processor, 32, 33 D / A converter, 34 text broadcast decoder, 35 character generator and kanji ROM, 36 frame memory, 37 SP encoder , 38, 39 ... A / D converter, 40 ... Audio encoder, 41 ... Input Terminals, 42: CC code decoder, 43, 44: Memory, 45: Selector.

 ──────────────────────────────────────────────────続 き Continuing from the front page (72) Nobuhide Sugimoto 70, Yanagicho, Kochi-ku, Kawasaki-shi, Kanagawa Prefecture Inside Toshiba Yanagicho Plant Co., Ltd. (72) Inventor Shinichi Kikuchi 3-3-9, Shimbashi, Minato-ku, Tokyo Toshiba A・ F-term in bu.E. Co., Ltd. (reference) GK08

Claims (10)

[Claims] 1. An information recording / reproducing apparatus for receiving a television broadcast signal and recording / reproducing on a recording medium, wherein the character code data multiplexed on the television broadcast signal is converted into sub-video data and recorded on the recording medium. An information recording / reproducing apparatus for multiplex television broadcasting, characterized by comprising means. 2. The recording device according to claim 1, wherein the recording device converts the character code data into bitmap data and expands the bitmap data into a frame memory. 2. A conversion means comprising:
An information recording / reproducing apparatus compatible with multiplex television broadcasting as described in the above. 3. The conversion means includes: detection means for detecting a character display start time from control data accompanying the character code data; and a display start time of a sub-picture based on the time information detected by the detection means. 3. The information recording / reproducing apparatus for multiplex television broadcasting according to claim 2, further comprising control information adding means for determining and adding the determined time information to said sub-picture pack. 4. The conversion means includes: detection means for detecting a character display end time from control data accompanying the character code data; and a display end time of a sub-picture based on time information detected by the detection means. 3. The information recording / reproducing apparatus for multiplex television broadcasting according to claim 2, further comprising control information adding means for determining and adding the determined time information to said sub-picture pack. 5. The detecting means for detecting a character display start position and a character display end position from control data accompanying the character code data, and converts the position information detected by the detecting means into the sub-picture. 3. The information recording / reproducing apparatus for multiplex television broadcasting according to claim 2, further comprising control information adding means for adding to the pack. 6. A detecting means for detecting a character display color from control data accompanying the character code data, and a control information adding means for adding the color information detected by the detecting means to the sub-picture pack. 3. An information recording / reproducing apparatus compatible with multiplex television broadcasting according to claim 2, comprising means. 7. The control means ignores control data other than information relating to a character display time, information relating to a character display position or information relating to a character display color among control data accompanying the character code data,
3. The information recording / reproducing apparatus for multiplex television broadcasting according to claim 2, wherein the information recording / reproducing apparatus is controlled so as not to be used for the sub-picture packing. 8. A deciding means for deciding a language code based on a teletext system in which said character code data is multiplexed on said television broadcast signal, and a language code decided by said deciding means is stored in a predetermined format of said recording medium. 8. The information recording / reproducing apparatus for multiplex television broadcasting according to claim 1, further comprising: a language code recording unit for recording in a region. 9. An information recording / reproducing apparatus which receives a television broadcast signal and records / reproduces it on a recording medium, divides the sub audio data multiplexed into the television broadcast signal into an audio stream different from the main audio data. An information recording / reproducing apparatus for multiplex television broadcasting, comprising recording means for separately packing each audio stream and recording the audio streams on the recording medium. 10. A determining means for determining a language code for sub audio data multiplexed on the television broadcast signal, and a language code recording for recording the language code determined by the determining means in a predetermined area of the recording medium. 10. An information recording / reproducing apparatus compatible with multiplex television broadcasting according to claim 9, comprising means.