JP2010154545A - Reproduction device for reproducing data stored in information storage medium with multi-language supporting subtitle data using text data and download font recorded therein, and data recording and/or reproducing device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a reproduction device for reproducing data stored in an information storage medium with sub-picture data recorded therein by forming moving image data into a data structure without needing to consider a bit generation amount occupied by the sub-picture data in advance when encoding the moving image data, and a data recording and/or reproducing device. <P>SOLUTION: This reproduction device for reproducing data includes steps of: reading AV data and text data; rendering subtitle image data from the text data; decoding the AV data to output the decoded AV data; and blending the subtitle image data with the decoded AV data. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a reproducing apparatus and a data recording and / or reproducing apparatus for reproducing data stored in an information storage medium on which a subtitle for multilingual support using text data and a download font is recorded.

  A conventional DVD uses a bitmap image as a subtitle. The subtitle data of the bitmap image is losslessly encoded and recorded on the DVD up to 32 pieces.

  The data structure of a DVD video, which is one of conventional multimedia information storage media, will be described as follows.

  FIG. 1 is a data structure diagram of a DVD. Referring to FIG. 1, a DVD as a multimedia storage medium divides a disc into a VMG area and a plurality of VTS areas, title information and title menu information in the VMG area, and a plurality of title information. In the VTS area. The VMG area is composed of 2 to 3 files, and each VTS area is composed of 3 to 12 files.

  FIG. 2 is a detailed structural diagram of the VMG region. Referring to FIG. 2, the VMG area includes a VMGI area for storing additional information about VMG, a VOBS area for storing moving picture information about menus, and a VMGI backup area. These exist in one file, but the presence of the VOBS area is optional.

  In the VTS area, information on the title of a reproduction unit and VOBS which is moving image data are stored. At least one title is recorded in one VTS.

  FIG. 3 is a detailed structural diagram of the VTS region. Referring to FIG. 3, the VTS area includes video title set information VTSI (Video Title Set Information), VOBS that is moving image data for menu screens, VOBS that is moving image data of a video title set, and VTSI backup data. The presence or absence of VOBS for displaying the menu screen is optional. Each VOBS is divided again into VOB and CELL which are recording units. One VOB is composed of a plurality of CELLs. The lowest recording unit mentioned in the present invention is CELL.

  FIG. 4 is a detailed structural diagram of VOBS which is moving image data. Referring to FIG. 4, one VOBS is composed of a plurality of VOBs, and one VOB is composed of a plurality of CELLs. The CELL is again composed of a plurality of VOBUs. VOBU is data encoded by MPEG, which is a moving image encoding method used in DVD. According to MPEG, an image is space-time compression-encoded, and thus an image is required before or after to decode a certain image. Therefore, in order to support a random access function for starting reproduction at an arbitrary point, intra coding that does not require an image before or after is performed for each fixed image. In MPEG, this is called an intra picture or an I picture, and a gap between this I picture and the next I picture is called a GOP (Group Of Picture). Usually, GOP consists of 12 to 15 images.

  MPEG also defines system encoding (ISO / IEC13818-1) for combining video data and audio data into one bit stream. For system encoding, a PS (program stream) multiplexing method optimized for creating a single program and storing it on an information storage medium, and a TS (transport stream) suitable for creating and transmitting a plurality of programs 2) Multiplexing methods are defined. Of these DVDs, the PS encoding method is adopted. According to the PS encoding method, video data or audio data is divided in units of packs (PCK), and then time-division multiplexed. Data other than video and audio data defined by MPEG can be named PS and can also be multiplexed with video data and audio data in PCK.

  The VOBU is composed of a plurality of PCKs. Of the plurality of PCKs, the first PCK is a navigation pack (NV_PCK). Next, a video pack (V_PCK), an audio pack (A_PCK), and a sub-picture pack (SP_PCK) are configured. The video data stored in the video pack is composed of a plurality of GOPs.

  SP_PCK is for 2D graphic data and caption data. That is, in DVD, subtitle data appearing in an overlapping manner with a video image is encoded by the same method as two-dimensional graphic data. That is, in the case of DVD, a separate encoding method for multilingual support is not adopted, and each subtitle data is converted into graphic data, and then processed and recorded by one encoding method. Graphic data for subtitles is called a sub-picture. A sub-picture is composed of a sub-picture unit (SPU). The SPU corresponds to one piece of graphic data.

  FIG. 5 is a relationship diagram between the SPU and SP_PCK. Referring to FIG. 5, one SPU includes an SPU header (SPUH), pixel data (PXD), and a sub-picture display control sequence table (SP_DCSQT). These are sequentially divided and recorded in SP_PCK having a size of 2048 bytes. At this time, when the last data of the SPU cannot completely fill one SP_PCK, the remaining space of the last SP_PCK is padded and made the same size as the remaining SP_PCK. That is, one SPU is composed of a plurality of SP_PCKs.

  In the SPUH, the size of the entire SPU and the position where the SP_DCSQT data starts in the SPU are recorded. PXD data is encoded data obtained by encoding a sub-picture. Pixel data constituting a sub-picture can have four types of values. These are background, pattern pixel, emphasis pixel-1, and emphasis pixel-2, which can be represented by 2-bit values, each having a binary number of 00, 01, 10, 11 values. Therefore, the sub-picture can be said to be a set of data having the four pixel values composed of a plurality of lines. Encoding is performed for each line.

  FIG. 6 is a data structure diagram when a sub-picture is encoded. As shown in FIG. 6, the SPU is run-length encoded. That is, when 1 to 3 pieces of specific pixel data are continued, the number of continuous pixels (No_P) is represented by 2 bits, and then a 2-bit pixel data value (PD) is recorded. When 4 to 15 are consecutive, the first 2 bits are recorded as 0, No_P is recorded with 4 bits, and PD is recorded with 2 bits. When 16 to 63 are consecutive, the first 4 bits are recorded as 0, No_P is recorded as 6 bits, and PD is recorded as 2 bits. When 64 to 255 are consecutive, the first 6 bits are recorded as 0, No_P is recorded as 8 bits, and PD is recorded as 2 bits. When the same pixel continues to the end of the line, the first 14 bits are recorded as 0 and the PD is recorded as 2 bits. In this way, when one line is encoded, 4 bits of 0 are recorded if they are not aligned in byte units. One line of encoded data cannot exceed 1440 bits.

  FIG. 7 shows the data structure of SP_DCSQT. Referring to FIG. 7, SP_DCSQT includes display control information for outputting the PXD data. SP_DCSQT is composed of a plurality of sub-picture display control sequences (SP_DCSQ). One SP_DCSQ is a set of display control commands (SP_DCCMD) executed at one time, and is composed of SP_DCSQ_STM indicating the start time, SP_NXT_DCSQ_SA including position information of the next SP_DCSQ, and a plurality of SP_DCCMDs.

  SP_DCCMD is control information on how the PXD (pixel data) is output in combination with a video image, and includes hue information of pixel data, contrast information with video data, output time, and end time. Contains information.

  FIG. 8 is a diagram illustrating a situation at the time of output in consideration of sub-picture data. Referring to FIG. 8, the pixel data itself is PXD, losslessly encoded, and is a sub-picture display area that is a position where a sub-picture is displayed in a video display area that is an area of a video image. Information on the SP display area and information on output start and end times are included in SP_DCSQT.

  In DVD, sub-picture data for subtitle data of up to 32 languages can be multiplexed and recorded together with moving image data. In this way, each language is classified into a stream ID provided by MPEG system encoding and a substream ID defined by DVD. Therefore, if the user selects one language, the SPU is extracted only for the SP_PCK having the stream ID and the substream ID, then the subtitle data is extracted by decoding, and the output is controlled by the display control command. .

  As described above, subtitle data is multiplexed with moving image data, and various problems occur.

  First, when encoding moving image data, the bit generation amount occupied by sub-picture data must be considered in advance. That is, the amount of data generated for each language varies as the caption data is converted into graphic data and processed, and the amount is also enormous. Usually, the moving image encoding is performed only once, and then in addition to the output, the sub-picture data for each language is multiplexed again to produce a DVD suitable for each region. However, depending on the language, the amount of sub-picture data is enormous, and the total amount of generated bits exceeds the maximum limit when multiplexed with moving image data. In addition, since the sub-picture data is multiplexed between the moving image data, the start position of each VOBU also changes depending on the region. In DVD, since the start position of VOBU is managed separately, this information must be updated every time a multiplexing process is newly started.

  Secondly, since the contents of each sub-picture are not known, it cannot be used for another purpose of outputting two languages at the same time, or outputting only subtitle data that is not for watching a movie and using it for language acquisition.

  An object of the present invention is to provide an information storage medium on which sub-picture data is recorded as a data structure that does not need to consider in advance the bit generation amount occupied by sub-picture data when encoding moving picture data, and an apparatus therefor. .

  Another object of the present invention is to provide a reproducing apparatus and a data recording and / or reproducing apparatus for reproducing data stored in an information storage medium in which sub-picture data is recorded as a data structure that can be used for purposes other than subtitles. It is to be.

  In the information storage medium in which the moving image data is recorded according to the present invention, the object is recorded separately from the plurality of clips in the recording unit in which the moving image data is stored, and based on the moving image data. A subtitle text data that is output as a graphic overlapped on an image, and the subtitle text data includes at least one language data. .

  In the information storage medium in which moving image data is recorded according to the present invention, the object is recorded separately from a plurality of clips as recording units in which the moving image data is stored, and the plurality of clips. Subtitle text data that can be output in a graphic overlapping manner on an image based on the data, and the subtitle text data includes data for providing at least one language subtitle. This is achieved by an information storage medium.

  The information storage medium may further include font data of characters that are recorded separately from the plurality of clips and can be used in the text data for the subtitle for graphic representation of the text data.

  When the subtitle text data is a plurality of language data, it can be recorded in a separate space for each language. The text data for the subtitle may include output synchronization information with the moving image data together with character data converted into graphic data and output. The text data for the subtitle is character data output after being converted into graphic data, and output position information indicating where the graphic data is output when it is overlapped with an image based on the moving image data Can be included. The text data for the subtitle includes character data converted into graphic data and output, and information for displaying graphic data output in one or more sizes when the graphic data overlaps with a moving image Can be included.

  The moving image data is divided into units that can be reproduced continuously, and the subtitle text data corresponding to the one unit may be limited in overall size. The moving image data is divided into playback units that can be played back continuously, and the text data for the subtitle corresponding to one playback unit is divided into a plurality of language sets to form the one language set. The total size of the subtitle text data can be limited.

  Text data constituting the subtitle text data may be expressed and recorded in Unicode for supporting a multilingual character set.

  When the subtitle text data is composed only of characters corresponding to the basic English character set ASCII and the Latin extended character set ISO8859-1, one character is encoded in a plurality of 8-bit units. Can be encoded and recorded using UTF-8.

  The text data for the subtitle is encoded using UTF-16 that encodes one character in a plurality of 16-bit units when a character having a code point value of 2 bytes size is included on Unicode. Can be recorded.

  The information storage medium may be removable. The information storage medium may be an optical disc from which data can be read using an optical device of the reproducing device.

  Meanwhile, according to another field of the present invention, the object is a reproducing apparatus for reproducing an information storage medium on which moving image data is recorded, wherein the information storage medium is a recording unit in which the moving image data is encoded. It is divided into clips and recorded as a plurality of clips, and text data for subtitles output by being overlapped with graphic data on an image based on the moving image data is recorded separately from the clips. The subtitle text data is composed of data of one or more languages, and the playback device includes a data player for reading data from the information storage medium, and a decoder for the encoded moving image data. A renderer for converting the subtitle text data into graphic data, the video data, the graphic data, And blender to make a single image by overlaying a buffer for temporarily storing the video data, also achieved by the reproducing apparatus which comprises a buffer for storing the text data for the subtitles.

  In the information storage medium, font data of characters used in the text data for the subtitle for graphic representation of the text data is recorded separately in a separate space. A buffer for temporarily storing font data is provided, and the renderer may have a function of converting text data of the text data for the subtitle into graphic data using the font data.

  In the case where the subtitle text data is a plurality of language data, the information storage medium is recorded in a separate space for each language, and the playback device can select the user's selection or the initial playback language in the playback device. The subtitle text data for the language specified in the above is temporarily stored in the buffer, font data for converting the subtitle text data into graphic data is temporarily stored in the font buffer, and the video data Simultaneously with reproduction, the subtitle text data can be converted into graphic data and output.

  The playback apparatus further includes a controller that controls the output start time and end time of the text data for the subtitle using synchronization information, and the information storage medium stores the text data for the subtitle as a graphic. The synchronization information that is converted into data and output in an overlapping manner with the image based on the moving image data can be recorded.

  The playback device further includes a controller that controls, based on the output position information, an overlap position of the subtitle text data with an image based on the moving image data, and the information storage medium includes the subtitle text. Character data that is converted into graphic data and output, and output position information that indicates where the graphic data is output when overlapped with the image based on the moving image data. it can.

  The moving image data recorded on the information storage medium is divided into playback units that can be played back continuously, and the subtitle text data corresponding to the playback unit is recorded with a limited overall size. And the playback device stores the size-limited text data for the subtitle before playback of the units that can be played back continuously in the buffer, and when a language change occurs during playback, A function of outputting the subtitle data for the language stored in the buffer can be provided.

  The moving image data recorded on the information storage medium is divided into units that can be reproduced continuously, and the subtitle text data corresponding to the one unit is divided into a plurality of language sets, The subtitle text data making up one language set is recorded with a limited overall size, and the playback device outputs the video data before playing back the units that can be played back continuously. The subtitle text data corresponding to the language set to which the language subtitle data must be stored is stored in the buffer, and when a language change occurs during playback, the subtitle text data for the language is buffered. If there is, the text data for the subtitle for the language is output. Both text data for subtitles whose serial text data for subtitles is corresponding to the language set belonging stored in the buffer may include a function of outputting the text data for the subtitle for the language.

  The information storage medium displays character data obtained by converting the subtitle text data into graphic data, and outputs of a plurality of graphic data when the graphic data overlaps an image based on the moving image data. And information to be recorded.

  In the information storage medium, text data constituting the text data for the subtitle is recorded and expressed in Unicode for supporting a multilingual character set, and the renderer graphically displays characters expressed in Unicode. It can be converted into data.

  In the information storage medium, when the subtitle text data is composed only of characters corresponding to ASCII which is a basic English character set or ISO8859-1 which is a Latin extended character set, one character is a plurality of 8-bit characters. It is encoded and recorded using UTF-8 which is encoded in units, and the renderer can convert characters expressed in UTF-8 into graphic data.

  In the information storage medium, when the text data for the subtitle includes characters having a code point value of 2 bytes on Unicode, UTF-16 for encoding one character in units of a plurality of 16 bits. The renderer may be used to convert characters expressed in the UTF-16 into graphic data.

  The information storage medium is a detachable type that can be easily inserted into and removed from the playback device, and the playback device can read and play back the removable information storage medium.

  The information storage medium is an optical disc from which data can be read using the optical device of the reproducing device, and the reproducing device can read and reproduce data recorded on the optical disc.

The playback device may further include the subtitle data that can be output without playing back the moving image data recorded on the information storage medium, and the renderer may include the one or more subtitle data for language. The above text data for language can be converted into graphic data.

  The subtitle data may be output in an overlapping manner in synchronization with the moving image.

  On the other hand, according to another field of the present invention, the object is a recording device for recording moving image data on an information storage medium, a data output device for recording data on the information storage medium, and output from the data output device. An encoder that encodes the moving image data, a subtitle data generator that generates subtitle data that is output by being added to the moving image data, a central processing unit, a fixed storage device, and a buffer, and the moving image encoder includes: After the moving image is divided into clips as recording units and compressed and encoded, the moving image is stored in the fixed storage device, and the subtitle data generator can reproduce at least one of the plurality of images based on the moving image data. Subtitle data for language is created in a text form and stored in the fixed storage device, the buffer temporarily stores data stored in the fixed storage device, and the data output unit includes: Moving image encoded data and subtitle data temporarily stored in the buffer are recorded on an information storage medium, and the central processing unit encodes the moving image data, the subtitle data generation step, and the encoded moving image data. Also, the present invention can be achieved by a recording apparatus that controls the subtitle text data to be recorded in separate areas of the information storage medium.

  The recording apparatus further includes a font data generator for generating font data for converting the text data for the subtitle into graphic data, and the font data generator converts the text data for the subtitle into a graphic form. The font data necessary for conversion into the fixed storage device is created and stored in the fixed storage device, the buffer temporarily stores the font data stored in the fixed storage device, and the data output device stores the font data in the buffer. Temporarily stored font data is recorded on an information storage medium, and the central processing unit can control the font data generation process so that the font data is recorded in a separate area of the information storage medium.

  When the subtitle text data is a plurality of language data, the central processing unit may be controlled to be recorded in a separate space for each language.

  The caption data generator may generate the caption data including output synchronization information with the moving image reproduction together with character data converted into graphic data and output. The caption data generator includes character data that can be converted into graphic data, and output position information that indicates where the graphic data is output when the graphic data overlaps with an image based on the moving image data. Text data for subtitles can be created.

  The subtitle data generator displays character data that can be converted into graphic data and graphic data output in one or more sizes when the graphic data overlaps with an image based on the moving image data. The subtitle data can be created including the above information.

  The encoded video data is divided into playback units that can be played back continuously, and the caption data generator uses the subtitle data so that the overall size of the caption data corresponding to the playback unit is limited. Text data can be created.

  The encoded video data is divided into reproduction units that can be reproduced continuously, and the caption data generator divides the text data for the subtitle corresponding to the reproduction unit into a plurality of language sets, and The subtitle data composing one language set can create text data for the subtitle so that the overall size is limited.

  The subtitle data generator may express the text data constituting the subtitle text data in Unicode for supporting a multilingual character set.

  When the subtitle text data is composed only of characters corresponding to ASCII which is a basic English character set and ISO8859-1 which is a Latin extended character set, a single character is divided into a plurality of 8-bit units. It can encode using UTF-8 to encode.

  When the text data for the subtitle includes characters having a code point value of 2 bytes on Unicode, the encoder uses UTF-16 that encodes one character in a plurality of 16-bit units. It can be encoded.

  The information storage medium may be removable. The information storage medium may be an optical disk.

  On the other hand, according to another field of the present invention, the objects include reading AV (audio / video) data and text data, rendering subtitle image data from the text data, and decoding the AV data. Reproducing data stored in an information storage medium, comprising: coding and outputting decoded AV data; and blending the subtitle image data and the decoded AV data It is also achieved by the method of doing.

  Meanwhile, according to another field of the present invention, the object is to read out AV data, text data, and font data, a decoder unit that decodes the AV data and outputs moving image data, and the text This can also be achieved by a playback device including a rendering unit that renders subtitle image data from data and a blender that synchronizes the moving image with the subtitle image data.

  On the other hand, according to another field of the present invention, the object is to read out text data and font data, to render a subtitle image data from the text data, and to output the subtitle image data. The present invention is also achieved by a playback device including an output unit and an input receiving unit that receives an input of subtitle data for the next line in order to control an output time of the subtitle data.

  On the other hand, according to another field of the present invention, the object is to store a storage unit, an encoder that encodes AV data and outputs the encoded AV data, and a subtitle generation unit that generates text data that can be rendered. A data recording unit for recording the encoded AV data and the text data that can be rendered in the storage unit; a reading unit for reading the encoded AV data and the text data that can be rendered; In order to output a blended video, a decoder unit for decoding the encoded AV data to create and output the video, a rendering unit for rendering the subtitle image data from the text data that can be rendered, The video data is synchronized with the subtitle image data. A blender unit that also achieved by a data recording and / or reproducing apparatus which comprises a.

  In order to achieve the above object, in the information storage medium according to the present invention, each subtitle data is not encoded in the AV data but is separately recorded in the recording space in the form of separate text data. The information storage medium stores additional font data necessary for rendering the subtitle data in the form of text. In addition, synchronization information for linking with the AV video that has been decrypted and output information for screen output are recorded. The subtitle data corresponds to the sub picture data in the conventional DVD.

That is, the following components are recorded on the information storage medium according to the present invention.
1) AV data (clip) in which video information is compression-encoded
2) Text data for multilingual subtitles 3) Font data for text data rendering

  It is possible to provide an information storage medium in which sub-picture data is recorded as a data structure that can be used for purposes other than captions, and an apparatus therefor.

It is a data structure figure of DVD. It is a detailed structural view of a VMG area. It is a detailed structure figure of a VTS area. It is a detailed structure figure of VOBS which is moving image data. It is a relationship diagram between SPU and SP_PCK. It is a data structure figure when a subpicture is encoded. It is a data structure figure of SP_DCSQT. It is a reference figure which shows the condition at the time of the output which considered subpicture data. 1 is a block diagram of a playback apparatus according to a preferred embodiment of the present invention. FIG. 4 is a structural diagram of text data (eg, subtitle data) stored in an information storage medium according to the present invention. 3 is a preferred embodiment of text data for a subtitle according to the present invention. FIG. 12 is a structural diagram of text data for a language different from the language of FIG. 11. It is an example of the text file used by this invention. It is an example of the subtitles applied in different styles. 12 is an example in which text data for Korean subtitles embodied in FIG. 11 is displayed on an actual screen. It is an example when a user implements a language change during subtitle reproduction of a specific language. It is an example of a language set of a plurality of multilingual subtitle data and font data. It is a correlation diagram of PlayList, PlayItem, Clip Information, and a clip. It is an example of the directory structure by this invention. This is an example in which the playback device outputs only caption data. This is an example in which the playback apparatus outputs one or more subtitle data for language simultaneously. In this example, only subtitle data is reproduced, and reproduction of moving image data is normally started from moving image data corresponding to the subtitle line data. 1 is a block diagram of a recording apparatus according to the present invention.

  Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.

  FIG. 9 is a block diagram of a playback apparatus according to a preferred embodiment of the present invention. Referring to FIG. 9, the playback apparatus includes a reader block for reading AV data, subtitle text data, and download font data stored in an information storage medium, a decoder block for decoding AV data, text It includes a renderer block that renders a file, and a blender block that synthesizes the moving image output from the decoder block and the caption data output from the renderer block.

  At the same time, the playback device is responsible for buffering data between the leader block, the decoder block, and the renderer block, and further includes a buffer block for storing the determined font data. A font data storage block may be provided.

  In the present invention, rendering refers to all necessary actions related to converting subtitle text data into graphic data for display on a display device. That is, in order to construct a subtitle image by repeating the process of searching for fonts matched with character codes for each character from downloaded font data or resident font data read from an information storage medium and converting them into graphics. The graphic data is generated, the hue is specified or converted, the character size is specified or converted, and the graphic data is appropriately generated by horizontal writing or vertical writing. In particular, when the font data to be used is an outline font, the font data defines the form of each character with a curve formula. In such a case, rendering also includes a rasterizing process that processes such a curve equation to produce graphic data.

  FIG. 10 is a structural diagram of text data (eg, subtitle data) stored in the information storage medium according to the present invention. Referring to FIG. 10, text data is recorded separately from the AV stream. Text data is rendered in addition to the text data output for subtitles, and then synchronization information for rendering the video information decoded with the AV stream data and the synchronization are displayed on the screen. Display area information for designating a position to be displayed, character size of rendered subtitle data, horizontal writing or vertical writing, display style box information such as alignment in the display area, hue, and contrast. Moreover, since each text data must be created for each of a plurality of languages, information for representing the language is also included. Such multilingual data may be stored separately in separate spaces, or may be multiplexed according to the time order output regardless of the language and stored in one space.

FIG. 11 is a diagram illustrating a preferred embodiment of text data for subtitles according to the present invention. Referring to FIG. 11, in this embodiment, a markup language is used as text data for a subtitle. The markup language used for the subtitle should use the minimum number of tags or elements in consideration of the usage being subtitles. As mentioned above, the tags for synchronization and screen display are used. Or it may have attributes. Here, subtitle, head, meta, body, and p elements are illustrated. In this embodiment, information is displayed by attribute. The attributes used in the example are:
-Start: When the start time of video playback that must be played back is set to 0, the time when the caption data should be output is the time (HH): minute (MM): second (SS): frame (FF) format Represents the time when the subtitle is displayed. It can be expressed in thousandths of a second. Alternatively, when the moving image data is MPEG video, it may have a PTS (Presentation Time Stamp) value of a video image displayed by overlaying the subtitle. Usually, the PTS value is a counter value operated at 27 MHz or 90 KHz. If the PTS value is used in this way, the operation can be performed in accordance with the video data accurately.

  -End: has an attribute value in the form of start, and displays the time when the displayed subtitle disappears.

  -Position: represents the coordinates of the upper left vertex in the video area of the display area where the caption data is displayed.

  -Direction: represents the direction of the caption data to be displayed.

  -Size: represents the width or height of the display area in which caption data is displayed. If the attribute value of “direction” is “horizontal”, it represents a fixed width value of the caption data box, and if it is “vertical”, it represents a fixed height value of the caption data box.

  In the case of the element used, the subtitle element represents the root of the text data, and includes a meta element that handles information necessary for the entire text data using the head element, or a style element that does not appear in the example of FIG. In this way, the meta element can describe necessary information about the text data using the attributes of name and content. In the case of this implementation ray, the meta element is used to display the title of the text data and the language to be expressed. In other words, the language text file can be conveniently selected by using the meta information in the text data when the multilingual language is selected. Of course, the language may be distinguished by the text file name, or a directory may be separately provided for each language text file in the directory structure and divided by the directory name.

  The subtitle data stored in this way is loaded into the buffer of the playback device before the playback of the moving image, converted into graphic data by the playback of the moving image and the render block, and overlapped with the video image so as to be in a predetermined display area at an accurate time. Expressed. Therefore, the subtitle data is displayed in the reproduction space at an accurate time, for example, Korean. As described above, the text data can be created not only with subtitle character data but also with control information in a certain format or grammar. Therefore, in the case of a renderer block, it is desirable to have a parser function for verifying whether a saved text file has been created with a predetermined grammar. Also, a decoder block using synchronization information included in the text file. In order to synchronize with the moving picture decoded by the above, it is desirable that there is a channel in which the playback time information and the playback status of the decoder block are notified or designated as an event exchange, unlike the decoder block.

  FIG. 12 is a structural diagram of text data for a language different from the language of FIG. Referring to FIG. 12, when the moving image data and the text data are recorded in separate areas as described above, the moving image data is encoded separately from the caption data, and then the encoded moving image data is respectively encoded. Multilingual support can be achieved by simply adding text data in different languages. In addition, when subtitle data and font data that are not stored together with moving image data are downloaded to the information storage medium through the network or loaded into the playback device through the additional information storage medium, the subtitle data to be easily supported can be expanded.

  In this way, when supporting multiple languages, the character code used for text data becomes a problem. In the present invention, Unicode is used as a preferred embodiment. Unicode is a character code created to express a global language of more than 65,000 characters. According to this, each character is represented by a code point occupied in Unicode. A character for representing each language is a set of code points having a constant continuous value. Such a character having a continuous space of code points is called a code chart. In addition, Unicode supports UTF-8, UTF-16, and UTF-32 as encoding forms for actually storing or transmitting the character data, that is, code points, which are respectively 8 bits, 16 bits, This is a method for representing one character by using a plurality of 32-bit data.

  The ISO8859-1 code, which is an extended character for expressing the languages of European countries by extending the ASCII code representing Latin characters and Latin, has a code point value from 0x00 to 0xFF in Unicode. Japanese hiragana characters have values from 0x3040 to 0x309F, and 11172 characters for representing contemporary Korean have values from 0xAC00 to 0xD7AF. Here, 0x means that the code point value is expressed in hexadecimal.

  If the caption data is composed of English characters, it is desirable to encode using UTF-8. If Korean is subtitle data for Japanese, if UTF-8 is used, one character can be expressed by 3 bytes. If UTF-16 is used, it is expressed by 2 bytes. At this time, English characters included in the caption data can also be expressed by 2 bytes.

  Different from Unicode, each country has its own character code. For example, in the KSC5601 character set which is a Korean character code, the Korean character has a 2-byte code point value and the English character has a 1-byte code point value. If the subtitle data is created by using character sets of each country without using Unicode, each playback device must understand all of these character sets, which increases the burden for implementation. .

  In order to process subtitle data with text data, font data is required. In order to support multilingual languages, such font data must support multilingual languages. However, it is substantially difficult to previously have such multilingual support fonts in the playback device. As a result, in the present invention, font data for only the characters used in the information storage medium is recorded in the information storage medium like the subtitle data, and this font data is loaded into the buffer before the moving image is played back by the playback device. And let it be used. That is, the playback device plays back the subtitle text data and the font data connected to each other. Link information between subtitle text data and font data is recorded in the subtitle text data or in a separate area. In consideration of the case where the user changes the language during playback, the playback device loads both the caption data and the font data, which must be guaranteed to be continuously played, into a buffer in the playback device before playback. . Here, continuous playback means continuous playback of moving image data images and audio outputs. Normally, the playback device stores a certain amount of data in the video and audio buffers and performs playback. However, if the underflow of the buffer provided in the playback device is prevented, continuous playback is possible. If the subtitle or font data has to be read again through the reader block during subtitle change during playback, the video and audio data need not be loaded in advance if underflow does not occur at this time.

  FIG. 13 is an example of a text file used in the present invention. Referring to FIG. 13, in this embodiment, a style element is used in a head element in order to use a CSS file format as a style application in a markup language that embodies a text file. By using CSS, subtitle data can use various fonts, sizes, and hues.

  It may be inconvenient for a certain application or a certain user to see the default closed caption style. For example, a visually handicapped person may feel inconvenient because the subtitle text font size is small. Therefore, when applying a style, it is one of the important issues how to apply and display the same text file so that it is suitable for general users or visually impaired people. Therefore, when the user first plays the information storage medium through the playback device, the user can select the style for applying the style according to the user setting by allowing the style such as the font size to be defined through the menu. A style sheet with multiple options may be used.

In the present invention, an @user rule that allows a user to set a caption style is described. In the example of the user type as seen from the set of CSS attributes, it is not a related matter to classify the type of user type, that is, the degree of visual impairment in detail, so only the following two cases are given as examples. :
-Small: style for users with normal vision,
-Large: Style for users with poor vision FIG. 14 is an example of subtitles applied with different styles. As shown in FIG. 14, the style is applied differently for users with good vision or bad users through the menu or user input device, preset in the playback device using @user rules Subtitles can be displayed.

  The playback device may output the position and the size differently depending on the user's preference without using the predetermined position and the font of the predetermined size according to the caption data.

  FIG. 15 is a diagram illustrating an example in which the Korean subtitle text data embodied in FIG. 11 is displayed on the actual screen. Referring to FIG. 15, since the width value of the caption data display area is fixed to 520 by the “size” attribute on the screen displayed by the second <p> element, the caption data that cannot be displayed in one line is broken. displayed. In still another embodiment, the caption data may be output only within the display area, and a line feed may be forcibly specified using a line feed element (br).

  The third <p> element is an example in which the display of the caption data is displayed vertically by the “direction” attribute.

  FIG. 16 shows a case where the user changes the language during the subtitle reproduction of the specific language. Referring to FIG. 16, when such a language change is necessary, the playback device changes the subtitle text data being played back (for example, Korean), and concatenates the font data to change the changed language. Render and output data (for example, English). If subtitle data and font data for this purpose are both loaded in the buffer, continuous reproduction of moving image data is easily possible. If the text data or font data to be changed is not loaded into the buffer, the data must be loaded into the buffer again. At this time, reproduction of moving image data may be paused, stopped, or interrupted.

  If multilingual conversion without pause, stop, or interrupt of video playback is attempted, the size of subtitle data and font data can be limited to the size of each buffer. However, in this case, the number of languages that can be supported is limited. Therefore, the present invention solves this by creating a unit called a language set.

  FIG. 17 shows a language set of a plurality of multilingual subtitle data and font data. Referring to FIG. 17, a plurality of multilingual subtitle data and font data added to one moving image are divided into a plurality of language sets. Subtitle data and font data corresponding to one language set are limited to the size of the buffer or less. The moving image reproduction is started after the language set to which the user selects or the subtitle data of the language selected as the default by the reproducing apparatus is loaded in the buffer before the moving image reproduction starts. When the user changes the language, the subtitle data belonging to this language set is already loaded in the buffer, so that the language can be changed without stopping the moving image reproduction. However, if a change is made to a language that does not belong to this language set, the playback device reloads the subtitle data and font data of that language set into the buffer. In this case, any existing language set data is lost. At this time, there is a possibility that pause, stop, or interrupt may occur in the moving image playback. Thereafter, when the language is changed, the language change operation is performed again according to the relationship between the language and the language set loaded in the buffer. Information about such a language set is recorded on the information storage medium, and the playback apparatus arbitrarily determines the playback apparatus in consideration of the data stored in the information storage medium and the size of the buffer in the playback apparatus. It may be determined.

  The information necessary for reproducing the moving image data and the relationship between the data and the caption data will be described as a preferred embodiment as follows. Clip is used as a recording unit of moving image data, and PlayList and PlayItem are used as playback units.

  In the information storage medium according to the present invention, AV streams are recorded in units of Clips. Usually, Clip is recorded in a continuous space. The AV stream is compressed and recorded in order to reduce the capacity. Therefore, in order to reproduce the compressed AV stream, it is necessary to know the characteristic information of the compressed moving image data. As a result, Clip Information of each Clip is recorded. In Clip Information, there is recorded an Entry Point Map in which the AV attribute of each Clip and the position information of an Entry Point that can be randomly accessed in a certain section unit are recorded. In the case of MPEG, which is widely used in video compression technology, this Entry Point is the position of an I picture for compressing an intra image, and this Entry Point Map is mainly used for a time search to find a point where a certain amount of time has elapsed after the start of playback. Used for

  PlayList is a basic unit of reproduction. A plurality of PlayLists are stored in the information storage medium. One PlayList includes a concatenation of a plurality of PlayItems. The PlayItem corresponds to a part of the Clip, and specifically, is used in a form in which a playback start time and an end time in the Clip are specified. Therefore, the Clip Information is used to specify the partial position in the actual clip. Find out.

  FIG. 18 is a correlation diagram of PlayList, PlayItem, Clip Information, and Clip. Referring to FIG. 18, together with PlayList, PlayItem, Clip Information, and Clip, in the present invention, a plurality of subtitle text data is recorded in each clip in a separate space. A plurality of subtitle data is linked to one clip, and such linkage information can be recorded in Clip Information. Although any clip has a plurality of subtitle data concatenated, any clip may have no subtitle data or only one. When PlayList is played back, PlayItems belonging to the PlayList are played back in sequence, and as a result, any one of a clip linked to each PlayItem and a plurality of subtitle data linked to the clip is rendered. Is output. Normally, since continuous playback is not guaranteed between PlayLists, all the subtitle text data linked before PlayList playback can be loaded into the buffer. In FIG. 18, font data is not separately displayed. Font data is usually produced by language. Therefore, the font data is recorded in a separate space for each language.

  FIG. 19 is an example of a directory structure according to the present invention. Referring to FIG. 19, a clip, Clip Information, PlayList, subtitle text data, and font data are stored in a file, and are divided into separate directories for each type. As shown in the figure, the subtitle text file and font file may be provided in a separate directory from the moving image data.

  The information storage medium according to the present invention is preferably a detachable information storage medium that is not fixed to the playback device and can be inserted and used only during playback. Unlike a large-capacity fixed information storage medium such as a hard disk, a removable information storage medium has a capacity limit. In many cases, a playback apparatus that plays back this also has a buffer of a limited size and a lower-order functional block of limited performance. Accordingly, the subtitle data and the font data used for the subtitle data are recorded on the information storage medium together with the moving image data recorded on the removable information storage medium, and the subtitle data is used at the time of reproduction by the reproduction device. The data that must be prepared in advance for the output of can be minimized. A typical example of such a removable recording medium is an optical disk.

  In the information storage medium according to the present invention, moving image data is stored in a separate space from subtitle text data, and the subtitle text data is data for a plurality of multilingual languages, and a font for outputting subtitle data. When data is provided, the playback device loads only the caption data and font data into the buffer, and then outputs the caption data overlapping with the video image while reproducing the moving image.

  FIG. 20 shows an example where the playback device outputs only caption data. Referring to FIG. 20, the playback device may have a function of outputting only caption data. That is, only the subtitle data that is one of the reproduction special skills and is output in an overlapped manner like the moving image data without reproducing the moving image data is converted into graphic data and output. In such a case, it is used for the purpose of learning a foreign language using subtitle data. In this case, the moving images are not overlapped, only the subtitle data is output, and neither the synchronization information nor the position information is ignored or included, and the playback device includes a plurality of subtitle data on the entire image. Output line data and wait for user input. After appreciating all the output caption data, the user transmits a signal for outputting the caption data of the next line to the playback device to control the output time of the caption data.

  FIG. 21 shows a case where the playback apparatus outputs one or more language caption data simultaneously. Referring to FIG. 21, as an example, the playback device may have a function of simultaneously outputting one or more language caption data when the caption data includes a plurality of languages. At this time, subtitle data to be output to the screen is selected using synchronization information of subtitle data for each language. That is, subtitle data is output according to the output start time order, and when the output time points are exactly the same, they are output classified according to language.

  In this way, it is possible to provide a function of normally starting reproduction of moving image data from moving image data corresponding to the subtitle line data while reproducing only caption data.

  FIG. 22 shows an example in which reproduction of moving image data is normally started from moving image data corresponding to the caption line data while reproducing only the caption data. As shown in FIG. 22, when the user selects one caption line data, the reproduction time corresponding to the line data is re-designated, and the video data corresponding to the time is normally reproduced.

  The recording apparatus according to the present invention is an apparatus for recording moving image data and subtitle data according to the present invention on an information storage medium.

  FIG. 23 is a block diagram of a recording apparatus according to the present invention. Referring to FIG. 23, the recording apparatus includes a central processing unit (CPU), a fixed mass storage device, a moving image encoder, a caption data generator, a font generator, a data output device, and a buffer.

  The moving image encoder, subtitle data generator, and font generator may be configured in software form on the CPU.

  In addition, a moving image input device for inputting moving images in real time may be provided.

  The storage device stores a moving image to be encoded or moving image data encoded by a moving image encoder. At the same time, dialogue and large font data added to the movie are also saved. The caption data generator receives the information for the output time of the caption line data from the video encoder, receives the caption line data from the dialogue data, creates the subtitle data for the caption, and stores it in the fixed storage device To do. The font data generator creates font data including characters used for the subtitle data for subtitles from the large-capacity font data stored in the fixed device, and stores it in the fixed storage device. That is, the font data stored in the information storage medium is a part of the large-capacity font data stored in the fixed storage device. The process of creating data in a form to be stored in the information storage medium is called authoring.

  When the authoring process is completed, the subtitle for subtitles added to the video data belonging to the clip is recorded by dividing the video encoded data stored in the fixed storage device into clips, which are recording units, and recorded on the information storage medium. Record the data in a separate area. At the same time, the font data necessary for converting the caption data into graphic data is recorded in a separate area.

  The moving image data is divided into playback units that can be played back continuously. Usually, the playback unit includes a plurality of clips. In one embodiment, the subtitle data that must be output after being overlapped with a moving image that belongs to one playback unit is limited to a certain size or less together with a plurality of language data. In another embodiment, subtitle data that must be output with overlapping videos belonging to one playback unit is classified into language sets that must be continuously changed for video playback when the language is changed. The subtitle data belonging to one playback unit includes a plurality of language sets, and the subtitle data belonging to one language set is limited to a certain size or less in combination of the plurality of language data.

  The subtitle data includes a character code using Unicode, and the form of data actually recorded can be encoded by the UTF-8 or UTF-16.

  The moving image data, subtitle data for subtitles, and font data recorded in the fixed storage device are temporarily stored in the buffer and recorded on the information storage medium by the data output device. The CPU executes software for controlling each device so as to sequentially perform such functions.

  According to the present invention, text data for multilingual subtitles is converted into text and then recorded separately from the AV stream, so that various subtitle effects can be provided to the user, and at the same time, an easy recording space can be arranged. To do.

  On the other hand, the font data necessary for this is collected by collecting only the characters necessary for the subtitle text and separately storing them in an information storage medium as a minimum size.

Claims (11)

A reading unit for reading AV data, text data, and font data;
A decoder unit for decoding the AV data and outputting moving image data;
A rendering unit for rendering subtitle image data from the text data;
And a blender for synchronizing the moving image with the subtitle image data.   The reproducing apparatus according to claim 1, wherein the reading unit and the decoding unit further include a buffer unit that buffers data between the rendering units.   The playback apparatus according to claim 1, wherein the AV data, the text data, and the font data are stored in an information storage medium that can be read by the reading unit.   2. The playback apparatus according to claim 1, wherein at least one text data and font data are stored in a downloadable database.   The playback apparatus according to claim 1, wherein the AV data is stored in an information storage medium that can be read by the reading unit.   The rendering unit searches for fonts that match each character code in the text data, and the fonts are recorded in one of a downloadable database and a storage unit of the playback device. Item 4. The playback device according to Item 1.   The reproducing apparatus according to claim 1, wherein the text file includes data for one or more languages, and the text data includes information representing one or more languages.   If the text file includes data for one or more languages, the text data is stored as multiplexed data and stored in a separate area for each language. The playback apparatus according to claim 1. A reading unit for reading text data and font data;
A rendering unit for rendering subtitle image data from the text data;
An output unit for outputting the subtitle image data;
A playback apparatus comprising: an input receiving unit that receives an input of subtitle data for a next line in order to control an output time of the subtitle data.   The text data and the font data are composed of a plurality of languages, and the subtitle information includes synchronization information for each language, and subtitle data for two or more languages is output simultaneously. The playback apparatus according to claim 9. A storage unit;
An encoder that encodes AV data and outputs the encoded AV data;
A subtitle generator for generating text data that can be rendered;
A data recording unit that records the encoded AV data and the text data that can be rendered in the storage unit;
A reading unit for reading the encoded AV data and the text data that can be rendered;
A decoder unit for decoding the encoded AV data to produce a moving image and outputting it;
A rendering unit for rendering subtitle image data from the text data that can be rendered;
A data recording and / or reproducing apparatus, comprising: a blender unit for synchronizing the moving image data with the subtitle image data in order to output a blended moving image.

Images