WO2005031739A1 - Support d'enregistrement d'information de sous-titres basees sur des textes correspondant a des donnees av a plusieurs voies de reproduction, et appareil de reproduction, et procede d'enregistrement associees - Google Patents

Support d'enregistrement d'information de sous-titres basees sur des textes correspondant a des donnees av a plusieurs voies de reproduction, et appareil de reproduction, et procede d'enregistrement associees Download PDF

Info

Publication number
WO2005031739A1
WO2005031739A1 PCT/KR2004/002481 KR2004002481W WO2005031739A1 WO 2005031739 A1 WO2005031739 A1 WO 2005031739A1 KR 2004002481 W KR2004002481 W KR 2004002481W WO 2005031739 A1 WO2005031739 A1 WO 2005031739A1
Authority
WO
WIPO (PCT)
Prior art keywords
subtitle
data
information
moving picture
text
Prior art date
Application number
PCT/KR2004/002481
Other languages
English (en)
Inventor
Hyun-Kwon Chung
Sung-Wook Park
Original Assignee
Samsung Electronics Co., Ltd.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from KR1020040004442A external-priority patent/KR20050031847A/ko
Application filed by Samsung Electronics Co., Ltd. filed Critical Samsung Electronics Co., Ltd.
Priority to US10/573,878 priority Critical patent/US7965924B2/en
Publication of WO2005031739A1 publication Critical patent/WO2005031739A1/fr

Links

Classifications

    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/102—Programmed access in sequence to addressed parts of tracks of operating record carriers
    • G11B27/105—Programmed access in sequence to addressed parts of tracks of operating record carriers of operating discs
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B20/00—Signal processing not specific to the method of recording or reproducing; Circuits therefor
    • G11B20/10—Digital recording or reproducing
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/19—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier
    • G11B27/28—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording
    • G11B27/30—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording on the same track as the main recording
    • G11B27/3027—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording on the same track as the main recording used signal is digitally coded
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B2220/00—Record carriers by type
    • G11B2220/20—Disc-shaped record carriers
    • G11B2220/25—Disc-shaped record carriers characterised in that the disc is based on a specific recording technology
    • G11B2220/2537—Optical discs
    • G11B2220/2541—Blu-ray discs; Blue laser DVR discs

Definitions

  • the present invention relates to reproduction of storage medium recording moving picture data, and more particularly, to a storage medium recording subtitle information compatible with a subpicture method of a digital versatile disc (DVD) and a presentation method of a bluray disc, and based on text corresponding to moving picture data having a plurality of playback routes, and a reproducing apparatus and a reproducing method therefor.
  • Background Art [2] Among conventional text-based subtitle technologies there are Synchronized Accessible Media Interchange (SAMI) technology of Microsoft and Real-text technology of RealNetwork.
  • SAMI Synchronized Accessible Media Interchange
  • FIG. 1 is a reference diagram explaining the conventional text-based subtitle technology.
  • FIG. 1 there is a text-based subtitle file corresponding to video stream data, and on the basis of synchronization time information included in a subtitle file, for example ⁇ sync time 00:05>, the subtitle corresponding to video stream data is output.
  • the conventional text-based subtitle information provides a subtitle file structure constructed assuming that continuous video data is reproduced.
  • FIG. 2 is a reference diagram explaining problems of the conventional text-based subtitle technology.
  • FIG. 2 with the conventional text-based subtitle file structure, there is a problem that when multiple story video having a plurality of playback routes is reproduced according to a user input, processing subtitles is impossible as shown in the figure. That is, only story route A can be reproduced, and story route B cannot be reproduced.
  • a storage medium including: moving picture data having a plurality of playback routes; a plurality of subtitle data items corresponding to the playback routes and supporting random search for a subtitle; and mapping information linking the moving picture data and the subtitle data.
  • the subtitle data may include reference offset information indicating reference information to randomly search for a subtitle of a desired time at a high speed and reproduce the subtitle, text data containing subtitle contents that are converted into pixel data and output, style information specifying an output style of the pixel data, and control information to control the output of the converted pixel data.
  • the subtitle of a desired time may be randomly searched for at a high speed among the subtitle data.
  • the reference offset information may include a cell identifier (VOB_ID and CELL_ID) of a video object that is a recording unit of the storage medium, or a start position of a clip that is a recording unit of the storage medium.
  • VOB_ID and CELL_ID cell identifier
  • the subtitle data may be described in the form of a markup language or a binary table.
  • the style information, the control information, and the text information may have respective identifiers for distinguishing each other, and the control information may include indication information indicating the style information and the text information corresponding to the control information, and in order to reduce a search time by integer calculation when random search is performed, the size of each of the style information and the control information may be predetermined and sequentially recorded in a predetermined area.
  • the style information may include at least one among information items on the width and height of the pixel data area, a background color, a time when the pixel data is to be stored and deleted in a buffer memory, a starting point from which subtitle text is rendered line spacing, output direction, bold type and Italic type of subtitle text, line break, color of subtitle text, and information on character code encoding.
  • the control information may include at least one among information items on an area on which the pixel data is to be output on the entire screen, a start point of subtitle text in the area, and a synchronization time indicating when the pixel data is to appear and disappear in synchronization with the moving picture data.
  • the the synchronization time information may be expressed as a lapse time from a reference cell (CELL) of a video object (VOBU) that is reference offset information of the moving picture data, or as a lapse time from a start position of a clip that is reference offset information of the moving picture data.
  • CELL reference cell
  • VOBU video object
  • the synchronization time information may be expressed by using a present time stamp (PTS) time on the basis of a reference time for reproducing moving pictures.
  • PTS present time stamp
  • the subtitle data or mapping information may further include at least one among font information describing the font of subtitle data to be displayed on the screen, information on a producer making the subtitle, packet identifier (PID) information of the subtitle data to distinguish from the moving picture data, and subtitle indication information by language of the subtitle data.
  • font information describing the font of subtitle data to be displayed on the screen
  • information on a producer making the subtitle information on a producer making the subtitle
  • packet identifier (PID) information of the subtitle data to distinguish from the moving picture data information by language of the subtitle data.
  • a reproducing apparatus for reproducing a storage medium on which moving picture data is recorded, the apparatus including: a decoder decoding moving picture data having a plurality of playback routes; and a subtitle processor converting subtitle data corresponding to a predetermined route and selected by using a plurality of subtitle data items corresponding to the playback routes and supporting random search for a subtitle and mapping information linking the moving picture data and the subtitle data, into pixel data, and synchronizing the converted pixel data with the moving picture data and outputting the pixel data.
  • the subtitle processor may include: a text subtitle decoder identifying subtitle data corresponding to the moving picture data of a route to be reproduced by parsing the mapping information, and converting the identified subtitle data into pixel data by parsing the subtitle data; and a graphic controller controlling the pixel data by using the parsed mapping information and subtitle data such that the pixel data is synchronized with the moving picture data and output.
  • the text subtitle decoder may parse reference offset information indicating reference information to randomly search for a subtitle of a desired time at a high speed and reproduce the subtitle, text data containing subtitle contents that are converted into pixel data and output, style information specifying an output style of the pixel data, and control information to control the output of the converted pixel data, and based on the style information, convert the text data into pixel data, and by using the parsed control information, the graphic controller may control such that the converted pixel data is synchronized with the moving picture data and output.
  • the text subtitle decoder may randomly search the subtitle data for the subtitle of a desired time at a high speed by using information on a time elapsed from the reference offset information.
  • the graphic controller may control the converted pixel data to be synchronized with the moving picture data and output.
  • Another method for reproducing data on a storage medium storing moving picture data having a plurality of playback routes, a plurality of subtitle data items corresponding to the playback routes and supporting random search for a subtitle, and mapping information linking the moving picture data and the subtitle data including: reading the subtitle data corresponding to moving picture data of a route to be reproduced by parsing the mapping information; identifying subtitle data of a position to be reproduced according to continuous reproduction or reproduction by random search, by parsing the subtitle data, and converting the subtitle data into pixel data; and synchronizing the converted pixel data with the moving picture data and outputting the pixel data.
  • FIG. 1 is a reference diagram explaining the conventional text-based subtitle technology
  • FIG. 2 is a reference diagram explaining problems of the conventional text-based subtitle technology
  • FIG. 3 is a reference diagram explaining text-based subtitle information corresponding to moving picture data having a plurality of playback routes according to a preferred embodiment of the present invention
  • FIGS. 4 through 10 are diagram explaining mapping information of moving picture data and subtitle data having a plurality of playback routes and the structure of subtitle data according to a preferred embodiment of the present invention
  • FIGS. 11 through 17 are diagrams explaining an implementation example of mapping information and subtitle data implemented on a DVD disc as a preferred embodiment of the present invention
  • FIGS. 18 through 24 are diagrams explaining an implementation example of mapping information and subtitle data implemented on a bluray disc as another preferred embodiment of the present invention
  • FIG. 18 through 24 are diagrams explaining an implementation example of mapping information and subtitle data implemented on a bluray disc as another preferred embodiment of the present invention.
  • FIG. 4 is a diagram explaining mapping information of moving picture data and subtitle data having a plurality of playback routes according to a preferred embodiment of the present invention
  • FIG. 5 is a diagram explaining subtitle indication information by language corresponding to moving picture data having a plurality of playback routes according to a preferred embodiment of the present invention
  • FIG. 6 is a diagram explaining the structure of subtitle data according to a preferred embodiment of the present invention
  • FIG. 7 is a diagram explaining a usage example of each field of subtitle data having the data structure of FIG. 6
  • FTG. 8 is a diagram explaining the structure of a reproducing apparatus according to a preferred embodiment of the present invention
  • FIG. 9 is a diagram explaining the structure of a subtitle processor of FIG.
  • FIG. 10 is a flowchart of the steps performed by a reproducing method for providing subtitle information based on text corresponding to moving picture data having a plurality of playback routes according to a preferred embodiment of the present invention
  • FIG. 11 is a diagram explaining the data structure of mapping information shown in FIG. 4 implemented on a DVD disc as an embodiment of the present invention
  • FIG. 12 is a diagram showing an example of mapping information shown in FIG. 11 implemented by using a markup language on a DVD disc as an embodiment of the present invention
  • FIG. 13 is a diagram showing an example of the mapping information described in the form of a table implemented on a DVD disc as an embodiment of the present invention
  • FIG. 10 is a flowchart of the steps performed by a reproducing method for providing subtitle information based on text corresponding to moving picture data having a plurality of playback routes according to a preferred embodiment of the present invention
  • FIG. 11 is a diagram explaining the data structure of mapping information shown in FIG. 4 implemented on a DVD disc as an embodiment of the present invention
  • FIG. 14 is a diagram explaining the structure of subtitle data shown in FIG. 6 implemented on a DVD disc as an embodiment of the present invention
  • FIGS. 15A and 15B are diagrams showing an example of subtitle data implemented on a DVD disc displayed on a screen as a preferred embodiment of the present invention
  • FIG. 16 is a diagram showing an example of subtitle data implemented by a markup language on a DVD disc as an embodiment of the present invention
  • FIG. 17 is a diagram showing an example of subtitle data implemented in the form of a binary table on a DVD disc as an embodiment of the present invention
  • FIG. 18 is a diagram explaining the data structure of mapping information shown in FIG. 4 implemented on a bluray disc as another embodiment of the present invention
  • FIG. 15A and 15B are diagrams showing an example of subtitle data implemented on a DVD disc displayed on a screen as a preferred embodiment of the present invention
  • FIG. 16 is a diagram showing an example of subtitle data implemented by a markup language on a DVD disc as an embodiment of the present invention
  • FIG. 17 is
  • FIG. 19 is a diagram showing an example of mapping information shown in FIG. 18 implemented by using a markup language on a bluray disc as another embodiment of the present invention.
  • FIG. 20 is a diagram showing an example of the mapping information described in the form of a table implemented on a bluray disc as another embodiment of the present invention.
  • FTG. 21 is a diagram explaining the structure of subtitle data shown in FIG. 6 implemented on a bluray disc as another embodiment of the present invention.
  • FIGS. 22A and 22B are diagrams showing an example of subtitle data implemented on a bluray disc displayed on a screen as another preferred embodiment of the present invention.
  • FTG. 23 is a diagram showing an example of subtitle data implemented by a markup language on a bluray disc as another embodiment of the present invention.
  • FIG. 24 is a diagram showing an example of subtitle data implemented in the form of a binary table on a bluray disc as another embodiment of the present invention. Best Mode
  • FIGS. 3 through 10 are diagram explaining mapping information of moving picture data and subtitle data having a plurality of playback routes and the structure of subtitle data according to a preferred embodiment of the present invention.
  • FIGS. 11 through 17 are diagrams explaining an implementation example of mapping information and subtitle data implemented on a DVD disc as a preferred embodiment (1) of the present invention.
  • FIGS. 18 through 24 are diagrams explaining an implementation example of mapping information and subtitle data implemented on a bluray disc as another preferred embodiment (2) of the present invention.
  • the storage medium has a structure including moving picture data having a plurality of playback routes for multiple story playback, a plurality of subtitle data items corresponding to the plurality of playback routes and supporting random search for a subtitle, and mapping information linking the moving picture data and subtitle data described above.
  • FIG. 3 is a reference diagram explaining text-based subtitle information corresponding to moving picture data having a plurality of playback routes according to a preferred embodiment of the present invention.
  • FTG. 4 is a diagram explaining mapping information of moving picture data and subtitle data having a plurality of playback routes according to a preferred embodiment of the present invention.
  • mapping information for linking moving picture data having a plurality of playback routes and a plurality of subtitle data corresponding to the moving picture data in order to support multiple story playback. That is, mapping information on the left hand side includes indication information for subtitle data items (A through C) corresponding to each video data items (A through C). According to this, whichever a user selects between playback A route and playback B route, video data and the corresponding subtitle can be output continuously.
  • FTG. 5 is a diagram explaining subtitle indication information by language corresponding to moving picture data having a plurality of playback routes according to a preferred embodiment of the present invention.
  • subtitle indication information by language indicates related mapping information for individual subtitle languages supported.
  • mapping information indicates a plurality of subtitle data items corresponding to a plurality of playback routes, respectively, as described above with reference to FIG. 4.
  • Korean subtitle is selected by a user selection, or as a set default, by the pointer of related mapping indication information
  • subtitle/video mapping information Y supporting Korean subtitle is linked.
  • a plurality of subtitle data A through C written in the corresponding language Y, that is, in Korean are linked to A through C video data items having a plurality of playback routes included in subtitle/video mapping information Y, respectively. Accordingly, multiple language subtitles are supported and at the same time, multiple story playback of moving picture data having a plurality of playback routes is enabled.
  • FTG. 6 is a diagram explaining the structure of subtitle data according to a preferred embodiment of the present invention.
  • FIG. 6 shown is the structure of a plurality of subtitle data linked by related subtitle indication information included in the subtitle/video mapping information described above with reference to FTG. 4.
  • the subtitle data includes header information, reference offset information, time information and/or text information.
  • header information is information on the entire subtitle data and may include position information of a subtitle to be displayed on a screen, and international standard record code (hereinafter referred to as ISRC) as information on a producer or a support language code.
  • ISRC international standard record code
  • Reference offset information is reference information for randomly searching for a subtitle of a desired time at a high speed and reproducing the subtitle.
  • a cell identifier (VOB_ID and CELLJD) of a video object (VOBU) used as a recording unit of a DVD storage medium, or the starting point of a clip used as a recording unit of a bluray disc storage medium can be used as reference offset information.
  • Synchronization time information synchronizing a subtitle with video data can be expressed as a lapse time from a starting point of a reference cell of a VOBU or a clip that is reference offset information of moving picture data.
  • synchronization time information can be expressed by using a presentation time stamp (hereinafter referred to as PTS) time on the basis of a reference time for reproducing moving pictures.
  • PTS presentation time stamp
  • Text information indicates text data containing subtitle contents to be converted into pixel data to present a bitmap image of the text subtitle and output.
  • the text information may include style information specifying the output style of pixel data and control information for controlling the output of the converted pixel data.
  • style information and control information will be explained later.
  • FTG. 7 is a diagram explaining a usage example of each field of subtitle data having the data structure of FIG. 6.
  • subtitle data includes position information of a subtitle to be displayed on a screen, a language code and/or ISRC information as header information.
  • the subtitle data includes a plurality of synchronization time information items synchronizing the subtitle with video data, and a plurality of text information items of a subtitle to be used as subtitle contents.
  • the subtitle data includes reference offset information for random search for a subtitle, and each reference offset information item indicates an immediate next reference offset information item. Accordingly, by using reference offset information, a subtitle can be searched for at a high speed and synchronization time information for synchronizing a subtitle with video data can also be expressed by a lapse time from reference offset information.
  • the storage medium according to the present invention as described above includes moving picture data having a plurality of playback routes, a plurality of subtitle data corresponding to the plurality of playback routes, and subtitle/video mapping information for multiple story playback.
  • subtitle data includes reference offset information for high speed random search.
  • subtitle indication information by language can be further included.
  • the subtitle/video mapping information, subtitle data, and subtitle indication information by language above described can be recorded as files separate from moving picture data, and can be recorded on an identical storage medium on which moving picture data is recorded, or can be recorded separately in a server or the like on the Internet.
  • FIG. 8 is a diagram explaining the structure of a reproducing apparatus according to a preferred embodiment of the present invention.
  • the reproducing apparatus includes a reading unit 810, a decoder 830, a subtitle processor 840, and a blender 850. Also, the reproducing apparatus may further include a buffer unit 820 temporarily storing data for buffering data.
  • the reading unit 810 reads each data item having the data structure described above from a storage medium or from the Internet 800, and depending on the type of each data item, store the data in a corresponding buffer unit 820. That is, AV stream data is stored in a moving picture data buffer 822, a plurality of subtitle data items corresponding to a plurality of playback routes (Refer to FIG. 6) are stored in a subtitle data buffer 824, and subtitle/video mapping information (Refer to FIG. 4) and subtitle indication information by language (Refer to FTG. 5) are stored in the corresponding buffer 826. Furthermore, font information of a subtitle is stored in a default font buffer 828. Meanwhile, a resident font buffer 842 storing a resident font read from a storage medium or from the Internet and residing on a memory can also be disposed
  • the decoder 830 decodes video stream data stored in the moving picture data buffer 822 and transmits moving pictures to be output to the blender 850.
  • the subtitle processor 840 generates a graphic image of a subtitle to be overlaid on moving pictures to be output, and controls the output of a subtitle to be synchronized with video data.
  • the subtitle processor 840 receives subtitle data from the subtitle data buffer 824, receives mapping information from the subtitle/video mapping information buffer 826, and identifies subtitle data corresponding to moving picture data corresponding to a selected language and a selected story route.
  • the subtitle processor 840 converts (or renders) the subtitle data into pixel data for a bitmap image and transmits the pixel data to the blender 850.
  • style information included in the subtitle data the output style of the subtitle can be controlled, and by using control information included in the subtitle data, an output time can be controlled to be synchronized with video data.
  • Font information stored in the default font buffer 828 and/or the resident font buffer 842 can be used. A detailed structure of the subtitle processor 840 will be explained later.
  • Rendering in the present invention indicates all required activities related to converting subtitle text data into graphic data to express the text data on a display apparatus. That is, it indicates all processes for finding a font matching a character code of each character in text data, from download font data read from an information storage medium, or from the resident font data, converting into a graphic, and outputting on a screen.
  • the blender 850 receives decoded video data from the decoder 830, receives converted pixel data from the subtitle processor 840, overlays the pixel data of a subtitle on an image based on the video data, and outputs to the display apparatus 860.
  • FTG. 9 is a diagram explaining the structure of the subtitle processor 840 of FIG. 8 in detail.
  • the subtitle processor 840 includes a text subtitle decoder 902 and a graphic controller 904.
  • the text subtitle decoder 902 receives subtitle data, subtitle/video mapping information, other language information, and font information from the buffers 824 and 826 described above, parses subtitle/video mapping information, identifies subtitle data corresponding to moving picture data of a route to be reproduced, parses the identified subtitle data, and converts the subtitle data into pixel data for a bitmap image graphic.
  • the graphic controller 904 controls an output time and position of the converted pixel data such that the converted pixel data is output synchronized with moving picture data.
  • the text subtitle decoder 902 decodes subtitle data, and parses reference offset information indicating reference information for randomly searching at a high speed for a subtitle of a desired time among subtitle data, and reproducing the subtitle, text data including subtitle contents to be converted into pixel data and then output, style information specifying an output style of pixel data and control information for controlling the output of converted pixel data. Also, based on the parsed style information, text data is converted into pixel data.
  • the graphic controller 904 controls based on the parsed control information such that the converted pixel data is synchronized with moving picture data and output.
  • An output time point or an output position can be included in control information.
  • FTG. 10 is a flowchart of the steps performed by a reproducing method for providing subtitle information based on text corresponding to moving picture data having a plurality of playback routes according to a preferred embodiment of the present invention.
  • a subtitle indication information item corresponding to a language selected by a user or set as a default in a reproducing apparatus is read among subtitle indication information by language (Refer to FIG. 5) in step 1002.
  • linked subtitle/video mapping information is read in step 1004.
  • subtitle data linked to video data of a route to be reproduced is read in step 1006.
  • pixel data for a bitmap image graphic is generated in step 1008.
  • the generated pixel data is output in step 1010.
  • subtitle indication information by language, subtitle/video mapping information, or subtitle data can be recorded on an identical storage medium on which moving picture data is recorded, or can be disposed on the Internet separately, and in the latter case, the address on the Internet can be stored on a storage medium.
  • mapping information and subtitle data implemented on a DVD disc as an embodiment (1) of the present invention will now be explained.
  • VMG video manager
  • VTS video title sets
  • VOBS video object set
  • a VOB is formed with a plurality of Cells, and each cell is formed with a plurality of video object units (VOBUs).
  • VOBUs video object units
  • VOBU_VOB_IDN information and VOBU_C_IDN information are recorded such that a video object to which a current VOBU unit belongs and identifier of a Cell (VOB D and CELL D) can be known.
  • C_ELTM information is recorded such that a relative reproduction time from the first video frame of a Cell to which a current VOBU belongs, to the first video frame of the current VOBU can be known.
  • FTG. 11 is a diagram explaining the data structure of mapping information shown in FIG. 4 implemented on a DVD disc as an embodiment (1) of the present invention.
  • a storage medium includes a video object VOB that is a recording unit of moving picture data of a DVD and indication information on subtitle data linked to the VOB.
  • Subtitle/video mapping information on the left hand side includes indication information indicating a VOBS linked to at least one or more subtitles. Also, information indicating linking relations between VOBSs is also included.
  • At least one is included among language information on which language is used to generate subtitle data, screen display title information of a subtitle, information on at least one or more fonts, ISRC code information of a producer who made subtitles, color table information to be used for a background color and foreground color of a subtitle character, and stream number information of a text subtitle to distinguish it from subtitle stream data of a subpicture method in AV stream data that is moving picture data.
  • the stream number information of a text subtitle may include, for example, a number set to SPRM (2), which is a system register of a reproducing apparatus.
  • FTG. 12 is a diagram showing an example of mapping information shown in FTG. 11 implemented by using a markup language on a DVD disc as an embodiment (1) of the present invention.
  • video object 1 in ⁇ vmg_vobs> tag is linked to a subtitle data file 1202
  • video object 1 in ⁇ vtms_vobs> tag is linked to a subtitle data file 1204
  • video object 1-9 in ⁇ vtstt_vobs> tag is linked to a subtitle data file 1206, file://english_ttlvobl.text.
  • language information, title information, font information, ISRC information, stream IDs, and color table information are included.
  • the example here uses the XML method but other encoding methods can also be used for presentation. That is, in the present invention, which data should be used is of importance, and the method for expressing data can be performed by selecting to use a markup language, or a binary table, or another method. Data that can be included in subtitle/video mapping information can be arranged as follows.
  • FTG. 13 is a diagram showing an example of the mapping information described in the form of a table implemented on a DVD disc as an embodiment (1) of the present invention.
  • position information 1302, 1304, and 1306 of subtitle data corresponding to a video object is included.
  • language information, title information, font information, ISRC information, color table information, and stream ID information can be included.
  • subtitle data displayed overlapping a video image is encoded in the same manner as 2-dimensional graphic data is encoded. That is, in the case of a DVD, a separate encoding method to support multiple languages is not employed, and each subtitle data is converted into pixel data for a bitmap image graphic, and then the pixel data is processed by one encoding method and recorded.
  • Graphic data for a subtitle is referred to as a subpicture.
  • a subpicture is formed with a subpicture unit (SPU) corresponding to one sheet of graphic data.
  • SPU subpicture unit
  • output control information to output pixel data output starting time information, color information of pixel data, information on contrast with video data, and information on an output time and a finish time are included.
  • FTG. 14 is a diagram explaining the structure of subtitle data shown in FTG. 6 implemented on a DVD disc as an embodiment (1) of the present invention.
  • subtitle data according to an embodiment (1) of the present invention includes header information, reference offset information, time information and/or text information.
  • the reference offset information is reference information to randomly search for a subtitle of a desired time at a high speed and reproduce the subtitle, and uses the cell identifier (VOB DN and CELLJDN) of the video object (VOB) described above, which is used as a recording unit of a DVD storage medium.
  • synchronization time information a lapse time from a starting time point of a reference cell is used.
  • synchronization time information can be expressed by using a presentation time stamp (PTS) time on the basis of a reference time to reproduce moving pictures.
  • style information specifying the output style of pixel data and control information for controlling output of converted pixel data can be included. The style information and control information will be explained later.
  • FIGS. 15A and 15B are diagrams showing an example of subtitle data implemented on a DVD disc displayed on a screen as a preferred embodiment (1) of the present invention.
  • a DVD pixel data is losslessly coded and information on a position at which a subpicture of a subtitle is displayed (SP display area) in an area to display the entire screen, and information for controlling an output start time and finish time, an output direction, and line spacing are included.
  • subpicture data for subtitle data of a maximum of 32 different languages can be multiplexed together with moving picture data and recorded. Each language is distinguished by a stream id provided by the MPEG system coding method, and a sub stream id defined by the DVD.
  • the corresponding subpicture unit (SPU) is extracted by taking only subpictures (SP_PCK) having the stream id and sub stream id corresponding to the language, and then, by decoding the subpicture unit (SPU), subtitle data is extracted and according to output control information, the output is controlled.
  • SP_PCK subpictures
  • FIGS. 15A and 15B the method for displaying a text-based subtitle according to the present invention constructed to have compatibility with the subpicture method of a DVD disc is shown.
  • the subtitle data described with reference to FIG. 14 is parsed by the subtitle processor 840 of FIG. 8 and converted into pixel data having an output image as shown in FIGS. 15A and 15B, and transferred to the blender 850. Accordingly, the reproducing apparatus according to the present invention can receive the pixel data for a bitmap image according to the present invention as the conventional bitmap-based subpicture data, synchronize it with video data and output on the screen. As a result, without modifying the structure of the conventional decoder 830, a subtitle can be processed to be compatible with the conventional subpicture method.
  • the text-based subtitle data according to the present invention has the following structure in order to be compatible with the subpicture method of a DVD as described above.
  • FTG. 16 is a diagram showing an example of subtitle data implemented by a markup language on a DVD disc as an embodiment (1) of the present invention.
  • a storage medium uses a video object number (VOBJDN), a cell number (CELLJDN), and a lapse time from a cell (time) as reference offset information (1600). Also, information indicating next reference offset information (next) is included.
  • VOBJDN video object number
  • CELLJDN cell number
  • time a lapse time from a cell
  • text information including the contents of a subtitle and style information indicating an output style are included (1602 and 1606).
  • control information for outputting pixel data obtained by converting a text subtitle after synchronization with video data is also included (1604 and 1608).
  • information on the width and height of a pixel data area to indicate the size of the pixel data is recorded.
  • information on the color of a background screen of pixel data rendering subtitle text is recorded.
  • time information on when pixel data is to be generated and deleted in the buffer memory of pixel data is included.
  • information on a starting point from which the first line of subtitle text begins is included.
  • information on line spacing when a plurality of lines of subtitle text are output is included in style information included in subtitle data according to the present invention.
  • the subtitle processor 830 parses style information in subtitle data having the information described above and controls the output style of subtitle text.
  • control information is included.
  • position information ((Xs, Ys), (Xe, Ye)) specifying an area to be actually output on the screen among pixel data, information on a starting point in a pixel data area corresponding to the first starting point of a text subpicture display area (Text SP Display Area) shown in FTG. 15 A, and time information on when the bitmap image of pixel data appears and disappears on the screen are recorded.
  • VOB_IDN video object number
  • CELLJDN cell number
  • ⁇ text> tag indicates style information and subtitle text information and ⁇ pixmap> tag indicates control information for outputting pixel data.
  • ⁇ pixmap> tag or ⁇ text> tag a lapse time from a Cell or PTS time information calculated from the standard time clock (STC) described above is appropriate.
  • 'start' information of ⁇ text> tag indicates address information of a starting point from which text is rendered
  • 'start' information of ⁇ pixmap> tag indicates information on an address from which pixel data is to be output.
  • synchronization time information for outputting subtitle data synchronized with video data can be expressed as a lapse time from a reference cell of a video object, and in particular, screen output time (Presentation Time Stamp, PTS) information based on a STC used by a reproducing apparatus to reproduce video data can be used.
  • PTS Presentation Time Stamp
  • FIG. 16 uses the XML method, but this is just an example and the contents of subtitle data including style information and control information, reference offset information and header information, described above can be expressed by other encoding methods.
  • subtitle data is expressed by a binary table method, not by the XML method will now be explained.
  • FTG. 17 is a diagram showing an example of subtitle data implemented in the form of a binary table on a DVD disc as an embodiment (1) of the present invention.
  • Subtitle data according to the present invention includes style information 1710, control information 1720, and text information 1730, and includes header information indicating starting positions of these information items.
  • each of the style information and control information to have a predetermined size and to be stored sequentially in a predetermined area, search time for random search and reproduction can be reduced compared to the conventional XML structure such as SAMI technology and Real-text technology, such that efficiency of search is enhanced.
  • mapping information and subtitle data implemented on a bluray disc as another embodiment (2) of the present invention will now be explained.
  • FTG. 18 is a diagram explaining the data structure of mapping information shown in FIG. 4 implemented on a bluray disc as another embodiment (2) of the present invention.
  • a storage medium includes a clip that is a recording unit of moving picture data of a bluray disc and indication information indicating subtitle data 1802 linked to the clip.
  • Subtitle/video mapping information on the left hand side includes indication information indicating a clip linked to at least one or more subtitles. Besides, at least one among language information on which language is used for subtitle data, screen display title information of a subtitle, information on at least one or more fonts, ISRC code information of a producer making the subtitle, color table information to be used for a background color and a foreground color of a subtitle character, and information on a packet identifier (hereinafter referred to as PID) number of a text subtitle to distinguish from subtitle stream data in the subpicture method in AV stream data that is moving picture data is included.
  • PID number information of a text subtitle can include, for example, a number set to PSR (2), which is a Player Status Register.
  • FTG. 19 is a diagram showing an example of mapping information shown in FTG. 18 implemented by using a markup language on a bluray disc as another embodiment (2) of the present invention.
  • subtitle clip file 0001 in ⁇ blu-ray-video> tag is linked to subtitle data file 1902, 'english_0001.text'.
  • language information, title information, font information, ISRC information, information on the PID number of a subtitle, and color table information are included.
  • the example here uses the XML method but other encoding methods can also be used for presentation. That is, in the present invention, which data should be used is of importance, and the method for expressing data can be performed by selecting to use a markup language, or a binary table, or another method.
  • Data that can be included in subtitle/video mapping information can be arranged as follows.
  • FTG. 20 is a diagram showing an example of the mapping information described in the form of a table implemented on a bluray disc as another embodiment (2) of the present invention.
  • position information of subtitle data corresponding to a video clip is included (2002). Besides, language information, title information, font information, ISRC information, color table information, and stream ID information can be included.
  • FTG. 21 is a diagram explaining the structure of subtitle data shown in FTG. 6 implemented on a bluray disc as another embodiment (2) of the present invention.
  • subtitle data according to another embodiment (2) of the present invention includes header information, reference offset information, time information and/or text information.
  • Header information and text information are the same as explained with reference to FIG. 6.
  • the reference offset information is reference information to randomly search for a subtitle of a desired time at a high speed and reproduce the subtitle, and uses reproduction time information (presentation time stamp, PTS) of the start position of a clip described above, which is used as a recording unit of a bluray disc storage medium.
  • reproduction time information presentation time stamp, PTS
  • PTS presentation time stamp
  • synchronization time information a relative time to a starting time point of reproduction of a clip is used.
  • synchronization time information can be expressed by using a presentation time stamp (PTS) time on the basis of a reference time to reproduce moving pictures.
  • style information specifying the output style of pixel data and control in- formation for controlling output of converted pixel data can be included.
  • the style information and control information will be explained later.
  • FIGS. 22A and 22B are diagrams showing an example of subtitle data implemented on a bluray disc displayed on a screen as another preferred embodiment (2) of the present invention.
  • the subtitle data described with reference to FIG. 21 is parsed by the subtitle processor 840 of FIG. 8 and converted into pixel data having an output image as shown in FIGS. 22 A and 22B, and transferred to the blender 850.
  • the reproducing apparatus according to the present invention can receive the pixel data for a bitmap image according to the present invention as the conventional bitmap-based presentation data of a bluray disc, synchronize it with video data and output on the screen.
  • a subtitle can be processed to be compatible with the conventional presentation method of a bluray disc.
  • the text-based subtitle data according to the present invention has the following structure in order to be compatible with the presentation method of a bluray disc as described above.
  • FTG. 23 is a diagram showing an example of subtitle data implemented by a markup language on a bluray disc as another embodiment (2) of the present invention.
  • a storage medium uses the reproduction start time point (sync-offset value) of a video clip. Also, information indicating next reference offset information (next) is included.
  • text information including the contents of a subtitle and style information indicating an output style are included (2302 and 2306).
  • control information for outputting pixel data obtained by converting a text subtitle after synchronization with video data is also included (2304 and 2308).
  • style information described with reference to FTG. 16 is included in the text-based subtitle data according to the present invention.
  • the subtitle processor 830 parses style information in subtitle data having the information described above and controls the output style of subtitle text.
  • control information specifying an area to be actually output on the screen among pixel data, information on a starting point (pixmap position) in a pixel data area corresponding to the first starting point of a text subpicture display area (Text SP Display Area) shown in FIG. 22A, and time information (composition begin end) on when the bitmap image of pixel data appears and disappears on the screen are recorded.
  • subtitle data information for outputting a subtitle in which a reproduction start time of a clip is '0' is shown. That is, by using the reproduction start time information of a clip that is reference offset information, when text-based subtitle data is randomly searched for, retrieval can be quickly performed.
  • ⁇ text> tag indicates style information and subtitle text information and ⁇ composition> tag indicates control information for outputting pixel data.
  • ⁇ composition> tag or ⁇ text> tag a lapse time from a reproduction start time of a clip or PTS time information calculated from the standard time clock (STC) described above is appropriate.
  • 'start' information of ⁇ text> tag indicates address information of a starting point from which text is rendered
  • 'position' information of ⁇ pixmap> tag indicates information on an address from which pixel data is to be output.
  • synchronization time information for outputting subtitle data synchronized with video data can be expressed as a relative time on the basis of the reproduction start time point of a video clip, and in particular, screen output time (Presentation Time Stamp, PTS) information based on a STC used by a reproducing apparatus to reproduce video data can be used.
  • PTS Presentation Time Stamp
  • FIG. 23 uses the XML method, but this is just an example and the contents of subtitle data including style information and control information, reference offset information and header information, described above can be expressed by other encoding methods.
  • subtitle data is expressed by a binary table method, not by the XML method will now be explained.
  • FTG. 24 is a diagram showing an example of subtitle data implemented in the form of a binary table on a bluray disc as another embodiment (2) of the present invention.
  • Subtitle data according to the present invention includes style information 2410, control information 2420, and text information 2430, and includes header information indicating starting positions of these information items. The detailed structure is explained above with reference to FIG. 17.
  • each of the style information and control information to have a predetermined size and to be stored sequentially in a predetermined area, search time for random search and reproduction can be reduced compared to the conventional XML structure such as SAMI technology and Real-text technology, such that efficiency of search is enhanced.
  • the present invention can also be embodied as computer readable codes on a computer readable recording medium.
  • the computer readable recording medium is any data storage device that can store data which can be thereafter read by a computer system. Examples of the computer readable recording medium include read-only memory (ROM), random-access memory (RAM), CD-ROMs, magnetic tapes, floppy disks, optical data storage devices, and carrier waves (such as data transmission through the Internet).
  • ROM read-only memory
  • RAM random-access memory
  • CD-ROMs compact discs
  • magnetic tapes magnetic tapes
  • floppy disks optical data storage devices
  • carrier waves such as data transmission through the Internet
  • subtitle information compatible with a bitmap image method such as the subpicture method of a DVD and the presentation method of a bluray disc, and based on text corresponding to moving picture data having a plurality of playback routes can be provided.

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Television Signal Processing For Recording (AREA)
  • Signal Processing For Digital Recording And Reproducing (AREA)

Abstract

L'invention porte: sur un support d'enregistrement d'informations de sous-titres basées sur des textes correspondant à des données d'images animées à plusieurs voies de reproduction; sur un appareil de reproduction, et sur la méthode d'enregistrement associée. Ledit support d'enregistrement peut comporter: des données d'images animées à plusieurs voies de reproduction: des groupes de données de sous-titres correspondant aux différentes voies de reproduction et à recherche aléatoire des sous-titres; et des informations faisant correspondre les données d'images animées aux données de sous-titres. Il est ainsi possible d'assurer la compatibilité avec la méthode des mémoires graphiques (traitement des sous-titres de DVD ou de disques Bluray), et de reproduire de multiples histoires. De plus, lorsqu'on procède à une recherche aléatoire ou à une reproduction, le temps de recherche des données de sous-titres est réduit, d'où un meilleur rendement.
PCT/KR2004/002481 2003-09-30 2004-09-24 Support d'enregistrement d'information de sous-titres basees sur des textes correspondant a des donnees av a plusieurs voies de reproduction, et appareil de reproduction, et procede d'enregistrement associees WO2005031739A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US10/573,878 US7965924B2 (en) 2003-09-30 2004-09-24 Storage medium for recording subtitle information based on text corresponding to AV data having multiple playback routes, reproducing apparatus and method therefor

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
KR10-2003-0067919 2003-09-30
KR20030067919 2003-09-30
KR1020040004442A KR20050031847A (ko) 2003-09-30 2004-01-20 복수의 재생경로를 가지는 동영상 데이터에 대한 텍스트기반의 자막 정보가 기록된 저장 매체, 재생 장치 및 그재생 방법
KR10-2004-0004442 2004-01-20

Publications (1)

Publication Number Publication Date
WO2005031739A1 true WO2005031739A1 (fr) 2005-04-07

Family

ID=34395706

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2004/002481 WO2005031739A1 (fr) 2003-09-30 2004-09-24 Support d'enregistrement d'information de sous-titres basees sur des textes correspondant a des donnees av a plusieurs voies de reproduction, et appareil de reproduction, et procede d'enregistrement associees

Country Status (1)

Country Link
WO (1) WO2005031739A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2148332A1 (fr) * 2003-10-01 2010-01-27 Samsung Electronics Co., Ltd. Procédé de reproduction des sous-titres textuels utilisant les informations de contrôle indiquant les instants pour lesquels les données de pixel sont générées et supprimées dans une mémoire tampon

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5497241A (en) * 1993-10-29 1996-03-05 Time Warner Entertainment Co., L.P. System and method for controlling display of motion picture subtitles in a selected language during play of a software carrier
US20010053280A1 (en) * 1996-04-12 2001-12-20 Kazuhiko Yamauchi Optical disc storing both video titles provided with AV functions and video titles with no such functions which can instantly distinguish between such kinds of titles, and a reproduction apparatus and reproduction method for such disc
US6345147B1 (en) * 1995-11-24 2002-02-05 Kabushiki Kaisha Toshiba Multi-language recording medium and reproducing device for the same
US20030099464A1 (en) * 2001-11-29 2003-05-29 Oh Yeong-Heon Optical recording medium and apparatus and method to play the optical recording medium

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5497241A (en) * 1993-10-29 1996-03-05 Time Warner Entertainment Co., L.P. System and method for controlling display of motion picture subtitles in a selected language during play of a software carrier
US6345147B1 (en) * 1995-11-24 2002-02-05 Kabushiki Kaisha Toshiba Multi-language recording medium and reproducing device for the same
US20010053280A1 (en) * 1996-04-12 2001-12-20 Kazuhiko Yamauchi Optical disc storing both video titles provided with AV functions and video titles with no such functions which can instantly distinguish between such kinds of titles, and a reproduction apparatus and reproduction method for such disc
US20030099464A1 (en) * 2001-11-29 2003-05-29 Oh Yeong-Heon Optical recording medium and apparatus and method to play the optical recording medium

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2148332A1 (fr) * 2003-10-01 2010-01-27 Samsung Electronics Co., Ltd. Procédé de reproduction des sous-titres textuels utilisant les informations de contrôle indiquant les instants pour lesquels les données de pixel sont générées et supprimées dans une mémoire tampon
US7965921B2 (en) 2003-10-01 2011-06-21 Samsung Electronics Co., Ltd. Storage medium including text-based caption information, reproducing apparatus and reproducing method thereof

Similar Documents

Publication Publication Date Title
US7965921B2 (en) Storage medium including text-based caption information, reproducing apparatus and reproducing method thereof
KR100970735B1 (ko) 동영상 데이터가 기록된 정보저장매체를 재생하는 재생 방법 및 기록 장치
US6345147B1 (en) Multi-language recording medium and reproducing device for the same
JP5620116B2 (ja) テキストデータとダウンロードフォントとを利用した多国語支援用サブタイトルデータが記録された情報保存媒体に保存されたデータを再生する再生装置及びデータ記録及び／または再生装置その装置
US8498515B2 (en) Recording medium and recording and reproducing method and apparatuses
US20100266265A1 (en) Information storage medium containing subtitle data for multiple languages using text data and downloadable fonts and apparatus therefor
TWI280568B (en) Information storage medium for storing subtitle and video mapping information, and method and apparatus for reproducing thereof
RU2358333C2 (ru) Носитель записи со структурой данных для управления воспроизведением данных текстовых субтитров и способы и устройства записи и воспроизведения
EP2141704A2 (fr) Support d'enregistrement présentant une structure de données permettant de gérer des données et procède et appareil d'enregistrement et de lecture
US7965924B2 (en) Storage medium for recording subtitle information based on text corresponding to AV data having multiple playback routes, reproducing apparatus and method therefor
WO2005031739A1 (fr) Support d'enregistrement d'information de sous-titres basees sur des textes correspondant a des donnees av a plusieurs voies de reproduction, et appareil de reproduction, et procede d'enregistrement associees
JP2004234838A (ja) 光ディスク記録装置、光ディスク再生装置、および光ディスク
JP2002197840A (ja) 光ディスクと光ディスク記録装置と光ディスク再生装置

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NA NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): BW GH GM KE LS MW MZ NA SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LU MC NL PL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
122 Ep: pct application non-entry in european phase
WWE Wipo information: entry into national phase

Ref document number: 10573878

Country of ref document: US