US20040179824A1 - Information playback apparatus and information playback method - Google Patents

Information playback apparatus and information playback method Download PDF

Info

Publication number
US20040179824A1
US20040179824A1 US10/740,617 US74061703A US2004179824A1 US 20040179824 A1 US20040179824 A1 US 20040179824A1 US 74061703 A US74061703 A US 74061703A US 2004179824 A1 US2004179824 A1 US 2004179824A1
Authority
US
United States
Prior art keywords
information
monitor
contents
enav
conversion
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US10/740,617
Inventor
Yasufumi Tsumagari
Hideki Mimura
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Toshiba Corp
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Assigned to KABUSHIKI KAISHA TOSHIBA reassignment KABUSHIKI KAISHA TOSHIBA ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: MIMURA, HIDEKI, TSUMAGARI, YASUFUMI
Publication of US20040179824A1 publication Critical patent/US20040179824A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B20/00—Signal processing not specific to the method of recording or reproducing; Circuits therefor
    • G11B20/10—Digital recording or reproducing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/01—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level
    • H04N7/0117—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level involving conversion of the spatial resolution of the incoming video signal
    • H04N7/0122—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level involving conversion of the spatial resolution of the incoming video signal the input and the output signals having different aspect ratios
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/102—Programmed access in sequence to addressed parts of tracks of operating record carriers
    • G11B27/105—Programmed access in sequence to addressed parts of tracks of operating record carriers of operating discs
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/11—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information not detectable on the record carrier
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/426—Internal components of the client ; Characteristics thereof
    • H04N21/42646—Internal components of the client ; Characteristics thereof for reading from or writing on a non-volatile solid state storage medium, e.g. DVD, CD-ROM
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
    • H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
    • H04N21/43072—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen of multiple content streams on the same device
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/432—Content retrieval operation from a local storage medium, e.g. hard-disk
    • H04N21/4325—Content retrieval operation from a local storage medium, e.g. hard-disk by playing back content from the storage medium
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440218—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440263—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/462—Content or additional data management, e.g. creating a master electronic program guide from data received from the Internet and a Head-end, controlling the complexity of a video stream by scaling the resolution or bit-rate based on the client capabilities
    • H04N21/4622—Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H04N5/84—Television signal recording using optical recording
    • H04N5/85—Television signal recording using optical recording on discs or drums
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B20/00—Signal processing not specific to the method of recording or reproducing; Circuits therefor
    • G11B20/10—Digital recording or reproducing
    • G11B20/10527—Audio or video recording; Data buffering arrangements
    • G11B2020/1062—Data buffering arrangements, e.g. recording or playback buffers
    • G11B2020/10675—Data buffering arrangements, e.g. recording or playback buffers aspects of buffer control
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B2220/00—Record carriers by type
    • G11B2220/20—Disc-shaped record carriers
    • G11B2220/25—Disc-shaped record carriers characterised in that the disc is based on a specific recording technology
    • G11B2220/2537—Optical discs
    • G11B2220/2562—DVDs [digital versatile discs]; Digital video discs; MMCDs; HDCDs
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H04N21/4316—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/44—Receiver circuitry for the reception of television signals according to analogue transmission standards
    • H04N5/445—Receiver circuitry for the reception of television signals according to analogue transmission standards for displaying additional information
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/44—Receiver circuitry for the reception of television signals according to analogue transmission standards
    • H04N5/445—Receiver circuitry for the reception of television signals according to analogue transmission standards for displaying additional information
    • H04N5/45—Picture in picture, e.g. displaying simultaneously another television channel in a region of the screen
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/79—Processing of colour television signals in connection with recording
    • H04N9/80—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
    • H04N9/804—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving pulse code modulation of the colour picture signal components
    • H04N9/8042—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving pulse code modulation of the colour picture signal components involving data reduction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/79—Processing of colour television signals in connection with recording
    • H04N9/80—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
    • H04N9/82—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only
    • H04N9/8205—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only involving the multiplexing of an additional signal and the colour video signal

Definitions

  • the present invention relates to an information playback apparatus and information playback method for playing back contents stored in an information storage medium.
  • the read-only DVD stores presentation data which records actual video and audio data, and navigation data used to manage the presentation data.
  • the presentation data contains video data, audio data, and sub-picture data, which are multiplexed according to the specification of a program stream (2048 bytes) specified by MPEG2.
  • the navigation data describes PGCs (ProGram Chains) and Cells, which set a time configuration and order of video and audio data to be played back. With this navigation data, multi-angle, multi-story, and parental functions can be implemented.
  • Jpn. Pat. Appln. KOKAI Publication No. 11-161663 above has a problem in the contents display method.
  • Various types of monitors as display means are available: a personal computer monitor, 4:3 TV monitor, and 16:9 TV monitor. Since these monitors have different pixel layouts, they display identical contents in different patterns. For example, contents which are created for the 4:3 TV monitor are displayed in a horizontally elongated pattern when they are displayed on the 16:9 TV monitor, and are displayed in a vertically elongated pattern when they are displayed on the personal computer monitor. Since the contents are formed as a combination of elements such as DVD data, moving picture data, still picture data, font data, and the like, it is difficult to create contents for each monitor.
  • An information playback apparatus comprises a first acquisition unit configured to acquire contents from an information storage medium, a second acquisition unit configured to acquire expansion information from at least one of the information storage medium and an external apparatus via a communication line, an image processing unit configured to process the contents and image data contained in the expansion information as needed on the basis of actual monitor information indicating an actual output destination of the contents and the expansion information, and a playback unit configured to play back the contents, and to play back image data, which is contained in the expansion information and has undergone the image process as needed, in synchronism with playback of the contents.
  • An information playback method comprises: acquiring expansion information from at least one of an information storage medium and an external apparatus via a communication line; processing contents acquired from the information storage medium and image data contained in the expansion information as needed on the basis of actual monitor information indicating an actual output destination of the contents and the expansion information; and playing back the contents, and playing back image data, which is contained in the expansion information and has undergone the image process as needed, in synchronism with playback of the contents.
  • FIG. 1 shows an example of the data structure of a DVD-Video disk
  • FIG. 2 shows an example of the data structure of an enhanced DVD-Video disk
  • FIG. 3 is a block diagram showing an example of a DVD playback apparatus (information playback apparatus);
  • FIG. 4 is a block diagram showing details of an element decoder and AV renderer adopted in the DVD playback apparatus shown in FIG. 3;
  • FIG. 5 shows an example of pixel conversion of contents for a PC monitor
  • FIG. 6 is a view for explaining differences of the characteristics of a PC monitor, 4:3 TV monitor, and 16:9 TV monitor;
  • FIG. 7 is a flow chart showing an example of a contents display method assuming a case wherein contents respectively for a PC monitor, 4:3 TV monitor, and 16:9 TV monitor are prepared;
  • FIG. 8 is a flow chart showing an example of pixel conversion upon displaying contents for a 4:3 TV monitor on a 4:3 TV monitor, 16:9 TV monitor, and PC monitor;
  • FIG. 9 is a flow chart showing an example of pixel conversion upon displaying contents for a 16:9 TV monitor on a 4:3 TV monitor, 16:9 TV monitor, and PC monitor;
  • FIG. 10 is a flow chart showing an example of pixel conversion upon displaying contents for a PC monitor on a 4:3 TV monitor, 16:9 TV monitor, and PC monitor;
  • FIG. 11 shows an example upon displaying DVD-Video contents and ENAV contents on a 16:9 TV monitor
  • FIG. 12 shows an example upon displaying DVD-Video contents and ENAV contents on a 4:3 TV monitor after LB conversion
  • FIG. 13 shows an example upon displaying DVD-Video contents and ENAV contents on a 4:3 TV monitor after PS conversion
  • FIG. 14 shows display example 1 upon displaying DVD-Video contents and ENAV contents on a 4:3 TV monitor after various kinds of conversion;
  • FIG. 15 shows display example 2 upon displaying DVD-Video contents and ENAV contents on a 4:3 TV monitor after various kinds of conversion;
  • FIG. 16 is a flow chart for explaining playback with an image process required to cope with various types of monitors
  • FIG. 17 is a flow chart showing the flow upon playing back different contents in correspondence with the type of designated monitor.
  • FIG. 18 shows an example of a CSS(Cascading-Style Sheet) file.
  • FIGS. 1 and 2 show examples of the data structures of DVD-Video disks which can be played back by a DVD-Video player shown in FIG. 3 (to be described later).
  • FIG. 1 shows an example of the data structure of a standard DVD-Video disk D 1 .
  • a DVD-Video area 3 of the standard DVD-Video disk D 1 stores DVD-Video contents C 1 (having an MPEG2 program stream structure).
  • FIG. 2 shows the data structure of an enhanced DVD-Video disk D 2 .
  • a DVD-Video area 3 of the enhanced DVD-Video disk D 2 stores DVD-Video contents C 1 (having an MPEG2 program stream structure) having the same data structure as the DVD-Video standard.
  • another recording area 4 of the enhanced DVD-Video disk D 2 stores enhanced navigation (to be abbreviated as ENAV hereinafter) contents C 21 which allows a wide variety of playback of video contents. Note that the presence of the recording area 4 is also accepted in the DVD-Video standard.
  • ENAV enhanced navigation
  • the basic data structure of a DVD-Video disk will be explained below.
  • the recording area of the DVD-Video disk includes a lead-in area 1 , volume space, and lead-out area 5 in turn from its inner periphery.
  • the volume space contains a volume/file structure information area 2 , and DVD-Video area (DVD-Video zone) 3 , and can also have another recording area (DVD other zone) 4 as an option.
  • the volume/file structure information area 2 is assigned for a UDF (Universal Disk Format) bridge.
  • the volume of the UDF bridge format is recognized according to ISO/IEC13346 Part 2 .
  • a space that recognizes this volume consists of successive sectors, and starts from the first logical sector of the volume space in FIGS. 1 and 2.
  • First 16 logical sectors are reserved for system use specified by IS09660.
  • the volume/file structure information area 2 with such contents is required.
  • the DVD-Video area 3 records management information called video manager VMG 30 and one or more video contents called video title sets VTS (VTS# 1 to VTS#n).
  • the VMG 30 is management information for all VTSs present in the DVD-Video area 3 , and contains control data VMGI, VMG menu data VMGM_VOBS (option), and VMG backup data.
  • Each VTS contains control data VTSI of that VTS, VTS menu data VTSM_VOBS (option), data VTSTT_VOBS of the contents (movie or the like) of that VTS (title), and VTSI backup data.
  • the DVD-Video area with such contents is also required.
  • a playback select menu or the like of each title (VTS# 1 to VTS#n) is given in advance by a provider (the producer of a DVD video disk) using the VMG, and a playback chapter select menu, the playback order of recorded contents (cells), and the like in a specific title (e.g., VTS# 1 ) are given in advance by the provider using the VTSI. Therefore, the viewer of the disk (the user of the DVD-Video player) can enjoy the recorded contents of that disk in accordance with menus of the VMG/VTSI prepared in advance by the provider and playback control information (program chain information PGCI) in the VTSI.
  • program chain information PGCI program chain information
  • the viewer (user) cannot play back the contents (movie or music) of each VTS by a method different from the VMG/VTSI prepared by the provider.
  • the enhanced DVD-Video disk D 2 shown in FIG. 2 is prepared for a mechanism that allows the user to play back the contents (movie or music) of each VTS by a method different from the VMG/VTSI prepared by the provider, and to play back while adding contents different from the VMG/VTSI prepared by the provider.
  • the ENAV contents C 21 contained in this disk D 2 cannot be accessed by a DVD-Video player which is manufactured on the basis of the conventional DVD-Video standard (even if the ENAV contents can be accessed, their contents cannot be used).
  • a DVD-Video player (player in FIG. 3 or the like) can access the ENAV contents C 21 , and can use their playback contents.
  • the ENAV contents C 21 are configured to contain audio data, still picture data, font/text data, moving picture data, animation data, and the like, and also an ENAV document (described in a Markup/Script language) as information for controlling playback of these data.
  • This playback control information describes, using a Markup language or Script language, playback methods (display method, playback order, playback switch sequence, selection of data to be played back, and the like) of the ENAV contents (consisting of audio, still picture, font/text, moving picture, animation, and the like) and/or the DVD-Video contents C 1 .
  • Markup languages such as HTML (Hyper Text Markup Language)/XHTML (extensible Hyper Text Markup Language), SMIL (Synchronized Multimedia Integration Language), and the like
  • Script languages such as an ECMA (European Computer Manufacturers Association) script, JavaScript, and the like, and so forth, may be used in combination.
  • the ENAV contents C 21 recorded on the other recording area cannot be played back (or used) by the conventional DVD-Video player but can be played back and used by a DVD-Video player (FIG. 3) according to an embodiment of the present invention. Therefore, when the ENAV contents C 21 (and also ENAV contents C 22 ) are played back using the DVD-Video player according to an embodiment of the present invention, the user can enjoy not only the contents of the VMG/VTSI prepared in advance by the provider but also a variety of video playback features.
  • FIG. 3 shows an example of a DVD-Video player used to play back an enhanced DVD-Video disk (FIG. 2) according to the embodiment of the present invention.
  • This DVD-Video player plays back and processes recorded contents (DVD-Video contents C 1 and/or ENAV contents C 21 ) from the enhanced DVD-Video disk D 2 (FIG. 2) which is compatible to the DVD-Video standard, and downloads and processes ENAV contents C 22 via a communication line such as the Internet or the like.
  • the ENAV contents C 21 are first expansion information
  • the ENAV contents C 22 are second expansion information.
  • ENAV contents C 21 and C 22 are one type of expansion information.
  • the DVD-Video player shown in FIG. 3 comprises a DVD-Video playback engine 100 , ENAV engine 200 , disk unit 300 , and user interface unit 400 .
  • the DVD-Video playback engine 100 plays back and processes an MPEG2 program stream (DVD-Video contents C 1 ) recorded on the disk D 2 .
  • the ENAV engine 200 plays back and processes the ENAV contents C 21 and C 22 .
  • the disk unit 300 reads out the DVD-Video contents C 1 and/or ENAV contents C 21 recorded on the disk D 2 .
  • the user interface unit 400 transmits inputs (user's operations) by the user of the player as user trigger.
  • the ENAV engine 200 comprises an Internet connection unit 211 .
  • the Internet connection unit 211 serves as a communication means used to establish connection to a communication line such as the Internet or the like.
  • the ENAV engine 200 comprises an ENAV buffer unit (preload/download buffer) 209 , XHTML+SMIL/CSS parser 210 , XHTML/CSS layout manager 207 , ECMA Script interpreter & DOM manipulator 205 , SMIL timing engine 206 , ENAV interface handler 202 , element decoders 2081 and 2082 , AV renderer 203 , buffer manager 204 , download manager 213 , network manager 212 , and ENAV system clock 214 .
  • a DVD-Video playback controller 102 In the block arrangement shown in FIG. 3, a DVD-Video playback controller 102 , a DVD-Video decoder 101 , a DVD system clock 103 , the ENAV interface handler 202 , the XHTML+SMIL/CSS parser 210 , the ECMA Script interpreter & DOM manipulator 205 , the SMIL timing engine 206 , the XHTML/CSS layout manager 207 , the AV renderer 203 , the element decoders 2081 and 2082 , the buffer manager 204 , the download manager 213 , the network manager 212 , the ENAV system clock 214 , and the like can be implemented by a microcomputer (and/or hardware logic) which serves as functions of the respective blocks by an installed program (firmware; not shown). A work area used upon executing this firmware can be assured on a semiconductor memory (and a hard disk as needed; not shown) in the respective blocks.
  • the DVD-Video playback engine 100 is a device for playing back the DVD-Video contents C 1 based on the existing DVD-Video standard, and includes the DVD-Video decoder 101 which decodes the DVD-Video contents C 1 loaded by the disk unit 300 , the DVD-Video playback controller 102 which makes playback control of the DVD-Video contents C 1 , and the DVD system clock 103 that determines the decode and output timings in the DVD-Video decoder.
  • the DVD-Video decoder 101 has a function of decoding video data, audio data, and sub-picture data based on the existing DVD-Video standard, and outputting the decoded video data (mixed data of the aforementioned video and sub-picture data) and audio data, respectively.
  • the DVD-Video playback engine 100 has the same function as that of a playback engine of a normal DVD-Video player, which is manufactured based on the existing DVD-Video standard. That is, the player shown in FIG. 3 can play back video data, audio data, and the like of an MPEG2 program stream as in a normal DVD-Video player, and can play back an existing DVD-Video disk (complying with the conventional DVD-Video standard) D 1 .
  • the DVD-Video playback controller 102 can also control playback of the DVD-Video contents C 1 in accordance with a “DVD control” signal output from the ENAV engine 200 . More specifically, if an arbitrary event (e.g., menu call or title jump) has occurred in the DVD-Video playback engine 100 in a DVD-Video playback mode, the DVD-Video playback controller 102 can output a “DVD trigger” signal indicating the playback status of the DVD-Video contents C 1 to the ENAV engine 200 .
  • a “DVD trigger” signal indicating the playback status of the DVD-Video contents C 1 to the ENAV engine 200 .
  • the DVD-Video playback controller 102 can output a “DVD status” signal indicating property information (e.g., an audio language, sub-picture subtitle language, playback operation, playback position, various kinds of time information, disk contents, and the like set in the player) of the DVD-Video player to the ENAV engine 200 .
  • property information e.g., an audio language, sub-picture subtitle language, playback operation, playback position, various kinds of time information, disk contents, and the like set in the player
  • the ENAV interface handler 202 receives “user trigger” signals corresponding to user's operations (menu call, title jump, play start, play stop, play pause, etc.) from the user interface unit 400 .
  • the ENAV interface handler 202 then transfers the received “user trigger” signals as corresponding ENAV events to the ECMA Script interpreter & DOM manipulator 205 .
  • the ENAV document makes the following instructions in response to the ENAV events.
  • the contents of the user trigger signal transmitted to the ENAV interface handler 202 may be transmitted to the AV renderer 203 as an “AV output control” signal.
  • AV output control a user trigger signal is output to the AV renderer 203 as a corresponding AV output control signal.
  • a user event indicating switching between a video/audio output from the DVD-Video playback engine 100 and that from the ENAV engine 200 is sent to the AV renderer 203 , the video/audio output can be switched in response to user's operation.
  • the ENAV interface handler 202 exchanges a “DVD status” signal, “DVD trigger” signal, and/or “DVD control” signal with the DVD-Video playback controller 102 , or exchanges a “user trigger” signal with the user interface unit 400 . Furthermore, the ENAV interface handler 202 exchanges an “ENAV event”, “ENAV property”, “ENAV command”, and “ENAV control” signal with the ECMA Script interpreter & DOM manipulator 205 and SMIL timing engine 206 . More specifically, the ENAV interface handler 202 executes the following processes.
  • the handler 202 transmits a “DVD trigger” signal which is received from the DVD-Video playback engine 100 and indicates the operation of the DVD-Video playback engine 100 , or a “user trigger” which is received from the user interface unit 400 and indicates the user's operation to the ECMA Script interpreter & DOM manipulator 205 and SMIL timing engine 206 as an “ENAV event”.
  • the handler 202 transmits a “DVD status” signal which is received from the DVD-Video playback engine 100 and indicates the playback status of the DVD-Video playback engine 100 to the ECMA Script interpreter & DOM manipulator 205 and SMIL timing engine 206 as an “ENAV property”. At this time, DVD status information is saved in a property buffer 202 a of the ENAV interface handler 202 as needed.
  • the handler 202 transmits an “ENAV control” signal from the SMIL timing engine 206 to the DVD-Video playback engine 100 as a “DVD control” signal.
  • the handler 202 outputs a “DVD control” signal used to control playback of the DVD-Video playback engine 100 to the DVD-Video playback engine 100 , an “AV output control” signal used to switch video and audio data to the AV renderer 203 , a “buffer control” signal used to load/erase the contents of the buffer to the buffer manager 204 , a “download control” signal used to download ENAV contents stored in the server unit to the download manager 213 , and an “element control” signal that instructs to decode ENAV elements to the element decoders 2081 and 2082 , in accordance with the contents of an “ENAV command” signal from the ECMA Script Interpreter & DOM manipulator 205 .
  • the handler 202 measures information of the DVD system clock in the DVD-Video playback engine 100 using its DVD timing generator 202 b , and transfers it as a “DVD timing” signal to the element decoder 2082 . That is, the element decoder 2082 can decode ENAV elements in synchronism with the system clocks of the DVD-Video playback engine 100 .
  • the ENAV interface handler 202 has a function of parsing and interpreting ENAV contents, and then converting control signals and the like between the DVD-Video playback engine 100 and ENAV engine 200 .
  • the ENAV interface handler 202 is configured to exchange a first signal and to exchange a second signal on the basis of the contents which are parsed by the XHTML+SMIL/CSS parser 210 and are interpreted by the ECMA Script interpreter & DOM manipulator 205 and SMIL timing engine 206 , or a user trigger from an input device.
  • the ENAV interface handler 202 controls the output states of video and audio signals by the AV renderer 203 on the basis of at least one of the first signal exchanged with the DVD-Video playback controller 102 , and the second signal exchanged with the ECMA Script interpreter & DOM manipulator 205 and SMIL timing engine 206 .
  • the first signal pertains to the playback status of the DVD-Video disk D 2 , and corresponds to the “DVD control” signal, “DVD trigger” signal, “DVD status” signal, and the like.
  • the second signal pertains to the contents of the ENAV contents, and corresponds to the “ENAV event” signal, “ENAV command” signal, “ENAV property” signal, “ENAV control” signal, and the like.
  • the ENAV interface handler 202 is configured to execute processes corresponding to user triggers in accordance with the ENAV document.
  • the AV renderer 203 is configured to mix video/audio data generated by the element decoder 2081 with video/audio data played back by the DVD-Video playback engine 100 , and to output the mixed data on the basis of the execution result of the process corresponding to the user trigger signal.
  • the AV renderer 203 is configured to select one of video/audio data generated by the element decoder 2081 and video/audio data played back by the DVD-Video playback engine 100 , and to output the selected video/audio data on the basis of the execution result of an ENAV command in the ENAV interface handler 202 .
  • the XHTML+SMIL/CSS parser 210 parses an ENAV document indicating playback control information, which is contained in the ENAV contents C 21 acquired from the DVD-Video disk D 2 or the ENAV contents C 22 acquired from the Internet or the like.
  • the ENAV document is made up of a combination of Markup languages such as HTML/XHTML, SMIL, and the like, and Script languages such as ECMA Script, JavaScript, and the like, as described above.
  • the XHTML+SMIL/CSS parser 210 has a function of transmitting an ECMA Script module to the ECMA Script interpreter & DOM manipulator 205 , SMIL module to the SMIL timing engine 206 , and XHTML module to the XHTML/CSS layout manager 207 in accordance with the parsing result.
  • the ECMA Script interpreter & DOM manipulator 205 interprets the aforementioned ECMA Script module and follows its instruction. That is, the ECMA Script interpreter & DOM manipulator 205 has a function of issuing an “ENAV command” signal to the ENAV interface handler 202 in correspondence with an “ENAV event” signal sent from the ENAV interface handler 202 or an “ENAV property” signal read from the property buffer of the ENAV interface handler 202 .
  • the ECMA Script interpreter & DOM manipulator 205 issues an “ENAV command” signal to the DVD-Video playback engine 100 or issues an “element control” signal to the element decoder 2081 in accordance with the time measured by the ENAV system clock 214 , thus controlling the DVD-Video playback engine 100 or decoding ENAV elements (audio, still picture, text/font, moving picture/animation).
  • the SMIL timing engine 206 interprets the aforementioned SMIL module and follows its instruction. That is, the SMIL timing engine 206 has a function of issuing an “ENAV control” signal to the ENAV interface handler 202 or element decoder 208 in correspondence with an “ENAV event” signal sent from the ENAV interface handler 202 or an “ENAV property” signal read from the property buffer of the ENAV interface handler 202 in accordance with the ENAV System clock 214 . With this function, control of the DVD-Video playback engine 100 and playback of video data (moving picture, still picture, animation) and audio data can be achieved at a desired timing.
  • the XHTML/CSS layout manager 207 interprets the aforementioned XHTML module and follows its instruction. That is, the XHTML/CSS layout manager 207 outputs a “layout control” signal to the AV renderer.
  • the “layout control” signal contains information associated with the size and position of a video window to be output (this information often contains information associated with a display time such as display start, end, or continue), and information associated with the level of audio data to be output (this information often contains information associated with an output time such as output start, end, or continue).
  • text information to be displayed which is contained in the XHTML module, is sent to the element decoder 208 , and is decoded and displayed using desired font data.
  • commands and variables unique to a Markup or Script language in the ENAV document those which are used to change the video size from the DVD-Video playback engine 100 and/or ENAV engine 200 and to change the layout of that video data are available.
  • a change in video size is designated using a size change command and a variable that designates the size after change.
  • a change in video layout is designated by a display position change command and a variable that designates the coordinate position or the like after change. When objects to be displayed overlap on the screen, a variable that designates depth ordering is added.
  • commands and variables used to change the audio level from the DVD-Video playback engine 100 and/or ENAV engine 200 or to select an audio language to be used are available.
  • a change in audio level is designated by an audio level change command and a variable that designates an audio level after change.
  • An audio language to be used is selected by an audio language change command and a variable that designates the type of language after change.
  • commands and variables used to control user trigger from the user interface unit 400 .
  • a “layout control” signal is sent from the XHTML/CSS layout manager (some functions are often implemented by the SMIL timing engine 206 ) to the AV renderer 203 .
  • the “layout control” signal controls the layout on the screen, size, output timing, and output time of video data to be displayed on, e.g., an external monitor device or the like (not shown), and/or the tone-volume, output timing, and output time of audio data to be played back from an external loudspeaker (not shown).
  • the element decoder 208 decodes ENAV contents data such as audio data, still picture data (include background picture data), text/font data, moving picture data, animation data, and the like contained in the ENAV contents C 21 or C 22 . That is, the element decoder 208 includes an audio decoder, still picture decoder, text/font decoder, and animation/moving picture decoder in correspondence with objects to be decoded.
  • audio data in the ENAV contents which is encoded by, e.g., MPEG, AC-3, or DTS is decoded by the audio decoder and is converted into non-compressed audio data.
  • Still picture data or background picture data which is encoded by JPEG, GIF, or PNG, is decoded by the still picture decoder, and is converted into non-compressed image data.
  • moving picture/animation data which is encoded by MPEG2, MPEG4, Macromedia Flash, or SVG (Scalable Vector Graphics) is decoded by the moving picture/animation decoder, and is converted into non-compressed moving picture data.
  • Text data contained in the ENAV contents is decoded by the text/font decoder using font data contained in the ENAV contents, and is converted into text image data which can be superimposed on a moving or still picture.
  • Video/audio data which contains these decoded audio data, image data, animation/moving picture data, and text image data as needed, is sent from the element decoder 208 to the AV renderer 203 .
  • ENAV contents are decoded in accordance with an instruction of an “element control” signal from the ENAV interface handler 202 .
  • ENAV contents e.g., audio commentary data, audio after-recording data
  • ENAV contents which are synchronous with the DVD-Video contents are decoded in synchronism with a “DVD timing” signal from the ENAV interface handler 202 .
  • ENAV contents which are asynchronous with the DVD-Video contents are decoded in synchronism with an “ENAV timing” signal from the ENAV system clock 214 .
  • the AV renderer 203 has a function of controlling a video/output output. More specifically, the AV renderer 203 controls, e.g., the video display position and size (often including the display timing and display time together), and the audio level (often including the output timing and output time together) in accordance with the “layout control” signal output from the XHTML/CSS layout manager 207 . Also, the AV renderer 203 performs pixel conversion of a video to be displayed in accordance with the type of the designated monitor and/or the type of the video to be displayed. The video/output outputs to be controlled are those from the DVD-Video playback engine 100 and element decoder 2081 . Furthermore, the AV renderer 203 has a function of controlling mixing and switching of the DVD-Video contents C 1 and ENAV contents C 21 or C 22 in accordance with an “AV output control” signal output from the ENAV interface handler 202 .
  • the ENAV engine 200 in the DVD-Video player in FIG. 3 comprises an interface for sending the ENAV document in the ENAV contents C 21 read from the DVD-Video disk D 2 to the XHTML+SMIL/CSS parser 210 via the ENAV buffer unit 209 , and an interface for sending data (audio data, still picture data, text/font data, moving picture data, and the like) in the read ENAV contents C 21 to the element decoder 208 via the ENAV buffer unit 209 .
  • These interfaces form an interface (first interface) independent from the Internet connection unit 211 in FIG. 3.
  • the DVD-Video player in FIG. 3 comprises an interface for receiving the ENAV contents C 22 from a communication line such as the Internet or the like, and sending the ENAV document in the received ENAV contents C 22 to the XHTML+SMIL/CSS parser 210 via the ENAV buffer unit 209 , and an interface for sending data (audio data, still picture data, text/font data, moving picture data, and the like) in the received ENAV contents C 22 to the element decoder 208 via the ENAV buffer unit 209 .
  • These interfaces form the Internet connection unit (second interface) shown in FIG. 3.
  • the ENAV buffer unit 209 comprises buffers used to store the ENAV contents C 22 downloaded from the server unit 500 , and to store the ENAV contents C 21 loaded from the enhanced DVD-Video disk D 2 by the disk unit 300 .
  • the ENAV buffer unit 209 reads the ENAV contents C 22 on an external server (server unit 500 ) under the control of the buffer manager 204 based on the ENAVE documents (Markup/Script language), and downloads the ENAV contents C 22 via the Internet connection unit 211 .
  • the ENAV buffer unit 209 loads the ENAV contents C 21 recorded on the enhanced DVD-Video disk D 2 under the control of the buffer manager 204 based on the ENAV document (Markup/Script language).
  • the disk unit 300 is a device that can access the disk at high speed, it can read out the ENAV contents C 21 from the enhanced DVD-Video disk D 2 while playing back the DVD-Video contents C 1 , i.e., reading out DVD-Video data from the enhanced DVD-Video disk D 2 .
  • the disk unit 300 is not a device that can make high-speed access, or if the playback operation of the DVD-Video contents C 1 is to be perfectly guaranteed, playback of the DVD-Video contents C 1 must not be interrupted.
  • the ENAV contents C 21 are read out from the enhanced DVD-Video disk D 2 and are stored in a preload unit (not shown) of the ENAV buffer unit 209 in advance prior to the beginning of playback.
  • the load on the disk unit 300 can be reduced.
  • the DVD-Video contents C 1 and ENAV contents can be simultaneously played back without interrupting playback of the DVD-Video contents C 1 .
  • the ENAV buffer unit 209 has a limited storage capacity. That is, the data size of ENAV contents C 21 or C 22 that can be stored in the ENAV buffer unit 209 is limited. For this reason, it is possible to erase ENAV contents C 21 or C 22 with low necessity and to save those with high necessity under the control of the buffer manager 204 (buffer control). Such save control and erase control may be automatically executed by the ENAV buffer unit 209 .
  • the buffer manager 204 can send the following instructions as “buffer control” to the ENAV buffer unit 209 in accordance with an instruction of the ENAV document.
  • the download manager 213 has a function of acquiring download data from the enhanced DVD disk D 2 of the disk unit 300 or the server unit 500 in accordance with an instruction of the ENAV document, parsing the download data, downloading required ENAV contents from the server unit 500 (download control), and holding the downloaded contents in the ENAV buffer unit 209 .
  • the download manager 213 loads download data on the disk or that on the server at a timing designated by the ENAV document.
  • the download manager 213 instructs to download data in the order they are described in the file (or all data at the same time) (download control).
  • the download manager 213 loads the ENAV document, and also download data on the disk or that on the server designated by the ENAV document at the same time.
  • the download manager 213 loads ENAV contents with high priority of playback until the ENAV buffer becomes full of data with reference to the file size and playback start time of the download data, and starts playback. Then, the download manager 213 erases ENAV contents that have been played back from the ENAV buffer with reference to the playback end time, and loads new ENAV contents.
  • the network manager 212 controls the operation of the Internet connection unit 211 . That is, when the ENAV document instructs connection/disconnection to/from the network as an ENAV command, the network manager 212 switches connection/disconnection of the Internet connection unit 211 .
  • the ENAV engine comprises:
  • the XHTML+SMIL/CSS parser 210 parses the contents of the ENAV documents.
  • the ECMA Script Interpreter & DOM manipulator 205 , SMIL timing engine 206 , and XHTML/CSS layout manager 207 respectively interpret the parsed modules.
  • the ENAV interface handler 202 handles control signals from the ECMA Script Interpreter & DOM manipulator 205 and SMIL timing engine 206 , and those from the DVD-Video playback controller 102 .
  • the element decoder 208 generates video/audio data corresponding to audio data, still picture data, text/font data, moving picture data, and the like contained in the ENAV contents C 21 or C 22 synchronized system clock of the DVD playback engine and ENAV engine.
  • the AV renderer 203 outputs data obtained by mixing video/audio data generated by the element decoder 208 to that played back by the DVD-Video playback engine 100 on the basis of the execution result of the ENAV command in the ENAV interface handler 202 .
  • the AV handler 203 selectively outputs one of video/audio data generated by the element decoder 208 and that played back by the DVD-Video playback engine 100 on the basis of the execution result of the ENAV command in the ENAV interface handler 202 .
  • the ENAV buffer unit 209 temporarily stores the ENAV contents C 22 acquired from the disk unit 300 or from the server unit 500 via the Internet connection unit 211 .
  • the download manager 213 downloads ENAV contents from the server unit to the ENAV buffer on the basis of download data.
  • the network manager 212 controls connection/disconnection to/from the network and the like in accordance with an instruction of the ENAV document.
  • FIG. 4 is a schematic view showing a pixel conversion function and related functions.
  • the DVD-Video contents are decoded by the decoder 101 of the DVD-Video playback engine 100 , and undergo one of “letter box conversion (LB conversion)”, “pan scan conversion (PS conversion)”, and “no conversion” in an LB/PS converter 101 a in accordance with an instruction (conversion control) of the XHTML/CSS layout manager 207 based on the ENAV document (LB/PS conversion). Furthermore, the converted contents are converted to a designated size by a DVD-Video resizing unit 203 f in accordance with an instruction (conversion control) of the XHTML/CSS layout manager 207 (reduction, enlargement, equal magnification).
  • the layout of the converted contents on a monitor is determined by a layout engine 203 j in accordance with an instruction (layout control) of the XHTML/CSS layout manager 207 based on the ENAV document, and the converted contents are then mixed with other ENAV elements (still picture, animation/moving picture, font, background) by a mixer 203 k.
  • switching of “LB conversion”, “PS conversion”, and “no conversion” by the XHTML/CSS layout manager 207 may be made by user's operations as long as the description of the ENAV document permits. That is, a switching instruction of the conversion is transferred as DVD control to the DVD-Video playback controller 102 of the DVD-Video playback engine 100 in response to a user trigger from the user interface unit 400 .
  • Still picture data and animation/moving picture data are respectively decoded by a still picture decoder 2081 a and animation/moving picture decoder 2081 b of the element decoder 2081 .
  • the converted data then undergo pixel conversion in a still picture converter 203 a or animation/moving picture pixel converter 203 b in the AV renderer 203 on the basis of an instruction (conversion control) of the XHTML/CSS layout manager 207 , ‘information of a monitor designated as an output destination (monitor information)’ which can be acquired from the ENAV interface handler, and the information (image information) from the still picture decoder 2081 a and animation/moving picture decoder 2081 b (still picture pixel conversion and animation/moving picture pixel conversion).
  • the monitor information indicates one of “4:3 TV monitor”, “16:9 TV monitor”, and “PC monitor” as the monitor designated as an output destination.
  • the monitor information is information (actual monitor information) indicating that an actual monitor as an output destination is a PC monitor, 4:3 TV monitor, or 16:9 TV monitor.
  • the image information indicates on which of monitors, i.e., one of “4:3 TV monitor”, “16:9 TV monitor”, “PC monitor”, and “no designation” the decoded still picture data and animation/moving picture data are designed to be displayed.
  • the image information is information (optimal monitor information) which indicates an optimal monitor (one of a PC monitor, 4:3 TV monitor, and 16:9 TV monitor) used to output.
  • the aforementioned still picture data and animation/moving picture data have a field that records information indicating on which of monitors these data are designed to be displayed.
  • the respective decoders decode data themselves, and also read this monitor information.
  • the decoders send the read monitor information to the pixel converters 203 a , 203 b , 202 c , and 202 d .
  • the ENAV document describes “PS conversion”, “LB conversion”, or “no conversion” when image information (optimal monitor information) and monitor information (actual monitor information) have different contents for given still picture data or animation/moving picture data. This information is supplied to the pixel converters 203 a , 203 b , 202 c , and 202 d as conversion control.
  • the image information may be recorded as, e.g., the file name of still picture data or animation/moving picture data in place of internal data of the still picture data or animation/moving picture data.
  • monitor information actual monitor information
  • image information optical monitor information
  • conversion since information of image data matches that of the monitor, conversion is unconditionally skipped.
  • monitor information indicates “16:9 TV monitor”
  • image information indicates “4:3 TV monitor”
  • conversion one of PS conversion, LB conversion, and no conversion
  • the ENAV document describes information indicating on which of monitors still picture data and animation/moving picture data are designed to be displayed in some cases. That is, even when still picture data or animation/moving picture data does not record any image information, or even when the pixel converters 203 a , 203 b , 202 c , and 202 d do not acquire any image information from the decoders 2081 a , 2081 b , and 2081 c , one of conversion processes can be made in accordance with the monitor information (actual monitor information) and the description of the ENAV document.
  • the still picture data and animation/moving picture data that have undergone pixel conversion are converted to a designated size (reduction, enlargement, equal magnification, or the like), as shown in FIG. 5, by a still picture resizing unit 203 g or animation/moving picture resizing unit 203 h , in accordance with an instruction (conversion control) of the XHTML/CSS layout manager 207 (still picture resizing, animation/moving picture resizing).
  • DVD-Video data is resized by the DVD-Video resizing unit 203 f as needed.
  • Still picture data is resized by the still picture resizing unit 203 g as needed.
  • animation/moving picture data is resized by the animation/moving picture resizing unit 203 h as needed.
  • background picture data is resized by a background picture resizing unit 203 i as needed.
  • the order of pixel conversion and resizing may be reversed. That is, after data may be resized to a designated size, they may undergo designated pixel conversion. Upon executing pixel conversion and resizing, image quality deteriorates in each conversion process. Hence, the order of pixel conversion and resizing may be changed depending on the conversion method and resizing method, thus suppressing such deterioration. For example, when enlargement (resizing) is done after LB conversion (pixel conversion), errors produced by LB conversion are enlarged by enlargement. In this case, when LB conversion (pixel conversion) is done after enlargement (resizing), errors can be prevented from being enlarged.
  • the resized still picture data and animation/moving picture data are laid out by the layout engine 203 j at locations designated by the ENAV document (layout control from the XHTML/CSS layout manager 207 ). Then, these data are mixed with the DVD-Video data and other ENAV elements (font, background) on a frame memory of the mixer 203 k.
  • Text data of the ENAV document is decoded by a font decoder 2081 c of the element decoder 2081 using font data, and is rasterized by a font engine/font pixel converter 202 c .
  • the font engine/font pixel converter 202 c executes pixel conversion (font pixel conversion) as needed on the basis of ‘information of a monitor designated as an output destination (monitor information)’ which can be acquired from the ENAV interface handler, and information (image information) from the font decoder 2081 c , in accordance with an instruction (conversion control) of the XHTML/CSS layout manager 207 .
  • monitor information actual monitor information
  • image information optical monitor information
  • font data corresponding to sizes to be displayed are pre-stored, they need not be resized if the XHTML/CSS layout manager 207 uses required font data. However, if the types of font sizes stored as font data are not sufficient, font data of a given size must be converted (enlarged or reduced) into that of the designated size.
  • the rasterized font data undergoes corrections of the character spacing and width in a line layout engine 203 n .
  • This is a function of adjusting a character string or the number of characters to be laid out per line/column designated by the ENAV document to fall within the range, as designated by the ENAV document. For example, when a character string to be laid out in one line extends across two lines, it is laid out to fall within one line by reducing the character spacing or width. Conversely, when a character string to be laid out over the entire line cannot fill up that line, it is laid out over the entire line by increasing the character spacing or width.
  • the font data is laid out by the layout engine 203 j at the location designated by the ENAV document (layout control). Then, the font data is mixed with the DVD-Video data and other ENAV elements (still picture, animation/moving picture, background) on the frame memory of the mixer 203 k.
  • background picture data there are two cases, i.e., a case wherein still picture data recorded on the enhanced DVD disk or server unit 500 is used and a case wherein the AV renderer 203 generates a designated background picture.
  • still picture data which is designated by the ENAV document as a background picture is decoded by a background picture decoder 2081 d in the element decoder 2081 . Furthermore, the decoded background picture data undergoes pixel conversion (background picture pixel conversion) by a background picture pixel converter 202 d in the AV renderer 203 on the basis of an instruction (conversion control) from the XHTML/CSS layout manager 207 , ‘information of a monitor designated as an output destination (monitor information)’ which can be acquired from the ENAV interface handler, and the information (image information) from the background picture decoder. Note that the conversion control, monitor information (actual monitor information), and image information (optimal monitor information) are the same as those of the aforementioned still picture data and animation/moving picture data.
  • the background picture data that has undergone pixel conversion is converted into a designated size (reduction, enlargement, equal magnification, or the like) by the background picture resizing unit 203 i in accordance with an instruction (conversion control) of the XHTML/CSS layout manager 207 (background picture resizing).
  • the resized background picture data is rasterized on a background frame memory (not shown) by a method designated by the ENAV document.
  • a method designated by the ENAV document For example, as the rasterizing method, a method of laying out one background picture data at the designated location, and a method of laying out a plurality of identical background picture data side by side are available.
  • the data on the background frame memory is rasterized on the frame memory of the mixer 203 k .
  • the EX-OR of the data on the background frame memory and the data on the frame memory of the mixer 203 k which include the DVD-Video data and other ENAV elements (still picture, animation/moving picture, font) is added to the frame memory of the mixer 203 k . That is, the data on the background frame memory is laid out on the frame memory of the mixer 203 k with respect to pixels on the frame memory of the mixer 203 k where none of still picture data, animation/moving picture data, and font data are laid out. In this way, the still picture data, animation/moving picture data, and font data are laid out in preference to (above) the background picture data.
  • a background generator 203 e of the AV renderer 203 generates data used as a background on the basis of information such as “color”, “pattern”, and the like designated by the ENAV document.
  • the generated-background data is rasterized on the background frame memory, and is mixed with the DVD-Video data and other ENAV elements on the frame memory of the mixer 203 k in the same manner as in the former case.
  • the DVD-Video contents and ENAV contents rasterized on the frame memory of the mixer 203 k are D/A-converted by a D/A converter & LB/PS converter 203 m .
  • the converted contents then undergo a “PS conversion”, “LB conversion”, or “no conversion” process in accordance with an instruction (conversion control) of the XHTML/CSS layout manager 207 , and are output to the connected monitor (D/A conversion & LB/PS conversion).
  • switching of “LB conversion”, “PS conversion”, and “no conversion” by the XHTML/CSS layout manager 207 may be made by user's operations as long as the description of the ENAV document permits. That is, a switching instruction of the conversion is transferred as AV output control to the AV renderer 203 in response to a user trigger from the user interface unit 400 .
  • the order of D/A conversion and LB/PS conversion may be reversed. That is, after the data on the frame memory of the mixer 203 k undergoes LB/PS conversion and the converted data is rasterized on a new frame memory, D/A conversion is executed.
  • the former method i.e., the method of executing LB/PS conversion after D/A conversion can be implemented using a small frame memory size while suppressing image quality deterioration in the two conversion process.
  • the latter method of LB/PS conversion requires the frame memory, but can improve the degree of freedom in LB/PS conversion.
  • FIG. 6 there are several types of monitors, i.e., a PC monitor, 4:3 TV monitor, and 16:9 TV monitor. These monitors have different pixel layouts. On the PC monitor, vertical and horizontal pixels are arranged uniformly (Square Pixel). By contrast, the 4:3 TV monitor has an aspect ratio of about 1:1.2, and the 16:9 TV monitor has an aspect ratio of about 1:1.6 (Rectangular Pixel). That is, an original image, which is a perfect circle on the PC monitor, appears as a horizontally elongated oval on the 4:3 TV monitor, and as a further horizontally elongated oval on the 16:9 TV monitor.
  • a PC monitor vertical and horizontal pixels are arranged uniformly (Square Pixel).
  • the 4:3 TV monitor has an aspect ratio of about 1:1.2
  • the 16:9 TV monitor has an aspect ratio of about 1:1.6 (Rectangular Pixel). That is, an original image, which is a perfect circle on the PC monitor, appears as a horizontally elongated oval
  • FIG. 7 is a flow chart showing the flow upon playing back different contents in correspondence with the type of designated monitor.
  • DVDINDEX.HTM an ENAV document which is stored on the enhanced DVD disk and is required to start up
  • DVDINDEX.HTM describes an instruction for loading a predetermined file after information of the output monitor of user's choice (actual monitor information), i.e., a default aspect ratio (SPRM( 14 )) in a video player configuration (P_CFG) (ST 102 ). If the output monitor information is “00b” which indicates “4:3 TV monitor”, “INDEX — 1.HTM” is loaded (ST 121 ).
  • the output monitor information is “11b” which indicates “16:9 TV monitor”, “INDEX — 2.HTM” is loaded (ST 131 ). If the output monitor information is “10b” which indicates “PC monitor”, “INDEX — 0.HTM” is loaded (ST 111 ).
  • “INDEX — 1.HTM” as the ENAV document for the 4:3 TV monitor describes a link to ENAV contents (still picture, animation/moving picture, font, background) for the 4:3 TV monitor. Also, this ENAV document describes an output method of DVD-Video contents onto the 4:3 TV monitor (current display mode of the video player configuration: “normal or wide (no conversion)”, “pan scan (PS conversion)”, “letter box (LB conversion)”. The ENAV contents for the 4:3 TV monitor are loaded according to this document (ST 122 ), and can be displayed on the 4:3 TV monitor (ST 123 ).
  • “INDEX — 2.HTM” describes a link to ENAV contents for the 16:9 TV monitor, and an instruction for DVD-Video contents.
  • the ENAV contents for the 16:9 TV monitor are loaded according to this document (ST 132 ), and can be displayed on the 16:9 TV monitor (ST 133 ).
  • “INDEX — 3.HTM” describes a link to ENAV contents for the PC monitor, and an instruction for DVD-Video contents.
  • the ENAV contents for the PC monitor are loaded according to this document (ST 112 ), and can be displayed on the PC monitor (ST 113 ).
  • FIG. 17 is a flow chart showing the flow upon playing back different contents in correspondence with the type of designated monitor.
  • DVDINDEX.HTM an ENAV document which is stored on the enhanced DVD disk and is required to start up
  • DVDINDEX.HTM describes an instruction for loading a CSS(Cascading Style Sheet) file (as described in FIG. 18) after information of the output monitor of user's choice (actual monitor information), i.e., a default aspect ratio (SPRM( 14 )) in a video player configuration (P_CFG) (ST 102 ). If the output monitor information is “00b” which indicates “4:3 TV monitor”, “4 — 3_style.css” is loaded (ST 121 #).
  • the output monitor information is “11b” which indicates “16:9 TV monitor”, “16 — 9_style.css” is loaded (ST 131 #). If the output monitor information is “10b” which indicates “PC monitor”, “pc_style.css” is loaded (ST 111 #).
  • “4 — 3_style.css” as the style sheet for the 4:3 TV monitor describes position information (ordinate and abscissa) and size information (vertical/horizontal length or scale-up/down ratio) to layout ENAV contents (still picture, animation/moving picture, font, background) for the 4:3 TV monitor. Also, this style sheet describes an output method of DVD-Video contents onto the 4:3 TV monitor (current display mode of the video player configuration: “normal or wide (no conversion)”, “pan scan (PS conversion)”, “letter box (LB conversion)”.
  • 16 — 9_style.css describes position/size information to layout ENAV contents for the 16:9 TV monitor, and an instruction for DVD-Video contents.
  • pc_style.css describes position/size information to layout ENAV contents for the PC monitor, and an instruction for DVD-Video contents.
  • FIG. 8 shows an example of pixel conversion executed when contents for the 4:3 TV monitor are to be displayed on the 4:3 TV monitor, 16:9 TV monitor, and PC monitor.
  • the respective pixel converters receive image data and image information (indicating one of “4:3 TV monitor”, “16:9 TV monitor”, and “PC monitor” for which that picture is designed) from the corresponding decoders (still picture decoder 2081 a , animation/moving picture decoder 2081 b , font decoder 2081 c , background picture decoder 2081 d ), and confirm that the image data are designed for the 4:3 TV monitor.
  • image information indicating a monitor on which the image data is to be displayed can be described in an ENAV document in place of image data itself.
  • the designated monitor is determined with reference to the current display mode of the video player configuration (P_CFG) (ST 201 ). That is, “monitor information” which is transferred from the ENAV interface to each pixel converter is referred to. At this time, if the designated monitor is a 4:3 TV monitor, since the monitor on which the contents are to be displayed matches the monitor which is designated to display, no pixel conversion is required (ST 222 ).
  • the designated monitor is a 16:9 TV monitor, it is checked based on the description of the ENAV document, i.e., conversion control sent from the XHTML/CSS layout manager 207 to the respective pixel converters if pixel conversion is to be executed (ST 231 ). If no pixel conversion is to be executed, (ST 231 , NO), the contents are output without any conversion (ST 232 ). In this case, contents are displayed to be horizontally elongated compared to the intended ones.
  • LB or PS conversion is executed in accordance with the description of the ENAV document (conversion control from the XHTML/CSS layout manager 207 ) (ST 233 , ST 234 , ST 235 ).
  • LB conversion in this case, non-display areas are formed on the right and left ends of the display area.
  • PS conversion in this case, the upper and lower portions of the original contents are not displayed.
  • the designated monitor is a PC monitor, it is checked based on the description of the ENAV document, i.e., conversion control sent from the XHTML/CSS layout manager 207 to the respective pixel converters if pixel conversion is to be executed (ST 211 ). If no pixel conversion is to be executed, (ST 211 , NO), the contents are output without any conversion (ST 212 ). In this case, contents are displayed to be slightly vertically elongated compared to the intended ones.
  • LB or PS conversion is executed in accordance with the description of the ENAV document (conversion control from the XHTML/CSS layout manager 207 ) (ST 213 , ST 214 , ST 215 ).
  • LB conversion conversion control from the XHTML/CSS layout manager 207
  • ST 213 , ST 214 , ST 215 non-display areas are formed on the upper and lower ends of the display area.
  • PS conversion in this case, the right and left end portions of the original contents are not displayed.
  • FIG. 9 shows an example of pixel conversion executed when contents for the 16:9 TV monitor are to be displayed on the 4:3 TV monitor, 16:9 TV monitor, and PC monitor.
  • the respective pixel converters receive image data and image information (indicating one of “4:3 TV monitor”, “16:9 TV monitor”, and “PC monitor” for which that picture is designed) from the corresponding decoders (still picture decoder 2081 a , animation/moving picture decoder 2081 b , font decoder 2081 c , background picture decoder 2081 d ), and recognize that the image data are designed for the 16:9 TV monitor.
  • image information indicating a monitor on which the image data is to be displayed can be described in an ENAV document in place of image data itself.
  • the designated monitor is determined with reference to the current display mode of the video player configuration (P_CFG) (ST 301 ). That is, “monitor information” which is transferred from the ENAV interface to each pixel converter is referred to. At this time, if the designated monitor is a 16:9 TV monitor, since the monitor on which the contents are to be displayed matches the monitor which is designated to display, no pixel conversion is required (ST 332 ).
  • the designated monitor is a 4:3 TV monitor, it is checked based on the description of the ENAV document, i.e., conversion control sent from the XHTML/CSS layout manager 207 to the respective pixel converters if pixel conversion is to be executed (ST 321 ). If no pixel conversion is to be executed, (ST 321 , NO), the contents are output without any conversion (ST 322 ). In this case, contents are displayed to be vertically elongated compared to the intended ones.
  • LB or PS conversion is executed in accordance with the description of the ENAV document (conversion control from the XHTML/CSS layout manager 207 ) (ST 323 , ST 324 , ST 325 ).
  • LB conversion in this case, non-display areas are formed on the upper and lower ends of the display area.
  • PS conversion in this case, the right and left end portions of the original contents are not displayed.
  • the designated monitor is a PC monitor, it is checked based on the description of the ENAV document, i.e., conversion control sent from the XHTML/CSS layout manager 207 to the respective pixel converters if pixel conversion is to be executed (ST 311 ). If no pixel conversion is to be executed, (ST 311 , NO), the contents are output without any conversion (ST 312 ). In this case, contents are displayed to be slightly vertically elongated compared to the intended ones.
  • LB or PS conversion is executed in accordance with the description of the ENAV document (conversion control from the XHTML/CSS layout manager 207 ) (ST 313 , ST 314 , ST 315 ).
  • LB conversion conversion control from the XHTML/CSS layout manager 207
  • ST 313 , ST 314 , ST 315 non-display areas are formed on the upper and lower ends of the display area.
  • PS conversion in this case, the right and left end portions of the original contents are not displayed.
  • FIG. 10 shows an example of pixel conversion executed when contents for the PC monitor are to be displayed on the 4:3 TV monitor, 16:9 TV monitor, and PC monitor.
  • the respective pixel converters receive image data and image information (indicating one of “4:3 TV monitor”, “16:9 TV monitor”, and “PC monitor” for which that picture is designed) from the corresponding decoders (still picture decoder 2081 a , animation/moving picture decoder 2081 b , font decoder 2081 c , background picture decoder 2081 d ), and recognize that the image data are designed for the PC monitor.
  • image information indicating a monitor on which the image data is to be displayed can be described in an ENAV document in place of image data itself.
  • the designated monitor is determined with reference to the current display mode of the video player configuration (P_CFG) (ST 401 ). That is, “monitor information” which is transferred from the ENAV interface to each pixel converter is referred to. At this time, if the designated monitor is a PC monitor, since the monitor on which the contents are to be displayed matches the monitor which is designated to display, no pixel conversion is required (ST 412 ).
  • the designated monitor is a 4:3 TV monitor, it is checked based on the description of the ENAV document, i.e., conversion control sent from the XHTML/CSS layout manager 207 to the respective pixel converters if pixel conversion is to be executed (ST 421 ). If no pixel conversion is to be executed, (ST 421 , NO), the contents are output without any conversion (ST 422 ). In this case, contents are displayed to be slightly horizontally elongated compared to the intended ones.
  • LB or PS conversion is executed in accordance with the description of the ENAV document (conversion control from the XHTML/CSS layout manager 207 ) (ST 423 , ST 424 , ST 425 ).
  • LB conversion in this case, non-display areas are formed on the right and left ends of the display area.
  • PS conversion in this case, the upper and lower portions of the original contents are not displayed.
  • the designated monitor is a 16:9 TV monitor, it is checked based on the description of the ENAV document, i.e., conversion control sent from the XHTML/CSS layout manager 207 to the respective pixel converters if pixel conversion is to be executed (ST 431 ). If no pixel conversion is to be executed, (ST 431 , NO), the contents are output without any conversion (ST 432 ). In this case, contents are displayed to be horizontally elongated compared to the intended ones.
  • LB or PS conversion is executed in accordance with the description of the ENAV document (conversion control from the XHTML/CSS layout manager 207 ) (ST 433 , ST 434 , ST 435 ).
  • LB conversion in this case, non-display areas are formed on the right and left ends of the display area.
  • PS conversion in this case, the upper and lower portions of the original contents are not displayed.
  • FIG. 11 shows a display example of DVD-Video contents and ENAV contents on a 16:9 TV monitor using the aforementioned pixel conversion function.
  • contents designed for a 16:9 TV monitor are prepared as DVD-Video contents
  • background picture data designed for a 16:9 TV monitor still picture data designed for a 4:3 TV monitor
  • font data designed for a PC monitor are prepared as ENAV contents.
  • the monitor “16:9 TV monitor” on which the contents are designed to be displayed matches the monitor “16:9 TV monitor” which is actually designated to display, pixel conversion is skipped, and the DVD-Video contents undergo resizing (in this case, reduced-scale display) designated by the ENAV document.
  • the background picture data since the monitor on which the background picture data is designed to be displayed matches the monitor which is actually designated to display, pixel conversion is skipped, and the background picture data undergoes resizing designated by the ENAV document.
  • the still picture data since the monitor “4:3 TV monitor” on which the contents are designed to be displayed matches the monitor “16:9 TV monitor”, the still picture data undergoes conversion shown in FIG. 8.
  • the ENAV document designates that “LB conversion is executed as pixel conversion”. Furthermore, the still picture data undergoes resizing designated by the ENAV document.
  • the font data since the monitor “PC monitor” on which the contents are designed to be displayed matches the monitor “16:9 TV monitor”, the font data undergoes conversion shown in FIG. 10.
  • the ENAV document designates that “no pixel conversion is made”. Also, the ENAV document designates the font size to be displayed, and if font data of that size is prepared, no resizing is required.
  • a method of displaying contents, which are designed to be displayed on a given monitor, on a different monitor in accordance with an instruction of the ENAV document will be described below.
  • an ENAV page (FIG. 11: made up of the DVD-Video contents and ENAV contents (still picture, font, and background picture)) which is designed to be displayed on the 16:9 TV monitor above is displayed on a 4:3 TV monitor.
  • FIG. 12 shows an example wherein the ENAV page (FIG. 11) which is designed to be displayed on the 16 9 monitor undergoes letter box conversion by the D/A converter & LB/PS converter 203 m in accordance with an instruction of the ENAV document, i.e., the conversion control from the XHTML/CSS layout manager 307 , and is then output onto the 4:3 TV monitor.
  • the ENAV document i.e., the conversion control from the XHTML/CSS layout manager 307
  • non-display areas are formed on the upper and lower ends of the monitor screen.
  • FIG. 13 shows an example wherein the ENAV page (FIG. 11) which is designed to be displayed on the 16:9 monitor undergoes pan scan conversion by the D/A converter & LB/PS converter 203 m in accordance with an instruction of the ENAV document, i.e., the conversion control from the XHTML/CSS layout manager 307 , and is then output onto the 4:3 TV monitor.
  • the right and left end portions of the ENAV page are not displayed.
  • these non-display areas and display areas can be designated as needed by the ENAV document, and can also be changed as needed by a user event issued by a user's operation.
  • the letter box conversion and pan scan conversion shown in FIGS. 12 and 13 can be designated as needed by the ENAV document, and can also be switched as needed by a user event issued by a user's operation.
  • FIG. 12 the actually displayed area is smaller than the area of the 4:3 TV monitor, i.e., non-display areas are formed on the TV monitor.
  • FIG. 13 given portions of the ENAV page are not displayed on the 4:3 TV monitor.
  • FIG. 14 shows an example wherein DVD-Video contents and ENAV contents (still picture, font, and background picture), which are the same as those used to display the ENAV page in FIG. 11, are displayed in accordance with an instruction of the ENAV document. Note that this conversion can be implemented as a function of the playback apparatus even when no instruction of the ENAV document is available.
  • DVD-Video contents for a 16:9 TV monitor undergo letter box conversion. Also, background picture data for a 16:9 TV monitor undergoes pan scan conversion that cuts off the right and left ends of the background picture. Since still picture data for a 4:3 TV monitor is originally designed to be displayed on the 4:3 TV monitor, conversion is skipped. Also, conversion of font data for a PC monitor is skipped.
  • the size after resizing and the font size used in display are the same as those in FIG. 11. That is, the playback apparatus can automatically apply the contents for the 16:9 TV monitor shown in FIG. 11 on the basis of image information of the DVD-Video contents and ENAV contents (still picture, font, and background picture), and can display the page shown in FIG. 14 on the 4:3 TV monitor.
  • FIG. 15 shows another example upon displaying the contents for the 16:9 TV monitor shown in FIG. 11 on a 4:3 TV monitor.
  • DVD-Video contents for a 16:9 TV monitor undergo pan scan conversion.
  • background picture data for a 16:9 TV monitor undergoes pan scan conversion that cuts off the right and left ends of the background picture. Since still picture data for a 4:3 TV monitor is originally designed to be displayed on the 4:3 TV monitor, conversion is skipped. Also, conversion of font data for a PC monitor is skipped.
  • the letter box conversion and pan scan conversion of the DVD-Video contents shown in FIGS. 14 and 15 can be designated as needed by the ENAV document, and can also be switched as needed by a user event issued by a user's operation.
  • DVD-Video contents C 1 are acquired from an enhanced DVD-Video disk D 2
  • ENAV contents C 21 or C 22 are acquired from at least one of the enhanced DVD-Video disk D 2 and external server unit 500 (ST 501 ).
  • the DVD-Video contents C 1 and image data contained in ENAV contents C 21 or C 22 undergo image processes as needed on the basis of actual monitor information, optimal monitor information, image conversion information (conversion control), and the characteristics of image data (those of still picture, moving picture, animation, font, background, and the like) (ST 502 ).
  • the image processes include the aforementioned pixel conversion process and resizing process.
  • the DVD-Video contents C 1 and ENAV contents C 21 or C 22 that have undergone the image processes are synchronously played back (ST 503 ).
  • the image data which have undergone the image processes are appropriately output to a predetermined monitor. In this way, contents can be displayed on the designated monitor by the intended display method.

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Databases & Information Systems (AREA)
  • Computer Graphics (AREA)
  • Television Signal Processing For Recording (AREA)
  • Signal Processing For Digital Recording And Reproducing (AREA)

Abstract

An information playback apparatus according to an aspect of this invention has an image processing unit configured to process contents and image data contained in expansion information as needed on the basis of actual monitor information indicating an actual output destination of the contents and the expansion information, and a playback unit configured to play back the contents, and to play back image data, which is contained in the expansion information and has undergone the image process as needed, in synchronism with playback of the contents.

Description

    CROSS-REFERENCE TO RELATED APPLICATIONS
  • This application is based upon and claims the benefit of priority from the prior Japanese Patent Application No. 2002-381577, filed Dec. 27, 2002, the entire contents of which are incorporated herein by reference. [0001]
    • BACKGROUND OF THE INVENTION
  • 1. Field of the Invention [0002]
  • The present invention relates to an information playback apparatus and information playback method for playing back contents stored in an information storage medium. [0003]
  • 2. Description of the Related Art [0004]
  • In recent years, the standard for a read-only DVD (Digital Versatile Disk) has been specified, and playback apparatus that play back video/audio information stored in read-only DVDs are commercially available. [0005]
  • According to the read-only DVD standard, the read-only DVD stores presentation data which records actual video and audio data, and navigation data used to manage the presentation data. The presentation data contains video data, audio data, and sub-picture data, which are multiplexed according to the specification of a program stream (2048 bytes) specified by MPEG2. The navigation data describes PGCs (ProGram Chains) and Cells, which set a time configuration and order of video and audio data to be played back. With this navigation data, multi-angle, multi-story, and parental functions can be implemented. [0006]
  • As a prior art associated with the above technique, an image display apparatus which provides a service that integrates a DVD-Video title and HTML file has been disclosed in Jpn. Pat. Appln. KOKAI Publication No. 11-161663. This image display apparatus extracts a URL from a navigation pack in a video object unit, and establishes connection to the Internet based on the extracted URL, so as to display data in conjunction with a scene to be played back. [0007]
  • According to the read-only DVD standard, only an MPEG2 program stream recorded on a disk can be played back, and information other than the MPEG2 program stream recorded on the disk cannot be played back. That is, the expandability of DVD playback is poor. [0008]
  • Jpn. Pat. Appln. KOKAI Publication No. 11-161663 above has a problem in the contents display method. Various types of monitors as display means are available: a personal computer monitor, 4:3 TV monitor, and 16:9 TV monitor. Since these monitors have different pixel layouts, they display identical contents in different patterns. For example, contents which are created for the 4:3 TV monitor are displayed in a horizontally elongated pattern when they are displayed on the 16:9 TV monitor, and are displayed in a vertically elongated pattern when they are displayed on the personal computer monitor. Since the contents are formed as a combination of elements such as DVD data, moving picture data, still picture data, font data, and the like, it is difficult to create contents for each monitor. [0009]
    • BRIEF SUMMARY OF THE INVENTION
  • An information playback apparatus according to an aspect of the present invention comprises a first acquisition unit configured to acquire contents from an information storage medium, a second acquisition unit configured to acquire expansion information from at least one of the information storage medium and an external apparatus via a communication line, an image processing unit configured to process the contents and image data contained in the expansion information as needed on the basis of actual monitor information indicating an actual output destination of the contents and the expansion information, and a playback unit configured to play back the contents, and to play back image data, which is contained in the expansion information and has undergone the image process as needed, in synchronism with playback of the contents. [0010]
  • An information playback method according to an aspect of the present invention comprises: acquiring expansion information from at least one of an information storage medium and an external apparatus via a communication line; processing contents acquired from the information storage medium and image data contained in the expansion information as needed on the basis of actual monitor information indicating an actual output destination of the contents and the expansion information; and playing back the contents, and playing back image data, which is contained in the expansion information and has undergone the image process as needed, in synchronism with playback of the contents.[0011]
    • BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWING
  • The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate presently preferred embodiments of the invention, and together with the general description given above and the detailed description of the preferred embodiments given below, serve to explain the principles of the invention. [0012]
  • FIG. 1 shows an example of the data structure of a DVD-Video disk; [0013]
  • FIG. 2 shows an example of the data structure of an enhanced DVD-Video disk; [0014]
  • FIG. 3 is a block diagram showing an example of a DVD playback apparatus (information playback apparatus); [0015]
  • FIG. 4 is a block diagram showing details of an element decoder and AV renderer adopted in the DVD playback apparatus shown in FIG. 3; [0016]
  • FIG. 5 shows an example of pixel conversion of contents for a PC monitor; [0017]
  • FIG. 6 is a view for explaining differences of the characteristics of a PC monitor, 4:3 TV monitor, and 16:9 TV monitor; [0018]
  • FIG. 7 is a flow chart showing an example of a contents display method assuming a case wherein contents respectively for a PC monitor, 4:3 TV monitor, and 16:9 TV monitor are prepared; [0019]
  • FIG. 8 is a flow chart showing an example of pixel conversion upon displaying contents for a 4:3 TV monitor on a 4:3 TV monitor, 16:9 TV monitor, and PC monitor; [0020]
  • FIG. 9 is a flow chart showing an example of pixel conversion upon displaying contents for a 16:9 TV monitor on a 4:3 TV monitor, 16:9 TV monitor, and PC monitor; [0021]
  • FIG. 10 is a flow chart showing an example of pixel conversion upon displaying contents for a PC monitor on a 4:3 TV monitor, 16:9 TV monitor, and PC monitor; [0022]
  • FIG. 11 shows an example upon displaying DVD-Video contents and ENAV contents on a 16:9 TV monitor; [0023]
  • FIG. 12 shows an example upon displaying DVD-Video contents and ENAV contents on a 4:3 TV monitor after LB conversion; [0024]
  • FIG. 13 shows an example upon displaying DVD-Video contents and ENAV contents on a 4:3 TV monitor after PS conversion; [0025]
  • FIG. 14 shows display example [0026] 1 upon displaying DVD-Video contents and ENAV contents on a 4:3 TV monitor after various kinds of conversion;
  • FIG. 15 shows display example [0027] 2 upon displaying DVD-Video contents and ENAV contents on a 4:3 TV monitor after various kinds of conversion;
  • FIG. 16 is a flow chart for explaining playback with an image process required to cope with various types of monitors; [0028]
  • FIG. 17 is a flow chart showing the flow upon playing back different contents in correspondence with the type of designated monitor; and [0029]
  • FIG. 18 shows an example of a CSS(Cascading-Style Sheet) file.[0030]
    • DETAILED DESCRIPTION OF THE INVENTION
  • A preferred embodiment of the present invention will be described hereinafter with reference to the accompanying drawings. [0031]
  • The data structure of a disk which considers compatibility to the DVD-Video standard will be explained first. [0032]
  • FIGS. 1 and 2 show examples of the data structures of DVD-Video disks which can be played back by a DVD-Video player shown in FIG. 3 (to be described later). [0033]
  • FIG. 1 shows an example of the data structure of a standard DVD-Video disk D[0034] 1. A DVD-Video area 3 of the standard DVD-Video disk D1 stores DVD-Video contents C1 (having an MPEG2 program stream structure).
  • On the other hand, FIG. 2 shows the data structure of an enhanced DVD-Video disk D[0035] 2. A DVD-Video area 3 of the enhanced DVD-Video disk D2 stores DVD-Video contents C1 (having an MPEG2 program stream structure) having the same data structure as the DVD-Video standard. Furthermore, another recording area 4 of the enhanced DVD-Video disk D2 stores enhanced navigation (to be abbreviated as ENAV hereinafter) contents C21 which allows a wide variety of playback of video contents. Note that the presence of the recording area 4 is also accepted in the DVD-Video standard.
  • The basic data structure of a DVD-Video disk will be explained below. The recording area of the DVD-Video disk includes a lead-in [0036] area 1, volume space, and lead-out area 5 in turn from its inner periphery. The volume space contains a volume/file structure information area 2, and DVD-Video area (DVD-Video zone) 3, and can also have another recording area (DVD other zone) 4 as an option.
  • The volume/file [0037] structure information area 2 is assigned for a UDF (Universal Disk Format) bridge. The volume of the UDF bridge format is recognized according to ISO/IEC13346 Part 2. A space that recognizes this volume consists of successive sectors, and starts from the first logical sector of the volume space in FIGS. 1 and 2. First 16 logical sectors are reserved for system use specified by IS09660. In order to assure compatibility to the conventional DVD-Video standard, the volume/file structure information area 2 with such contents is required.
  • The DVD-[0038] Video area 3 records management information called video manager VMG 30 and one or more video contents called video title sets VTS (VTS# 1 to VTS#n). The VMG 30 is management information for all VTSs present in the DVD-Video area 3, and contains control data VMGI, VMG menu data VMGM_VOBS (option), and VMG backup data. Each VTS contains control data VTSI of that VTS, VTS menu data VTSM_VOBS (option), data VTSTT_VOBS of the contents (movie or the like) of that VTS (title), and VTSI backup data. To assure compatibility to the conventional DVD-Video standard, the DVD-Video area with such contents is also required.
  • A playback select menu or the like of each title ([0039] VTS# 1 to VTS#n) is given in advance by a provider (the producer of a DVD video disk) using the VMG, and a playback chapter select menu, the playback order of recorded contents (cells), and the like in a specific title (e.g., VTS#1) are given in advance by the provider using the VTSI. Therefore, the viewer of the disk (the user of the DVD-Video player) can enjoy the recorded contents of that disk in accordance with menus of the VMG/VTSI prepared in advance by the provider and playback control information (program chain information PGCI) in the VTSI. However, with the DVD-Video standard, the viewer (user) cannot play back the contents (movie or music) of each VTS by a method different from the VMG/VTSI prepared by the provider.
  • The enhanced DVD-Video disk D[0040] 2 shown in FIG. 2 is prepared for a mechanism that allows the user to play back the contents (movie or music) of each VTS by a method different from the VMG/VTSI prepared by the provider, and to play back while adding contents different from the VMG/VTSI prepared by the provider. The ENAV contents C21 contained in this disk D2 cannot be accessed by a DVD-Video player which is manufactured on the basis of the conventional DVD-Video standard (even if the ENAV contents can be accessed, their contents cannot be used). However, a DVD-Video player (player in FIG. 3 or the like) can access the ENAV contents C21, and can use their playback contents.
  • The ENAV contents C[0041] 21 (C22) are configured to contain audio data, still picture data, font/text data, moving picture data, animation data, and the like, and also an ENAV document (described in a Markup/Script language) as information for controlling playback of these data. This playback control information describes, using a Markup language or Script language, playback methods (display method, playback order, playback switch sequence, selection of data to be played back, and the like) of the ENAV contents (consisting of audio, still picture, font/text, moving picture, animation, and the like) and/or the DVD-Video contents C1. For example, Markup languages such as HTML (Hyper Text Markup Language)/XHTML (extensible Hyper Text Markup Language), SMIL (Synchronized Multimedia Integration Language), and the like, Script languages such as an ECMA (European Computer Manufacturers Association) script, JavaScript, and the like, and so forth, may be used in combination.
  • Since the contents of the enhanced DVD-Video disk D[0042] 2 in FIG. 2 except for the other recording area comply with the DVD-Video standard, video contents recorded on the DVD-Video area can be played back using an already prevalent DVD-Video player (i.e., this disk is compatible to the conventional DVD-Video disk D1).
  • The ENAV contents C[0043] 21 recorded on the other recording area cannot be played back (or used) by the conventional DVD-Video player but can be played back and used by a DVD-Video player (FIG. 3) according to an embodiment of the present invention. Therefore, when the ENAV contents C21 (and also ENAV contents C22) are played back using the DVD-Video player according to an embodiment of the present invention, the user can enjoy not only the contents of the VMG/VTSI prepared in advance by the provider but also a variety of video playback features.
  • FIG. 3 shows an example of a DVD-Video player used to play back an enhanced DVD-Video disk (FIG. 2) according to the embodiment of the present invention. This DVD-Video player plays back and processes recorded contents (DVD-Video contents C[0044] 1 and/or ENAV contents C21) from the enhanced DVD-Video disk D2 (FIG. 2) which is compatible to the DVD-Video standard, and downloads and processes ENAV contents C22 via a communication line such as the Internet or the like. Note that the ENAV contents C21 are first expansion information, and the ENAV contents C22 are second expansion information.
  • Note that ENAV contents C[0045] 21 and C22 are one type of expansion information.
  • The DVD-Video player shown in FIG. 3 comprises a DVD-[0046] Video playback engine 100, ENAV engine 200, disk unit 300, and user interface unit 400. The DVD-Video playback engine 100 plays back and processes an MPEG2 program stream (DVD-Video contents C1) recorded on the disk D2. The ENAV engine 200 plays back and processes the ENAV contents C21 and C22. The disk unit 300 reads out the DVD-Video contents C1 and/or ENAV contents C21 recorded on the disk D2. The user interface unit 400 transmits inputs (user's operations) by the user of the player as user trigger.
  • The [0047] ENAV engine 200 comprises an Internet connection unit 211. The Internet connection unit 211 serves as a communication means used to establish connection to a communication line such as the Internet or the like. Furthermore, the ENAV engine 200 comprises an ENAV buffer unit (preload/download buffer) 209, XHTML+SMIL/CSS parser 210, XHTML/CSS layout manager 207, ECMA Script interpreter & DOM manipulator 205, SMIL timing engine 206, ENAV interface handler 202, element decoders 2081 and 2082, AV renderer 203, buffer manager 204, download manager 213, network manager 212, and ENAV system clock 214.
  • In the block arrangement shown in FIG. 3, a DVD-[0048] Video playback controller 102, a DVD-Video decoder 101, a DVD system clock 103, the ENAV interface handler 202, the XHTML+SMIL/CSS parser 210, the ECMA Script interpreter & DOM manipulator 205, the SMIL timing engine 206, the XHTML/CSS layout manager 207, the AV renderer 203, the element decoders 2081 and 2082, the buffer manager 204, the download manager 213, the network manager 212, the ENAV system clock 214, and the like can be implemented by a microcomputer (and/or hardware logic) which serves as functions of the respective blocks by an installed program (firmware; not shown). A work area used upon executing this firmware can be assured on a semiconductor memory (and a hard disk as needed; not shown) in the respective blocks.
  • The DVD-[0049] Video playback engine 100 is a device for playing back the DVD-Video contents C1 based on the existing DVD-Video standard, and includes the DVD-Video decoder 101 which decodes the DVD-Video contents C1 loaded by the disk unit 300, the DVD-Video playback controller 102 which makes playback control of the DVD-Video contents C1, and the DVD system clock 103 that determines the decode and output timings in the DVD-Video decoder.
  • The DVD-Video decoder [0050] 101 has a function of decoding video data, audio data, and sub-picture data based on the existing DVD-Video standard, and outputting the decoded video data (mixed data of the aforementioned video and sub-picture data) and audio data, respectively. With this function, the DVD-Video playback engine 100 has the same function as that of a playback engine of a normal DVD-Video player, which is manufactured based on the existing DVD-Video standard. That is, the player shown in FIG. 3 can play back video data, audio data, and the like of an MPEG2 program stream as in a normal DVD-Video player, and can play back an existing DVD-Video disk (complying with the conventional DVD-Video standard) D1.
  • In addition, the DVD-[0051] Video playback controller 102 can also control playback of the DVD-Video contents C1 in accordance with a “DVD control” signal output from the ENAV engine 200. More specifically, if an arbitrary event (e.g., menu call or title jump) has occurred in the DVD-Video playback engine 100 in a DVD-Video playback mode, the DVD-Video playback controller 102 can output a “DVD trigger” signal indicating the playback status of the DVD-Video contents C1 to the ENAV engine 200. In this case (simultaneously with output of the DVD trigger signal or at an appropriate timing before and after the output), the DVD-Video playback controller 102 can output a “DVD status” signal indicating property information (e.g., an audio language, sub-picture subtitle language, playback operation, playback position, various kinds of time information, disk contents, and the like set in the player) of the DVD-Video player to the ENAV engine 200.
  • The [0052] ENAV interface handler 202 receives “user trigger” signals corresponding to user's operations (menu call, title jump, play start, play stop, play pause, etc.) from the user interface unit 400. The ENAV interface handler 202 then transfers the received “user trigger” signals as corresponding ENAV events to the ECMA Script interpreter & DOM manipulator 205. For example, the ENAV document makes the following instructions in response to the ENAV events.
  • 1. Issue an ENAV command corresponding to a user's operation. That is, the same command as the user's operation is transferred to the DVD-[0053] Video playback engine 100 as DVD control.
  • 2. Issue an ENAV command different from a user's operation. That is, the user's operation is replaced by another operation in accordance with the instruction of the ENAV document. [0054]
  • 3. Ignore the user trigger. That is, the user event is inhibited since, for example, a DVD-Video playback process that is not designed by the contents provider may be made. [0055]
  • Note that the contents of the user trigger signal transmitted to the [0056] ENAV interface handler 202 may be transmitted to the AV renderer 203 as an “AV output control” signal. As a result, for example, when the user has changed the contents or window size or has shifted its display position using a cursor key of a remote controller (not shown), a user trigger signal is output to the AV renderer 203 as a corresponding AV output control signal. In addition, when a user event indicating switching between a video/audio output from the DVD-Video playback engine 100 and that from the ENAV engine 200 is sent to the AV renderer 203, the video/audio output can be switched in response to user's operation.
  • The [0057] ENAV interface handler 202 exchanges a “DVD status” signal, “DVD trigger” signal, and/or “DVD control” signal with the DVD-Video playback controller 102, or exchanges a “user trigger” signal with the user interface unit 400. Furthermore, the ENAV interface handler 202 exchanges an “ENAV event”, “ENAV property”, “ENAV command”, and “ENAV control” signal with the ECMA Script interpreter & DOM manipulator 205 and SMIL timing engine 206. More specifically, the ENAV interface handler 202 executes the following processes.
  • 1. The [0058] handler 202 transmits a “DVD trigger” signal which is received from the DVD-Video playback engine 100 and indicates the operation of the DVD-Video playback engine 100, or a “user trigger” which is received from the user interface unit 400 and indicates the user's operation to the ECMA Script interpreter & DOM manipulator 205 and SMIL timing engine 206 as an “ENAV event”.
  • 2. The [0059] handler 202 transmits a “DVD status” signal which is received from the DVD-Video playback engine 100 and indicates the playback status of the DVD-Video playback engine 100 to the ECMA Script interpreter & DOM manipulator 205 and SMIL timing engine 206 as an “ENAV property”. At this time, DVD status information is saved in a property buffer 202 a of the ENAV interface handler 202 as needed.
  • 3. The [0060] handler 202 transmits an “ENAV control” signal from the SMIL timing engine 206 to the DVD-Video playback engine 100 as a “DVD control” signal.
  • 4. The [0061] handler 202 outputs a “DVD control” signal used to control playback of the DVD-Video playback engine 100 to the DVD-Video playback engine 100, an “AV output control” signal used to switch video and audio data to the AV renderer 203, a “buffer control” signal used to load/erase the contents of the buffer to the buffer manager 204, a “download control” signal used to download ENAV contents stored in the server unit to the download manager 213, and an “element control” signal that instructs to decode ENAV elements to the element decoders 2081 and 2082, in accordance with the contents of an “ENAV command” signal from the ECMA Script Interpreter & DOM manipulator 205.
  • 5. The [0062] handler 202 measures information of the DVD system clock in the DVD-Video playback engine 100 using its DVD timing generator 202 b, and transfers it as a “DVD timing” signal to the element decoder 2082. That is, the element decoder 2082 can decode ENAV elements in synchronism with the system clocks of the DVD-Video playback engine 100.
  • As described above, the [0063] ENAV interface handler 202 has a function of parsing and interpreting ENAV contents, and then converting control signals and the like between the DVD-Video playback engine 100 and ENAV engine 200.
  • The [0064] ENAV interface handler 202 is configured to exchange a first signal and to exchange a second signal on the basis of the contents which are parsed by the XHTML+SMIL/CSS parser 210 and are interpreted by the ECMA Script interpreter & DOM manipulator 205 and SMIL timing engine 206, or a user trigger from an input device. In other words, the ENAV interface handler 202 controls the output states of video and audio signals by the AV renderer 203 on the basis of at least one of the first signal exchanged with the DVD-Video playback controller 102, and the second signal exchanged with the ECMA Script interpreter & DOM manipulator 205 and SMIL timing engine 206. The first signal pertains to the playback status of the DVD-Video disk D2, and corresponds to the “DVD control” signal, “DVD trigger” signal, “DVD status” signal, and the like. The second signal pertains to the contents of the ENAV contents, and corresponds to the “ENAV event” signal, “ENAV command” signal, “ENAV property” signal, “ENAV control” signal, and the like.
  • Note that the [0065] ENAV interface handler 202 is configured to execute processes corresponding to user triggers in accordance with the ENAV document. The AV renderer 203 is configured to mix video/audio data generated by the element decoder 2081 with video/audio data played back by the DVD-Video playback engine 100, and to output the mixed data on the basis of the execution result of the process corresponding to the user trigger signal. Or the AV renderer 203 is configured to select one of video/audio data generated by the element decoder 2081 and video/audio data played back by the DVD-Video playback engine 100, and to output the selected video/audio data on the basis of the execution result of an ENAV command in the ENAV interface handler 202.
  • Generally speaking, the XHTML+SMIL/[0066] CSS parser 210 parses an ENAV document indicating playback control information, which is contained in the ENAV contents C21 acquired from the DVD-Video disk D2 or the ENAV contents C22 acquired from the Internet or the like. The ENAV document is made up of a combination of Markup languages such as HTML/XHTML, SMIL, and the like, and Script languages such as ECMA Script, JavaScript, and the like, as described above. The XHTML+SMIL/CSS parser 210 has a function of transmitting an ECMA Script module to the ECMA Script interpreter & DOM manipulator 205, SMIL module to the SMIL timing engine 206, and XHTML module to the XHTML/CSS layout manager 207 in accordance with the parsing result.
  • The ECMA Script interpreter & [0067] DOM manipulator 205 interprets the aforementioned ECMA Script module and follows its instruction. That is, the ECMA Script interpreter & DOM manipulator 205 has a function of issuing an “ENAV command” signal to the ENAV interface handler 202 in correspondence with an “ENAV event” signal sent from the ENAV interface handler 202 or an “ENAV property” signal read from the property buffer of the ENAV interface handler 202.
  • At this time, the ECMA Script interpreter & [0068] DOM manipulator 205 issues an “ENAV command” signal to the DVD-Video playback engine 100 or issues an “element control” signal to the element decoder 2081 in accordance with the time measured by the ENAV system clock 214, thus controlling the DVD-Video playback engine 100 or decoding ENAV elements (audio, still picture, text/font, moving picture/animation).
  • The [0069] SMIL timing engine 206 interprets the aforementioned SMIL module and follows its instruction. That is, the SMIL timing engine 206 has a function of issuing an “ENAV control” signal to the ENAV interface handler 202 or element decoder 208 in correspondence with an “ENAV event” signal sent from the ENAV interface handler 202 or an “ENAV property” signal read from the property buffer of the ENAV interface handler 202 in accordance with the ENAV System clock 214. With this function, control of the DVD-Video playback engine 100 and playback of video data (moving picture, still picture, animation) and audio data can be achieved at a desired timing.
  • The XHTML/[0070] CSS layout manager 207 interprets the aforementioned XHTML module and follows its instruction. That is, the XHTML/CSS layout manager 207 outputs a “layout control” signal to the AV renderer. The “layout control” signal contains information associated with the size and position of a video window to be output (this information often contains information associated with a display time such as display start, end, or continue), and information associated with the level of audio data to be output (this information often contains information associated with an output time such as output start, end, or continue). Also, text information to be displayed, which is contained in the XHTML module, is sent to the element decoder 208, and is decoded and displayed using desired font data.
  • Practical methods of parsing and interpreting Markup and Script languages can adopt the same methods as parsing/interpretation in state-of-the-art techniques such as HTML/XHTML, SMIL, and the like or ECMA Script, JavaScript, and the like (the hardware used is the microcomputer that has been mentioned at the beginning of the description of FIG. 3). Note that commands and variables described in Scripts are different since objects to be controlled are different. The ENAV document used upon practicing the present invention uses unique commands and variables associated with playback of the DVD-Video disk D[0071] 2 and/or the ENAV contents C21 or C22. For example, a command that switches the playback contents of the DVD-Video disk D2 or the ENAV contents C21 or C22 in response to a given event is unique to a Markup or Script language in the ENAV document.
  • As another example of commands and variables unique to a Markup or Script language in the ENAV document, those which are used to change the video size from the DVD-[0072] Video playback engine 100 and/or ENAV engine 200 and to change the layout of that video data are available. A change in video size is designated using a size change command and a variable that designates the size after change. A change in video layout is designated by a display position change command and a variable that designates the coordinate position or the like after change. When objects to be displayed overlap on the screen, a variable that designates depth ordering is added. Also, commands and variables used to change the audio level from the DVD-Video playback engine 100 and/or ENAV engine 200 or to select an audio language to be used are available. A change in audio level is designated by an audio level change command and a variable that designates an audio level after change. An audio language to be used is selected by an audio language change command and a variable that designates the type of language after change. Furthermore, commands and variables used to control user trigger from the user interface unit 400.
  • On the basis of the commands/variables of the Markup and Script languages in the ENAV document, as exemplified above, a “layout control” signal is sent from the XHTML/CSS layout manager (some functions are often implemented by the SMIL timing engine [0073] 206) to the AV renderer 203. The “layout control” signal controls the layout on the screen, size, output timing, and output time of video data to be displayed on, e.g., an external monitor device or the like (not shown), and/or the tone-volume, output timing, and output time of audio data to be played back from an external loudspeaker (not shown).
  • The element decoder [0074] 208 decodes ENAV contents data such as audio data, still picture data (include background picture data), text/font data, moving picture data, animation data, and the like contained in the ENAV contents C21 or C22. That is, the element decoder 208 includes an audio decoder, still picture decoder, text/font decoder, and animation/moving picture decoder in correspondence with objects to be decoded. For example, audio data in the ENAV contents, which is encoded by, e.g., MPEG, AC-3, or DTS is decoded by the audio decoder and is converted into non-compressed audio data. Still picture data or background picture data, which is encoded by JPEG, GIF, or PNG, is decoded by the still picture decoder, and is converted into non-compressed image data. Likewise, moving picture/animation data, which is encoded by MPEG2, MPEG4, Macromedia Flash, or SVG (Scalable Vector Graphics) is decoded by the moving picture/animation decoder, and is converted into non-compressed moving picture data. Text data contained in the ENAV contents is decoded by the text/font decoder using font data contained in the ENAV contents, and is converted into text image data which can be superimposed on a moving or still picture. Video/audio data, which contains these decoded audio data, image data, animation/moving picture data, and text image data as needed, is sent from the element decoder 208 to the AV renderer 203.
  • These ENAV contents are decoded in accordance with an instruction of an “element control” signal from the [0075] ENAV interface handler 202. Also, ENAV contents (e.g., audio commentary data, audio after-recording data) which are synchronous with the DVD-Video contents are decoded in synchronism with a “DVD timing” signal from the ENAV interface handler 202. Furthermore, ENAV contents which are asynchronous with the DVD-Video contents are decoded in synchronism with an “ENAV timing” signal from the ENAV system clock 214.
  • The [0076] AV renderer 203 has a function of controlling a video/output output. More specifically, the AV renderer 203 controls, e.g., the video display position and size (often including the display timing and display time together), and the audio level (often including the output timing and output time together) in accordance with the “layout control” signal output from the XHTML/CSS layout manager 207. Also, the AV renderer 203 performs pixel conversion of a video to be displayed in accordance with the type of the designated monitor and/or the type of the video to be displayed. The video/output outputs to be controlled are those from the DVD-Video playback engine 100 and element decoder 2081. Furthermore, the AV renderer 203 has a function of controlling mixing and switching of the DVD-Video contents C1 and ENAV contents C21 or C22 in accordance with an “AV output control” signal output from the ENAV interface handler 202.
  • Note that the [0077] ENAV engine 200 in the DVD-Video player in FIG. 3 comprises an interface for sending the ENAV document in the ENAV contents C21 read from the DVD-Video disk D2 to the XHTML+SMIL/CSS parser 210 via the ENAV buffer unit 209, and an interface for sending data (audio data, still picture data, text/font data, moving picture data, and the like) in the read ENAV contents C21 to the element decoder 208 via the ENAV buffer unit 209. These interfaces form an interface (first interface) independent from the Internet connection unit 211 in FIG. 3.
  • The DVD-Video player in FIG. 3 comprises an interface for receiving the ENAV contents C[0078] 22 from a communication line such as the Internet or the like, and sending the ENAV document in the received ENAV contents C22 to the XHTML+SMIL/CSS parser 210 via the ENAV buffer unit 209, and an interface for sending data (audio data, still picture data, text/font data, moving picture data, and the like) in the received ENAV contents C22 to the element decoder 208 via the ENAV buffer unit 209. These interfaces form the Internet connection unit (second interface) shown in FIG. 3.
  • The [0079] ENAV buffer unit 209 comprises buffers used to store the ENAV contents C22 downloaded from the server unit 500, and to store the ENAV contents C21 loaded from the enhanced DVD-Video disk D2 by the disk unit 300.
  • The [0080] ENAV buffer unit 209 reads the ENAV contents C22 on an external server (server unit 500) under the control of the buffer manager 204 based on the ENAVE documents (Markup/Script language), and downloads the ENAV contents C22 via the Internet connection unit 211.
  • The [0081] ENAV buffer unit 209 loads the ENAV contents C21 recorded on the enhanced DVD-Video disk D2 under the control of the buffer manager 204 based on the ENAV document (Markup/Script language). At this time, if the disk unit 300 is a device that can access the disk at high speed, it can read out the ENAV contents C21 from the enhanced DVD-Video disk D2 while playing back the DVD-Video contents C1, i.e., reading out DVD-Video data from the enhanced DVD-Video disk D2. If the disk unit 300 is not a device that can make high-speed access, or if the playback operation of the DVD-Video contents C1 is to be perfectly guaranteed, playback of the DVD-Video contents C1 must not be interrupted. In such case, the ENAV contents C21 are read out from the enhanced DVD-Video disk D2 and are stored in a preload unit (not shown) of the ENAV buffer unit 209 in advance prior to the beginning of playback. In this way, since the ENAV contents C21 are read out from the preload unit simultaneously when the DVD-Video contents C1 are read out from the enhanced DVD-Video disk D2, the load on the disk unit 300 can be reduced. Hence, the DVD-Video contents C1 and ENAV contents can be simultaneously played back without interrupting playback of the DVD-Video contents C1.
  • In this way, when the ENAV contents C[0082] 22 downloaded from the server unit 500 are stored in the ENAV buffer unit 209 in the same manner as the ENAV contents C21 recorded on the enhanced DVD-Video disk D2, the DVD-Video contents C1 and ENAV contents C22 can be simultaneously read out and played back.
  • The [0083] ENAV buffer unit 209 has a limited storage capacity. That is, the data size of ENAV contents C21 or C22 that can be stored in the ENAV buffer unit 209 is limited. For this reason, it is possible to erase ENAV contents C21 or C22 with low necessity and to save those with high necessity under the control of the buffer manager 204 (buffer control). Such save control and erase control may be automatically executed by the ENAV buffer unit 209.
  • The [0084] buffer manager 204 can send the following instructions as “buffer control” to the ENAV buffer unit 209 in accordance with an instruction of the ENAV document.
  • load a specific file or a part of file from a server (download) [0085]
  • load a specific file or a part of file from a disk (preload) [0086]
  • erase a specific file or a part of file from a buffer [0087]
  • The [0088] download manager 213 has a function of acquiring download data from the enhanced DVD disk D2 of the disk unit 300 or the server unit 500 in accordance with an instruction of the ENAV document, parsing the download data, downloading required ENAV contents from the server unit 500 (download control), and holding the downloaded contents in the ENAV buffer unit 209.
  • For example, when the download data is made up of a file name to be downloaded, location, file size, and contents type, the [0089] download manager 213 loads download data on the disk or that on the server at a timing designated by the ENAV document. The download manager 213 instructs to download data in the order they are described in the file (or all data at the same time) (download control).
  • For example, when the download data is made up of a file name to be downloaded, location, file size, contents type, playback start time, and playback end time, the [0090] download manager 213 loads the ENAV document, and also download data on the disk or that on the server designated by the ENAV document at the same time. The download manager 213 loads ENAV contents with high priority of playback until the ENAV buffer becomes full of data with reference to the file size and playback start time of the download data, and starts playback. Then, the download manager 213 erases ENAV contents that have been played back from the ENAV buffer with reference to the playback end time, and loads new ENAV contents.
  • The [0091] network manager 212 controls the operation of the Internet connection unit 211. That is, when the ENAV document instructs connection/disconnection to/from the network as an ENAV command, the network manager 212 switches connection/disconnection of the Internet connection unit 211.
  • The building components of the ENAV engine in FIG. 3 can also be summarized as follows. That is, the ENAV engine comprises: [0092]
  • XHTML+SMIL/[0093] CSS Parser 210
  • The XHTML+SMIL/[0094] CSS parser 210 parses the contents of the ENAV documents.
  • ECMA Script Interpreter & [0095] DOM Manipulator 205, SMIL Timing Engine 206, XHTML/CSS Layout Manager 207
  • The ECMA Script Interpreter & [0096] DOM manipulator 205, SMIL timing engine 206, and XHTML/CSS layout manager 207 respectively interpret the parsed modules.
  • [0097] ENAV Interface Handler 202
  • The [0098] ENAV interface handler 202 handles control signals from the ECMA Script Interpreter & DOM manipulator 205 and SMIL timing engine 206, and those from the DVD-Video playback controller 102.
  • Element Decoder [0099] 208
  • The element decoder [0100] 208 generates video/audio data corresponding to audio data, still picture data, text/font data, moving picture data, and the like contained in the ENAV contents C21 or C22 synchronized system clock of the DVD playback engine and ENAV engine.
  • [0101] AV Renderer 203
  • The [0102] AV renderer 203 outputs data obtained by mixing video/audio data generated by the element decoder 208 to that played back by the DVD-Video playback engine 100 on the basis of the execution result of the ENAV command in the ENAV interface handler 202. Or the AV handler 203 selectively outputs one of video/audio data generated by the element decoder 208 and that played back by the DVD-Video playback engine 100 on the basis of the execution result of the ENAV command in the ENAV interface handler 202.
  • [0103] ENAV Buffer Unit 209
  • The [0104] ENAV buffer unit 209 temporarily stores the ENAV contents C22 acquired from the disk unit 300 or from the server unit 500 via the Internet connection unit 211.
  • [0105] Download Manager 213
  • The [0106] download manager 213 downloads ENAV contents from the server unit to the ENAV buffer on the basis of download data.
  • [0107] Network Manager 212
  • The [0108] network manager 212 controls connection/disconnection to/from the network and the like in accordance with an instruction of the ENAV document.
  • FIG. 4 is a schematic view showing a pixel conversion function and related functions. [0109]
  • The DVD-Video contents are decoded by the decoder [0110] 101 of the DVD-Video playback engine 100, and undergo one of “letter box conversion (LB conversion)”, “pan scan conversion (PS conversion)”, and “no conversion” in an LB/PS converter 101a in accordance with an instruction (conversion control) of the XHTML/CSS layout manager 207 based on the ENAV document (LB/PS conversion). Furthermore, the converted contents are converted to a designated size by a DVD-Video resizing unit 203 f in accordance with an instruction (conversion control) of the XHTML/CSS layout manager 207 (reduction, enlargement, equal magnification). The layout of the converted contents on a monitor is determined by a layout engine 203 j in accordance with an instruction (layout control) of the XHTML/CSS layout manager 207 based on the ENAV document, and the converted contents are then mixed with other ENAV elements (still picture, animation/moving picture, font, background) by a mixer 203 k.
  • At this time, switching of “LB conversion”, “PS conversion”, and “no conversion” by the XHTML/[0111] CSS layout manager 207 may be made by user's operations as long as the description of the ENAV document permits. That is, a switching instruction of the conversion is transferred as DVD control to the DVD-Video playback controller 102 of the DVD-Video playback engine 100 in response to a user trigger from the user interface unit 400.
  • Still picture data and animation/moving picture data are respectively decoded by a [0112] still picture decoder 2081a and animation/moving picture decoder 2081b of the element decoder 2081. The converted data then undergo pixel conversion in a still picture converter 203 a or animation/moving picture pixel converter 203 b in the AV renderer 203 on the basis of an instruction (conversion control) of the XHTML/CSS layout manager 207, ‘information of a monitor designated as an output destination (monitor information)’ which can be acquired from the ENAV interface handler, and the information (image information) from the still picture decoder 2081 a and animation/moving picture decoder 2081 b (still picture pixel conversion and animation/moving picture pixel conversion).
  • The monitor information indicates one of “4:3 TV monitor”, “16:9 TV monitor”, and “PC monitor” as the monitor designated as an output destination. In other words, the monitor information is information (actual monitor information) indicating that an actual monitor as an output destination is a PC monitor, 4:3 TV monitor, or 16:9 TV monitor. Also, the image information indicates on which of monitors, i.e., one of “4:3 TV monitor”, “16:9 TV monitor”, “PC monitor”, and “no designation” the decoded still picture data and animation/moving picture data are designed to be displayed. In other words, the image information is information (optimal monitor information) which indicates an optimal monitor (one of a PC monitor, 4:3 TV monitor, and 16:9 TV monitor) used to output. [0113]
  • For example, the aforementioned still picture data and animation/moving picture data have a field that records information indicating on which of monitors these data are designed to be displayed. The respective decoders decode data themselves, and also read this monitor information. The decoders send the read monitor information to the [0114] pixel converters 203 a, 203 b, 202 c, and 202 d. Furthermore, the ENAV document describes “PS conversion”, “LB conversion”, or “no conversion” when image information (optimal monitor information) and monitor information (actual monitor information) have different contents for given still picture data or animation/moving picture data. This information is supplied to the pixel converters 203 a, 203 b, 202 c, and 202 d as conversion control.
  • Moreover, the image information (optimal monitor information) may be recorded as, e.g., the file name of still picture data or animation/moving picture data in place of internal data of the still picture data or animation/moving picture data. [0115]
  • For example, when the monitor information (actual monitor information) of given still picture data or animation/moving picture data indicates “4:3 TV monitor” and the image information (optimal monitor information) also indicates “4:3 TV monitor”, since information of image data matches that of the monitor, conversion is unconditionally skipped. When the monitor information (actual monitor information) indicates “16:9 TV monitor”, and the image information (optimal monitor information) indicates “4:3 TV monitor”, since information of image data is different from that of the monitor, designated conversion (one of PS conversion, LB conversion, and no conversion) is made in accordance with the description of the ENAV document. [0116]
  • As another example, the ENAV document describes information indicating on which of monitors still picture data and animation/moving picture data are designed to be displayed in some cases. That is, even when still picture data or animation/moving picture data does not record any image information, or even when the [0117] pixel converters 203 a, 203 b, 202 c, and 202 d do not acquire any image information from the decoders 2081 a, 2081 b, and 2081 c, one of conversion processes can be made in accordance with the monitor information (actual monitor information) and the description of the ENAV document.
  • The still picture data and animation/moving picture data that have undergone pixel conversion are converted to a designated size (reduction, enlargement, equal magnification, or the like), as shown in FIG. 5, by a still [0118] picture resizing unit 203 g or animation/moving picture resizing unit 203 h, in accordance with an instruction (conversion control) of the XHTML/CSS layout manager 207 (still picture resizing, animation/moving picture resizing).
  • DVD-Video data is resized by the DVD-[0119] Video resizing unit 203 f as needed. Still picture data is resized by the still picture resizing unit 203 g as needed. Also, animation/moving picture data is resized by the animation/moving picture resizing unit 203 h as needed. Furthermore, background picture data is resized by a background picture resizing unit 203 i as needed.
  • The order of pixel conversion and resizing may be reversed. That is, after data may be resized to a designated size, they may undergo designated pixel conversion. Upon executing pixel conversion and resizing, image quality deteriorates in each conversion process. Hence, the order of pixel conversion and resizing may be changed depending on the conversion method and resizing method, thus suppressing such deterioration. For example, when enlargement (resizing) is done after LB conversion (pixel conversion), errors produced by LB conversion are enlarged by enlargement. In this case, when LB conversion (pixel conversion) is done after enlargement (resizing), errors can be prevented from being enlarged. [0120]
  • Finally, the resized still picture data and animation/moving picture data are laid out by the [0121] layout engine 203 j at locations designated by the ENAV document (layout control from the XHTML/CSS layout manager 207). Then, these data are mixed with the DVD-Video data and other ENAV elements (font, background) on a frame memory of the mixer 203 k.
  • Text data of the ENAV document is decoded by a [0122] font decoder 2081 c of the element decoder 2081 using font data, and is rasterized by a font engine/font pixel converter 202 c. At the same time, the font engine/font pixel converter 202 c executes pixel conversion (font pixel conversion) as needed on the basis of ‘information of a monitor designated as an output destination (monitor information)’ which can be acquired from the ENAV interface handler, and information (image information) from the font decoder 2081 c, in accordance with an instruction (conversion control) of the XHTML/CSS layout manager 207. Note that the conversion control, monitor information (actual monitor information), and image information (optimal monitor information) are the same as those of the aforementioned still picture data and animation/moving picture data.
  • Since font data corresponding to sizes to be displayed are pre-stored, they need not be resized if the XHTML/[0123] CSS layout manager 207 uses required font data. However, if the types of font sizes stored as font data are not sufficient, font data of a given size must be converted (enlarged or reduced) into that of the designated size.
  • Furthermore, the rasterized font data undergoes corrections of the character spacing and width in a [0124] line layout engine 203 n. This is a function of adjusting a character string or the number of characters to be laid out per line/column designated by the ENAV document to fall within the range, as designated by the ENAV document. For example, when a character string to be laid out in one line extends across two lines, it is laid out to fall within one line by reducing the character spacing or width. Conversely, when a character string to be laid out over the entire line cannot fill up that line, it is laid out over the entire line by increasing the character spacing or width.
  • Finally, the font data is laid out by the [0125] layout engine 203 j at the location designated by the ENAV document (layout control). Then, the font data is mixed with the DVD-Video data and other ENAV elements (still picture, animation/moving picture, background) on the frame memory of the mixer 203 k.
  • As for background picture data, there are two cases, i.e., a case wherein still picture data recorded on the enhanced DVD disk or [0126] server unit 500 is used and a case wherein the AV renderer 203 generates a designated background picture.
  • In the former case, still picture data which is designated by the ENAV document as a background picture is decoded by a [0127] background picture decoder 2081 d in the element decoder 2081. Furthermore, the decoded background picture data undergoes pixel conversion (background picture pixel conversion) by a background picture pixel converter 202 d in the AV renderer 203 on the basis of an instruction (conversion control) from the XHTML/CSS layout manager 207, ‘information of a monitor designated as an output destination (monitor information)’ which can be acquired from the ENAV interface handler, and the information (image information) from the background picture decoder. Note that the conversion control, monitor information (actual monitor information), and image information (optimal monitor information) are the same as those of the aforementioned still picture data and animation/moving picture data.
  • Furthermore, the background picture data that has undergone pixel conversion is converted into a designated size (reduction, enlargement, equal magnification, or the like) by the background [0128] picture resizing unit 203 i in accordance with an instruction (conversion control) of the XHTML/CSS layout manager 207 (background picture resizing).
  • The resized background picture data is rasterized on a background frame memory (not shown) by a method designated by the ENAV document. For example, as the rasterizing method, a method of laying out one background picture data at the designated location, and a method of laying out a plurality of identical background picture data side by side are available. [0129]
  • Finally, the data on the background frame memory is rasterized on the frame memory of the [0130] mixer 203 k. At this time, the EX-OR of the data on the background frame memory and the data on the frame memory of the mixer 203 k, which include the DVD-Video data and other ENAV elements (still picture, animation/moving picture, font), is added to the frame memory of the mixer 203 k. That is, the data on the background frame memory is laid out on the frame memory of the mixer 203 k with respect to pixels on the frame memory of the mixer 203 k where none of still picture data, animation/moving picture data, and font data are laid out. In this way, the still picture data, animation/moving picture data, and font data are laid out in preference to (above) the background picture data.
  • In the latter case, a [0131] background generator 203 e of the AV renderer 203 generates data used as a background on the basis of information such as “color”, “pattern”, and the like designated by the ENAV document. The generated-background data is rasterized on the background frame memory, and is mixed with the DVD-Video data and other ENAV elements on the frame memory of the mixer 203 k in the same manner as in the former case.
  • The priority of overlapping among DVD-Video data, ENAV elements including background data is defined by Markup document such as HTML/XHTML and CSS. In other words, transparency (so-called alpha-blending) of each element (that is, DVD-Video, ENAV elements including background data) is described in the Markup document. [0132]
  • The DVD-Video contents and ENAV contents rasterized on the frame memory of the [0133] mixer 203 k are D/A-converted by a D/A converter & LB/PS converter 203 m. The converted contents then undergo a “PS conversion”, “LB conversion”, or “no conversion” process in accordance with an instruction (conversion control) of the XHTML/CSS layout manager 207, and are output to the connected monitor (D/A conversion & LB/PS conversion). At this time, switching of “LB conversion”, “PS conversion”, and “no conversion” by the XHTML/CSS layout manager 207 may be made by user's operations as long as the description of the ENAV document permits. That is, a switching instruction of the conversion is transferred as AV output control to the AV renderer 203 in response to a user trigger from the user interface unit 400.
  • The order of D/A conversion and LB/PS conversion may be reversed. That is, after the data on the frame memory of the [0134] mixer 203 k undergoes LB/PS conversion and the converted data is rasterized on a new frame memory, D/A conversion is executed. The former method, i.e., the method of executing LB/PS conversion after D/A conversion can be implemented using a small frame memory size while suppressing image quality deterioration in the two conversion process. On the other hand, the latter method of LB/PS conversion requires the frame memory, but can improve the degree of freedom in LB/PS conversion.
  • The effects obtained upon executing pixel conversion will be explained below. [0135]
  • As shown in FIG. 6, there are several types of monitors, i.e., a PC monitor, 4:3 TV monitor, and 16:9 TV monitor. These monitors have different pixel layouts. On the PC monitor, vertical and horizontal pixels are arranged uniformly (Square Pixel). By contrast, the 4:3 TV monitor has an aspect ratio of about 1:1.2, and the 16:9 TV monitor has an aspect ratio of about 1:1.6 (Rectangular Pixel). That is, an original image, which is a perfect circle on the PC monitor, appears as a horizontally elongated oval on the 4:3 TV monitor, and as a further horizontally elongated oval on the 16:9 TV monitor. [0136]
  • Hence, in order to display appropriate videos on the respective monitors, contents must be prepared for these monitors. FIG. 7 is a flow chart showing the flow upon playing back different contents in correspondence with the type of designated monitor. [0137]
  • Upon reception of a startup instruction, the [0138] ENAV engine 200 loads an ENAV document (DVDINDEX.HTM) which is stored on the enhanced DVD disk and is required to start up (ST101). For example, DVDINDEX.HTM describes an instruction for loading a predetermined file after information of the output monitor of user's choice (actual monitor information), i.e., a default aspect ratio (SPRM(14)) in a video player configuration (P_CFG) (ST102). If the output monitor information is “00b” which indicates “4:3 TV monitor”, “INDEX—1.HTM” is loaded (ST121). If the output monitor information is “11b” which indicates “16:9 TV monitor”, “INDEX—2.HTM” is loaded (ST131). If the output monitor information is “10b” which indicates “PC monitor”, “INDEX—0.HTM” is loaded (ST111). “INDEX—1.HTM” as the ENAV document for the 4:3 TV monitor describes a link to ENAV contents (still picture, animation/moving picture, font, background) for the 4:3 TV monitor. Also, this ENAV document describes an output method of DVD-Video contents onto the 4:3 TV monitor (current display mode of the video player configuration: “normal or wide (no conversion)”, “pan scan (PS conversion)”, “letter box (LB conversion)”. The ENAV contents for the 4:3 TV monitor are loaded according to this document (ST122), and can be displayed on the 4:3 TV monitor (ST123).
  • Likewise, “INDEX[0139] —2.HTM” describes a link to ENAV contents for the 16:9 TV monitor, and an instruction for DVD-Video contents. The ENAV contents for the 16:9 TV monitor are loaded according to this document (ST132), and can be displayed on the 16:9 TV monitor (ST133).
  • Also, “INDEX[0140] —3.HTM” describes a link to ENAV contents for the PC monitor, and an instruction for DVD-Video contents. The ENAV contents for the PC monitor are loaded according to this document (ST112), and can be displayed on the PC monitor (ST113).
  • In this example, since all ENAV contents are created for corresponding output monitors, no pixel conversion is required. That is, “no conversion” is designated in still picture pixel conversion, animation/moving picture pixel conversion, font pixel conversion, and background picture pixel conversion. [0141]
  • As another example, in order to display appropriate videos on the respective monitors, CSS (cascading style sheet) which is information to control the position and the size of contents must be prepared for these monitors. FIG. 17 is a flow chart showing the flow upon playing back different contents in correspondence with the type of designated monitor. [0142]
  • Upon reception of a startup instruction, the [0143] ENAV engine 200 loads an ENAV document (DVDINDEX.HTM) which is stored on the enhanced DVD disk and is required to start up (ST101). For example, DVDINDEX.HTM describes an instruction for loading a CSS(Cascading Style Sheet) file (as described in FIG. 18) after information of the output monitor of user's choice (actual monitor information), i.e., a default aspect ratio (SPRM(14)) in a video player configuration (P_CFG) (ST102). If the output monitor information is “00b” which indicates “4:3 TV monitor”, “4—3_style.css” is loaded (ST121#). If the output monitor information is “11b” which indicates “16:9 TV monitor”, “16—9_style.css” is loaded (ST131#). If the output monitor information is “10b” which indicates “PC monitor”, “pc_style.css” is loaded (ST111#). “4—3_style.css” as the style sheet for the 4:3 TV monitor describes position information (ordinate and abscissa) and size information (vertical/horizontal length or scale-up/down ratio) to layout ENAV contents (still picture, animation/moving picture, font, background) for the 4:3 TV monitor. Also, this style sheet describes an output method of DVD-Video contents onto the 4:3 TV monitor (current display mode of the video player configuration: “normal or wide (no conversion)”, “pan scan (PS conversion)”, “letter box (LB conversion)”.
  • Likewise, “16[0144] —9_style.css” describes position/size information to layout ENAV contents for the 16:9 TV monitor, and an instruction for DVD-Video contents.
  • Also, “pc_style.css” describes position/size information to layout ENAV contents for the PC monitor, and an instruction for DVD-Video contents. [0145]
  • However, preparing contents in correspondence with respective monitors imposes a heavy load on contents creation of the contents provider, and the ENAV contents occupy larger disk and buffer sizes. Hence, a method of sharing contents (still picture, animation/moving picture, font, background picture) for a given monitor with other monitors will be described below. That is, if contents for a given monitor are not prepared, display is made using available contents for another monitor. A method of executing image processes such as pixel conversion, resizing, and the like as needed (in accordance with an instruction of the ENAV document or the setup of the playback apparatus) at that time will be described below. [0146]
  • FIG. 8 shows an example of pixel conversion executed when contents for the 4:3 TV monitor are to be displayed on the 4:3 TV monitor, 16:9 TV monitor, and PC monitor. [0147]
  • The respective pixel converters (still picture [0148] pixel converter 203 a, animation/moving picture pixel converter 203 b, font pixel converter 202 c, background picture pixel converter 202 d) receive image data and image information (indicating one of “4:3 TV monitor”, “16:9 TV monitor”, and “PC monitor” for which that picture is designed) from the corresponding decoders (still picture decoder 2081 a, animation/moving picture decoder 2081 b, font decoder 2081 c, background picture decoder 2081 d), and confirm that the image data are designed for the 4:3 TV monitor. Note that information indicating a monitor on which the image data is to be displayed can be described in an ENAV document in place of image data itself.
  • The designated monitor is determined with reference to the current display mode of the video player configuration (P_CFG) (ST[0149] 201). That is, “monitor information” which is transferred from the ENAV interface to each pixel converter is referred to. At this time, if the designated monitor is a 4:3 TV monitor, since the monitor on which the contents are to be displayed matches the monitor which is designated to display, no pixel conversion is required (ST222).
  • If the designated monitor is a 16:9 TV monitor, it is checked based on the description of the ENAV document, i.e., conversion control sent from the XHTML/[0150] CSS layout manager 207 to the respective pixel converters if pixel conversion is to be executed (ST231). If no pixel conversion is to be executed, (ST231, NO), the contents are output without any conversion (ST232). In this case, contents are displayed to be horizontally elongated compared to the intended ones. If pixel conversion is to-be executed (ST231, YES), LB or PS conversion is executed in accordance with the description of the ENAV document (conversion control from the XHTML/CSS layout manager 207) (ST233, ST234, ST235). As a result of LB conversion in this case, non-display areas are formed on the right and left ends of the display area. Also, as a result of PS conversion in this case, the upper and lower portions of the original contents are not displayed.
  • If the designated monitor is a PC monitor, it is checked based on the description of the ENAV document, i.e., conversion control sent from the XHTML/[0151] CSS layout manager 207 to the respective pixel converters if pixel conversion is to be executed (ST211). If no pixel conversion is to be executed, (ST211, NO), the contents are output without any conversion (ST212). In this case, contents are displayed to be slightly vertically elongated compared to the intended ones. If pixel conversion is to be executed (ST211, YES), LB or PS conversion is executed in accordance with the description of the ENAV document (conversion control from the XHTML/CSS layout manager 207) (ST213, ST214, ST215). As a result of LB conversion in this case, non-display areas are formed on the upper and lower ends of the display area. Also, as a result of PS conversion in this case, the right and left end portions of the original contents are not displayed.
  • FIG. 9 shows an example of pixel conversion executed when contents for the 16:9 TV monitor are to be displayed on the 4:3 TV monitor, 16:9 TV monitor, and PC monitor. [0152]
  • The respective pixel converters (still picture [0153] pixel converter 203 a, animation/moving picture pixel converter 203 b, font pixel converter 202 c, background picture pixel converter 202 d) receive image data and image information (indicating one of “4:3 TV monitor”, “16:9 TV monitor”, and “PC monitor” for which that picture is designed) from the corresponding decoders (still picture decoder 2081 a, animation/moving picture decoder 2081 b, font decoder 2081 c, background picture decoder 2081 d), and recognize that the image data are designed for the 16:9 TV monitor. Note that information indicating a monitor on which the image data is to be displayed can be described in an ENAV document in place of image data itself.
  • The designated monitor is determined with reference to the current display mode of the video player configuration (P_CFG) (ST[0154] 301). That is, “monitor information” which is transferred from the ENAV interface to each pixel converter is referred to. At this time, if the designated monitor is a 16:9 TV monitor, since the monitor on which the contents are to be displayed matches the monitor which is designated to display, no pixel conversion is required (ST332).
  • If the designated monitor is a 4:3 TV monitor, it is checked based on the description of the ENAV document, i.e., conversion control sent from the XHTML/[0155] CSS layout manager 207 to the respective pixel converters if pixel conversion is to be executed (ST321). If no pixel conversion is to be executed, (ST321, NO), the contents are output without any conversion (ST322). In this case, contents are displayed to be vertically elongated compared to the intended ones. If pixel conversion is to be executed (ST321, YES), LB or PS conversion is executed in accordance with the description of the ENAV document (conversion control from the XHTML/CSS layout manager 207) (ST323, ST324, ST325). As a result of LB conversion in this case, non-display areas are formed on the upper and lower ends of the display area. Also, as a result of PS conversion in this case, the right and left end portions of the original contents are not displayed.
  • If the designated monitor is a PC monitor, it is checked based on the description of the ENAV document, i.e., conversion control sent from the XHTML/[0156] CSS layout manager 207 to the respective pixel converters if pixel conversion is to be executed (ST311). If no pixel conversion is to be executed, (ST311, NO), the contents are output without any conversion (ST312). In this case, contents are displayed to be slightly vertically elongated compared to the intended ones. If pixel conversion is to be executed (ST311, YES), LB or PS conversion is executed in accordance with the description of the ENAV document (conversion control from the XHTML/CSS layout manager 207) (ST313, ST314, ST315). As a result of LB conversion in this case, non-display areas are formed on the upper and lower ends of the display area. Also, as a result of PS conversion in this case, the right and left end portions of the original contents are not displayed.
  • FIG. 10 shows an example of pixel conversion executed when contents for the PC monitor are to be displayed on the 4:3 TV monitor, 16:9 TV monitor, and PC monitor. [0157]
  • The respective pixel converters (still picture [0158] pixel converter 203 a, animation/moving picture pixel converter 203 b, font pixel converter 203 c, background picture pixel converter 203 d) receive image data and image information (indicating one of “4:3 TV monitor”, “16:9 TV monitor”, and “PC monitor” for which that picture is designed) from the corresponding decoders (still picture decoder 2081 a, animation/moving picture decoder 2081 b, font decoder 2081 c, background picture decoder 2081 d), and recognize that the image data are designed for the PC monitor. Note that information indicating a monitor on which the image data is to be displayed can be described in an ENAV document in place of image data itself.
  • The designated monitor is determined with reference to the current display mode of the video player configuration (P_CFG) (ST[0159] 401). That is, “monitor information” which is transferred from the ENAV interface to each pixel converter is referred to. At this time, if the designated monitor is a PC monitor, since the monitor on which the contents are to be displayed matches the monitor which is designated to display, no pixel conversion is required (ST412).
  • If the designated monitor is a 4:3 TV monitor, it is checked based on the description of the ENAV document, i.e., conversion control sent from the XHTML/[0160] CSS layout manager 207 to the respective pixel converters if pixel conversion is to be executed (ST421). If no pixel conversion is to be executed, (ST421, NO), the contents are output without any conversion (ST422). In this case, contents are displayed to be slightly horizontally elongated compared to the intended ones. If pixel conversion is to be executed (ST421, YES), LB or PS conversion is executed in accordance with the description of the ENAV document (conversion control from the XHTML/CSS layout manager 207) (ST423, ST424, ST425). As a result of LB conversion in this case, non-display areas are formed on the right and left ends of the display area. Also, as a result of PS conversion in this case, the upper and lower portions of the original contents are not displayed.
  • If the designated monitor is a 16:9 TV monitor, it is checked based on the description of the ENAV document, i.e., conversion control sent from the XHTML/[0161] CSS layout manager 207 to the respective pixel converters if pixel conversion is to be executed (ST431). If no pixel conversion is to be executed, (ST431, NO), the contents are output without any conversion (ST432). In this case, contents are displayed to be horizontally elongated compared to the intended ones. If pixel conversion is to be executed (ST431, YES), LB or PS conversion is executed in accordance with the description of the ENAV document (conversion control from the XHTML/CSS layout manager 207) (ST433, ST434, ST435). As a result of LB conversion in this case, non-display areas are formed on the right and left ends of the display area. Also, as a result of PS conversion in this case, the upper and lower portions of the original contents are not displayed.
  • FIG. 11 shows a display example of DVD-Video contents and ENAV contents on a 16:9 TV monitor using the aforementioned pixel conversion function. For example, assume that contents designed for a 16:9 TV monitor are prepared as DVD-Video contents, and background picture data designed for a 16:9 TV monitor, still picture data designed for a 4:3 TV monitor, and font data designed for a PC monitor are prepared as ENAV contents. [0162]
  • As for the DVD-Video contents, since the monitor “16:9 TV monitor” on which the contents are designed to be displayed matches the monitor “16:9 TV monitor” which is actually designated to display, pixel conversion is skipped, and the DVD-Video contents undergo resizing (in this case, reduced-scale display) designated by the ENAV document. [0163]
  • Likewise, as for the background picture data, since the monitor on which the background picture data is designed to be displayed matches the monitor which is actually designated to display, pixel conversion is skipped, and the background picture data undergoes resizing designated by the ENAV document. [0164]
  • As for the still picture data, since the monitor “4:3 TV monitor” on which the contents are designed to be displayed matches the monitor “16:9 TV monitor”, the still picture data undergoes conversion shown in FIG. 8. In this example, the ENAV document designates that “LB conversion is executed as pixel conversion”. Furthermore, the still picture data undergoes resizing designated by the ENAV document. [0165]
  • As for the font data, since the monitor “PC monitor” on which the contents are designed to be displayed matches the monitor “16:9 TV monitor”, the font data undergoes conversion shown in FIG. 10. In this example, the ENAV document designates that “no pixel conversion is made”. Also, the ENAV document designates the font size to be displayed, and if font data of that size is prepared, no resizing is required. [0166]
  • As described above, even when the DVD-Video contents and respective ENAV contents are designed to be displayed on different types of monitors, appropriate display can be attained by executing pixel conversion designated by the ENAV document. In this way, even contents which are created by the contents provider to form a site on the Internet, i.e., contents for PC can be diverted to ENAV contents to be recorded on an enhanced DVD disk or server unit. [0167]
  • A method of displaying contents, which are designed to be displayed on a given monitor, on a different monitor in accordance with an instruction of the ENAV document will be described below. In the following description, a case will be exemplified below wherein an ENAV page (FIG. 11: made up of the DVD-Video contents and ENAV contents (still picture, font, and background picture)) which is designed to be displayed on the 16:9 TV monitor above is displayed on a 4:3 TV monitor. [0168]
  • FIG. 12 shows an example wherein the ENAV page (FIG. 11) which is designed to be displayed on the [0169] 16 9 monitor undergoes letter box conversion by the D/A converter & LB/PS converter 203 m in accordance with an instruction of the ENAV document, i.e., the conversion control from the XHTML/CSS layout manager 307, and is then output onto the 4:3 TV monitor. As a result of this letter box conversion, non-display areas are formed on the upper and lower ends of the monitor screen.
  • FIG. 13 shows an example wherein the ENAV page (FIG. 11) which is designed to be displayed on the 16:9 monitor undergoes pan scan conversion by the D/A converter & LB/[0170] PS converter 203 m in accordance with an instruction of the ENAV document, i.e., the conversion control from the XHTML/CSS layout manager 307, and is then output onto the 4:3 TV monitor. In this case, the right and left end portions of the ENAV page are not displayed. For example, these non-display areas and display areas can be designated as needed by the ENAV document, and can also be changed as needed by a user event issued by a user's operation.
  • Note that the letter box conversion and pan scan conversion shown in FIGS. 12 and 13 can be designated as needed by the ENAV document, and can also be switched as needed by a user event issued by a user's operation. [0171]
  • However, in FIG. 12, the actually displayed area is smaller than the area of the 4:3 TV monitor, i.e., non-display areas are formed on the TV monitor. In FIG. 13, given portions of the ENAV page are not displayed on the 4:3 TV monitor. To solve such problems, FIG. 14 shows an example wherein DVD-Video contents and ENAV contents (still picture, font, and background picture), which are the same as those used to display the ENAV page in FIG. 11, are displayed in accordance with an instruction of the ENAV document. Note that this conversion can be implemented as a function of the playback apparatus even when no instruction of the ENAV document is available. [0172]
  • DVD-Video contents for a 16:9 TV monitor undergo letter box conversion. Also, background picture data for a 16:9 TV monitor undergoes pan scan conversion that cuts off the right and left ends of the background picture. Since still picture data for a 4:3 TV monitor is originally designed to be displayed on the 4:3 TV monitor, conversion is skipped. Also, conversion of font data for a PC monitor is skipped. [0173]
  • In this example, although a layout is slightly different from the page for the 16:9 TV monitor shown in FIG. 11, fonts are easier to read than FIG. 12, and the still and background pictures are displayed in a larger scale. Also, non-display areas can be reduced compared to FIG. 13. [0174]
  • In this example, the size after resizing and the font size used in display are the same as those in FIG. 11. That is, the playback apparatus can automatically apply the contents for the 16:9 TV monitor shown in FIG. 11 on the basis of image information of the DVD-Video contents and ENAV contents (still picture, font, and background picture), and can display the page shown in FIG. 14 on the 4:3 TV monitor. [0175]
  • FIG. 15 shows another example upon displaying the contents for the 16:9 TV monitor shown in FIG. 11 on a 4:3 TV monitor. In this case, DVD-Video contents for a 16:9 TV monitor undergo pan scan conversion. Also, background picture data for a 16:9 TV monitor undergoes pan scan conversion that cuts off the right and left ends of the background picture. Since still picture data for a 4:3 TV monitor is originally designed to be displayed on the 4:3 TV monitor, conversion is skipped. Also, conversion of font data for a PC monitor is skipped. [0176]
  • Note that the letter box conversion and pan scan conversion of the DVD-Video contents shown in FIGS. 14 and 15 can be designated as needed by the ENAV document, and can also be switched as needed by a user event issued by a user's operation. [0177]
  • An overview of the present invention will be described below with reference to the flow chart shown in FIG. 16. DVD-Video contents C[0178] 1 are acquired from an enhanced DVD-Video disk D2, and ENAV contents C21 or C22 are acquired from at least one of the enhanced DVD-Video disk D2 and external server unit 500 (ST501). The DVD-Video contents C1 and image data contained in ENAV contents C21 or C22 undergo image processes as needed on the basis of actual monitor information, optimal monitor information, image conversion information (conversion control), and the characteristics of image data (those of still picture, moving picture, animation, font, background, and the like) (ST502). Note that the image processes include the aforementioned pixel conversion process and resizing process. The DVD-Video contents C1 and ENAV contents C21 or C22 that have undergone the image processes are synchronously played back (ST503). As a result, the image data which have undergone the image processes are appropriately output to a predetermined monitor. In this way, contents can be displayed on the designated monitor by the intended display method.
  • Additional advantages and modifications will readily occur to those skilled in the art. Therefore, the invention in its broader aspects is not limited to the specific details and representative embodiments shown and described herein. Accordingly, various modifications may be made without departing from the spirit or scope of the general inventive concept as defined by the appended claims and their equivalents. [0179]

Claims (11)

What is claimed is:
1. An information playback apparatus comprising:
a first acquisition unit configured to acquire contents from an information storage medium;
a second acquisition unit configured to acquire expansion information from at least one of the information storage medium and an external apparatus via a communication line;
an image processing unit configured to process the contents and image data contained in the expansion information as needed on the basis of actual monitor information indicating an actual output destination of the contents and the expansion information; and
a playback unit configured to play back the contents, and to play back image data, which is contained in the expansion information and has undergone the image process as needed, in synchronism with playback of the contents.
2. An apparatus according to claim 1, wherein the image processing unit comprises:
a pixel conversion unit configured to convert pixels which form the image data contained in the expansion information; and
a size conversion unit configured to convert a size of the image data contained in the expansion information.
3. An apparatus according to claim 1, wherein the image processing unit processes image data contained in the expansion information as needed on the basis of characteristics of that image data or an instruction contained in the expansion information.
4. An apparatus according to claim 1, wherein the expansion information contains optimal monitor information that indicates an optimal output destination of image data contained in that expansion information, and
the image processing unit processes image data contained in the expansion information as needed on the basis of the actual monitor information and the optimal monitor information.
5. An apparatus according to claim 4, wherein the expansion information contains image conversion information that instructs predetermined image conversion when a monitor designated by the actual monitor information is different from a monitor designated by the optimal monitor information, and
the image processing unit processes image data contained in the expansion information as needed on the basis of the actual monitor information, the optimal monitor information, and the image conversion information.
6. An information playback method comprising:
acquiring expansion information from at least one of an information storage medium and an external apparatus via a communication line;
processing contents acquired from the information storage medium and image data contained in the expansion information as needed on the basis of actual monitor information indicating an actual output destination of the contents and the expansion information; and
playing back the contents, and playing back image data, which is contained in the expansion information and has undergone the image process as needed, in synchronism with playback of the contents.
7. A method according to claim 6, wherein the image data process includes at least one of a pixel conversion process that converts pixels which form the image data contained in the expansion information, and a size conversion process that converts a size of the image data contained in the expansion information.
8. A method according to claim 6, wherein image data contained in the expansion information is processed as needed on the basis of characteristics of that image data or an instruction contained in the expansion information.
9. A method according to claim 6, wherein the expansion information contains optimal monitor information that indicates an optimal output destination of image data contained in that expansion information, and
image data contained in the expansion information is processed as needed on the basis of the actual monitor information and the optimal monitor information.
10. A method according to claim 9, wherein the expansion information contains image conversion information that instructs predetermined image conversion when a monitor designated by the actual monitor information is different from a monitor designated by the optimal monitor information, and
image data contained in the expansion information is processed as needed on the basis of the actual monitor information, the optimal monitor information, and the image conversion information.
11. An information playback apparatus comprising:
a first acquisition unit configured to acquire contents from an information storage medium;
a second acquisition unit configured to acquire expansion information from an external apparatus via a communication line;
an image processing unit configured to apply a conversion process to the contents and image data contained in the expansion information on the basis of actual monitor information indicating an actual output destination of the contents and the expansion information, and optimal monitor information which indicates an optimal output destination of the image data contained in the expansion information, and is contained in the expansion information; and
a playback unit configured to play back the contents in accordance with the conversion process of the image processing unit, and to play back image data in the expansion information in synchronism with playback of the contents.
US10/740,617 2002-12-27 2003-12-22 Information playback apparatus and information playback method Abandoned US20040179824A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2002-381577 2002-12-27
JP2002381577 2002-12-27

Publications (1)

Publication Number Publication Date
US20040179824A1 true US20040179824A1 (en) 2004-09-16

Family

ID=32948314

Family Applications (1)

Application Number Title Priority Date Filing Date
US10/740,617 Abandoned US20040179824A1 (en) 2002-12-27 2003-12-22 Information playback apparatus and information playback method

Country Status (4)

Country Link
US (1) US20040179824A1 (en)
KR (1) KR100603229B1 (en)
CN (1) CN100344156C (en)
TW (1) TWI261821B (en)

Cited By (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070025700A1 (en) * 2005-07-29 2007-02-01 Lg Electronics Inc. Recording medium, method and apparatus for reproducing data and method and apparatus for recording data
US20070025706A1 (en) * 2005-07-29 2007-02-01 Lg Electronics Inc. Method and apparatus for reproducing data, recording medium, and method and apparatus for recording data
US20070025696A1 (en) * 2005-07-29 2007-02-01 Lg Electronics Inc. Recording medium, method and apparatus for reproducing data, and method and apparatus for recording data
US20070025699A1 (en) * 2005-07-29 2007-02-01 Lg Electronics Inc. Recording medium, method and apparatus for reproducing data, and method and apparatus for recording data
US20070041713A1 (en) * 2005-08-22 2007-02-22 Kim Kun S Apparatus for reproducing data, method thereof, apparatus for recording the same, method thereof and recording medium
US20070041710A1 (en) * 2005-08-22 2007-02-22 Lg Electronics Apparatus for reproducing data, method thereof, apparatus for recording the same, method thereof and recording medium
US20070041279A1 (en) * 2005-08-22 2007-02-22 Kim Kun S Method and apparatus for reproducing data, recording medium, and method and apparatus for recording data
US20070041709A1 (en) * 2005-08-22 2007-02-22 Lg Electronics Inc. Recording medium, method and apparatus for reproducing data, and method and apparatus for recording data
US20070101162A1 (en) * 2005-09-13 2007-05-03 Hideo Ando Information storage medium, information reproducing apparatus, and information reproducing method
US20070116302A1 (en) * 2005-11-17 2007-05-24 Kim Kun S Method and apparatus for reproducing audio data, recording medium, and method and apparatus for recording audio data
US20070147790A1 (en) * 2005-12-27 2007-06-28 Sony Corporation Image data recorder, image data recording method, and program
US20080056679A1 (en) * 2006-04-03 2008-03-06 Kim Kun S Recording medium, method and apparatus for reproducing data, and method and apparatus for recording data
US20080056678A1 (en) * 2006-04-18 2008-03-06 Kim Kun S Apparatus for reproducing data, method thereof, apparatus for recording the same, method thereof and recording medium
US20080063369A1 (en) * 2006-04-17 2008-03-13 Kim Kun S Method and apparatus for reproducing data, recording medium, and method and apparatus for recording data
EP1924992A2 (en) * 2005-08-22 2008-05-28 LG Electronics Inc. Apparatus for reproducing data, method thereof, apparatus for recording the same, method thereof and recording medium
US20090147288A1 (en) * 2007-12-07 2009-06-11 Canon Kabushiki Kaisha Rendering apparatus, rendering method, and computer-readable storage medium
US20100166391A1 (en) * 2003-03-10 2010-07-01 Yasufumi Tsumagari Information storage medium, information playback apparatus, and information playback method
USRE45909E1 (en) * 2005-06-30 2016-03-01 Novatek Microelectronics Corp. Video decoding apparatus, video decoding method, and digital audio/video playback system capable of controlling presentation of sub-pictures

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4915459B2 (en) * 2009-04-03 2012-04-11 ソニー株式会社 Information processing apparatus, information processing method, and program
TWI632810B (en) * 2013-07-19 2018-08-11 新力股份有限公司 Data generating device, data generating method, data reproducing device, and data reproducing method
CN112817681B (en) * 2021-02-09 2023-03-24 杭州海康威视系统技术有限公司 Data display method, device, equipment and machine-readable storage medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6148140A (en) * 1997-09-17 2000-11-14 Matsushita Electric Industrial Co., Ltd. Video data editing apparatus, optical disc for use as a recording medium of a video data editing apparatus, and computer readable recording medium storing an editing program
US6229574B1 (en) * 1997-08-28 2001-05-08 Lg Electronics Inc. Screen ratio converter for digital TV
US6310654B1 (en) * 1998-02-04 2001-10-30 Hitachi, Ltd. Decoder device and receiver using the same
US20020180887A1 (en) * 2001-06-01 2002-12-05 Kim Ick Hwan Image display method and apparatus

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6288991B1 (en) * 1995-03-06 2001-09-11 Fujitsu Limited Storage medium playback method and device
KR100214609B1 (en) * 1996-08-02 1999-08-02 구자홍 Apparatus and method for controlling aspect in dvd player
KR19980021419A (en) * 1996-09-16 1998-06-25 김광호 Personal computer MPEG and DVD player
US20010003454A1 (en) * 1998-06-30 2001-06-14 Paul Chambers Method and apparatus for mapping a digital versatile disk (dvd) image onto high resolution computer display device
KR20000034259A (en) * 1998-11-28 2000-06-15 전주범 Apparatus adjusting picture aspect ratio for wide television
JP2000184365A (en) * 1998-12-18 2000-06-30 Nippon Telegr & Teleph Corp <Ntt> Video image comparison monitor system
JP4356202B2 (en) * 2000-06-29 2009-11-04 パナソニック株式会社 Video signal processing device
CN1275134C (en) * 2001-10-23 2006-09-13 三星电子株式会社 Information storage medium including markup document and AV data, recording method, reproducing method, and reproducing apparatus therefor

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6229574B1 (en) * 1997-08-28 2001-05-08 Lg Electronics Inc. Screen ratio converter for digital TV
US6148140A (en) * 1997-09-17 2000-11-14 Matsushita Electric Industrial Co., Ltd. Video data editing apparatus, optical disc for use as a recording medium of a video data editing apparatus, and computer readable recording medium storing an editing program
US6310654B1 (en) * 1998-02-04 2001-10-30 Hitachi, Ltd. Decoder device and receiver using the same
US20020180887A1 (en) * 2001-06-01 2002-12-05 Kim Ick Hwan Image display method and apparatus

Cited By (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100166391A1 (en) * 2003-03-10 2010-07-01 Yasufumi Tsumagari Information storage medium, information playback apparatus, and information playback method
USRE45909E1 (en) * 2005-06-30 2016-03-01 Novatek Microelectronics Corp. Video decoding apparatus, video decoding method, and digital audio/video playback system capable of controlling presentation of sub-pictures
US20070025700A1 (en) * 2005-07-29 2007-02-01 Lg Electronics Inc. Recording medium, method and apparatus for reproducing data and method and apparatus for recording data
US20070025706A1 (en) * 2005-07-29 2007-02-01 Lg Electronics Inc. Method and apparatus for reproducing data, recording medium, and method and apparatus for recording data
US20070025696A1 (en) * 2005-07-29 2007-02-01 Lg Electronics Inc. Recording medium, method and apparatus for reproducing data, and method and apparatus for recording data
US20070025699A1 (en) * 2005-07-29 2007-02-01 Lg Electronics Inc. Recording medium, method and apparatus for reproducing data, and method and apparatus for recording data
US20070025697A1 (en) * 2005-07-29 2007-02-01 Lg Electronics Inc. Recording medium, method and apparatus for reproducing data, and method and apparatus for recording data
EP1924992A2 (en) * 2005-08-22 2008-05-28 LG Electronics Inc. Apparatus for reproducing data, method thereof, apparatus for recording the same, method thereof and recording medium
EP1924992A4 (en) * 2005-08-22 2010-04-07 Lg Electronics Inc Apparatus for reproducing data, method thereof, apparatus for recording the same, method thereof and recording medium
US20070041709A1 (en) * 2005-08-22 2007-02-22 Lg Electronics Inc. Recording medium, method and apparatus for reproducing data, and method and apparatus for recording data
US20070041712A1 (en) * 2005-08-22 2007-02-22 Lg Electronics Method and apparatus for reproducing data, recording medium, and method and apparatus for recording data
US20070041713A1 (en) * 2005-08-22 2007-02-22 Kim Kun S Apparatus for reproducing data, method thereof, apparatus for recording the same, method thereof and recording medium
US20070041710A1 (en) * 2005-08-22 2007-02-22 Lg Electronics Apparatus for reproducing data, method thereof, apparatus for recording the same, method thereof and recording medium
US20070041279A1 (en) * 2005-08-22 2007-02-22 Kim Kun S Method and apparatus for reproducing data, recording medium, and method and apparatus for recording data
US20070041711A1 (en) * 2005-08-22 2007-02-22 Lg Electronics Apparatus for reproducing data, method thereof, apparatus for recording the same, method thereof and recording medium
US20080056676A1 (en) * 2005-08-22 2008-03-06 Kim Kun S Apparatus for reproducing data, method thereof, apparatus for recording the same, method thereof and recording medium
US7983526B2 (en) * 2005-09-13 2011-07-19 Kabushiki Kaisha Toshiba Information storage medium, information reproducing apparatus, and information reproducing method
US20070101162A1 (en) * 2005-09-13 2007-05-03 Hideo Ando Information storage medium, information reproducing apparatus, and information reproducing method
US20070116302A1 (en) * 2005-11-17 2007-05-24 Kim Kun S Method and apparatus for reproducing audio data, recording medium, and method and apparatus for recording audio data
US20070147790A1 (en) * 2005-12-27 2007-06-28 Sony Corporation Image data recorder, image data recording method, and program
US7746384B2 (en) * 2005-12-27 2010-06-29 Sony Corporation Image data recorder, image data recording method, and program
US20080056679A1 (en) * 2006-04-03 2008-03-06 Kim Kun S Recording medium, method and apparatus for reproducing data, and method and apparatus for recording data
US20080063369A1 (en) * 2006-04-17 2008-03-13 Kim Kun S Method and apparatus for reproducing data, recording medium, and method and apparatus for recording data
US20080056678A1 (en) * 2006-04-18 2008-03-06 Kim Kun S Apparatus for reproducing data, method thereof, apparatus for recording the same, method thereof and recording medium
US20090147288A1 (en) * 2007-12-07 2009-06-11 Canon Kabushiki Kaisha Rendering apparatus, rendering method, and computer-readable storage medium
US8233164B2 (en) * 2007-12-07 2012-07-31 Canon Kabushiki Kaisha Rendering apparatus, rendering method, and computer-readable storage medium

Also Published As

Publication number Publication date
TWI261821B (en) 2006-09-11
KR20040060763A (en) 2004-07-06
CN1535008A (en) 2004-10-06
CN100344156C (en) 2007-10-17
KR100603229B1 (en) 2006-07-24
TW200425100A (en) 2004-11-16

Similar Documents

Publication Publication Date Title
US20040179824A1 (en) Information playback apparatus and information playback method
US7580614B2 (en) Information playback apparatus having expansion information storage unit and information playback method
US20100166391A1 (en) Information storage medium, information playback apparatus, and information playback method
KR100675595B1 (en) Information storage medium, information recording method, and information playback method
US20120033942A1 (en) Enhanced navigation system using digital information medium
US20070031122A1 (en) Information storage medium, information playback method, information decode method, and information playback apparatus
US20050213941A1 (en) Information recording medium, methods of recording/playback information onto/from recording medium
US20060182418A1 (en) Information storage medium, information recording method, and information playback method
US20050259968A1 (en) Information recording medium, methods of recording/playback information onto/from recording medium
KR100570925B1 (en) Information playback apparatus and information playback method
KR20070054260A (en) Information storage medium, information reproducing apparatus, and information reproducing method
US20060127051A1 (en) Information recording medium, information playback method, and information playback apparatus
KR100584709B1 (en) Information playback apparatus and information playback method
EP1713077A2 (en) Information storage medium, information recording apparatus, and information playback apparatus
US20060110135A1 (en) Information storage medium, information playback method, and information playback apparatus
JP3908724B2 (en) Information reproducing apparatus and information reproducing method
JP2006134520A (en) Information storage medium, and method and device for information reproduction
US20050094973A1 (en) Moving picture reproducing apparatus in which player mode information is set, reproducing method using the same, and storage medium
JP3875685B2 (en) Information reproducing apparatus and information reproducing method
JP2007037167A (en) Information reproducing apparatus and information reproducing method
JP2007122869A (en) Device and method for reproducing information

Legal Events

Date Code Title Description
AS Assignment

Owner name: KABUSHIKI KAISHA TOSHIBA, JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:TSUMAGARI, YASUFUMI;MIMURA, HIDEKI;REEL/FRAME:015376/0968;SIGNING DATES FROM 20031215 TO 20031216

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION