US8155501B2 - Reproducing apparatus, reproducing method, and system LSI - Google Patents

Reproducing apparatus, reproducing method, and system LSI Download PDF

Info

Publication number
US8155501B2
US8155501B2 US12/376,353 US37635308A US8155501B2 US 8155501 B2 US8155501 B2 US 8155501B2 US 37635308 A US37635308 A US 37635308A US 8155501 B2 US8155501 B2 US 8155501B2
Authority
US
United States
Prior art keywords
playback
application
speed
unit
instruction
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related, expires
Application number
US12/376,353
Other languages
English (en)
Other versions
US20100034510A1 (en
Inventor
Tomomi Oda
Taisaku Suzuki
Yasuyuki Matsuura
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Panasonic Corp
Original Assignee
Panasonic Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Panasonic Corp filed Critical Panasonic Corp
Assigned to PANASONIC CORPORATION reassignment PANASONIC CORPORATION ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: MATSUURA, YASUYUKI, ODA, TOMOMI, SUZUKI, TAISAKU
Publication of US20100034510A1 publication Critical patent/US20100034510A1/en
Application granted granted Critical
Publication of US8155501B2 publication Critical patent/US8155501B2/en
Expired - Fee Related legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H04N5/78—Television signal recording using magnetic recording
    • H04N5/782—Television signal recording using magnetic recording on tape
    • H04N5/783—Adaptations for reproducing at a rate different from the recording rate
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/06—Buying, selling or leasing transactions
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B20/00—Signal processing not specific to the method of recording or reproducing; Circuits therefor
    • G11B20/10—Digital recording or reproducing
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/102—Programmed access in sequence to addressed parts of tracks of operating record carriers
    • G11B27/105—Programmed access in sequence to addressed parts of tracks of operating record carriers of operating discs
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/34—Indicating arrangements 
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B20/00—Signal processing not specific to the method of recording or reproducing; Circuits therefor
    • G11B20/10—Digital recording or reproducing
    • G11B2020/10935—Digital recording or reproducing wherein a time constraint must be met
    • G11B2020/10944—Real-time recording or reproducing, e.g. for ensuring seamless playback of AV data
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B2220/00—Record carriers by type
    • G11B2220/20—Disc-shaped record carriers
    • G11B2220/21—Disc-shaped record carriers characterised in that the disc is of read-only, rewritable, or recordable type
    • G11B2220/213—Read-only discs
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B2220/00—Record carriers by type
    • G11B2220/20—Disc-shaped record carriers
    • G11B2220/25—Disc-shaped record carriers characterised in that the disc is based on a specific recording technology
    • G11B2220/2537—Optical discs
    • G11B2220/2541—Blu-ray discs; Blue laser DVR discs
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H04N5/84—Television signal recording using optical recording
    • H04N5/85—Television signal recording using optical recording on discs or drums

Definitions

  • the present invention belongs to a technical field of application control performed in conjunction with AV playback.
  • the application control mentioned above is a technique to perform decoding of AV streams and execution of applications in parallel.
  • Interactive applications designed to operate in conjunction with the AV playback include, for example, applications for realizing a game that is synchronized with video and audio of the main part of a movie, and applications for realizing online shopping during the playback of the main part of a movie by establishing connection with an external server via a telephone line, the Internet or the like.
  • the added value of the playback apparatus is increased when such interactive applications are chosen as the execution objects.
  • Patent Documents 1 and 2 discloses techniques to improve the operability of playback apparatuses.
  • Patent Document 1 Japanese Laid-open Patent Application Publication No. 2003-134472
  • Patent Document 2 Japanese Laid-open Patent Application Publication No. 2002-223408
  • Some of the interactive applications are designed such that user operations using the GUI are valid only within a period for which items for sale are displayed in the frame, on the time line of the AV playback.
  • Such a GUI is intended to promote sales of items relating to the video content, in cooperation with business enterprises that provide online shopping.
  • the operation using the GUI is, for example, a purchase of an item which requires a careful decision, and if the period for which the GUI is valid has been set to be short by chance, the user might feel rushed.
  • the playback apparatuses can not exclude applications developed without consideration of the operability for the users, it can be said that the manufacturers of the playback apparatuses are in a position where they can easily get involved in troubles due to poor structures of GUIs of the applications.
  • the object of the present invention is to provide a playback apparatus that is capable of complementing poor operability of applications.
  • the present invention provides a playback apparatus comprising: an execution unit operable to execute an application; a playback unit; a receiving unit operable to receive an instruction from a user; and a control unit, wherein if the receiving unit receives the instruction during AV playback by the playback unit, the control unit instructs the playback unit to perform the AV playback at a predetermined speed level, and outputs a key event corresponding to the instruction to the application.
  • the control unit instructs the playback unit to perform the AV playback at the predetermined speed level.
  • the operation of the application is in synchronization with the AV playback, and the operation speed of the application is decreased or paused according to the speed of the AV playback. Therefore, the operation speed of the application decreases or the operation pauses according to the instruction by the control unit.
  • the key event corresponding to the instruction from the user is output to the application after the operation speed of the application is decreased or paused, the speed of the interactive control performed by the application will be indirectly adjusted through the control of the AV playback. Therefore, the user can be at easy in considering whether to buy an item.
  • the manufacture of the playback apparatus can prevent from getting involved in troubles relating purchase of items by the user.
  • the playback apparatus having a platform of the application, complements the poor GUI. Therefore, it is possible to realize stable user operation without being affected by the quality of the GUI of the application.
  • the playback apparatus may further comprise a setup unit operable to receive a setup instruction from the user, wherein the predetermined speed level may be one of speed levels that include a speed level slower than a normal speed level and a speed level for pausing the AV playback.
  • the predetermined speed level may be one of speed levels that include a speed level slower than a normal speed level and a speed level for pausing the AV playback.
  • the function of complementing the operability of the application will be realized by that the user sets the speed level slower than the normal speed level or the speed level for pausing the AV playback at the time of setup or in advance. Since the function of performing the AV playback at a predetermined speed level is that BD-ROM playback apparatuses are commonly provided with, only a few improvements are required for the playback apparatus to complement the operability of the application.
  • the execution unit may keep an execution speed of the application even if the playback unit performs the AV playback at the predetermined speed level.
  • the execution unit does not perform the execution at a slow speed even if the playback unit performs the AV playback at a slow speed. As a result, it is possible to increase the responsivity to the user's input.
  • the setup unit receives a numeric value ranging from 0 to N, the speed level slower than the normal speed level is represented by a numeric value ranging from 1 to N, the speed level for pausing the AV playback is represented by a numeric value 0, and the predetermined speed level is changeable by re-input of a numeric value ranging from 0 to N.
  • the playback apparatus may further comprise: a timer; and a timer management unit operable to manage the timer, wherein using the timer, the timer management unit may measure an elapsed time from receipt of the instruction by the receiving unit, and perform timeout notification when the elapsed time reaches a predetermined time, and the AV playback at the predetermined speed level may be terminated based on the timeout notification by the timer management unit.
  • the complement of the operability of the application and the AV playback at the predetermined speed level will be automatically cancelled after the elapse of a predetermined time period. Therefore, the introduction of the complementing function does not cause any extra trouble for the user.
  • the playback apparatus may further comprise: a player state register storing therein a parameter relating to a current state of the playback unit; and a state judgment unit operable to judge, when the receiving unit receives the instruction, whether or not the playback unit is currently performing the AV playback, with reference to the parameter, wherein the control unit may instruct the playback unit to perform the AV playback at the predetermined speed level only if the state judgment unit judges that the playback unit is currently performing the AV playback.
  • the player state register is an element that BD-ROM playback apparatuses are commonly provided with, and the playback apparatus performs the complement of the operability of the application after confirming that the playback apparatus is currently performing the AV playback, with reference to the player state register. Therefore, only a few improvements are required for the playback apparatus to complement the operability of the application.
  • the application may include an event listener, a key event as a target of speed control, included in a plurality of key events, may have been registered with the event listener, and the control unit may instruct the playback unit to perform the AV playback at the predetermined speed level only if a key event, received by the receiving unit as the instruction, is the target of the speed control registered with the event listener.
  • the playback apparatus Since a key event as a target of speed control, included in a plurality of key events, has been registered with the event listener, it is possible to realize operations in conjunction, that is, for example, when a specific key of the remote control is pressed, the playback apparatus realizes the AV playback at a predetermined speed level while starting up a desired application.
  • This structure further increases the operability of the application because the user can start up the application and realize the AV playback at the predetermined speed level at the same time by only a single action of pressing the specific key.
  • the execution unit may execute the application by generating an instance from class files stored in a recording medium, a class file of a playback speed instruction program may be stored in the recording medium, and the predetermined speed level may be provided to the playback unit by the playback speed instruction program.
  • the playback unit may perform the AV playback of a digital stream stored in a recording medium, the digital stream may include speed control information, and the predetermined speed level may be defined in the speed control information.
  • the speed control information may show a start position and an end position of the digital stream, and in a case where the playback unit is currently performing the AV playback, the control unit may instruct the playback unit to perform the AV playback at the predetermined speed level after the AV playback reaches the start position, and instruct the playback unit to terminate the AV playback at the predetermined speed level after the AV playback reaches the end position.
  • the playback unit may perform the AV playback of titles stored in a recording medium
  • class files of the application may be stored in the recording medium
  • the execution unit may be a platform of a virtual machine, and include a heap memory, a class loader and an application manager
  • the application manager may perform application signaling of a title boundary on the platform
  • the playback unit starts the AV playback of any of the titles, put the application into an executable state by instructing the class loader to generate, on the heap memory, an instance of any of the class files whose active section corresponds to said any of the titles
  • the receiving unit may include a user event manager, the user event manager may generate a key event corresponding to the instruction if the instruction is valid for said any of the titles, and transmit the key event to the application in the executable state
  • the control unit may instruct the playback unit to perform the AV playback at the predetermined speed level before the key event is transmitted by the user event manager.
  • control unit as a component of the present invention can be implemented as an additional module to the user event manager in the playback apparatus, it is possible to realize this complement by a simple addition of the module to the BD-J terminal standard model without making a significant change to the standard model. Therefore, manufactures of playback apparatuses can easily incorporate the speed control function described above into their playback apparatus.
  • An operation mode object may be stored in the recording medium, the operation mode object may be a table that defines an operation mode to be applied to dynamic control of a title when playback of the title is started, and include an application management table and a key interest table that indicates a key that is valid for the title, when the playback of the title is started, the application manager may extract the application management table from the operation mode object that corresponds to the title, and perform the application signaling based on the application management table, when the playback of the title is started, the user event manager may extract the key interest table from the operation mode object that corresponds to the title, and judge whether or not a key received by the receiving unit as the instruction is valid according to the key interest table, and the key event transmitted to the application may correspond to the key that is defined as valid in the key interest table.
  • the user event manager is an essential component of a player model defined in the BD-J application layer standard, and the complementing function pertaining to the present invention can be realized in conformity with the player model.
  • Playlist information referring to an AV stream may be stored in the recording medium
  • the operation mode object may include accessible playlist information indicating a playlist that is to be automatically played when an instruction to play back the title is made
  • the playback unit may perform the AV playback by playing the AV stream based on the playlist indicated by the accessible playlist information, and if the predetermined speed level is slower than the normal speed level, a time length of the title may increase as a playback time length of the AV stream increases.
  • the operation period of the application that operates in synchronization with the AV stream can be extended.
  • the operability of the AV stream is indirectly improved through the adjustment of the playback period of the AV stream mentioned above. Therefore, it is easy to realize the complement of the operability of the application in common BD-ROM playback apparatuses.
  • FIG. 1A shows the structure of a BD-ROM 100 as an example of a recording medium used with the present invention
  • FIG. 1B shows an internal structure of Index.bdmv
  • FIG. 2A shows an example file structure of the JAR file
  • FIG. 2B shows an internal structure of a BD-J object
  • FIG. 3 shows GUIs of an interactive application and an online shopping application to be executed by a playback apparatus pertaining to the present invention
  • FIG. 4 shows specifications of operations performed by applications intended for use with the playback apparatus
  • FIG. 5 shows a hardware structure of the playback apparatus
  • FIG. 6 shows a layer model of a software structure of the playback apparatus
  • FIG. 7 schematically shows an improvement of specifications of operations performed by the applications
  • FIG. 8A shows an internal structure of player state information in a player state register 2 a
  • FIG. 8B shows an internal structure of player setting information
  • FIG. 9 shows a setup menu of the playback apparatus
  • FIG. 10 shows functional components of a playback control engine 2 ;
  • FIG. 11 is a flowchart showing processing procedures as a main routine of the playback control engine 2 ;
  • FIG. 12 is a flowchart showing processing procedures of operation state judgment processing
  • FIG. 13 is a flowchart showing processing procedures of playback speed instruction processing
  • FIG. 14 is a flowchart showing processing procedures of setup processing
  • FIG. 15A shows GUI specifications of the interactive application
  • FIG. 15B shows GUI specifications of the online shopping application
  • FIG. 16 shows an internal structure of a JAR file pertaining to the second embodiment
  • FIG. 17 shows how instances of class files pertaining to the second embodiment operate
  • FIG. 18 is a flowchart showing processing procedures as a main flow in the second embodiment
  • FIG. 19 is a flowchart showing processing procedures of playback speed instruction processing
  • FIG. 20 shows an AV stream in which information for speed control is incorporated
  • FIG. 21 shows components that particularly relate to improvement in the third embodiment (i.e. a stream decoder 105 , a playback control engine 2 , and a control information setting unit 13 );
  • FIG. 22 is a flowchart showing processing procedures as a main flow in the third embodiment.
  • FIG. 23 shows an internal structure of an operation mode object a BD-J object) pertaining to the fourth embodiment
  • FIG. 24 schematically shows a system LSI in which a stream decoder 105 , an AV decoder 106 , a RAM 108 , a ROM 109 , a CPU 110 and an instruction receiving unit 112 are incorporated; and
  • FIG. 25 shows a way of incorporating the system LSI into the playback apparatus.
  • the playback apparatus causes a JavaTM application provided via a BD-ROM to be executed by a virtual machine thereof. Since the BD-ROM is the execution target of the playback apparatus, the internal structure of the BD-ROM is explained firstly, and followed by the explanation of the playback apparatus.
  • FIG. 1A shows the structure of the BD-ROM 100 as an example recording medium used with this embodiment.
  • the BD-ROM stores therein AV data and application programs.
  • the first tier of FIG. 1A shows the appearance of the BD-ROM.
  • the BD-ROM has a recording area spiraling from the inner circumference to the outer circumference of the BD-ROM.
  • the second tier depicts the spiral recording area drawn out to the sides.
  • the recording area has a logical address space between the lead-in area on the side of the inter circumference and the lead-out area on the side of the outer circumference.
  • the logical address space can store therein the logical data.
  • BCA Burst Cutting Area
  • the logical address space stores therein file system information at the top, and also stores AV streams and so on.
  • the file system is, for example, the UDF or the ISO9660. This file system enables reading of logical data from the recording area described above.
  • the third tier shows the directories and the file structure of the recording area.
  • a BDMV directory is placed directly under a ROOT directory, and a STREAM directory, an MPLS directory, a JAR directory and a BDJO directory exist under the BDMV directory.
  • the AV stream is a transport stream in the MPEG2-TS format, obtained by the time-division multiplexing of digitized moving pictures, subtitles and audio data.
  • the AV stream is placed under the STREAM directory.
  • the playlist information defines one or more pairs of an In_Time and an Out_Time on the playback time line of the AV stream, in order to define logical playback sections and playback paths.
  • the playlist information includes a stream number table, which defines valid streams among the elementary streams multiplexed into the AV stream.
  • the stream number table determines, for each of the elementary streams included in the AV stream, whether to permit the playback thereof.
  • the AV playback can be started by the JavaTM application instructing the JavaTM virtual machine to generate a JMF player instance for playing back the playlist information.
  • the JMF player is actual data generated on a heap memory of the virtual machine, based on the JMF player class.
  • the pair of the AV stream and the playlist information constitutes a playback unit called “title”.
  • the AV playback of the BD-ROM is performed in units of the titles.
  • FIG. 1B shows the internal structure of the Index.bdmv.
  • the Index.bdmv is a table for associating an operation mode object to the title, which is a playback unit including the AV stream and the playlist information.
  • the operation mode object is information for determining the operation mode used for dynamic control relating to the title while playing back the title based on the Index.bdmv.
  • the BD-ROM stores a various types of titles.
  • the Index.bdmv shown on the left of the FIG. 1B includes indexes respectively defined for the various types of titles. Specifically, this Index.bdmv includes an Index Table Entry for a First Playback, an Index Table Entry for a Top Menu, an Index Table Entry for a Title # 1 , an Index Table Entry for a Title # 2 , . . . and an Index Table Entry for a Title #N.
  • This table designates, for each of the titles, the Top Menu and the First Playback, the Movie object or the BD-J object to be executed first.
  • the playback apparatus for the BD-ROM refers to the Index.bdmv every time a title or a menu is called, and executes a designated object.
  • the “First Playback” indicates a Movie object or a BD-J object that is to be automatically executed when the disc is mounted.
  • the First Playback has been set by the content provider.
  • the “Top Menu” indicates a Movie object or a BD-J object that is to be called when a command such as “Menu Call” is executed according to a user's operation from the remote control.
  • the lead lines h 1 in the drawing show the up-close details of the common data structure of the Index Table Entries.
  • the Index Table Entry is defined by this common data structure. This structure includes a “Title_object_type”, and a “Title_bdjo_file_name”.
  • the “Title_object_type” shows whether the operation mode object associated with the corresponding title is a Movie object or a BD-J object.
  • the “Title_bdjo_file_name” shows the file name of the Movie object or the BD-J object associated with the title.
  • the Index.bdmv having the stated structure realizes the correspondence between the titles and the operation mode objects.
  • An XXXXX.JAR (“XXXX” is variable, and the extension “.JAR” is fixed) is a JavaTM archive file.
  • a JavaTM archive file is in the ZIP file format that is specialized for the JavaTM, and expand able by any commercially-available ZIP expansion software.
  • “XXXXX” is variable, and the extension “.JAR” is fixed.
  • Such a file is herein after called a “JAR file”.
  • a JAR file includes a plurality of files in the form of directories.
  • a single JAR file includes at least one class file, a metafile showing the attribute of the JAR file, and data such as images. Basically, a single JAR file includes a single JavaTM application, and the JavaTM application can be executed on the JavaTM virtual machine.
  • FIG. 2A shows an example file structure inside the JAR file.
  • the Jar file has a structure where a “class file for an interactive application” and a “class file for an online shopping application” exist under the root directory.
  • the JavaTM applications defined by these class files are JavaTM Xlets controlled via an Xlet interface.
  • the Xlet interface has four states, namely “loaded”, “paused”, “active” and “destroyed”. Applications mentioned in this Specification are instances of the class files recorded on a recording medium such as a BD-ROM in the stated manner.
  • FIG. 2B shows the internal structure of the BD-J object. As shown on the left of the FIG. 2B , the BD-J object includes an application management table and a Key Interest table.
  • the application management table is a table for realizing “application signaling”.
  • the “application signalizing” means to control activation and termination of the application through managing the titles on the BD-ROM as active sections of the application.
  • the “active sections” are sections on the time line of the whole content recorded on the BD-ROM, where the application can be active on the heap memory of the virtual machine.
  • the term “active” means a state of the application, in which the application has been read into the heap memory and is executable by the virtual machine. On the other hand, sections in which the application is actually operating are called “operation sections”.
  • the lead lines h 2 in the drawing show the up-close details of the internal structure of the application management table.
  • the application management table includes a plurality of application entries # 1 -#n.
  • the lead lines h 3 show the up-close details of the common data structure of the application entries.
  • the application entry includes a “control code” and an “application ID”.
  • a “control code” shows how to start up the application, that is, whether to automatically start up the application in the title (Auto Start) or to start up after waiting for a call from another application (Present).
  • An “application id” identifies an application using five-digit number as a file name of the JAR file.
  • the lead lines h 4 show the up-close details of the structure of the Key Interest table.
  • the Key Interest table includes a playback key entry, a stop key entry, a fast-forwarding key entry, a rewinding key entry, an up direction key entry, a down direction key entry, a right direction key entry and a left direction key entry. These are entries corresponding to the keys provided on the remote control of the playback apparatus.
  • the lead lines h 5 show the up-close details of the configuration for the key entry. Specifically, whether or not to generate a key event when the corresponding key is pressed has been determined for each key.
  • the playback apparatus can read them into the memory by making a system call for “file open”.
  • the “file open” is processing for searching directories for a file using the file name given when the system call is made, and if the file is found, securing a FCB (File Control Block) and returning a file handle number.
  • FCB File Control Block
  • the FCB is generated by copying the directory entry of the target file onto the memory.
  • the application signaling is performed in units of the titles.
  • the title includes playback units such as the playlist information and the AV stream, and has a reasonable time length. Accordingly, the operation sections of the application can not be too short as long as the signaling is performed in units of the titles.
  • the length of the operation section is likely to be short. Further, if the application is of a type that is started up after waiting for a call from another application and terminated by a call from yet another application, the length of the operation section sometimes becomes short, too.
  • the length of the operation section depends on how long the person stays within the frame. If the person stays within the frame for only a short period, the length of the operation section of the application started up by the call can be extremely short.
  • the application that is started up by another application when a particular person appears in the frame is taken as an example for an application which might have an extremely short operation section.
  • FIG. 3 shows GUIs of an interactive application and an online shopping application, which are to be executed by the playback apparatus pertaining to this embodiment.
  • An “interactive application” has a video control function that enables the user to select one of selectable objects appearing in the video.
  • This application displays a pointer p 1 as the GUI. The user can move this pointer p 1 by operating the direction keys of the remote control, and select a particular object (e.g. the female golfer) in the moving picture.
  • An “online shopping application” is used for selecting and purchasing an item appearing in the video displayed on the screen.
  • This application displays a purchase window p 2 as the GUI.
  • This button GUI is accepts confirmation of the purchase. If the user presses the button to confirm the purchase, electronic payment will be made on the network.
  • FIG. 4 shows specifications of operations performed by the applications intended for use with the playback apparatus.
  • the first tier shows the GUIs of the applications
  • the second tier shows the period for which the online shopping application is executed
  • the third tier shows the period for which the interactive application is executed.
  • the interactive application executes interactive processing in synchronization with the AV playback, and the operation section thereof is shown at the third tier in the drawing. Specifically, the interactive application is operating all the time while the AV playback is being executed.
  • the interactive application can display the pointer p 1 , move the pointer p 1 according to the user's operation, and put a focus on the person, etc., existing on the AV playback screen, according to the user's confirmation operation.
  • the online shopping application is associated with a person, etc. appearing on the AV playback screen, and the operation section thereof has been configured as the second tier in the drawing shows. Specifically, the online shopping application is started up when the person appears in the frame and the confirmation is made from the remote control (the timing t 1 in the drawing), and terminated when the person goes out of the frame (the timing t 2 in the drawing). While running, the online shopping application displays the purchase window p 2 , presents the details of the item related to the person to the user, and accepts the user's operation for purchasing the item.
  • the GUIs of the interactive application and the online shopping application are displayed as the first tier in the drawing shows. Specifically, the interactive application during operation displays the pointer p 1 on the AV screen according to the user's operation.
  • the online shopping application is started up when a predetermined person (e.g. the female golfer) appears in the frame of the AV screen and the user's confirmation is made on this person.
  • the online shopping application displays a composite screen generated by combining the person's image and the purchase window p 2 , presents the details of the item related to the person to the user, and accepts the user's operation for purchasing the item.
  • the online shopping application After progression of the AV playback, the online shopping application will be terminated when the person mentioned above disappears from the frame.
  • the online shopping application according to the specifications mentioned above operates only while the associated person is being displayed on the screen. If the period for which the associated person is displayed on the AV screen is short, the period for which the online shopping application accepts the purchase of the item is very short, accordingly.
  • the playback apparatus can be controlled from the remote control.
  • the remote control is a device that receives, from the user, operations that are unique to AV apparatuses, such as playback, stop, pause and skip operations, and operations to the hierarchized GUI.
  • the remote control is provided with a playback key, a stop key, a pause key, a skip key, a menu key for calling a setup menu, direction keys for moving the focus of the GUI parts constituting the menu, an enter key for a confirmation operation onto the GUI parts constituting the menu, a cancel key for going back to an upper level of the hierarchized GUI, and numeric keys. These keys constitute a key matrix.
  • the remote control specifies the row position and the column position of a pressed key based on a detected contact with the key matrix, and generates a key code by encoding the row position and the column position.
  • the remote control transmits a remote control signal including the generated key code.
  • the remote control signal to be transmitted includes frames each having a length for a few milliseconds.
  • the I/O bits included in the bit system of the frames includes that with a carrier signal of a few kilohertz and the without the carrier signal.
  • the playback apparatus can receive the remote control signal by generating a clock pulse that has the same frequency and the same duty ratio as the carrier and capturing the bit system of the data part. Unlike personal computers, the playback apparatus receives instructions from the user via the remote control. Accordingly, the GUIs of the playback apparatus and the applications are specialized for operations via a remote controller.
  • FIG. 5 shows the hardware structure of the playback apparatus.
  • the playback apparatus includes a BD-ROM drive 101 , an HDD 102 , a memory card drive 103 , a switch 104 , a stream decoder 105 , an AV decoder 106 , a video frame buffer 107 , a RAM 108 , a ROM 109 , a CPU 110 , a graphics frame buffer 111 , an operation receiving unit 112 , and a network interface 113 .
  • the BD-ROM driver 101 performs loading and ejecting of the BD-ROM having the internal structure shown in FIG. 1A , and has access to the BD-ROM.
  • the HD drive 102 is capable of storing therein class files equivalent to the class files provided via the BD-ROM.
  • the memory card drive 103 is capable of loading a semiconductor memory card into which class files equivalent to the class files provided via the BD-ROM have been written.
  • the switch 104 selectively outputs the class files and the AV stream read from the BD-ROM drive 101 , the HDD 102 and the memory card drive 103 to the stream decoder 105 and the RAM 108 .
  • the stream decoder 105 separates the AV stream recorded on the BD-ROM 100 into the video stream and the audio stream.
  • the AV decoder 106 decodes the video data and the audio data separated and extracted from the stream decoded by the stream decoder 105 , while keeping the synchronization between the video data and the audio data.
  • the AV decoder 106 outputs the decoded video data to the display, and the decoded audio data to the speaker.
  • the AV decoder 106 realizes slow playback by repeating the output of each frame of the video data a predetermined number of times. For example, if the AV decoder 106 has been instructed to perform the playback at the 1 ⁇ 2 speed of the normal playback and received video data corresponding to the first frame, video data corresponding to the second frame, . . .
  • the AV decoder 106 outputs each piece of video data in duplicate. Specifically, the AV decoder 106 outputs, in a second, video data corresponding to the first frame, video data corresponding to the first frame, video data corresponding to the second frame, video data corresponding to the second frame, video data corresponding to the fifteenth frame, and video data corresponding to the fifteenth frame. Since the AV decoder 106 outputs two pieces of video data of the same frame, the playback of the AV stream requires a time that is twice as long as the normal playback. As a result, the playback apparatus can realize the slow playback that is at the 1 ⁇ 2 speed of the normal playback.
  • the video frame buffer 107 stores therein non-compressed frame images obtained through the decoding by the AV decoder 106 .
  • the update frequency of the video frame buffer in a second is thirty times per second. This means that the AV decoder 106 outputs thirty frames of the AV stream in a second to the video frame buffer 107 , and thirty frames of the graphics rendered by the application are output to the graphics frame buffer 111 in a second.
  • the RAM 108 stores therein data necessary for the CPU 110 to perform data processing.
  • the ROM 109 stores therein programs that have been built in the playback apparatus, such as an interpreter, a native library, and a class library.
  • the CPU 110 executes a native code stored in the ROM 109 for the built-in programs.
  • the graphic frame buffer 111 is used for rendering the GUI when the CPU 110 performs interactive control.
  • the graphics rendering realized by the graphic frame buffer 111 is, for example, the GUI display by the applications, the menu display at the setup, and so on.
  • the graphic rendered by the applications such as the purchase window p 2 and the pointer 1 , are rendered through operations by the graphic frame buffer 111 , because they are kinds of GUIs.
  • the graphics on the graphics frame buffer 111 are managed with use of numeric values for graphics management.
  • the graphics data image corresponding to each numeric value is displayed on the screen for a predetermined period.
  • the applications generate new graphics during this period. After the predetermined period, the data stored in the graphic frame buffer 111 will be overwritten with newly generated graphics data.
  • the numeric values for the graphics management are updated according to the overwriting. That is, the GUI display by the applications changes as the frames of the AV playback progress, based on repetition of the series of operations, namely “the generation of the graphics by the applications”, “the updating of the generated graphics”, “the overwriting of the graphics” and “the updating of the numeric values for the graphics management”. Moreover, it is possible to change the update frequency of the data in the graphics buffer 111 within a unit time (e.g. a second) by changing the number of times the series of operations are repeated within the unit time (the number of times is herein after referred to as the execution speed of the applications).
  • a unit time e.g. a second
  • GUI display graphics data display
  • the operation receiving unit 112 detects and notifies user's operations performed on the input devices such as the remote control and the front panel of the playback apparatus. This notification is made by generating a UOP according to an interruption caused by an interruption handler included in the device driver corresponding to each input device.
  • a UOP (UOP event) is an event that occurs when a pressed key is detected based on the key matrix provided on the remote control and front panel, and includes a key code corresponding to the pressed key.
  • the interruption handler included in the device driver corresponding to the remote control and the front panel generates a UOP event by generating an interruption signal based on a pressed key when a pressed key is detected based on the contact with the key matrix.
  • the network interface 113 executes a protocol stack for network connection, and has the playback apparatus realize, as network drives, drives of server computers on the network. As a result, the playback apparatus can download data from the network drive, and upload data to the network drive. The playback apparatus can perform data communications with external servers via the network interface 113 . Therefore, in the case of executing the online shopping application, the playback apparatus can realize the electronic payment with payment servers on the network according to the byte codes constituting the application, via the network interface 113 .
  • the playback apparatus of FIG. 5 is a JavaTM platform structured by a full implementation of the JavaTM 2 Micro Edition (J2ME) Personal Basis Profile (PBP 1.0) and the Globally Executable MHP specification (GEM1.0.2) for package media targets.
  • the playback apparatus has a layer model that is illustrated in FIG. 6 .
  • FIG. 6 shows the layer model of the soft ware structure of the playback apparatus.
  • This layer model mainly includes the following three layers:
  • the BD-ROM Resident System Software includes a user event manager 9 .
  • This layer is referred to as a BD-J module 3 , and works as the execution environment for the applications. This corresponds to the Java platform (referred to as the BD-J module).
  • the playback engine 1 performs the AV playback functions.
  • the AV playback functions of the playback apparatus are conventional functions that follow those of DVD players, CD players, and so on.
  • the AV playback functions include, for example, functions of starting the playback (Play), stopping the playback (Stop), pausing the playback (Pause On), canceling the pausing (Pause Off), canceling the Still function (Still off), forwarding with speed designation (Forward Play (speed)), rewinding with speed designation (Backward Play (speed)), switching the audio (Audio Change), switching the subtitles (Subtitle Change), and switching the angle (Angle Change).
  • the playback control engine 2 performs functions such as (i) playback of the playlist and (ii) acquisition/setting of the playback state.
  • the function of playing back the playlist is one of the AV playback functions, and performed to start or stop the playback according to the playlist.
  • the playback control engine 2 also includes a player state register 2 a that shows the state of the playback apparatus, and a player setting register 2 b that shows the setting of the playback apparatus by the manufacture and the user.
  • the playback control engine 2 performs the function of acquiring/setting the playback state of the playback apparatus, according to player state information included in the player state register 2 a and player setting information included in the player setting register 2 b .
  • the player setting register 2 b includes setup items of “automatic speed control” and “speed level”, and if the automatic speed control in the player setting register 2 b is ON, the playback at the speed level in the player setting register 2 b will be realized.
  • the BD-J module 3 is the platform of the playback apparatus, and includes a JavaTM virtual machine 4 , a heap memory 5 , an application cache 6 , a class loader 7 and an application manager 8 .
  • the JavaTM virtual machine 4 is an interpreter.
  • the Java TM) virtual machine 4 converts byte codes, constituting an application stored in the heap memory 5 , into native codes that the CPU 110 can interpret, and provides the CPU 110 with the native codes. As a result, it is possible to have the CPU 110 execute the application as the byte codes.
  • the heap memory 5 is a memory for storing therein applications as byte codes, which are instances of the class files.
  • the application cache 6 is a cache memory for storing therein applications.
  • the class loader 7 reads the class files of the applications from the BD-ROM 100 and converts the class files into byte codes.
  • the byte codes obtained in this way will be stored into the heap memory 5 . Accordingly, the heap memory 5 stores the applications as the byte codes, and these byte codes will be executed by the Java TM) virtual machine 4 .
  • the application manager 8 When the titles to be played back by the playback apparatus is switched from one to another, the application manager 8 reads the application programs from the BD-ROM 100 and stores the programs into the application cache 6 . Then, the application manager 8 refers to the control code of each application. If the control code is AutoStart (automatic startup), the application manager 8 causes the JavaTM virtual machine 44 to execute the application to be automatically started up. The application manager performs this conversion by outputs an instruction to the class loader 7 .
  • AutoStart automatic startup
  • the interactive application is to be automatically started up at the AV playback. Therefore, the interactive application is automatically started up in the manner stated above.
  • the online shopping application mentioned above is an application that is to be started up according to a startup request from the user or a call from another application. Therefore, if a direction key of the remote control is pressed when the online shopping application is in the state of being cached in the application cache 6 and waiting for the startup request from the user and a call from another application, the online shopping application will be converted into executable codes and stored into the heap memory 5 .
  • the JavaTM virtual machine 4 executes the application programs by interrupting and executing the codes stored in the heap memory 5 .
  • the user event manager 9 judges whether to generate a key event (an event that the applications can receive) corresponding to the UOP event. In the case of judging that it is necessary to generate a key event, the user event manager 9 outputs a key event to the applications. Since the key Interest table of the BD-J object defines whether to generate a key event for each key, the user event manager 9 makes the judgment with reference to the entries included in the Key Interest table of the BD-J object.
  • Each of the arrows ⁇ 1 , 2 , 3 and 5 schematically shows a characteristic processing flow in this layer model. As mentioned above, an occurrence of a key event and output of the key event to an application are made when an UOP event occurs ( ⁇ 5 ).
  • Characteristic processing of the user event manager 9 is that the user event manger 9 outputs the occurred key event to the playback control engine 2 ( ⁇ 2 ) before outputting the key event.
  • the playback control is performed based on the automatic speed control and the speed level stored in the player setting register 2 b . As a result of this playback control, the slow playback and the pause of the playback can be realized.
  • the above are the explanations for the layer model of the software in the playback apparatus.
  • the software elements shown in this drawing operate as follows. Since the interactive application is an element for controlling the video that is being played back and soon by selecting a one of selectable objects, the pointer p 1 appears on the AV screen.
  • the class loader 7 converts the online shopping application programs stored in the application cache 6 into executable byte codes, and stores the byte codes into the heap memory 5 .
  • the JavaTM virtual machine 4 executes the codes stored in the heap memory 5
  • the online shopping application program stars up, the purchase window p 2 appears on the display. From this window, the user can purchase the item through a prescribed procedure.
  • the AV playback is controlled such that the playback speed will be the prescribed speed level.
  • the AV stream will be played at a slow speed or paused while the user is operating the interactive application program.
  • a predetermined period e.g. thirty seconds
  • the playback speed returns to the normal.
  • the JavaTM virtual machine 4 does not operate slowly in synchronization with the slow playback of the AV stream (In other words, the number of times in the unit time (i.e. the execution speed) of repeating the series of operations, namely “the generation of the graphics by the applications”, “the updating of the generated graphics”, “the overwriting of the graphics” and “the updating of the numeric values for the graphics management” does not change according to the playback speed of the AV stream).
  • the applications are executed at the speed (normal speed) that is the same as the speed in the case where the AV stream is being played at the normal speed.
  • the execution speed of the application is decreased according to the slow playback speed of the AV stream, the responsivity is decreased, which is inconvenient for the user.
  • the slow operation in synchronization with the AV playback is avoided to increase the responsivity of the interactive application program upon receipt of inputs.
  • the signaling is performed on the applications by the application manager 8 in units of titles, based on the application management table. Even if the JavaTM virtual machine 4 is operating at the normal speed, if the AV playback is performed at a low speed, the period for which the playback of each title continues is increased accordingly. As a result, the applications continue their operations at the normal speeds. Therefore, it is possible to increase the lengths of the operation sections of the applications while keeping the normal responsivity.
  • FIG. 7 schematically shows the improvement of the specifications of the operations performed by the applications.
  • the first tier shows a plurality of frame images used for the AV playback performed by the playback apparatus.
  • the second tier shows the operation sections of the interactive application and the online shopping application.
  • the third tier shows the GUI display performed by the online shopping application.
  • the operation section of the online shopping application As the length of the operation section becomes longer, the user has an enough time for operating the GUI displayed by the online shopping application. As described above, if the automatic speed control is ON, the playback of the AV data is controlled to be performed at the speed level predetermined by the user. Therefore, the operation section of the online shopping application associated with a specific person's image becomes longer, and the user can easily operate the GUI displayed by the online shopping application. This is the improvement of the specifications of the operations of the applications, which is provided by the characteristic feature of the playback apparatus.
  • the playback apparatus has a function mode in which the specifications of the operations of the applications are improved.
  • This mode which improves the operability for the user by extending the operation sections of the application by controlling the AV playback speed so as to be slow or to be paused, is called “application EASY mode”.
  • the player state register 2 a in the playback apparatus accepts configurations of the application EASY mode.
  • the player state information stored in the player state register 2 a is described next.
  • the player state register 2 a is used for showing the playback state of the contents on the playback apparatus, and the information stored therein dynamically changes according to the playback state of the content recorded on the BD-ROM 100 .
  • the playback state of the content is specified based on parameters, such as a current title number, a current chapter number, a current angle number, and a current audio number.
  • FIG. 8A shows the internal structure of the player state information stored in the player state register 2 a .
  • the player state information stored in the player state register 2 a includes a “current title number”, a “current chapter number”, a “current angle number”, and a “current audio number”.
  • the “current title number” shows the title that is currently being played, using a valid title number (that is equal to or more than 1). If no title is currently being played, the current title number shows an invalid value (e.g. 0).
  • the “current chapter number” shows the chapter that is currently being played, using a valid chapter number (that is equal to or more than 1).
  • the chapters are defined within the title that is indicated by the current title number. If no chapter is currently being played, the current chapter number shows an invalid value (e.g. 0).
  • the “current angle number” shows a video angle that is currently being selected, using a valid angle number (that is equal to or more than 1). If no video is currently being played, the current angle number shows an invalid value (e.g. 0).
  • the “current audio number” shows, in the same manner as the current angle number, audio that is currently being selected, using a valid audio number (that is equal to or more than 1). If no video is currently being played, the current audio number shows an invalid value (e.g. 0).
  • the player setting information does not dynamically change according to the playback state. Instead, the player setting information has been prestored to show the user's intention about how the content on the BD-ROM 100 should be played back. Some elements included in the player setting information can be changed according to the user's input.
  • FIG. 8B shows the internal structure of the player setting information. As this drawing shows, the player setting information includes a “Region code”, an “audio language”, a “subtitle language”, an “automatic speed control”, and a “speed level”.
  • the “Region code” shows the region where it is allowed to sell or use the playback apparatus.
  • the “Region code” cannot be changed by the user.
  • the “audio language” shows the default configuration of the audio language.
  • the “subtitle language” shows the default configuration of the subtitle language.
  • the “automatic speed control” is information showing whether or not it is allowed to change the playback speed of the AV stream when an “input relating to operations of the application”, which has been defined such that the application becomes executable, is made by the user.
  • the “input relating to operations of the application” is, for example, a key-in of the cursor and the ENTER key for starting up the application.
  • the automatic speed control is started in conjunction with the movement of the person and the object.
  • the “speed level” is information showing the speed of the playback of the AV stream to be controlled when the automatic control is permitted (set to be ON) by the “automatic speed control”.
  • the automatic speed control shows ON (permitted)/OFF (not permitted) and the speed level shows any of six levels, namely 0-5.
  • the playback apparatus can accept setting of the application EASY mode when displaying the setup menu.
  • FIG. 9 shows the setup menu of the playback apparatus.
  • the root menu mn 1 is at the highest level of the hierarchical structure, and general setting items for the playback apparatus, such as screen aspect settings and the audio output settings are listed here.
  • the characteristic point of this embodiment is that these setting items include the setting item for the application EASY mode.
  • the mode setting menu mn 2 shown in the drawing is displayed when the application EASY mode is selected.
  • the mode setting menu mn 2 for the application EASY mode includes an explanation of this mode and two button members bn 1 and bn 2 for receiving a selection between “ON” and “OFF”. When “ON” is selected, the level setting menu mn 3 is popped up.
  • the level setting menu mn 3 includes six button members corresponding to the speeds from “0” to “5” respectively. It is possible to set the speed level in the player setting register 2 b by selecting one of these levels.
  • the user can set the speed level in the application EASY mode to be “1 (very slow)” or “0 (pause)” to extend the period for which the particular person is displayed, such that the user can easily operate the GUI of the application.
  • the playback control engine 2 of the playback apparatus includes functional elements that are shown in FIG. 10 .
  • FIG. 10 shows the functional elements included in the playback control engine 2 .
  • the playback control engine 2 includes an operation state judgment unit 11 , a playback speed instruction unit 12 , a control information setting unit 13 , and a timer management unit 14 .
  • the operation state judgment unit 11 judges, when a key event occurs, whether or not the playback apparatus is in the state of playing back the AV stream, and whether or not the key event is a key event for operating the application. If the playback apparatus is in the state of playing back the AV stream, and the key event is for operating the application, the operation state judgment unit 11 notifies the playback speed instruction unit 12 of the received key event.
  • the operation state judgment unit 11 makes the judgment as to whether or not the playback apparatus is in the state of playing back the AV stream by judging whether or not the current title number stored in the player state register 2 a is a valid title number. If the title number stored in the player state register 2 a is valid, the operation state judgment unit 11 judges that the content recorded on the BD-ROM 100 is currently being played. On the other hand, if the title number stored in the player state register 2 b is invalid, the operation state judgment unit 11 judges that the content is currently not being played.
  • the key event for operating the application is a key event that has been defined in the key Interest table as a key event that is to be received by an application and executable by the application in the title. If the key event received from the operation receiving unit 112 is a key event that has been defined in the key Interest table, the operation state judgment unit 11 judges that the received key event is the key event for operating the application.
  • the playback speed instruction unit 12 refers to the information that has been set in the player setting register 2 b , and controls the playback engine 1 so as to perform the AV playback at the speed level set in the player setting register 2 b .
  • the playback speed instruction unit 12 controls the stream decoder 105 so as to separate and extract fifteen frames of the AV data from among thirty frames of the AV data displayed in a second.
  • the playback speed instruction unit 12 instructs the timer management unit 14 to start the time measurement using the timer.
  • the control information setting unit 13 stores information about the ON/OFF of the automatic control function of the playback speed of the AV stream and the playback speed after the automatic control into the player setting register 2 b .
  • the user presses the menu key of the remote control and selects the mode setting menu mn 2 for setting the application EASY mode in the sate where the playback apparatus is not playing the AV stream, the control information setting unit 13 displays the mode setting menu mn 2 for setting the application EASY mode of FIG. 9 .
  • the control information setting unit 13 reads the information which has been set in the mode setting menu mn 2 (“ON” in this example) and the speed level which has been set in the level setting menu (the speed level “1” in this example).
  • the automatic speed control of the player setting information stored in the player setting register 2 b is set to be “ON”, and the automatic control of the AV stream will be permitted.
  • the speed level in the player setting register 2 b is set to be “1”.
  • the timer management unit 14 controls the timer included in the playback apparatus.
  • the timer management unit 14 starts the time measuring using this timer.
  • the timer management unit 14 makes notification of the time out. Specifically, upon receipt of a message that instructs to start the time measurement by the timer from the playback speed instruction unit 12 , the timer management unit 14 starts the time measurement using the timer, and after a prescribed time (30 seconds in this example), outputs a time out message to the playback speed instruction unit 14 .
  • the time management unit 14 If the timer management unit 14 receives a message to instruct to start the time measurement again, within a predetermined time (30 seconds in this example) after receiving the instruction to start the time measurement, the time management unit 14 resets the timer to restart the measurement. As described above, since the timer management unit 4 receives the message for instructing to start the time measurement using the timer again within the predetermined period, it can be assumed that the user is continuously operating the application. Therefore, it is possible to more certainly prevent the user from missing an opportunity to operate the application if the timer is reset at this timing.
  • a standard player model of the apparatus that executes the BD-J application shown in FIG. 6 includes a module (the user event manager 9 ) that judges whether to output a user event, occurred due to user's any operation, to the application, and outputs a key event to the application in the case of judging affirmatively.
  • FIG. 11 is a flowchart showing a processing procedure as the main routine for the playback control engine 2 .
  • Step S 1 the operation receiving unit 112 is in the state of waiting for an operation input by the user from the remote control. If the operation receiving unit 112 receives the input, the result of the judgment at Step S 1 is Yes, and the processing moves to Step S 2 .
  • Step S 2 is for judging whether or not the received operation input is a playback control request (playback, pause, and so on). If judged as Yes at Step S 2 , an instruction is provided to perform the playback at the playback speed requested by the user (Step 3 ). In other words, the stream decoder 105 is instructed to decode the input stream to separate it into video data and audio data, and to output the video data and the audio data to the AV decoder 106 (Step S 4 )
  • the class files read from the BD-ROM are converted into the executable codes, and stored in the heap memory 5 .
  • the JavaTM virtual machine 4 starts up the application program stored in the heap memory 5 , interprets and executes the executable codes, and generates and outputs graphics images if necessary.
  • the AV decoder 106 decodes the video data included in the AV stream in synchronization with the audio data, outputs the decoded audio to the speaker and outputs the decoded video to the display (Step S 5 ). Then, the processing returns to Step 1 for waiting for an input.
  • Step S 6 the operation state judgment unit 11 is notified of the received key event (Step S 6 ), and instructed to perform operation state judgment processing (Step S 7 ).
  • the processing branches according to the result of this processing.
  • This operation state judgment processing is performed for judging whether or not the AV stream is currently being played and whether or not the received key event is for operating an application and executable while a title is being played. If the playback apparatus is in the state of playing an AV stream, and the pressed key is the direction key or the ENTER key, playback speed instruction processing (Step S 8 ) is executed, and the processing moves to Step S 4 .
  • setup menu processing (Step S 9 ) is executed and the processing returns to Step 1 for waiting for an input. Even if the playback apparatus is in the state of playing an AV stream, if the received key event does not relate to operations of the application nor the menu key, the key event is discarded (Step S 10 ) and the processing returns to Step 1 for waiting for an input.
  • FIG. 12 is a flowchart showing the operation state judgment processing.
  • the operation state judgment unit 11 Upon receipt of a key event corresponding to an operation input, the operation state judgment unit 11 reads the player state information from the player state register 2 a at Step S 12 , and judges whether the current title number and the current chapter number included in the player state information are valid or invalid at Step 13 .
  • Step 13 If the current title number is valid, the processing moves from Step 13 to Step 14 .
  • Step S 14 is a judging step for judging whether the received key event is a key relating to an operation of the application (e.g. the direction key and the ENTER key). If judged as Yes at this step, the key event is notified to the playback speed instruction unit 12 (Step S 15 ), and the processing returns to the main flowchart. If judged at Step 14 that the received key event is not a key relating to an operation of the application, the received key event is discarded (Step S 16 ), and the processing returns to the main flowchart.
  • the received key event is a key relating to an operation of the application (e.g. the direction key and the ENTER key). If judged as Yes at this step, the key event is notified to the playback speed instruction unit 12 (Step S 15 ), and the processing returns to the main flowchart. If judged at Step 14 that the received key event is not a key relating to an operation of the application, the received key event is discarded (Step S 16 ), and the processing returns to the main flow
  • Step S 13 if the current title number and the current chapter number are invalid, the key event received from the operation receiving unit 112 is notified to the control information setting unit 13 (Step S 17 ), and the processing returns to the main flowchart.
  • FIG. 13 is a flowchart showing the processing procedures of the playback speed instruction processing.
  • Step 21 is for judging whether the message received from the operation state judgment unit 11 is a key event notification or a timeout notification.
  • Step S 22 the playback control engine 2 acquires the player setting information (Step S 22 ), and the processing moves to Step S 23 .
  • Step 23 is for judging whether or not the player setting information stored in the player setting register 2 b permits the automatic speed control (i.e. ON or OFF). If Step S 23 is Yes, Step S 24 to Step S 26 will be executed. If the automatic speed control is not permitted (OFF) and Step S 23 is No, Step S 24 to Step S 26 will be skipped.
  • Step S 24 is for judging whether the speed level defined in the player setting information is 0 or not. If judged as Yes, the playback control engine 2 instructs the playback speed instruction unit 12 to pause the playback (Step S 26 ). If judged as No, the playback control engine 2 instructs the playback speed instruction unit 12 to perform the playback at a speed corresponding to the speed level (i.e. slow playback) (Step S 27 ).
  • the speed level can be adjusted in five levels by defining the speed level “1” as a speed much slower than the normal playback, and the speed level “5” as a speed a little slower than the normal playback.
  • Step S 28 a message for instructing to start the time measurement using the timer is notified to the timer management unit 14 (Step S 28 ), and the processing returns to the main routine.
  • This timeout notification shows that a predetermined period (30 seconds in this example) has elapsed since the last key input from the timer management unit 14 . If the received message is a timeout notification from the timer management unit 14 , the playback engine 1 is instructed to perform the normal playback (Step S 29 ), and the processing returns to the main routine.
  • FIG. 14 is a flowchart showing the setup processing. This flowchart includes three judgment steps. The processing to be executed changes depending on the combination of the judgment results.
  • Step S 31 is for judging whether the type of the key event is the setup key
  • Step S 32 is for judging whether the setup menu is being displayed.
  • Step S 33 is for judging whether the type of the key event is the ENTER key or the direction key.
  • the direction key is used for controlling the mode setting menu mn 2 for setting the application EASY mode.
  • the ENTER key is used for storing the configuration of the mode setting menu mn 2 into the player setting information register 2 b.
  • Step S 33 is performed for judging whether the occurred key event is for controlling the mode setting menu mn 2 or for storing the configuration of the mode setting menu mn 2 into the player setting information register 2 b.
  • the setup menu is displayed at Step S 34 .
  • the mode setting menu mn 2 for setting the application EASY mode shown in FIG. 9 .
  • This menu includes, for example, the setting items for the automatic speed control and the speed level. When the automatic speed control is turned on, the setting item for the speed level appears so that the user can set the speed level.
  • Step S 32 If judged as No at Step S 32 , the key event is discarded at Step S 38 , and the processing returns to the main routine.
  • the automatic speed control in the player setting information stored in the player setting register 2 b is ON, the AV stream is paused or played back according to the speed level indicated in the player setting information, which is slower than the normal playback speed. Accordingly, it is possible to give a longer operation time to the user who operates the interactive applications. Therefore, even if the playback time at the normal speed of the AV stream is extremely short, it is possible to secure [[an]] enough operation time for the user to operate the applications executed in synchronization with the AV playback.
  • control information setting unit 13 is explained as a built-in type program that is built in the playback apparatus.
  • the second embodiment relates to an improvement of the first embodiment, according to which the control information setting unit 13 is provided via the BD-ROM 100 .
  • FIG. 15A shows the specifications of the GUIs of the interactive application.
  • the interactive application executes processing corresponding to the pressed direction key.
  • a point p 1 is displayed in the video frame on the display screen.
  • the user can select a selectable object displayed within the video frame.
  • the user can click an object image in the video frame, using the point p 1 .
  • an F 1 car is illustrated as an object image.
  • an information window p 3 pops up.
  • This image screen shows an explanation of the clicked part of the object included in the video frame.
  • the drawing shows that a tire part of the F 1 car has been clicked and details of the part is displayed as the spec of the F 1 car.
  • the information window p 3 shows the manufacturer of the tire (Stonebridge).
  • the online shopping application program is started up when a red key on the remote control is pressed. A particular role has been assigned to this key. The user can buy a ticket on line using the application.
  • the online shopping application of this embodiment is started up when the key having a particular role is pressed.
  • FIG. 15B shows the specifications of the GUIs of the online shopping application.
  • the video frame in this drawing includes a purchase window p 2 of the online shopping application, from which the user can buy the ticket.
  • a purchase window p 2 it is preferable that the playback speed of the AV stream is under control, in the same manner as in the first embodiment.
  • FIG. 16 shows the internal structure of the JAR file pertaining to the second embodiment. This drawing is based on FIG. 2A , and the hatchings show the differences from FIG. 2A . Specifically, this embodiment is improved from the first embodiment in that the JAR file includes a class file of a playback speed instruction application 12 a , and an event listener 15 for select a key event for starting up the playback speed instruction application 12 a is included in the class file of the interactive application.
  • FIG. 17 shows how the instances of the class files pertaining to the second embodiment operate. This drawing is based on FIG. 6 .
  • the playback speed instruction application 12 a is depicted in the heap memory 5 .
  • the player state register 2 a , the player setting register 2 b , the operation state judgment unit 11 , the playback speed instruction unit 12 and the timer management unit 14 are additionally written in the playback control engine 2 .
  • the following explains the new components, namely the event listener 15 and the playback speed instruction application 12 a.
  • the event listener 15 stores therein key event reservation information.
  • the key event reservation information shows, among key events that can be accepted by the application, a key event that is to be performed with changing of the playback speed.
  • the event listener 15 Upon receiving such a key event from the operation receiving unit 112 , the event listener 15 causes the application to perform processing corresponding to the received key event while instructing the playback speed instruction application 12 a to control the playback speed.
  • the event listener 15 causes the application to perform processing corresponding to the received key event, and does not give the instruction to the playback speed instruction application 12 a.
  • the playback speed instruction application 12 a Upon receiving the instruction to control the playback speed, the playback speed instruction application 12 a instructs the playback engine 1 to control the playback speed according to the instruction. Since the playback speed instruction application 12 a is provided to the BD-J module 3 from the class files on the BD-ROM 100 , and operates on the BD-J module 3 , the playback speed instruction application 12 a reads the current title number and the current chapter number from the player state register 2 a in the playback control engine 2 , and reads the settings of the automatic speed control and the speed level from the player setting register 2 b in the playback control engine 2 . Also, the playback speed instruction application 12 a instructs the timer management unit 14 in the playback control engine 2 to start the time measuring, and receives notification of the timeout from the time management unit 14 .
  • FIG. 18 is a flowchart showing the main processing procedures pertaining to the second embodiment. This drawing is based on FIG. 11 , the same step numbers are given to the same steps as FIG. 11 .
  • Step S 1 the operation receiving unit 112 is in the state of waiting for an operation input by the user from the remote control. If the operation receiving unit 112 receives the input, the result of the judgment at Step S 1 is Yes, and the processing moves to Step S 2 .
  • Step S 2 is for judging whether or not the received operation input is a playback control request (playback, pause, and so on). If judged as Yes at Step S 2 , an instruction is provided to perform the playback at the playback speed requested by the user (Step 3 ), and the processing moves to Step 4 .
  • Step S 41 the received key event is notified to the application (Step S 41 ), and the playback speed instruction processing (Step S 8 ) is performed. Then, the processing moves to Step S 4 .
  • the stream decoder 105 decodes the input stream to separate it into video data and audio data, and outputs them to the AV decoder 106 .
  • the application program generates graphics images according to need.
  • the AV decoder 106 decodes the video data and the audio data while keeping the synchronization between them.
  • the AV decoder 106 outputs the decoded audio to the speaker and outputs the decoded video to the display.
  • FIG. 19 is a flowchart showing the processing procedures of the playback speed instruction.
  • Step S 51 is a step for waiting for a notification of a key event from the application. If a key event is notified, the event listener is caused to analyze the key event (Step S 52 ).
  • Step S 53 is for judging whether the key event is registered in the key event reservation information, as a target of the speed control. If judged as No (not registered) at Step S 53 , Step S 54 is skipped, and the processing moves to Step S 55 .
  • the playback speed instruction application 12 a provides the instruction of the playback speed (Step S 54 ), and the application is caused to perform the processing corresponding to the key event (S 55 ), and the processing returns to the main routine.
  • the event listener When the red key is pressed, the event listener performs the processing corresponding to the received key event, that is, the processing to display the purchase window p 2 on the screen. At the same time, the event listener judges that the key event is of a key that is a target of the playback speed control, and instructs the playback speed instruction application 12 a to control the playback of the AV stream that is being played. Upon receipt of this instruction, the playback speed instruction application 12 a instructs the playback engine 1 to display the AV stream that is in the state of being paused.
  • the playback engine 1 Upon receipt of the instruction, the playback engine 1 displays the AV stream and the purchase window p 2 overlaid on the video frame. This state is illustrated in FIG. 15B . In this state, the user performs certain operations to make a purchase. After that, the purchase window p 2 will be closed, and the AV playback will return to the normal.
  • an application program intended by the creator of the AV stream can be played back at an intended speed, with an intended timing such as when the user presses a particular key.
  • the manufacture of the playback apparatus can enable the playback apparatus to perform the same function as the playback speed instruction unit 12 as explained in the first embodiment, by providing the AV stream provider with a library that can be used for generating the playback speed instruction application 12 a .
  • the same processing as the first embodiment with use of an older type of playback apparatus in which the program of the playback speed instruction unit 13 is not built as a built-in program.
  • the second embodiment improves the present invention in that the application for the speed control is provided from the recording medium.
  • the third embodiment improves the present invention in that the information relating to the speed control is included in the AV stream.
  • FIG. 20 shows an AV stream in which the information for speed control is included.
  • the top tier in this drawing shows an AV stream that has a file name “YYYYY.M2TS” and is stored in the BD-ROM.
  • this AV stream includes stream table information.
  • the lead lines y 51 show the up-close details of the stream table information.
  • the stream table information includes “section control information” and “stream control information”.
  • the lead lines y 52 show the up-close details of the “section control information”.
  • the section control information includes a section type (“ 8 ” in the drawing), a section identifier (“ 16 ” in the drawing), and a section number (“ 1 ” in the drawing).
  • the lead lines y 53 show the up-close details of the “stream control information”.
  • the stream control information includes a stream type (“ 2 ” in the drawing), a program type (“ 150 ” in the drawing), the count of speed control information entries (“ 1 ” in the drawing), and speed control information entries.
  • the lead lines y 54 show the up-close details of an entry of the speed control information.
  • the control information includes a start time (“2:24:43.09” in the drawing), an end time (“2:34:43.09” in the drawing), and a speed (“5” in the drawing).
  • FIG. 21 shows components that particularly relate to the improvement in the third embodiment (i.e. the stream decoder 105 , the playback control engine 2 , and the control information setting unit 13 ).
  • the stream decoder 105 separates the stream control information from the AV stream, and passes it to the control information setting unit 13 .
  • the control information setting unit 13 writes, as the speed level, the speed control information of the stream control information received from the stream decoder 105 , into the player setting register 2 b.
  • FIG. 22 is a flowchart showing the main processing procedures pertaining to the third embodiment.
  • Step S 61 is a step for waiting for the completion of the separation of the stream control information from the AV stream.
  • the speed control information included in the stream control information is written into the player setting register 2 b (Step S 62 ), and the processing moves to Step S 63 .
  • Step S 63 is a step for waiting for the time indicated by the timer to reach the start time included in the speed control information.
  • the playback is performed at the speed acquired from the player setting register 2 b (Step S 64 ), and an instruction is given to the stream decoder 105 to separate the stream and outputs the resultant data (Step S 65 ).
  • the AV playback by the AV decoder 106 and the application GUI are output (Step S 66 ).
  • Step S 67 is a step for waiting for the time indicated by the timer to reach the end time included in the speed control information.
  • the playback at the normal speed is performed (Step S 68 ), and the stream decoder is caused to separate the stream and output the resultant data (Step S 69 ).
  • the AV playback by the AV decoder 106 and the application GUI are output (Step S 70 ), and the processing returns to Step S 61 .
  • FIG. 23 shows the internal structure of the operation mode object (BD-J object) pertaining to the fourth embodiment.
  • the Accessible playlist table shows, for each active section of the application, playback control to be performed in parallel with the execution of the application. Since applications are instable, they sometimes cause a startup failure and an abnormal termination. As a failsafe mechanism for the startup failure and the abnormal termination, the Accessible playlist table is provided for each active section.
  • the Accessible playlist table shows playback control to be performed when a certain active section of an application is started. This control is the AV stream playback that is based on the playlist information.
  • the application execution and the playlist playback can be realized at the same time by causing the playback engine 1 to perform the playback control based on the playlist information.
  • the AV playback of this embodiment is performed based on the playlist information indicated by the Accessible playlist table of the operation mode object. Therefore, if the speed level indicated by the playback speed instruction unit 12 or the playback speed instruction application 12 a is slower than the normal playback speed, the playback time length of the AV stream increases, and accordingly the time length of the title increases. In this way, it is possible to indirectly increase the operation period of the application by increasing the time length of the title through the instruction of the speed level. This gives enough time for the user to operate the GUI.
  • the application manager realizes the application signaling by using the titles on the BD-ROM as the active sections.
  • the application signaling may be realized in a different manner as long as the lengths of the active sections can be increased.
  • the application signaling may be realized in units of the playlists and the chapters.
  • the format of the player information table in the player setting register is not limited to that described in the first embodiment. Any formats may be adopted as long as the information relating to the AV stream recorded on the recording medium in the format can be stored in the player setting register.
  • the format of the player setting information is not limited to that described in the first embodiment. Any formats may be adopted as long as the information that has been set to the playback apparatus 100 in the format can be stored in the player setting register 2 b.
  • the state of playing back the AV stream may include the state of performing specific playback such as the fast-forwarding. If this is the case, when the timer management unit notifies of the time out in the playback speed instruction processing, the playback may be return to the specific playback.
  • the speed level in the embodiments above is defined in six levels from 0 to 5, the number of the levels is not limited to six. The number of levels may be any.
  • the speed level “0” indicates the paused state
  • the definition is not limited to this.
  • the speed level “5” may indicate the paused state. In other words, it is only necessary that any of settable speed levels corresponds to the paused state.
  • the stream decoder 105 , the AV decoder 106 , the RAM 108 , the ROM 109 , the CPU 110 , and the instruction receiving unit 112 may be structured as a single system LSI.
  • the ROM 109 includes the playback engine 1 , and the playback state judgment unit 11 and the playback speed instruction unit 12 which are included in the playback control engine 2 , among the software components depicted in FIG. 10 .
  • FIG. 24 schematically shows a system LSI that includes the stream decoder 105 , the AV decoder 106 , the RAM 108 , the ROM 109 , the CPU 110 and the instruction receiving unit 112 .
  • a system LSI is a package including a bare chip implemented on a high-density substrate.
  • a package that includes a plurality of bare chips implemented on a high-density substrate and has an appearance like a single LSI is also referred to as a system LSI (Such a system LSI is called “multi-chip module”).
  • the QFP is a system LSI in which pins are attached to the four sides of the package.
  • the PGA is a system LSI in which many pins are disposed all over the bottom face of the package.
  • FIG. 25 shows a way of incorporating the system LSI into the playback apparatus.
  • system LSI Since the purpose of the system LSI mentioned above is to realize the functions of the playback apparatus, it is preferable that the system LSI complies with the UniPhier architecture.
  • a system LSI complying with the UniPhier architecture includes the following circuit blocks:
  • DPP Data Parallel Processor
  • the Data Parallel Processor is an SIMD type processor in which a plurality of element processors performing the same operations. Computing device included in each element processor operate at the same time according to a single instruction so that decoding of a plurality of pixels constituting a picture can be performed in parallel.
  • IPP Instruction Parallel Processor
  • the Instruction Parallel Processor includes a “Local Memory Controller” constituted of an instruction RAM, an instruction cache, a data RAM and a data cache, a “Processing Unit” constituted of an instruction fetch unit, a decoder, an execution unit and a register file, and a “Virtual Multi Processor Unit” that instructs the Processing Unit to execute a plurality of applications in parallel.
  • a “Local Memory Controller” constituted of an instruction RAM, an instruction cache, a data RAM and a data cache
  • a “Processing Unit” constituted of an instruction fetch unit, a decoder, an execution unit and a register file
  • a “Virtual Multi Processor Unit” that instructs the Processing Unit to execute a plurality of applications in parallel.
  • the CPU block includes peripheral circuits such as an ARM core, an external bus interface (Bus Control Unit: BCC), a DMA controller, a timer and a vector interruption controller, and peripheral interfaces such as a UART, a GPIO (a General Purpose Input Output) and a synchronous serial interface.
  • BCC Bus Control Unit
  • DMA controller DMA controller
  • timer timer
  • vector interruption controller a vector interruption controller
  • peripheral interfaces such as a UART, a GPIO (a General Purpose Input Output) and a synchronous serial interface.
  • GPIO General Purpose Input Output
  • the stream I/O block realizes data input/output via a USB interface and an ATA packet interface from/to a drive device, a hard disk drive device and an SD memory card drive device, which are connected to the external bus.
  • the AV I/O block includes an audio input/output, a video input/output and an OSD controller, and realizes data input/output from/to a TV and an AV amplifier.
  • the memory control block is a block for realizing reading and writing on a SD-RAM connected via the external bus, and includes an internal bus connection unit that controls the internal connections among the blocks, an access control unit that performs data transfer from/to the SD-RAM connected to the outside the system LSI, and an access schedule unit that controls access requests from the blocks to the SD-RAM.
  • the manufacturing process is specifically as follows: Firstly, create a circuit diagram of a part to be realized as the system LSI, based on the structure diagrams shown in the embodiments above, and realize the components shown in the structure diagrams using circuit elements, ICs and LSIs.
  • connection lines that connects among the circuit elements, the ICs and the LSIs, and peripheral circuits thereof, and an interface to the outside. Further, define connection lines, power source lines, ground lines, clock signal lines and so on. It is necessary to complete the circuit diagram while adjusting the operation timings of the components and securing the bandwidths required for the components, in terms of the spec of the LSI.
  • the implementation designing is a process of creating a substrate layout, performed to determine the positions of the parts (the circuit elements, the IC, the LSI) on the substrate as shown on the circuit diagram, and how to connect the connection lines on the substrate as shown on the circuit diagram.
  • the result of the implementation designing is converted to CAM data, and output to the NC machine tool or the like.
  • the NC machine tool performs SoC implementation and SiP implementation, based on the CAM data.
  • the SoC (System on chip) implementation is a technique to print a plurality of circuits on a single chip.
  • the SiP is a technique to form a single package from a plurality of chips, using resins or the like.
  • the system LSI pertaining to the present invention can be manufactured through the processes mentioned above, based on the drawings showing the internal structure of the playback apparatus explained in each of the embodiments above.
  • the integrated circuit generated as described above may be variously referred to as an IC, an LSI, a super LSI or an ultra LSI, depending on the degree of the integration.
  • the system LSI realized with use of an FPGA includes many logic elements disposed in a grid pattern. It is possible to realize the hardware structures shown in the embodiments above by connecting the horizontal and the vertical lines according to the input/output combination described in the LUT (Look Up Table).
  • the LUT is stored in the SRAM, and the content of the SRAM disappears when it is powered off. Therefore, when using such an FPGA, it is necessary to write the LUT for realizing the hardware structures into the SRAM, using configuration information.
  • the HDD 102 and the memory card drive 103 may be realized as local storages that can be accessed with use of methods acquired from the JavaTM IO package.
  • the HDD 102 and the memory card drive 103 structure a so-called virtual package if they realized as local storages.
  • a local storage has a plurality of domain areas.
  • a domain area is a directory corresponding to a disk root certificate that is unique to a BD-ROM. Under this directory, directories for each organization are placed.
  • the disk root certificate is a root certificate that has been given to a creator of the BD-ROM by a root certificate authority and allocated to the BD-ROM by the creator.
  • the disk root certificate is encoded in the X.509 format, for example.
  • the specification of the X.509 format is published by the CCITT, and disclosed in “CCITT Recommendation X.509 (1988), “The Directory—Authentication Framework”.
  • the directories of each application of an organization are the same as those of the MHP.
  • the local storage has a structure in which the directories of each application of the organization are located under the directory corresponding to the root certificate. This structure maintains the compatibility with the storage method of the MHP.
  • part of the file paths for accessing the directories in the local storage corresponds to the root certificate, is called a “local storage root”.
  • a class object is generated based on class files read from the directory corresponding to the disk root certificate of the BD-ROM, using the local storage root, and provided to be executed by the JavaTM virtual machine 4 .
  • the contents of the BD-ROM and the local storage area are encrypted according to the Advanced Access Content System (AACS) with signature information added thereto, and the right to use is defined in a permission file.
  • AACS Advanced Access Content System
  • a desired file exists at a location indicated by a file path “/Persistent/1/1/streams/”
  • exists ( ) method of the JavaTM shows an example of the exists ( ) method of the case where the desired file is “O.m2ts”: new JavaTM.io.File(“/Persistent/1/1/streams/0.m2ts”).exists( );
  • the BD-J object as the operation mode object described in the embodiments above includes cache management information, and the storage into the application cache 6 is performed based on this cache management information.
  • the cache management information shows files of which application should be read into the application cache 6 when the title corresponding to the BD-J object becomes the current title, before the AV playback of the current title is started.
  • the BD-J module 3 reads, into the application cache 6 , files indicated by the cache management information included in the BD-J object corresponding to the current title, before the AV playback of the current title is started.
  • the cache management information includes entries respectively corresponding to the applications. Each entry instructs the playback apparatus to read the corresponding application into the application cache 6 . Each entry is given a prescribed priority.
  • the BD-J module 3 firstly reads the application that corresponds to the entry that is given the highest priority into the application cache 6 , and then sequentially reads the applications corresponding to the rest of the entries into the application cache 6 in the order of descending priorities.
  • the applications shown in the cache management information are given group attributes. Accordingly, one between applications suitable for a minimum standard memory size and applications suitable for an operational environment with a larger memory size can be loaded into the application cache 6 of the playback apparatus according to the memory size of the playback apparatus. Therefore, it is possible to secure operations under the minimum standard environment, while providing people in charge of the authoring with an environment that highly motivates them.
  • Each entry may be given a language attribute for identifying a language group to which the corresponding application belongs.
  • the BD-J module 3 reads, into the application cache 6 , files indicated by the cache management information in the BD-J object corresponding to the current title, before the AV playback of the current title is started. Then, the BD-J module 3 performs control for placing an application in an appropriate language in the application cache 6 , among the applications having different language attributes.
  • the user event manager 9 judges whether or not the event is indicated as being valid in the Key Interest table. If judging affirmatively, the user event manager 9 outputs the key event to the application.
  • the operation corresponding to the event may be performed by the playback control engine 2 .
  • the user event manager 9 performs the playback control for the playback control engine 2 . Since the playback apparatus ensures comfortable operations even if the application includes a bug, the software houses as the application providers can develop differentiated playback control without hesitation even bugs are found.
  • the GUI screens mentioned in the embodiments above are preferably formed with use of OSD (On Screen Display) image data and a Look Up Table.
  • the OSD image data represents image using a bit having a prescribed length, and allocated to each pixel.
  • the bit length of the prescribed bit shows the number of colors used for rendering images. For example, if the length of the prescribed bit is 1 bit, the pixels of the OSD image data will be colored with two colors, and if the length of the prescribed bit is 2 bits, the pixels will be colored with four colors. If the length of the prescribed bit is 4 bits, the pixels will be colored with 16 colors.
  • the LUT includes a plurality of entries corresponding to pixel codes respectively.
  • Each entry includes a mixing rate ⁇ which shows the output ratio among brightness data to be allocated to a pixel of the OSD, red color difference data to be allocated to the pixel, blue color difference data to be allocated to the pixel, and the OSD.
  • ⁇ which shows the output ratio among brightness data to be allocated to a pixel of the OSD
  • red color difference data to be allocated to the pixel
  • blue color difference data to be allocated to the pixel
  • OSD the OSD.
  • each entry To display unique colors such as red, blue, green and yellow, each entry have values of the brightness data, the blue color difference data and the red color difference data, and the values are different from each other.
  • Interactive operation on the GUI screen structured from the above components is realized by the following markup information including a plurality of pieces of item information.
  • the markup information includes “focus destination information” which shows destination of the focus when keys of the remote control are pressed under condition that the corresponding selectable item is focused, and “pallet information” which shows the brightness and the color in the LUT used for displaying the corresponding selectable item that enters the normal state and the focused state, and “commands” that are to be executed by the playback apparatus when the selection of the item is confirmed.
  • the playback apparatus receives the pixel data and the OSD data for a plurality of lines and entries of the LUT, converts them to video signals by performing filtering according to the prescribed magnification rate and the mixing rate ⁇ , and outputs the signal to the monitor of the externally connected TV receiver or the like.
  • the playback apparatus realizes the movement of the focus among items by changing the LUT used for the display, according to the user's operation and the interactive control information.
  • the playback apparatus pertaining to the present invention is applicable to terminal apparatuses for playing AV streams that include applications programs for providing interactive services.
  • the playback apparatus facilitates operations of application programs that can be executed in parallel with playback of video, and removes the burden of the operations.

Landscapes

  • Business, Economics & Management (AREA)
  • Engineering & Computer Science (AREA)
  • Accounting & Taxation (AREA)
  • Finance (AREA)
  • Signal Processing (AREA)
  • General Business, Economics & Management (AREA)
  • Strategic Management (AREA)
  • Physics & Mathematics (AREA)
  • Marketing (AREA)
  • General Physics & Mathematics (AREA)
  • Economics (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Development Economics (AREA)
  • Signal Processing For Digital Recording And Reproducing (AREA)
  • Indexing, Searching, Synchronizing, And The Amount Of Synchronization Travel Of Record Carriers (AREA)
  • Television Signal Processing For Recording (AREA)
  • Signal Processing Not Specific To The Method Of Recording And Reproducing (AREA)
US12/376,353 2007-02-28 2008-01-11 Reproducing apparatus, reproducing method, and system LSI Expired - Fee Related US8155501B2 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JP2007049914 2007-02-28
JP2007-049914 2007-02-28
PCT/JP2008/050233 WO2008105188A1 (ja) 2007-02-28 2008-01-11 再生装置、再生方法、システムlsi

Publications (2)

Publication Number Publication Date
US20100034510A1 US20100034510A1 (en) 2010-02-11
US8155501B2 true US8155501B2 (en) 2012-04-10

Family

ID=39721029

Family Applications (1)

Application Number Title Priority Date Filing Date
US12/376,353 Expired - Fee Related US8155501B2 (en) 2007-02-28 2008-01-11 Reproducing apparatus, reproducing method, and system LSI

Country Status (5)

Country Link
US (1) US8155501B2 (zh)
EP (1) EP2051253A4 (zh)
JP (1) JP5065373B2 (zh)
CN (1) CN101542622A (zh)
WO (1) WO2008105188A1 (zh)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10719909B2 (en) 2016-09-30 2020-07-21 Alibaba Group Holding Limited Image loading method and device
US11361796B2 (en) * 2018-12-26 2022-06-14 Pioneer Corporation Display control device, operation detection device, display control method, and display control program
US11583298B2 (en) 2013-08-21 2023-02-21 Laboratoires Bodycad Inc. Bone resection guide and method

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010226278A (ja) * 2009-03-23 2010-10-07 Panasonic Corp 記録装置、方法、プログラム、及び媒体
KR20110025123A (ko) * 2009-09-02 2011-03-09 삼성전자주식회사 비디오 영상 배속 재생 방법 및 장치
US9336826B2 (en) * 2009-10-15 2016-05-10 Sony Corporation Method for facilitating online interactions initiated using optical disc players
US8909029B2 (en) * 2010-10-13 2014-12-09 Sony Corporation Capturing playback key events in BD players
US8990303B2 (en) 2013-01-31 2015-03-24 Paramount Pictures Corporation System and method for interactive remote movie watching, scheduling, and social connection
KR102460069B1 (ko) * 2015-09-30 2022-10-28 삼성전자주식회사 보안 인증 장치 및 보안 인증 방법
CN106911953A (zh) * 2016-06-02 2017-06-30 阿里巴巴集团控股有限公司 一种视频播放控制方法、装置及视频播放系统
US11778275B2 (en) * 2019-03-26 2023-10-03 Saturn Licensing Llc Information processing terminal, information processing method, and program

Citations (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6282365B1 (en) * 1996-09-30 2001-08-28 Matsushita Electric Industrial Co., Ltd. Recording/reproducing method suitable for recording/reproducing AV data on/from disc, recorder and reproducer for the method, information recording disc and information processing system
JP2002101088A (ja) 2000-09-22 2002-04-05 Toshiba Corp 有料放送受信システム及びその方法
JP2002223408A (ja) 2001-01-29 2002-08-09 Maspro Denkoh Corp 再生装置
JP2003134472A (ja) 2001-10-24 2003-05-09 Matsushita Electric Ind Co Ltd 映像処理装置
US20030194210A1 (en) * 2002-04-16 2003-10-16 Canon Kabushiki Kaisha Moving image playback apparatus, moving image playback method, and computer program thereof
WO2005029836A2 (en) 2003-09-12 2005-03-31 Opentv, Inc. Method and system for controlling recording and playback of interactive applications
US20050265167A1 (en) * 2004-05-31 2005-12-01 Orion Electric Co., Ltd. Reproducing device or recording/reproducing device or video display device incorporating reproducing device or recording/reproducing device
JP2006060752A (ja) 2004-08-24 2006-03-02 Fujitsu Ten Ltd 再生装置
US20060059426A1 (en) * 2004-09-15 2006-03-16 Sony Corporation Image processing apparatus, method, and program, and program storage medium
JP2006135535A (ja) 2004-11-04 2006-05-25 Funai Electric Co Ltd 再生装置
US20060120698A1 (en) 2004-11-04 2006-06-08 Funai Electric Co., Ltd. Recorder, reproducing device and editor
WO2006129815A1 (en) 2005-05-31 2006-12-07 Matsushita Electric Industrial Co., Ltd. Recording and reproduction apparatus and recording and reproduction method
JP2007018623A (ja) 2005-07-08 2007-01-25 Matsushita Electric Ind Co Ltd 情報記録媒体、およびその再生装置、再生方法。
US20070186229A1 (en) * 2004-07-02 2007-08-09 Conklin Charles C Methods and apparatus for identifying viewing information associated with a digital media device
US20090016705A1 (en) * 2003-07-11 2009-01-15 Mccrossan Joseph Recording medium, recording method, reproduction apparatus and method, and computer-readable program

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000332709A (ja) * 1999-05-18 2000-11-30 Sony Corp マルチメディア情報再生装置、及びマルチメディア情報再生方法
JP2001245024A (ja) * 2000-02-29 2001-09-07 Toshiba Corp 携帯情報機器及びその制御方法
JP2007110388A (ja) * 2005-10-13 2007-04-26 Funai Electric Co Ltd 連係動作プログラム及び接続機器
JP2007322754A (ja) * 2006-06-01 2007-12-13 Kawai Musical Instr Mfg Co Ltd キー入力練習装置及びキー入力練習用コンピュータプログラム

Patent Citations (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6282365B1 (en) * 1996-09-30 2001-08-28 Matsushita Electric Industrial Co., Ltd. Recording/reproducing method suitable for recording/reproducing AV data on/from disc, recorder and reproducer for the method, information recording disc and information processing system
JP2002101088A (ja) 2000-09-22 2002-04-05 Toshiba Corp 有料放送受信システム及びその方法
JP2002223408A (ja) 2001-01-29 2002-08-09 Maspro Denkoh Corp 再生装置
JP2003134472A (ja) 2001-10-24 2003-05-09 Matsushita Electric Ind Co Ltd 映像処理装置
US20030194210A1 (en) * 2002-04-16 2003-10-16 Canon Kabushiki Kaisha Moving image playback apparatus, moving image playback method, and computer program thereof
US20070230899A1 (en) 2002-04-16 2007-10-04 Canon Kabushiki Kaisha Moving image playback apparatus, moving image playback method, and computer program thereof
US20090016705A1 (en) * 2003-07-11 2009-01-15 Mccrossan Joseph Recording medium, recording method, reproduction apparatus and method, and computer-readable program
WO2005029836A2 (en) 2003-09-12 2005-03-31 Opentv, Inc. Method and system for controlling recording and playback of interactive applications
US20050265167A1 (en) * 2004-05-31 2005-12-01 Orion Electric Co., Ltd. Reproducing device or recording/reproducing device or video display device incorporating reproducing device or recording/reproducing device
US20070186229A1 (en) * 2004-07-02 2007-08-09 Conklin Charles C Methods and apparatus for identifying viewing information associated with a digital media device
JP2006060752A (ja) 2004-08-24 2006-03-02 Fujitsu Ten Ltd 再生装置
US20060059426A1 (en) * 2004-09-15 2006-03-16 Sony Corporation Image processing apparatus, method, and program, and program storage medium
US20060120698A1 (en) 2004-11-04 2006-06-08 Funai Electric Co., Ltd. Recorder, reproducing device and editor
JP2006135535A (ja) 2004-11-04 2006-05-25 Funai Electric Co Ltd 再生装置
WO2006129815A1 (en) 2005-05-31 2006-12-07 Matsushita Electric Industrial Co., Ltd. Recording and reproduction apparatus and recording and reproduction method
JP2007018623A (ja) 2005-07-08 2007-01-25 Matsushita Electric Ind Co Ltd 情報記録媒体、およびその再生装置、再生方法。

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
Blu-ray Disc Application Definition Blu-ray Disc Format BDJ Baseline Application and Logical Model Definition for BD-ROM, Blu-ray Disc Association, Mar. 2005, pp. 15, 34, 35, 39-45.
International Search Report issued Feb. 12, 2008 in the International (PCT) Application of which the present application is the U.S. National Stage.
Supplementary European Search Report issued Dec. 1, 2010 in corresponding European application No. EP 08 70 3097.

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11583298B2 (en) 2013-08-21 2023-02-21 Laboratoires Bodycad Inc. Bone resection guide and method
US10719909B2 (en) 2016-09-30 2020-07-21 Alibaba Group Holding Limited Image loading method and device
US11361796B2 (en) * 2018-12-26 2022-06-14 Pioneer Corporation Display control device, operation detection device, display control method, and display control program

Also Published As

Publication number Publication date
JPWO2008105188A1 (ja) 2010-06-03
US20100034510A1 (en) 2010-02-11
EP2051253A1 (en) 2009-04-22
WO2008105188A1 (ja) 2008-09-04
EP2051253A4 (en) 2010-12-29
JP5065373B2 (ja) 2012-10-31
CN101542622A (zh) 2009-09-23

Similar Documents

Publication Publication Date Title
US8155501B2 (en) Reproducing apparatus, reproducing method, and system LSI
CN100474915C (zh) 记录介质、再现装置、记录方法、程序以及再现方法
CN101131851B (zh) 记录介质、再现装置、记录方法、程序和再现方法
US20090228520A1 (en) Recording medium, recording device, and playback device for use in individual sales and method therefor
JP2004079055A (ja) 光ディスク装置と光ディスク処理方法及び光ディスク
WO2010106745A1 (ja) アプリケーション実行装置
KR101237160B1 (ko) 재생 장치 및 기록 매체
KR20070047825A (ko) 영상데이터와 애플리케이션을 연동시켜서 재생하는재생장치, 재생방법 및 프로그램
MXPA05010367A (es) Medio de grabacion, dispositivo de reproduccion, programa, metodo de reproduccion y circuito integrado de sistema.
JP2007049247A (ja) 映像再生示装置
CN101371307A (zh) 使用信息存储介质的信息再现系统
US8649653B2 (en) Reproduction device, reproduction method, and program
JP5032408B2 (ja) 簡易レジューム再生装置及び簡易レジューム再生方法
EP1654671B2 (en) Information storage medium containing interactive graphic stream, and reproducing apparatus and method thereof
KR20070005570A (ko) 그래픽 정보를 관리하기 위한 데이터 구조를 갖는 기록매체와 기록 및 재생 방법
JP2006073187A (ja) 光ディスク装置及び光ディスク処理方法
JP4855372B2 (ja) 再生装置、データ再生方法、制御プログラムおよび記録媒体
WO2007060913A1 (ja) 再生装置及びプログラム
JP2009015904A (ja) 光ディスク再生装置及び光ディスク再生方法
JP2001346148A (ja) 動画再生制御方法および画像再生装置
US20090022482A1 (en) Optical disc reproducing apparatus
JP5393847B2 (ja) 簡易レジューム再生装置、及びプログラム
JP2003297064A (ja) ディスク再生装置およびディスク再生装置の制御方法

Legal Events

Date Code Title Description
AS Assignment

Owner name: PANASONIC CORPORATION,JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:ODA, TOMOMI;SUZUKI, TAISAKU;MATSUURA, YASUYUKI;REEL/FRAME:022462/0135

Effective date: 20090127

Owner name: PANASONIC CORPORATION, JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:ODA, TOMOMI;SUZUKI, TAISAKU;MATSUURA, YASUYUKI;REEL/FRAME:022462/0135

Effective date: 20090127

FEPP Fee payment procedure

Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

STCF Information on status: patent grant

Free format text: PATENTED CASE

FPAY Fee payment

Year of fee payment: 4

FEPP Fee payment procedure

Free format text: MAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

LAPS Lapse for failure to pay maintenance fees

Free format text: PATENT EXPIRED FOR FAILURE TO PAY MAINTENANCE FEES (ORIGINAL EVENT CODE: EXP.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

STCH Information on status: patent discontinuation

Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362

FP Lapsed due to failure to pay maintenance fee

Effective date: 20200410