JP4600756B2 - Playback apparatus and method - Google Patents

Description

  The present invention relates to a playback device and method, content data, and a recording medium, and in particular, when playing back video data composed of a plurality of tracks, the playback device capable of playing back with the number of tracks corresponding to its own playback processing capability, and The present invention relates to a method, content data, and a recording medium.

  In the production of video content, special effects are used to provide multiple information, to change the screen transition, and to protect the privacy on the screen. This special effect editing involves recording the video data after applying the special effect on the recording medium and recording the special effect processing procedure while recording the original image data as it is. There is a method for reproducing a special effect by processing original image data according to a special effect processing procedure. The latter is particularly called non-destructive editing, and can be edited using application software such as QuickTime (quick time, hereinafter abbreviated as “QT”).

  In nondestructive editing using QT, not only special effects on images but also superimposition of characters and graphics can be described in the QT file format. In other words, special effects / characters / graphics distinction, start time, end time, video ID to which special effects, etc. are added are recorded in the QT file format on the recording medium, and at the time of playback specified at the specified time By displaying a specified type of special effect on the displayed image and then displaying it on the display device, it is possible to reproduce a video with the same special effect as the editor added in editing.

  By the way, in such non-destructive editing, a large number of special effects and characters may be superimposed on the original image data. In such a case, since there are many special effects that should be superimposed on the original image at the same time, the limit of the playback processing capability in the unit time of the playback device may be exceeded. Nevertheless, since the playback device tries to play back all the special effects and the like applied to the original image, there is a problem that the playback video is jerky or frames are dropped.

  Therefore, in the present invention, video data can be appropriately reproduced within the range of the reproduction processing capability by selectively narrowing down special effects and the like to be simultaneously superimposed on the original image within the range of the reproduction processing capability according to the priority order. It is an object to provide a playback apparatus and method, content data, and a recording medium.

The playback apparatus of the present invention manages the plurality of real data stored in the first area in association with the first area for storing the plurality of real data that can be decoded by the decoding means on the time axis. A second area for storing management data provided corresponding to each of the actual data, and the management data stored in the second area includes content data including identifiers of a plurality of actual data. A playback device for playback, wherein input means for inputting content data including a plurality of actual data having video data, audio data, and a plurality of types of graphic data, and first content data input by the input means Refer to the identifier included in the second area of the content data for each of the multiple actual data included in the area, and select multiple types of graphic data Analysis means for analyzing, storage means for storing information indicating the priority order to be decoded corresponding to each of a plurality of types of graphic data, and a plurality of actual data included in the first area of content data, Information indicating video data and audio data, and decoding means for decoding data determined as a decoding target from a plurality of types of graphic data, types analyzed by the analyzing means, and priority stored in the storage means And determination means for determining which of a plurality of types of graphic data to be included in the decoding target of the decoding means based on a threshold value for determining whether or not the priority is to be decoded. It is characterized by that.
The information indicating the priority order defines the priority order of each of a plurality of types of graphic data in accordance with the types of graphic data to be processed simultaneously.
The discriminating means is set in accordance with the type analyzed by the analyzing means , the information indicating the priority stored in the storage means, and the playback capability of the playback device to determine whether or not the priority should be a decoding target. The graphic data to be decoded is determined based on the threshold value .

The reproduction method of the present invention manages the plurality of real data stored in the first area in association with the first area for storing the plurality of real data that can be decoded by the decoding means on the time axis. A second area for storing management data provided corresponding to each of the actual data, and the management data stored in the second area includes content data including identifiers of a plurality of actual data. A reproduction method for reproduction, wherein an input step is input in which content data including a plurality of actual data having video data, audio data, and a plurality of types of graphic data is input, and a first of the content data input by the processing of the input step Each of the plurality of actual data included in one area is referred to the identifier included in the second area of the content data, and a plurality of types of graphics are An analysis step for analyzing the type of data, a storage step for storing information on whether or not to decode the actual data indicating the priority order to be decoded corresponding to each of a plurality of types of graphic data, and a first step of content data Among the plurality of actual data included in one area, the video data and the audio data, and the decoding step for decoding the data determined as the decoding target from the plural types of graphic data, and the analysis step are analyzed. One of a plurality of types of graphic data is decoded based on the type, the information indicating the priority stored in the storing step , and a threshold value for determining whether or not the priority should be a decoding target. And a determining step for determining whether to include the data as a decoding target.

In the playback apparatus and method of the present invention, the first area for storing a plurality of actual data that can be decoded by the decoding means and the plurality of actual data stored in the first area are managed in association on the time axis. Therefore, there is a second area for storing management data provided corresponding to each of the plurality of actual data, and the management data stored in the second area includes identifiers of the plurality of actual data. The contained content data is reproduced. Specifically, content data including a plurality of actual data having video data, audio data, and a plurality of types of graphic data is input, and each of the plurality of actual data included in the first area of the input content data is It refers to the identifier included in the second region of the content data is analyzed the type of multiple types of graphic data, by species analyzed, decoded and all the information indicating the priority, and priority Which of the plurality of types of graphic data is included in the decoding target is determined based on a threshold value for determining whether or not to be decoded.

The second playback device of the present invention manages the first area for storing a plurality of actual data that can be decoded by the decoding means and the plurality of actual data stored in the first area in association with each other on the time axis. Therefore, the management data stored in the second area includes identifiers of the plurality of actual data. The second area stores management data provided corresponding to each of the plurality of actual data. A playback device for playing back content data, wherein input means for inputting content data including a plurality of actual data having video data, audio data, and a plurality of types of text data, and content data input by the input means Each of the plurality of actual data included in the first area is referred to the identifier included in the second area of the content data, and the types of the plurality of types of text data are determined. Analysis means for analyzing, storage means for storing information indicating a priority order to be decoded corresponding to each of a plurality of types of text data, and a plurality of actual data included in the first area of the content data, Information indicating video data and audio data, and decoding means for decoding data determined as a decoding target from a plurality of types of text data, types analyzed by the analysis means, and priority stored in the storage means And a discriminating unit that determines which of a plurality of types of text data is to be included in the decoding unit of the decoding unit based on a threshold value for determining whether to be a decoding target with respect to priority. It is characterized by that.
The discriminating means is set in accordance with the type analyzed by the analyzing means , the information indicating the priority stored in the storage means, and the playback capability of the playback device to determine whether or not the priority should be a decoding target. Based on the threshold value, text data to be decoded is determined.

The second reproduction method of the present invention manages the first area for storing a plurality of actual data that can be decoded by the decoding means and the plurality of actual data stored in the first area in association with each other on the time axis. Therefore, the management data stored in the second area includes identifiers of the plurality of actual data. The second area stores management data provided corresponding to each of the plurality of actual data. A reproduction method for reproducing content data, in which content data including video data, audio data, and a plurality of types of actual data including a plurality of types of text data is input, and the content input by the processing of the input step Each of the plurality of actual data included in the first area of the data is referred to the identifier included in the second area of the content data. An analysis step for analyzing the type of data, a storage step for storing information on whether or not to decode the actual data indicating the priority order to be decoded corresponding to each of a plurality of types of text data, Of the plurality of actual data included in the first area, the decoding step for decoding the video data and the audio data, and the data determined as the decoding target from the plurality of types of text data, and the analysis step process Which of the plurality of types of text data is based on the analyzed type , information indicating the priority stored in the storage step , and a threshold value for determining whether or not to be a decoding target for the priority , And a determination step for determining whether or not to include the decoding target.

In the second reproducing apparatus and method of the present invention, the first area storing a plurality of actual data that can be decoded by the decoding means and the plurality of actual data stored in the first area are associated on the time axis. There is a second area for storing management data provided corresponding to each of the plurality of actual data, and the management data stored in the second area includes a plurality of actual data. Content data including the identifier is reproduced. Specifically, content data including a plurality of actual data having video data, audio data, and a plurality of types of text data is input, and each of the plurality of actual data included in the first region of the input content data is It refers to the identifier included in the second region of the content data is analyzed the type of a plurality of kinds of text data, by species analyzed, decoded and all the information indicating the priority, and priority It is determined which of the plurality of types of text data is included in the decoding target based on a threshold value for determining whether or not to be decoded.

  As described above, according to the present invention, since the track in the video data is reproduced within the range of the reproduction capability, the video can be reproduced with smooth motion and no frame dropping.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. In addition, about the same structure in each figure, the same code | symbol is attached | subjected and the description is abbreviate | omitted.

(First embodiment)

  The first embodiment is an embodiment of a playback device that plays back video by selecting graphics to be played back simultaneously with the original image according to the playback processing capability of the playback device when various graphics are applied to the original image. is there.

  FIG. 1 is a block diagram showing a configuration of a playback apparatus according to the first embodiment.

  In FIG. 1, the playback apparatus 10 according to the first embodiment includes an input data interface 11, an input data analysis unit 12, a priority table storage unit 13, a priority determination unit 14, an image decoding unit 15, a graphics decoding unit 16, An audio decoding unit 17, an image processing unit 18, an image output unit 19, and an audio output unit 20 are provided.

  The input data interface 11 is an interface for connecting an external device and the playback apparatus 10 and receives video data from the outside. The input video data is output to the input data analysis unit 12. The external device is, for example, a drive device that reads video data recorded from a disk-shaped recording medium, a CD drive device that reads video data from a CD-ROM, a DVD drive device that reads video data from a DVD, and a hard disk drive device Etc.

  The input data analysis unit 12 determines the content of the input video data, that is, video data, audio data, graphic data (title), graphic data (frame), graphic data (shade), etc. At the same time, the discrimination result is output to the priority discrimination unit 14.

  The priority determination unit 14 refers to the priority table stored in the priority table storage unit 13 based on the determination result, thereby determining the reproduction priority of the input video data according to a preset threshold value. decide. The priority determination unit 14 discards the video data according to the determined reproduction priority order, or outputs the video data to the image decoding unit 15 or the graphic decoding unit 16. The playback priority is determined by selecting the track to be played when any two tracks are selected from a plurality of tracks and both tracks cannot be played simultaneously and only one of them can be played. It is superior or inferior.

  Here, the threshold value is determined in advance by the designer or manufacturer of the playback device based on the hardware playback processing capability of the playback device 10 and set in the priority determination unit 14. The threshold value may be stored in the priority table storage unit 13 in advance, and may be read by the priority determination unit 14 as necessary.

  The priority table storage unit 13 is an erasable read-only memory such as an EEPROM (electrically erasable programmable read-only memory), and stores a priority table described later.

  The image decoding unit 15 decodes the input video data (video data) and outputs the decoded video data to the image processing unit 18.

  The graphics decoding unit 16 decodes the input video data (graphic data) and outputs the decoded video data to the image processing unit 18.

  The image processing unit 18 performs predetermined graphic processing on the original image based on the input video data and graphic data, and then outputs video data to the image output unit 19.

  The image output unit 19 outputs the video data after processing the video data in accordance with an external display device.

  On the other hand, the audio decoding unit 17 decodes the input audio data (audio data) and outputs the decoded audio data to the audio output unit 20.

  The audio output unit 20 outputs the audio data after performing signal processing on the audio data in accordance with an external audio reproduction device.

  Next, the operation of the playback apparatus in the first embodiment will be described.

  FIG. 2 is a diagram illustrating an example of input data according to the first embodiment.

  FIG. 3 is a flowchart showing the operation of the playback apparatus in the first embodiment.

  FIG. 4 is a diagram illustrating a priority table according to the first embodiment. FIG. 4A is a first example of the priority table, and FIG. 4B is a second example of the priority table.

  First, input data is input to the input data analysis unit 12 via the input data interface 11. The input data is video data including video data, audio data, and a plurality of types of graphic data. Each data includes an identifier indicating the type of track, and indicates the distinction of the data content by the type of track. Yes. Multiple types of graphic data include, for example, a title that indicates the title of the video, a frame that borders the screen, a shade that hides part of the screen with a shadow to protect privacy, etc. A mark such as an arrow to mark a certain part of the mark (Mark), an accent to accentuate a certain part of the screen (Accent), and display for emphasis of subtitles and dialogue Notices such as speech balloons.

  Such input data is configured in a QT format, for example. QT is software that manages various types of data along a time axis, and is an OS extension function for synchronously playing back moving images, sounds, texts, and the like without using special hardware. In the QT file, a basic data unit is called an atom, and the QT is composed of a resource atom and a data atom. The resource atom is a part for storing information necessary for reproducing the file and information necessary for referring to actual data. The data atom is a part that stores actual data such as video and audio. Each atom contains size and type information along with its data. In QT, the minimum unit of data is handled as a sample, and a chunk is defined as a set of samples. QT is disclosed in, for example, “INSIDE MACINTOSH: QuickTime (Japanese version) (Addison Wesles)”.

  For example, the input data is composed of a resource atom 101 and a data atom 102 as shown in FIG. The data atom 102 includes video data 121, audio data 122, graphic data (title) 123 as graphic data of a title, graphic data (frame) 124 as graphic data of a frame, graphic data (shade of graphic data of a shade). ) 125, graphic data (mark) 126 which is graphic data of a mark, graphic data (accent) 127 which is graphic data of accent, and actual data of graphic data (notice) 128 which is graphic data of Notice Composed. In order to manage these real data in association with each other on the time axis, the resource atom 101 includes a track atom (video) 111, a track atom (audio) 112, a track atom (title) 113, a track atom, An atom (frame) 114, a track atom (shade) 115, a track atom (mark) 116, a track atom (accent) 117, and a track atom (notice) 118 are configured. The identifier for determining the track type of the actual data is described in an atom (track property atom) that describes the attribute of the track provided in the user data atom in the track atom corresponding to the actual data. The The user data atom is an atom prepared by QT as an atom describing user-defined data.

  The input data analysis unit 12 refers to the identifier described in the track property atom, determines the type of the track of the actual data, and outputs the determination result to the priority determination unit 14.

  In FIG. 3, when the determination result and the actual data are input, the priority determination unit 14 acquires the priority by accessing the priority table storage unit 13 (S11).

  Priorities are assigned by serial numbers to all graphics types to be applied to the original image. For example, as shown in FIG. 4A, the priority of the title is 1, the priority of the frame is 5, the priority of the shade is 2, the priority of the mark is 6, the priority of the accent is 4, and The priority of Notice is 3. The lower the numerical value, the higher the priority order, and the higher the numerical value, the lower the priority order. Here, although not shown, the priority order of the video data 121 and the audio data 122 is set to 1, which is the highest.

  Next, the priority determination unit 14 determines what type of actual data is input from the determination result. The priority determination unit 14 identifies the priority of the actual data by referring to the acquired priority, and compares the priority of the actual data with the threshold (S12).

  As a result of the comparison, when the priority of the actual data is higher than the threshold, the priority determination unit 14 determines that the actual data is the image decoding unit 15, the graphic decoding unit 16, or the real data according to the type of the actual data. The data is output to the voice decoding unit 17. On the other hand, as a result of the comparison, when the priority of the actual data is lower than the threshold, the priority determination unit 14 discards the actual data (S13).

  For example, when the threshold is set to 3 due to the simultaneous playback capability of the playback device 10, the video data 121, the audio data 122, the graphic data (title) 123, and the graphic data (shade) 125 are stored in the image decoding unit 15 and the audio, respectively. The data is output to the decoding unit 17 or the graphics decoding unit 16. Then, the image processing unit 18 performs a process of superimposing and displaying the graphic data (title) 123 and the graphic data (shade) 125 on the decoded video data 121, and outputs the result to the image output unit 19.

  Further, for example, when the threshold is set to 5 due to the simultaneous playback capability of the playback device 10, the video data 121, the audio data 122, the graphic data (title) 123, the graphic data (shade) 125, and the graphic data (notice) 128. And graphic data (accent) 127 are output to the image decoding unit 15, the audio decoding unit 17, or the graphics decoding unit 16, respectively. Then, the image processing unit 18 performs a process of superimposing and displaying the decoded graphic data (title) 123, graphic data (shade) 125, graphic data (accent) 127, and graphic data (notice) 128 on the decoded video data 121. And output to the image output unit 19.

  As described above, in the first embodiment, the actual data is reproduced within the range of the processing capability of the reproducing apparatus 10 according to the priority order, so that the video data can be reproduced with smooth movement and no frame dropping. Furthermore, since the actual data is reproduced within the range of the processing capability of the playback device 10 in accordance with the priority order, it is not necessary to create video data in accordance with the processing capability of the playback device 10, and is common to playback devices having different processing capabilities. Video data can be used. Also, by changing the priority assigned to each graphics type, it is possible to reproduce a video in which different graphics are superimposed even with the same processing capability.

  Here, in the first priority table shown in FIG. 4A, the priority order of each graphics data is fixed regardless of the number of graphics applied simultaneously. Therefore, when the actual data to be reproduced at the same time is the video data 121, the audio data 122, and the graphics data (frame) 124, if the threshold is 3, even if the processing capacity of the reproducing apparatus 10 has a margin, Since the priority of the graphics data (frame) 124 is 5, the graphics data (frame) 124 is not output to the graphics decoding unit 16 and only the video data 121 and the audio data 122 are reproduced. Therefore, it is preferable to use the second priority table shown in FIG. 4B instead of the first priority table.

  In FIG. 4B, the second priority table defines the priority order of each graphic in accordance with the graphics track to be processed simultaneously.

  In the second priority table, as shown in the first row, when the graphics track to be processed simultaneously is a frame, a shade, a mark, an accent, and a notice, the priority of the frame is 1, The priority is 5, the mark priority is 2, the accent priority is 3, and the notice priority is 4. As shown in the second row, when the graphics tracks to be processed simultaneously are a title, a frame, and a shade, the title priority is 1, the frame priority is 2, and the shade priority is 2. It is said. The same applies to the following lines. Then, as shown in the last line, when the graphics track to be processed simultaneously is a mark, an accent, and a notice, the mark priority is 1, the accent priority is 2, and the notice priority is 3.

  In the playback apparatus 10 having such a second priority table, the input video data tracks are video data 121, audio data 122, graphics data (frame) 124, graphics data (shade) 125, and graphics. In the case where the image data (mark) 126, the graphics data (accent) 127, and the graphics data (notice) 128 are configured, the priority determination unit 14 prioritizes the first row in the second priority table. Applying the degree, S12 and S13 of FIG. 3 are executed. Therefore, video data to be processed simultaneously includes video data 121, audio data 122, graphics data (frame) 124, graphics data (shade) 125, graphics data (mark) 126, graphics data (accent) 127, and graphics. If the threshold is 3, the graphics data (shade) 125, the graphics (accent) 127, and the graphics (notice) 128 are not reproduced.

  If the input video data track is composed of video data 121, audio data 122, graphics data (title) 123, graphics data (frame) 124, and graphics data (shade) 125, The priority determination unit 14 executes S12 and S13 of FIG. 3 by applying the priority of the second row in the second priority table. In this case, since the priority order of the frame and the shade is both 2, when these graphics data are input simultaneously, the priority determination unit 14 discards both data.

  Next, another embodiment will be described.

(Second Embodiment)

  In the first embodiment, only graphic data is composed of a plurality of tracks. However, in the second embodiment, not only graphics data but also audio data and text data are composed of a plurality of tracks. It is an embodiment.

  FIG. 5 is a block diagram showing the configuration of the playback apparatus in the second embodiment.

  In FIG. 5, the playback device 30 in the second embodiment includes an input data interface 11, an input data analysis unit 12, a priority determination unit 31, a priority table storage unit 33, an image decoding unit 15, a graphics decoding unit 16, A text decoding unit 32, an audio decoding unit 17, an image processing unit 18, an image output unit 19, and an audio output unit 20 are provided.

  The input data interface 11 is connected to the input data analysis unit 12, and the input data analysis unit 12 is connected to the priority determination unit 31. The priority determination unit 31 is connected to the priority table storage unit 33, the image decoding unit 15, the graphics decoding unit 16, the text decoding unit 32, and the audio decoding unit 17.

  The image decoding unit 15, the graphics decoding unit 16, and the text decoding unit 32 are connected to the image processing unit 18. The text decoding unit 32 decodes the input video data (text data) and outputs the decoded video data to the image processing unit 18.

  The image processing unit 18 is connected to the image output unit 19. The audio decoding unit 17 is connected to the audio output unit 20.

  Next, the operation of the playback apparatus in the second embodiment will be described.

  FIG. 6 is a diagram illustrating an example of input data according to the second embodiment.

  FIG. 7 is a diagram illustrating a priority table in the second embodiment.

  First, input data is input to the input data analysis unit 12 via the input data interface 11. The input data is video data including one or more of video data, audio data, graphic data, and text data, and each data includes an identifier indicating the type of track.

  For example, the input data is composed of a resource atom 151 and a data atom 152 as shown in FIG. The data atom 152 includes video-1 data 181, audio-1 data 182, audio-2 data 183, audio-3 data 184, graphic-1 data, graphic-2 data 186, text-1 data 187, text-2. Data 188, text-3 data 189, and text-4 data 190 are included in the actual data. In order to manage these actual data in association with each other on the time axis, the resource atom 151 includes a track atom (video-1) 161, a track atom (audio-1) 162, and a track atom (audio-). 2) 163, track atom (audio-3) 164, track atom (graphics-1) 165, track atom (graphics-2) 166, track atom (text-1) 167, track atom ( Text-2) 168, track atom (text-3) 169, and track atom (text-4) 170. The identifier for determining the data type of the actual data is described in the track property atom in the track atom corresponding to the actual data.

  The input data analysis unit 12 refers to the identifier described in the track property atom, determines the type of track of actual data, and outputs the determination result to the priority determination unit 31.

  When the determination result and the actual data are input, the priority determination unit 31 acquires the priority by accessing the priority table storage unit 33.

  A priority is assigned to each track by a serial number. For example, as shown in FIG. 7, the priority of video-1 is 1, the priority of audio-1 is 2, the priority of audio-2 is 5, the priority of audio-3 is 7, -1 has a priority of 6, graphics-2 has a priority of 8, text-1 has a priority of 3, text-2 has a priority of 4, text-3 has a priority of 9, The priority of text-4 is 10. The lower the numerical value, the higher the priority order, and the higher the numerical value, the lower the priority order.

  Next, the priority determination unit 31 determines which track the actual data input from the determination result is. The priority determination unit 31 identifies the priority order of the actual data by referring to the acquired priority order, and compares the priority order of the actual data with a threshold value.

  As a result of the comparison, when the priority of the actual data is higher than the threshold, the priority determination unit 31 converts the actual data into the image decoding unit 15, the graphic decoding unit 16, The data is output to the text decoding unit 32 or the voice decoding unit 17. On the other hand, as a result of the comparison, when the priority of the actual data is lower than the threshold, the priority determination unit 31 discards the actual data.

  For example, when the threshold value is set to 5 due to the simultaneous playback capability of the playback device 30, the video-1 data 181, the audio-1 data 182, the text-1 data 187, and the text-2 data 188 are respectively stored in the image decoding unit 15. And output to the voice decoding unit 17 or the text decoding unit 32. Then, the image processing unit 18 performs processing to display the decoded text-1 data 187 and text-2 data 188 on the decoded video-1 data 181 and outputs it to the image output unit 19.

  Also, for example, when the threshold is set to 7 due to the simultaneous playback capability of the playback device 30, video-1 data 181, audio-1 data 182, audio-2 data 183, graphics-1 data 185, text-1 Data 187 and text-2 data 188 are output to the image decoding unit 15, the audio decoding unit 17, the graphics decoding unit 16, or the text decoding unit 32, respectively. Then, the image processing unit 18 performs a process of displaying the graphic-1 data 185, the text-1 data 187, and the text-2 data 188 on the decoded video-1 data 181 and outputting them to the image output unit 19. To do.

  As described above, in the second embodiment, since the actual data is reproduced within the range of the processing capability of the reproducing device 30 in accordance with the priority order, the video data can be reproduced with smooth movement and no frame dropping. Furthermore, since the actual data is reproduced within the range of the processing capability of the playback device 30 in accordance with the priority order, it is not necessary to create video data according to the processing capability of the playback device 30, and it is common to playback devices having different processing capabilities. Video data can be used. By making the priorities different, it is possible to reproduce a video in which different graphics are superimposed even with the same processing capability.

  In addition, by having a plurality of audio data, it is possible to cope with monaural reproduction and stereo reproduction. Furthermore, subtitles can be displayed in a plurality of languages by having a plurality of text data.

  Next, another embodiment will be described.

(Third embodiment)

  In the second embodiment using the second priority table, the priority determination unit 31 selects a threshold according to the type of data, compares the track priority with the threshold, and determines the data according to the result. In the third embodiment, a determination unit is provided for each data type, and the priority of input data is determined for each data type. It is a form.

  FIG. 8 is a block diagram illustrating a configuration of a playback apparatus according to the third embodiment.

  In FIG. 8, the playback apparatus 40 in the third embodiment includes an input data interface 11, an input data analysis unit 41, a priority table storage unit 35, an image data storage unit 42, a graphics data storage unit 44, and a text data storage unit. 46, audio data storage unit 48, image data selection unit 43, graphics data selection unit 45, text data selection unit 47, audio data selection unit 49, image decoding unit 15, graphics decoding unit 16, text decoding unit 32, audio A decoding unit 17, an image processing unit 18, an image output unit 19, and an audio output unit 20 are provided.

  The input data interface 11 is connected to the input data analysis unit 41.

  The input data analysis unit 41 is connected to the image data storage unit 42, the graphics data storage unit 44, the text data storage unit 46, and the audio data storage unit 48, and outputs the input data to each of these storage units according to the data type of the input data. To do.

  The image data storage unit 42 is a memory that stores video data among the input data, and is connected to the image data selection unit 42. The graphics data storage unit 44 is a memory that stores graphics data among the input data, and is connected to the graphics data selection unit 44. The text data storage unit 46 is a memory that stores text data among input data, and is connected to the text data selection unit 46. The audio data storage unit 48 is a memory that stores audio data among the input data, and is connected to the audio data selection unit 48.

  The image data selection unit 42 is connected to the priority table storage unit 35 and the image decoding unit 15. Based on the determination result, the image data selection unit 42 refers to the priority table stored in the priority table storage unit 35 to determine the reproduction priority order of the input video data according to a preset threshold value. To do. The image data selection unit 42 discards the image data or outputs the image data to the image decoding unit 15 according to the determined reproduction priority order.

  The graphics data selection unit 44 is connected to the priority table storage unit 35 and the graphics decoding unit 16. The graphics data selection unit 44 refers to the priority table stored in the priority table storage unit 35 based on the determination result, and sets the reproduction priority order of the input video data according to a preset threshold value. decide. The graphics data selection unit 44 discards the graphics data or outputs the graphics data to the graphics decoding unit 16 according to the determined reproduction priority order.

  The text data selection unit 46 is connected to the priority table storage unit 35 and the text decoding unit 32. The text data selection unit 46 refers to the priority table stored in the priority table storage unit 35 based on the determination result, and sets the reproduction priority order of the input text data according to a preset threshold value. decide. The text data selection unit 46 discards the text data or outputs it to the text decoding unit 16 according to the determined reproduction priority order.

  The audio data selection unit 48 is connected to the priority table storage unit 35 and the audio decoding unit 17. Based on the determination result, the audio data selection unit 48 refers to the priority table stored in the priority table storage unit 35 to determine the reproduction priority order of the input audio data according to a preset threshold value. To do. The audio data selection unit 48 discards the audio data or outputs the audio data to the audio data decoding unit 17 according to the determined reproduction priority order.

  The image decoding unit 15, the graphics decoding unit 16, and the text decoding unit 32 are connected to the image processing unit 18. The image processing unit 18 is connected to the image output unit 19. The audio decoding unit 17 is connected to the audio output unit 20.

  Further, in the priority table storage unit 35, for example, as shown in FIG. 9, a threshold is stored for each data type and a priority is stored for each data.

  FIG. 9 is a diagram illustrating a priority table according to the third embodiment.

  In FIG. 9, the priority table in the third embodiment defines a threshold for each type of data and defines a priority for each track in each data.

  For example, in the priority table, the video threshold is 2, and the priority of video-1 is 1. The audio threshold is 3, audio-1 has a priority of 1, audio-2 has a priority of 4, audio data-3 has a priority of 3, and audio-4 has a priority of 2. Is done. The graphics threshold is 3, the priority of graphics-1 is 1, the priority of graphics-2 is 4, and the priority of graphics-3 is 2. The text threshold is set to 2, the priority of text-1 is 1, the priority of text-2 is 3, the priority of text-3 is 5, and the priority of text-4 is 6. The

  Next, the operation of the playback apparatus in the third embodiment will be described.

  FIG. 10 is a flowchart showing the operation of the text data selection unit in the third embodiment.

  First, input data is input to the input data analysis unit 41 via the input data interface 11.

  The input data analysis unit 41 determines the data type of the actual data with reference to the identifier described in the track property atom, and inputs the input data according to the determination result to the image data storage unit 42, the graphics data storage unit 44, and outputs the result together with the determination result to the text data storage unit 46 or the voice data storage unit 48.

  The image data selection unit 43, the graphics data selection unit 45, the text data selection unit 47, and the audio data selection unit 49 are similar in operation except for the type of data to be handled. These will be described below as representatives of these parts.

  In FIG. 10, when the determination result and the actual data are input from the text data storage unit 46, the text data selection unit 47 accesses the priority table storage unit 35 to thereby reproduce the number of reproducible text tracks (text (Threshold) is acquired (S31).

  Next, the text data selection unit 47 obtains a priority order corresponding to each text data stored in the text data storage unit 46 by accessing the priority table storage unit 35 (S32).

  The text data selection unit 47 compares the priority and the threshold in the actual data of the text by referring to the acquired threshold and priority (S33).

  As a result of the comparison, when the priority order of the actual data of the text is higher than the threshold, the text data selection unit 47 outputs the actual data of the text to the text decoding unit 32 (S34). On the other hand, as a result of the comparison, if the priority of the actual data of the text is lower than the threshold, the text data selection unit 47 discards the actual data of the text.

  As described above, in the third embodiment, since the number of tracks that can be reproduced is defined for each data type, each data can be appropriately reproduced within the range of the reproduction capability of the reproduction apparatus. In particular, since the amount of data to be processed per unit time differs depending on the type of data, the threshold value can be determined appropriately.

  Next, another embodiment will be described.

(Fourth embodiment)

  In the above-described embodiment, when there are no tracks of all data types, the playback processing capability of the playback device may not be used. Therefore, the fourth embodiment is an embodiment in which each data is reproduced according to the priority order so that unused reproduction processing capacity is kept as much as possible.

  FIG. 11 is a block diagram illustrating a configuration of a playback device according to the fourth embodiment.

  In FIG. 11, the playback device 50 according to the fourth embodiment includes an input data interface 11, an input data analysis unit 41, an image data storage unit 42, a graphics data storage unit 44, a text data storage unit 46, and an audio data storage unit 48. A data selection unit 51, a priority table storage unit 37, an image decoding unit 15, a graphics decoding unit 16, a text decoding unit 32, an audio data decoding unit 17, an image processing unit 18, an image output unit 19, and an audio output unit 20. It is prepared for.

  The input data interface 11 is connected to the input data analysis unit 41. The input data analysis unit 41 is connected to the image data storage unit 42, the graphics data storage unit 44, the text data storage unit 46, and the audio data storage unit 48.

  The image data storage unit 42, the graphics data storage unit 44, the text data storage unit 46, and the audio data storage unit 48 are connected to the data selection unit 51.

  As will be described later, the data selection unit 51 converts each real data into the image decoding unit 15, the graphics decoding unit 16, the text decoding unit 32, Output to any of the audio data decoding unit 17 or discard. The data selection unit 51 reads the priority table storage unit 37, the maximum reproduction processing capacity (MaxTrack), and the priority order of each actual data as necessary.

  Here, the priority table storage unit 37 stores a priority table in which priority is given to all tracks regardless of the type of track.

  FIG. 12 is a diagram illustrating a priority table according to the fourth embodiment.

  In FIG. 12, the priority table shows, for example, that the priority of video-1 is 1, the priority of video-2 is 9, the priority of audio-1 is 6, and the priority of audio-2 is 2. The priority of audio-3 is 11, the priority of audio-4 is 12, the priority of graphics-1 is 4, the priority of graphics-2 is 10, and the priority of graphics-3 , Graphics-4 has a priority of 15, Graphics-5 has a priority of 17, Text-1 has a priority of 3, Text-2 has a priority of 7, and Text-3 has a priority of 3. The priority is 8, the priority of text-4 is 13, the priority of text-5 is 14, and the priority of text-6 is 16. The lower the numerical value, the higher the priority order, and the higher the numerical value, the lower the priority order.

  The image decoding unit 15, the graphics decoding unit 16, and the text decoding unit 32 are connected to the image processing unit 18. The image processing unit 18 is connected to the image output unit 19. The audio decoding unit 17 is connected to the audio output unit 20.

  Next, the operation of the playback apparatus in the fourth embodiment will be described.

  FIG. 13 is a flowchart showing the operation of the data selection unit in the fourth embodiment.

  First, input data is input to the input data analysis unit 41 via the input data interface 11.

  The input data analysis unit 41 determines the data type of the actual data with reference to the identifier described in the track property atom, and inputs the input data according to the determination result to the image data storage unit 42, the graphics data storage unit 44, and outputs the result together with the determination result to the text data storage unit 46 or the voice data storage unit 48.

  In FIG. 13, the data selection unit 51 reads MaxTrack of the playback device 50 by accessing the priority table storage unit 37 (S41).

  Next, the data selection unit 51 identifies the video data track with the highest priority by accessing the priority table storage unit 37, and reads the video data from the image data storage unit 42 (S42).

  Next, since the data selection unit 51 has assigned a part of the playback capability to the video data, the data selection unit 51 subtracts that amount from MaxTrack (S43).

  Next, the data selection unit 51 identifies the audio data track with the highest priority by accessing the priority table storage unit 37, and reads the audio data from the audio data storage unit 48 (S44).

  Next, since the data selection unit 51 has assigned a part of the playback capability to the audio data, the data selection unit 51 subtracts that amount from MaxTrack (S45).

  As described above, since the reproduction capability is preferentially assigned to the reproduction of the video data and the audio data, it is possible to ensure the minimum reproduction of video.

  Next, the data selection unit 51 determines whether or not MaxTrack> 0, that is, whether or not the playback processing capability remains in the playback device 51 (S46).

  As a result of the determination, if MaxTrack> 0, there is a surplus in the playback processing capacity, so by accessing the priority table storage unit 37, the playback processing capacity is still allocated to the tracks stored in each storage unit. Among the tracks that have not been recorded, the track with the highest priority is selected (S47).

  Next, since the data selection unit 51 has assigned a part of the reproduction capability to the actual data, the data selection unit 51 subtracts that amount from MaxTrack (S48).

  On the other hand, if MaxTrack ≦ 0 is determined as a result of the determination, there is no room in the playback processing capability, and the selection of the track to be played back is terminated.

  As described above, in the fourth embodiment, the track having the highest priority among the tracks stored in the respective storage units to which the playback processing capability has not yet been allocated has the playback processing capability. Are selected sequentially, so that the reproduction processing capacity of the reproduction apparatus 50 can be utilized without leaving as much as possible.

  Next, another embodiment will be described.

(Fifth embodiment)

  In the fourth embodiment, from the viewpoint of enabling the data selection unit to easily determine the reproducible track, the playback processing capability of the playback device necessary for processing the data of each track Were considered equivalent, and the reproducible track was determined only by the number of tracks. On the other hand, the fifth embodiment is an embodiment in which a reproducible track is determined in consideration of the time required for the reproduction processing of each track. For this reason, compared with the fourth embodiment, the present embodiment can use the reproduction processing capability of the reproduction apparatus without waste.

  Here, in the playback device according to the fifth embodiment, the priority table storage unit 37 stores not only the nonvolatile storage circuit that stores the priority table, but also the readable / writable storage circuit that stores each data being processed (for example, 11 except that a random access memory (RAM) and a timer (not shown) connected to the data selection unit 51 are provided, and the data selection unit 51 performs processing according to FIG. 14 described later. Since it is the same, description of the structure is abbreviate | omitted.

  In the present embodiment, for all tracks, the unit time in the reproduction process (for example, in the case of QT, the product of a time scale and a sample duration) is the same. To do.

  Next, the operation of the playback apparatus in the fifth embodiment will be described.

  FIG. 14 is a flowchart showing the operation of the data selection unit in the fifth embodiment.

  First, input data is input to the input data analysis unit 41 via the input data interface 11.

  The input data analysis unit 41 determines the data type of the actual data with reference to the identifier described in the track property atom, and inputs the input data according to the determination result to the image data storage unit 42, the graphics data storage unit 44, and outputs the result together with the determination result to the text data storage unit 46 or the voice data storage unit 48.

  In FIG. 14, the data selection unit 51 initializes variables such as variables T1, T2, Tr, Tc, and Ts (S51).

  Next, the data selection unit 51 acquires the current time from the timer, and substitutes the current time for the variable T1 (S52).

  Next, the data selection unit 51 obtains the frame rate of the video data (image data) by calculating from the time to sample atom and the media handler atom (S53).

  Next, the data selection unit 51 calculates a processing time allocated for reproducing one frame, subtracts a correction time Tc necessary for processing such as track selection from the processing time, The subtraction result is substituted into the variable Tr (S54). The variable Tr is an effective time allocated for reproducing one frame.

  Here, the correction time Tc is stored in the priority table storage unit 37 as a predetermined initial value in advance, and then changed to a time actually required during use of the playback apparatus. The predetermined initial value includes, for example, a large number of tracks so that a track selection process is always performed, and more time is required for the process of identifying and selecting a track with a higher priority. By preparing multiple pieces of input data in which data is placed and actually inputting these data to the playback device, the time taken to identify and select a track with high priority is measured. The processing time when the most time is required.

  Next, the data selection unit 51 identifies the track of the video data with the highest priority by accessing the priority table storage unit 37, and reads the video data from the image data storage unit 42 (S55).

  Next, the data selection unit 51 calculates the consumption time necessary for reproducing the read video data, and substitutes the calculation result for the variable Ts (S56). Here, the time required for the reproduction process varies depending on the Codec type of the data. Therefore, for each Codec type, various data is input to the playback device, playback processing is performed, the processing time is measured, and statistical processing is performed, for example, an average value is determined from the obtained processing time data. To do. Note that the Codec type is a type of data encoding or decoding method, and is, for example, MPEG2 in the case of video.

  Next, the data selection unit 51 subtracts the variable Ts from the variable Tr and sets the subtraction result as a new value of the variable Tr (S57).

  Next, the data selection unit 51 adds the video data track read in S55 to the reproduction list (S58). The reproduction list is prepared as a track ID table in the priority table storage unit 37.

  Next, the data selection unit 51 identifies the audio data track with the highest priority by accessing the priority table storage unit 37, and reads the audio data from the audio data storage unit 48 (S59).

  Next, the data selection unit 51 calculates a consumption time necessary for reproducing the read audio data, and substitutes the calculation result for the variable Ts. The data selection unit 51 subtracts the variable Ts from the variable Tr and sets the subtraction result as a new value of the variable Tr. Then, the data selection unit 51 adds the audio data track read in S59 to the reproduction list (S60).

  As described above, since the reproduction capability is preferentially assigned to the reproduction of the video data and the audio data, it is possible to ensure the minimum reproduction of video.

  Next, the data selection unit 51 determines whether or not Tr> 0, that is, whether or not the playback processing capability remains in the playback device (S61).

  As a result of the determination, if Tr> 0, there is a surplus in the reproduction processing capacity. Therefore, by accessing the priority table storage unit 37, whether or not the reproduction process is appropriate for the tracks stored in each storage unit is determined. Among the tracks that have not been determined yet, the track with the highest priority is selected (S62).

  Next, the data selection unit 51 calculates a consumption time necessary for reproducing the selected data, and substitutes the calculation result for the variable Ts (S63).

  Next, the data selection unit 51 compares the magnitudes of the variable Tr and the variable Ts. If the variable Tr> the variable Ts, the data selection unit 51 reproduces the selected data within the remaining reproduction processing capacity. Therefore, the data selection unit 51 adds the track of the data selected in S62 to the reproduction list (S65).

  Next, the data selection unit 51 subtracts the variable Ts from the variable Tr, sets the subtraction result as the value of the new variable Tr, and returns the process to S61 (S66).

  On the other hand, if the variable Tr ≦ 0 in S61, no reproduction processing capability remains, and if the variable Tr ≦ variable Ts in S64, sufficient reproduction processing capability to reproduce the selected data. In these cases, the data selection unit 51 acquires the current time from the timer and substitutes the current time for the variable T2 (S67).

  Next, the data selection unit 51 subtracts the variable T1 from the variable T2, assigns the subtraction result to the correction time Tc, and changes the correction time Tc to the time actually required by the playback device (S68).

  Next, the data selection unit 51 outputs each data to be reproduced according to the reproduction list to the image decoding unit 15, the graphic decoding unit 16, the text decoding unit 32, or the audio data decoding unit 17 in accordance with the content of the data. Plays video.

  As described above, in the fifth embodiment, the track of the data with the highest priority among the tracks stored in the respective storage units and not yet assigned the reproduction processing capability is considered in the actual processing time. Since the playback processing capability is selected sequentially, the playback processing capability of the playback device can be utilized without further surplus as compared with the fourth embodiment.

  Next, another embodiment will be described.

(Sixth embodiment)

  In the fifth embodiment, when playback processing capability remains in the playback device, it is determined whether playback processing is possible within the range of playback processing capability in which this track remains in order from the track with the highest priority. However, if the playback process cannot be performed, the selection of the track has been completed without determining whether or not the playback process is possible within the range of the remaining playback processing capacity. In the embodiment, in this case, it is determined whether or not the reproduction process is possible within the range of the reproduction processing capacity in which other tracks remain. For this reason, compared with the fifth embodiment, the present embodiment can use the reproduction processing capability of the reproduction apparatus without waste.

  Here, in the playback device according to the sixth embodiment, the priority table storage unit 37 stores not only the nonvolatile memory circuit that stores the priority table, but also the readable / writable memory circuit that stores each data being processed (for example, 11 except that a random access memory (RAM) and a timer (not shown) connected to the data selection unit 51 are provided, and the data selection unit 51 performs processing according to FIG. 15 to be described later. Since it is the same, description of the structure is abbreviate | omitted.

  FIG. 15 is a flowchart showing the operation of the data selection unit in the sixth embodiment.

  In FIG. 15, the processing from S51 to S60 in which input data is input via the input data interface 11 and video data and audio data with the highest priority are selected by the data selection unit 51 in the reproduction list is shown in FIG. Since this is the same, the description thereof is omitted.

  The data selection unit 51 determines whether or not Tr> 0 (S61).

  As a result of the determination, if Tr> 0, the playback processing capacity is sufficient, and by accessing the priority table storage unit 37, whether or not the playback process is appropriate for the tracks stored in each storage unit is determined. Among the tracks that have not been determined yet, the track with the highest priority is selected (S62).

  Next, the data selection unit 51 calculates a consumption time necessary for reproducing the selected data, and substitutes the calculation result for the variable Ts (S63).

  Next, the data selection unit 51 compares the magnitudes of the variable Tr and the variable Ts. If the variable Tr> the variable Ts, the data selection unit 51 reproduces the selected data within the remaining reproduction processing capacity. Therefore, the data selection unit 51 adds the track of the data selected in S62 to the reproduction list (S65).

  Next, the data selection unit 51 subtracts the variable Ts from the variable Tr, sets the subtraction result as the value of the new variable Tr, and returns the process to S61 (S66).

  On the other hand, if the variable Tr ≦ 0 in S61, no reproduction processing capability remains, so the data selection unit 51 acquires the current time from the timer and substitutes the current time for the variable T2 (S67). .

  Next, the data selection unit 51 subtracts the variable T1 from the variable T2, assigns the subtraction result to the correction time Tc, and changes the correction time Tc to the time actually required by the playback device (S68).

  In S64, if the variable Tr ≦ the variable Ts, the reproduction processing capacity sufficient for reproducing the selected data does not remain, so that the reproduction processing remaining in other tracks except for the track is performed. In order to determine whether or not there is a reproducible track within the capacity range, the data selection unit 51 selects a track that is stored in each storage unit and that has not yet been determined whether the playback process is appropriate. Judge whether or not there is.

  As a result of the determination, the data selection unit 51 returns the process to S61 when there is a track for which the appropriateness of the reproduction process is not determined, and returns to S67 when there is no track for which the appropriateness of the reproduction process is not determined. The process of S68 and the process of S68 are performed.

  As described above, in the sixth embodiment, as long as there is reproduction processing capability, all the reproducible tracks are searched within the range of this reproduction processing capability in consideration of the priority order, so that the reproduction processing capability of the reproduction apparatus is the fifth. Compared to the embodiment, the present invention can be used without further surplus.

  Next, another embodiment will be described.

(Seventh embodiment)

  In the fifth and sixth embodiments, it is assumed that the unit time in the reproduction process is the same for all tracks as a precondition, but in this embodiment, a more general implementation that does not require this precondition. It is a form.

  FIG. 16 is a flowchart showing the operation of the data selection unit in the seventh embodiment.

  First, input data is input to the input data analysis unit 41 via the input data interface 11.

  The input data analysis unit 41 determines the data type of the actual data with reference to the identifier described in the track property atom, and inputs the input data according to the determination result to the image data storage unit 42, the graphics data storage unit 44, and outputs the result together with the determination result to the text data storage unit 46 or the voice data storage unit 48.

  In FIG. 16, the data selection unit 51 initializes variables such as variables T1, T2, Rt, Rc, Rp, Tc, and Tf (S81).

  Next, the data selection unit 51 obtains the frame rate of the video data (image data) by calculating from the time to sample atom and the media handler atom (S82).

  Next, the data selection unit 51 calculates the processing time allocated for reproducing one frame, and substitutes the calculation result for the variable Tf (S83). The variable Tf is a time allotted for reproducing one frame.

  Next, the data selection unit 51 divides the correction time Tc necessary for processing such as track selection by the variable Tf, and substitutes the division result for Rc (S84).

  Next, the data selection unit 51 rearranges the tracks in order of priority according to, for example, the priority table (S85).

  Next, the data selection unit 51 selects a track to be reproduced at the start of reproduction within the range of the reproduction processing capability (S86).

  Here, an operation of selecting a track to be reproduced at the start of reproduction will be described.

  FIG. 17 is a flowchart showing an operation of selecting a track at the start of reproduction.

  In FIG. 17, the data selection unit 51 substitutes a variable Rc for a variable Rt indicating the total amount of reproduction processing (S111).

  Next, the data selection unit 51 identifies the video data track with the highest priority by accessing the priority table storage unit 37, and reads the video data from the image data storage unit 42 (S112).

  Next, the data selection unit 51 calculates the processing amount of video data necessary for reproducing the read video data, and substitutes the calculation result for the variable Rs (S113). Here, for example, in the case of QT, the processing amount of video data is a value obtained by dividing the time required for processing one sample (one frame) by the duration time of one sample.

  Similarly, the processing amount of audio data is a value obtained by dividing the time required for processing one sample by the duration time of one sample. The processing amount of graphics data is a value obtained by dividing the time required for processing one sample by the time for one frame of video (the same as the duration time of one sample of video data). The amount of processing for the special effect is a value obtained by dividing the time required for the calculation for reproducing one frame of the video by the time for one frame of the video.

  Next, the data selection unit 51 adds the value of the variable Rs to the variable Rt and sets the addition result as a new value of the variable Rt (S114).

  Next, the data selection unit 51 identifies the audio data track with the highest priority by accessing the priority table storage unit 37, and reads the audio data from the image data storage unit 42 (S115).

  Next, the data selection unit 51 calculates the processing amount of the video data necessary for reproducing the read audio data, and substitutes the calculation result for the variable Rs (S116).

  Next, the data selection unit 51 adds the value of the variable Rs to the variable Rt, and sets the addition result as a new value of the variable Rt (S117).

  Next, the data selection unit 51 determines whether or not the variable Rt is 1.0 or less, that is, whether or not the playback processing capability remains in the playback device (S118).

  As a result of the determination, if the variable Rt ≦ 1.0, the reproduction processing capacity remains, so that the track stored in each storage unit by accessing the priority table storage unit 37 The track with the highest priority is selected from the tracks for which the suitability of the reproduction process has not yet been determined (S119).

  Next, the data selection unit 51 calculates a processing amount necessary for reproducing the selected data, and substitutes the calculation result for the variable Rs (S120).

  Next, the data selection unit 51 adds the value of the variable Rs to the variable Rt, sets the addition result as a new value of the variable Rt, and returns the process to S118 (S121).

  On the other hand, if the result of determination in S118 is that variable Rt> 1.0, the reproduction processing capacity does not remain, so the process returns to S87 (FIG. 16) of the main routine (S122).

  Returning to FIG. 16, the data selection unit 51 selects each piece of data selected as data to be reproduced at the start of reproduction according to the content of the image, the image decoding unit 15, the graphic decoding unit 16, the text decoding unit 32, or the audio data decoding unit. The playback apparatus starts playback of video (S87).

  Next, the data selection unit 51 determines whether or not there is a track that has been reproduced (S88). As a result of the determination, the data selection unit 51 repeats the process of S88 when there is no reproduction-completed track. On the other hand, as a result of the determination, if there is a track whose reproduction has ended, the data selection unit 51 obtains the current time from the timer and substitutes it for the variable T1 (S89).

  Next, the data selection unit 51 deletes the playback-completed track from the playback list (S90).

  Next, the data selection unit 51 recalculates the variable Rt (S91). Here, recalculation of the variable Rt will be described.

  FIG. 18 is a flowchart showing recalculation of Rt.

  In FIG. 18, the data selection unit 51 substitutes the value of the variable Rc for the variable Rt (S131).

  Next, the data selection unit 51 accesses the priority table storage unit 37, counts the number of tracks registered in the reproduction list, and substitutes the count result for the variable n (S132).

  Next, the data selection unit 51 initializes the loop variable j by substituting 0 (S133).

  Next, the data selection unit 51 determines the magnitude relationship between the variable j and the variable n. When the variable j <variable n, the data selection unit 51 calculates the processing amount of the j-th track in the playlist, and calculates the calculation result. Substitute into Rs (S135).

  Next, the data selection unit 51 adds the value of the variable Rs to the variable Rt, and sets the addition result as a new value of the variable Rt (S136).

  Next, the data selection unit 51 increments the loop variable j by adding 1 to the loop variable j and sets the addition result as the value of the new loop variable j, and returns the process to S134 (S137). In this way, the total processing amount of the tracks registered in the reproduction list is recalculated.

  On the other hand, if variable j ≧ variable n in S134, each processing amount is calculated for all the tracks registered in the reproduction list after deleting the track for which the reproduction processing has been completed, and the total processing amount is recalculated. Thus, the process returns to S91 (FIG. 16) of the main routine (S138).

  Since there is enough room in the playback processing capacity of the playback device by the processing amount of the track for which playback processing has been completed, the processing of S92 to S100 is performed in order to search for and play back a track that can be played back with this remaining power.

  That is, referring back to FIG. 16, the data selection unit 51 accesses the priority table storage unit 37, so that the track that is stored in each storage unit and that is not registered in the playlist is the most. A track with high priority data is selected (S92).

  Next, the data selection unit 51 calculates a processing amount necessary for reproducing the selected data, and substitutes the calculation result for the variable Rp (S93).

  Next, the data selection unit 51 determines whether or not the addition result obtained by adding the value of the variable Rs to the variable Rt is smaller than 1.0 (S94).

  If it is determined that (variable Rt + variable Rp) ≦ 1.0, the selected track can be reproduced, and the selected track is added to the reproduction list (S95). The data selection unit 51 adds the value of the variable Rs to the variable Rt, sets the addition result as the new value of the variable Rt, and returns the process to S92 (S96).

  On the other hand, if it is determined in S94 that (variable Rt + variable Rp)> 1.0, the reproduction processing capability for reproducing the selected track does not remain. The selection unit 51 acquires the current time from the timer, and substitutes the current time for the variable T2 (S97).

  Next, the data selection unit 51 subtracts the variable T1 from the variable T2, assigns the subtraction result to the correction time Tc, and changes the correction time Tc to the time actually required by the playback device (S98).

  Next, the data selection unit 51 divides the correction time Tc by the variable Tf and assigns the division result to Rc (S84).

  Next, the data selection unit 51 accesses the priority table storage unit 37, and the image decoding unit 15, the graphic decoding unit 16, and the text decoding unit 32 according to the contents of the data to be reproduced according to the reproduction list. Or it outputs to the audio | voice data decoding part 17, and a reproducing | regenerating apparatus starts reproduction | regeneration of an image | video (S100). Then, the data selection unit 51 returns the process to S88.

  As described above, in the seventh embodiment, even if the unit time for the reproduction processing is not the same for all tracks, the tracks stored in the respective storage units and not yet assigned with the reproduction processing capacity. Since the data processing track having the highest priority is sequentially selected when the reproduction processing capacity is generated in consideration of the actual processing amount, the reproduction processing capacity of the reproduction apparatus is used without being excessive as compared with the fourth embodiment. can do.

It is a block diagram which shows the structure of the reproducing | regenerating apparatus in 1st Embodiment. It is a figure which shows an example of the input data in 1st Embodiment. 3 is a flowchart showing the operation of the playback device in the first embodiment. It is a figure which shows the priority table in 1st Embodiment. It is a block diagram which shows the structure of the reproducing | regenerating apparatus in 2nd Embodiment. It is a figure which shows an example of the input data in 2nd Embodiment. It is a figure which shows the priority table in 2nd Embodiment. It is a block diagram which shows the structure of the reproducing | regenerating apparatus in 3rd Embodiment. It is a figure which shows the priority table in 3rd Embodiment. It is a flowchart which shows operation | movement of the text data selection part in 3rd Embodiment. It is a block diagram which shows the structure of the reproducing | regenerating apparatus in 4th Embodiment. It is a figure which shows the priority table in 4th Embodiment. It is a flowchart which shows operation | movement of the data selection part in 4th Embodiment. It is a flowchart which shows operation | movement of the data selection part in 5th Embodiment. It is a flowchart which shows operation | movement of the data selection part in 6th Embodiment. It is a flowchart which shows operation | movement of the data selection part in 7th Embodiment. It is a flowchart which shows the operation | movement which selects the track | truck at the time of reproduction | regeneration start. It is a flowchart which shows recalculation of Rt.

Explanation of symbols

12, 41 Input data analysis unit 13, 33, 35, 37 Priority table storage unit 14, 31 Priority discrimination unit 42 Image data storage unit 43 Image data selection unit 44 Graphics data storage unit 45 Graphic data selection unit 46 Text data Storage unit 47 Text data selection unit 48 Audio data storage unit 49 Audio data selection unit 51 Data selection unit

Claims (7)

A first area for storing a plurality of actual data that can be decoded by the decoding means, and a plurality of actual data stored in the first area are associated with each other on the time axis and managed so as to correspond to each of the plurality of actual data And a second area for storing management data provided, and the management data stored in the second area reproduces content data including identifiers of the plurality of actual data In
Input means for inputting the content data including the plurality of actual data having video data, audio data, and a plurality of types of graphic data;
Each of the plurality of actual data included in the first area of the content data input by the input means is referred to the identifier included in the second area of the content data, and the plurality of types An analysis means for analyzing the type of graphic data of
Storage means for storing information indicating a priority order to be decoded corresponding to each of the plurality of types of graphic data;
Of the plurality of actual data included in the first area of the content data, the video data, the audio data, and the data determined as a decoding target from the plurality of types of graphic data are decoded. Decryption means;
The type that has been analyzed by said analyzing means, said information indicating the priority stored in the storage means, and the priority of the plurality of based on a threshold for determining whether to a decoding target against And a discriminating unit for determining which of the types of graphic data is included in the decoding target of the decoding unit. The information indicating the priority order defines the priority order of each of the plurality of types of graphic data according to the type of graphic data to be processed at the same time. Playback device. The discriminating unit is configured to determine the type analyzed by the analyzing unit, information indicating the priority stored in the storage unit, and whether or not the priority should be a decoding target. The playback apparatus according to claim 1, wherein the graphic data to be decoded is determined based on the threshold value set in accordance with the playback capability of the video data. A first area for storing a plurality of actual data that can be decoded by the decoding means, and a plurality of actual data stored in the first area are associated with each other on the time axis and managed so as to correspond to each of the plurality of actual data And a second area for storing management data provided in the same manner, and the management data stored in the second area reproduces content data including identifiers of the plurality of actual data In
An input step in which the content data including the plurality of actual data having video data, audio data, and a plurality of types of graphic data is input;
Each of the plurality of real data included in the first area of the content data input by the processing of the input step is referred to the identifier included in the second area of the content data. An analysis step for analyzing the type of graphic data of
A storage step of storing information regarding whether or not to decode the actual data indicating the priority order to be decoded corresponding to each of the plurality of types of graphic data;
Of the plurality of actual data included in the first area of the content data, the video data, the audio data, and the data determined as a decoding target from the plurality of types of graphic data are decoded. A decryption step;
The analyzed by the processing of the analyzing step type, based on said information indicating the priority stored in the storage step, and the threshold for determining whether to a decoding target with respect to the priority And a determining step for determining which of the plurality of types of graphic data is included in the decoding target of the decoding means. A first area for storing a plurality of actual data that can be decoded by the decoding means, and a plurality of actual data stored in the first area are associated with each other on the time axis and managed so as to correspond to each of the plurality of actual data And a second area for storing management data provided, and the management data stored in the second area reproduces content data including identifiers of the plurality of actual data In
Input means for inputting the content data including the plurality of actual data having video data, audio data, and a plurality of types of text data;
Each of the plurality of actual data included in the first area of the content data input by the input means is referred to the identifier included in the second area of the content data, and the plurality of types An analysis means for analyzing the type of text data of
Storage means for storing information indicating a priority order to be decoded corresponding to each of the plurality of types of text data;
Of the plurality of actual data included in the first area of the content data, the video data, the audio data, and the data determined to be decoded from the plurality of types of text data are decoded. Decryption means;
The type that has been analyzed by said analyzing means, said information indicating the priority stored in the storage means, and the priority of the plurality of based on a threshold for determining whether to a decoding target against And a discriminating unit for determining which of the types of text data is included in the decoding target of the decoding unit. The discriminating unit is configured to determine the type analyzed by the analyzing unit, information indicating the priority stored in the storage unit, and whether or not the priority should be a decoding target. The playback apparatus according to claim 5, wherein the text data to be decrypted is determined based on the threshold value set according to the playback capability of the player . A first area for storing a plurality of actual data that can be decoded by the decoding means, and a plurality of actual data stored in the first area are associated with each other on the time axis and managed so as to correspond to each of the plurality of actual data And a second area for storing management data provided in the same manner, and the management data stored in the second area reproduces content data including identifiers of the plurality of actual data In
An input step in which the content data including the plurality of actual data having video data, audio data, and a plurality of types of text data is input;
Each of the plurality of real data included in the first area of the content data input by the processing of the input step is referred to the identifier included in the second area of the content data. An analysis step for analyzing the type of text data of
A storage step of storing information regarding whether or not to decode the actual data indicating the priority order to be decoded corresponding to each of the plurality of types of text data;
Of the plurality of actual data included in the first area of the content data, the video data, the audio data, and the data determined to be decoded from the plurality of types of text data are decoded. A decryption step;
The analyzed by the processing of the analyzing step type, based on said information indicating the priority stored in the storage step, and the threshold for determining whether to a decoding target with respect to the priority And a determining step for determining which of the plurality of types of text data is included in the decoding target of the decoding means.

Images