JP2008252446A - Video reproducing device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a video reproducing device capable of flexibly reproducing video. <P>SOLUTION: A computer 1 is provided with an HD DVD drive 119 for reading data of AV content stored in an HD DVD medium 119a; a DVD reproducing part 140 for decoding read data to generate first video data B3 and B4; a file parser 151 for reading reproducing control information stored in an HDD 117; an additional reproducing information generating part 150 for generating second video data, on the basis of read information; and a graphic compositor 163 for generating and reproducing the superimposed video data C2 obtained by superimposing the irst video data on the second video data. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to a video playback apparatus that plays back video data stored in a storage medium.

In recent years, the mainstream of equipment for recording audio and video has shifted from conventional analog magnetic tapes to digital magnetic disks and semiconductor memories. In particular, the storage capacity of recording media used in video recording / playback apparatuses has increased dramatically. If such a storage medium is used, videos of a large number of programs provided by broadcasting or communication can be stored and freely selected and viewed by the user (for example, see Patent Document 1 below).
JP 2006-309920 A

  In such video playback, various playback methods such as, for example, playing back while adding desired additional information to the original video as well as simply playing back the content recorded on the recording medium. There may be a request for

  Therefore, an object of the present invention is to provide a video playback apparatus that can flexibly perform video playback.

  The video reproduction apparatus of the present invention includes a video information reading unit that reads video information stored in a first storage medium, and a first video data that is decoded by the video information reading unit and generates first video data. Based on the video data generating means, the control information reading means for reading the playback control information stored in the second storage medium different from the first storage medium, and the second based on the playback control information read by the control information reading means 2nd video data generation means which produces | generates video data, The video superimposition reproduction | regeneration means which produces | generates and reproduces | regenerates the superimposition video data which superimposed 1st video data and 2nd video data, It is characterized by the above-mentioned. .

  According to the video playback apparatus of the present invention, video playback can be performed flexibly.

  Hereinafter, a computer 1 as a preferred embodiment of a video reproduction apparatus according to the present invention will be described in detail with reference to the drawings.

  A notebook personal computer 1 shown in FIG. 1 includes a computer main body 3 and a display unit 5 that can be opened and closed with respect to the computer main body 3. In the display unit 5, a TFT-LCD (Thin Film Transistor Liquid Crystal Display) 7 is incorporated as a video display device, and the display screen of the LCD 7 is located substantially at the center of the display unit 5.

  The display unit 5 is attached to the computer main body 3 so as to be rotatable between an open position and a closed position. The computer main body 3 has a thin box-shaped casing. On the upper surface of the computer main body 3, a keyboard 9, a power button 11 for powering on / off the computer 1, a touch pad 15, a click button 17, and a speaker 19 are provided. Is arranged.

  Further, the computer 1 can play back audio / video (AV) content (in HD DVD Video standard) stored in HD DVD media in the HD DVD standard. Furthermore, the computer 1 can also write AV content on the HD DVD media. On the side surface of the computer main body 3, a slot 21 for inserting / removing HD DVD media to / from the HD DVD drive 119 (see FIG. 2) is provided.

  As shown in FIG. 2, the computer 1 includes a CPU 101, a north bridge 103, a main memory 105, a graphics controller 107, a video memory (VRAM) 107a, a south bridge 109, a BIOS-ROM 111, a sound controller 113, a hard disk drive (HDD). ) 117, HD DVD drive 119, embedded controller / keyboard controller IC (EC / KBC) 121, network controller 123, digital TV tuner 125, and the like.

  The CPU 101 is a processor that controls the operation of the computer 1 and executes various programs loaded from the HDD 117 to the main memory 105. As various programs executed by the CPU 101, there are an operating system, an HD DVD player application program 131 for reproducing HD contents of the DVD standard, a TV application for enabling viewing of digital TV broadcasts, and the like. The CPU 101 also executes a BIOS (Basic Input Output System; a program for hardware control) stored in the BIOS-ROM 111.

  The north bridge 103 is a bridge device that connects the local bus of the CPU 101 and the south bridge 109. The north bridge 103 also includes a memory controller that controls access to the main memory 105. The north bridge 103 also has a function of executing communication with the graphics controller 107 via a PCI Express standard serial bus or the like.

  The graphics controller 107 is a display controller that controls the LCD 7 used as a display monitor of the computer 1. The graphics controller 107 has image processing functions such as blend processing, scaling processing, and luma key processing. A display signal generated by the graphics controller 107 is sent to the LCD 7. The display signal can also be sent to an external TV or HDMI monitor via an interface provided in the computer main body 3.

  The south bridge 109 controls each device on a PCI (Peripheral Component Interconnect) bus and each device on an LPC (Low Pin Count) bus. The south bridge 109 includes an IDE (Integrated Drive Electronics) controller for controlling the HDD 117 and the HD DVD drive 119. Further, the south bridge 109 has a function of executing communication with the sound controller 113. The sound controller 113 is a sound source device and outputs audio data to be reproduced to the speaker 19.

  The embedded controller / keyboard controller IC (EC / KBC) 121 is a one-chip micro integrated with an embedded controller for power management and a keyboard controller for controlling the keyboard 9, the touch pad 15, and the click button 17. It is a computer. When the touch pad 15 is operated, an operation signal is generated, and the cursor displayed on the display screen of the LDC 7 moves based on the operation signal. Further, the EC / KBC 121 has a function of powering on / off the computer 1 in accordance with the operation of the power button 11 by the user.

  In the computer 1, an HD DVD medium (first storage medium) 119a is inserted into the HD DVD drive 119, and the CPU 101 executes the HD DVD player application 131, whereby AV content (video) stored in the HD DVD medium 119a is recorded. Information) can be reproduced. Further, the application 131 refers to a markup file (control information file) prepared in advance in the HDD (second storage medium) 117 by the user, and based on the description of the markup file, the main video of the AV content is recorded. 2 has a function of displaying desired text information and an image superimposed on each other and outputting a desired voice superimposed on the main voice. Such a function makes it possible, for example, to display a description of each scene of the movie while displaying the movie as AV content on the screen.

  Further, the application 131 has a function of automatically performing a desired trick play such as fast-forwarding or jumping based on the description of the markup file while reproducing AV content. Such a function makes it possible to use, for example, a playback of a cut version while picking up only the main scenes of a movie. Hereinafter, text information, images, sounds, trick play, and the like that are added to the AV content main part and reproduced as described above are referred to as “additional reproduction information”.

  Next, the configurations of the computer 1 and the application 131 that enable playback of AV content as described above will be described with reference to FIGS.

  First, FIG. 3 shows an example of a markup file for setting the additional reproduction information. The markup file F1 is created as a text file described in the XML format and is stored in the HDD 117 in advance. The markup file F1 includes audio setting information H1 for setting additional audio to be output superimposed on the audio of the AV content main video, video setting information H2 for setting additional images to be displayed superimposed on the video of the AV content main video, and AV. Trick play setting information H3 for setting trick play in content reproduction is described.

  For example, in the example of FIG. 3, the audio setting information H1 is indicated by an audio file “hello.wav” at a volume of 50% at “reproduction time 00: 01: 15: 00 to 00: 01: 22: 00”. This means a setting that “sound is output by superimposing the sound on the main part”. As in this example, the audio setting information H1 describes the timing at which the additional audio is output and the content of the additional audio. The video configuration information H2, "Play time 00: 00: 10:00 to 00:00: 12: at 00, to the position of the display on the 10,130, and the character of the" Hello ", the image file" face.png " This means a setting of “displaying the image indicated by“ overlaid on the main video ”. As in this example, the video setting information H2 describes the timing at which the additional image is displayed, the position of the additional image, and the content of the additional image. Further, the trick play setting information H3 means a setting that “Pause is automatically performed at a reproduction time of 00: 00: 11: 20”. As in this example, the trick play setting information H3 describes the timing at which trick play is performed and the contents of trick play.

  The markup file F1 does not store the displayed image data or sound data itself, but describes the image file name to be referred to and the sound file name to be referred to as so-called metadata. By adopting a file format that describes metadata in this way, the file size can be saved. The audio file “hello.wav” and the image file “face.png” are stored in the HDD 117 in advance.

  Next, as shown in FIG. 4, the application 131 executed on the computer 1 includes a DVD playback unit (first video data generation unit, first audio data generation unit) 140, an additional playback information generation unit (second video data). A generating unit, a second audio data generating unit) 150, an audio mixer (audio superimposing / reproducing unit) 161, and a graphic compositor (video superimposing / reproducing unit) 163. The additional reproduction information generation unit 150 includes a file parser (control information reading unit) 151, a timing engine (reproduction operation control unit) 153, a sound decoder 155, an image decoder 157, and a font renderer 159. These components 140, 150, 151 to 163 are functional components realized by software when the CPU 101 (see FIG. 2) executes the application 131.

  Among these, the DVD playback unit 140 is a subprogram for playing back the AV content of the HD DVD video standard stored in the HD DVD media 119a as usual, and the DVD playback unit 140 is a conventional HD DVD playback program. Can be adopted. As shown in FIG. 5, the DVD playback unit 140 includes a stream separation unit 141, an audio decoder 142, a video decoder 143, a sub-picture decoder 144, and a multiplexing unit 145. These components 141 to 145 are functional components realized by software by the CPU 101 (see FIG. 2) executing a subprogram that realizes the DVD playback unit 140.

  As shown in FIGS. 5 and 6, the HD DVD drive (video information reading means, audio information reading means) 119 reads the DVD stream A1 related to the AV content main part from the inserted HD DVD medium 119a (S602). The read DVD stream A1 is input to the stream separation unit 141, and audio data, video data, and sub-picture data used for movie subtitles and the like are separated. The stream separation unit 141 outputs the separated audio data, video data, and sub-picture data to the audio decoder 142, the video decoder 143, and the sub-picture decoder 144, respectively. The stream separation unit 141 outputs the reproduction time information A4 included in the DVD stream A1 to the timing engine 153 of the additional reproduction information generation unit 150.

  As will be described in detail later, the timing engine 153 controls the timing for outputting the additional reproduction information based on the reproduction time information A4, so that the output of the additional reproduction information can be synchronized with the reproduction of the AV content main part. become. In addition, upon receiving a playback operation instruction B1 from a timing engine 153, which will be described later, the stream separation unit 141 performs control of the HD DVD drive 119 and processing of the DVD stream A1 based on the playback operation instruction B1, thereby reproducing AV content. Inside, trick play such as jump, fast forward, rewind, slow play, pause, etc. is realized.

  The audio decoder 142 decodes the separated audio data, and outputs the decoded audio data to the audio mixer 161 outside the DVD playback unit 140 as audio data A2 of the main content of the AV content (S604). The video decoder 143 decodes and outputs the separated video data. The sub picture decoder 144 decodes and outputs the separated sub picture data. Then, the multiplexing unit 145 multiplexes the decoded video data and the sub-picture data, and outputs them to the graphic compositor 163 outside the DVD playback unit 140 as AV content main video data A3 (S604). The audio data (first audio data) A2 of the AV content main part output from the DVD reproducing unit 140 in this way is hereinafter referred to as “main audio data”, and the video data (first video of the AV content main part). Data) A3 is referred to as “main video data”.

  Referring again to FIGS. 4 and 6, information from the markup file F <b> 1 is input to the additional reproduction information generation unit 150. That is, the file parser 151 of the additional reproduction information generation unit 150 reads the markup file F1 from the HDD 117 (S606), and the description contents of the file F1 (audio setting information H1, video setting information H2, trick play setting information H3; reproduction control) Information) is output to the timing engine 153.

  The timing engine 153 matches the playback time 00: 01: 15: 00 to 00: 01: 22: 00 set in the audio setting information H1 based on the playback time information A4 output from the DVD playback unit 140. Then, an audio output instruction at a volume of 50% is output to the sound decoder 155. This voice output instruction includes the file name “hello.wav” of the voice file F2 set by the voice setting information H1.

  Further, the timing engine 153 outputs an image output instruction to the image decoder 157 in accordance with the reproduction time 00: 00: 10: 0 to 00: 00: 00: 12: 00 set by the video setting information H2. This image output instruction includes the file name “face.png” of the image file F3 set by the video setting information H2 and the image display position “10, 130”.

  Further, the timing engine 153 outputs a text output instruction to the font renderer 157 in accordance with the playback time 00: 00: 10: 0 to 00: 00: 00: 12: 00 set by the video setting information H2. This text output instruction includes a set text "Hello" and the display position of the text in image configuration information H2 "10,130".

  Further, the timing engine 153 outputs a playback operation instruction B1 to the DVD playback unit 140 in accordance with the playback time 00: 00: 11: 20 set by the trick play setting information H3. The reproduction operation instruction B1 includes the trick play type “pause” set in the trick play setting information H3. Upon receiving the playback operation instruction B1, the stream separation section 141 (see FIG. 5) of the DVD playback section 140 performs control of the HD DVD drive 119 and processing of the DVD stream A1, and realizes the trick play “pause” related to the instruction. .

  When the sound decoder 155 receives the sound output instruction from the timing engine 153, the sound decoder 155 reads out the data of the sound file F2 “hello.wav” related to the instruction from the HDD 117. Then, the audio data of the audio file F2 is decoded, and the decoded audio data (second audio data) B2 is output to the audio mixer 161 (S608).

  When the image decoder 157 receives an image output instruction from the timing engine 153, the image decoder 157 reads data of the image file F3 “face.png” related to the instruction from the HDD 117. Then, image data of a screen in a state where the image of the image file F3 is set at the display position “10, 130” according to the image display instruction is created. Then, the image data of the screen is decoded, and bitmap data (second video data) B3 is output to the graphic compositor 163 (S608).

  When the font renderer 159 receives a text output instruction from the timing engine 153, the font renderer 159 reads out from the HDD 117 a font data file F4 corresponding to a predetermined font in which the text is to be displayed. Then, referring to the font data of the font data file F4, to image the text "Hello" to be displayed. Then, image data of a screen in a state where the image is set at the display position “10, 130” according to the image display instruction is created. Then, the image data of the screen is decoded, and bitmap data (second video data) B4 is output to the graphic compositor 163 (S608).

  The audio mixer 161 superimposes the main audio data A2 from the DVD playback unit 140 and the audio data B2 from the sound decoder 155, and sends the superimposed audio data (superimposed audio data) C1 to the sound controller 113 (S610). The sound controller 113 sends a control signal based on the audio data C1 to the speaker 19.

  The graphic compositor 163 superimposes the main video data A3 from the DVD playback unit 140, the bitmap data B3 from the image decoder 157, and the bitmap data B4 from the font renderer 159, and superimposes the video data (superimposed video). Data) C2 is sent to the graphics controller 107 (S610). The graphics controller 107 sends a control signal based on the video data C2 to the LCD 7.

  In this manner, the additional sound set in the markup file F1 is superimposed on the audio of the AV content main part and output from the speaker 19, and the LCD 7 adds the additional audio set in the markup file F1 to the video of the main AV content. The images are superimposed and displayed on the screen (S612).

  Based on the above configuration, if a markup file is prepared in the HDD 117 in advance, the audio and image as additional playback information can be used as the main audio / video as the AV content stored in the HD DVD media 119a is played back. The set trick play is automatically executed while being reproduced by being superimposed on the video. As a result, according to such a computer 1 and application 131, it is possible to express flexible AV content with various additional reproduction information added.

  Next, an example of AV content playback using the computer 1 and the application 131 will be described. For example, there are movies that are very difficult to understand, and movies that have hidden lines in detail. Therefore, by using the audio setting information H1 and the video setting information H2 to set explanatory text, explanatory images, explanatory audio, etc., explanation can be automatically added at a desired timing during movie playback. You can also add movie subtitles. In this case, an LCD of a general computer generally has a screen aspect ratio of 16:10. When a movie having a screen aspect ratio of 16: 9 is played, margins appear at the top and bottom of the screen. If the display position is adjusted with the setting information H2, it is possible to display subtitles in the margin.

  In addition, if the trick play setting information H3 is set by appropriately combining trick play such as fast-forwarding and jumping, a cut version that can be viewed in a short time can be created. It is also possible to create a movie or parody that is completely different from the main story by combining trick play.

  Further, the setting of the additional reproduction information as described above is prepared in the markup file F1 separately from the AV content main data, and the markup file F1 is an HDD 117 which is a storage medium different from the HD DVD medium 119a. Stored in Therefore, it is possible to express various AV contents without changing the AV contents stored in the HD DVD media 119a. Further, if such a markup file F1 is shared among users, the same expression of AV content can be shared, and the interpretation, opinion, summary, etc. of AV content can be shared between the users. Further, since the additional reproduction information is set by the description of the text data in the markup file F1, it can be easily created and edited by the user. The users can easily exchange additional reproduction information by exchanging the markup file F1. As a result, a deeper level of user interaction with respect to AV content information is promoted and created.

  The present invention is not limited to the embodiment described above. For example, the setting of the additional reproduction information is described in the markup file F1 in the XML format, but the present invention is not limited to this, and a user-friendly interface such as a GUI may be employed. The storage locations of the AV content main part and the markup file F1 are not limited to the HD DVD medium 119a and the HDD 117, respectively. The AV content main part and the markup file F1 may be stored in different media. The AV content main part is not limited to the HD DVD Video standard, and may be data of the DVD video standard. In this case, the computer 1 may employ a DVD drive instead of the HD DVD drive 119.

1 is a perspective view showing a computer which is an embodiment of a video reproduction apparatus according to the present invention. It is a block diagram which shows the system configuration | structure of the computer of FIG. FIG. 3 is a diagram showing an example of a markup file used in the HD DVD player application of FIG. 2. FIG. 2 is a block diagram illustrating components of the computer of FIG. 1 during execution of an HD DVD player application. It is a block diagram which shows the detail of the DVD reproduction part of FIG. It is a flowchart which shows the process of a HD DVD player application.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 ... Computer (video reproduction apparatus), 117 ... HDD (2nd storage medium), 119 ... HD DVD drive (video information reading means, audio | voice information reading means), 119a ... HD DVD media (1st storage medium), 140... DVD reproduction unit (first video data generation unit, first audio data generation unit), 150. Additional reproduction information generation unit (second video data generation unit, second audio data generation unit), 151... File parser (control) (Information reading means), 153... Timing engine (reproduction operation control means), 161... Audio mixer (audio superimposition reproduction means), 163... Graphic compositor (video superimposition reproduction means), A2 ... audio data (first audio data) A3: Video data (first video data), B2: Decoded audio data (second audio data), B3: Video Map data (second video data), B4... Bit map data (second video data), C1... Audio data (superimposed audio data), C2... Video data (superimposed video data), F1. File), H1 ... audio setting information (reproduction control information), H2 ... video setting information (reproduction control information), H3 ... reproduction control information (reproduction control information).

Claims (5)

Video information reading means for reading video information stored in the first storage medium;
First video data generating means for decoding the video information read by the video information reading means to generate first video data;
Control information reading means for reading reproduction control information stored in a second storage medium different from the first storage medium;
Second video data generating means for generating second video data based on the reproduction control information read by the control information reading means;
Video superimposition reproduction means for generating and reproducing superimposed video data in which the first video data and the second video data are superimposed;
A video reproducing apparatus comprising: Voice information reading means for reading voice information stored in the first storage medium;
First audio data generating means for decoding the video information read by the audio information reading means and generating first audio data to be reproduced together with the first video data;
Second audio data generating means for generating second audio data based on the reproduction control information read by the control information reading means;
Audio superimposed reproduction means for generating superimposed audio data in which the first audio data and the second audio data are superimposed, and reproducing together with the superimposed video data reproduced by the video superimposed reproduction means;
The video reproduction apparatus according to claim 1, further comprising:   3. The reproduction operation control means for controlling the reproduction operation of the superimposed video data by the video superimposing reproduction means based on the reproduction control information read by the control information reading means. The video playback device described in 1.   The video reproduction apparatus according to claim 1, wherein the reproduction control information is described in a control information file stored in the second recording medium. In the control information file,
5. The video playback according to claim 4, wherein metadata indicating a file to be referred to when the second video data generating means generates the second video data is described as the playback control information. apparatus.

Images