JP5275402B2 - Information processing apparatus, video playback method, and video playback program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an information processor, a video reproduction method and a video reproduction program which can carry out video reproduction which is subjected to high resolution processing while suppressing a reproduction stop. <P>SOLUTION: The information processor has a stream data separation part 200 which separates compressed video data and compressed sub-picture data from compressed stream data read out from a recording medium; a first conversion processing part 112 which is connected to a main control part controlling the reproduction of an optical recording medium via a bus 119 and generates converted video data by performing high resolution processing for data formed by decoding the compressed video data; a second conversion processing part 204 which generates converted sub-picture data by performing high resolution processing for data which is formed by decoding the compressed sub-picture data; and a drawing part which synthesizes the converted video data and the converted sub-picture data and outputs them to a display part. <P>COPYRIGHT: (C)2011,JPO&amp;INPIT

Description

  The present invention relates to an information processing apparatus, a video playback method, and a video playback program.

Recently, with the development of computer multimedia, DVD (Digital Versatile Disk)
Computers equipped with DVD drives capable of reproducing the above are becoming widespread. 1 DVD
The ROM medium can record about 4.7 Gbytes of data, which is about 7 times the current CD-ROM on one side, and can record about 9.4 Gbytes of data on double-sided recording. By using this DVD-ROM medium, it is possible to reproduce a moving image such as a movie including a large amount of video information with high quality on a computer.

The data structure of the video information recorded on the DVD-ROM medium is defined by the DVD video standard. Video information is roughly divided into two types of data: presentation data and navigation data.

Presentation data is a set of video objects to be played back, and is composed of video, sub-pictures, and audio. Video data is compressed and encoded by the MPEG-2 system. A sub-picture is bitmap data, and is used for displaying subtitles of movies, choices on a menu screen, and the like. One video object can include video data of one channel, audio data of up to 8 channels, and sub-picture data of up to 32 channels.

In recent years, with the progress of digital compression encoding technology for moving images, playback devices (players) capable of handling HD (High Definition) standard high-definition video have begun to spread. Recently, software development for making it possible to handle HD-definition high-definition video on a personal computer is also in progress (see, for example, Patent Document 1).

In the information processing apparatus described in Patent Document 1, it is assumed that two cursors coexisting when a content in which a cursor is defined are reproduced in a multi-window environment can be appropriately operated according to a pointing device operation.

JP 2008-40826 A

However, the conventional information processing apparatus performs various internal processes in the background even during the DVD playback operation. In particular, when playing a DVD, the internal processing load is greater than during normal operation, so SD (Standard Definition) video is converted to high-definition HD video and played back, and subtitles and menus are displayed. If an operation is to be performed, the load of internal processing becomes even larger, and there are problems such as discontinuity due to interruption of the reproduction of moving images depending on the situation.

Accordingly, an object of the present invention is to provide an information processing apparatus, a video playback method, and a video playback program capable of performing video playback with high resolution processing while suppressing playback stop.

In order to achieve the above object, the present invention provides a first processor that controls reproduction of stream data in which first encoded data and second encoded data are multiplexed;
A second processor connected to the first processor via a bus;
Separating means for separating the first encoded data and the second encoded data from the stream data;
First conversion processing means for generating first image data by increasing the resolution of the first encoded data on the second processor;
A second conversion processing unit for generating second image data by increasing the resolution of the second encoded data on hardware different from that of the second processor;
Rendering means for outputting an image obtained by combining the first image data and the second image data to a display device;
An information processing apparatus characterized by comprising:

In order to achieve the above object, the present invention provides the first encoded data and the second encoded data from stream data in which the first encoded data and the second encoded data are multiplexed. Separating steps to separate and
A first conversion processing step of generating first image data by increasing the resolution of the first encoded data on a processor connected to the main control unit via a bus;
A second conversion processing step of generating second image data by increasing the resolution of the second encoded data on hardware different from the processor;
There is provided a video reproducing method including a drawing step of outputting an image obtained by synthesizing the first image data and the second image data to a display device.
In order to achieve the above object, the present invention provides a computer,
Separating means for separating the first encoded data and the second encoded data from the stream data obtained by multiplexing the first encoded data and the second encoded data;
First conversion processing means for generating first image data by increasing the resolution of the first encoded data on a processor connected to the main control unit via a bus;
Second conversion processing means for generating second image data by increasing the resolution of the second encoded data on hardware different from the processor;
Provided is a video reproduction program for causing an image obtained by synthesizing the first image data and the second image data to function as a drawing unit that outputs the image to a display device.

According to the present invention, it is possible to perform video playback that has been subjected to predetermined image processing while suppressing playback stop.

It is a perspective view which shows the information processing apparatus which concerns on embodiment of this invention. It is a block diagram which shows the system configuration | structure of the information processing apparatus which concerns on embodiment of this invention. It is a figure explaining the flow of data at the time of DVD reproduction. It is a figure which shows the reproduction | regeneration processing at the time of reproducing | regenerating DVD with the information processing apparatus which concerns on embodiment of this invention. . It is a flowchart which shows the flow of the reproduction | regeneration processing at the time of reproducing | regenerating DVD with the information processing apparatus which concerns on embodiment of this invention.

Embodiments of the present invention will be described below in detail with reference to the drawings. FIG. 1 is a perspective view showing an information processing apparatus according to an embodiment of the present invention.

(Embodiment of the present invention)
The information processing apparatus 1 is a notebook personal computer, and includes a computer main body 11 and a display unit 12. Display unit 1
2, a display device composed of an LCD (Liquid Crystal Display) 13 is incorporated.

The display unit 12 is attached to the computer main body 11 so as to be rotatable between an open position and a closed position. The computer main body 11 has a thin box-shaped housing,
On the upper surface, a keyboard 14, a power switch 15 for powering on / off the information processing apparatus 1, a touch pad 16, and the like are arranged.

Further, a DVD drive 17 is provided on the side of the computer main body 11 as an optical media drive. The DVD drive 17 can perform recording and reproduction on a recording medium such as a CD (Compact Disc) or a DVD 18.

FIG. 2 is a block diagram showing a system configuration of the information processing apparatus according to the embodiment of the present invention.

As shown in FIG. 2, the information processing apparatus 1 includes a CPU 101 and a north bridge 102.
, Main memory 103, south bridge 104, graphics processing unit (GP
U) 105, video memory (VRAM) 105A, sound controller 106, BIO
S-ROM 109, LAN controller 110, hard disk drive (HDD) 11
1, DVD drive 17, multimedia processor 112, card controller 113
, Wireless LAN controller 114, IEEE 1394 controller 115, embedded controller / keyboard controller IC (EC / KBC) 116, TV tuner 11
7 and a remote control unit interface 118 and the like.

The CPU 101 is a processor as a main control unit that controls the operation of the information processing apparatus 1, and various applications such as an operating system (OS) and a DVD application program loaded from the hard disk drive (HDD) 111 to the main memory 103. Run the program. The DVD application program is software for executing a recording / reproducing function for a DVD. Also, the CPU 101 is a BIOS
-The BIOS (Basic Input Output System) stored in the ROM 109 is also executed. BI
The OS is a program for hardware control.

The north bridge 102 is a bridge device that connects the local bus of the CPU 101 and the south bridge 104. The north bridge 102 also includes a memory controller that controls access to the main memory 103. The North Bridge 102 is a PC
It also has a function of executing communication with the GPU 105 via an I Express standard serial bus or the like.

The GPU 105 is a display controller that controls the LCD 13 that is used as a display monitor of the information processing apparatus 1. The display signal generated by the GPU 105 is LCD1.
Sent to 3. The GPU 105 is connected to an external television device (TV) via a TV terminal 119.
It is also possible to send a digital video signal to 120, an HDMI control circuit 121 and an HDMI
A digital video signal can also be sent to the HDMI monitor 123 via the terminal 122.

The south bridge 104 includes each device on an LPC (Low Pin Count) bus and PCI.
(Peripheral Component Interconnect) Control each device on the bus. The south bridge 104 includes an IDE (Integrated Drive Electronics) controller for controlling the hard disk drive (HDD) 111 and the DVD drive 17.
Further, the south bridge 104 has a function of executing communication with the sound controller 106.

Furthermore, the South Bridge 104 includes a PCI Express standard serial bus PCI E
A multimedia processor 112 is connected via an xpress bus 135.

The multimedia processor 112 converts HD video data (HD image quality) into video data included in compressed stream data as DVD playback data based on playback of a DVD by the DVD drive 17 serving as reading means. A processor as a first conversion processing unit that up-converts data).

In the present embodiment, when the up-conversion function is selected during DVD playback in which video content such as a movie is recorded, video data (main video data) and audio data encoded according to the MPEG (Moving Picture Experts Group) 2 system Compressed stream data obtained by multiplexing sub-picture data (sub-picture data) such as subtitle data is read from the DVD as DVD playback data by the DVD application program. The resolution of the compressed stream data is, for example, 720 × 480 or 720 × 576. D
The video data included in the compressed stream data read from the VD is transferred to the multimedia processor 112 via the PCI Express bus 135 having a high transfer speed, and as decoding processing and HD-quality video data, for example, 1920 × After up-conversion processing to a resolution of 1080, it is combined with sub-picture data that has been up-converted separately from video data, and is rendered.

In the present embodiment, a multimedia processor 112, which is a dedicated processor different from the CPU 101, is used as a back-end processor, and this multimedia processor 112 performs decoding processing of compressed stream data and up-conversion processing of video data. The Therefore, the up-conversion process can be executed without increasing the load on the CPU 101.

The sound controller 106 is a sound source device, and outputs audio data to be reproduced to the speaker 19 or the HDMI control circuit 121.

The card controller 113 controls cards such as PC cards and SD (Secure Digital) cards. The wireless LAN controller 114 is, for example, a wireless communication device that performs wireless communication of the IEEE 802.11 standard. The IEEE 1394 controller 115 is
Communication with an external device is executed via an IEEE1394 standard serial bus.

The embedded controller / keyboard controller IC (EC / KBC) 116 is
This is a one-chip microcomputer in which an embedded controller for power management and a keyboard controller for controlling the keyboard (KB) 14 and the touch pad 16 are integrated. This embedded controller / keyboard controller IC (EC / K
BC) 116 has a function of powering on / off the information processing apparatus 1 in accordance with the operation of the power switch 15 by the user. Further, the embedded controller / keyboard controller IC (EC / KBC) 116 is connected to the remote control unit interface 11.
8 has a function of executing communication with the terminal 8.

The TV tuner 117 is a receiving device that receives broadcast program data broadcast by a television broadcast signal, and is realized as a digital TV tuner capable of receiving digital broadcast program data such as terrestrial digital TV broadcast. .

  FIG. 3 is a diagram for explaining the flow of data during DVD playback.

DVD reproduction data based on reproducing a DVD is compressed stream data including sub-picture data such as video data, audio data, and caption data. In the following description, the flow of video data and sub-picture data when outputting compressed stream data read from a DVD as HD image quality data will be described.

The compressed stream data includes PCI bus 130, south bridge 104, DMI (Direct
Media Interface) bus 131, north bridge 102, and data bus 132 are transferred to main memory 103.

The video data included in the compressed stream data transferred to the main memory 103 is DVD
The data is read from the main memory 103 based on the execution of the application program, and the data bus 132, the north bridge 102, the DMI bus 131, the south bridge 104, the PCI Expr
It is transferred to the multimedia processor 112 via the ess bus 135.

The compressed stream data transferred to the multimedia processor 112 is subjected to MPEG2 decoding processing and up-conversion processing, and then the PCI Express bus 13 as HD image quality data.
5, South Bridge 104, DMI Bus 131, North Bridge 102, Data Bus 13
2 to the main memory 103 again.

The video data which is the up-converted HD image quality data transferred to the main memory 103 is read again from the main memory 103 based on the execution of the DVD application program, and passes through the data bus 132, the north bridge 102, and the data bus 134. GPU
105 and transferred from the GPU 105 to the VRAM 105A.

Also, the sub-picture data included in the compressed stream data transferred to the main memory 103 is read from the main memory 103 based on the execution of the DVD application program, and the data bus 132, the north bridge 102, and the FSB (Front Side Bus) are read out. ) 133 and transferred to the CPU 101 via the CPU 101, and after the up-conversion processing conforming to the HD standard by the CPU 101, the GPU 105 via the FSB 133, the north bridge 102, and the data bus 132.
And transferred from the GPU 105 to the VRAM 105A. Note that the up-conversion processing of sub-picture data can be performed by the GPU 105, and is performed by the CPU 101 or the GPU 105 depending on the operation status of the information processing apparatus 1.

The video data and sub-picture data transferred to the VRAM 105A are combined for each frame, transferred to the GPU 105, and rendered by the GPU 105. Note that the video data and the sub-picture data may be combined by the CPU 101 or the GPU 105.

FIG. 4 is a diagram showing a reproduction process when a DVD is reproduced by the information processing apparatus according to the embodiment of the present invention.

DVD playback is executed by a DVD application program loaded into the main memory 103 of the information processing apparatus 1. The DVD application program functions as a stream data separator (separator) that separates the compressed stream data, and controls a transfer of the separated compressed stream data.
A video decoder 201 having a sub-picture decoder 202 that decodes compressed sub-picture data included in the compressed stream data, and a multimedia processor control unit 203 that controls transfer of the compressed video data to the multimedia processor 112. Have.

The navigation filter 200 separates the compressed video data and the compressed sub-picture data included in the compressed stream data, and outputs them to the video decoder 201.

The video decoder 201 decodes the compressed sub-picture data transmitted from the navigation filter 200 and the compressed video data transmitted from the navigation filter 200 when up-conversion processing is designated. Multimedia processor control unit 2 for transmitting to multimedia processor 112
03.

The multimedia processor 112 includes a decoder 112A that decodes the compressed video data transmitted from the multimedia processor control unit 203, and an upconverter 112B that upconverts the decoded baseband video data.

The multimedia processor control unit 203 includes a video data decoder, and has a function of converting compressed video data into baseband SD data when up-conversion processing is not designated.

Also, the baseband sub-picture data output from the video decoder 201 is transmitted to the mixer 205 via the up-converter 204 provided in the subsequent stage. Baseband video data is transmitted from the multimedia processor control unit 203 to the mixer 205.

The up-converter 204 is a second conversion processing unit that performs up-conversion processing of sub-picture data such as subtitles decoded by the sub-picture decoder 202 into converted sub-picture data.

The mixer 205 combines the up-converted video data and the up-converted sub-picture data.

The renderer 206 performs image quality improvement processing of video data obtained by combining video data and sub-picture data, and performs rendering processing of an image to be displayed. Here, the image quality improvement processing is processing such as adjustment of the hue of the synthesized video data.

Hereinafter, a DVD reproducing operation in the information processing apparatus of the present invention will be described with reference to the drawings. The following description is for a case where DVD playback is performed with the up-conversion process enabled.

FIG. 5 is a flowchart showing the flow of playback processing when a DVD is played back by the information processing apparatus according to the embodiment of the present invention.

First, when the operating system (OS) of the information processing apparatus 1 is activated, the user operates the keyboard 14 and the touch pad 16 to activate the DVD application program (S1).

Subsequently, the DVD 18 on which video content such as a movie is recorded is set in the DVD drive 17 of the information processing apparatus 1, and the up-conversion processing is enabled while viewing the screen display of the DVD application program displayed on the LCD 13 of the display unit 12. (S2
).

The CPU 101 causes the compressed stream data reproduced by the DVD drive 17 to be transferred to the main memory 103 via the PCI bus 130, the south bridge 104, the DMI bus 131, the north bridge 102, and the data bus 132 (S3).

The compressed stream data transferred to the main memory 103 is decrypted by a DVD application program loaded in the main memory 103 and then compressed into video data compressed by the navigation filter 200 and compressed sub-picture data. Separated and output to the video decoder 201, respectively.

The compressed video data is transmitted to the multimedia processor control unit 203 of the video decoder 201. This compressed video data is read from the main memory 103 in synchronism with the DVD playback operation, and the data bus 132, the north bridge 102, and the DMI bus 13 are read out.
1, the data is transferred to the multimedia processor 112 via the south bridge 104 and the PCI Express bus 135 (S4).

The multimedia processor 112 decodes the compressed video data by the decoder 112A into baseband video data, and converts the video data into the upconverter 11.
Up-convert to 2B high resolution HD image quality data (S5).

The up-converted high-resolution HD image quality data is stored in the DVD application program loaded in the main memory 103 via the PCI Express bus 135, the south bridge 104, the DMI bus 131, the north bridge 102, and the data bus 132. The data is transferred again to the media processor control unit 203. (S6)

The DVD application program uses the up-converted video data as G
Transfer to PU 105. The GPU 105 transfers the video data to the VRAM 105A (
S7).

Further, the DVD application program transfers the sub picture data to the CPU 101 (S8).

The CPU 101 up-converts the sub-picture data and transfers the up-converted sub-picture data to the GPU 105 (S9).

The GPU 105 transfers the transferred sub-picture data to the VRAM 105A. GP
The U 105 synthesizes video data and sub-picture data of HD image quality data temporarily stored in the VRAM 105 A by the mixer 205 and renders a renderer 206 as a drawing unit.
(S10).

The renderer 206 draws video data obtained by combining the video data and the sub-picture data and outputs the video data to the display driver. The display driver drives the LCD 13 to display the video data on the screen (S11).

(Effect of the embodiment of the present invention)
According to the embodiment of the present invention described above, conversion processing such as decoding and up-conversion of video data is performed by the multimedia processor 112 connected through a high-speed transmission path such as a PCI Express bus, and the converted video data is converted into video data. Since the data is transferred to the subsequent processing circuit via a high-speed transmission path, decoding processing and up-conversion processing to HD image quality data that requires a large amount of calculation and processing time can be efficiently performed separately from the sub-picture data. As a result, even when a high-definition video of the HD standard is played back while playing a DVD, high-speed and stable data conversion processing having real-time characteristics can be performed without interrupting the playback operation.

In particular, baseband data has a larger amount of information than encoded bitstream signal format data, especially if it is an HD standard video that is a high-quality video. When the up-conversion processing of the video data data and the sub-picture data is performed by the multimedia processor 112 and the synthesis thereof is performed by the CPU 101 or the GPU 105,
Since the HD-quality baseband data flows on the bus as two streams, it can squeeze the bandwidth and cause playback delay. Therefore, in the present embodiment, sub-picture data is up-converted on the CPU 101 or GPU 105 (by the up-converter 204), and HD image quality baseband data flowing on the bus is video data up-converted by the multimedia processor 112. Only to. As a result, the amount of information flowing on the bus can be suppressed, thereby ensuring real-time performance.

In this embodiment, the multimedia processor 112 performs not only up-conversion processing but also decoding processing. As a result, the decoding process is performed by the CPU 101 or G.
Compared with the case where only the up-conversion processing is performed by the PU 105 and the multimedia processor 112, the amount of information flowing on the bus 131 can be suppressed, and thereby real-time performance can be ensured.

Furthermore, since the screen display of subtitles and the like displayed as subpictures frequently occurs during playback, switching between ON / OFF and display switching between Japanese subtitles and other language subtitles is performed by the multimedia processor 112. By decoding with CPU101 or GPU105 rather than doing,
It is possible to flexibly respond to user needs.

Also, when converting video data to high-definition HD image quality data, the information processing load of the conversion processing unit increases dramatically. However, in the information processing apparatus 1 of the above-described embodiment, the sub-picture conversion processing is a multi-process. Since the processing is not performed by the media processor 112, the multimedia processor 112 can be used by specifying a higher resolution.
In addition to ensuring real-time performance in synchronization with video playback based on playback, it is possible to select an algorithm with a larger amount of calculation for high resolution processing.

[Other embodiments]
The present invention is not limited to the above-described embodiment, and various modifications can be made without departing from or changing the technical idea of the present invention.

The invention described in the scope of claims at the time of the patent assessment of the original application of the present application will be appended below.
[1] A first processor for performing reproduction control of stream data in which first encoded data and second encoded data are multiplexed, and a second processor connected to the first processor via a bus A processor for separating the first encoded data and the second encoded data from the stream data, and data obtained by decoding the first encoded data on the second processor The first conversion processing means for generating the first image data by increasing the resolution with the above, and the resolution of the decoded data of the second encoded data on the hardware different from the second processor A second conversion processing unit that generates second image data; and a drawing unit that outputs an image obtained by combining the first image data and the second image data to a display device. To the information processing apparatus.
[2] The information processing apparatus according to [1], wherein the second conversion processing unit and the drawing unit are mounted on a graphics processing unit.
[3] The information processing apparatus according to [1], wherein the second processor includes a decoder that decodes the first encoded data.
[4] A separation step of separating the first encoded data and the second encoded data from the stream data obtained by multiplexing the first encoded data and the second encoded data, and main control A first conversion processing step for generating first image data by increasing the resolution of data obtained by decoding the first encoded data on a processor connected to the processor via a bus, and hardware different from the processor A second conversion processing step for generating second image data by increasing the resolution of the data obtained by decoding the second encoded data on the wear, the first image data, the second image data, And a drawing step of outputting a combined image to a display device.
[5] The video reproduction method according to [4], wherein the second conversion processing step and the drawing step are executed in a graphics processing unit.
[6] The video reproduction method according to [4], wherein in the first conversion processing step, the first encoded data is decoded on the processor.

DESCRIPTION OF SYMBOLS 1 ... Information processing apparatus, 11 ... Computer main body, 12 ... Display unit, 14 ... Keyboard, 15 ... Power switch, 16 ... Touch pad, 17 ... DVD drive, 18 ... DV
D, 19 ... Speaker, 102 ... North bridge, 103 ... Main memory, 104 ... South bridge, 106 ... Sound controller, 110 ... LAN controller, 112 ... Multimedia processor, 112A ... Decoder, 112B ... Upconverter, 113 ... Card controller 114 ... Wireless LAN controller 115 ... IEEE 1394 controller 117 ... TV tuner 118 ... Remote control unit interface 119 ... TV
Terminal 121, HDMI control circuit 122, HDMI terminal 123, HDMI monitor, 1
30 ... PCI bus, 131 ... DMI bus, 132 ... data bus, 133 ... FSB, 134
... Data bus, 135 ... PCI Express bus, 200 ... Navigation filter, 201 ...
Video decoder 202 ... Sub-picture decoder 203 ... Multimedia processor control unit 204 ... Up converter 205 ... Mixer 206 ... Renderer

Claims (4)

A first processor that performs reproduction control of stream data in which first encoded data and second encoded data are multiplexed;
A second processor connected to the first processor via a bus;
Separating means for separating the first encoded data and the second encoded data from the stream data;
First conversion processing means for generating first image data by increasing the resolution of the first encoded data on the second processor;
A second conversion processing unit for generating second image data by increasing the resolution of the second encoded data on hardware different from that of the second processor;
Rendering means for outputting an image obtained by combining the first image data and the second image data to a display device;
An information processing apparatus comprising:   The information processing apparatus according to claim 1, wherein the second conversion processing unit and the drawing unit are mounted on a graphics processing unit. A separation step of separating the first encoded data and the second encoded data from stream data obtained by multiplexing the first encoded data and the second encoded data;
A first conversion processing step of generating first image data by increasing the resolution of the first encoded data on a processor connected to the main control unit via a bus;
A second conversion processing step of generating second image data by increasing the resolution of the second encoded data on hardware different from the processor;
A video reproduction method comprising: a drawing step of outputting an image obtained by synthesizing the first image data and the second image data to a display device. Computer
Separating means for separating the first encoded data and the second encoded data from the stream data obtained by multiplexing the first encoded data and the second encoded data;
First conversion processing means for generating first image data by increasing the resolution of the first encoded data on a processor connected to the main control unit via a bus;
Second conversion processing means for generating second image data by increasing the resolution of the second encoded data on hardware different from the processor;
A video reproduction program for causing an image obtained by combining the first image data and the second image data to function as a drawing unit that outputs the image to a display device.

Images