JP2012004890A - Video signal output device, and video signal output method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To settle the issue of effective application of a high picture quality treatment in a video signal output device because an effect differs depending on kind and situation of video contents, and to settle the issue of reducing power consumption of the video signal output device because the power consumption increases when the high picture quality treatment is applied.SOLUTION: A scene detecting means is provided which receives a video signal related to a video content and detects the scene of the video contents. Further, a filtering means is provided which executes a first filtering process on the video signal related to the received video content if the detected scene is a first scene, and executes a second filtering process applying a more process amount than the first filtering process if the detected scene is a second scene which requires the picture quality higher than the first scene, depending on the scene that has been detected. Further, an output means is provided which outputs a video signal related to the filtered video content.

Description

  Embodiments described herein relate generally to a video signal output device that performs video processing on recorded video content and outputs the processed video content.

In recent years, video content playback apparatuses that play back recorded video content have become widespread.
In these video content playback apparatuses, video processing is performed on the video signal related to the recorded video content, and a playback image is output.
As an example of the video processing, there is a high quality processing for improving the quality of a playback image output from the video content playback device.
However, since the effect of the high image quality processing varies depending on the type and situation of the video content, effective application has been desired in the video signal output apparatus.
In addition, it is known that the power consumption is increased by performing the image quality enhancement processing, and it has been desired to reduce the power consumption of the video output device.

JP 2007-27956 A

Since the effect of high image quality processing varies depending on the type and situation of the video content, effective application has been a problem in video signal output devices.
In addition, it is known that the power consumption is increased by performing the image quality enhancement process, and it has been a problem to reduce the power consumption of the video output device.

A scene detection unit is provided for receiving a video signal related to the video content and detecting a scene of the video content.
Further, according to the detected scene, when the detected scene is the first scene, a first filtering process is performed on the video signal related to the received video content so that the image quality higher than that of the first scene is obtained. In the case of the required second scene, a filtering unit is provided that performs a second filtering process having a larger processing amount than the first filtering process.

  The image processing apparatus further includes output means for outputting a video signal related to the filtered video content.

The block diagram which shows the structure of the video signal output device concerning embodiment. 1 is a block diagram mainly showing the configuration of a video processing unit in a video signal output apparatus according to an embodiment. 6 is a flowchart for explaining the operation of the video signal output apparatus according to the embodiment. 6 is a flowchart for explaining an operation of filtering processing in the video signal output apparatus according to the embodiment. The figure which shows an example of the correspondence of a scene and a filter in the video signal output device concerning embodiment.

Hereinafter, embodiments will be described with reference to the drawings.
FIG. 1 is a block diagram illustrating a configuration of a video signal output apparatus according to the embodiment.
Reference numeral 1 is a video output device (digital broadcast receiver), reference numeral 2 is an antenna, reference numeral 3 is a tuner, reference numeral 4 is a signal processing unit, reference numeral 5 is a video processing unit, reference numeral 6 is an audio processing unit, reference numeral 7 is a display device, Reference numeral 8 denotes a screen, and reference numeral 9 denotes a speaker.

  Reference numeral 10 denotes a bus, reference numeral 11 denotes a control unit, reference numeral 12 denotes an MPU, reference numeral 13 denotes a RAM, reference numeral 14 denotes a ROM, reference numeral 15 denotes a flash memory, reference numeral 16a denotes a storage unit, and reference numeral 16b denotes a set value holding unit.

  Reference numeral 17 denotes an internal recording device. For example, it is configured by a built-in HDD (hard disk device), a built-in SSD (Solid State Disk: a recording device using a flash memory which is a semiconductor storage element), or the like.

  Reference numeral 18 denotes an external interface, and reference numeral 19 denotes an external recording apparatus connected to the outside via the external interface 18. The external recording device 18 is also composed of the HDD, SSD, or the like.

  Reference numeral 20 is an operation receiving unit, reference numeral 21 is an operating device, reference numeral 21 is a transmission / reception unit, reference numeral 22 is a transmission / reception unit, reference numeral 23 is a power consumption comparison unit, reference numeral 24 is a GUI control unit, reference numeral 25 is a broadcasting station, reference numeral 26 is a network. Reference numeral 27 denotes a server.

The video output device 1 can perform recording on each of the internal recording device 17 and the external recording device 18.
Here, for example, filtering processing is performed on the video content recorded in the external recording device 19 and output as a video signal.
Although not particularly shown, the tuner 3 includes a plurality of tuners and is configured to receive a plurality of channels.
Further, the internal recording device 17 includes HDDs for time shift and normal recording, and the time shift HDD temporarily stores, for example, a maximum of 8 channels of programs for the past about 26 hours, that is, 26 hours and 8 channels. Can be “rounded”.

The video processing unit 5 receives a video signal related to the video content output from the signal processing unit 4 and detects a scene of the video content as will be described later.
Further, as shown in FIG. 5 to be described later, when the detected scene is scene 1 according to the detected scene, the first filtering process is performed on the video signal related to the received video content. Performs the second filtering process.

When the detected scene is scene 3, the third filtering process is performed on the video signal related to the received video content.
Then, a video signal related to the video content subjected to the first to third filtering processes is output.
FIG. 2 is a block diagram mainly showing the configuration of the video processing unit in the video signal output apparatus according to the embodiment.
Here, for example, the video signal output device 1 receives a broadcast program transmitted from the broadcast station 25 in the MPEG2 format, and transcodes it into the H.264 format (MPEG-4 AVC format) (high efficiency encoding process). Then, the image is recorded in the external recording device 19.

Alternatively, the received broadcast program can be recorded in the format transmitted from the broadcast station 25.
That is, video content is recorded on the external recording device 19 in the form of a video signal (video data). The video signal is subjected to high-efficiency encoding processing such as MPEG2 and H.264.

  Then, the video content recorded in the external recording device 19 is output to the video processing unit 5, the image processing unit 5 performs a filtering process for improving the image quality, and outputs the video content to the video display device 7 as a video signal. Is done.

  Reference numeral 51 denotes a decoding processing section, reference numeral 52 denotes a scene detection section, reference numeral 53 denotes a high quality filter selection section, reference numeral 54 denotes a combination of high quality filters, reference numeral 55 denotes an image quality improvement section, and reference numeral 56 denotes an image output section.

In the external recording device 19, video content is recorded as described above.
Video content in the form of a video signal in the H.264 format output from the external recording device 19 is received by the decoding processing unit 51. The decoding processing unit 51 performs decoding processing of the received video content in H.264 format. The decoded video content in the form of a video signal is output toward the scene detection unit 52.

  The scene detection unit 52 receives video content in the form of a decoded video signal. For example, the scene detection unit 52 detects the scene of the received video content in real time, and outputs the detection result to the high-quality filter selection unit 53.

  As shown in FIG. 2, the high image quality filter selection unit 53 selects and determines a filtering process corresponding to the detection result of the scene detected by the scene detection unit 52 from the high image quality filter combination 54.

  Here, the deblocking filter is a technique that smoothes the block boundary of integer conversion and suppresses the generation of block noise. The deblocking filter can be expected to improve the compression ratio, but has a problem that the processing amount is large.

  Frame interpolation increases the number of frames displayed per unit time by estimating the motion of an object in the screen and creating an intermediate image corresponding to the motion. This is a technique for improving blurring and unnatural movement of an object.

  Super-resolution is one of digital image processing technologies, and is a technology for generating output signals by increasing the resolution of input signals such as moving images and still images. In general, the super-resolution processing is effective for an image with a small pixel value, but is a filter processing that is less effective as the pixel value increases.

Here, the filter 1 is a case where a scene 1, that is, a CM is detected as a scene of the video content.
A first filtering process corresponding to this, that is, a filtering process for turning off three filterings of a deblocking (noise reduction) filter, frame interpolation, and super-resolution.

  In this filter 1, when CM is detected as a content scene, the three types of filtering, deblocking (noise reduction) filter, frame interpolation, and super-resolution, are turned off, and the power consumption is reduced compared to the image quality improvement processing. To give priority.

The filter 2 is a case where a scene 2, that is, a normal main part without highlight is detected as a scene of the video content.
A second filtering process corresponding to this, that is, a filtering process for turning on two filterings of a deblocking (noise reduction) filter and frame interpolation and turning off super-resolution filtering.

  In this filter 2, when a normal main part without highlight is detected as a content scene, two filterings of a deblocking (noise reduction) filter and a frame interpolation are turned on, and a certain level of image quality improvement processing is performed. By turning off super-resolution filtering, which consumes relatively high power, the power consumption is reduced to some extent.

The filter 3 is a case where a scene 3, that is, a highlighted main part is detected as a scene of video content.
Then, a third filtering process corresponding to this, that is, a filtering process for turning on all three filterings of a deblocking (noise reduction) filter, frame interpolation, and super-resolution.

  In this filter 3, when a main part with a highlight is detected as a content scene, all three filterings of a deblocking (noise reduction) filter, frame interpolation, and super-resolution are turned on, and processing with higher image quality is performed. I do.

The image quality improving unit 55 performs the image quality improving filtering process selected from the filters 1 to 3 as described above on the decoded video signal.
The image output unit 56 outputs the video signal (video content) subjected to the high image quality filtering process to the video output device 7.
FIG. 3 is a flowchart for explaining the operation of the video signal output apparatus according to the embodiment.
Reference sign S100 is a start step here. Then, it progresses to the step which attached code | symbol S101.
Reference numeral S <b> 101 is a step of receiving video content (video signal) output from the external recording device 19. Subsequently, the process proceeds to the step denoted by reference numeral S102.
Reference numeral S <b> 102 is a step of detecting a scene of the video content decoded by the decoding processing unit 51.
The scene detection of the video content can be detected using, for example, bit rate information or image size information in the video stream of the video content (video signal). For example, when the main part of a program is transmitted with an image size of 16: 9, the CM may detect the difference in the image size by using the fact that the image size may be transmitted with a 4: 3 size. It is possible to detect.

  In addition, the highlight scene of the main part of the program is expected to have a larger amount of information (that is, the bit rate is higher) than the normal scene of the main part of the program. It is possible to detect a normal scene of the main program and a highlight scene of the main program.

  Further, the detection using the image size and the detection using the bit rate can be appropriately combined to detect the CM, the main program normal scene, and the main program highlight scene.

Alternatively, the scene can be detected by detecting the statistic of the luminance distribution of the video signal input to the scene detection unit 52 and detecting the transition direction of the brightness of the scene.
Alternatively, a broadcast transmitted from a broadcast station is sent with a flag that distinguishes CM, a normal program main scene, and a main program highlight scene, and these flags are detected on the receiving side to detect each scene. It is also possible to do.

  Then, as will be described later, when each broadcast scene is detected (that is, when the broadcast scene changes), the filter is switched according to the detected scene, and the filtering process is performed.

Then, it progresses to the step which attached | subjected code | symbol S103.
The code | symbol S103 is a step which selects a filtering process (combination of an image filter) as mentioned above. Then, it progresses to the step which attached | subjected code | symbol S104.
Reference numeral S <b> 104 is a step of performing an image quality enhancement filter process. FIG. 3B shows an example of image quality enhancement filter processing. The filtering process selected as described above is executed. Here, any one of the image quality enhancement filtering processes of the filtering processes 1 to n is executed. Subsequently, the process proceeds to the step denoted by reference numeral S105.

  Reference numeral S <b> 105 is a step of outputting the video content subjected to the image quality enhancement filtering process to the video display device 7. Then, it progresses to the step which attached | subjected code | symbol S106.

  Reference numeral S <b> 106 is a step of receiving a video signal related to the video content subjected to the image quality enhancement filtering process and displaying the video content on the video display device 7. Then, it progresses to the step which attached | subjected code | symbol S107.

Reference S107 is an end step, and the process ends here.
FIG. 4 is a flowchart for explaining an operation of the filtering process in the video signal output apparatus according to the embodiment.
Reference numeral S200 is a start step here. Subsequently, the process proceeds to the step denoted by reference numeral 101 (S101 is the same as FIG. 3).
Reference S101 is a step of receiving video content as described above. Then, it progresses to the step which attached | subjected code | symbol S102 (S102 is the same as FIG. 3).
Reference S202 is a step of detecting a scene of the video content. Then, it progresses to the step which attached | subjected code | symbol S203.
Reference numeral S203 is a step of determining whether the detected scene of the video content is the first scene. When it is determined that the detected scene of the video content is the first scene, the process proceeds to the step denoted by reference numeral S204 (Yes). If it is not determined that the detected scene of the video content is the first scene, the process proceeds to the step denoted by reference numeral S205 (No).

Reference S204 is a step of performing the first filtering process. Subsequently, the process proceeds to the step denoted by reference numeral S105.
Reference numeral S205 is a step of determining whether the detected scene of the video content is the second scene. When it is determined that the detected scene of the video content is the second scene, the process proceeds to the step denoted by reference numeral S206 (Yes). When it is not determined that the detected scene of the video content is the second scene, the process proceeds to the step denoted by reference numeral S207 (No).

Reference S206 is a step of performing the second filtering process. Subsequently, the process proceeds to the step denoted by reference numeral S105.
Reference S207 is a step of determining whether the detected scene of the video content is the third scene. If it is determined that the detected scene of the video content is the third scene, the process proceeds to the step denoted by reference numeral S208 (Yes). When it is not determined that the detected scene of the video content is the third scene, the process proceeds to the step denoted by reference numeral S202, and the above process is repeated (No).

Reference S208 is a step of performing the second filtering process. Subsequently, the process proceeds to the step denoted by reference numeral S105.
Reference numeral S105 is a step of outputting the video content filtered as described above (S105 is the same as FIG. 3). Subsequently, the process proceeds to the step denoted by reference numeral S106.

  Reference numeral S106 is a step of displaying the output video content on the video display device 7 (S106 is the same as FIG. 3). Then, it progresses to the step which attached | subjected code | symbol S211.

Reference S211 is an end step, and the process here ends.
That is, in this embodiment, when a broadcast scene is detected, the filter is switched according to the detected scene, and the switched filtering process is performed.
For example, when the detected scene is the first scene (for example, CM), the first filtering process shown in FIG. 5 is performed. Further, when the detected scene is the second scene (for example, the normal scene of the main part of the program), the second filtering process is performed. If the detected scene is the third scene (for example, the highlight scene of the main part of the program), the third filtering process is performed.

FIG. 5 is a diagram illustrating an example of correspondence between scenes and filters in the video signal output apparatus according to the embodiment.
As shown in the figure, here, as the types of video content scenes, scene 1 is CM (commercial), scene 2 is a normal content main scene, and scene 3 is a content main content highlight scene. Furthermore, a scene not exemplified here can be defined and applied in the same manner as described above.

  If scene 1 (CM) is detected as the scene type of the video content, the first filtering process (deblocking (noise reduction) filter OFF, frame interpolation OFF, super-resolution OFF) is executed. At this time, when the first filtering process is performed, the image quality is normal and the processing amount is normal.

In this case, priority is given to reducing the power consumption over the high image quality processing.
If scene 2 (normal main part without highlight) is detected as the type of scene of the video content, the second filtering process (deblocking (noise reduction) filter ON, frame interpolation ON, super-resolution OFF) Is executed. At this time, when the second filtering process is performed, the image quality is high, but the processing amount is larger than that of the first filtering process. As the processing amount increases, the power consumption also increases.

In this case, a certain level of high image quality processing and a certain amount of power consumption reduction are compatible.
In addition, when the scene type of the video content (main part with highlight) is detected, the third filtering process (deblocking (noise reduction) filter ON, frame interpolation ON, super-resolution ON) is executed. . At this time, when the third filtering process is performed, the image quality becomes super high image quality, but the processing amount becomes larger than those of the first filtering process and the second filtering process. As the processing amount further increases, the power consumption increases accordingly.

In this case, processing for achieving a super high image quality is performed.
By configuring as described above, in the embodiment of the present invention, it is possible to effectively apply the image quality improvement processing in the video signal output device.
In addition, it is possible to reduce the power consumption of the video output device that performs the high image quality processing.
Note that the above embodiment is not limited to the description itself, and in the implementation stage, the constituent elements can be variously modified and embodied without departing from the spirit of the invention.

  DESCRIPTION OF SYMBOLS 1 ... Video output device (digital broadcast receiver), 5 ... Video processing part, 7 ... Video display device, 19 ... External recording device, 51 ... Decoding processing part, 52 ... Scene detection part, 53 ... High quality filter selection part, 54 ... a plurality of filters, 55 ... an image quality improving unit, 56 ... an image output unit.

Claims (6)

A scene detection means for receiving a video signal related to the video content and detecting a scene of the video content;
If the detected scene is the first scene according to the detected scene, a first filtering process is performed on the video signal related to the received video content, and higher image quality than that of the first scene is required. Filtering means for performing a second filtering process having a larger processing amount than the first filtering process,
A video signal output device comprising output means for outputting a video signal related to the filtered video content.   In the case of a third scene that requires higher image quality than the first and second scenes, the filtering means further performs a third filtering process having a larger processing amount than the first and second filtering processes. The video signal output device according to claim 1 to be performed. It further comprises recording means for recording a video signal related to the video content,
The video signal output apparatus according to claim 1, wherein the video signal output unit receives a video signal related to the video content recorded in the recording unit. It further comprises display means for displaying video,
4. The video signal output device according to claim 1, wherein a video signal related to the filtered video content is received and displayed on the display unit. 5.   The video signal output apparatus according to claim 1, wherein the third filtering process includes a super-resolution process. Receiving a video signal related to the video content and detecting a scene of the video content;
If the detected scene is the first scene according to the detected scene, a first filtering process is performed on the video signal related to the received video content, and higher image quality than that of the first scene is required. A second filtering process having a larger processing amount than the first filtering process,
A video signal output method comprising a step of outputting a video signal related to the filtered video content.

Images