JP5159493B2 - Image processing device - Google Patents

Description

  The present invention relates to an image processing apparatus, and more particularly, to motion blur correction processing of a moving image signal.

Conventionally, a device for displaying a moving image is known.
As this type of device, for example, a television receiver (hereinafter referred to as a television) is known. A television generally has a function of inputting and displaying a moving image signal supplied from an external device such as a video camera in addition to a television program received by a tuner.

  In a video camera, a user often takes a picture while holding the camera at the time of shooting, and screen shots due to camera shake often occur in the shot moving images.

  Therefore, when a moving image including such a screen blur is reproduced by a video camera and displayed on a television, a moving image including the screen blur is displayed.

  Therefore, conventionally, many techniques for preventing camera shake that occurs when an image is taken with a video camera have been proposed.

In addition, a technique for correcting camera shake at the time of playback of a moving image shot with a video camera that does not have a camera shake correction function during shooting has been proposed (see, for example, Patent Document 1).
Japanese Patent Laid-Open No. 10-42233

  In recent years, the large screen of televisions and the increase in the number of pixels have progressed, and it is likely that moving images shot with a video camera as described above are often displayed on such a large screen and viewed on a high-definition television.

  However, in Patent Document 1, no blur correction is performed in consideration of the number of pixels of a display device that displays a moving image.

  Therefore, when moving images are displayed on a large-screen, high-definition display device, there is a risk that the image will remain displayed with the screen blur remaining if only the blur correction is performed as in the case of displaying on a display device with a low resolution. there were.

  An object of the present invention is to solve such a problem and to appropriately correct blurring of a moving image so that a good image can be displayed.

  An input unit that inputs a moving image signal, a blur correction unit that corrects blurring of an image indicated by the moving image signal input by the input unit, and a moving image signal output from the blur correction unit is output to a display device. Output means, and control means for controlling correction processing by the blur correction means based on the number of pixels of the moving image signal input by the input means and the number of pixels of the display device.

  According to the present invention, it is possible to appropriately correct blurring of an input moving image signal.

  Embodiments of the present invention will be described below.

  FIG. 1 is a diagram showing a configuration of a display device 100 to which the present invention is applied. The display device 100 in FIG. 1 inputs and displays a moving image signal output from an external device such as a video camera.

  In FIG. 1, an input unit 101 inputs a moving image signal output from an external device via a transmission path shown in the figure. In the present embodiment, the input unit 101 inputs a moving image signal and its additional information as a digital signal.

  The input unit 101 outputs the input moving image signal to the screen blur correction unit 102 and the pixel number detection unit 106. The screen blur correction unit 102 corrects the screen blur of the moving image signal input in accordance with the correction accuracy control signal from the control unit 107 as described below, and outputs the corrected image to the conversion unit 103. The conversion unit 103 converts the number of pixels (resolution) of each screen of the moving image signal output from the screen blur correction unit 102 according to the number of pixels (resolution) of the display unit 105 and outputs the converted signal to the display control unit 104.

  The display control unit 104 multiplexes various types of information with the moving image signal output from the conversion unit 103 and displays the information on the display unit 105 in accordance with an instruction from the control unit 107. The display unit 105 includes a liquid crystal panel and its driver.

  In addition, the pixel number detection unit 106 detects the number of pixels of the input moving image signal or the resolution (the number of pixels per unit size) based on the additional information added to the input moving image signal. The detection result is output to the control unit 107.

  In accordance with an instruction from the user I / F 108, the control unit 107 controls each unit so that various types of information and the input moving image signal are displayed on the display unit 105. In addition, the control unit 107 compares the number of pixels of the input moving image signal detected by the pixel number detection unit 106 with the number of pixels of the display unit 105, and controls correction processing by the screen blur correction unit 102 according to the comparison result. To do. Further, the control unit 107 controls resolution conversion processing (conversion magnification) by the conversion unit 103 according to the comparison result. Note that the control unit 107 has a memory, and compares the information on the number of pixels of the display unit 105 stored in the memory with the number of pixels of the input moving image signal.

  The user interface (I / F) 108 includes a remote controller, its receiver, various operation buttons, and the like.

Next, the screen blur correction unit 102 will be described.
FIG. 2 is a block diagram illustrating a configuration of the screen blur correction unit 102.

  In FIG. 2, an input moving image signal s200 is output to the screen blur detection unit 201, the memory 202, and the selection unit 205.

  The screen blur detection unit 301 has a memory and detects screen blur information indicating the blur amount and blur direction of an image between two consecutive frames, and outputs the detected information to the correction reading unit 203 for each frame. Further, the screen blur detection unit 201 changes the screen blur detection accuracy and the correction range in accordance with the correction accuracy control signal from the control unit 107.

  The memory 202 can store image signals of at least two frames, and stores the input image signal s200 in a region other than the storage region of the image signal being read by the correction reading unit 203.

  The correction reading unit 203 selects and reads out a part of the image signal from one frame of image signal stored in the memory 202 according to the screen blur information from the screen blur detection unit 201, and outputs it to the enlargement processing unit 204. To do. At this time, the correction reading unit 203 changes the reading range so as to eliminate screen blur based on the screen blur information detected by the screen blur detection unit 201. In addition, the correction reading unit 203 changes the size of the read range (cutout frame) according to the correction range (correction amount) based on the correction accuracy setting signal.

  The enlargement processing unit 204 changes the size of the image signal of each screen selected and read by the correction reading unit 203 and outputs the changed image signal. Specifically, based on the correction accuracy setting signal, the size of the image signal from the correction reading unit 203 is enlarged to the same size as the input image signal s200, and the corrected image signal s204 is output to the selection unit 205. Note that the enlargement processing by the enlargement processing unit 204 and the interpolation processing at the time of enlargement use known methods.

  The selection unit 205 selects and outputs one of the input image signal s200 and the corrected image signal s204 from the enlargement processing unit 204 based on the shake correction control signal from the control unit 107. Specifically, when a control signal indicating blur correction execution is received from the control unit 107, the corrected image signal s204 is selected. When a control signal indicating blur correction prohibition is received, the control signal is input. The image signal s200 is selected and output.

  In this way, when the blur correction is not executed, the input image signal is output as it is, so that there is no image degradation due to the enlargement process during the blur correction.

  Next, the screen blur detection unit 201 will be described.

FIG. 3 is a block diagram illustrating a configuration of the screen blur detection unit 201.
In FIG. 3, the input moving image signal is input to the memory 307. The memory 307 can store the input moving image signal for at least two frames.

  Further, the correction accuracy setting signal output from the control unit 107 is input to the accuracy setting unit 306 and the range setting unit 307. The accuracy setting unit 306 sets the pixel sample accuracy in the pixel sample unit 302 according to the sample accuracy indicated by the correction accuracy setting signal. The pixel sample unit 302 sequentially reads the moving image signals stored in the memory 301, samples the read moving image signals according to the pixel sample accuracy set by the accuracy setting unit 306, and outputs the sampled moving image signals to the pixel shifting unit 303.

  The range setting unit 307 sets the shake correction range according to the correction range indicated by the correction accuracy setting signal. The pixel shifting unit 303 shifts the image signal output from the pixel sample unit 302 according to the set correction range. The correlation evaluation unit 304 compares the image signal from the pixel shift unit 303 with the image signal of the previous frame read from the memory 301, and evaluates the correlation.

  Then, the singularity detection unit 305 detects an inflection point between the shifted pixel value and the correlation evaluation value, and outputs it as screen blur information.

  Here, the state of screen blur correction will be described with reference to FIG.

  In FIG. 4A, 401 indicates the state of the input image signal of one frame. Then, the image signal in the region indicated by the cutout frame 402 having a size corresponding to the correction range is read out by the correction reading unit 203 from such an image signal 401. Further, 403 is an image enlarged by the enlargement processing unit 204 to the same size as the input image signal. Here, the correction ranges set by the correction accuracy setting signal are ΔXmax and ΔYmax shown in FIG.

  That is, the larger the correction range, the smaller the size of the cutout frame 402. Therefore, when the correction range is increased, the subsequent enlargement ratio is also increased, and the image quality is greatly deteriorated by interpolation.

  FIG. 4B shows the state of the image signal 404 of the next frame after the frame 401.

In the frame 404, the solid line is the image of the frame 404, and the dotted line is the image of the previous frame 401. As shown in the figure, the current frame 404 has a screen blur 406 in the downward direction compared to the previous frame 401.
The screen blur detection unit 201 calculates the screen blur amount and direction.

  As a specific calculation method, for example, the current frame is shifted by a predetermined amount of pixels to obtain a correlation with the previous frame, and when the correlation is the largest value, the pixel shift amount is set as the amount of screen blur.

  In the case of a moving image, since the movement of the subject affects the correlation of the entire screen, it is possible to calculate a highly reliable screen blur amount by calculating without the influence of the moving subject.

  The image 407 is the image 407 enlarged by the enlargement processing unit 204 after the image signal is read out by the correction reading unit 203 by setting the same position 405 as that of the previous frame as the clipping frame without considering the screen blur amount generated in this way. . In 407, the screen blur amount 406 is also enlarged to a blur amount 408.

  That is, the screen blur amount is enlarged as it is, and the screen blur amount cannot be corrected.

  Accordingly, a description will be given of the setting process of the cutout frame in consideration of the generated screen blur amount.

  In this case, as shown in FIG. 4C, the cutout frame is moved by the same direction and the same amount (Δy) as the screen blur 406 with respect to the image signal of the frame 404 in which the screen blur 406 is generated. That is, the clipping frame 409 is moved by 410 compared to the clipping frame 405. Then, when the image signal of the area of the cutout frame 409 is read from the memory 302 and enlarged by the enlargement processing unit 304, a moving image in which the amount of screen blur of the previous frame is corrected is generated as indicated by 411. Through the above operation, the amount of screen blur is corrected.

  Next, blur correction processing control according to the present embodiment will be described with reference to the flowchart of FIG. The processing in FIG. 5 is executed by the control unit 107.

  The flow in FIG. 5 starts when the user I / F 209 instructs to turn on the power and the moving image signal input to the input unit 101 is changed.

First, the number of pixels of the input moving image signal detected by the pixel number detection unit 106 is compared with the number of pixels of the display unit 105, and the following calculation is performed to calculate the ratio α (S501).
α = number of pixels of input moving image signal / number of pixels of display unit (Formula 1)
Next, it is determined whether or not α is 2 or less (S502). When α> 2, the number of pixels of the display unit 105 is sufficiently smaller than the number of pixels of the input moving image signal. That is, it is determined that the display unit 105 does not have sufficient resolution to display the input moving image, and a control signal indicating prohibition of screen blur correction is output to the screen blur correction unit 102 (S511).

  If α ≦ 2 in S502, a control signal indicating execution of blur correction is output to the screen blur correction unit 102 (S503).

  Then, it is determined whether or not α ≦ 1 (S504). In the case of α> 1, that is, when the number of pixels of the input moving image signal is up to about twice the number of pixels of the display unit 105, the sampling pixel period related to the screen blur detection is set in units of two pixels. In addition, the correction range of the screen blur detection is set to 5% which is weak, and a correction accuracy setting signal is output to the screen blur correction unit 102 (S508).

  If α ≦ 1 in S504, it is determined whether α ≦ 1/2 or not (S505). When α> 1/2, that is, when the number of pixels of the display unit 105 is larger than the number of pixels of the input moving image signal and there is not much difference between them, the sampling pixel period related to screen blur detection is set to one pixel unit. . Then, the correction range for screen blur detection is set to a medium 10%, and a correction accuracy setting signal is output to the screen blur correction unit 102 (S509).

  If α ≦ 1/2 in S505, it is determined whether α ≦ 1/4 (S506). When α> ¼, that is, when the number of pixels of the display unit 105 is larger than the number of pixels of the input moving image signal and the difference between the two is slightly large, the sampling pixel period related to screen blur detection is set to 1/2 pixel unit. And Then, the correction range for screen blur detection is set to 20%, which is slightly stronger, and a correction accuracy setting signal is output to the screen blur correction unit 102 (S510). When the cycle of the sampling pixel is set to ½, the pixel sample unit 302 generates a sample pixel by calculating an average value of two adjacent pixels.

  Finally, if α ≦ 1/4 in S506, that is, if the number of pixels of the display unit 105 is larger than the number of pixels of the input moving image signal and the difference between them is considerably large, the sampling pixel period related to screen blur detection is set. The unit is 1/4 pixel. Then, the screen blur detection correction range is set to a strong 40%, and a correction accuracy setting signal is output to the screen blur correction unit 102 (S507). When the sampling pixel period is set to 1/4, the pixel sample unit 302 generates a sample pixel by calculating a value obtained by weighting and adding two adjacent pixels according to the pixel position after sampling. To do.

  As described above, in this embodiment, it is determined whether or not to correct the screen blur according to the comparison result between the number of pixels of the input moving image signal and the number of display pixels. Also, the degree of screen blur correction is controlled.

  Specifically, as the number of display pixels is larger than the number of pixels of the input moving image signal, the screen blur correction accuracy is increased and the screen blur correction range is increased.

  As a result, even when moving image signals having different numbers of pixels are displayed, it is possible to correct screen blur included in the moving image to be displayed while minimizing image quality degradation.

  In this embodiment, the screen blur correction unit 102 is configured to select and output one of the input moving image signal and the moving image signal subjected to the blur correction process. However, when the blur correction is prohibited, the blur correction is performed. The structure which stops operation | movement of a part may be sufficient.

  Specifically, if the operation of the screen blur correction unit 201 to the enlargement processing unit 204 in FIG. 2 is stopped, useless power is not consumed.

  Next, a second embodiment will be described.

  In the present embodiment, a case will be described in which the present invention is applied to a reproducing apparatus that reproduces a moving image signal from a recording medium and outputs it to an external display device.

FIG. 6 is a diagram showing a configuration of the playback apparatus 600 in the present embodiment.
In FIG. 6, a recording medium 601 records moving image signals of a plurality of titles having different numbers of pixels. The user operates the user I / F 608 to select a title to be reproduced from a plurality of titles recorded on the recording medium 601 and instruct reproduction. When a reproduction instruction is given by the user, the control unit 607 controls the reproduction unit 602 to reproduce the moving image signal of the designated title.
The user I / F 608 includes a remote controller, its receiver, various operation buttons, and the like.

  The reproduction unit 602 reproduces the moving image signal designated from the recording medium 601 and its additional information, and outputs the reproduced signal to the signal processing unit 603. When the reproduced moving image signal is encoded, the signal processing unit 603 performs a decoding process, performs other necessary processes, and outputs the reproduced moving image signal to the screen blur correction unit 604. Further, the signal processing unit 602 outputs additional information reproduced together with the moving image signal to the pixel number detection unit 609.

  The pixel number detection unit 609 detects the number of pixels in each frame of the reproduced moving image signal based on the input additional information, and outputs the detection result to the control unit 607.

  The screen blur correction unit 603 corrects the screen blur of the input moving image signal in accordance with the correction accuracy control signal from the control unit 607, and outputs it to the output processing unit 605.

  The output processing unit 605 multiplexes various types of information with the moving image signal from the screen blur correction unit 603 and outputs the multiplexed information to the communication unit 606 in accordance with an instruction from the control unit 607. When the user I / F 608 instructs to display various menu information, the output processing unit 605 generates the menu information according to an instruction from the control unit 607 and outputs the menu information to the communication unit 606.

  The communication unit 606 transmits the moving image signal from the output processing unit 605 to an external display device 6010 via a predetermined transmission path. The display device 6010 displays a moving image related to the moving image signal transmitted from the communication unit 606. The communication unit 606 can transmit and receive various commands and information to and from the display device 6010 in addition to transmitting a moving image signal to the display device 6010. The communication unit 606 receives information on the number of display pixels from the display device 6010 at a predetermined timing and outputs the information to the control unit 607 as described later.

  The control unit 607 controls each unit to reproduce the moving image signal recorded on the recording medium 601 in accordance with an instruction from the user I / F 608. Further, the control unit 607 compares the number of pixels of the reproduced moving image signal with the number of display pixels of the display device 6010 acquired by the communication unit 606, and controls the correction process by the screen blur correction unit 604 according to the comparison result.

  In the playback apparatus 600, the configuration of the screen blur correction unit 603 is the same as the configuration illustrated in FIGS. Also, the screen blur correction unit 603 corrects and outputs the screen blur of the moving image signal in accordance with the blur correction control signal from the control unit 607 and the correction accuracy setting signal, as in the first embodiment. Therefore, a detailed description of the screen blur correction unit 603 is omitted.

  Next, the display pixel number information acquisition process of the external display device 6010 in this embodiment will be described with reference to the flowchart of FIG. The processing in FIG. 7 is executed by the control unit 607 controlling each unit.

  7 is started when the power is turned on and when a display device 6010 is newly connected.

  First, the communication unit 606 is instructed to request the number of display pixels of the display device 6010. The communication unit 606 transmits a command for requesting the number of display pixels to the external display device 6010 (S701). When the communication unit 606 receives information on the number of display pixels from the display device 6010, the received information on the number of display pixels is output to the control unit 607 (S702). The control unit 607 stores information on the number of display pixels in an internal memory (S703).

  Next, control of the shake correction process in the present embodiment will be described with reference to the flowchart of FIG. The processing in FIG. 8 is executed by the control unit 607 controlling each unit.

When the user gives an instruction to start reproduction of a moving image signal, the moving image signal is reproduced from the recording medium 601 as described above. Then, first, the number of pixels of the reproduced moving image signal is detected based on the detection result of the pixel number detection unit 609 (S801). Next, the information on the number of display pixels of the display device 6010 acquired by the processing of FIG. 7 and the number of pixels of the reproduction moving image signal are calculated according to the following formula (S802).
α = number of pixels of the playback video signal / number of display pixels of the display device (Formula 2)
Hereinafter, the processes of S803 to S812 are the same as steps S502 to S511 of FIG.

  As described above, in the present embodiment, when the moving image signal is reproduced and output to the external display device, information on the number of display pixels of the display device is acquired. The degree of screen blur correction is controlled according to the comparison result between the number of pixels of the reproduced moving image signal and the number of display pixels.

  Specifically, as the number of display pixels is larger than the number of pixels of the reproduction moving image signal, the screen blur detection accuracy is increased and the screen blur correction range is increased.

  As a result, even when a moving image signal is reproduced and output to a display device, it is included in the moving image to be displayed while minimizing image quality degradation in consideration of the number of pixels of the display device and the number of pixels of the reproduced image. It is possible to correct screen blur.

  Next, a third embodiment will be described. In the present embodiment, as in the first embodiment, a display device that displays a moving image signal input from the outside will be described.

  FIG. 9 is a diagram showing a configuration of the display device 900 of the present embodiment. The display device 900 of FIG. 9 is different from the display device 100 of FIG. 1 in that an electronic zoom unit 901 is added, and the other configuration is the same as that of FIG. Therefore, the same functional blocks as those in FIG. 1 are denoted by the same reference numerals, and detailed description thereof is omitted.

  In FIG. 9, the moving image signal input from the input unit 101 is output to the electronic zoom unit 901 and the pixel number detection unit 106. The electronic zoom unit 901 enlarges an image signal of a partial area designated by the control unit 107 out of each screen of the input moving image signal and outputs the enlarged image signal to the screen blur correction unit 102.

  In the present embodiment, the zoom magnification in the electronic zoom unit 901 can be set by the user operating the user I / F 108.

  Next, the electronic zoom unit 901 will be described.

  FIG. 10 is a block diagram showing the configuration of the electronic zoom unit 901.

  In FIG. 10, the input moving image signal is stored in the memory 1001. The memory 1001 can store at least one frame of moving image signal.

  On the other hand, the control unit 107 generates a zoom control signal indicating the readout range and zoom magnification in the electronic zoom unit 901 based on the number of pixels of the input moving image signal and the magnification set by the user, and outputs the zoom control signal to the zoom control unit 1004. . For example, when the zoom magnification is four times, in the input moving image signal, a rectangular area in the center portion of the screen, which is composed of half the number of pixels in each of the vertical and horizontal directions, is set as a readout range and is output together with information on the zoom magnification.

  Based on the zoom control signal, the zoom control unit 1004 instructs the reading unit 1002 to read the image signal in the specified reading range. The reading unit 1002 reads an image signal in a range specified by the zoom control unit 1004 and outputs the image signal to the enlargement unit 1003.

  In addition, the zoom control unit 1004 outputs zoom magnification information to the enlargement unit 1003. The enlarging unit 1003 enlarges the image signal read by the reading unit 1002 based on the zoom magnification information, enlarges it to the size of the input image signal, and outputs it.

  Next, shake correction processing control in the present embodiment will be described with reference to the flowchart of FIG. The processing in FIG. 11 is executed by the control unit 107 controlling each unit.

  In the present embodiment, the control unit 107 generates the above-described blur correction control signal and the correction accuracy setting signal based on the number of pixels of the input moving image signal, the number of pixels of the display unit 105, and the zoom magnification, thereby generating screen blur. The data is output to the correction unit 102.

  The flow of FIG. 11 starts when the user I / F 209 instructs to turn on the power, when the moving image signal input to the input unit 101 is changed, and when the zoom magnification is changed.

First, the number of pixels of the input moving image signal is detected (S1101). Next, the zoom magnification set by the user is detected (S1102). Then, based on the number of pixels of the input moving image signal and the zoom magnification, the number of pixels in the readout range in the electronic zoom unit 901 is calculated (S1103). Then, the following calculation is performed based on the number of pixels in the electronic zoom reading range and the number of pixels in the display unit 105, and the ratio α is calculated (S1104).
α = number of pixels in the readout range / number of pixels in the display unit (Formula 3)
Hereinafter, the processing of S1105 to S1114 is the same as steps S502 to S511 of FIG.

  As described above, in the present embodiment, when the input moving image signal is enlarged and displayed by the electronic zoom process, the screen blurring is determined according to the comparison result between the number of pixels in the electronic zoom reading range and the number of display pixels. The degree of correction is controlled.

  For this reason, even when the enlargement range changes due to the electronic zoom, it is possible to correct the screen blur included in the moving image to be displayed while suppressing the minimum image quality degradation.

  Next, a fourth embodiment will be described. In the present embodiment, as in the second embodiment, a reproducing apparatus that reproduces a moving image signal from a recording medium and outputs it to an external display device will be described.

  FIG. 12 is a diagram showing the configuration of the playback device 1200 of this embodiment. The playback apparatus 1200 of FIG. 12 is different from the playback apparatus 600 of FIG. 6 in that an electronic zoom unit 1201 is added, and the other configuration is the same as that of FIG. Therefore, the same functional blocks as those in FIG. 6 are given the same numbers, and detailed descriptions thereof are omitted.

  In FIG. 12, a moving image signal reproduced from the recording medium 601 and processed by the signal processing unit 604 is output to the electronic zoom unit 1201. The electronic zoom unit 1201 has the same configuration as the electronic zoom unit 901 illustrated in FIG. 10, and enlarges the image signal in the range specified by the control unit 607 from each screen of the input moving image signal. The data is output to the correction unit 604.

  In the present embodiment, the zoom magnification in the electronic zoom unit 1201 can be set by the user operating the user I / F 608.

  Further, the control unit 1207 generates a zoom control signal indicating the reading range and zoom magnification in the electronic zoom unit 1201 based on the number of pixels of the reproduced moving image signal and the zoom magnification set by the user, and the electronic zoom unit 1201. Output to. In addition, the control unit 607 generates the above-described blur correction control signal and correction accuracy setting signal based on the number of pixels of the reproduced moving image signal, the number of display pixels of the display device 601, and the zoom magnification, thereby generating screen blur. The data is output to the correction unit 604.

  Next, control of blur correction processing in the present embodiment will be described with reference to the flowchart of FIG. The processing in FIG. 13 is executed by the control unit 607 controlling each unit.

  When the reproduction of the moving image signal is started by the user or the zoom magnification is changed by the user, the flow of FIG. 13 is started.

First, based on the detection result of the pixel number detection unit 609, the number of pixels of the reproduced moving image signal is detected (S1301). Next, the zoom magnification set by the user is detected (S1302). Based on the number of pixels of the input moving image signal and the zoom magnification, the number of pixels in the readout range in the electronic zoom unit 1201 is calculated (S1303). Then, the following calculation is performed based on the number of pixels in the readout range of the electronic zoom and the number of display pixels of the display device 6010, and the ratio α is calculated (S1304).
α = number of pixels in readout range / number of display pixels of display device (Formula 4)
Hereinafter, the processing of S1305 to S1314 is the same as that of steps S502 to S511 of FIG.

  As described above, in the present embodiment, when the reproduced moving image signal is enlarged by electronic zoom and output to an external display device, information on the number of display pixels of the display device is acquired. The degree of screen blur correction is controlled in accordance with the comparison result between the number of pixels in the enlarged range and the number of display pixels in the electronic zoom.

  As a result, even when the moving image signal is enlarged by electronic zoom and output to the display device, the image blurring is suppressed while minimizing the image quality degradation in consideration of the number of pixels of the display device and the number of pixels in the zoom range. It becomes possible to correct.

  Next, a fifth embodiment will be described. In the present embodiment, as in the first and third embodiments, a display device that displays a moving image signal input from the outside will be described.

  FIG. 14 is a diagram showing the configuration of the display device 1400 of the present embodiment. The display device 1400 of FIG. 14 is different from the display device 100 of FIG. 9 in that a distance measuring unit 1401 is added, and the other configuration is the same as that of FIG. Therefore, the same functional blocks as those in FIG. 9 are given the same numbers, and detailed descriptions thereof are omitted.

  In FIG. 14, the distance measurement unit 1401 measures the distance between the user who is viewing the moving image displayed on the display device 1400 and the display device 1400, and outputs the measurement result to the control unit 107. Many known techniques have been proposed for measuring the distance between the display device and the user, and in the present embodiment, any one of the known measuring techniques is used.

  In the third embodiment, the correction process by the screen blur correction unit 102 is controlled based on the readout range in the electronic zoom unit 901 and the number of display pixels on the display unit 105.

  In this embodiment, in addition to the electronic zoom readout range and the number of display pixels, the screen blur correction unit 102 performs processing based on information about the screen size of the display unit 105 and the distance to the user measured by the distance measurement unit 1401. Control.

  The control unit 107 has a built-in memory, and information on the number of pixels of the display unit 105 and information on the screen size are stored in the memory. In general, in a display device such as a television receiver, the display screen is rectangular, and the screen size is often expressed by the length of a diagonal line (unit: inch). Therefore, also in the present embodiment, the screen size of the display unit 105 is stored as information on the length of the diagonal line.

  Next, blur correction processing control according to the present embodiment will be described with reference to the flowchart of FIG. The processing in FIG. 15 is executed by the control unit 107 controlling each unit.

  In the present embodiment, the control unit 107 controls the screen blur correction unit 102 based on the number of pixels of the input moving image signal, the number of pixels of the display unit 105, the zoom magnification, the size of the display unit 105, and the distance to the user. Control.

  The flow of FIG. 15 is performed when the power-on instruction by the user I / F 209, the moving image signal input to the input unit 101 is changed, the zoom magnification is changed, and the distance to the user is changed. Start.

  First, the number of pixels of the input moving image signal is detected (S1501). Next, the zoom magnification set by the user is detected (S1502). Based on the number of pixels of the input moving image signal and the zoom magnification, the number of pixels in the readout range in the electronic zoom unit 901 is calculated (S1503). Next, the distance to the user is detected (S1504).

  Then, the following calculation is performed to calculate a reference ratio α for blur correction (S1505).

First, the following calculation is performed to calculate γ, which is the ratio between the number of pixels in the electronic zoom readout range and the number of pixels in the display unit 105.
γ = number of pixels in reading range / number of pixels in display unit (Formula 5)
Next, the correction value β is obtained from the distance information to the user and the size of the display unit 105 as follows.
β = f (1 / screen size, distance to the user) (Formula 6)
Here, β is inversely proportional to the screen size and proportional to the distance to the user.

Then, from these γ and β, the reference ratio α is obtained by the following calculation.
α = γ × β (Formula 7)
When α is calculated in this manner, the processing of S1305 to S1314 is performed in the same manner as steps S502 to S511 of FIG.

  Here, for example, when α> 2, the number of display pixels is sufficiently smaller than the number of pixels in the readout range, the screen size is small, and the distance to the user is long. That is, a moving image that does not have a very high resolution is displayed to the user. In this case, the blur correction process is prohibited (N in S1506, S1515).

  Further, when 2 ≧ α> 1, the number of pixels in the readout range is within a difference of about twice the number of display pixels, and the screen size and the distance to the user are not extreme values. In this case, the degree of screen blur correction is set to be weak (N in S1508, S1512).

  When 1 ≧ α> 1/2, the number of display pixels is the same as the number of pixels in the readout range, the screen size is the normal size, and the distance to the user is not so far. In this case, the degree of screen blur correction is set to medium (N in S1509, S1513).

  Further, when 1/2 ≧ α> ¼, there is not much difference between the number of display pixels and the reading range, the screen size is a medium size, and the distance to the user is not so close. In this case, the degree of screen blur correction is set slightly higher (N in S1510, S1514).

  In addition, when 1/4 ≧ α, the number of pixels in the readout range is ¼ or less of the number of display pixels, the screen size is large, and the distance to the user is short. In this case, the degree of screen blur correction is set to be stronger (Y in S1510, S1511).

  As described above, in the present embodiment, when the input moving image signal is displayed, the degree of screen blur correction is set according to the distance to the user and the screen size in addition to the electronic zoom readout range and the number of display pixels. I have control.

  Therefore, it is possible to correct the screen blur included in the moving image to be displayed while suppressing the minimum image quality degradation according to the screen size and the position where the user is viewing.

  In the present embodiment, the correction value β is calculated using both the screen size and the distance to the user, but only one of them may be used. In this embodiment, the correction value β is calculated by a function that is inversely proportional to the screen size and proportional to the distance to the user, but this function can be set as appropriate.

  In the present embodiment, γ is calculated based on the readout range and the number of display pixels at the time of electronic zoom. However, when the electronic zoom unit is not provided as shown in FIG. 1, the number of pixels of the input moving image signal is calculated. Γ may be calculated from the number of display pixels.

  In this case, the degree of screen blur correction is controlled based on the number of pixels of the input moving image signal, the number of display pixels, the display screen size, and / or the distance to the user.

  Next, a sixth embodiment will be described.

  The configuration of this embodiment is the same as that of the playback device 1200 of FIG.

  In the present embodiment, information about the screen size of the display device 6010 is acquired from the display device 6010 in addition to information about the number of display pixels. Then, screen blur correction processing is controlled using the information on the screen size.

  The acquisition processing of the display pixel number and screen size information of the external display device 6010 will be described with reference to the flowchart of FIG.

  The processing of FIG. 16 is started when the power is turned on and when a display device 6010 is newly connected.

  First, the control unit 607 instructs the communication unit 606 to request the number of display pixels of the display device 6010. The communication unit 606 transmits a command for requesting information on the number of display pixels and the screen size to the external display device 6010 (S1601). When the communication unit 606 receives information on the number of display pixels and the screen size from the display device 6010, the received information is output to the control unit 607 (S1602). The control unit 607 stores information on the number of display pixels and the screen size in an internal memory (S1603).

  Next, the control of the blur correction process in the present embodiment will be described with reference to the flowchart of FIG. The process of FIG. 17 is almost the same as the process of FIG. 13, but the calculation process of α in S1704 is different.

In step S1704, the reference ratio α is calculated by performing the following calculation based on the number of pixels in the electronic zoom reading range, the number of display pixels of the display device 6010, and the image size.
α = number of pixels in readout range / number of display pixels of display device × 1 / screen size (Equation 8)
Thereafter, similarly to the process of FIG. 13, the process of the screen blur correction unit 604 is controlled according to the value of α.

  As described above, in the present embodiment, when a moving image signal is output to the display device, the degree of screen blur correction according to the screen size of the display device in addition to the electronic zoom readout range and the number of pixels of the display device. Is controlling.

  Therefore, it is possible to correct the screen blur included in the moving image to be displayed while suppressing the minimum image quality degradation according to the screen size.

  In the present embodiment, α is calculated based on the readout range, the number of display pixels, and the screen size at the time of electronic zoom. However, when the electronic zoom unit is not provided as shown in FIG. 6, α may be calculated from the number of pixels of the reproduction moving image signal, the number of pixels of the display device, and the screen size.

  In this case, the degree of screen blur correction is controlled based on the number of pixels of the reproduced moving image signal, the number of pixels of the display device, and the display screen size.

  If the external display device has a configuration for detecting the distance to the user, the distance information is acquired from the display device, and the distance information with the user is used as in the process of FIG. The blur correction process may be controlled.

  In the present embodiment, the case where the present invention is applied to a display device or a playback device has been described. In addition to this, for example, an imaging device such as a video camera or a digital camera, a portable terminal such as a mobile phone, or the like is applicable to the present invention as long as it has a function of outputting a moving image to a display device.

It is a figure which shows the structure of the display apparatus in embodiment of this invention. It is a figure which shows the structure of a screen shake correction | amendment part. It is a figure which shows the structure of a screen shake detection part. It is a figure which shows the mode of the blur correction by a screen blur correction part. It is a flowchart which shows a blurring correction process. It is a figure which shows the structure of the reproducing | regenerating apparatus in embodiment of this invention. It is a flowchart which shows the acquisition process of the display pixel number information by a reproducing | regenerating apparatus. It is a flowchart which shows a blurring correction process. It is a figure which shows the structure of the display apparatus in embodiment of this invention. It is a figure which shows the structure of an electronic zoom part. It is a flowchart which shows a blurring correction process. It is a figure which shows the structure of the reproducing | regenerating apparatus in embodiment of this invention. It is a flowchart which shows a blurring correction process. It is a figure which shows the structure of the display apparatus in embodiment of this invention. It is a flowchart which shows a blurring correction process. It is a flowchart which shows the acquisition process of the number of display pixels and screen size by a reproducing | regenerating apparatus. It is a flowchart which shows a blurring correction process.

Claims (12)

An input means for inputting a moving image signal;
A blur correction unit that corrects a blur of an image indicated by the moving image signal input by the input unit;
Output means for outputting a moving image signal output from the shake correction means to a display device;
An image processing apparatus comprising: control means for controlling correction processing by the blur correction means based on the number of pixels of the moving image signal input by the input means and the number of pixels of the display device. An input means for inputting a moving image signal;
An enlarging means for enlarging a partial range of each screen in the moving image signal input by the input means;
A shake correction unit that corrects a shake of an image indicated by the moving image signal enlarged by the enlargement unit;
Output means for outputting a moving image signal output from the shake correction means to a display device;
An image processing apparatus comprising: control means for controlling correction processing by the blur correction means based on the number of pixels in the range enlarged by the enlargement means and the number of pixels of the display device.   The image processing apparatus according to claim 1, wherein the control unit controls whether or not correction processing by the shake correction unit is executed. The control unit increases the correction range by the blur correction unit as the number of pixels of the display device is larger than the number of pixels of the moving image signal input by the input unit. An image processing apparatus according to 1.   3. The image processing according to claim 2, wherein the control unit increases the correction range by the blur correction unit as the number of pixels of the display device is larger than the number of pixels in the enlarged range. apparatus. Said control means further, the display device based on the distance to the user to appreciate the image displayed on the image processing apparatus according to claim 1 or 2, wherein the controller controls the correction process.   The image processing apparatus according to claim 6, wherein the control unit increases a correction range by the shake correction unit as the distance is shorter.   3. The image processing apparatus according to claim 1, further comprising means for receiving information on the number of pixels of the display device transmitted from the display device. The blur correction unit includes a memory, a blur detection unit that detects screen blur in a moving image signal input to the blur correction unit, and a moving image signal stored in the memory based on a detection result of the blur detection unit. Reading means for reading out a partial area of the image data, and means for enlarging a moving image signal of the partial area read out by the reading means, wherein the control means determines the size of the area read out by the reading means and the the image processing apparatus according to claim 1 or 2, characterized in that for controlling the operation of the shake detection means.   The image processing apparatus according to claim 2, wherein the enlargement unit changes a size of the enlarged range according to a designated enlargement ratio. A blur correction step for correcting blur of an image indicated by the input moving image signal;
An output step of outputting the moving image signal output from the blur correction step to a display device;
An image processing method comprising: a control step of controlling correction processing by the blur correction step based on the number of pixels of the input moving image signal and the number of pixels of the display device. An enlargement step for enlarging a partial range of each screen in the input video signal;
A blur correction step of correcting blur of an image indicated by the video signal magnified by the magnification step;
An output step of outputting the moving image signal output from the blur correction step to a display device;
An image processing method comprising: a control step of controlling correction processing by the blur correction step based on the number of pixels in the range enlarged by the enlargement step and the number of pixels of the display device.

Images