JP2011164967A5

JP2011164967A5 -

Info

Publication number: JP2011164967A5
Application number: JP2010027532A
Authority: JP
Filing date: 2010-02-10
Publication date: 2013-02-28
Anticipated expiration: 2030-02-10

Description

この発明に係る画像処理装置は、低解像度入力画像を入力して超解像画像を出力するものであり、前記低解像度入力画像を第１の高解像度変換をして高解像度入力画像を生成する第１の高解像度変換部と、前記低解像度入力画像に基づいて生成される推定高解像度画像を低解像度変換して低解像度画像を生成する低解像度変換部と、前記低解像度画像と前記低解像度入力画像とから差分画像を生成する差分画像生成部と、前記差分画像から指標値を算出する指標値算出部と、前記差分画像を第２の高解像度変換をして差分高解像度画像を生成する第２の高解像度変換部と、前記差分高解像度画像と前記推定高解像度画像とから高解像度画像を生成する高解像度画像生成部と、前記第１の高解像度変換、前記第２の高解像度変換および前記低解像度変換で用いられる変換パラメータを前記指標値と所定のしきい値とを比較して修正し、前記推定高解像度画像を前記低解像度変換部および前記高解像度画像生成部に出力するか、超解像画像として出力して画像処理を終了するかを判定する制御部とを備え、前記低解像度変換部は、前記高解像度入力画像および前記高解像度画像を入力し、入力した前記高解像度入力画像および前記高解像度画像から１つを選択して前記推定高解像度画像とする。 An image processing apparatus according to the present invention inputs a low resolution input image and outputs a super-resolution image, and generates a high resolution input image by performing a first high resolution conversion on the low resolution input image. A first high-resolution converter; a low-resolution converter that generates a low-resolution image by converting the estimated high-resolution image generated based on the low-resolution input image; and the low-resolution image and the low-resolution A difference image generation unit that generates a difference image from the input image, an index value calculation unit that calculates an index value from the difference image, and a second high resolution conversion of the difference image to generate a difference high resolution image A second high-resolution conversion unit; a high-resolution image generation unit that generates a high-resolution image from the differential high-resolution image and the estimated high-resolution image; the first high-resolution conversion; and the second high-resolution conversion. And the low solution A conversion parameter used in degree conversion is corrected by comparing the index value with a predetermined threshold value, and the estimated high resolution image is output to the low resolution conversion unit and the high resolution image generation unit, or a super solution A control unit that determines whether to output the image as an image and end the image processing, wherein the low-resolution conversion unit inputs the high-resolution input image and the high-resolution image, and inputs the input high-resolution input image and One of the high resolution images is selected as the estimated high resolution image.

Claims

In an image processing apparatus that inputs a low-resolution input image and outputs a super-resolution image,
Wherein the first high-resolution conversion unit to generate a high-resolution input image with a low resolution input image first high-resolution conversion,
A low-resolution conversion unit that generates a low-resolution image by converting the estimated high-resolution image generated based on the low-resolution input image to a low resolution;
Wherein the differential image generating section that generates a differential image from a low resolution image wherein the low-resolution input image,
An index value calculation unit for calculating an index value from the difference image;
A second high-resolution conversion unit for generating a differential high-resolution image the difference image by the second high-resolution conversion,
The high resolution image generation unit that generates the estimated high-resolution image Toka et high resolution image and the difference high resolution image,
A conversion parameter used in the first high resolution conversion, the second high resolution conversion, and the low resolution conversion is corrected by comparing the index value with a predetermined threshold value, and the estimated high resolution image is low resolution conversion unit and to be output to the high resolution image generation unit, and a control unit to determine whether to end the image processing and outputs a super-resolution image,
The low resolution conversion unit inputs the high resolution input image and the high resolution image, and selects one of the input high resolution input image and the high resolution image as the estimated high resolution image. An image processing apparatus.

In an image processing apparatus that inputs a low-resolution input image and outputs a super-resolution image,
A first high-resolution conversion unit configured to generate a high-resolution input image by performing a first high-resolution conversion on the low-resolution input image;
A low-resolution conversion unit that generates a low-resolution image by converting the estimated high-resolution image generated based on the low-resolution input image to a low resolution;
A difference image generation unit for generating a difference image from the low resolution image and the low resolution input image;
An index value calculation unit for calculating an index value from the difference image;
A second high-resolution conversion unit configured to generate a differential high-resolution image by performing a second high-resolution conversion on the difference image;
A high-resolution image generation unit that generates a high-resolution image from the differential high-resolution image and the estimated high-resolution image;
A control unit that corrects conversion parameters used in the first high resolution conversion, the second high resolution conversion, and the low resolution conversion by comparing the index value with a predetermined threshold;
The high-resolution generation unit inputs the high-resolution input image and the high-resolution image obtained for a second low-resolution input image, and selects one from the input high-resolution input image and the high-resolution image The estimated high resolution image,
The high resolution image generation unit generates the high resolution image from the differential high resolution image obtained for the low resolution input image and the estimated high resolution image obtained for the second low resolution input image. images processing device shall be the features.

A motion detector for detecting motion information from the low resolution input image and the second low resolution input image;
The high-resolution image generation unit refers to the differential image obtained for the low-resolution input image based on the motion information detected by the motion detection unit, and the differential high-resolution image obtained by high-resolution conversion The image processing apparatus according to claim 2, wherein the high-resolution image is generated from an estimated high-resolution image obtained for the second low-resolution input image.

The motion detection unit detects motion information for each region,
Based on the motion information detected by the motion detection unit, the first high-resolution conversion unit applies an enlargement process that has a lower processing load than the high-resolution conversion for the region in which the motion is detected to the region in which no motion is detected. The image processing apparatus according to claim 3, wherein the high-resolution input image is generated.

The control unit counts the number of times that the high-resolution image generation unit has repeatedly generated the high-resolution image with respect to the low-resolution input image, and based on the counted number of repeated generations, the high-resolution image the image processing according to claim 1, wherein the high resolution or image iteratively to generate, or determines whether the estimated high-resolution image is terminated is output as the super-resolution image to the image generating unit apparatus.

The control unit is configured to perform high resolution conversion performed by the first and second high resolution conversion units and low resolution performed by the low resolution conversion unit based on a distance from the optical axis center of the optical system to the position of the conversion target pixel. Modify the transformation parameters that define the transformation
The image processing apparatus according to claim 1, wherein the image processing apparatus is an image processing apparatus.

In an image processing apparatus that inputs a low-resolution input image and outputs a super-resolution image,
A high-resolution conversion unit that performs high-resolution conversion on a low-resolution input image or difference image, and generates a high-resolution input image obtained by converting the low-resolution input image into high-resolution or a differential high-resolution image obtained by converting the difference image into high-resolution ,
A high resolution input image or a high resolution image generated by the high resolution converter as an estimated high resolution image, a low resolution converter that generates a low resolution image by converting the estimated high resolution image to a low resolution;
A difference image generation unit for generating the difference image obtained from the low resolution image generated by the low resolution conversion unit and the low resolution input image;
An index value calculation unit for calculating an index value from the difference image;
A high-resolution image generation unit that generates the high-resolution image obtained from the difference high-resolution image generated by the high-resolution conversion unit and the estimated high-resolution image from the difference image generated by the difference image generation unit;
A conversion parameter used in high resolution conversion performed by the high resolution conversion unit and low resolution conversion performed by the low resolution conversion unit is corrected by comparing the index value with a predetermined threshold value, and the estimated high resolution image is corrected. A control unit that determines whether to output to the low resolution conversion unit and the high resolution image generation unit, or to output the image as a super-resolution image and end image processing;
The low resolution conversion unit inputs the high resolution input image and the high resolution image, and selects one of the input high resolution input image and the high resolution image as the estimated high resolution image. An image processing apparatus.

In an image processing apparatus that inputs a low-resolution input image and outputs a super-resolution image,
A first high resolution conversion step of performing a first high resolution conversion on the low resolution input image to generate a high resolution input image;
A low resolution conversion step of generating a low resolution image by converting the estimated high resolution image generated based on the low resolution input image to a low resolution;
A difference image generation step of generating a difference image from the low resolution image and the low resolution input image;
An index value calculating step of calculating an index value from the difference image;
A second high-resolution conversion step of generating a differential high-resolution image by performing a second high-resolution conversion on the difference image;
A high-resolution image generating step for generating a high-resolution image from the differential high-resolution image and the estimated high-resolution image;
A conversion parameter used in the first high resolution conversion, the second high resolution conversion, and the low resolution conversion is corrected by comparing the index value with a predetermined threshold value, and the estimated high resolution image is A control step for determining whether to output to the low resolution conversion step and the high resolution image generation step, or to output as a super resolution image and end the image processing,
In the low resolution conversion step, the high resolution input image and the high resolution image are input, and one of the input high resolution input image and the high resolution image is selected as the estimated high resolution image. An image processing method.

In an image processing apparatus that inputs a low-resolution input image and outputs a super-resolution image,
A first high resolution conversion step of performing a first high resolution conversion on the low resolution input image to generate a high resolution input image;
A low resolution conversion step of generating a low resolution image by converting the estimated high resolution image generated based on the low resolution input image to a low resolution;
A difference image generation step of generating a difference image from the low resolution image and the low resolution input image;
An index value calculating step of calculating an index value from the difference image;
A second high-resolution conversion step of generating a differential high-resolution image by performing a second high-resolution conversion on the difference image;
A high-resolution image generating step for generating a high-resolution image from the differential high-resolution image and the estimated high-resolution image;
A control step of correcting conversion parameters used in the first high resolution conversion, the second high resolution conversion, and the low resolution conversion by comparing the index value with a predetermined threshold value,
The high-resolution generation step inputs the high-resolution input image and the high-resolution image obtained with respect to a second low-resolution input image, and selects one from the input high-resolution input image and high-resolution image The estimated high resolution image,
The high-resolution image generation step is configured to convert the high-resolution image from a differential high-resolution image obtained from the low-resolution input image and an estimated high-resolution image obtained from the second low-resolution input image.
An image processing method comprising generating the image processing method.