JP2015132930A - Space super-resolution and gradation interpolation device and program - Google Patents

Space super-resolution and gradation interpolation device and program Download PDF

Info

Publication number
JP2015132930A
JP2015132930A JP2014003339A JP2014003339A JP2015132930A JP 2015132930 A JP2015132930 A JP 2015132930A JP 2014003339 A JP2014003339 A JP 2014003339A JP 2014003339 A JP2014003339 A JP 2014003339A JP 2015132930 A JP2015132930 A JP 2015132930A
Authority
JP
Japan
Prior art keywords
resolution
image
super
interpolation
gradation
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
JP2014003339A
Other languages
Japanese (ja)
Other versions
JP6276596B2 (en
Inventor
康孝 松尾
Yasutaka Matsuo
康孝 松尾
境田　慎一
Shinichi Sakaida
慎一 境田
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Japan Broadcasting Corp
Original Assignee
Nippon Hoso Kyokai NHK
Japan Broadcasting Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nippon Hoso Kyokai NHK, Japan Broadcasting Corp filed Critical Nippon Hoso Kyokai NHK
Priority to JP2014003339A priority Critical patent/JP6276596B2/en
Publication of JP2015132930A publication Critical patent/JP2015132930A/en
Application granted granted Critical
Publication of JP6276596B2 publication Critical patent/JP6276596B2/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Image Processing (AREA)

Abstract

PROBLEM TO BE SOLVED: To obtain a space super-resolution and gradation interpolation image efficiently and accurately.SOLUTION: A space super-resolution and gradation interpolation device 1 comprises a requantization part 10 for generation of a requantization image obtained by requantization of an original image to a target gradation number, and a space super-resolution and gradation interpolation part 20 for space super-resolution of the requantization image to a target resolution and also gradation interpolation through filter processing to generate a space super-resolution and gradation interpolation image.

Description

本発明は、原画像を空間超解像処理及び階調補間処理して空間超解像・階調補間画像を生成する空間超解像・階調補間装置及びプログラムに関する。   The present invention relates to a spatial super-resolution / gradation interpolation apparatus and program for generating a spatial super-resolution / tone interpolation image by performing spatial super-resolution processing and gradation interpolation processing on an original image.

従来、画像を空間方向に空間超解像処理して元の画像よりも解像度の高い画像を生成する空間超解像技術が知られている。例えば、被写体の照明方程式パラメータを推定し、推定した照明方程式パラメータについて高解像度化を行い、高解像度化された照明方程式パラメータを合成して高解像度画像を生成し、その際、推定した照明方程式パラメータの推定精度が所定の精度を満たさない画素が存在するときは、高解像度化した照明方程式パラメータをフィードバックして、再度、照明方程式パラメータの推定を行うことにより、被写体の画像を高解像度化する技術が知られている（例えば、特許文献１参照）。   Conventionally, a spatial super-resolution technique for generating an image having a higher resolution than the original image by performing spatial super-resolution processing on the image in the spatial direction is known. For example, the illumination equation parameter of the subject is estimated, the resolution of the estimated illumination equation parameter is increased, and a high-resolution image is generated by synthesizing the increased illumination equation parameter. At that time, the estimated illumination equation parameter When there is a pixel whose estimation accuracy does not satisfy the predetermined accuracy, a technique for increasing the resolution of the image of the subject by feeding back the illumination equation parameter having a higher resolution and estimating the illumination equation parameter again Is known (see, for example, Patent Document 1).

また、画像を階調方向に補間処理して元の画像よりも階調数の多い画像を生成する階調補間装置が知られている。例えば、処理対象画素の印字濃度に対して複数の閾値と補間演算誤差を設定し、処理対象画素とその隣接する画素の持つ補間演算誤差の平均との総和を複数の閾値と比較し、その最も近い値の閾値を実行閾値として用いるなどして中間階調を補間する技術が知られている（例えば、特許文献２参照）。   There is also known a gradation interpolation device that generates an image having a larger number of gradations than the original image by performing interpolation processing on the image in the gradation direction. For example, a plurality of threshold values and interpolation calculation errors are set for the print density of the processing target pixel, and the sum of the processing target pixel and the average of interpolation calculation errors of adjacent pixels is compared with the plurality of threshold values. A technique for interpolating intermediate gradations by using a near threshold value as an execution threshold is known (for example, see Patent Document 2).

特許第４１３９８５３号公報Japanese Patent No. 4139533 特開平４−１８８５５号公報Japanese Patent Laid-Open No. 4-18855

空間超解像及び階調補間の手法として多くの方法が知られているが、原画像を空間方向に拡大し、且つ階調を補間するには、空間超解像処理及び階調補間処理を別々に適用する必要があった。このため、効率的な処理を行うことができなかった。また、標本化と量子化間には密接な相関があるが、これらを別々に行うことは、例えば空間超解像処理を最適に行ったとしても階調補間処理で空間超解像結果が損なわれるため、処理を別々に行った結果が必ずしも高画質な超解像画像になるとは限らなかった。   Many methods are known as spatial super-resolution and gradation interpolation methods. To enlarge the original image in the spatial direction and interpolate the gradation, spatial super-resolution processing and gradation interpolation processing are performed. It had to be applied separately. For this reason, efficient processing could not be performed. In addition, there is a close correlation between sampling and quantization, but performing these separately, for example, even if spatial super-resolution processing is optimally performed, spatial super-resolution results are lost in tone interpolation processing. Therefore, the result of performing the processing separately does not necessarily result in a high-resolution super-resolution image.

かかる事情に鑑みてなされた本発明の目的は、効率的且つ高精度に空間超解像・階調補間画像を得ることができる空間超解像・階調補間装置及びプログラムを提供することにある。   An object of the present invention made in view of such circumstances is to provide a spatial super-resolution / gradation interpolation apparatus and program capable of obtaining a spatial super-resolution / tone interpolation image efficiently and with high accuracy. .

上記課題を解決するため、本発明に係る空間超解像・階調補間装置は、原画像を空間超解像処理及び階調補間処理して、所定の目標解像度及び目標階調数を有する空間超解像・階調補間画像を生成する空間超解像・階調補間装置であって、原画像を目標階調数に再量子化した再量子化画像を生成する再量子化部と、前記再量子化画像を目標解像度に空間超解像するとともに、フィルタ処理により階調補間して、空間超解像・階調補間画像を生成する空間超解像・階調補間部と、を備えることを特徴とする。   In order to solve the above-described problem, a spatial super-resolution / gradation interpolation apparatus according to the present invention performs spatial super-resolution processing and gradation interpolation processing on an original image to obtain a space having a predetermined target resolution and target number of gradations. A spatial super-resolution / gradation interpolation device for generating a super-resolution / gradation-interpolated image, wherein the re-quantization unit generates a re-quantized image obtained by re-quantizing the original image to a target number of gradations; Spatial super-resolution / gradation interpolation unit that generates spatial super-resolution / gradation-interpolated images by spatially re-resolutioning the re-quantized image to the target resolution and performing gradation interpolation by filtering. It is characterized by.

さらに、本発明に係る空間超解像・階調補間装置において、前記空間超解像・階調補間部は、前記再量子化画像を周波数分解して高周波帯域成分を生成する周波数分解部と、前記再量子化画像及び前記高周波帯域成分をフィルタ処理により階調補間して、再量子化整形画像及び高周波帯域整形成分を生成する階調補間部と、前記再量子化整形画像を低周波帯域成分とし前記高周波帯域整形成分を高周波帯域成分として周波数再構成して、前記空間超解像・階調補間画像を生成する周波数再構成部と、を備えることを特徴とする。   Furthermore, in the spatial super-resolution / gradation interpolation device according to the present invention, the spatial super-resolution / gradation interpolation unit generates a high-frequency band component by frequency-decomposing the re-quantized image; A gradation interpolation unit that performs gradation interpolation on the requantized image and the high-frequency band component by filtering, and generates a requantized shaped image and a high-frequency band shaped component; and the requantized shaped image is converted into a low-frequency band component. And a frequency reconfiguration unit configured to reconfigure the frequency as the high frequency band shaping component as a high frequency band component and generate the spatial super-resolution / gradation interpolation image.

さらに、本発明に係る空間超解像・階調補間装置において、前記周波数分解部は、ウェーブレット分解して前記高周波帯域成分を生成し、前記階調補間部は、バイラテラルフィルタを用いて前記フィルタ処理を行うことを特徴とする。   Furthermore, in the spatial super-resolution / gradation interpolation apparatus according to the present invention, the frequency resolution unit generates a high-frequency band component by wavelet decomposition, and the tone interpolation unit uses a bilateral filter to filter the filter. It is characterized by performing processing.

また、上記課題を解決するため、本発明に係るプログラムは、コンピュータを、上記空間超解像・階調補間装置として機能させることを特徴とする。   In order to solve the above problems, a program according to the present invention causes a computer to function as the spatial super-resolution / gradation interpolation apparatus.

本発明によれば、効率的且つ高精度に空間超解像・階調補間画像を得ることができるようになる。   According to the present invention, it is possible to obtain a spatial super-resolution / tone-interpolated image efficiently and with high accuracy.

本発明に係る空間超解像・階調補間処理装置の処理概要を説明する図である。It is a figure explaining the process outline | summary of the space super-resolution and the gradation interpolation processing apparatus which concerns on this invention. 本発明の一実施形態に係る空間超解像・階調補間装置の構成例を示すブロック図である。It is a block diagram which shows the structural example of the space super-resolution and gradation interpolation apparatus which concerns on one Embodiment of this invention. 本発明の一実施形態に係る空間超解像・階調補間装置の動作例を示すブロック図である。It is a block diagram which shows the operation example of the space super-resolution and the gradation interpolation apparatus which concerns on one Embodiment of this invention.

図１は、本発明に係る空間超解像・階調補間処理装置の処理概要を説明する図である。ただし、図１に示す解像度及び階調は一例であり、この値に限定されるものではない。   FIG. 1 is a diagram for explaining the processing outline of the spatial super-resolution / tone interpolation processing apparatus according to the present invention. However, the resolution and gradation shown in FIG. 1 are examples, and are not limited to these values.

図１に示す例では、まず「解像度４Ｋ×２Ｋ、階調８ｂｉｔ」の原画像の階調数を目標とする１２ｂｉｔに再量子化した再量子化画像を生成する。再量子化画像は８ｂｉｔの各画素値が１２ｂｉｔに変換されただけであるため、この段階では画素値はなめらかではなく飛び飛びの値となる。次に、この再量子化画像の解像度を目標とする８Ｋ×４Ｋに拡大（空間超解像処理）する。その際に、１２ｂｉｔの階調を補間する階調補間処理を同時に行うことにより、「解像度８Ｋ×４Ｋ、階調１２ｂｉｔ」の空間超解像・階調補間画像を生成する。   In the example illustrated in FIG. 1, first, a requantized image is generated that is requantized to 12 bits with the target number of gradations of “resolution 4K × 2K, gradation 8 bits”. In the re-quantized image, each 8-bit pixel value is converted into 12-bit, so the pixel value is not a smooth value at this stage. Next, the resolution of this requantized image is enlarged to a target 8K × 4K (space super-resolution processing). At this time, a spatial super resolution / tone interpolation image of “resolution 8K × 4K, tone 12 bits” is generated by simultaneously performing tone interpolation processing for interpolating 12 bits of tone.

以下、本発明の実施形態について詳細に説明する。   Hereinafter, embodiments of the present invention will be described in detail.

図２は、本発明の一実施形態に係る空間超解像・階調補間装置の構成例を示すブロック図である。図２に示す例では、空間超解像・階調補間装置１は、再量子化部１０と、空間超解像・階調補間部２０とを備える。   FIG. 2 is a block diagram showing a configuration example of a spatial super-resolution / gradation interpolation apparatus according to an embodiment of the present invention. In the example illustrated in FIG. 2, the spatial super-resolution / tone interpolation device 1 includes a re-quantization unit 10 and a spatial super-resolution / tone interpolation unit 20.

空間超解像・階調補間装置１は、入力される原画像に対して再量子化処理、及び空間超解像・階調補間処理を施し、所定の目標とする解像度（目標解像度）及び目標とする階調数（目標階調数）を有する空間超解像・階調補間画像を生成して出力する。なお、空間超解像・階調補間装置１に、ユーザにより設定される目標解像度及び目標階調数を入力し、空間超解像・階調補間装置１は、入力された目標解像度及び目標階調数を有する空間超解像・階調補間画像を生成するようにしてもよい。   The spatial super-resolution / gradation interpolation apparatus 1 performs requantization processing and spatial super-resolution / gradation interpolation processing on an input original image to obtain a predetermined target resolution (target resolution) and target A spatial super resolution / tone interpolation image having the number of tones (target tone number) is generated and output. Note that the target resolution and target number of gradations set by the user are input to the spatial super-resolution / gradation interpolation apparatus 1, and the spatial super-resolution / gradation interpolation apparatus 1 receives the input target resolution and target floor. A spatial super-resolution / tone-interpolated image having a logarithm may be generated.

再量子化部１０は、原画像を目標とする階調数に再量子化した再量子化画像を生成し、空間超解像・階調補間部２０に出力する。階調数を８ｂｉｔから１２ｂｉｔに再量子化する場合には、例えば画素値を単純に１６倍する。あるいは、変換前の画素値と変換後の画素値とを対応付けた再量子化テーブルを有する場合には、再量子化テーブルに基づいて画素値を変換する。   The requantization unit 10 generates a requantized image obtained by requantizing the original image to the target number of gradations, and outputs the requantized image to the spatial super-resolution / gradation interpolation unit 20. When the number of gradations is requantized from 8 bits to 12 bits, for example, the pixel value is simply multiplied by 16. Alternatively, when a requantization table in which a pixel value before conversion and a pixel value after conversion are associated is provided, the pixel value is converted based on the requantization table.

空間超解像・階調補間部２０は、再量子化部１０により生成された再量子化画像を目標とする空間解像度に空間超解像するとともに、フィルタを用いて同時に階調補間する。図２に示す例では、空間超解像・階調補間部２０は、周波数分解部２１と、階調補間部２２と、周波数再構成部２３とを備える。   The spatial super-resolution / gradation interpolation unit 20 performs spatial super-resolution on the re-quantized image generated by the re-quantization unit 10 to a target spatial resolution and simultaneously performs gradation interpolation using a filter. In the example illustrated in FIG. 2, the spatial super-resolution / gradation interpolation unit 20 includes a frequency decomposition unit 21, a gradation interpolation unit 22, and a frequency reconstruction unit 23.

周波数分解部２１は、再量子化部１０により生成された再量子化画像をデシメーション無しで（つまり、周波数帯域成分の画像サイズの縮小を行わずに）周波数分解（例えば、ウェーブレット分解）し、再量子化画像の空間標本化周波数を超える高周波帯域成分を階調補間部２２に出力する。   The frequency decomposition unit 21 performs frequency decomposition (for example, wavelet decomposition) on the requantized image generated by the requantization unit 10 without decimation (that is, without reducing the image size of the frequency band component), A high frequency band component exceeding the spatial sampling frequency of the quantized image is output to the gradation interpolation unit 22.

階調補間部２２は、再量子化部１０により生成された再量子化画像、及び周波数分解部２１により生成された高周波帯域成分に波形整形用のフィルタを適用して再量子化整形画像、及び高周波帯域整形成分を生成し、周波数再構成部２３に出力する。フィルタ処理を行うことにより、超解像処理と同時に階調補間処理を行うことができる。階調補間部２２で用いるフィルタとして、例えば、原画像の撮影時における光学的な劣化過程を模擬した低域通過フィルタである点拡がり関数（ＰＳＦ：Point spread function）のフィルタ、ガウシアン関数のフィルタ、Lanczosフィルタなどを用いることができる。   The gradation interpolation unit 22 applies a waveform shaping filter to the requantized image generated by the requantization unit 10 and the high frequency band component generated by the frequency decomposition unit 21, and A high frequency band shaping component is generated and output to the frequency reconstruction unit 23. By performing the filter process, the gradation interpolation process can be performed simultaneously with the super-resolution process. As a filter used in the gradation interpolation unit 22, for example, a point spread function (PSF) filter, a Gaussian function filter, which is a low-pass filter simulating an optical degradation process at the time of capturing an original image, Lanczos filters can be used.

あるいは、階調補間部２２で用いる低域通過フィルタとして、バイラテラルフィルタを用いることができる。バイラテラルフィルタは、画像はエッジ領域以外では階調が滑らかに変化すると仮定し、エッジを保持しながら低域通過フィルタ処理を行うフィルタである。バイラテラルフィルタを用いて波形整形及び階調補間を同時に行うことで、標本化と量子化間の高い相関を利用した空間超解像・階調補間が可能となる。例えば、輝度変化が少ない平坦な空間領域では、空間高周波帯域のパワーが低く輝度値が滑らかに変化するように作用する。また、輝度変化が大きいエッジ領域では、空間高周波帯域のパワーが高く輝度値が大きく変化するように作用する。   Alternatively, a bilateral filter can be used as the low-pass filter used in the gradation interpolation unit 22. The bilateral filter is a filter that performs low-pass filter processing while maintaining an edge on the assumption that the gradation of the image changes smoothly except in the edge region. By simultaneously performing waveform shaping and gradation interpolation using a bilateral filter, spatial super-resolution and gradation interpolation using a high correlation between sampling and quantization becomes possible. For example, in a flat space area where the luminance change is small, the power in the spatial high frequency band is low and the luminance value is changed smoothly. In the edge region where the luminance change is large, the power in the spatial high frequency band is high, and the luminance value is changed greatly.

周波数再構成部２３は、階調補間部２２により生成された再量子化整形画像を空間低周波帯域とし、階調補間部２２により生成された高周波帯域整形成分を空間高周波帯域成分として、周波数再構成（例えば、ウェーブレット再構成）し、空間超解像・階調補間画像を生成し、出力する。   The frequency reconstruction unit 23 uses the requantized shaped image generated by the gradation interpolation unit 22 as a spatial low frequency band, and uses the high frequency band shaped component generated by the gradation interpolation unit 22 as a spatial high frequency band component. A configuration (for example, wavelet reconstruction) is performed, and a spatial super-resolution / tone-interpolated image is generated and output.

図３は、空間超解像・階調補間部２０の動作例を説明する図であり、空間超解像処理により解像度を縦横それぞれ２倍にする例を示している。まず、周波数分解部２１により、再量子化画像Ｓを周波数分解する（ステップＳ１０１）。ここでは、周波数分解としてデシメーション無しの１階離散ウェーブレット分解を行っている。ＬＬは低周波帯域成分であり、ＬＨは水平方向高周波帯域成分であり、ＨＬは垂直方向高周波帯域成分であり、ＨＨは斜め方向高周波帯域成分である。ＬＨ，ＨＬ，ＨＨを高周波帯域成分とする。   FIG. 3 is a diagram for explaining an example of the operation of the spatial super-resolution / gradation interpolation unit 20 and shows an example in which the resolution is doubled both vertically and horizontally by the spatial super-resolution processing. First, the frequency decomposition unit 21 performs frequency decomposition on the requantized image S (step S101). Here, first-order discrete wavelet decomposition without decimation is performed as frequency decomposition. LL is a low frequency band component, LH is a horizontal high frequency band component, HL is a vertical high frequency band component, and HH is a diagonal high frequency band component. Let LH, HL, and HH be high frequency band components.

次に、階調補間部２２により、再量子化画像Ｓ及び高周波帯域成分ＬＨ，ＨＬ，ＨＨにそれぞれ波形整形用のフィルタを適用し、再量子化整形画像Ｓ’、及び高周波帯域整形成分ＬＨ’，ＨＬ’，ＨＨ’を生成する（ステップＳ１０２）。   Next, the tone interpolation unit 22 applies filters for waveform shaping to the requantized image S and the high frequency band components LH, HL, and HH, respectively, so that the requantized shaped image S ′ and the high frequency band shaped component LH ′. , HL ′ and HH ′ are generated (step S102).

次に、周波数再構成部２３により、再量子化整形画像Ｓ’を空間低周波帯域とし、高周波帯域整形成分ＬＨ’，ＨＬ’，ＨＨ’を空間高周波帯域成分として配置する（ステップＳ１０３）。そして、周波数再構成部２３により、ステップＳ１０３にて配置した周波帯域成分をウェーブレット再構成し、空間超解像・階調補間画像を生成する（ステップＳ１０４）。   Next, the frequency reconstruction unit 23 arranges the requantized shaped image S ′ as a spatial low frequency band and arranges the high frequency band shaped components LH ′, HL ′, and HH ′ as spatial high frequency band components (step S <b> 103). Then, the frequency reconstruction unit 23 performs wavelet reconstruction of the frequency band components arranged in step S103, and generates a spatial super-resolution / tone-interpolated image (step S104).

以上説明したように、本発明に係る空間超解像・階調補間装置１は、原画像を目標階調数に再量子化した再量子化画像を生成した後に、再量子化画像を目標解像度に空間超解像するとともに、フィルタ処理により階調補間して、空間超解像・階調補間画像を生成する。つまり、再量子化画像の空間超解像処理及び階調補間処理を同時に行う。このため、空間超解像・階調補間装置１によれば、効率的且つ高精度に空間超解像・階調補間画像を得ることができる。   As described above, the spatial super-resolution / gradation interpolation apparatus 1 according to the present invention generates a re-quantized image obtained by re-quantizing the original image to the target number of gradations, and then converts the re-quantized image to the target resolution. In addition, spatial super-resolution and gradation interpolation by filter processing are performed to generate a spatial super-resolution / tone-interpolated image. That is, spatial super-resolution processing and gradation interpolation processing of the requantized image are performed simultaneously. For this reason, according to the spatial super resolution / gradation interpolation apparatus 1, a spatial super resolution / gradation interpolation image can be obtained efficiently and with high accuracy.

なお、上述した空間超解像・階調補間装置１として機能させるためにコンピュータを用いることができ、そのようなコンピュータは、空間超解像・階調補間装置１の各機能を実現する処理内容を記述したプログラムを該コンピュータの記憶部に格納しておき、該コンピュータのＣＰＵによってこのプログラムを読み出して実行させることで実現することができる。なお、このプログラムは、コンピュータ読取り可能な記録媒体に記録することができる。   Note that a computer can be used to function as the spatial super-resolution / tone interpolation device 1 described above, and such a computer performs processing contents for realizing each function of the spatial super-resolution / tone interpolation device 1. Is stored in a storage unit of the computer, and the program is read and executed by the CPU of the computer. This program can be recorded on a computer-readable recording medium.

上述の実施形態は、代表的な例として説明したが、本発明の趣旨及び範囲内で、多くの変更及び置換ができることは当業者に明らかである。したがって、本発明は上述の実施形態によって制限するものと解するべきではなく、特許請求の範囲から逸脱することなく、種々の変形や変更が可能である。例えば、実施形態に記載の複数の構成ブロックを１つに組み合わせたり、あるいは１つの構成ブロックを分割したりすることが可能である。   Although the above embodiments have been described as representative examples, it will be apparent to those skilled in the art that many changes and substitutions can be made within the spirit and scope of the invention. Therefore, the present invention should not be construed as being limited by the above-described embodiments, and various modifications and changes can be made without departing from the scope of the claims. For example, a plurality of constituent blocks described in the embodiments can be combined into one, or one constituent block can be divided.

このように、本発明は、画像を空間超解像処理及び階調補間処理して、所定の目標解像度及び目標階調数を有する空間超解像・階調補間画像を生成する任意の用途に有用である。   As described above, the present invention can be applied to any application that performs spatial super-resolution processing and gradation interpolation processing on an image to generate a spatial super-resolution / tone-interpolated image having a predetermined target resolution and target number of gradations. Useful.

１ 空間超解像・階調補間装置
１０ 再量子化部
２０ 空間超解像・階調補間部
２１ 周波数分解部
２２ 階調補間部
２３ 周波数再構成部 DESCRIPTION OF SYMBOLS 1 Spatial super-resolution / tone interpolation device 10 Re-quantization unit 20 Spatial super-resolution / tone interpolation unit 21 Frequency decomposition unit 22 Tone interpolation unit 23 Frequency reconfiguration unit

Claims (4)

原画像を空間超解像処理及び階調補間処理して、所定の目標解像度及び目標階調数を有する空間超解像・階調補間画像を生成する空間超解像・階調補間装置であって、
原画像を目標階調数に再量子化した再量子化画像を生成する再量子化部と、
前記再量子化画像を目標解像度に空間超解像するとともに、フィルタ処理により階調補間して、空間超解像・階調補間画像を生成する空間超解像・階調補間部と、
を備えることを特徴とする空間超解像・階調補間装置。 A spatial super-resolution / tone interpolation device that performs spatial super-resolution processing and gradation interpolation processing on an original image to generate a spatial super-resolution / tone-interpolated image having a predetermined target resolution and target number of gradations. And
A requantization unit that generates a requantized image obtained by requantizing the original image to a target number of gradations;
A spatial super-resolution / tone interpolation unit that spatially resolves the re-quantized image to a target resolution and performs gradation interpolation by filter processing to generate a spatial super-resolution / tone-interpolated image;
A spatial super-resolution / gradation interpolation apparatus characterized by comprising: 前記空間超解像・階調補間部は、
前記再量子化画像を周波数分解して高周波帯域成分を生成する周波数分解部と、
前記再量子化画像及び前記高周波帯域成分をフィルタ処理により階調補間して、再量子化整形画像及び高周波帯域整形成分を生成する階調補間部と、
前記再量子化整形画像を低周波帯域成分とし前記高周波帯域整形成分を高周波帯域成分として周波数再構成して、前記空間超解像・階調補間画像を生成する周波数再構成部と、
を備えることを特徴とする、請求項１に記載の空間超解像・階調補間装置。 The spatial super-resolution / tone interpolation unit is
A frequency resolving unit that generates a high frequency band component by frequency resolving the requantized image;
A gradation interpolation unit that performs gradation interpolation on the requantized image and the high-frequency band component by filtering, and generates a re-quantized shaped image and a high-frequency band shaped component;
A frequency reconfiguring unit that generates the spatial super-resolution / tone-interpolated image by reconfiguring the re-quantized shaped image as a low frequency band component and the high frequency band shaped component as a high frequency band component;
The spatial super-resolution / tone interpolation device according to claim 1, comprising: 前記周波数分解部は、ウェーブレット分解して前記高周波帯域成分を生成し、
前記階調補間部は、バイラテラルフィルタを用いて前記フィルタ処理を行うことを特徴とする、請求項２に記載の空間超解像・階調補間装置。 The frequency resolving unit generates the high frequency band component by wavelet decomposition,
The spatial super-resolution / gradation interpolation apparatus according to claim 2, wherein the gradation interpolation unit performs the filtering process using a bilateral filter. コンピュータを、請求項１から３のいずれか一項に記載の空間超解像・階調補間装置として機能させるためのプログラム。

A program for causing a computer to function as the spatial super-resolution / gradation interpolation device according to any one of claims 1 to 3.

JP2014003339A 2014-01-10 2014-01-10 Spatial super-resolution / tone interpolation device and program Active JP6276596B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2014003339A JP6276596B2 (en) 2014-01-10 2014-01-10 Spatial super-resolution / tone interpolation device and program

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2014003339A JP6276596B2 (en) 2014-01-10 2014-01-10 Spatial super-resolution / tone interpolation device and program

Publications (2)

Publication Number Publication Date
JP2015132930A true JP2015132930A (en) 2015-07-23
JP6276596B2 JP6276596B2 (en) 2018-02-07

Family

ID=53900087

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2014003339A Active JP6276596B2 (en) 2014-01-10 2014-01-10 Spatial super-resolution / tone interpolation device and program

Country Status (1)

Country Link
JP (1) JP6276596B2 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2018190145A (en) * 2017-05-01 2018-11-29 日本放送協会 Spatial/gradation super-resolution apparatus and program
JP2019049865A (en) * 2017-09-11 2019-03-28 日本放送協会 Gradation super-resolution device and program
KR20190109207A (en) * 2018-03-16 2019-09-25 엘지전자 주식회사 Signal processing device and image display apparatus including the same
KR102214502B1 (en) * 2019-12-13 2021-02-09 한국과학기술원 Image joint processing method and apparatus

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2005067294A1 (en) * 2004-01-09 2005-07-21 Matsushita Electric Industrial Co., Ltd. Image processing method, image processing device, and image processing program
JP2006110816A (en) * 2004-10-13 2006-04-27 Sony Corp Printing controller, printer, information processor, printing control method and program

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2005067294A1 (en) * 2004-01-09 2005-07-21 Matsushita Electric Industrial Co., Ltd. Image processing method, image processing device, and image processing program
JP2006110816A (en) * 2004-10-13 2006-04-27 Sony Corp Printing controller, printer, information processor, printing control method and program

Cited By (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2018190145A (en) * 2017-05-01 2018-11-29 日本放送協会 Spatial/gradation super-resolution apparatus and program
JP7002213B2 (en) 2017-05-01 2022-01-20 日本放送協会 Spatial / gradation super-resolution device and program
JP2019049865A (en) * 2017-09-11 2019-03-28 日本放送協会 Gradation super-resolution device and program
KR20190109204A (en) * 2018-03-16 2019-09-25 엘지전자 주식회사 Signal processing device and image display apparatus including the same
KR20190109206A (en) * 2018-03-16 2019-09-25 엘지전자 주식회사 Signal processing device and image display apparatus including the same
KR102142019B1 (en) * 2018-03-16 2020-09-14 엘지전자 주식회사 Signal processing device and image display apparatus including the same
KR102157545B1 (en) * 2018-03-16 2020-09-18 엘지전자 주식회사 Signal processing device and image display apparatus including the same
US10923018B2 (en) 2018-03-16 2021-02-16 Lg Electronics Inc. Signal processing device, method of enhancing image signal, and image display apparatus including the same
US11081041B2 (en) 2018-03-16 2021-08-03 Lg Electronics Inc. Signal processing device and image display apparatus including the same
KR20190109207A (en) * 2018-03-16 2019-09-25 엘지전자 주식회사 Signal processing device and image display apparatus including the same
US11669941B2 (en) 2018-03-16 2023-06-06 Lg Electronics Inc. Signal processing device and image display apparatus including the same
KR102546990B1 (en) * 2018-03-16 2023-06-23 엘지전자 주식회사 Signal processing device and image display apparatus including the same
US11748855B2 (en) 2018-03-16 2023-09-05 Lg Electronics Inc. Signal processing device and image display apparatus including the same
KR102214502B1 (en) * 2019-12-13 2021-02-09 한국과학기술원 Image joint processing method and apparatus
KR20210075910A (en) * 2019-12-13 2021-06-23 한국과학기술원 Deep joint frame processing method and apparatus apparatus for performing frame interpolation, super-resolution or inverse tone mapping
KR102307622B1 (en) 2019-12-13 2021-10-01 한국과학기술원 Deep joint frame processing method and apparatus apparatus for performing frame interpolation, super-resolution or inverse tone mapping

Also Published As

Publication number Publication date
JP6276596B2 (en) 2018-02-07

Similar Documents

Publication Publication Date Title
JP6432214B2 (en) Image processing apparatus, image processing method, storage medium, and program
JP2016058081A (en) Method and device for generating sharp image on the basis of blurry image
JP2011188391A (en) Image processing apparatus, method and program
JP6276596B2 (en) Spatial super-resolution / tone interpolation device and program
JP2018537056A (en) High dynamic range color conversion correction
JP2014199664A (en) Gray scale image processing method and apparatus
JP7141862B2 (en) Method for tone-adapting an image to the target peak luminance of a target display device
JP6376767B2 (en) Image processing apparatus and image processing method
JP6174903B2 (en) Spatial / gradation super-resolution device and program
JP6778541B2 (en) Super-resolution device and program
JP6354586B2 (en) Noise removal system, noise removal method and program
JP2010101924A (en) Image processing apparatus, image processing method, and program
JP2018190145A (en) Spatial/gradation super-resolution apparatus and program
JP2018056969A (en) Image processing device
WO2011087083A1 (en) Data processing method, data processing device and data processing program
JP6388476B2 (en) Encoding apparatus and program
JP5837844B2 (en) Pseudo contour region detection device and program
JP5878785B2 (en) Gradation reduction apparatus and program
JP6190170B2 (en) Space / gradation reduction apparatus and program
JP2011049696A (en) Image processing device, and image processing method
JP5934031B2 (en) Gradation reduction apparatus and program
JP2016076758A (en) Reproducer, encoder, and reproduction method
JP2020088449A (en) Image processing apparatus, image processing method, and program
WO2017183297A1 (en) Image processing device, image processing program and image processing method, and image transmission/reception system and image transmission/reception method
JP6163022B2 (en) Encoding apparatus and program

Legal Events

Date Code Title Description
A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20161128

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20170926

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20171124

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20171219

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20180112

R150 Certificate of patent or registration of utility model

Ref document number: 6276596

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250