WO2012043407A1 - 信号処理装置、制御プログラム、および集積回路 - Google Patents
信号処理装置、制御プログラム、および集積回路 Download PDFInfo
- Publication number
- WO2012043407A1 WO2012043407A1 PCT/JP2011/071706 JP2011071706W WO2012043407A1 WO 2012043407 A1 WO2012043407 A1 WO 2012043407A1 JP 2011071706 W JP2011071706 W JP 2011071706W WO 2012043407 A1 WO2012043407 A1 WO 2012043407A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- signal
- sharpening
- horizontal
- vertical
- sub
- Prior art date
Links
- 238000012545 processing Methods 0.000 title claims abstract description 568
- 238000006243 chemical reaction Methods 0.000 claims description 54
- 238000004364 calculation method Methods 0.000 claims description 43
- 230000009467 reduction Effects 0.000 claims description 33
- 238000000034 method Methods 0.000 abstract description 110
- 230000008569 process Effects 0.000 abstract description 100
- 238000010586 diagram Methods 0.000 description 53
- 230000006870 function Effects 0.000 description 34
- 238000000605 extraction Methods 0.000 description 22
- 230000004069 differentiation Effects 0.000 description 14
- 230000002238 attenuated effect Effects 0.000 description 12
- 238000005070 sampling Methods 0.000 description 12
- 230000004048 modification Effects 0.000 description 11
- 238000012986 modification Methods 0.000 description 11
- 238000001228 spectrum Methods 0.000 description 10
- 238000007796 conventional method Methods 0.000 description 8
- 238000004891 communication Methods 0.000 description 7
- 230000001965 increasing effect Effects 0.000 description 7
- 230000005540 biological transmission Effects 0.000 description 5
- 230000000694 effects Effects 0.000 description 5
- 230000000630 rising effect Effects 0.000 description 5
- 238000013461 design Methods 0.000 description 4
- 230000015654 memory Effects 0.000 description 4
- 230000015556 catabolic process Effects 0.000 description 3
- 238000006731 degradation reaction Methods 0.000 description 3
- 230000003111 delayed effect Effects 0.000 description 2
- 230000002708 enhancing effect Effects 0.000 description 2
- 238000012886 linear function Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- NAWXUBYGYWOOIX-SFHVURJKSA-N (2s)-2-[[4-[2-(2,4-diaminoquinazolin-6-yl)ethyl]benzoyl]amino]-4-methylidenepentanedioic acid Chemical compound C1=CC2=NC(N)=NC(N)=C2C=C1CCC1=CC=C(C(=O)N[C@@H](CC(=C)C(O)=O)C(O)=O)C=C1 NAWXUBYGYWOOIX-SFHVURJKSA-N 0.000 description 1
- 101150012579 ADSL gene Proteins 0.000 description 1
- 102100020775 Adenylosuccinate lyase Human genes 0.000 description 1
- 108700040193 Adenylosuccinate lyases Proteins 0.000 description 1
- 230000000903 blocking effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000000593 degrading effect Effects 0.000 description 1
- 230000006866 deterioration Effects 0.000 description 1
- 239000003623 enhancer Substances 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/14—Picture signal circuitry for video frequency region
- H04N5/20—Circuitry for controlling amplitude response
- H04N5/205—Circuitry for controlling amplitude response for correcting amplitude versus frequency characteristic
- H04N5/208—Circuitry for controlling amplitude response for correcting amplitude versus frequency characteristic for compensating for attenuation of high frequency components, e.g. crispening, aperture distortion correction
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/14—Picture signal circuitry for video frequency region
- H04N5/142—Edging; Contouring
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/73—Deblurring; Sharpening
Definitions
- the present invention relates to a signal processing device or the like that improves image quality by sharpening an image.
- contour compensation is performed to make the rise and fall of an image signal corresponding to the contour portion of an image displayed on the own device steep.
- This contour compensation is performed by extracting a high frequency component of an image signal (luminance signal) input to a display of a television receiver and adding the extracted high frequency component to the input image signal. Done.
- the frequency characteristics of the image signal that deteriorates due to processing performed in each circuit in the television receiver is improved, and the apparent image quality is improved.
- Patent Document 1 There is a technique disclosed in Patent Document 1 as a technique related to improvement in image quality degradation.
- the technique disclosed in Patent Document 1 is a technique for improving the encoding efficiency of an image signal by using a spatio-temporal filter and an enhancer using a linear operation.
- Japanese Patent Publication Japanese Patent Laid-Open No. 2006-310934 (Publication Date: November 9, 2006)”
- the sharpening process according to the prior art is a process for performing a linear operation on an image signal to be processed. Therefore, in the sharpening process according to the conventional technique, although the frequency component in the vicinity of the Nyquist frequency fs / 2 that is a half of the sampling frequency fs increases, the frequency component higher than the Nyquist frequency fs / 2 (that is, the processing) High frequency components not included in the target image signal) cannot be used. For this reason, the image quality cannot be sufficiently improved particularly when an image is enlarged.
- the resolution of a high-definition television (HDTV: High Definition Television) (1080 ⁇ 1920 pixel full high-definition) television receiver that is displayed on a conventional analog television or the like is half that of full high-definition television.
- HDTV High Definition Television
- the image signal after the enlargement process is in the vicinity of the Nyquist frequency Fbs / 2.
- the sharpening process according to the conventional technique is performed, the image after the enlargement process is displayed in a blurred manner.
- the spatio-temporal filter is used to attenuate the high-frequency components in the oblique direction except for the horizontal and vertical directions of the image, and then sharpen the image.
- the processing it is possible to suppress a phenomenon in which oblique lines appear to be glaring in an image after the sharpening processing.
- the image quality cannot be sufficiently improved in the horizontal direction and the vertical direction of the image for the reasons described above.
- the present invention has been made in view of the above problems, and an object of the present invention is to provide a signal processing device, a control program, and an integrated circuit capable of highly sharpening an image with a simple configuration. It is in.
- a signal processing device performs a process for sharpening the image on an input signal representing an image, and outputs a signal representing the sharpened image.
- a high-frequency component removing unit that generates a diagonally reduced signal by removing a high-frequency component from the input signal among frequency components in a direction excluding a horizontal direction and a vertical direction of an image represented by the input signal;
- Sharpening means for receiving a diagonal reduction signal and outputting a sharpening signal obtained by sharpening the diagonal reduction signal, and the sharpening means is adjacent to the horizontal direction of the image represented by the input signal.
- a horizontal-side sharpening means for outputting a horizontal-side sharpening signal obtained by sharpening a signal representing a pixel group consisting of pixels arranged in parallel, and a pixel comprising pixels arranged adjacent to each other in the vertical direction of the image represented by the input signal
- Vertical-side sharpening means for outputting a vertical-side sharpening signal obtained by sharpening a signal representing the horizontal sharpening means, wherein the horizontal-side sharpening means and the vertical-side sharpening means are connected in cascade, and the diagonal reduction
- the signal is input to the horizontal-side sharpening means or the vertical-side sharpening means on the upper stage side connected in cascade, and the sharpening means is connected to the horizontal-side sharpening means or the vertical-side side on the lower stage side connected in cascade.
- the signal output from the sharpening means is output as the sharpening signal
- the horizontal-side sharpening means represents a pixel group composed of pixels arranged adjacent to each other in the horizontal direction of the image represented by the input signal.
- Horizontal side low frequency component removal means for generating and outputting a horizontal side low frequency removal signal by removing at least a direct current component from frequency components included in the signal, and the horizontal side low frequency removal signal as inputs, and the horizontal side ⁇ side Horizontal-side nonlinearity that monotonically increases in a broad sense in a non-linear manner with respect to the horizontal-side low-frequency rejection signal when the sign of the frequency-removed signal is maintained and at least the value of the horizontal-side low-frequency rejection signal is near 0
- a horizontal non-linear processing means for generating a processed signal and outputting the horizontal non-linear processed signal; a signal input to the horizontal sharpening means and the horizontal non-linear processed signal; Horizontal-side addition means for generating and outputting a sharpening signal
- the vertical low frequency component removing means for generating and outputting a vertical low frequency removal signal by removing at least a direct current component from the frequency component included in the output, and the vertical low frequency removal signal as inputs, When the sign of the vertical low frequency rejection signal is maintained, and at least when the value of the vertical low frequency rejection signal is close to 0, monotonically increases in a non-linear and broad sense with respect to the vertical low frequency rejection signal.
- a vertical addition means for generating and outputting the vertical sharpening signal.
- An integrated circuit is an integrated circuit that performs a process for sharpening the image on an input signal representing an image and outputs a signal representing the sharpened image.
- a high-frequency component removing circuit that generates a diagonally reduced signal by removing a high-frequency component from the input signal among frequency components in directions other than the horizontal direction and vertical direction of the image represented;
- a sharpening circuit that outputs a sharpening signal obtained by sharpening an oblique reduction signal, and the sharpening circuit includes a group of pixels arranged adjacent to each other in the horizontal direction of an image represented by the input signal.
- a vertical sharpening circuit for outputting a sharpening signal the horizontal sharpening circuit and the vertical sharpening circuit are connected in cascade, and the diagonal reduction signal is connected in an upper stage connected in cascade Input to the horizontal side sharpening circuit or the vertical side sharpening circuit on the side, and the sharpening circuit is a signal output from the horizontal side sharpening circuit or the vertical side sharpening circuit on the lower stage side connected in cascade Is output as the sharpening signal, the horizontal sharpening circuit from the frequency component included in the signal representing the pixel group consisting of pixels arranged adjacent in the horizontal direction of the image represented by the input signal, A horizontal side low frequency component removal circuit that generates and outputs a horizontal side low frequency removal signal by removing at least a direct current component, and the horizontal side low frequency removal signal as inputs, and the sign of the horizontal side low frequency removal signal Positive or negative And at least when the value of the horizontal side low frequency rejection signal is near 0, a horizontal side nonlinear processing signal that monotonically increases in a non-linear and
- the vertical side sharpening circuit includes a frequency component included in a signal representing a pixel group composed of pixels arranged adjacent to each other in the vertical direction of the image represented by the input signal.
- a vertical low frequency component removal circuit that generates and outputs a vertical low frequency removal signal by removing at least a direct current component, and the vertical low frequency removal signal as inputs.
- the vertical-side non-linear processing circuit that outputs the vertical-side non-linear processing signal, and the signal input to the vertical-side sharpening circuit and the vertical-side non-linear processing signal are added to obtain the vertical-side sharpening signal.
- a vertical adder circuit for generating and outputting.
- the oblique reduction signal is generated by removing the high frequency component from the input signal among the frequency components in the direction excluding the horizontal direction and the vertical direction of the image represented by the input signal.
- two sharpening processes are sequentially performed and a sharpening signal is output.
- the sharpening process is a process for generating a horizontal sharpening signal that is a harmonic obtained by sharpening a signal that represents a group of pixels that are arranged adjacent to each other in the horizontal direction of an image represented by an input signal. is there.
- generating the horizontal sharpening signal first, at least a direct current component is removed from a frequency component included in a signal representing a pixel group composed of pixels arranged adjacent to each other in the horizontal direction of the image represented by the input signal. As a result, a horizontal low frequency removal signal is generated.
- the sign of the horizontal low frequency removal signal when the sign of the horizontal low frequency removal signal is maintained, and at least when the value of the horizontal low frequency removal signal is near 0, it increases monotonically in a non-linear and broad sense with respect to the horizontal low frequency removal signal.
- a horizontal nonlinear processing signal is generated.
- the horizontal side sharpening signal is generated by adding the input signal and the horizontal low frequency removal signal.
- the other sharpening process generates a vertical sharpening signal that is a harmonic that sharpens a signal that represents a group of pixels that are arranged adjacent to each other in the vertical direction of the image represented by the input signal. It is processing to do.
- a vertical sharpening signal first, at least a DC component is removed from a frequency component included in a signal representing a pixel group composed of pixels arranged adjacent to each other in the vertical direction of the image represented by the input signal.
- a vertical low frequency removal signal is generated.
- the sign of the vertical side low frequency rejection signal is maintained and at least the value of the vertical side low frequency rejection signal is close to 0, it increases monotonically in a non-linear and broad sense with respect to the vertical side low frequency rejection signal.
- a vertical nonlinear processing signal is generated.
- the vertical sharpening signal is generated by adding the input signal and the vertical low frequency removal signal.
- the two sharpening processes do not apply non-linear processing to the frequency components in the direction excluding the horizontal direction and vertical direction of the image represented by the diagonally reduced signal, and to the frequency components in the horizontal direction and vertical direction of the image.
- a signal subjected to nonlinear processing can be output as a sharpening signal.
- the horizontal sharpening signal is generated by adding an input signal and a horizontal nonlinear processing signal subjected to nonlinear processing such as squaring the horizontal low frequency removal signal.
- the sign of the generated signal maintains the sign of the horizontal low frequency removal signal.
- the vertical sharpening signal is generated by adding an input signal and a vertical nonlinear processing signal subjected to nonlinear processing such as squaring the vertical low frequency removal signal.
- the sign of the generated signal maintains the sign of the sign of the vertical low frequency removal signal.
- the horizontal-side sharpening signal and the vertical-side sharpening signal include high-band frequency components that are not included in the oblique reduction signal.
- the horizontal side sharpening signal and the vertical side sharpening signal include frequency components higher than the Nyquist frequency, which is a half of the sampling frequency in the case of discretizing the oblique reduction signal.
- the signal processing device and the integrated circuit according to the present invention attenuate the frequency component in the oblique direction of the image, and then rise and fall of the signal corresponding to the edge portion of the horizontal and vertical frequency components of the image. Can be made steep.
- the rising and falling of the signal corresponding to the edge portion can be made sharper.
- the signal processing apparatus and the integrated circuit according to the present invention have a phenomenon in which the diagonal lines of the sharpened image appear to be glaring while sharpening higher (stronger) than in the past in the horizontal and vertical directions of the image. Therefore, the image quality and the sense of resolution can be greatly improved.
- a signal processing device is a signal processing device that performs processing for sharpening the image on an input signal representing an image and outputs a signal representing the sharpened image.
- a high-frequency component removing means for generating a diagonally reduced signal by removing a high-frequency component from the input signal among frequency components in a direction excluding a horizontal direction and a vertical direction of an image represented by the input signal, and the diagonally reduced signal
- a sharpening means for outputting a sharpening signal obtained by sharpening the oblique reduction signal, and the sharpening means includes pixels arranged adjacent to each other in the horizontal direction of the image represented by the input signal.
- a horizontal-side sharpening means for outputting a horizontal-side sharpening signal obtained by sharpening a signal representing a pixel group consisting of the pixel group, and a pixel group consisting of pixels arranged adjacent to each other in the vertical direction of the image represented by the input signal.
- Vertical-side sharpening means for outputting a sharpened vertical-side sharpening signal
- the horizontal-side sharpening means and the vertical-side sharpening means are connected in cascade
- the oblique reduction signal is Input to the horizontal-side sharpening means or the vertical-side sharpening means connected on the upper stage side, the sharpening means from the horizontal-side sharpening means or the vertical-side sharpening means on the lower-stage connected in cascade
- the output signal is output as the sharpening signal
- the horizontal sharpening means is included in a signal representing a pixel group consisting of pixels arranged adjacent to each other in the horizontal direction of the image represented by the input signal.
- Horizontal-side low-frequency component removal means for generating and outputting a horizontal-side low-frequency removal signal by removing at least a direct current component from the frequency component, and the horizontal-side low-frequency removal signal as inputs. Trust When the sign of the horizontal side low frequency removal signal is maintained and at least the value of the horizontal side low frequency removal signal is in the vicinity of 0, the horizontal side nonlinear processing signal that monotonically increases in a non-linear and broad sense with respect to the horizontal side low frequency removal signal.
- a horizontal non-linear processing means for generating and outputting the horizontal non-linear processing signal; and adding the signal inputted to the horizontal sharpening means and the horizontal non-linear processing signal to obtain the horizontal sharpening signal.
- the horizontal-side sharpening means is included in a signal representing a pixel group composed of pixels arranged adjacent to each other in the vertical direction of the image represented by the input signal.
- a vertical low frequency component removing means for generating and outputting a vertical low frequency removal signal by removing at least a direct current component from the frequency component, and the vertical low frequency removal signal as inputs.
- a vertical nonlinear processing means for generating a processing signal and outputting the vertical nonlinear processing signal; and adding the signal inputted to the vertical sharpening means and the vertical nonlinear processing signal to the vertical side Vertical side addition means for generating and outputting a sharpening signal.
- An integrated circuit is an integrated circuit that performs a process for sharpening the image on an input signal representing an image and outputs a signal representing the sharpened image.
- a high-frequency component removing circuit that generates a diagonally reduced signal by removing a high-frequency component from the input signal among frequency components in directions other than the horizontal direction and vertical direction of the image represented;
- a sharpening circuit that outputs a sharpening signal obtained by sharpening an oblique reduction signal, and the sharpening circuit includes a group of pixels arranged adjacent to each other in the horizontal direction of an image represented by the input signal.
- a vertical sharpening circuit for outputting a sharpening signal the horizontal sharpening circuit and the vertical sharpening circuit are connected in cascade, and the diagonal reduction signal is connected in an upper stage connected in cascade Input to the horizontal side sharpening circuit or the vertical side sharpening circuit on the side, and the sharpening circuit is a signal output from the horizontal side sharpening circuit or the vertical side sharpening circuit on the lower stage side connected in cascade Is output as the sharpening signal, the horizontal sharpening circuit from the frequency component included in the signal representing the pixel group consisting of pixels arranged adjacent in the horizontal direction of the image represented by the input signal, A horizontal side low frequency component removal circuit that generates and outputs a horizontal side low frequency removal signal by removing at least a direct current component, and the horizontal side low frequency removal signal as inputs, and the sign of the horizontal side low frequency removal signal Positive or negative And at least when the value of the horizontal side low frequency rejection signal is near 0, a horizontal side nonlinear processing signal that monotonically increases in a non-linear and
- the vertical side sharpening circuit includes a frequency component included in a signal representing a pixel group composed of pixels arranged adjacent to each other in the vertical direction of the image represented by the input signal.
- a vertical low frequency component removal circuit that generates and outputs a vertical low frequency removal signal by removing at least a direct current component, and the vertical low frequency removal signal as inputs.
- the vertical-side non-linear processing circuit that outputs the vertical-side non-linear processing signal, and the signal input to the vertical-side sharpening circuit and the vertical-side non-linear processing signal are added to obtain the vertical-side sharpening signal.
- a vertical side adder circuit for generating and outputting.
- the rise and fall of the signal corresponding to the edge portion of the frequency component in the horizontal direction and the vertical direction of the image can be made steep.
- the rising and falling of the signal corresponding to the edge portion can be made sharper.
- FIG. 1 It is a block diagram which shows the structure of the signal processing apparatus which concerns on one Embodiment of this invention. It is a block diagram which shows the structure of the modification of the signal processing apparatus shown in FIG. It is a schematic diagram which shows the two-dimensional frequency characteristic of the two-dimensional filter with which the signal processing apparatus shown in FIG. 1 is provided. It is a trial figure which shows the example of a design of a two-dimensional filter.
- A) is explanatory drawing which shows the tap coefficient of a two-dimensional filter.
- B is a schematic diagram which shows the transmission characteristic of a two-dimensional filter. It is a schematic diagram which shows the other example of a design of a two-dimensional filter.
- A) is explanatory drawing which shows the tap coefficient of a two-dimensional filter.
- FIG. 9A is a diagram schematically illustrating a waveform of a signal input to the sharpening processing unit illustrated in FIG.
- FIG. 9B is a diagram schematically illustrating the waveform of the high-frequency signal generated by the sharpening processing unit illustrated in FIG. FIG.
- FIG. 9C is a diagram schematically illustrating the waveform of the nonlinear signal generated by the sharpening processing unit illustrated in FIG.
- FIG. 9D is a diagram schematically illustrating the waveform of the code conversion signal generated by the sharpening processing unit illustrated in FIG.
- FIG. 9E is a diagram schematically illustrating a waveform of an output signal generated by the sharpening processing unit illustrated in FIG.
- FIG. 10A is a diagram schematically illustrating a waveform of a signal input to the sharpening processing unit illustrated in FIG.
- FIG. 10B is a diagram schematically showing a waveform obtained by enhancing the signal shown in FIG. It is a block diagram which shows the other structure of the sharpening process part contained in the signal processing apparatus which concerns on this invention.
- FIG. 13A is a diagram schematically illustrating a waveform of a signal input to the sharpening processing unit illustrated in FIG.
- FIG. 13B is a diagram schematically showing the waveform of the high-frequency signal generated by the sharpening processing unit shown in FIG.
- FIG. 13C is a diagram schematically illustrating the waveform of the nonlinear signal generated by the sharpening processing unit illustrated in FIG. (D) of FIG. 13 is a figure which shows typically the waveform of the differential signal produced
- FIG. 13 is a figure which shows typically the waveform of the code conversion signal produced
- FIG. 13F is a diagram schematically illustrating the waveform of the output signal generated by the sharpening processing unit illustrated in FIG. It is a block diagram which shows the further another structure of the sharpening process part contained in the signal processing apparatus which concerns on this invention.
- (A) of FIG. 15 is a figure which shows typically the waveform of the signal input into the sharpening process part shown in FIG.
- FIG. 15B is a diagram schematically showing the waveform of the high-frequency signal generated by the sharpening processing unit shown in FIG.
- FIG. 15C schematically shows the waveform of the nonlinear signal generated by the sharpening processing unit shown in FIG. FIG.
- FIG. 15D is a diagram schematically illustrating a waveform of an output signal generated by the sharpening processing unit illustrated in FIG. It is a block diagram which shows the further another structure of the sharpening process part contained in the signal processing apparatus which concerns on this invention. It is a block diagram which shows the further another structure of the sharpening process part contained in the signal processing apparatus which concerns on this invention. It is a schematic diagram which shows the frequency spectrum of the image signal of sampling frequency fs.
- FIG. 19 is a schematic diagram showing the frequency spectrum of the image signal after the number of pixels is doubled in the horizontal direction by up-converting the image signal having the frequency spectrum shown in FIG. FIG.
- FIG. 20 is a schematic diagram illustrating a frequency spectrum of an image signal after a sharpening process is performed on the image signal having the frequency spectrum illustrated in FIG. 19 by the signal processing device illustrated in FIG. 1.
- A is a figure which shows the vertical line, horizontal line, and diagonal line which are contained in the image before sharpening.
- B) is a vertical line, horizontal line, and diagonal line after the sharpening process is performed on the vertical line, horizontal line, and diagonal line shown in (a) by the signal processing apparatus shown in FIG.
- FIG. (C) shows that the signal processing apparatus shown in FIG. 1 does not attenuate high frequency components with the two-dimensional filter included in the signal processing apparatus shown in FIG. 1 with respect to the oblique line of the image shown in (a).
- FIG. 1 It is a figure which shows the diagonal line contained in the image after performing the sharpening process in the sharpening process part provided. It is a block diagram which shows the structure of the signal processing apparatus which concerns on other embodiment of this invention. It is a block diagram which shows the structure of the modification of the signal processing apparatus shown in FIG. It is a block diagram which shows the structure of the signal processing apparatus which concerns on further another embodiment of this invention. It is a block diagram which shows the structure of the modification of the signal processing apparatus shown in FIG.
- the signal processing device (integrated circuit) 500 has a frequency component in the horizontal direction (horizontal direction and main scanning direction) and a frequency component in the vertical direction (vertical direction and sub-scanning direction) of the image.
- it is an apparatus that performs a sharpening process for sharpening an image.
- the sharpening process performed by the signal processing device 500 is a rise of a signal corresponding to a contour portion (edge) included in an image by performing a non-linear operation on a signal representing an image (hereinafter referred to as an image signal). And a process of making the trailing edge highly steep (enhanced).
- the sharpening process performed by the signal processing apparatus 500 can add a high frequency component that cannot be used in a conventionally known sharpening process using linear calculation to an image signal. Can be sharpened (strongly). Details of the sharpening process performed by the signal processing apparatus 500 will be described later.
- the frequency components in the oblique direction excluding the horizontal direction and the vertical direction of the image include a frequency component in the horizontal direction and a frequency component in the vertical direction. Therefore, if the horizontal frequency component and the vertical frequency component of the image are simply sharpened, the diagonal direction is excessively sharpened and the edge portion of the diagonal line is trimmed (see FIG. 21). (It will be described later in (c)). That is, simply by sharpening the frequency component in the horizontal direction and the frequency component in the vertical direction of an image, a phenomenon in which diagonal lines appear to be glaring generally occurs. Note that the phenomenon in which diagonal lines appear to be glaring occurs when subtitles (character supermarkets) or fine patterns (tree foliage, stadium seats) are sharpened. Also, flickering occurs when the sharpened diagonal line moves. Therefore, in order to prevent image quality deterioration, it is necessary to suppress a phenomenon in which diagonal lines appear to be glaring.
- the sharpening process performed by the signal processing device 500 sharpens the image at a higher level (stronger) than before, and simply sharpens the horizontal frequency component and the vertical frequency component of the image. If only, the phenomenon in which the diagonal lines appear to be glaring will occur more remarkably.
- the signal processing apparatus 500 attenuates the frequency component in the oblique direction of the image, and then performs the sharpening process on each of the horizontal frequency component and the vertical frequency component of the image.
- the signal processing device 500 it is possible to suppress a phenomenon in which the diagonal lines of the sharpened image appear to be glaring, while sharpening the image in the horizontal and vertical directions at a higher level (stronger) than before. .
- signal processing device 500 an image signal input to the signal processing device 500 is referred to as an input signal SA.
- An image signal output from the signal processing device 500 is denoted as an output signal SO.
- the image represented by the input signal SA may be a still image or a moving image. Furthermore, the moving image is displayed in real time on, for example, a standard definition television (SDTV: Standard Definition Television) or a high-definition television (HDTV) receiver. It is assumed that the moving image is composed of a plurality of temporally continuous frames (screens).
- SDTV Standard Definition Television
- HDTV high-definition television
- the input signal SA will be described as being constituted by a data string (series of pixel values) composed of pixel values of pixels arranged adjacent to each other in the horizontal direction of the image, but is arranged adjacent to each other in the vertical direction of the image. You may be comprised by the data sequence which consists of the pixel value of a pixel.
- a sharpening processing unit (horizontal-side sharpening means, vertical-side sharpening means, horizontal-side sub-sharpening means, vertical-side sub-sharpening means, horizontal-side sharpening circuit, which is a main component of the signal processing apparatus 500
- the outline of the vertical side sharpening circuit 100 will be described.
- the sharpening processing unit 100 may be any of the sharpening processing units 100a to 100e described later. In the present specification, when the sharpening processing units 100a to 100e are not distinguished, they are simply expressed as “sharpening processing unit 100”.
- the sharpening processing unit 100 performs a sharpening process for sharpening the waveform on the signal input to the sharpening processing unit 100 and outputs the sharpened signal.
- the sharpening process is a process of sharpening (enhancing) the rise and fall of a signal corresponding to a contour portion (edge) included in an image represented by an input signal.
- a signal input to the sharpening processing unit 100 is also referred to as an input signal Sin.
- a signal output from the sharpening processing unit 100 is also referred to as an output signal Sout.
- the sharpening processing unit 100 includes at least a non-linear processing unit that performs a non-linear operation (horizontal non-linear processing means, vertical non-linear processing means, horizontal sub-non-linear processing means, vertical sub-non-linear processing means, Horizontal non-linear processing circuit, vertical non-linear processing circuit) 102 is provided.
- a non-linear processing unit that performs a non-linear operation horizontal non-linear processing means, vertical non-linear processing means, horizontal sub-non-linear processing means, vertical sub-non-linear processing means, Horizontal non-linear processing circuit, vertical non-linear processing circuit
- non-linear processing unit 102 when non-linear processing units 102a to 102e described later are not distinguished, they are simply expressed as “non-linear processing unit 102”.
- the sharpening processing unit 100 performs a non-linear operation in the non-linear processing unit 102 on the high-frequency component of the input signal Sin, so that the high-frequency component (specifically, the input signal Sin is not included in the input signal Sin).
- the output signal Sout can include a frequency component higher than the Nyquist frequency, which is a half of the sampling frequency in the case of discretization. Therefore, when sharpening processing is performed by the sharpening processing unit 100, the rising and falling edges of the input signal Sin are made steeper than the sharpening processing using a conventionally known linear operation. Can do.
- the output signal Sout is also expressed as a harmonic of the input signal Sin.
- the signal processing device 500a is a device that performs a sharpening process in each of the horizontal direction and the vertical direction of the original image after reducing diagonal lines of the original image.
- the oblique direction of the image is generally less visible to humans than the horizontal and vertical directions of the image, so even if the oblique lines are reduced in the sharpened image, Does not affect the subjective image quality of the viewer.
- FIG. 1 is a block diagram showing a configuration of the signal processing device 500a.
- the signal processing device 500 a includes a two-dimensional filter (high frequency component removing means, high frequency component removing circuit) 200 and a sharpening unit (sharpening means, sharpening circuit) 150.
- the two-dimensional filter 200 is a so-called two-dimensional low-pass filter that attenuates high-frequency components in an oblique direction excluding the horizontal direction and the vertical direction of the original image represented by the input signal SA.
- a signal output from the two-dimensional filter 200 is referred to as a filter signal S200 (an oblique reduction signal). The characteristics of the two-dimensional filter 200 will be described later.
- the sharpening unit 150 includes two sharpening processing units 100 connected in cascade. As described above, the sharpening processing unit 100 outputs a higher harmonic wave of the input signal Sin by performing a non-linear operation on the high-frequency component included in the input signal Sin.
- One sharpening processing unit 100 performs sharpening processing in the horizontal direction of the image represented by the input signal.
- the sharpening processing unit 100 is particularly referred to as a sharpening processing unit 100A (horizontal sharpening means, horizontal sharpening circuit).
- the harmonic output from the sharpening processing unit 100A is referred to as a sharpening signal S101 (horizontal-side sharpening signal).
- the sharpening processing unit 100 performs sharpening processing in the vertical direction of the image represented by the input signal.
- the sharpening processing unit 100 is particularly referred to as a sharpening processing unit 100B (vertical sharpening means, vertical sharpening circuit).
- the harmonic output from the sharpening processing unit 100B is referred to as a sharpening signal S102 (vertical sharpening signal).
- the sharpening processing unit 100A is provided on the upper side of the cascade connection, and the sharpening processing unit 100B is provided on the lower side of the column connection.
- the filter signal S200 is input to the sharpening processing unit 100A, and the sharpening signal S101 output from the sharpening processing unit 100A is input to the sharpening processing unit 100B.
- the sharpening signal S102 output from the sharpening processing unit 100B becomes the output signal SO.
- connection order between the sharpening processing unit 100A and the sharpening processing unit 100B may be either. That is, instead of performing the sharpening process in the vertical direction after performing the sharpening process in the horizontal direction, the configuration may be such that the sharpening process is performed in the horizontal direction after performing the sharpening process in the vertical direction.
- the signal processing device 500 according to the modification is referred to as a signal processing device 500b.
- a block diagram showing the configuration of the signal processing device 500b is as shown in FIG.
- the signal processing device 500b includes a two-dimensional filter 200 and a sharpening unit (sharpening means, sharpening circuit) 151.
- the sharpening unit 151 includes a sharpening processing unit 100B in the upper stage.
- a sharpening processing unit 100A is provided in the lower stage in a cascade connection.
- the filter signal S200 is input to the sharpening processing unit 100B, and the sharpening signal S102 output from the sharpening processing unit 100B is input to the sharpening processing unit 100A.
- the sharpening signal S101 output from the sharpening processing unit 100A becomes the output signal SO.
- the signal processing device 500a and the signal processing device 500b is suitable depends on the frequency component included in the image to be sharpened. Specifically, a signal processing device 500a having a configuration in which sharpening processing is first performed in the horizontal direction for an image (for example, a television broadcast image) in which the horizontal frequency component is higher than the vertical frequency component. Is suitable. On the other hand, for an image having more frequency components in the vertical direction than frequency components in the horizontal direction, the signal processing device 500b having a configuration in which the sharpening process is first performed in the vertical direction is suitable.
- FIG. 3 shows a part of the two-dimensional frequency characteristic of an image, where the horizontal axis represents the horizontal frequency and the vertical axis represents the sub-horizontal frequency. Note that the horizontal sampling frequency is denoted by fh, and the sub-horizontal sampling frequency is denoted by fv.
- the two-dimensional filter 200 includes (1) a line segment AB, a line segment BC, a line segment CD, and a line segment connecting points indicating Nyquist frequencies on the horizontal and vertical axes shown in FIG.
- the frequency component is attenuated by at least 3 dB.
- the frequency component is attenuated by 3 dB or more.
- Points T, U, V , W satisfy the characteristic of blocking the frequency component. Any two-dimensional filter 200 may be used as long as the characteristics are satisfied.
- FIGS. 4 and 5 are schematic diagrams illustrating design examples of the two-dimensional filter 200.
- the two-dimensional filter 200 is designed with a two-dimensional low-pass filter configured by three taps in each of the horizontal direction and the vertical direction.
- the tap coefficient is set to the value shown in FIG. 4A
- the transmission characteristics of the two-dimensional filter 200 are as shown in FIG. 4B.
- the two-dimensional filter 200 can highly attenuate the high-frequency component in the oblique direction.
- the two-dimensional filter 200 is designed by a two-dimensional low-pass filter configured with 7 taps in each of the horizontal direction and the vertical direction.
- the tap coefficient is set to the value shown in FIG. 5A
- the transmission characteristics of the two-dimensional filter 200 are as shown in FIG. 5B.
- the two-dimensional filter 200 can attenuate the high-frequency component in the oblique direction to a higher degree.
- tap coefficients shown in FIGS. 4A and 5A are merely examples, and are not limited to these values.
- FIG. 6 is a block diagram illustrating a configuration of the sharpening processing unit 100a.
- the sharpening processing unit 100a includes a high-frequency component extraction unit (horizontal low-frequency component removal means, vertical low-frequency component removal means, horizontal sub-low frequency component removal means, vertical sub-low frequency component removal). Means, horizontal side low frequency component removal circuit, vertical side low frequency component removal circuit) 11, nonlinear processing unit 102a, and addition unit (horizontal side addition means, vertical side addition means, horizontal side sub addition means, vertical side sub addition means) Horizontal side addition circuit, vertical side addition circuit) 15.
- the high-frequency component extraction unit 11 generally extracts a high-frequency component included in the input signal Sin, and outputs a high-frequency signal S11 (horizontal low-frequency removal signal, vertical low-frequency removal signal, horizontal sub-low-frequency removal signal, Output as a vertical sub-low frequency removal signal).
- S11 horizontal low-frequency removal signal, vertical low-frequency removal signal, horizontal sub-low-frequency removal signal, Output as a vertical sub-low frequency removal signal.
- FIG. 7 is a block diagram showing a configuration of the high-frequency component extraction unit 11.
- the high-frequency component extracting unit 11 includes a filter 110, a rounding processing unit (low level signal removing unit) 132, and a limiter (high level signal removing unit) 133.
- each of the unit delay elements 111h is a signal delayed by unit time in the horizontal direction of the image represented by the input signal (that is, the image represented by the input signal).
- a signal representing a pixel group consisting of pixels arranged adjacent to each other in the horizontal direction is output.
- each of the unit delay elements 111h is delayed by a unit time in the vertical direction of the image represented by the input signal (that is, the image represented by the input signal).
- a signal representing a pixel group consisting of pixels arranged adjacently in the vertical direction is output.
- Each of the multipliers 112k multiplies the input signal by a coefficient Ck, and outputs the multiplication result to the adder 131.
- the addition unit 131 generates the high frequency signal SH1 by adding the signals output from the multiplication unit 112k.
- the filter 110 may be configured using a low-pass filter.
- FIG. 8 shows another configuration example of the filter 110. As shown in the figure, the filter 110 may be composed of a low-pass filter 1101 and a subtraction unit 1102.
- the rounding processing unit 132 generates a low-level removal signal SH2 by removing a low-level signal that can be regarded as noise included in the high-frequency signal SH1, so that the subsequent nonlinear processing unit 102 does not amplify the noise.
- the low level removal signal SH2 is generated by changing the signal value of the high frequency signal SH1 whose absolute value is equal to or lower than a predetermined lower limit LV to “0”.
- the input signal Sin can take any integer value from ⁇ 255 to 255, if the lower limit LV is “2”, the absolute value of the signal value of the high frequency signal SH1 is “2” or less. Are all regarded as noise and changed to “0” (that is, rounded).
- the limiter 133 removes the high level signal value included in the low level removal signal SH2 so as not to further amplify the signal having sufficient energy in the subsequent non-linear processing unit 102, thereby obtaining a high frequency signal. S11 is generated.
- the absolute value of the portion of the signal of the low level removal signal SH2 whose absolute value is larger than the upper limit value UV1 is set so that the signal value of the low level removal signal SH2 is equal to or less than the predetermined upper limit value UV1.
- a high frequency signal S11 is generated by performing a process of changing to the upper limit value UV1 or less (hereinafter also referred to as a clip process).
- the signal value of the part is changed to “64” or “ ⁇ 64” according to the sign. Alternatively, it may be changed to “0”.
- the filter 110 described above applies a signal that is limited to 3 rd MSB (about 64 or ⁇ 64 for an 8-bit signal) to, for example, 12-bit operation. Add to the input signal Sin. For this reason, the rounding processing unit 132 and the limiter 133 perform processing for limiting the calculation result performed by the filter 110 to the equivalent of an 8-bit signal.
- the high-frequency component extraction unit 11 includes the rounding processing unit 132 and the limiter 133.
- the high-frequency component extraction unit 11 may include a member that integrates them.
- the nonlinear processing unit 102a includes a non-linear calculation unit (even power calculation unit, square root calculation unit) 21, a code conversion unit (code conversion unit) 41, and a limiter (horizontal amplitude adjustment unit, vertical side). Amplitude adjusting means, horizontal sub-amplitude adjusting means, vertical sub-amplitude adjusting means) 51.
- the non-linear operation unit 21 performs non-linear operation on the high-frequency signal S11 to generate a non-linear signal S21.
- the nonlinear calculation performed by the nonlinear calculation unit 21 will be described.
- the input signal value to the non-linear operation unit 21 is x
- the output signal value from the non-linear operation unit 21 is y
- the function f (x) is a non-linear function that monotonously increases positively and negatively (originally symmetric).
- the monotonic increase means a monotonic increase in a broad sense.
- the function f (x) is preferably
- at least in the vicinity of x “0”.
- Examples of such a function f (x) include those represented by the following mathematical formulas (1) to (3).
- the function f (x) represented by the following mathematical formulas (2) and (3) is used, the function f (x) has a large increase in the value of 0 ⁇ x ⁇ 1, so It is preferable to use it.
- the nonlinear signal S21 obtained by squaring the high-frequency signal S11 is the data string X1 2 , X2 2 , X3 2 ,.
- the resulting digital signal is the data string X1 2 , X2 2 , X3 2 ,.
- x may be normalized by 255 when using the function f (x).
- the right side x of the function f (x) represented by the above formula (2) is normalized by x / 255, and the right side is multiplied by 255. ) May be used.
- the following numerical formula (4) satisfies the condition of f (x)> x.
- x on the right side of the function f (x) represented by the equation (2) is normalized by 255 and the right side is multiplied by 255, but the value to be multiplied by the right side is normalized. It is not necessary to be the same value as the value (255 in this example), as long as the condition
- function f (x) may be a function using a trigonometric function shown in the following mathematical formula (6).
- the code conversion unit 41 Based on the sign bit information of the high-frequency signal S11, the code conversion unit 41 generates a code-converted signal S41 that reflects the sign of the high-frequency signal S11 in the nonlinear signal S21. That is, the code conversion unit 41 maintains the code as it is for the portion of the nonlinear signal S21 that has the same code as the high-frequency signal S11. On the other hand, the sign of the non-linear signal S21 with the sign different from the high frequency signal S11 is inverted.
- the limiter 51 performs a process (hereinafter also referred to as an amplitude adjustment process) for adjusting the amplitude (signal level and intensity) of the code conversion signal S41 generated by the code conversion unit 41, whereby the nonlinear processing signal S12 ( A horizontal non-linear processing signal, a vertical non-linear processing signal, a horizontal sub-non-linear processing signal, and a vertical sub-non-linear processing signal).
- the limiter 51 multiplies the code conversion signal S41 by a predetermined magnification value ⁇ (
- magnification value ⁇ can be appropriately set according to the motion of the image and the amount of noise.
- magnification value ⁇ is set to a fixed value, for example, it is desirable that the absolute value is 0.5 or less.
- the limiter 51 does not further amplify a signal having sufficient energy, so that the absolute value of the signal of the nonlinear processing signal S12 is set so that the signal value of the nonlinear processing signal S12 is not more than a predetermined upper limit value UV2.
- a process of changing the absolute value to the upper limit value UV2 or less (hereinafter also referred to as clip processing) is performed.
- clip processing For a portion where the absolute value of the signal value of the nonlinear processing signal S12 exceeds “64”, the signal value of the portion is changed to “64” or “ ⁇ 64” according to the sign. Alternatively, it may be changed to “0”.
- the non-linear processing unit 102a may be configured not to include the limiter 51 and to perform neither the amplitude adjustment process nor the clip process of the code conversion signal S41.
- the code conversion signal S41 generated by the code conversion unit 41 is output from the nonlinear processing unit 102a as the nonlinear processing signal S12.
- the adder 15 generates the output signal Sout by adding the nonlinear processing signal S12 as a compensation signal to the input signal Sin. It is assumed that the adder 15 appropriately includes a delay element for adjusting the timing between the input signal Sin and the nonlinear processing signal S12.
- FIGS. 9A to 9E are diagrams schematically showing waveforms of signals generated in the respective parts of the sharpening processing unit 100a.
- the signal shown in FIG. 9A is input to the sharpening processing unit 100a as the input signal Sin.
- the high-frequency component extraction unit 11 when the input signal Sin is input to the high-frequency component extraction unit 11, the high-frequency component included in the input signal Sin is extracted, and the high-frequency signal S11 shown in FIG. 9B is generated.
- the signal shown in (a) of FIG. 10 is the same as the input signal Sin shown in (a) of FIG.
- the input signal Sin shown in (a) of FIG. 10 is enhanced, in the sharpening process using linear calculation, a high-frequency signal is extracted from the input signal Sin shown in (a) of FIG. A method of adding the input signal Sin to the high frequency signal is used. Therefore, in the sharpening process using the linear operation, a signal component exceeding the Nyquist frequency that is not included in the input signal Sin is not added.
- a signal shown in FIG. 10B is generated.
- the rise in the signal shown in FIG. 10B is steeper than the rise of the signal in the input signal Sin shown in FIG. 10A, but the nonlinear processing signal S12 generated by the sharpening processing unit 100a.
- the rising edge of the signal in ((e) of FIG. 9) is steeper.
- the nonlinear processing unit 102a described above may be configured to differentiate the nonlinear signal S21 generated by the nonlinear computing unit 21. This is because the direct current component included in the nonlinear signal S21 can be removed by differentiating the nonlinear signal S21.
- FIG. 11 is a block diagram illustrating a configuration of the sharpening processing unit 100b.
- the sharpening processing unit 100b includes a high-frequency component extraction unit 11, a nonlinear processing unit 102b, and an addition unit 15.
- the nonlinear processing unit 102b includes a differentiating unit (differentiating unit) 31 between the nonlinear computing unit 21 and the code converting unit 41 in addition to the configuration of the nonlinear processing unit 102a illustrated in FIG. Since the high-frequency component extraction unit 11, the members other than the differentiation unit 31 of the nonlinear processing unit 102b, and the addition unit 15 are the same as those described above, detailed description thereof is omitted here.
- the differentiating unit 31 generates the differential signal S31 by differentiating the non-linear signal S21 generated by the non-linear operation unit 21.
- FIG. 12 is a block diagram illustrating the configuration of the differentiating unit 31.
- the differentiating unit 31 includes a unit delay element 3111 and a subtracting unit 3112, and calculates a backward difference with respect to a signal input to the differentiating unit 31.
- the code converting unit 41 converts a signal obtained by reflecting the sign of the high frequency signal S11 to the nonlinear signal S21 based on the sign bit information of the high frequency signal S11. It generates as S42. That is, the code conversion unit 41 maintains the code as it is for the portion of the differential signal S31 that has the same code as the high-frequency signal S11. On the other hand, the sign of the non-linear signal S21 with the sign different from the high frequency signal S11 is inverted.
- the limiter 51 generates a nonlinear processing signal S12 by performing amplitude adjustment processing and clipping processing on the code conversion signal S42 generated by the code conversion unit 41.
- the amplitude of the code conversion signal S42 is adjusted by multiplying the code conversion signal S42 by a predetermined magnification value ⁇ .
- the non-linear processing unit 102b may be configured not to include the limiter 51 and to perform neither the amplitude adjustment process nor the clip process of the code conversion signal S42.
- the code conversion signal S42 generated by the code conversion unit 41 is output from the nonlinear processing unit 102b as the nonlinear processing signal S12.
- FIG. 13 are diagrams schematically showing waveforms of signals generated in each part of the sharpening processing unit 100b.
- the signal shown in FIG. 13A is input to the sharpening processing unit 100b as the input signal Sin.
- the signal shown in (a) of FIG. 13 is the same as the signal shown in (a) of FIG.
- the high-frequency component extraction unit 11 when the input signal Sin is input to the high-frequency component extraction unit 11, the high-frequency component included in the input signal Sin is extracted, and the high-frequency signal S11 shown in FIG. 13B is generated.
- FIG. 14 is a block diagram illustrating a configuration of the sharpening processing unit 100c.
- the sharpening processing unit 100c includes a high-frequency component extraction unit 11, a nonlinear processing unit 102c, and an addition unit 15.
- the nonlinear processing unit 102 c includes a nonlinear computing unit (odd power computing unit) 22 and a limiter 51. Since the high-frequency component extraction unit 11, the limiter 51, and the addition unit 15 are the same as those described above, detailed description thereof is omitted here.
- the non-linear operation unit 22 performs non-linear operation on the high-frequency signal S11 to generate a non-linear signal S22.
- the nonlinear calculation performed by the nonlinear calculation unit 22 will be described.
- the input signal value to the non-linear operation unit 22 is x
- the output signal value from the non-linear operation unit 22 is y
- the function g (x) is a non-linear function that monotonously increases positively and negatively (originally symmetric).
- the monotonic increase means a monotonic increase in a broad sense.
- the function g (x) is preferably
- at least in the vicinity of x “0”.
- the data string constituting the high-frequency signal S11 is X1, X2, X3,...
- the nonlinear signal S22 obtained by squaring the high-frequency signal S11 is represented by the data string X1 3 , X2 3 , X3 3 ,.
- the resulting digital signal is represented by the data string X1 3 , X2 3 , X3 3 ,.
- the limiter 51 generates the nonlinear processing signal S12 by performing amplitude adjustment processing and clipping processing on the nonlinear signal S22 generated by the nonlinear calculation unit 22.
- the non-linear processing unit 102c may be configured not to include the limiter 51 and to perform neither the amplitude adjustment process nor the clip process of the non-linear signal S22.
- the nonlinear signal S22 generated by the nonlinear computing unit 22 is output from the nonlinear processing unit 102c as the nonlinear processing signal S12.
- FIGS. 15A to 15D are diagrams schematically illustrating waveforms of signals generated in the respective units of the sharpening processing unit 100c.
- the signal shown in FIG. 15A is input to the sharpening processing unit 100c as the input signal Sin.
- the signal shown in FIG. 15A is the same as the signal shown in FIG.
- the high frequency component extraction unit 11 when the input signal Sin is input to the high frequency component extraction unit 11, the high frequency component included in the input signal Sin is extracted, and the high frequency signal S11 shown in FIG. 15B is generated.
- the input signal Sin is expressed by a function F (x) where time is x.
- the function F (x) can be expressed by a Fourier series as shown in the following formula (8).
- N is the order of the highest frequency harmonic that does not exceed the Nyquist frequency fs / 2 with respect to the sampling frequency fs. That is, the following formula (9) is satisfied.
- G (x) is expressed by the following formula (10).
- the input signal Sin input to the sharpening processing unit 100 includes a high-frequency component of the signal G (x) or the signal G (x).
- (G (x)) 2 includes angular frequency components such as (N + 1) ⁇ , (N + 2) ⁇ ,.
- (G (x)) 2 includes a frequency component higher than the Nyquist frequency fs / 2. That is, the nonlinear signal S21 generated by the nonlinear computing unit 21 includes a frequency component higher than the Nyquist frequency fs / 2, such as a harmonic component such as a frequency 2N ⁇ / (2 ⁇ ).
- Equations (23) and (24) can be rewritten.
- (G (x)) 3 includes a frequency component 3N times the basic angular frequency ⁇ and a frequency component -3N times.
- (G (x)) 3 includes various frequency components from ⁇ 3N to 3N times the basic angular frequency ⁇ . I understand that.
- (G (x)) 3 includes a frequency component higher than the Nyquist frequency fs / 2. That is, the nonlinear signal S22 generated by the nonlinear operation unit 22 includes a frequency component higher than the Nyquist frequency fs / 2, such as a harmonic component having a frequency of 3N ⁇ / (2 ⁇ ).
- the output signal Sout generated by the sharpening processing unit 100 includes a high frequency component not included in the input signal Sin, that is, a frequency component higher than the Nyquist frequency.
- FIG. 16 is a block diagram showing a configuration of the sharpening processing unit 100d.
- the sharpening processing unit 100d includes a high frequency component extraction unit 11, a nonlinear processing unit 102d, and an addition unit 15. Since the high-frequency component extraction unit 11 and the addition unit 15 are the same as those described above, detailed description thereof is omitted here.
- the nonlinear processing unit 102d includes a square calculation unit 61, a first differentiation unit 71, a second differentiation unit 81, and a multiplication unit 91.
- the square calculator 61 generates a square signal S61 by squaring the high-frequency signal S11. That is, if the data sequence that constitutes the high-frequency signal S11 is X1, X2, X3,..., The square signal S61 obtained by squaring the high-frequency signal S11 is represented by the data sequences X1 2 , X2 2 , X3 2 ,. The resulting digital signal.
- the first differentiating unit 71 generates the first differential signal S71 by differentiating the square signal S61 generated by the square calculating unit 61.
- the structure of the 1st differentiation part 71 is the structure similar to the differentiation part 31, for example.
- the second differentiator 81 generates the second differential signal S81 by differentiating the input signal Sin.
- the structure of the 2nd differentiation part 81 is the structure similar to the differentiation part 31, for example.
- the multiplication part 91 produces
- the processing signal S12 is a digital signal composed of data strings U1, V1, U2, V2, U3, V3,.
- the square calculation unit 61 is provided in order to perform nonlinear calculation.
- a fourth power calculation unit that squares the high-frequency signal S11 may be used instead of the square calculation unit 61. More generally, a power calculation unit that generates a signal corresponding to the power of the high-frequency signal S11 having an even number of 2 or more as a power index may be used.
- the configuration includes the square calculation unit 61.
- a configuration including an absolute value processing unit 62 that calculates the absolute value of the input signal is good.
- FIG. 17 is a block diagram illustrating a configuration of the sharpening processing unit 100e.
- the sharpening processing unit 100e includes a high-frequency component extraction unit 11, a nonlinear processing unit 102e, and an addition unit 15. Since the high-frequency component extraction unit 11 and the addition unit 15 are the same as those described above, detailed description thereof is omitted here.
- the nonlinear processing unit 102e includes an absolute value processing unit 62, a first differentiation unit 71, a second differentiation unit 81, and a multiplication unit 91. Since the first differentiating unit 71, the second differentiating unit 81, and the multiplying unit 91 are the same as those described above, detailed description thereof is omitted here.
- the absolute value processing unit 62 generates an absolute value signal S62 that is a signal corresponding to the absolute value of the high-frequency signal S11. That is, if the data string that constitutes the high-frequency signal S11 is X1, X2, X3,...,
- the absolute value signal S62 is a digital signal composed of the data strings
- the first differentiating unit 71 generates the first differential signal S72 by differentiating the absolute value signal S62 generated by the absolute value processing unit 62.
- FIG. 19 shows the frequency spectrum of the image signal after the enlargement process is performed to double the number of pixels in the horizontal direction by up-converting the image signal having the frequency spectrum shown in FIG.
- the signal processing device 500 can include a frequency component higher than the Nyquist frequency in the image signal that has been subjected to the sharpening process. Therefore, the frequency spectrum shown in FIG.
- the frequency spectrum of the image signal after the sharpening process is performed on the image signal having the above by the signal processing device 500 is as shown in FIG.
- a frequency component higher than the Nyquist frequency fs / 2 is added to the frequency spectrum. That is, a high frequency component not included in the original signal is added.
- the signal processing apparatus 500 can add a high-frequency component that cannot be used in a sharpening process using a conventionally known linear operation, and thus is represented by an image signal after the enlargement process.
- the image can be sharpened appropriately.
- FIG. 21 is a schematic diagram illustrating how an image is sharpened.
- FIG. 21 is a diagram showing vertical lines, horizontal lines, and diagonal lines included in the image before sharpening. As shown in the figure, it is assumed that the image before sharpening is slightly blurred.
- FIG. 21B shows the vertical line after the sharpening process is performed by the signal processing device 500a or the signal processing device 500b on each of the vertical line, horizontal line, and diagonal line shown in FIG. It is a figure which shows a line, a horizontal line, and a diagonal line. As shown in the figure, it can be seen that after sharpening, the sharpness and resolution are improved compared to before sharpening.
- 21C shows the sharpening processing unit 100A and the sharpening processing unit without attenuating high-frequency components by the two-dimensional filter 200 with respect to the oblique line of the image shown in FIG. It is a figure which shows the oblique line contained in the image after performing the sharpening process in 100B. As shown in the figure, in this case, the edge portion of the diagonal line is excessively sharpened and is edged.
- the horizontal and vertical directions of the image are sharpened to a higher (stronger) level than before, and the image after sharpening is processed. It is possible to suppress the phenomenon that the diagonal lines appear to be glaring.
- the degree of sharpening performed by the sharpening processing unit 100A and the sharpening processing unit 100B is preferably set according to the degree by which the frequency component in the oblique direction of the image is attenuated by the two-dimensional filter 200.
- the oblique line of the image remains somewhat, so that the oblique line of the sharpened image looks glaring. In order to suppress this, it is preferable not to increase the degree of sharpening performed by the subsequent sharpening processing unit 100A and the sharpening processing unit 100B.
- the sharpening processing unit 100A and the sharpening processing unit 100B in the subsequent stage perform sharpening. Even if the degree is increased, the diagonal lines of the sharpened image do not appear to be very glaring.
- the degree of sharpening performed by the sharpening processing unit 100A and the sharpening processing unit 100B can be set by the following two methods.
- the first method is to set a magnification value ⁇ by which the limiter 51 multiplies the code conversion signal S41.
- the magnification value ⁇ is set.
- the magnification value ⁇ By setting the magnification value ⁇ to a large value, the amplitude of the code conversion signal S41 increases, and as a result, the amplitude of the nonlinear processing signal S12 increases. This increases the degree of sharpening.
- the magnification value ⁇ is set.
- the amplitude of the code conversion signal S41 becomes small, and as a result, the amplitude of the nonlinear processing signal S12 becomes small. This reduces the degree of sharpening.
- the second method is to set the coefficient Ck of the filter 110 included in the high frequency component extraction unit 11 (change the frequency characteristic). That is, this is a method of using the filter 110 corresponding to the degree of the frequency component in the oblique direction attenuated by the two-dimensional filter 200.
- each of the coefficients Ck is set so that the frequency component to be passed by the filter 110 increases as the amount of the frequency component in the oblique direction of the image attenuated by the two-dimensional filter 200 increases.
- the coefficient Ck is set in this way, the high frequency signal SH1 becomes large, and as a result, the amplitude of the nonlinear processing signal S12 becomes large. This increases the degree of sharpening.
- each of the coefficients Ck is set so that the smaller the amount of attenuation of the frequency component in the oblique direction of the image by the two-dimensional filter 200, the smaller the frequency component that is passed by the filter 110.
- the coefficient Ck is set in this way, the high frequency signal SH1 becomes small, and as a result, the amplitude of the nonlinear processing signal S12 becomes small. This reduces the degree of sharpening.
- the signal processing device 500a or the signal processing device 500b described in the first embodiment is configured to perform sharpening processing in each of the horizontal direction and the vertical direction of the original image after reducing the diagonal lines of the original image. Therefore, in the image after sharpening, diagonal lines remain reduced. If the image after sharpening is configured to add diagonal lines of the original image, the image after sharpening can be further improved in image quality.
- the signal processing device 500 according to the present embodiment is referred to as a signal processing device 500c.
- members having the same functions as those shown in the first embodiment are denoted by the same reference numerals, and the description thereof is omitted unless specifically described.
- FIG. 22 is a block diagram illustrating a configuration of the signal processing device 500c.
- the signal processing device 500c includes a high-pass filter (DC component removing unit) 220, a two-dimensional filter 200, a sharpening unit 150, and an adding unit (input signal adding unit) 240.
- the high-pass filter 220 is a generally known high-pass filter and may be any filter as long as it removes the direct current component of the original image represented by the input signal SA. Further, it may be a one-dimensional filter or a two-dimensional filter. A signal output from the high-pass filter 220 is referred to as a high-frequency signal S220.
- the two-dimensional filter 200 and the sharpening unit 150 are the same as those in the first embodiment.
- the two-dimensional filter 200 attenuates high-frequency components in an oblique direction excluding the horizontal direction and the vertical direction of the image represented by the high-frequency signal S220.
- the adding unit 240 generates the output signal SO by adding the sharpening signal S102 output from the sharpening processing unit 100B of the sharpening unit 150 and the input signal SA. It is assumed that the adding unit 240 appropriately includes a delay element for adjusting the timing between the sharpening signal S102 and the input signal SA.
- the reason why the high-pass filter 220 is provided is to prevent the DC component from doubling when the sharpening signal S102 and the input signal SA are added by the adding unit 240.
- the DC component is removed from one of the signals.
- the direct current component may be removed after the high frequency component in the oblique direction is attenuated. That is, the connection order of the high-pass filter 220 and the two-dimensional filter 200 may be reversed.
- the signal processing device 500d includes a sharpening unit 151 instead of the sharpening unit 150 of the signal processing device 500c.
- the filter signal S200 is input to the sharpening processing unit 100B of the sharpening unit 151.
- the sharpening signal S102 output from the sharpening processing unit 100B is input to the sharpening processing unit 100A.
- the sharpening signal S101 output from the sharpening processing unit 100A of the sharpening unit 151 is input to the adding unit 240.
- the diagonal lines are enhanced by adding the diagonal lines of the original image to the sharpened image. Therefore, for example, when sharpening processing is performed on the diagonal line shown in FIG. 21A by the signal processing device 500c or the signal processing device 500d, the diagonal line shown in FIG. Since the diagonal lines are enhanced, the sharpened image looks higher in quality than that shown in FIG. (Setting of sharpening degree according to 2D filter)
- the sharpening processing unit 100A and the sharpening processing unit 100B are performed according to the degree to which the frequency component in the oblique direction of the image is attenuated by the two-dimensional filter 200. It is preferable to set the degree of sharpening applied at. Since the setting content is the same as the content described in the first embodiment, the description thereof is omitted here.
- the signal processing device 500 according to the present embodiment is referred to as a signal processing device 500e.
- members having the same functions as those shown in the first embodiment are denoted by the same reference numerals, and the description thereof is omitted unless specifically described.
- FIG. 24 is a block diagram illustrating a configuration of the signal processing device 500e.
- the signal processing device 500e includes a two-dimensional filter 200, a sharpening unit 150, a sharpening unit (sub-sharpening means) 152, a difference determination section (difference determination means) 300, and a signal output section (signal). Output means) 320.
- the two-dimensional filter 200 and the sharpening unit 150 are the same as those in the first embodiment. However, the sharpening processing unit 100B of the sharpening unit 150 outputs a sharpening signal S102 to the connection point In1.
- the sharpening unit 152 sharpens the input signal SA.
- the sharpening unit 152 includes a sharpening processing unit 100C (horizontal side sub-sharpening means) and a sharpening processing unit 100D (vertical side sub-sharpening means) connected in cascade.
- the sharpening processing unit 100C performs a sharpening process in the horizontal direction of the image represented by the input signal.
- the sharpening processing unit 100C has the same configuration as the sharpening processing unit 100A, but the degree of sharpening is smaller than that of the sharpening processing unit 100A, as will be described later.
- the harmonic output from the sharpening processing unit 100C is denoted as a sharpening signal S103 (horizontal sub-sharpening signal).
- the sharpening processing unit 100D performs sharpening processing in the vertical direction of the image represented by the input signal.
- the sharpening processing unit 100D has the same configuration as the sharpening processing unit 100B, but the degree of sharpening is smaller than the sharpening processing unit 100B, as will be described later.
- the harmonic output from the sharpening processing unit 100D is represented as a sharpening signal S104 (vertical sub-sharpening signal).
- the sharpening processing unit 100C is provided on the upper stage side of the cascade connection, and the input signal SA is inputted.
- the sharpening processing unit 100D is provided on the lower side of the cascade connection, and receives the sharpening signal S103.
- the sharpening signal S104 output from the sharpening processing unit 100D is output to the connection point In2.
- the sharpening processing unit 100C is less sharpened than the sharpening processing unit 100A, and the sharpening processing unit 100D. Is less sharpened than the sharpening processor 100B.
- a magnification value ⁇ (hereinafter referred to as ⁇ 3) that the limiter 51 provided in the sharpening processing unit 100D multiplies the code conversion signal S41 by the limiter 51 provided in the sharpening processing unit 100B multiplies the code conversion signal S41. It is set to be smaller than a magnification value ⁇ (hereinafter referred to as ⁇ 4). For example, ⁇ 3 is about 1/3 times ⁇ 4.
- the sharpening processing unit 100C and the sharpening processing unit 100D the amplitude of the code conversion signal S41 becomes smaller than that of the sharpening processing unit 100A and the sharpening processing unit 100B, respectively, and as a result, the amplitude of the nonlinear processing signal S12 Becomes smaller. Therefore, the sharpening processing unit 100C and the sharpening processing unit 100D are less sharpened than the sharpening processing unit 100A and the sharpening processing unit 100B.
- the filter 110 provided in the sharpening processing unit 100C sets each of the coefficients Ck so that the frequency components to be passed are reduced, and the filter 110 provided in the sharpening processing unit 100A is configured to increase the frequency components to be passed. Each coefficient Ck is set to.
- the filter 110 included in the sharpening processing unit 100D sets each of the coefficients Ck so that the frequency components to be passed are reduced, and the filter 110 provided in the sharpening processing unit 100B is configured to increase the frequency components to be passed. Each coefficient Ck is set to.
- the sharpening processing unit 100C and the sharpening processing unit 100D the high frequency signal SH1 is smaller than that in the sharpening processing unit 100A and the sharpening processing unit 100B, respectively, and as a result, the amplitude of the nonlinear processing signal S12 is small. Become. Therefore, the sharpening processing unit 100C and the sharpening processing unit 100D are less sharpened than the sharpening processing unit 100A and the sharpening processing unit 100B.
- the difference determination unit 300 detects the degree to which the frequency component in the oblique direction is reduced by the two-dimensional filter 200. Specifically, the difference between the input signal SA and the filter signal S200 is calculated for each block region composed of a plurality of adjacent pixels, and the calculated difference value is a predetermined value (hereinafter referred to as a predetermined value TH). It is determined whether it is above.
- the block area includes (1) two consecutive pixels (a pixel and its right adjacent pixel, or a pixel and its left adjacent pixel), and (2) three consecutive pixels (a pixel and its left and right pixels). (Pixels), (3) 5 adjacent pixels (for example, a pixel and its upper, lower, left, and right pixels) (4) There are various types such as those consisting of 16 pixels of 4 pixels ⁇ 4 pixels. is not.
- the difference determining unit 300 notifies the signal output unit 320 of the determination result for each block area.
- the difference determination unit 300 appropriately includes a delay element for adjusting the timing between the input signal SA and the filter signal S200.
- the signal output unit 320 is a switch that switches the connection between the connection point Out and the connection point In1 and the connection point In2 according to the determination result by the difference determination unit 300.
- the connection point Out and the connection point In1 are connected.
- the sharpening signal S102 output from the sharpening processing unit 100B is output from the signal output unit 320 as the output signal SO.
- the connection point Out and the connection point In2 are connected.
- the sharpening signal S104 output from the sharpening processing unit 100D is output from the signal output unit 320 as the output signal SO.
- At least one of the sharpening unit 150, the sharpening unit 152, and the signal output unit 320 appropriately includes a delay element for adjusting the timing between the sharpening signal S102 and the sharpening signal S104. It shall be.
- the signal processing device 500e switches and outputs the output signal SO according to the degree of the frequency component in the oblique direction reduced by the two-dimensional filter 200.
- the signal processing device 500f includes a sharpening unit (sharpening means) 151 instead of the sharpening unit 150 of the signal processing device 500e, and the sharpening unit 152 of the signal processing device 500e includes Instead, a sharpening unit (sub-sharpening means) 153 is provided.
- the filter signal S200 is input to the sharpening processing unit 100B.
- the sharpening signal S102 output from the sharpening processing unit 100B is input to the sharpening processing unit 100A.
- the sharpening processing unit 100A outputs the sharpening signal S101 to the connection point In1 of the signal output unit 320.
- the input signal SA is input to the sharpening processing unit 100D.
- the sharpening signal S104 output from the sharpening processing unit 100D is input to the sharpening processing unit 100C.
- the sharpening processing unit 100C outputs the sharpening signal S103 to the connection point In2 of the signal output unit 320.
- the filter signal S200 is sharpened and output in a block region where the amount of diagonal lines is reduced, and the input signal is output in a block region where the amount of reduction of diagonal lines is small.
- SA is sharpened and output. That is, appropriate sharpening can be performed according to the amount of reduction of the oblique lines. Therefore, for example, when sharpening processing is performed on the diagonal line shown in FIG. 21A by the signal processing device 500e or the signal processing device 500f, the diagonal line shown in FIG. Since the diagonal lines are enhanced, the sharpened image looks higher in quality than that shown in FIG.
- the sharpening processing unit 100A and the sharpening processing unit 100B are performed according to the degree to which the frequency component in the oblique direction of the image is attenuated by the two-dimensional filter 200. It is preferable to set the degree of sharpening applied at. Since the setting content is the same as the content described in the first embodiment, the description thereof is omitted here.
- each block of the signal processing device 500 may be configured as hardware by a logic circuit formed on an integrated circuit (IC chip), or software using a CPU (central processing unit) as follows. It may be realized by.
- IC chip integrated circuit
- CPU central processing unit
- the signal processing device 500 When realized by software, the signal processing device 500 (particularly the sharpening processing unit 100) includes a CPU that executes instructions of a control program that realizes each function, a ROM (read only memory) that stores the program, and the program And a storage device (recording medium) such as a memory for storing the program and various data.
- An object of the present invention is a recording medium on which a program code (execution format program, intermediate code program, source program) of a control program of the signal processing device 500, which is software that realizes the functions described above, is recorded so as to be readable by a computer. This can also be achieved by supplying the signal processing device 500 and reading and executing the program code recorded on the recording medium by the computer (or CPU or MPU).
- Examples of the recording medium include tapes such as magnetic tapes and cassette tapes, magnetic disks such as floppy (registered trademark) disks / hard disks, and disks including optical disks such as CD-ROM / MO / MD / DVD / CD-R.
- IC cards including memory cards
- semiconductor memories such as mask ROM / EPROM / EEPROM / flash ROM
- logic circuits such as PLD (Programmable logic device), etc. it can.
- the signal processing device 500 may be configured to be connectable to a communication network, and the program code may be supplied via the communication network.
- the communication network is not particularly limited.
- the Internet intranet, extranet, LAN, ISDN, VAN, CATV communication network, virtual private network, telephone line network, mobile communication network, satellite communication. A net or the like is available.
- the transmission medium constituting the communication network is not particularly limited.
- infrared rays such as IrDA and remote control
- Bluetooth It can also be used for wireless such as registered trademark), IEEE 802.11 wireless, HDR (High Data Rate), NFC (Near Field Communication), DLNA (Digital Living Network Alliance), mobile phone network, satellite line, terrestrial digital network, etc. .
- means does not necessarily mean physical means, but includes cases where the functions of each means are realized by software. Further, the function of one means may be realized by two or more physical means, or the functions of two or more means may be realized by one physical means.
- the signal processing apparatus may be configured such that the horizontal sharpening means is provided on the upper side of the column connection and the vertical sharpening means is provided on the lower side of the column connection. .
- an image for example, a television with a higher frequency component in the horizontal direction than the frequency component in the vertical direction. John broadcast video
- an image for example, a television with a higher frequency component in the horizontal direction than the frequency component in the vertical direction. John broadcast video
- the signal processing apparatus may have a configuration in which the vertical sharpening means is provided on the upper side of the column connection, and the horizontal sharpening means is provided on the lower side of the column connection. .
- an image in which the frequency component in the vertical direction is higher than the frequency component in the horizontal direction is preferably sharpened.
- the signal processing apparatus includes a DC component removing unit that removes at least a DC component from the frequency components included in the input signal before the diagonally reduced signal is generated by the high frequency component removing unit.
- the input signal and the sharpening signal may be added and input signal adding means for outputting a signal obtained by the addition may be further provided.
- At least a DC component is removed from the frequency components included in the input signal before generating the diagonally reduced signal. Further, the input signal and the sharpening signal are added, and a signal obtained by the addition is output.
- the diagonal line included in the image represented by the input signal can be included in the image represented by the sharpening signal. Further, since at least the direct current component is removed from the oblique reduction signal, the direct current component is not enhanced as a result of adding the input signal and the sharpening signal.
- the signal processing apparatus includes a sub-sharpening means for receiving the input signal and outputting a sub-sharpening signal obtained by sharpening the input signal, and a block region including a plurality of adjacent pixels. Calculating a difference between the input signal and the oblique reduction signal, and determining whether the calculated difference is equal to or greater than a predetermined value, and inputting the sharpening signal and the sub-sharpening signal.
- the sharpening signal is output, and for the block area in which the difference calculated by the difference determination means is less than a predetermined value Further includes signal output means for outputting the sub-sharpening signal, wherein the sub-sharpening means is a pixel lined up adjacent in the horizontal direction of the image represented by the input signal.
- Vertical side sub-sharpening means for outputting a vertical-side sub-sharpening signal obtained by sharpening a signal representing the horizontal sub-sharpening means and the vertical-side sub-sharpening means are connected in cascade,
- the input signal is input to the horizontal side sub-sharpening means or the vertical side sub-sharpening means on the upper stage side connected in cascade, and the sub-sharpening means is connected to the horizontal side sub-sharpening on the lower stage side connected in cascade.
- the signal output from the vertical sub-sharpening means is output as the sub-sharpening signal, and the horizontal sub-sharpening means is adjacent to the horizontal direction of the image represented by the input signal.
- An image made up of aligned pixels Horizontal sub-low frequency component removing means for generating and outputting a horizontal sub-low frequency removal signal by removing at least a DC component from frequency components included in a signal representing a group, and the horizontal sub-low frequency removal signal
- the horizontal sub-low frequency removal signal is Generating a horizontal sub-nonlinear processing signal that monotonically increases in a non-linear and broad sense, and outputting the horizontal sub-non-linear processing signal; a signal input to the horizontal sub-sharpening means; Horizontal side sub-addition means for generating and outputting the horizontal side sub-sharpening signal by adding a horizontal sub-nonlinear processing signal, and the vertical side sub-sharpening means,
- a vertical sub-low frequency removal signal is generated by removing at least a direct current component from a frequency component included in a signal representing a pixel group composed of pixels arranged adjacent
- the vertical sub-low frequency component removing means and the vertical sub-low frequency removing signal are input, the sign of the vertical sub-low frequency removing signal is maintained, and at least the vertical sub-low frequency signal is maintained.
- a vertical sub-nonlinear processing signal that monotonically increases in a non-linear and broad sense with respect to the vertical sub-low frequency removal signal is generated, and the vertical sub-nonlinear processing signal is output.
- the vertical sub-sharpening signal is generated by adding the signal input to the vertical sub-sharpening means and the vertical sub-sharpening signal to the vertical sub-linear processing signal. It may be configured to include a vertical side sub adding means for outputting Te.
- the input signal is further subjected to two sharpening processes in sequence, and a sub-sharpening signal is output.
- One sharpening process is a process of generating a horizontal sub-sharpening signal, which is a harmonic obtained by sharpening a signal representing a pixel group consisting of pixels arranged adjacent to each other in the horizontal direction of the image represented by the input signal. It is.
- generating the horizontal sub-sharpening signal first, at least the DC component is removed from the frequency component included in the signal representing the pixel group consisting of pixels arranged in the horizontal direction adjacent to the image represented by the input signal. By doing so, a horizontal sub-low frequency removal signal is generated.
- the horizontal sub-sharpening signal is generated by adding the input signal and the horizontal sub-low frequency removal signal.
- a vertical sub-sharpening signal which is a harmonic obtained by sharpening a signal representing a pixel group composed of pixels arranged adjacent to each other in the vertical direction of the image represented by the input signal. It is a process to generate.
- generating the vertical sub-sharpening signal first, at least the DC component is removed from the frequency component included in the signal representing the pixel group consisting of pixels arranged adjacent to each other in the vertical direction of the image represented by the input signal. By doing so, the vertical sub-low frequency removal signal is generated.
- the vertical side sub-low frequency removal signal When the sign of the vertical side sub-low frequency removal signal is maintained, and at least when the value of the vertical side sub-low frequency removal signal is near 0, it is non-linearly broadly defined with respect to the vertical side sub-low frequency removal signal. A monotonically increasing vertical side non-linear processing signal is generated. Then, the vertical sub-sharpening signal is generated by adding the input signal and the vertical sub-low frequency removal signal.
- the two sharpening processes do not apply non-linear processing to the frequency components in the direction excluding the horizontal and vertical directions of the image represented by the input signal, but to the horizontal and vertical frequency components of the image.
- a signal subjected to nonlinear processing can be output as a sub-sharpening signal.
- the horizontal side sub-sharpening signal is generated by adding the input signal and the horizontal side sub-nonlinear processing signal subjected to nonlinear processing such as squaring the horizontal side sub-low frequency removal signal. .
- the sign of the generated signal maintains the sign of the sign of the horizontal sub-low frequency removal signal.
- the vertical-side sub-sharpening signal is generated by adding the input signal and the vertical-side sub-nonlinear processing signal subjected to nonlinear processing such as squaring the vertical-side sub-low frequency removal signal. .
- the sign of the generated signal maintains the sign of the sign of the vertical sub-low frequency removal signal.
- the horizontal sub-sharpening signal and the vertical sub-sharpening signal include high-band frequency components that are not included in the input signal.
- the horizontal side sub-sharpening signal and the vertical side sub-sharpening signal include frequency components higher than the Nyquist frequency that is a half of the sampling frequency when the input signal is discretized.
- the difference between the input signal and the diagonally reduced signal is calculated, it is determined whether the calculated difference is equal to or greater than a predetermined value, and the difference is equal to or greater than the predetermined value.
- a sharpening signal is output for a block area, and a sub-sharpening signal is output for a block area whose difference is less than a predetermined value.
- the sharpening signal obtained by sharpening the diagonal reduction signal is output, and in the block area where the amount of diagonal line reduction is small, the input signal is sharpened. Output sub-sharpening signal.
- the output signal can be switched according to the amount of reduction of the diagonal line. Therefore, by setting the degree of sharpening performed by the sharpening means to be different from the degree of sharpening performed by the sub-sharpening means, the degree of sharpening according to the amount of reduction in diagonal lines There is an effect that can be made different.
- the horizontal-side sharpening means when the horizontal-side sharpening means is provided above the vertical-side sharpening means, the horizontal-side sub-sharpening means is higher than the vertical-side sub-sharpening means. And the horizontal-side sharpening means is provided below the vertical-side sharpening means, the horizontal-side sub-sharpening means is provided below the vertical-side sub-sharpening means. There may be.
- the order of the two sharpening processes performed on the input signal can be made the same as the order of the two sharpening processes performed on the oblique reduction signal.
- the signal processing apparatus further includes a horizontal-side amplitude adjusting unit that adjusts the amplitude of the horizontal-side nonlinear processing signal by multiplying by a first predetermined magnification value.
- the vertical nonlinear processing means includes vertical amplitude adjusting means for adjusting the amplitude of the vertical nonlinear processing signal by multiplying by a second predetermined magnification value
- the horizontal sub nonlinear processing means includes: Horizontal side sub-amplitude adjustment means for adjusting the amplitude of the horizontal side non-linear processing signal by multiplying by a third predetermined magnification value, wherein the vertical side sub-nonlinear processing means includes the vertical side sub-nonlinear processing signal.
- Vertical sub-amplitude adjusting means for adjusting the amplitude by multiplying by a fourth predetermined magnification value, wherein the first predetermined magnification value is larger than the second predetermined magnification value, Serial third predetermined magnification value may be larger configuration than the fourth predetermined magnification value.
- the amplitude of the signal output by the horizontal side sharpening processing means, the vertical side sharpening processing means, the sub horizontal side sharpening processing means, and the sub vertical side sharpening processing means is further appropriately increased. Can be adjusted. Then, the amplitude of the signal output from the horizontal side sharpening processing means can be made larger than the amplitude of the signal output from the sub horizontal side sharpening processing means, and the amplitude of the signal output from the vertical side sharpening processing means can be increased. The amplitude of the signal output by the sub vertical sharpening processing means can be made larger.
- At least one of the horizontal nonlinear processing means, the vertical nonlinear processing means, the horizontal sub nonlinear processing means, and the vertical sub nonlinear processing means includes two or more.
- Even power calculation means for generating an even power signal by raising an input signal to a power with an even power as an exponent, and the sign of the even power signal is different from that of the input signal.
- a code conversion means for inverting the code of the portion, and outputting the even power signal with the code inverted by the code conversion means.
- an even power signal is generated by powering an input signal with an even number of 2 or more as a power index, and the sign of the even power signal has a positive or negative sign.
- the sign of the portion different from the frequency component before powering is inverted, and the inverted signal is output.
- the input signal is raised to the power of an even number equal to or greater than 2, and the sign is output with the sign of the low-frequency removal signal before the power raised while maintaining the sign.
- a signal obtained by adding the output signal and the input signal includes a high frequency component not included in the input signal.
- At least one of the horizontal nonlinear processing means, the vertical nonlinear processing means, the horizontal sub nonlinear processing means, and the vertical sub nonlinear processing means includes two or more.
- the differential signal has a sign conversion means for inverting the sign of a portion different from the input signal, and outputs the differential signal whose sign is inverted by the sign conversion means. Also good.
- an even power signal is generated by powering an input signal with an even number of 2 or more as a power index, and a differential signal is generated by differentiating the even power signal. Then, in the differential signal, the sign of the portion where the sign is different from the frequency component before the power is inverted, and the inverted signal is output.
- the input signal is removed by raising the power of an even number of 2 or more as a power, and differentiating a direct current component that can be included in the signal after the power, and the sign is determined by the sign before and after the power. Since the signal with the sign of the input signal maintained is output, the signal obtained by adding the output signal and the input signal is included in the input signal. Contains no high frequency components.
- the rise and fall of the signal corresponding to the edge portion included in the signal is sharpened more steep than the conventional method of performing linear calculation. Since the direct current component that can be included in the signal after the squaring is removed by differentiating, the rising and falling edges of the signal are compared with the case where the direct current component that can be included in the signal after the squaring is not removed. It can be made steeper.
- At least one of the horizontal nonlinear processing means, the vertical nonlinear processing means, the horizontal sub nonlinear processing means, and the vertical sub nonlinear processing means includes three or more.
- An odd power calculation unit that raises an input signal to a power with an odd number as a power index may be provided, and the signal raised by the odd power calculation unit may be output.
- the odd number of 3 or more is used as a power exponent and the input signal is raised to the power, and the raised signal is output.
- the signal obtained by raising the input signal to the power of an odd number of 3 or more is output, the signal obtained by adding the output signal and the input signal is:
- the input signal includes high frequency components that are not included.
- At least one of the horizontal nonlinear processing means, the vertical nonlinear processing means, the horizontal sub nonlinear processing means, and the vertical sub nonlinear processing means is input.
- a square root computing means for generating a square root signal by multiplying the square root of the absolute value of the signal divided by the maximum value that can be taken by the input signal and the maximum value, and the sign of the square root signal The sign conversion means for inverting the sign of a portion different from the input signal may be provided, and the square root signal whose sign is inverted by the sign conversion means may be output.
- the square root of the absolute value of the value obtained by dividing the input signal by the maximum value that the input signal can take that is, the value obtained by normalizing the input signal
- the maximum A square root signal obtained by multiplying the value and the sign having the same sign as that of the input signal sign is output.
- a signal obtained by adding the output signal and the input signal includes a high frequency component that is not included in the input signal.
- At least one of the horizontal nonlinear processing means, the vertical nonlinear processing means, the horizontal sub nonlinear processing means, and the vertical sub nonlinear processing means is input.
- the value of the signal is in the vicinity of 0, a configuration in which a signal whose absolute value is larger than the absolute value of the input signal may be output.
- the value of the signal added to the signal to be sharpened when generating the output signal is set to a value larger than the signal to be sharpened. be able to.
- the signal processing apparatus includes the horizontal side low frequency component removing unit, the vertical side low frequency component removing unit, the horizontal side sub low frequency component removing unit, and the vertical side sub low frequency component removing unit. At least one of the configurations may be a high-pass filter having three or more taps.
- the signal obtained by adding the non-linear processing signal to the signal excluding the DC component contained in the signal to be sharpened and the signal to be sharpened is the object to be sharpened.
- a high frequency component that is not included in the signal is included.
- the signal processing apparatus includes the horizontal side low frequency component removing unit, the vertical side low frequency component removing unit, the horizontal side sub low frequency component removing unit, and the vertical side sub low frequency component removing unit.
- At least one of the signals to be output is a low-level signal removing unit that changes the signal value of the portion where the absolute value is smaller than the predetermined lower limit value to 0, and the absolute value of the output signal is lower than the predetermined upper limit value. It may be configured to further include a high-level signal removing unit that changes a signal value of a large part to a value not more than the upper limit value while maintaining a sign.
- the signal value of the part whose absolute value is smaller than a predetermined lower limit value to 0 among the signals to output the signal value of the part whose absolute value is larger than the predetermined upper limit value among output signals Only the absolute value is changed below the upper limit value while maintaining the sign.
- noise included in the output signal can be removed, and high-frequency components with large energy included in the output signal can be prevented from being amplified by nonlinear processing.
- the signal processing device may be realized by a computer.
- a control program for the signal processing device that causes the signal processing device to be realized by the computer by causing the computer to operate as each of the means, and A computer-readable recording medium on which it is recorded also falls within the scope of the present invention.
- a chip including the integrated circuit also falls within the scope of the present invention.
- the present invention can be applied to an apparatus for processing a digital signal representing an image.
- the present invention can be suitably applied to a display device that displays a still image or a moving image.
- High frequency component extraction unit (horizontal low frequency component removing means, vertical low frequency component removing means, horizontal sub low frequency component removing means, vertical sub low frequency component removing means, horizontal low frequency component removing circuit, vertical side Low frequency component removal circuit) 15 Adder (horizontal adder, vertical adder, horizontal sub adder, vertical sub adder, horizontal adder, vertical adder) 21 Nonlinear operation unit (even power calculation means, square root calculation means) 22 Nonlinear operation unit (odd power method) 31 Differentiation part (differentiation means) 41 Code conversion unit (code conversion means) 51 limiter (horizontal side amplitude adjusting means, vertical side amplitude adjusting means, horizontal side sub amplitude adjusting means, vertical side sub amplitude adjusting means) 100, 100a to 100e Sharpening processing section (horizontal side sharpening means, vertical side sharpening means, horizontal side sub sharpening means, vertical side sub sharpening means, horizontal side sharpening circuit, vertical side sharpening circuit) 100A sharpening processor (horizontal sharpening means, horizontal
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Image Processing (AREA)
- Picture Signal Circuits (AREA)
Abstract
Description
大処理する場合には、画質を十分に改善することができない。
各実施形態に係る信号処理装置(集積回路)500は、概略的に言えば、画像の水平方向(横方向、主走査方向)の周波数成分および垂直方向(縦方向、副走査方向)の周波数成分に対して、画像を鮮鋭化するための鮮鋭化処理を施す装置である。
次に、信号処理装置500の主要な構成要素である鮮鋭化処理部(水平側鮮鋭化手段、垂直側鮮鋭化手段、水平側サブ鮮鋭化手段、垂直側サブ鮮鋭化手段、水平側鮮鋭化回路、垂直側鮮鋭化回路)100の概要について説明する。なお、鮮鋭化処理部100は、後述する鮮鋭化処理部100a~100eのいずれであってもよい。本明細書では、鮮鋭化処理部100a~100eを区別しないとき、単に、「鮮鋭化処理部100」と表記する。
本発明の一実施形態について図1から図21に基づいて説明すると以下の通りである。なお、本実施形態に係る信号処理装置500を、信号処理装置500aと表記する。
図1を参照しながら、信号処理装置500aの構成について説明する。図1は、信号処理装置500aの構成を示すブロック図である。同図に示すように、信号処理装置500aは、2次元フィルタ(高周波成分除去手段、高周波成分除去回路)200、および鮮鋭化ユニット(鮮鋭化手段、鮮鋭化回路)150を備えている。
鮮鋭化処理部100Aと鮮鋭化処理部100Bとの接続順はどちらが先であってもよい。つまり、水平方向について鮮鋭化処理を施した後に垂直方向について鮮鋭化処理を施す代わりに、垂直方向について鮮鋭化処理を施した後に、水平方向について鮮鋭化処理を施す構成であってもよい。
次に、図3を参照しながら、2次元フィルタ200の2次元周波数特性について説明する。図3は、画像の2次元周波数特性の一部を示しており、横軸は水平方向の周波数を表し、縦軸は副水平方向の周波数を表している。なお、水平方向のサンプリング周波数をfhと表記し、副水平方向のサンプリング周波数をfvと表記している。
次に、鮮鋭化処理部100の詳細な構成について説明する。
図6は、鮮鋭化処理部100aの構成を示すブロック図である。同図に示すとおり、鮮鋭化処理部100aは、高周波成分抽出部(水平側低周波成分除去手段、垂直側低周波成分除去手段、水平側サブ低周波成分除去手段、垂直側サブ低周波成分除去手段、水平側低周波成分除去回路、垂直側低周波成分除去回路)11、非線形処理部102a、および加算部(水平側加算手段、垂直側加算手段、水平側サブ加算手段、垂直側サブ加算手段、水平側加算回路、垂直側加算回路)15を備えている。
次に、図9の(a)~(e)を参照しながら、鮮鋭化処理部100aの各部にて生成される信号の波形について説明する。図9の(a)~(e)は、鮮鋭化処理部100aの各部にて生成される信号の波形を模式的に示す図である。ここでは、図9の(a)に示す信号が、入力信号Sinとして鮮鋭化処理部100aに入力されるものとする。
上述した非線形処理部102aにおいて、非線形演算部21にて生成される非線形信号S21を微分する構成としてもよい。非線形信号S21を微分することによって、非線形信号S21に含まれる直流成分を除去することができるからである。
次に、図13の(a)~(f)を参照しながら、鮮鋭化処理部100bの各部にて生成される信号の波形について説明する。図13の(a)~(f)は、鮮鋭化処理部100bの各部にて生成される信号の波形を模式的に示す図である。ここでは、図13の(a)に示す信号が、入力信号Sinとして鮮鋭化処理部100bに入力されるものとする。なお、図13の(a)に示す信号は、図9の(a)に示す信号と同じである。
上述した非線形処理部102aおよび非線形処理部102bの構成では、符号変換部41を備える構成としたが、高周波信号S11に対して施す非線形演算が、高周波信号S11の符号の正負を維持するものであれば、符号変換部41を備える必要はない。
次に、図15の(a)~(d)を参照しながら、鮮鋭化処理部100cの各部にて生成される信号の波形について説明する。図15の(a)~(d)は、鮮鋭化処理部100cの各部にて生成される信号の波形を模式的に示す図である。ここでは、図15の(a)に示す信号が、入力信号Sinとして鮮鋭化処理部100cに入力されるものとする。なお、図15の(a)に示す信号は、図9の(a)に示す信号と同じである。
次に、鮮鋭化処理部100が生成する出力信号Soutが、入力信号Sinが有する高調波成分等のナイキスト周波数fs/2を超える高周波成分を含む理由について説明する。
鮮鋭化処理部100にて施す非線形演算は、上述した以外にも様々に考えられる。そこで、図16および図17を参照しながら、鮮鋭化処理部100dおよび100eの構成例について説明する。
上述した鮮鋭化処理部100dの構成では、2乗演算部61を備える構成としたが、2乗演算部61に代えて、入力された信号の絶対値を計算する絶対値処理部62を備える構成としてもよい。
図18に示す周波数スペクトルを有する画像信号をアップコンバートすることによって画素数を横方向に2倍にする拡大処理が施された後の画像信号の周波数スペクトルを図19に示す。図19に示すように、拡大処理後の画像信号には、サンプリング周波数fsに対するナイキスト周波数fs/2と、新たなサンプリング周波数Fbsに対するナイキスト周波数Fbs/2(=fs)との間に周波数成分が存在しない。そのため、拡大処理後の画像信号に対して、従来から知られている線形演算を用いる鮮鋭化処理を施した場合、ナイキスト周波数Fbs/2の近傍の周波数成分が加算されることはない。
図21を参照しながら、信号処理装置500aまたは信号処理装置500bにて、画像に鮮鋭化処理を施した様子について説明する。図21は、画像を鮮鋭化する様子を示す概要図である。
鮮鋭化処理部100Aおよび鮮鋭化処理部100Bにて施す鮮鋭化の度合いは、2次元フィルタ200にて画像の斜め方向の周波数成分を減衰させる度合いに応じて設定することが好ましい。
実施形態1にて説明した信号処理装置500aまたは信号処理装置500bは、原画像の斜め線を低減した上で、原画像の水平方向および垂直方向のそれぞれについて鮮鋭化処理を施す構成である。そのため、鮮鋭化後の画像では、斜め線は低減された状態のままである。鮮鋭化後の画像に、原画像の斜め線を加える構成とすれば、鮮鋭化後の画像をさらに高画質にすることができる。
図22を参照しながら、信号処理装置500cの構成について説明する。図22は、信号処理装置500cの構成を示すブロック図である。同図に示すように、信号処理装置500cは、高域通過フィルタ(直流成分除去手段)220、2次元フィルタ200、鮮鋭化ユニット150、および加算部(入力信号加算手段)240を備えている。
本実施形態の場合にも、実施形態1にて説明したように、鮮鋭化処理部100Aと鮮鋭化処理部100Bとの接続順はどちらが先であってもよい。当該変形例に係る信号処理装置500を信号処理装置500dと表記する。信号処理装置500dの構成を示すブロック図は、図23に示すとおりとなる。
上述したように、信号処理装置500cまたは信号処理装置500dでは、鮮鋭化後の画像に対して、原画像の斜め線を加えることによって、斜め線を増強させる。そのため、例えば、図21の(a)に示す斜め線に対して、信号処理装置500cまたは信号処理装置500dにて鮮鋭化処理を施した場合、図21の(b)に示す斜め線よりも、斜め線が増強されるので、鮮鋭化後の画像は、図21の(b)よりも高画質に見える。
(2次元フィルタに応じた鮮鋭化度合いの設定)
本実施形態の場合にも、実施形態1にて説明したように、2次元フィルタ200にて画像の斜め方向の周波数成分を減衰させる度合いに応じて、鮮鋭化処理部100Aおよび鮮鋭化処理部100Bにて施す鮮鋭化の度合いを設定することが好ましい。当該設定内容は、実施形態1にて説明した内容と同様であるので、ここではその説明を省略する。
本実施形態では、原画像に含まれる斜め線の低減量に応じて、鮮鋭化度合いを切り替える形態について説明する。本発明の一実施形態について図24および図25に基づいて説明すると以下の通りである。本実施形態に係る信号処理装置500を、信号処理装置500eと表記する。なお、説明の便宜上、実施形態1にて示した各部材と同一の機能を有する部材には、同一の符号を付記し、特に記載する場合を除きその説明を省略する。
図24を参照しながら、信号処理装置500eの構成について説明する。図24は、信号処理装置500eの構成を示すブロック図である。同図に示すように、信号処理装置500eは、2次元フィルタ200、鮮鋭化ユニット150、鮮鋭化ユニット(サブ鮮鋭化手段)152、差分判定部(差分判定手段)300、および信号出力部(信号出力手段)320を備えている。
本実施形態の場合にも、実施形態1にて説明したように、鮮鋭化処理部100Aと鮮鋭化処理部100Bとの接続順はどちらが先であってもよい。当該変形例に係る信号処理装置500を信号処理装置500fと表記する。信号処理装置500fの構成を示すブロック図は、図25に示すとおりとなる。
上述したように、信号処理装置500eまたは信号処理装置500fでは、斜め線の低減量が多いブロック領域では、フィルタ信号S200を鮮鋭化して出力し、斜め線の低減量が少ないブロック領域では、入力信号SAを鮮鋭化して出力する。つまり、斜め線の低減量に応じて適度な鮮鋭化を施すことができる。そのため、例えば、図21の(a)に示す斜め線に対して、信号処理装置500eまたは信号処理装置500fにて鮮鋭化処理を施した場合、図21の(b)に示す斜め線よりも、斜め線が増強されるので、鮮鋭化後の画像は、図21の(b)よりも高画質に見える。
本実施形態の場合にも、実施形態1にて説明したように、2次元フィルタ200にて画像の斜め方向の周波数成分を減衰させる度合いに応じて、鮮鋭化処理部100Aおよび鮮鋭化処理部100Bにて施す鮮鋭化の度合いを設定することが好ましい。当該設定内容は、実施形態1にて説明した内容と同様であるので、ここではその説明を省略する。
最後に、信号処理装置500の各ブロックは、集積回路(ICチップ)上に形成された論理回路によってハードウェアとして構成してもよいし、次のようにCPU(central processing unit)を用いてソフトウェアによって実現してもよい。
15 加算部(水平側加算手段、垂直側加算手段、水平側サブ加算手段、垂直側サブ加算手段、水平側加算回路、垂直側加算回路)
21 非線形演算部(偶数冪乗演算手段、平方根演算手段)
22 非線形演算部(奇数冪乗演算手段)
31 微分部(微分手段)
41 符号変換部(符号変換手段)
51 リミッタ(水平側振幅調整手段、垂直側振幅調整手段、水平側サブ振幅調整手段、垂直側サブ振幅調整手段)
100、100a~100e 鮮鋭化処理部(水平側鮮鋭化手段、垂直側鮮鋭化手段、水平側サブ鮮鋭化手段、垂直側サブ鮮鋭化手段、水平側鮮鋭化回路、垂直側鮮鋭化回路)
100A 鮮鋭化処理部(水平側鮮鋭化手段、水平側鮮鋭化回路)
100B 鮮鋭化処理部(垂直側鮮鋭化手段、垂直側鮮鋭化回路)
100C 鮮鋭化処理部(水平側サブ鮮鋭化手段)
100D 鮮鋭化処理部(垂直側サブ鮮鋭化手段)
102、102a~102e 非線形処理部(水平側非線形処理手段、垂直側非線形処理手段、水平側サブ非線形処理手段、垂直側サブ非線形処理手段、水平側非線形処理回路、垂直側非線形処理回路)
150、151 鮮鋭化ユニット(鮮鋭化手段、鮮鋭化回路)
152、153 サブ鮮鋭化ユニット(サブ鮮鋭化手段)
200 2次元フィルタ(高周波成分除去手段、高周波成分除去回路)
220 高域通過フィルタ(直流成分除去手段)
240 加算部(入力信号加算手段)
300 差分判定部(差分判定手段)
320 信号出力部(信号出力手段)
500、500a~500f 信号処理装置(集積回路)
S11 高周波信号(水平側低周波除去信号、垂直側低周波除去信号、水平側サブ低周波除去信号、垂直側サブ低周波除去信号)
S12 非線形処理信号(水平側非線形処理信号、垂直側非線形処理信号、水平側サブ非線形処理信号、垂直側サブ非線形処理信号)
S21 非線形信号(偶数冪乗信号、平方根信号)
S22 非線形信号
S31 微分信号
S101 鮮鋭化信号(水平側鮮鋭化信号)
S102 鮮鋭化信号(垂直側鮮鋭化信号)
S103 鮮鋭化信号(水平側サブ鮮鋭化信号)
S104 鮮鋭化信号(垂直側サブ鮮鋭化信号)
S200 フィルタ信号(斜め低減信号)
S220 高域信号
SA 入力信号
SO 出力信号
Claims (16)
- 画像を表す入力信号に対して上記画像を鮮鋭化する処理を施し、該鮮鋭化させた画像を表す信号を出力する信号処理装置であって、
上記入力信号で表される画像の水平方向および垂直方向を除く方向の周波数成分のうち高周波成分を上記入力信号から除去することによって斜め低減信号を生成する高周波成分除去手段と、
上記斜め低減信号を入力とし、上記斜め低減信号を鮮鋭化させた鮮鋭化信号を出力する鮮鋭化手段とを備え、
上記鮮鋭化手段は、
入力される信号で表される画像の水平方向に隣接して並ぶ画素から成る画素群を表す信号を鮮鋭化した水平側鮮鋭化信号を出力する水平側鮮鋭化手段と、
入力される信号で表される画像の垂直方向に隣接して並ぶ画素から成る画素群を表す信号を鮮鋭化した垂直側鮮鋭化信号を出力する垂直側鮮鋭化手段とを備えており、
上記水平側鮮鋭化手段と上記垂直側鮮鋭化手段とは縦列接続されており、
上記斜め低減信号は、縦列接続された上段側の上記水平側鮮鋭化手段または上記垂直側鮮鋭化手段に入力され、
上記鮮鋭化手段は、縦列接続された下段側の上記水平側鮮鋭化手段または上記垂直側鮮鋭化手段から出力される信号を、上記鮮鋭化信号として出力し、
上記水平側鮮鋭化手段は、
入力される信号で表される画像の水平方向に隣接して並ぶ画素から成る画素群を表す信号に含まれる周波数成分から、少なくとも直流成分を除去することによって水平側低周波除去信号を生成して出力する水平側低周波成分除去手段と、
上記水平側低周波除去信号を入力とし、上記水平側低周波除去信号の符号の正負が維持され、かつ、少なくとも上記水平側低周波除去信号の値が0の近傍のとき、上記水平側低周波除去信号に対して非線形に広義に単調増加する水平側非線形処理信号を生成し、当該水平側非線形処理信号を出力する水平側非線形処理手段と、
上記水平側鮮鋭化手段に入力される信号と上記水平側非線形処理信号とを加算することによって、上記水平側鮮鋭化信号を生成して出力する水平側加算手段とを備え、
上記垂直側鮮鋭化手段は、
入力される信号で表される画像の垂直方向に隣接して並ぶ画素から成る画素群を表す信号に含まれる周波数成分から、少なくとも直流成分を除去することによって垂直側低周波除去信号を生成して出力する垂直側低周波成分除去手段と、
上記垂直側低周波除去信号を入力とし、上記垂直側低周波除去信号の符号の正負が維持され、かつ、少なくとも上記垂直側低周波除去信号の値が0の近傍のとき、上記垂直側低周波除去信号に対して非線形に広義に単調増加する垂直側非線形処理信号を生成し、当該垂直側非線形処理信号を出力する垂直側非線形処理手段と、
上記垂直側鮮鋭化手段に入力される信号と上記垂直側非線形処理信号とを加算することによって、上記垂直側鮮鋭化信号を生成して出力する垂直側加算手段とを備えることを特徴とする信号処理装置。 - 縦列接続の上段側に上記水平側鮮鋭化手段が設けられ、
縦列接続の下段側に上記垂直側鮮鋭化手段が設けられていることを特徴とする請求項1に記載の信号処理装置。 - 縦列接続の上段側に上記垂直側鮮鋭化手段が設けられ、
縦列接続の下段側に上記水平側鮮鋭化手段が設けられていることを特徴とする請求項1に記載の信号処理装置。 - 上記高周波成分除去手段にて上記斜め低減信号を生成する前に、上記入力信号に含まれる周波数成分のうち少なくとも直流成分を除去する直流成分除去手段と、
上記入力信号と上記鮮鋭化信号とを加算するとともに、該加算にて得られる信号を出力する入力信号加算手段とをさらに備えることを特徴とする請求項1から3のいずれか1項に記載の信号処理装置。 - 上記入力信号を入力とし、上記入力信号を鮮鋭化させたサブ鮮鋭化信号を出力するサブ鮮鋭化手段と、
隣接する複数の画素から成るブロック領域毎に、上記入力信号と上記斜め低減信号との差分を算出するとともに、当該算出した差分が所定値以上であるか否かを判定する差分判定手段と、
上記鮮鋭化信号および上記サブ鮮鋭化信号を入力とし、上記差分判定手段にて算出した差分が所定値以上である上記ブロック領域については上記鮮鋭化信号を出力するともに、上記差分判定手段にて算出した差分が所定値未満である上記ブロック領域については上記サブ鮮鋭化信号を出力する信号出力手段とをさらに備え、
上記サブ鮮鋭化手段は、
入力される信号で表される画像の水平方向に隣接して並ぶ画素から成る画素群を表す信号を鮮鋭化した水平側サブ鮮鋭化信号を出力する水平側サブ鮮鋭化手段と、
入力される信号で表される画像の垂直方向に隣接して並ぶ画素から成る画素群を表す信号を鮮鋭化した垂直側サブ鮮鋭化信号を出力する垂直側サブ鮮鋭化手段とを備え、
上記水平側サブ鮮鋭化手段と上記垂直側サブ鮮鋭化手段とは縦列接続されており、
上記入力信号は、縦列接続された上段側の上記水平側サブ鮮鋭化手段または上記垂直側サブ鮮鋭化手段に入力され、
上記サブ鮮鋭化手段は、縦列接続された下段側の上記水平側サブ鮮鋭化手段または上記垂直側サブ鮮鋭化手段から出力される信号を、上記サブ鮮鋭化信号として出力し、
上記水平側サブ鮮鋭化手段は、
入力される信号で表される画像の水平方向に隣接して並ぶ画素から成る画素群を表す信号に含まれる周波数成分から、少なくとも直流成分を除去することによって水平側サブ低周波除去信号を生成して出力する水平側サブ低周波成分除去手段と、
上記水平側サブ低周波除去信号を入力とし、上記水平側サブ低周波除去信号の符号の正負が維持され、かつ、少なくとも上記水平側サブ低周波除去信号の値が0の近傍のとき、上記水平側サブ低周波除去信号に対して非線形に広義に単調増加する水平側サブ非線形処理信号を生成し、当該水平側サブ非線形処理信号を出力する水平側サブ非線形処理手段と、
上記水平側サブ鮮鋭化手段に入力される信号と上記水平側サブ非線形処理信号とを加算することによって、上記水平側サブ鮮鋭化信号を生成して出力する水平側サブ加算手段とを備え、
上記垂直側サブ鮮鋭化手段は、
入力される信号で表される画像の垂直方向に隣接して並ぶ画素から成る画素群を表す信号に含まれる周波数成分から、少なくとも直流成分を除去することによって垂直側サブ低周波除去信号を生成して出力する垂直側サブ低周波成分除去手段と、
上記垂直側サブ低周波除去信号を入力とし、上記垂直側サブ低周波除去信号の符号の正負が維持され、かつ、少なくとも上記垂直側サブ低周波除去信号の値が0の近傍のとき、上記垂直側サブ低周波除去信号に対して非線形に広義に単調増加する垂直側サブ非線形処理信号を生成し、当該垂直側サブ非線形処理信号を出力する垂直側サブ非線形処理手段と、
上記垂直側サブ鮮鋭化手段に入力される信号と上記垂直側サブ非線形処理信号とを加算することによって、上記垂直側サブ鮮鋭化信号を生成して出力する垂直側サブ加算手段とを備えることを特徴とする請求項1から3のいずれか1項に記載の信号処理装置。 - 上記水平側鮮鋭化手段が上記垂直側鮮鋭化手段より上段に設けられている場合、上記水平側サブ鮮鋭化手段が上記垂直側サブ鮮鋭化手段より上段に設けられ、
上記水平側鮮鋭化手段が上記垂直側鮮鋭化手段より下段に設けられている場合、上記水平側サブ鮮鋭化手段が上記垂直側サブ鮮鋭化手段より下段に設けられていることを特徴とする請求項5に記載の信号処理装置。 - 上記水平側非線形処理手段は、上記水平側非線形処理信号の振幅を、第1の所定の倍率値を乗算することによって調整する水平側振幅調整手段を備え、
上記垂直側非線形処理手段は、上記垂直側非線形処理信号の振幅を、第2の所定の倍率値を乗算することによって調整する垂直側振幅調整手段を備え、
上記水平側サブ非線形処理手段は、上記水平側サブ非線形処理信号の振幅を、第3の所定の倍率値を乗算することによって調整する水平側サブ振幅調整手段を備え、
上記垂直側サブ非線形処理手段は、上記垂直側サブ非線形処理信号の振幅を、第4の所定の倍率値を乗算することによって調整する垂直側サブ振幅調整手段を備え、
上記第1の所定の倍率値は上記第2の所定の倍率値よりも大きく、上記第3の所定の倍率値は上記第4の所定の倍率値よりも大きいことを特徴とする請求項5または6に記載の信号処理装置。 - 上記水平側非線形処理手段、上記垂直側非線形処理手段、上記水平側サブ非線形処理手段、および上記垂直側サブ非線形処理手段の少なくともいずれかは、
2以上の偶数を冪指数として、入力される信号を冪乗することにより偶数冪乗信号を生成する偶数冪乗演算手段と、
上記偶数冪乗信号のうち、符号の正負が、上記入力される信号と異なる部分の符号を反転する符号変換手段とを備え、
上記符号変換手段によって符号が反転された上記偶数冪乗信号を出力することを特徴とする請求項1から7のいずれか1項に記載の信号処理装置。 - 上記水平側非線形処理手段、上記垂直側非線形処理手段、上記水平側サブ非線形処理手段、および上記垂直側サブ非線形処理手段の少なくともいずれかは、
2以上の偶数を冪指数として、入力される信号を冪乗することにより偶数冪乗信号を生成する偶数冪乗演算手段と、
上記偶数冪乗信号を微分することによって微分信号を生成する微分手段と、
上記微分信号のうち、符号の正負が、上記入力される信号と異なる部分の符号を反転する符号変換手段とを備え、
上記符号変換手段によって符号が反転された上記微分信号を出力することを特徴とする請求項1から7のいずれか1項に記載の信号処理装置。 - 上記水平側非線形処理手段、上記垂直側非線形処理手段、上記水平側サブ非線形処理手段、および上記垂直側サブ非線形処理手段の少なくともいずれかは、
3以上の奇数を冪指数として、入力される信号を冪乗する奇数冪乗演算手段を備え、
上記奇数冪乗演算手段によって冪乗された信号を出力することを特徴とする請求項1から7のいずれか1項に記載の信号処理装置。 - 上記水平側非線形処理手段、上記垂直側非線形処理手段、上記水平側サブ非線形処理手段、および上記垂直側サブ非線形処理手段の少なくともいずれかは、
入力される信号を、当該入力される信号の取り得る最大値で除算した値の絶対値の平方根と、上記最大値とを乗算することによって平方根信号を生成する平方根演算手段と、
上記平方根信号のうち、符号の正負が、上記入力される信号と異なる部分の符号を反転する符号変換手段とを備え、
上記符号変換手段によって符号が反転された上記平方根信号を出力することを特徴とする請求項1から7のいずれか1項に記載の信号処理装置。 - 上記水平側非線形処理手段、上記垂直側非線形処理手段、上記水平側サブ非線形処理手段、および上記垂直側サブ非線形処理手段の少なくともいずれかは、
入力される信号の値が0の近傍のとき、絶対値が上記入力される信号の絶対値よりも大きい信号を出力することを特徴とする請求項1から11のいずれか1項に記載の信号処理装置。 - 上記水平側低周波成分除去手段、上記垂直側低周波成分除去手段、上記水平側サブ低周波成分除去手段、および上記垂直側サブ低周波成分除去手段の少なくともいずれかは、
タップ数が3以上の高域通過型のフィルタであることを特徴とする請求項1から12のいずれか1項に記載の信号処理装置。 - 上記水平側低周波成分除去手段、上記垂直側低周波成分除去手段、上記水平側サブ低周波成分除去手段、および上記垂直側サブ低周波成分除去手段の少なくともいずれかは、
出力する信号のうち、絶対値が所定下限値よりも小さい部分の信号値を0に変更する低レベル信号除去手段と、
出力する信号のうち、絶対値が所定上限値よりも大きい部分の信号値を、符号を維持して絶対値のみ当該上限値以下に変更する高レベル信号除去手段とをさらに備えることを特徴とする請求項1から13のいずれか1項に記載の信号処理装置。 - 請求項1から14のいずれか1項に記載の信号処理装置が備えるコンピュータを動作させる制御プログラムであって、上記コンピュータを上記の各手段として機能させるための制御プログラム。
- 画像を表す入力信号に対して上記画像を鮮鋭化する処理を施し、該鮮鋭化させた画像を表す信号を出力する集積回路であって、
上記入力信号で表される画像の水平方向および垂直方向を除く方向の周波数成分のうち高周波成分を上記入力信号から除去することによって斜め低減信号を生成する高周波成分除去回路と、
上記斜め低減信号を入力とし、上記斜め低減信号を鮮鋭化させた鮮鋭化信号を出力する鮮鋭化回路とを有し、
上記鮮鋭化回路は、
入力される信号で表される画像の水平方向に隣接して並ぶ画素から成る画素群を表す信号を鮮鋭化した水平側鮮鋭化信号を出力する水平側鮮鋭化回路と、
入力される信号で表される画像の垂直方向に隣接して並ぶ画素から成る画素群を表す信号を鮮鋭化した垂直側鮮鋭化信号を出力する垂直側鮮鋭化回路とを有しており、
上記水平側鮮鋭化回路と上記垂直側鮮鋭化回路とは縦列接続されており、
上記斜め低減信号は、縦列接続された上段側の上記水平側鮮鋭化回路または上記垂直側鮮鋭化回路に入力され、
上記鮮鋭化回路は、縦列接続された下段側の上記水平側鮮鋭化回路または上記垂直側鮮鋭化回路から出力される信号を、上記鮮鋭化信号として出力し、
上記水平側鮮鋭化回路は、
入力される信号で表される画像の水平方向に隣接して並ぶ画素から成る画素群を表す信号に含まれる周波数成分から、少なくとも直流成分を除去することによって水平側低周波除去信号を生成して出力する水平側低周波成分除去回路と、
上記水平側低周波除去信号を入力とし、上記水平側低周波除去信号の符号の正負が維持され、かつ、少なくとも上記水平側低周波除去信号の値が0の近傍のとき、上記水平側低周波除去信号に対して非線形に広義に単調増加する水平側非線形処理信号を生成し、当該水平側非線形処理信号を出力する水平側非線形処理回路と、
上記水平側鮮鋭化回路に入力される信号と上記水平側非線形処理信号とを加算することによって、上記水平側鮮鋭化信号を生成して出力する水平側加算回路とを有し、
上記垂直側鮮鋭化回路は、
入力される信号で表される画像の垂直方向に隣接して並ぶ画素から成る画素群を表す信号に含まれる周波数成分から、少なくとも直流成分を除去することによって垂直側低周波除去信号を生成して出力する垂直側低周波成分除去回路と、
上記垂直側低周波除去信号を入力とし、上記垂直側低周波除去信号の符号の正負が維持され、かつ、少なくとも上記垂直側低周波除去信号の値が0の近傍のとき、上記垂直側低周波除去信号に対して非線形に広義に単調増加する垂直側非線形処理信号を生成し、当該垂直側非線形処理信号を出力する垂直側非線形処理回路と、
上記垂直側鮮鋭化回路に入力される信号と上記垂直側非線形処理信号とを加算することによって、上記垂直側鮮鋭化信号を生成して出力する垂直側加算回路とを有していることを特徴とする集積回路。
Priority Applications (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US13/823,299 US8773594B2 (en) | 2010-09-29 | 2011-09-22 | Signal processing device, and integrated circuit including oblique lowpass filtering and multiple sharpening components |
JP2012536410A JP5583780B2 (ja) | 2010-09-29 | 2011-09-22 | 信号処理装置および集積回路 |
EP11828963.6A EP2624536A1 (en) | 2010-09-29 | 2011-09-22 | Signal processing device, control program, and integrated circuit |
CN201180047272.1A CN103141077B (zh) | 2010-09-29 | 2011-09-22 | 信号处理装置、控制程序以及集成电路 |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2010219711 | 2010-09-29 | ||
JP2010-219711 | 2010-09-29 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2012043407A1 true WO2012043407A1 (ja) | 2012-04-05 |
Family
ID=45892858
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2011/071706 WO2012043407A1 (ja) | 2010-09-29 | 2011-09-22 | 信号処理装置、制御プログラム、および集積回路 |
Country Status (5)
Country | Link |
---|---|
US (1) | US8773594B2 (ja) |
EP (1) | EP2624536A1 (ja) |
JP (1) | JP5583780B2 (ja) |
CN (1) | CN103141077B (ja) |
WO (1) | WO2012043407A1 (ja) |
Cited By (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP5320538B1 (ja) * | 2012-08-09 | 2013-10-23 | 清一 合志 | 画像強調装置、画像強調方法 |
JP5403450B1 (ja) * | 2013-02-25 | 2014-01-29 | 清一 合志 | 画像処理装置、画像処理方法 |
WO2014025067A1 (ja) * | 2012-08-09 | 2014-02-13 | 株式会社計測技術研究所 | 画像強調装置、画像強調方法 |
JP5629902B1 (ja) * | 2013-08-20 | 2014-11-26 | 合志 清一 | 画像処理装置、画像処理方法 |
WO2015029450A1 (ja) * | 2013-08-30 | 2015-03-05 | 株式会社計測技術研究所 | 画像処理装置及び画像処理方法 |
JP2016521571A (ja) * | 2013-06-11 | 2016-07-25 | プルーリオミクス・ベー・フェー | 多能性哺乳動物幹細胞に由来する心筋細胞を成熟させるための培地組成物 |
Families Citing this family (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2011061958A1 (ja) * | 2009-11-17 | 2011-05-26 | シャープ株式会社 | 復号化装置、復号化装置の制御方法、伝送システム、および制御プログラムを記録したコンピュータ読み取り可能な記録媒体 |
US8811765B2 (en) | 2009-11-17 | 2014-08-19 | Sharp Kabushiki Kaisha | Encoding device configured to generate a frequency component extraction signal, control method for an encoding device using the frequency component extraction signal, transmission system, and computer-readable recording medium having a control program recorded thereon |
JP6096382B2 (ja) * | 2014-04-11 | 2017-03-15 | 富士フイルム株式会社 | 画像処理装置、撮像装置、画像処理方法及びプログラム |
CN105698789A (zh) * | 2016-01-12 | 2016-06-22 | 西北工业大学 | 舰船升沉测量方法及其测量系统 |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH07184085A (ja) * | 1993-12-24 | 1995-07-21 | Matsushita Electric Ind Co Ltd | 映像信号処理装置 |
JPH08139969A (ja) * | 1994-11-08 | 1996-05-31 | Matsushita Electric Ind Co Ltd | 輪郭補正回路 |
JPH09233489A (ja) * | 1996-02-23 | 1997-09-05 | Sharp Corp | ノイズ低減回路 |
JP2006310934A (ja) | 2005-04-26 | 2006-11-09 | Nippon Hoso Kyokai <Nhk> | プリフィルタ |
Family Cites Families (38)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH07312704A (ja) | 1994-05-18 | 1995-11-28 | Victor Co Of Japan Ltd | 画質補償回路 |
JPH09307897A (ja) | 1996-05-09 | 1997-11-28 | Fuji Photo Film Co Ltd | 画像データ圧縮処理方法 |
JPH09319869A (ja) | 1996-05-28 | 1997-12-12 | Nippon Hoso Kyokai <Nhk> | 画像エンハンサ |
EP0897222A4 (en) | 1997-02-10 | 2007-07-25 | Sony Corp | PROCESS AND EQUIPMENT FOR DATA PROCESSING |
JPH1166311A (ja) | 1997-08-08 | 1999-03-09 | Hitachi Tobu Semiconductor Ltd | むら検査方法および装置 |
JPH11340878A (ja) | 1998-05-22 | 1999-12-10 | Ricoh Co Ltd | 位相等化方式 |
JP3788031B2 (ja) | 1998-06-03 | 2006-06-21 | コニカミノルタホールディングス株式会社 | 画像処理方法および画像処理装置 |
JP2001169116A (ja) | 1999-12-10 | 2001-06-22 | Victor Co Of Japan Ltd | 画像強調装置及びその方法 |
JP2002125200A (ja) | 2000-10-16 | 2002-04-26 | Hitachi Ltd | 動画像フォーマット変換装置 |
US6831947B2 (en) | 2001-03-23 | 2004-12-14 | Sharp Laboratories Of America, Inc. | Adaptive quantization based on bit rate prediction and prediction error energy |
WO2002084997A1 (fr) | 2001-04-11 | 2002-10-24 | Sony Corporation | Circuit d'accentuation de contours |
JP2003069859A (ja) | 2001-08-27 | 2003-03-07 | Seiko Epson Corp | 動きに適応した動画像処理 |
JP2003101774A (ja) | 2001-09-25 | 2003-04-04 | Ricoh Co Ltd | 画像処理装置 |
JP2003134352A (ja) | 2001-10-26 | 2003-05-09 | Konica Corp | 画像処理方法及び装置並びにプログラム |
JP2003198878A (ja) | 2001-12-28 | 2003-07-11 | Sharp Corp | 輪郭補正装置 |
JP3879543B2 (ja) * | 2002-03-08 | 2007-02-14 | ソニー株式会社 | 画像処理装置 |
EP1349113A3 (en) | 2002-03-20 | 2006-01-11 | Ricoh Company | Image processor and image processing method |
JP4141712B2 (ja) | 2002-03-20 | 2008-08-27 | 株式会社リコー | 画像処理装置 |
JP4451057B2 (ja) * | 2002-12-27 | 2010-04-14 | シャープ株式会社 | 表示装置の駆動方法、表示装置、および、そのプログラム |
SG115540A1 (en) * | 2003-05-17 | 2005-10-28 | St Microelectronics Asia | An edge enhancement process and system |
JP4139760B2 (ja) | 2003-10-10 | 2008-08-27 | 富士フイルム株式会社 | 画像処理方法および装置ならびに画像処理プログラム |
JP4419566B2 (ja) | 2003-12-25 | 2010-02-24 | ソニー株式会社 | 映像信号処理装置、映像信号処理方法および映像信号処理プログラム |
JP4724124B2 (ja) * | 2004-10-08 | 2011-07-13 | パナソニック株式会社 | 画像処理装置および画像処理プログラム |
JP2006157584A (ja) | 2004-11-30 | 2006-06-15 | Konica Minolta Medical & Graphic Inc | 画像処理方法 |
US7639884B2 (en) | 2005-04-26 | 2009-12-29 | Nippon Hoso Kyokai | Prefilter, compressive coding pre-processing apparatus and decompressive decoding post-processing apparatus, and compressive coding apparatus and decompressive decoding apparatus |
US7668387B2 (en) | 2005-06-20 | 2010-02-23 | Intel Corporation | Selective local transient improvement and peaking for video sharpness enhancement |
EP1763188A1 (en) | 2005-09-09 | 2007-03-14 | Vrije Universiteit Brussel | Multistage tuning-tolerant equalizer filter with detection mechanisms for lower and higher frequency gain loops |
US7590174B2 (en) | 2005-12-20 | 2009-09-15 | Altera Corporation | Signal adjustment receiver circuitry |
JP2007265122A (ja) | 2006-03-29 | 2007-10-11 | Victor Co Of Japan Ltd | 画像処理装置 |
JP4116649B2 (ja) | 2006-05-22 | 2008-07-09 | 株式会社東芝 | 高解像度化装置および方法 |
JP4475255B2 (ja) | 2006-06-19 | 2010-06-09 | ソニー株式会社 | 画像処理装置 |
JP2008103785A (ja) | 2006-10-17 | 2008-05-01 | Sony Corp | 輪郭強調回路、輪郭強調方法、撮像装置およびビューファインダ |
JP2009198935A (ja) | 2008-02-25 | 2009-09-03 | Panasonic Corp | 液晶表示装置 |
JP2010140460A (ja) * | 2008-11-13 | 2010-06-24 | Sony Corp | 画像処理装置および方法、並びにプログラム |
CN102362486B (zh) | 2009-03-31 | 2015-02-04 | 夏普株式会社 | 图像增强装置、图像增强方法、图像增强程序和信号处理装置 |
WO2010140281A1 (ja) | 2009-06-04 | 2010-12-09 | シャープ株式会社 | 信号処理装置、信号処理装置の制御方法、制御プログラム、および該制御プログラムを記録したコンピュータ読み取り可能な記録媒体 |
US8427256B2 (en) | 2009-06-16 | 2013-04-23 | Sharp Kabushiki Kaisha | Waveform shaping device, equalizer, receiving system, method of controlling waveform shaping device, control program, and computer-readable medium in which control program is recorded |
WO2011061958A1 (ja) | 2009-11-17 | 2011-05-26 | シャープ株式会社 | 復号化装置、復号化装置の制御方法、伝送システム、および制御プログラムを記録したコンピュータ読み取り可能な記録媒体 |
-
2011
- 2011-09-22 WO PCT/JP2011/071706 patent/WO2012043407A1/ja active Application Filing
- 2011-09-22 JP JP2012536410A patent/JP5583780B2/ja not_active Expired - Fee Related
- 2011-09-22 CN CN201180047272.1A patent/CN103141077B/zh not_active Expired - Fee Related
- 2011-09-22 US US13/823,299 patent/US8773594B2/en not_active Expired - Fee Related
- 2011-09-22 EP EP11828963.6A patent/EP2624536A1/en not_active Withdrawn
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH07184085A (ja) * | 1993-12-24 | 1995-07-21 | Matsushita Electric Ind Co Ltd | 映像信号処理装置 |
JPH08139969A (ja) * | 1994-11-08 | 1996-05-31 | Matsushita Electric Ind Co Ltd | 輪郭補正回路 |
JPH09233489A (ja) * | 1996-02-23 | 1997-09-05 | Sharp Corp | ノイズ低減回路 |
JP2006310934A (ja) | 2005-04-26 | 2006-11-09 | Nippon Hoso Kyokai <Nhk> | プリフィルタ |
Cited By (17)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9471962B2 (en) | 2012-08-09 | 2016-10-18 | Keisoku Giken Co., Ltd. | Image enhancement apparatus and image enhancement method |
US9495732B2 (en) | 2012-08-09 | 2016-11-15 | Keisoku Giken Co., Ltd. | Image enhancing device and image enhancement method |
WO2014024373A1 (ja) * | 2012-08-09 | 2014-02-13 | 株式会社計測技術研究所 | 画像強調装置、画像強調方法 |
WO2014025067A1 (ja) * | 2012-08-09 | 2014-02-13 | 株式会社計測技術研究所 | 画像強調装置、画像強調方法 |
JP5320538B1 (ja) * | 2012-08-09 | 2013-10-23 | 清一 合志 | 画像強調装置、画像強調方法 |
WO2014129209A1 (ja) | 2013-02-25 | 2014-08-28 | 株式会社計測技術研究所 | 画像処理装置、画像処理方法 |
CN105075232A (zh) * | 2013-02-25 | 2015-11-18 | 株式会社计测技术研究所 | 图像处理装置、图像处理方法 |
US9374508B2 (en) | 2013-02-25 | 2016-06-21 | KEISOU GIKEN Co., Ltd. | Image processing apparatus and image processing method |
JP5403450B1 (ja) * | 2013-02-25 | 2014-01-29 | 清一 合志 | 画像処理装置、画像処理方法 |
CN105075232B (zh) * | 2013-02-25 | 2018-03-20 | 株式会社计测技术研究所 | 图像处理装置、图像处理方法 |
JP2016521571A (ja) * | 2013-06-11 | 2016-07-25 | プルーリオミクス・ベー・フェー | 多能性哺乳動物幹細胞に由来する心筋細胞を成熟させるための培地組成物 |
WO2015025521A1 (ja) | 2013-08-20 | 2015-02-26 | 株式会社計測技術研究所 | 画像処理装置、画像処理方法 |
JP5629902B1 (ja) * | 2013-08-20 | 2014-11-26 | 合志 清一 | 画像処理装置、画像処理方法 |
US9848163B2 (en) | 2013-08-20 | 2017-12-19 | Keisoku Giken Co., Ltd. | Image processing apparatus and image processing method |
WO2015029450A1 (ja) * | 2013-08-30 | 2015-03-05 | 株式会社計測技術研究所 | 画像処理装置及び画像処理方法 |
JP2015050585A (ja) * | 2013-08-30 | 2015-03-16 | 合志 清一 | 画像処理装置及び画像処理方法 |
US9734563B2 (en) | 2013-08-30 | 2017-08-15 | Keisoku Giken Co., Ltd. | Image processing apparatus and image processing method |
Also Published As
Publication number | Publication date |
---|---|
US20130176495A1 (en) | 2013-07-11 |
JPWO2012043407A1 (ja) | 2014-02-06 |
EP2624536A1 (en) | 2013-08-07 |
CN103141077A (zh) | 2013-06-05 |
US8773594B2 (en) | 2014-07-08 |
CN103141077B (zh) | 2016-01-20 |
JP5583780B2 (ja) | 2014-09-03 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP5583780B2 (ja) | 信号処理装置および集積回路 | |
JP5281690B2 (ja) | 画像強調装置、画像強調方法、画像強調プログラム、および信号処理装置 | |
JP5450668B2 (ja) | 信号処理装置、制御プログラム、および集積回路 | |
WO2010140281A1 (ja) | 信号処理装置、信号処理装置の制御方法、制御プログラム、および該制御プログラムを記録したコンピュータ読み取り可能な記録媒体 | |
WO2011061958A1 (ja) | 復号化装置、復号化装置の制御方法、伝送システム、および制御プログラムを記録したコンピュータ読み取り可能な記録媒体 | |
JP5291804B2 (ja) | 符号化装置、符号化装置の制御方法、伝送システム、および制御プログラムを記録したコンピュータ読み取り可能な記録媒体 | |
WO2010146728A1 (ja) | 波形整形装置、等化器、受信システム、波形整形装置の制御方法、制御プログラム、および該制御プログラムを記録したコンピュータ読み取り可能な記録媒体 | |
WO2012124591A1 (ja) | 信号処理装置、制御プログラム、および集積回路 | |
JP5403450B1 (ja) | 画像処理装置、画像処理方法 | |
JP5320538B1 (ja) | 画像強調装置、画像強調方法 | |
US9848163B2 (en) | Image processing apparatus and image processing method | |
JP5730362B2 (ja) | 画像処理装置及び画像処理方法 | |
JP5396626B1 (ja) | 画像強調装置、画像強調方法 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
WWE | Wipo information: entry into national phase |
Ref document number: 201180047272.1 Country of ref document: CN |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 11828963 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 2012536410 Country of ref document: JP Kind code of ref document: A |
|
WWE | Wipo information: entry into national phase |
Ref document number: 13823299 Country of ref document: US |
|
REEP | Request for entry into the european phase |
Ref document number: 2011828963 Country of ref document: EP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2011828963 Country of ref document: EP |
|
NENP | Non-entry into the national phase |
Ref country code: DE |