WO2007122966A1 - 視覚処理装置、視覚処理方法、プログラム、表示装置および集積回路 - Google Patents
視覚処理装置、視覚処理方法、プログラム、表示装置および集積回路 Download PDFInfo
- Publication number
- WO2007122966A1 WO2007122966A1 PCT/JP2007/056448 JP2007056448W WO2007122966A1 WO 2007122966 A1 WO2007122966 A1 WO 2007122966A1 JP 2007056448 W JP2007056448 W JP 2007056448W WO 2007122966 A1 WO2007122966 A1 WO 2007122966A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- image
- signal
- visual processing
- effect adjustment
- unit
- Prior art date
Links
- 238000012545 processing Methods 0.000 title claims abstract description 407
- 230000000007 visual effect Effects 0.000 title claims abstract description 315
- 238000003672 processing method Methods 0.000 title claims description 10
- 230000000694 effects Effects 0.000 claims abstract description 365
- 238000001514 detection method Methods 0.000 claims abstract description 121
- 230000008859 change Effects 0.000 claims abstract description 51
- 230000002093 peripheral effect Effects 0.000 claims abstract description 37
- 238000004364 calculation method Methods 0.000 claims description 28
- 230000007274 generation of a signal involved in cell-cell signaling Effects 0.000 claims description 15
- 238000000605 extraction Methods 0.000 claims description 11
- 238000003708 edge detection Methods 0.000 claims description 9
- 238000012935 Averaging Methods 0.000 claims description 6
- 239000000284 extract Substances 0.000 claims description 6
- 239000008186 active pharmaceutical agent Substances 0.000 abstract description 63
- 230000015572 biosynthetic process Effects 0.000 abstract description 3
- 238000003786 synthesis reaction Methods 0.000 abstract description 3
- 238000006243 chemical reaction Methods 0.000 description 42
- 238000010586 diagram Methods 0.000 description 38
- 230000004048 modification Effects 0.000 description 34
- 238000012986 modification Methods 0.000 description 34
- 239000002131 composite material Substances 0.000 description 28
- 238000000034 method Methods 0.000 description 23
- 230000006870 function Effects 0.000 description 20
- 238000003860 storage Methods 0.000 description 17
- 230000008569 process Effects 0.000 description 11
- 241000053227 Themus Species 0.000 description 5
- 238000004891 communication Methods 0.000 description 5
- 238000003384 imaging method Methods 0.000 description 5
- 241000282414 Homo sapiens Species 0.000 description 4
- 238000012937 correction Methods 0.000 description 4
- 238000009826 distribution Methods 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 4
- 239000004065 semiconductor Substances 0.000 description 4
- 230000006835 compression Effects 0.000 description 3
- 238000007906 compression Methods 0.000 description 3
- 230000007423 decrease Effects 0.000 description 3
- 230000003247 decreasing effect Effects 0.000 description 3
- 210000003127 knee Anatomy 0.000 description 3
- 230000009467 reduction Effects 0.000 description 3
- 230000004044 response Effects 0.000 description 3
- 230000000593 degrading effect Effects 0.000 description 2
- 210000003128 head Anatomy 0.000 description 2
- 230000006872 improvement Effects 0.000 description 2
- 230000010354 integration Effects 0.000 description 2
- 101100457838 Caenorhabditis elegans mod-1 gene Proteins 0.000 description 1
- 101150110972 ME1 gene Proteins 0.000 description 1
- 101001115885 Zea mays DNA mismatch repair protein MSH2 Proteins 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000003111 delayed effect Effects 0.000 description 1
- 235000013399 edible fruits Nutrition 0.000 description 1
- 125000001475 halogen functional group Chemical group 0.000 description 1
- 230000010365 information processing Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- NJPPVKZQTLUDBO-UHFFFAOYSA-N novaluron Chemical compound C1=C(Cl)C(OC(F)(F)C(OC(F)(F)F)F)=CC=C1NC(=O)NC(=O)C1=C(F)C=CC=C1F NJPPVKZQTLUDBO-UHFFFAOYSA-N 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 229920001690 polydopamine Polymers 0.000 description 1
- 230000002194 synthesizing effect Effects 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
- H04N1/40—Picture signal circuits
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
- H04N1/40—Picture signal circuits
- H04N1/409—Edge or detail enhancement; Noise or error suppression
- H04N1/4092—Edge or detail enhancement
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/90—Dynamic range modification of images or parts thereof
- G06T5/94—Dynamic range modification of images or parts thereof based on local image properties, e.g. for local contrast enhancement
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/14—Picture signal circuitry for video frequency region
- H04N5/142—Edging; Contouring
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/14—Picture signal circuitry for video frequency region
- H04N5/20—Circuitry for controlling amplitude response
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20004—Adaptive image processing
- G06T2207/20012—Locally adaptive
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20021—Dividing image into blocks, subimages or windows
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20172—Image enhancement details
- G06T2207/20192—Edge enhancement; Edge preservation
Definitions
- Visual processing device visual processing method, program, display device, and integrated circuit
- the present invention relates to a visual processing device, a visual processing method, a program, a display device, and an integrated circuit, and more particularly to a visual processing device, a visual processing method, and a program that adjust so as to vary the effect of visual processing of an image.
- Tone processing is a process of converting pixel values using a look-up table (hereinafter referred to as “LUT”) for each target pixel, regardless of the surrounding pixels of the target pixel, and is called gamma correction.
- LUT look-up table
- pixel values are converted using an LUT that enhances the high gradation level of the appearance frequency in the original image.
- gradation processing using LUT gradation processing that determines and uses one LUT for the entire original image, and gradation processing that determines and uses LUT for each of the image areas into which the original image was divided Is known.
- Spatial processing converts the value of the pixel of interest using the value of the pixel of interest that is the target of filter application and the values of surrounding pixels.
- There is a technique for performing contrast enhancement of an original image using this spatially processed image signal see, for example, Patent Document 1).
- Patent Document 1 US Pat. No. 4,667,304 Specification
- an image with a small percentage of edge area an image with a small number of gradations, an image in which similar values with a small luminance difference from adjacent pixels occur continuously, or a block image divided into multiple
- a special image visual processing is performed on an image with a small proportion of blocks containing high-frequency components
- An object is to provide a visual processing device, a visual processing method, a program, a display device, and an integrated circuit that can be changed.
- a first invention is a visual processing device including a peripheral image information extraction unit, a visual processing unit, a special image detection unit, and an effect adjustment unit.
- the peripheral image information extraction unit extracts peripheral image information of an image signal that can form one image.
- the visual processing unit is based on image signals and surrounding image information! / Outputs a processed signal obtained by visually processing the image signal.
- the special image detection unit detects a statistical information bias in a predetermined area included in one image formed by the image signal, and based on the detected statistical information bias, 1
- a special image degree indicating a degree that each image is a special image is calculated, and an effect adjustment signal is output based on the calculated special image degree.
- the effect adjustment unit controls the visual processing unit so as to set the effect of the visual processing on the image signal forming one image according to the effect adjustment signal.
- the special image detection unit detects the statistical information bias in a predetermined area included in one image formed by the image signal, and detects the detected statistical information bias. Therefore, a special image degree indicating the degree to which one image is a special image is calculated, and is output as an effect adjustment signal based on the calculated special image degree. Then, the effect adjustment unit forms one image according to the effect adjustment signal.
- the visual processing unit is controlled to set the effect of the visual processing on the image signal to be performed. Therefore, it is possible to calculate one special image degree per image, and based on the special image degree, it is possible to perform optimal visual processing for one image!
- one image refers to a two-dimensional image displayed on a display device, and in the case of a still image, refers to a two-dimensional image constituting a display screen displayed on the display device.
- a moving image it means a two-dimensional image displayed on a display device by an image (video) signal for one frame or an image (video) signal for one field.
- an image signal forming one image may include a synchronization signal for display on a display device.
- the “predetermined area included in one image” refers to an image area having a predetermined size included in one image. For example, one image is displayed on the display device.
- the image area that occupies 80% of the central force of the display screen relative to the entire display screen, and the black part that appears around the display screen when a single image is displayed on the display device (
- the aspect ratio of the display device is different from the aspect ratio of the image to be displayed, the black part displayed on the display screen of the display device, such as a display device with a display screen with an aspect ratio of 16: 9.
- the black parts corresponding to pedestal level video signals of NTSC and other television signals;
- the “predetermined area included in one image” includes the entire area of the display screen (all image areas of one image) when one image is displayed on the display device. Needless to say.
- visual processing is processing that performs tone correction on a pixel of interest (region) using tone characteristics that change according to the brightness around the pixel of interest (region).
- tone value of the target pixel in the input signal is a small tone value (for example, an 8-bit tone value of “50”) and the surrounding brightness of the target pixel is dark (For example, 8-bit gradation value “20”)
- the gradation value of the target pixel is set to a large gradation value (for example, The tone correction is performed so that the 8-bit tone value is “150”).
- the tone value of the target pixel in the input signal is small!
- the tone value for example, “50” for an 8-bit tone value
- the brightness around the pixel of interest Is bright for example, “10 0” for an 8-bit gradation value
- the gradation value of the target pixel becomes a small gradation value (for example, “30” for an 8-bit gradation value).
- Gradation correction is performed as described above. Such processing is an example of spatial visual processing.
- the second invention is the first invention, in which the special image detection unit changes a ratio or density of a region where the density changes in a predetermined area included in one image formed by the image signal.
- the statistical information bias is detected based on the ratio of non-performing areas.
- the third invention is the second invention, wherein the special image detection unit increases the degree of the special image as the ratio of the area where the shading changes is small or as the ratio of the area where the shading does not change is large.
- the degree of special image can be accurately detected, and an effect adjustment signal suitable for special image processing can be output.
- the fourth invention is the second invention, wherein the special image detecting unit has a signal level of the effect adjustment signal when the density change area ratio, which is a ratio of the area where the density changes, is smaller than the first value! Is a value smaller than the first effect adjustment signal level threshold value, and the density change area ratio is greater than or equal to the first value and less than the second value (> first value), the intensity change area ratio is large. The higher the value, the greater the signal level of the effect adjustment signal. Then, the special image detecting unit, when the density change area ratio is equal to or greater than the second value, sets the density change area ratio for the second effect adjustment signal level that is larger than the first effect adjustment signal level threshold. The value is larger than the threshold value.
- the effect adjustment signal takes a value from “0” to “1” and the effect adjustment signal is “1”, the effect of the visual processing by the effect adjustment unit is maximized, and the effect adjustment signal is “0”. If the effect of the visual processing by the effect adjustment unit is minimal (including the case where there is no effect), the effect adjustment signal level is set to “0” when the density change area ratio is smaller than the first value. Hard If the density change area ratio is greater than or equal to the first value and smaller than the second value (> first value), the effect adjustment signal level increases monotonously with respect to the density change area ratio. (Set a value between “0” and “1”) and fix the effect adjustment signal level at “1” when the density change area ratio is greater than or equal to the second value.
- one image formed by the image signal is a special image
- the effect of visual processing can be minimized or not effective.
- one image formed by the image signal is a natural image
- the effect of visual processing can be maximized.
- one image formed by the image signal is an intermediate image between the special image and the natural image, the effect of visual processing can be appropriately applied.
- the fifth invention is the third or fourth invention, wherein the special image detection unit detects the ratio of the region where the shading changes by detecting the edge component in the image.
- the sixth invention is the third or fourth invention, wherein the special image detection unit detects a ratio of a region where the density does not change by detecting a flatness in the image.
- the special image detection unit determines the flatness based on the number of gradation levels or the continuous length of similar pixels! , Is detected.
- the eighth invention is the fifth invention, wherein the special image detecting unit is an edge pixel which is the number of pixels constituting an edge in a predetermined region included in one image formed by an image signal. Detect statistical information bias based on numbers. According to this, for example, it is possible to detect statistical information bias by simply counting the number of edge pixels in a predetermined area included in one image, so that the amount of calculation is reduced. And the processing speed of the visual processing device can be improved. For example,
- a ninth invention is the fifth invention, wherein the special image detection unit detects an edge pixel in a predetermined region included in one image formed by the image signal, and an edge An edge pixel number calculation unit that calculates the number of pixels, and a first effect adjustment signal generation unit that outputs an effect adjustment signal according to the number of edge pixels calculated by the edge pixel number calculation unit.
- the number of edge pixels detected by the edge detection unit can be calculated by the edge pixel number calculation unit.
- the first effect adjustment signal generation unit can output an effect adjustment signal corresponding to the number of edge pixels calculated by the edge pixel number calculation unit.
- the amount of calculation can be reduced and the processing speed of the visual processing device can be improved.
- the edge pixel number NN calculated by the edge pixel number calculation unit is compared with a predetermined threshold value Tth, and when the threshold value Tth is exceeded, the edge pixel number NN is set.
- the bias of statistical information may be detected by outputting an effect adjustment signal based on a continuous function f (NN) as a variable.
- the tenth invention is the fifth invention, wherein the special image detection unit is a ratio of the number of edge pixels to the number of pixels constituting a predetermined area included in one image formed by an image signal. Statistical information bias is detected based on the edge pixel ratio.
- a special image can also be detected for edge force in the image, and an effect adjustment signal corresponding to the edge pixel ratio in the special image can be generated. Note that here, "Number of edge pixels
- the eleventh invention is the fifth invention, wherein the special image detecting unit An edge detection unit that detects an edge amount and an edge density calculation unit that detects an edge pixel whose edge amount is equal to or greater than a predetermined value and calculates an edge pixel ratio that is a ratio of the number of edge pixels to the total number of pixels of an image signal. And output an effect adjustment signal according to the edge pixel ratio.
- a special image can also be detected with respect to edge force in the image, and an effect adjustment signal corresponding to the deviation of the ratio of edge pixels in the special image can be generated.
- the twelfth invention is the tenth or eleventh invention, wherein the special image detection unit outputs the output value of the effect adjustment signal as a value equal to or greater than the first threshold when the edge pixel ratio is equal to or greater than 20%.
- the output value of the effect adjustment signal is set to the first value.
- the effect adjustment signal can be adjusted to achieve a visual effect for natural images, and appropriate visual processing can be realized.
- a natural image is an image created artificially or artificially (an image such as a test pattern image in which the gradation values that can be formed by the pixels forming the image are biased (the number of gradations is small))
- a pixel that forms an image such as a landscape image (such as an image of a landscape photographed with a camera) can have a large number of gradations (number of gradation values) (a wide gradation value distribution). That means.
- the edge pixel ratio is 20% or more, it is desirable that the first threshold value is set to a certain degree higher than the effect adjustment signal in order to realize a visual effect for natural images.
- the effect adjustment signal takes a value from “0” to “1” and the effect adjustment signal is “1”, the effect of the visual processing by the effect adjustment unit is maximized, and the effect adjustment signal is “0”.
- the first threshold value may be set to “0.8”, for example.
- a thirteenth aspect of the present invention is the third or fourth aspect of the present invention, wherein the special image detection unit includes a high-frequency component that exists in a predetermined region included in one image formed by the image signal.
- Statistical bias is detected based on the number of high-frequency blocks. Accordingly, it is possible to generate an effect adjustment signal based on the number of high-frequency blocks in the image.
- the number of blocks KK in a predetermined area included in one image is compared with a predetermined threshold value Kth. If the threshold value Kth is exceeded, the number of blocks KK is a continuous variable.
- Statistical bias may be detected by the function ff (KK).
- the “block” is composed of a plurality of pixels.
- a fourteenth aspect of the invention is the third or fourth aspect of the invention, in which the special image detecting unit includes a high-frequency component that exists in a predetermined area included in one image formed by the image signal.
- the high-frequency block detection unit that detects high-frequency blocks, a high-frequency block number calculation unit that calculates the number of high-frequency blocks existing in a predetermined area, and an effect according to the number of high-frequency blocks calculated by the high-frequency block calculation unit And a third effect adjustment signal generator for outputting an adjustment signal.
- the high-frequency block detected by the high-frequency block detector can be detected, and an effect adjustment signal corresponding to the number of high-frequency blocks calculated by the high-frequency block number calculator can be output.
- the amount of calculation can be reduced, and the processing speed of the visual processing device can be improved.
- the high frequency block number KK calculated by the high frequency block number calculation unit is compared with a predetermined threshold value Kth, and if the threshold value Kth is exceeded, the high frequency block number KK It may be possible to detect a bias of statistical information by outputting an effect adjustment signal based on a continuous function ff (KK) that uses as a variable.
- the fifteenth aspect of the present invention is the third or fourth aspect of the present invention, wherein the special image detection unit is provided for the total number of blocks existing in a predetermined area included in one image formed by the image signal. Statistical bias is detected based on the high-frequency block ratio, which is the ratio of the number of high-frequency blocks.
- a special image can be detected by detecting a high-frequency block in the image, and an effect adjustment signal can be generated according to the deviation of the ratio of the high-frequency block in the special image.
- the sixteenth invention is the third or fourth invention, wherein the special image detection unit detects a high frequency block including a high frequency component from an image signal divided into a plurality of blocks; A high-frequency block density detection unit that detects a ratio of the number of high-frequency blocks to a plurality of blocks, and a fourth effect adjustment signal generation unit that outputs an effect adjustment signal according to the ratio.
- a special image can be detected by detecting a high-frequency block in the image, and an effect adjustment signal can be generated according to the deviation of the ratio of the high-frequency block in the special image.
- a seventeenth aspect of the invention is the seventh aspect of the invention, wherein the special image detection unit detects a frequency for each gradation level from the image signal, a frequency for each gradation level, a predetermined threshold value, A frequency determination unit that detects a gradation level having a frequency greater than a predetermined threshold, a gradation number detection unit that detects the number of gradation levels determined to be high by the frequency determination unit, and a gradation And a fifth effect adjustment signal generator that outputs an effect adjustment signal according to the number of levels.
- the special image can also be detected from the number of gradation levels in the image, and the gradation level in the special image can be detected. It is possible to generate an effect adjustment signal corresponding to the number deviation.
- An eighteenth aspect of the invention is the seventh aspect of the invention, wherein the special image detecting unit includes a similar luminance detecting unit that detects a similar pixel in which a luminance difference between adjacent pixels is equal to or less than a predetermined value from the image signal, and a similar pixel detecting unit.
- a continuous length detection unit that detects continuous lengths that are continuous
- an average continuous length calculation unit that calculates an average continuous length by averaging a plurality of continuous lengths detected by the continuous length detection unit, and an average continuous length
- a sixth effect adjustment signal generator for outputting an effect adjustment signal in response. Accordingly, a special image can be detected from the average continuous length of similar pixels in the image, and an effect adjustment signal corresponding to the bias of the average continuous length in the special image can be generated.
- the nineteenth invention is the first invention according to any one of the first to eighteenth inventions, wherein the effect adjustment unit combines the image signal and the peripheral image information by changing the ratio according to the effect adjustment signal.
- the visual processing unit outputs a signal and performs visual processing on the image signal based on the first composite signal and the image signal.
- the visual processing unit can select different gradation conversion processing based on the first composite signal, and the effect of visual processing can be made different.
- the twentieth invention is the invention according to any one of the first to eighteenth inventions, wherein the effect adjustment unit changes the ratio between the image signal and the processing signal in accordance with the effect adjustment signal and combines the second synthesized signal. Is output.
- the ratio between the image signal and the processing signal is further changed according to the effect adjustment signal.
- Output, and the effect of visual processing can be made different.
- a twenty-first invention is any one of the first to eighteenth inventions, wherein the visual processing unit has a two-dimensional lookup table, and the visual processing is performed based on characteristic data set in the two-dimensional lookup table.
- the effect adjusting unit sets the characteristic data synthesized by changing the ratio of the plurality of characteristic data having different visual processing effects according to the effect adjustment signal in the visual processing unit.
- a twenty-second invention is the invention according to any one of the first to twenty-first inventions, wherein the special image detection unit inputs a reduced image obtained by reducing the image signal, and biases statistical information from the reduced image.
- the special adjustment image is detected and the effect adjustment signal is output based on the statistical information bias. This further suppresses the influence of noise when detecting the special image.
- the amount of processing can be reduced.
- the twenty-third invention is the invention according to any one of the first to twenty-second inventions, in which the special image detection unit detects whether the image signal is a frame image from one or more previous frame images, or the image signal is a field image. Sometimes one or more previous field image forces detect statistical information bias.
- a twenty-fourth invention is the twenty-third invention, further comprising a continuous change processing unit for continuously changing the effect adjustment signal, wherein the continuous change processing unit is configured to output the effect adjustment signal in units of frames. Is the effect adjustment signal power between frames, and when output in S-field units, the effect adjustment signal is continuously changed between fields.
- a twenty-fifth aspect of the invention is a data receiving unit that receives image data that has been communicated or broadcast, a decoding unit that decodes the received image data into video data, and an output signal that is obtained by performing visual processing on the decoded video data.
- a display device comprising: a visual processing device according to any one of the first to twenty-fourth inventions that outputs a signal; and a display unit that displays an output signal visually processed by the visual processing device.
- the intensity of visual processing can be changed in real time by image brightness adjustment and displayed on a display device.
- a photographing device or a portable information device including a visual processing device can be realized.
- the imaging device may be configured to include an imaging unit that captures an image and a visual processing device that performs visual processing using an image captured by the imaging unit as an input signal.
- the portable information device also includes a data receiving unit that receives image data that has been communicated or broadcast, a visual processing device that visually processes the received image data and outputs an output signal, and a display of the visually processed output signal. It may be configured to include display means for performing. With such a configuration, it is possible to obtain the same effect as the visual processing device even in the portable information device.
- the portable information device includes an imaging unit that captures an image, a visual processing device that performs visual processing using the image captured by the imaging unit as an input signal and outputs an output signal, and an output signal that has undergone visual processing.
- the structure provided with the data transmission part to transmit may be sufficient.
- a twenty-sixth aspect of the present invention is a visual processing method including a peripheral image information extraction step, a visual processing step, a special image detection step, and an effect adjustment step.
- peripheral image information extraction step peripheral image information of an image signal that can form one image is extracted.
- the visual processing step the image signal is viewed based on the image signal and the peripheral image information.
- special image detection step statistical information bias in a predetermined area included in one image formed by the image signal is detected, and based on the detected statistical information bias! Then, a special image degree indicating the degree to which one image is a special image is calculated, and an effect adjustment signal is output based on the calculated special image degree.
- the effect adjustment step the effect of visual processing on the image signal that forms one image is set according to the effect adjustment signal.
- a twenty-seventh aspect of the invention is a program that causes a computer to execute a peripheral image information extraction step, a visual processing step, a special image detection step, and an effect adjustment step.
- peripheral image information extraction step peripheral image information of an image signal that can form one image is extracted.
- the visual processing step the image signal is visually processed based on the image signal and the peripheral image information.
- special image detection step statistical information bias in a predetermined area included in one image formed by the image signal is detected, and based on the detected statistical information bias! /, The degree to which one image is a special image! The special image degree indicating, is calculated, and an effect adjustment signal is output based on the calculated special image degree.
- the effect adjustment step the effect of the visual processing on the image signal forming one image is set according to the effect adjustment signal.
- This program can maintain the visual processing effect when a normal image that is not a special image is input, and achieve an appropriate visual processing effect with reduced side effects even when a special image is input can do.
- a twenty-eighth aspect of the invention is an integrated circuit including a peripheral image information extraction unit, a visual processing unit, a special image detection unit, and an effect adjustment unit.
- the peripheral image information extraction unit extracts peripheral image information of an image signal that can form one image.
- the visual processing unit A processing signal obtained by visually processing the image signal based on the side image information is output.
- the special image detection unit detects a statistical information bias in a predetermined area included in one image formed by the image signal, and based on the detected statistical information bias, A special image degree indicating a degree that the image is a special image is calculated, and the calculated special image degree is output as an effect adjustment signal.
- the effect adjustment unit controls the visual processing unit to set the effect of the visual processing on the image signal forming one image according to the effect adjustment signal.
- visual processing effects can be maintained when normal images that are not special images are input, and appropriate visual processing effects with reduced side effects can be achieved even when special images are input. be able to.
- a visual processing device that can suppress side effects and can change the intensity of visual processing of the image with a simple configuration, A visual processing method, a program, a display device, and an integrated circuit can be provided.
- FIG. 1 is a block diagram showing a configuration of a visual processing device according to a first embodiment of the present invention.
- FIG. 3 is an explanatory diagram for explaining the output of the processed signal.
- FIG. 6 is an explanatory diagram for explaining the edge pixel.
- FIG. 8 is a flowchart for explaining the operation of the visual processing device and a configuration diagram of a continuous change processing unit.
- FIG. 9 is a block diagram showing the configuration of the special image detection unit of the first modification.
- FIG. 10 is an explanatory diagram for explaining the frequency distribution detected by the frequency detector of the first modification.
- FIG. 11 is an explanatory diagram for explaining the effect adjustment signal of Modification 1
- FIG. 12 is a block diagram showing a configuration of a special image detection unit according to the second modification.
- FIG. 13 is an explanatory diagram for explaining the continuous length of Modification 2
- FIG. 14 is an explanatory diagram for explaining an effect adjustment signal of Modification 2
- FIG. 15 is a block diagram showing the configuration of a special image detection unit of the third modification.
- FIG. 16 is an explanatory diagram for explaining a block image of Modification 3
- FIG. 17 is an explanatory diagram for explaining an effect adjustment signal of Modification 3
- FIG. 18 is a block diagram showing a configuration of a visual processing device according to the second embodiment of the present invention.
- FIG. 19 is a block diagram showing a configuration of a visual processing device according to a third embodiment of the present invention.
- FIG. 20 is a block diagram showing the configuration of a visual processing system in a fourth embodiment of the present invention.
- FIG. 21 is an explanatory diagram for explaining the two-dimensional gain characteristics.
- FIG. 22 is a block diagram showing the configuration of a computer according to the embodiment of the present invention.
- FIG. 23 is an example of an image display screen for explaining the operation of the visual processing device according to another embodiment.
- FIG. 24 is an example of a split display screen for an image for explaining the operation of the visual processing device in another embodiment.
- a natural image can be obtained by performing visual processing on a natural image having a large number of gradations to obtain a clear image in which the local contrast ratio is emphasized.
- the special image has an extremely small proportion of the area where the shading changes in the image of the image signal, or an extremely large proportion of the area where the shading in the image of the image signal does not change. Information bias.
- This side effect (this side effect is sometimes referred to as “Halo”) is very small when the image is displayed on the display device! , Easy to see in the area (looks unnatural to the human eye).
- the visual processing device detects a special image having a statistical information bias from the image signal, generates an effect adjustment signal based on the degree of the statistical information bias, and generates the effect adjustment signal.
- the visual processing effect is adjusted (changed) in accordance with the effect adjustment signal.
- visual processing is processing that has characteristics that are close to how human eyes can see, depending on the comparison between the value of the target pixel of the input image signal and the value of the surrounding pixels (brightness). This process determines the value of the output signal.
- Visual processing is applied to backlight compensation, knee processing, dynamic range (hereinafter referred to as “DR”) compression processing, color processing, or brightness adjustment (including gradation processing and contrast adjustment).
- DR dynamic range
- YCbCr color space YUV color space, Lab color space, Luv color
- the luminance component Y or lightness component L of the space, YIQ color space, and YPbPr color space is defined as the luminance signal.
- the luminance signal will be described as an image signal.
- FIG. 1 is a block diagram showing the configuration of the visual processing device 1 according to the first embodiment of the present invention.
- the visual processing device 1 includes a spatial processing unit 10 that extracts peripheral image information (unsharp signal) US from an input image signal IS, and a statistical processing from the image signal IS.
- Special image detection unit 40 that detects special images with information bias and outputs special image effect adjustment signal DS for differentiating the effect of visual processing based on the degree of statistical information bias, and special image
- the effect adjustment signal DS which is obtained by continuously changing the effect adjustment signal DS between frames, and the ratio of the image signal IS and the peripheral image information US are changed according to the effect adjustment signal MOD.
- An effect adjustment unit 20 that outputs the synthesized signal MUS synthesized in this way, and a visual processing unit 30 that outputs a processing output OS obtained by visually processing the image signal in accordance with the synthesized signal MUS from the effect adjustment unit 20.
- the special image detection unit 40 can output the special image effect adjustment signal DS corresponding to the degree of information bias of the special image.
- the effect adjustment unit 20 can generate a composite signal MUS for differentiating the effect of visual processing in the visual processing unit 30 by an effect adjustment signal MOD obtained by continuously changing the special image effect adjustment signal DS.
- the visual processing unit 30 can gradation-convert the image signal IS in accordance with the composite signal MUS output from the effect adjustment unit 20.
- the visual processing device 1 can detect the special image, and the visual processing unit 30 can change the effect of the visual processing on the special image and suppress side effects. .
- the spatial processing unit 10 extracts the value of the target pixel and the value of the pixel in the peripheral area of the target pixel (hereinafter referred to as “peripheral pixel”) from the image signal IS, and uses the extracted pixel value to generate an image. Filters the signal IS.
- the unsharp signal US is generated by processing the image signal IS with a low-pass filter.
- the unsharp signal us is generated by the following calculation.
- [W] is the weighting factor of the pixel located in the i-th row and j-th column in the target pixel and the surrounding pixels
- [A] is located in the i-th row and j-th column in the target pixel and the surrounding pixels.
- “ ⁇ ” means that the sum of the target pixel and the surrounding pixels is calculated.
- the area size of the peripheral pixels is a size that is preliminarily set according to the effect. If the area size is larger than a predetermined size, the visual effect can be enhanced. For example, if the size of the target image is 1024 pixels in length and 768 pixels in width, the area power of 80 pixels or more in width and width each generates an unsharp signal US, which is about 3 pixels in length and width respectively. The visual effect can be enhanced as compared with the local region.
- the low-pass filter use a FIR (Finite Impulse Response) type spatial filter or IIR (Infinite Impulse Response) type spatial filter.
- the effect adjustment unit 20 combines the image signal IS and the unsharp signal US by interpolation processing according to the effect adjustment signal MOD output from the continuous change processing unit 50, and outputs a combined signal MUS.
- the composite signal MUS is divided internally as in (Equation 1) below, for example, according to the effect adjustment signal MOD.
- the continuous change processing unit 50 will be described later.
- the value of the effect adjustment signal MOD changes in the range from “0.0” to “1.0”, the effect adjustment signal MOD is “0.0”, and there is no visual processing effect.
- the effect adjustment signal MOD When “1. 0” is selected, the effect of visual processing is maximized. Note that (Equation 1) can be transformed as (Equation 2), and similarly, a composite signal MUS can be generated.
- the visual processing unit 30 displays the image according to the composite signal MUS from the effect adjustment unit 20. Tone-convert the image signal IS.
- the visual processing unit 30 performs tone conversion based on the two-dimensional tone conversion characteristics shown in FIG. 2, for example.
- the two-dimensional gradation conversion means gradation conversion in which an output value is determined for two inputs of the composite signal MUS and the image signal IS.
- the visual processing unit 30 outputs a processing signal OS for the image signal IS and the composite signal MUS based on the two-dimensional gradation conversion characteristics.
- Various visual effects can be produced by the gradation conversion characteristics.
- FIG. 2 is an explanatory diagram for explaining the two-dimensional gradation conversion characteristics.
- the horizontal axis is the input image signal IS
- the vertical axis is the output of the converted processing signal OS.
- the two-dimensional gradation conversion has predetermined gradation conversion characteristics according to the signal levels (gradation values) of the combined signals MUS0 to MUSn. That is, in the two-dimensional gradation conversion, one of the gradation conversion curves MUS0 to MUSn is selected according to the signal level (gradation value) of the composite signal MUS, and the selected gradation conversion curve is selected.
- the input signal IS IS gradation value
- OS OS gradation value
- the gradation Conversion curve MUSI 20 is selected, and when the MUS signal level (gradation value) is “120”, the gradation Conversion curve MUSI 20 is selected.
- the gradation conversion curves MUS0 to MUSn are set to the number of gradation values of the MUS signal.
- Prepare a gradation conversion curve corresponding to the gradation value of the MUS signal by using the provided gradation conversion curve power interpolation method for the gradation conversion curves that are less than the corresponding number. By calculating, two-dimensional gradation conversion may be realized.
- the pixel value of the image signal IS is an 8-bit value
- the pixel value of the output signal OS corresponding to the value of the image signal IS divided into 6-6 levels is a predetermined 2D gradation conversion characteristic. Determined by.
- the gradation conversion characteristic is a gradation conversion curve having a predetermined gamma conversion characteristic, and the output monotonously decreases with respect to the subscript of the composite signal MUS. Note that even if there is a part of the subscript of the composite signal MUS where the output is not partly monotonically decreasing, it may be substantially monotonically decreasing.
- the visual processing unit 30 selects MUSO when the input image signal IS has a value “a” and the gradation value of the surrounding area is small.
- the value of the processing output OS becomes “P”, and conversely, the processing output OS value becomes “Q” by selecting MUSn when the gradation value of the surrounding area is large.
- the processing output OS can be largely changed from the value “P” to the value “Q” by changing the gradation value of the surrounding area. . Thereby, the contrast of the dark part can be enhanced according to the composite signal MUS.
- the gradation conversion characteristic of curve 2 shown in FIG. 2 can be provided.
- the tone conversion characteristics of curve 2 can adjust the brightness of the entire image (gamma conversion), but there are no visual effects such as increasing local contrast.
- FIG. 3 is an explanatory diagram for explaining the output of the processing signal OS.
- the horizontal axis is the pixel position to be processed, and the vertical axis is the output of the composite signal MUS.
- the composite signal MUS is an image. Output is intermediate between signal IS and unsharp signal US.
- the processing signal OS visually processed based only on the image signal IS is OS (IS, IS), and the visual processing is performed based on the image signal IS and the unsharp signal US.
- OS OS
- IS, MUS which is the processing signal OS visually processed according to the image signal IS and the composite signal MUS
- OS IS, IS
- OS IS, US
- the visual processing unit 30 can increase or decrease the local contrast enhancement effect according to the composite signal MUS.
- there are various effects ranging from the effect of processing that only changes the brightness of the entire image to the effect of processing that changes (changes) the contrast in the local area according to the ambient brightness.
- Visual processing can be realized in the visual processing device 1.
- knee processing, DR compression processing, color processing, and the like can be realized by changing the two-dimensional gradation conversion characteristics.
- the visual processing unit 30 may have a two-dimensional lookup table (hereinafter referred to as “two-dimensional LUT”).
- the two-dimensional LUT of the visual processing unit 30 performs gradation conversion by setting characteristic data (hereinafter referred to as “profile”) shown in FIG.
- the visual processing unit 30 may perform visual processing using an arithmetic circuit.
- the 2D LUT table can be eliminated, and the circuit scale of the visual processing device 1 can be reduced. Can be reduced.
- Fig. 4 (a) is a block diagram showing the configuration of the special image detector 40
- Fig. 5 is an explanatory diagram for explaining the special image
- Fig. 6 is an explanatory diagram for explaining the edge pixels
- Fig. 7 is for the special image. It is explanatory drawing for demonstrating the output of the effect adjustment signal DS.
- the special image detection unit 40 determines an edge pixel that detects an edge amount for each pixel from the image signal IS, and an edge pixel whose edge amount is equal to or greater than a predetermined value.
- the edge amount determination unit 42 calculates the ratio of the number of edge pixels to the total number of pixels in the image signal IS.
- an effect adjustment signal generating unit 44 for outputting a special image effect adjustment signal DS in accordance with the ratio calculated by the edge density calculation unit 43.
- the determination is made using the statistical bias of the number of pixels (edge pixels) that can be regarded as edges without considering the strength of the edges. That is, the more edge pixels (the larger the ratio of edge pixels to all pixels), the more natural the image is judged, and the smaller the edge pixels, the more likely the special image.
- the special image detection unit 40 detects a statistical information bias from the frame image one frame or more before when the image signal is a frame image, or when the image signal is an S field image, the special image detection unit 40 is one field or more before.
- Field image power Detects statistical information bias.
- the visual processing device 1 can use the special image effect adjustment signal DS corresponding to the bias of the special image information from the head of the frame or field.
- the special image detection unit 40 processes the special image 200 shown in FIG. 5
- the special image 200 includes a background area 201, a pattern group 202, a pattern group 203, and a pattern group 204.
- the gray value is constant or the fluctuation is small.
- Each group is assumed to have almost the same force intensity value with different shapes.
- the edge detection unit 41 detects an edge amount for each pixel from the image signal IS.
- the edge detection unit 41 uses an edge detection filter (not shown) such as a first-order differential filter such as a Sobel filter or a Prewitt filter, or a second-order differential filter such as a Laplacian filter. To detect.
- an edge detection filter such as a first-order differential filter such as a Sobel filter or a Prewitt filter, or a second-order differential filter such as a Laplacian filter.
- the edge amount determination unit 42 compares the threshold value and the edge amount that are preliminarily set for each pixel, and determines an edge pixel when the edge amount is equal to or greater than a predetermined threshold value.
- an output 300 as shown in FIG. 6 is obtained.
- the edge pixels are the edge pixel 301, the edge pixel 302, and the edge pixel 303, which are generated in the contour area of the graphic pattern of the special image 200.
- the edge density calculation unit 43 calculates the edge density, which is the ratio of the number of edge pixels to the total number of pixels of the image signal IS, as follows.
- Edge density number of edge pixels ⁇ total number of pixels
- the edge density is the ratio of the number of edge pixels to all the pixels in the frame. If the image signal IS is a field image, the ratio is the ratio of the number of edge pixels to all pixels in the field.
- the effect adjustment signal generator 44 adjusts the output according to the edge density. That is, the effect adjustment signal generator 44 outputs the signal level (value) of the special image effect adjustment signal DS as the edge density increases. For example, as shown in FIG. 7, the signal level of the special image effect adjustment signal DS is increased in a range where the edge density is a predetermined value Tha or more and a predetermined value Thb. By providing the threshold value in this way, it is possible to generate the special image effect adjustment signal DS in which the visual effect is completely eliminated when the threshold value is less than the threshold value “Tha” including the special image.
- the special image effect adjustment signal DS can be generated for processing without reducing the visual effect.
- the horizontal axis represents the edge density
- the vertical axis represents the output of the special image effect adjustment signal DS.
- the output range of the signal level of the special image effect adjustment signal DS to be output is “0.0” to “1.0”.
- the intensity of visual processing “0.2” to “1” It may be adjusted to “0”.
- the visual processing device 1 is configured so that the effect of the visual processing becomes stronger as the signal level of the special image effect adjustment signal DS increases.
- the continuous change processing unit 50 When the special image effect adjustment signal DS is output in units of frames, the continuous change processing unit 50 outputs the special image effect adjustment signal DS in units of fields. When applied, the effect adjustment signal MOD is continuously changed between fields.
- the continuous change processing unit 50 includes a storage unit (not shown) such as a register for temporarily storing the special image effect adjustment signal DS, and the special image effect output from the special image detection unit 40 in a new frame.
- An effect adjustment signal MOD is generated by internally dividing the adjustment signal DS and the special image effect adjustment signal DS temporarily stored, and the generated effect adjustment signal MOD is stored in the storage unit.
- the storage unit stores the first detected special image effect adjustment signal DS as an initial value.
- the continuous change processing unit 50 outputs the effect adjustment signal MOD generated by the internal division calculation. This prevents the effect adjustment signal MOD from changing abruptly between frames.
- the continuous change processing unit 50 can be realized by an IIR filter or the like.
- FIG. 8A is a flowchart for explaining the operation of the visual processing device 1.
- FIG. 8B is a diagram illustrating an example of the configuration of the continuous change processing unit 50.
- the frame image power of one or more frames before is also used to detect statistical information bias.
- the image signal IS is a field image
- a plurality of field images are input to the visual processing device 1 in order to detect a bias in the field image statistical information one or more fields before (S101).
- the special image detection unit 40 detects a special image from the image signal IS which is a frame image or a field image to be detected. Then, the special image effect adjustment signal DS corresponding to the statistical bias of the detected special image is output (S102).
- the frame image (field image) that is one frame (field) or more before is input to the visual processing device 1 at present. This is to immediately start processing for the frame image (field image).
- the visual processing device 1 performs visual processing on the image signal IS without delaying the image signal IS until the special image effect adjustment signal DS corresponding to the statistical information bias is output. is there.
- To detect statistical deviations in statistical information from frame images (field images) before (however, close to the current frame (current field) and up to the number of frames (field number) before). There is no problem.
- a special image effect adjustment signal DS corresponding thereto may be output.
- the image signal IS constituting the current frame image (current field image) is delayed until the special image effect adjustment signal DS is output (for example, using a frame (field) memory or the like).
- the special image effect adjustment signal DS is used to perform visual processing on the image signal IS constituting the current frame image (current field image). You should do it!
- the visual processing device 1 performs an interpolation process so that the effect adjustment signal MOD continuously changes between frames.
- the visual processing device 1 reads the effect adjustment signal MOD 1 one frame before temporarily stored in the storage unit 5001 such as a register for temporary storage by the continuous change processing unit 50 (S103), and the special image detected in step S102.
- Effect adjustment signal DS and effect adjustment signal MODI read in step S103 are interpolated by internal division etc., and effect adjustment signal MOD generated by the interpolation process is output from continuous change processing unit 50 ( S104).
- S104 continuous change processing unit 50
- the visual processing device 1 When there is little need to suppress flickering of images caused by differences in visual effects, the visual processing device 1 has a configuration in which the continuous change processing unit 50 is omitted in order to simplify the configuration, and the effect adjustment signal Use the special image effect adjustment signal DS instead of MOD. Next, the visual processing device 1 temporarily stores the effect adjustment signal MOD generated by interpolating the special image effect adjustment signal DS and the effect adjustment signal MODI in the storage unit 5001 (S105). When this interpolation processing is based on internal division calculation, the ratio of the internal division is given in advance.
- the effect adjustment unit 20 generates a composite signal MUS that combines the image signal IS and the unsharp signal US from the spatial processing unit 10 in accordance with the effect adjustment signal MOD (S106). ).
- the visual processing device 1 receives the secondary signal shown in FIG. One of the curves of the original gradation conversion characteristic is selected, and the image signal IS is converted (S107).
- the visual processing device 1 determines whether or not there is a frame image to be processed next (S108). If there is no frame image that needs to be processed next, the visual processing is completed. On the other hand, if there is a frame image that needs to be processed next, the process returns to step S101 to input the next frame image. Thereafter, the steps from S 101 to S 108 are repeatedly executed until there are no more frames to be processed.
- the interpolation processing target is not limited to between frames but may be between fields. .
- a special image detection unit 40 ′ shown in FIG. 4 (b) may be used instead of the special image detection unit 40 shown in FIG. 4 (a).
- the special image detection unit 40 ′ is detected from the image signal IS by the edge detection unit 41 ′ that detects edge pixels included in the image area of one image formed by the image signal IS, and the edge detection unit 41 ′.
- An edge pixel number calculation unit 45 that calculates the number of edge pixels as the number of edge pixels, and an effect adjustment signal generation unit 44 ′ that outputs an effect adjustment signal according to the number of edge pixels.
- the function ffn (NN) (function f fn (NN)) with the number of edge pixels NN calculated by the edge pixel number calculation unit 45 as a variable is used.
- the special image effect adjustment signal DS is output. Using this special image effect adjustment signal DS, visual processing by the visual processing device 1 can be realized.
- the visual processing device 1 of the first embodiment of the present invention even when a special image is input, an edge in the image is detected and based on the detected edge amount. Since the effect of visual processing is adjusted, it is possible to enhance the visual effect of natural images and suppress side effects of special images.
- the method of detecting the statistical bias is not limited to the method of the special image detection unit 40 described above.
- the special image has an extremely small percentage of the area where the shading changes in the image of the image signal IS, or the area where the shading does not change in the image of the image signal IS.
- the ratio is extremely large !, and there is a bias in statistical information.
- the statistical information bias is detected from the ratio of regions in which the shading does not change in the image of the image signal IS.
- the region where the density does not change can be detected based on the flatness of the image.
- a method for detecting the degree of flatness a method for detecting a deviation in the number of gradations from the image signal IS is employed. In an image in which the number of gradation levels (number of gradations) that can be taken by each pixel constituting the image is extremely small (an image in which the distribution of the number of gradation levels taken by each pixel is extremely narrow), the area where the density is constant is wide. Therefore, the degree of flatness in the image increases. The degree of special images can be obtained from this information bias.
- FIG. 9 is a block diagram showing the configuration of the special image detection unit 70 of Modification Example 1.
- FIG. 10 is an explanatory diagram for explaining the frequency distribution detected by the frequency detection unit 71 of Modification Example 1.
- FIG. 6 is an explanatory diagram for explaining a special image effect adjustment signal DS output from the special image detection unit 70 of Example 1.
- FIG. 10 is an explanatory diagram for explaining the frequency distribution detected by the frequency detection unit 71 of Modification Example 1.
- FIG. 6 is an explanatory diagram for explaining a special image effect adjustment signal DS output from the special image detection unit 70 of Example 1.
- the special image detection unit 70 compares the frequency for each gradation level with a predetermined threshold, and the frequency detection unit 71 for detecting the frequency for each gradation level from the image signal.
- a frequency determination unit 72 that determines a gradation level having a higher frequency
- a gradation number detection unit 73 that detects the number of gradation levels determined to be higher by the frequency determination unit 72
- a gradation number detection unit 73 And an effect adjustment signal generator 74 that outputs an effect adjustment signal in accordance with the number of gradation levels detected in.
- the frequency detection unit 71 detects the frequency for each gradation level from the image signal by the histogram method. For example, if the image signal is 256 gradations, the appearance frequency of each gradation level from “0” to “255” is detected.
- the frequency determination unit 72 compares the frequency for each gradation level with a predetermined threshold value, and detects a gradation level with a frequency higher than the predetermined threshold value. As shown in FIG. 10, the frequency determining unit 72 determines that the frequency 401 is greater than a predetermined threshold value Th at the gradation level La. Similarly, the frequency determination unit 72 determines that the frequency 402, the frequency 403, and the frequency 400 are each greater than a predetermined threshold Th at the gradation level Lb, the gradation level Lc, and the gradation level Ld.
- the horizontal axis in FIG. 10 is the gradation level
- the vertical axis is the frequency.
- the gradation number detection unit 73 counts the number of gradation levels determined by the frequency determination unit 72 as having a high frequency.
- the effect adjustment signal generator 74 increases the signal level (value) of the special image effect adjustment signal DS as the number of gradations increases in accordance with the counted number of gradation levels.
- the effect adjustment signal DS is output. For example, as shown in FIG. 11, the signal level (value) of the special image effect adjustment signal DS is increased within a range where the counted number of gradation levels is a predetermined value The or more and a predetermined value Thd.
- the effect adjustment signal generation unit 74 can generate the special image effect adjustment signal DS that completely eliminates the visual effect when the threshold value is less than the threshold value “Thc” in which the special image is included.
- the effect adjustment signal generation unit 74 can generate a special image effect adjustment signal DS for processing without degrading the visual effect when the threshold value “Thd” or more including a normal image that is not a special image is included.
- the horizontal axis represents the number of gradation levels
- the vertical axis represents the output of the special image effect adjustment signal DS.
- the range of the value of the special image effect adjustment signal DS to be output is changed from “0.0” to “1.0”, but from “0.2” to “1.0” depending on the intensity of visual processing. You may make it adjust to.
- the visual processing device 1 is configured so that the effect of the visual processing becomes stronger as the value of the special image effect adjustment signal DS becomes larger.
- the special image detection unit 70 of Modification 1 the degree of the special image can be detected from the image signal according to the bias of the image information, and the special image detection unit 40 is replaced with the special image detection unit 70. It becomes possible.
- the ratio power of the area in which the shading in the image of the image signal IS does not change is detected.
- the region where the density does not change can be detected based on the flatness of the image.
- a method of detecting the flatness an average of averaging a plurality of detected continuous lengths is detected from the image signal IS by detecting a continuous length in which similar pixels having a luminance difference with an adjacent pixel are equal to or less than a predetermined value.
- a method of detecting the continuous length is adopted.
- the degree of the special image can be detected.
- the degree of special images can be detected from statistical information bias.
- FIG. 12 is a block diagram showing the configuration of the special image detection unit 80 of the second modification
- FIG. 13 is an explanatory diagram for explaining the continuous length of similar pixels in the image
- FIG. 14 is the special image utility of the second modification. It is explanatory drawing for demonstrating the fruit adjustment signal DS.
- the special image detection unit 80 of Modification 2 includes a similar luminance detection unit 81 that detects a similar pixel in which the luminance difference between adjacent pixels is equal to or less than a predetermined value from the image signal IS, and a similar pixel detection unit.
- an effect adjustment signal generator 84 for outputting a special image effect adjustment signal DS according to the average continuous length.
- the similar luminance detection unit 81 detects a similar pixel in which the luminance difference between adjacent pixels is equal to or less than a predetermined value from the image signal.
- the predetermined value is a value that is determined experimentally and is determined by the image quality specifications of the required device.
- the continuous length detection unit 82 detects a continuous length in which similar pixels are continuous.
- the continuous length is similar in the vertical direction such as the vertical direction 503, the vertical direction 504 and the vertical direction 505, and in the horizontal direction such as the horizontal direction 500, the horizontal direction 501 and the horizontal direction 502.
- the number of continuous pixels is detected as the continuous length.
- the average continuous length calculation unit 83 calculates an average continuous length by averaging a plurality of continuous lengths detected by the continuous length detection unit 82.
- the effect adjustment signal generation unit 84 outputs the signal level (value) of the special image effect adjustment signal DS so as to decrease as the average continuous length increases in accordance with the average continuous length. For example, As shown in FIG. 14, the signal level (value) of the special image effect adjustment signal DS is decreased in the range where the detected average continuous length is not less than a predetermined value “The” and a predetermined value “T hfj”.
- the horizontal axis is the average continuous length
- the vertical axis is the output of the special image effect adjustment signal DS
- the special image effect adjustment signal DS can be generated for processing without reducing the visual effect.
- the effect adjustment signal generator 84 can generate the special image effect adjustment signal DS in which the visual effect is completely eliminated when the threshold value is “13 ⁇ 4” or more including the special image.
- the range of the value of the special image effect adjustment signal DS to be output is “0.0” to “1.0”. Depending on the intensity of visual processing, “0.2” to “1.0”, etc. You may make it adjust to. Further, the visual processing device 1 is configured so that the larger the value of the special image effect adjustment signal DS, the stronger the visual processing effect.
- the special image detection unit 80 of the second modification As described above, according to the special image detection unit 80 of the second modification, the degree of special image having a bias of image information can be detected from the image signal, and the special image detection unit 40 is replaced with the special image detection unit 80. It becomes possible.
- Modification Example 3 of the special image detection unit 40 will be described.
- the ratio power of the area where the shading changes in the image of the image signal IS is detected.
- the region where the shading changes can be detected by the high frequency component in the image.
- a high frequency block including high frequency components is detected from a plurality of divided blocks, and the ratio of the number of high frequency blocks to the total number of divided blocks is detected, thereby detecting the degree of special image! To do.
- FIG. Fig. 15 (a) is a block diagram showing the configuration of the special image detection unit 90 of Modification 3
- Fig. 16 is an explanatory diagram for explaining the block image
- Fig. 17 is a special image effect adjustment signal DS of Modification 3. It is explanatory drawing for demonstrating.
- the special image detection unit 90 of Modification 3 detects a high frequency block including a high frequency component from the image signal IS divided into a plurality of blocks.
- the output unit 91, the high frequency block density detection unit 92 that detects the ratio of the number of high frequency blocks to the total number of blocks, and the effect of outputting an effect adjustment signal according to the ratio of the number of blocks detected by the high frequency block density detection unit 92 An adjustment signal generator 93.
- the high frequency block detecting unit 91 can detect a high frequency component for each encoded block. For example, high frequency components can be extracted by detecting the AC coefficient for each code block.
- the high frequency block detecting unit 91 determines that a block when a high frequency component equal to or greater than a predetermined value is detected is a high frequency block.
- the high frequency block detection unit 91 detects a high frequency component and determines that it is “a high frequency block”. On the other hand, the high frequency block detection unit 91 cannot detect the high frequency components because the blocks 601 and 602 have substantially constant gray values, and determines that each is not a high frequency block. Hereafter, the same determination is made for all the divided blocks.
- the high frequency block density detector 92 detects the ratio of the number of high frequency blocks to the total number of blocks divided into a plurality of blocks (hereinafter referred to as “block density”!).
- the effect adjustment signal generator 93 outputs the special image effect adjustment signal DS by increasing the value of the special image effect adjustment signal DS as the block density increases in accordance with the block density. For example, as shown in FIG. 17, the value of the special image effect adjustment signal DS is increased in a range where the detected block density is greater than or equal to a predetermined value Thg to a predetermined value Thh.
- the effect adjustment signal generation unit 93 can generate the special image effect adjustment signal DS that completely eliminates the visual effect when the threshold value is “11 ⁇ ” or less including the special image.
- the effect adjustment signal generator 93 can generate a special image effect adjustment signal DS for processing without degrading the visual effect when the threshold value “Thh” or more including a normal image that is not a special image is included.
- the horizontal axis is the block density
- the vertical axis is the output of the special image effect adjustment signal DS.
- the special image effect adjustment signal DS to be output The range is set from “0.0” to “1.0”, but it may be adjusted from “0.2” to “1.0” depending on the intensity of visual processing.
- the visual processing device 1 is configured so that the effect of the visual processing becomes stronger as the value of the special image effect adjustment signal DS is larger.
- a special image detection unit 90 ′ shown in FIG. 15B may be used instead of the special image detection unit 90 shown in FIG.
- the special image detection unit 90 ′ includes a high-frequency block detection unit 91 ′ that detects a high-frequency block included in the image area of one image formed by the image signal IS from the image signal IS, and a high-frequency block detection unit.
- a high-frequency block number calculating unit 94 that calculates the number of high-frequency blocks detected by 91 ′, and an effect adjustment signal generating unit 93 ′ that outputs an effect adjustment signal according to the number of high-frequency blocks.
- the degree of the special image having the bias of the image information can be detected from the image signal IS, and the special image detection unit 40 is changed to the special image detection unit 90. It can be replaced.
- a reduction processing unit for reducing the image signal is provided between the image signal and the special image detection unit 40 (70, 80, 90), and statistically reduced from the reduced image generated by the reduction processing unit. It is also possible to detect special images with information bias and output an effect adjustment signal based on this statistical bias.
- the reduced image By using a reduced image, it is possible to detect a flat region near the edge while suppressing the influence of noise.
- the reduced image generated by the reduction method that thins out after averaging the image signal Since noise components are reduced, statistical information bias can be detected while suppressing the influence of noise. If a reduced image is used, the number of pixels to be detected can be reduced and the amount of calculation can be reduced.
- the visual processing device 1 outputs a synthesized signal MUS that is synthesized by changing the ratio of the image signal IS and the peripheral image information (unsharp signal) US according to the effect adjustment signal MOD,
- the visual processing unit 30 outputs the processing output OS obtained by visually processing the image signal according to the composite signal MUS from the effect adjusting unit 20, but the visual processing device 2 according to the second embodiment of the present invention Then, the effect adjustment unit 21 outputs a composite output OUT obtained by synthesizing the visually processed processing output OS and the image signal IS according to the effect adjustment signal.
- the visual processing device 2 according to this embodiment will be described with reference to FIG.
- FIG. 18 is a block diagram showing the configuration of the visual processing device 2 according to the second embodiment of the present invention.
- the same parts as those in the first embodiment are denoted by the same reference numerals, and detailed description thereof is omitted.
- the visual processing unit 30 outputs a processing output OS based on the image signal IS and the output US of the spatial processing unit 10.
- the effect adjustment unit 21 performs the internal calculation on the image signal IS and the processing output OS according to the effect adjustment signal MOD, thereby making the visual processing effect different.
- the output OUT from the effect adjustment unit 21 is calculated by internal division as shown in the following (Equation 3).
- Equation 3 can also be realized by modifying it as (Equation 4).
- the synthesized signal OUT synthesized by changing the ratio between the processed signal OS and the image signal IS in accordance with the effect adjustment signal MOD. It can output, and the effect of visual processing can be made different.
- the special image detection unit 40 may be replaced with the special image detection unit 70 of the first embodiment of the present invention. According to this, a special image can be detected in the same manner, and according to the bias of the image information.
- the effect adjustment signal MOD can be generated.
- the special image detection unit 40 may be replaced with the special image detection unit 80 of the first embodiment of the present invention. According to this, a special image can be similarly detected, and an effect adjustment signal MOD corresponding to the bias of the image information can be generated.
- the special image detection unit 40 may be replaced with the special image detection unit 90 of the first embodiment of the present invention. According to this, a special image can be similarly detected, and an effect adjustment signal MOD corresponding to the bias of the image information can be generated.
- the visual processing device 1 outputs a synthesized signal MUS that is synthesized by changing the ratio of the image signal IS and the peripheral image information (unsharp signal) US according to the effect adjustment signal MOD,
- the visual processing unit 30 outputs the processing output OS obtained by visually processing the image signal according to the composite signal MUS from the effect adjustment unit 20, but the visual processing device 3 according to the third embodiment of the present invention
- the effect adjustment unit 22 creates a profile (hereinafter referred to as “composite profile” and “! ⁇ ⁇ ”) by changing the proportion of output from each of the profiles with different visual processing effects according to the effect adjustment signal MOD.
- the LUT of the visual processing unit 30 is set. This embodiment will be described with reference to FIG.
- FIG. 19 is a block diagram showing a configuration of the visual processing device 3 according to the third embodiment of the present invention.
- the same parts as those in the first embodiment are denoted by the same reference numerals, and detailed description thereof is omitted.
- the effect adjustment unit 22 synthesizes the first profile 60 and the second profile 61 having different visual processing intensities by internal calculation according to the effect adjustment signal MOD, creates a synthesis profile, and creates the synthesized profile in the LUT of the visual processing unit 30.
- the visual processing unit 30 can perform visual processing with different levels of visual processing and different visual effects according to the composite profile set in the LUT.
- a plurality of profiles having different visual processing intensities and effects are synthesized according to the effect adjustment signal MOD.
- the effect of visual processing can be varied.
- the special image detection unit 40 may be replaced with the special image detection unit 70 in the first embodiment of the present invention. According to this, a special image can be detected in the same manner, and an effect adjustment signal MOD corresponding to the information bias can be generated.
- the special image detection unit 40 may be replaced with the special image detection unit 80 in the first embodiment of the present invention. According to this, a special image can be detected in the same manner, and an effect adjustment signal MOD corresponding to the information bias can be generated.
- the special image detection unit 40 may be replaced with the special image detection unit 90 in the first embodiment of the present invention. According to this, a special image can be detected in the same manner, and an effect adjustment signal MOD corresponding to the information bias can be generated.
- the gradation conversion value based on the two-dimensional gradation conversion characteristics is output.
- a gain-type visual processing system 4 that performs gradation conversion using a gain output will be described with reference to FIGS. 20 and 21.
- FIG. 20 is a block diagram showing the configuration of the gain-type visual processing system 4 in the fourth embodiment of the present invention
- FIG. 21 is an explanatory diagram for explaining the two-dimensional gain characteristics.
- the gain-type visual processing system 4 includes a gain-type visual processing device 5 that outputs a gain signal GAIN obtained by visually processing the image signal IS, and a multiplier 11 that multiplies the gain signal GAIN and the image signal IS. Speak.
- the gain-type visual processing device 5 includes a visual processing device 1 that outputs a processed signal OS obtained by visually processing the image signal IS, and a divider 12 that divides the processed signal OS by the image signal IS.
- the visual processing device 1 outputs a gradation conversion value obtained by visually processing the output of the image signal IS. By dividing the gradation conversion value by the image signal IS, the gain-type visual processing device 5 Can be realized.
- the multiplier 11 is configured to output the gain signal GAIN output from the gain-type visual processing device 5 and the image signal I. Multiply s and output a gradation conversion value obtained by visually processing the image signal IS.
- the visual processing unit 30 may directly use a profile having a two-dimensional gain characteristic shown in FIG.
- the vertical axis in FIG. 21 is the gain output GN
- the horizontal axis is the image signal IS.
- the two-dimensional gain characteristic shown in FIG. 21 is equivalent to the one obtained by dividing the output of the two-dimensional gradation characteristic profile shown in FIG. 2 by the image signal IS.
- the profile having the two-dimensional gain characteristic may be set in the LUT of the visual processing unit 30 of the visual processing device 1. In this way, if the profile of the 2D gain characteristic is set in advance in the LUT of the visual processing unit 30, the gain output GN and the gain signal GAIN are equivalent, so even if the divider 12 is deleted, the gain-type visual processing Device 5 can be realized.
- the gain-type visual processing device 5 changes the processing signal visually processed with respect to the input image signal IS. Since it is small, the number of bits of the input signal can be reduced and the circuit scale can be reduced. In addition, when the visual processing unit 30 is equipped with a two-dimensional LUT, the memory capacity can be reduced.
- the visual processing device 1 according to the first embodiment of the present invention may be replaced with the visual processing device 2 according to the second embodiment of the present invention. This also makes it possible to realize the gain-type visual processing device 5.
- the visual processing device 1 in the first embodiment of the present invention may be replaced with the visual processing device 3 in the third embodiment of the present invention. This also makes it possible to realize the gain-type visual processing device 5.
- the visual processing effect can be maintained, and a special image can be maintained. Side effects can be reduced when images are input.
- the special image degree is calculated for all the pixels of one image formed by the input image signal! / , And calculate the special image degree! ⁇ for the pixels that form a predetermined area of one image formed by the input image signal! You may make it take out.
- the image signal corresponding to an image 2302 having an aspect ratio of 4: 3 is excluded, except for the image signals (pixels) corresponding to the black portions 2304 and 2305.
- the special image degree may be calculated to generate a special image effect adjustment signal.
- the image signal (pixels) corresponding to the black parts 2308 and 2309 is excluded, and it corresponds to the image 2307 having an aspect ratio of 16: 9.
- the special image degree may be calculated only for the image signal (pixel) to be generated, and the special image effect adjustment signal may be generated! ⁇ .
- FIGS. 23 (a) and (b) are for convenience of explanation and are not drawn with an accurate aspect ratio.
- the special image degree may be calculated for each image to be divided and displayed in an image signal when a plurality of images are divided and displayed on one display screen. For example, as shown in FIG. 24, in the case of an image signal that displays a special image 2302 in the left area and a general image 2403 in the right area on the display screen 2401, the special image 2302 in the left area is formed.
- the special image degree is calculated only by the image signal (pixel) to be generated, the special image effect adjustment signal is generated, and the special image is generated only by the image signal (pixel) forming the natural image 23 03 in the right area.
- the degree may be calculated to generate a special image effect adjustment signal. In other words, the special image degree may be calculated for each divided and displayed image unit to generate a special image effect adjustment signal.
- various functions such as a spatial processing function, an effect adjustment function, a visual processing function, and a special image detection function in the visual processing device or the visual processing system described in the embodiment of the present invention are hardware using an integrated circuit or the like. May be implemented by hardware or central processing equipment (Hereinafter referred to as “CPU”), software that operates using a digital signal processor or the like.
- CPU central processing equipment
- the various functions described above may be realized by a mixed process of software and nodeware.
- each function in the embodiments of the present invention may be individually integrated circuits, or an integrated circuit integrated into a single chip so as to include a part or all of them. It is good.
- the integrated circuit here is not limited to LSI, but may be called IC, system LSI, super LSI, or ultra LSI depending on the degree of integration.
- the integrated circuit may be realized by a dedicated circuit or a general-purpose processor.
- a dedicated circuit for example, an FPGA (Field Programmable Gate Array) that can be programmed after manufacturing a semiconductor chip, or a reconfigurable processor that can reconfigure the connection and setting of cells inside the integrated circuit may be used.
- FPGA Field Programmable Gate Array
- reconfigurable processor that can reconfigure the connection and setting of cells inside the integrated circuit may be used.
- FIG. 22 is a block diagram showing a configuration of a computer according to the embodiment of the present invention.
- a computer 6 includes a CPU 100 that executes instructions of various programs, a read-only memory 101 (hereinafter referred to as “ROM 101”) in which programs are stored, and a random access memory 102 in which data in temporary storage is stored. (Hereinafter referred to as “RAM 102”), an input unit 103 for inputting an image, an output unit 104 for outputting an image, and a storage unit 105 for storing a program and various data.
- a communication unit 106 for performing communication with the outside and a drive 107 for appropriately connecting an information storage medium may be provided.
- Each functional unit transmits and receives control signals and data via the bus 110.
- the CPU 100 executes processing of various functions according to the program stored in the ROM 101.
- the ROM 101 stores programs, profiles, and the like.
- the RAM 102 temporarily stores data necessary for processing of various functions by the CPU 100.
- the input unit 103 inputs an image. For example, a video signal is acquired by receiving radio waves and decoding the received signal. Also, try to get digital images directly via wire.
- the output unit 104 outputs an image. For example, output to a display device such as a liquid crystal display device or a plasma display.
- the storage unit 105 is composed of a magnetic memory or the like, and stores various programs and data.
- the communication unit 106 may be connected to the network 111 and may acquire the program via the network 111 or install the acquired program in the storage unit 105 as necessary. As a result, the computer 6 can download the program through the communication unit 106.
- the drive 107 connects an information storage medium as appropriate, and acquires storage information stored in the information storage medium.
- the information storage medium is, for example, a disk 108 such as a magnetic disk, a magneto-optical disk, or an optical disk, or a memory card 109 such as a semiconductor memory.
- a program for executing various functions, a profile, and the like may be stored in the disk 108 or a memory card 109 such as a semiconductor memory, and the information may be given to the computer 6.
- the program may be preliminarily incorporated into the computer with dedicated hardware, or may be provided preliminarily incorporated into the ROM 101 and the storage unit 105.
- the program can also be applied to devices that handle images such as information processing devices, display devices, digital cameras, mobile phones, and PDAs.
- the program is built in or connected to a device that handles images, and executes visual processing similar to the visual processing realized by the visual processing device or the visual processing system described in the above embodiment.
- the display mode may be switched when a special image is detected.
- the data for the referenced two-dimensional LUT is stored in a storage device such as a hard disk or ROM. Referenced as necessary.
- 2D LUT data it may be provided from a two-dimensional gain data (profile) providing device for a two-dimensional LUT that is directly connected to a visual processing device or indirectly connected via a network.
- the visual processing device the visual processing method, and the program according to the present invention, it is possible to visually process an image signal, and in particular, it is possible to suppress side effects even when a special image is input. It is useful as a device, visual processing method and program.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Image Processing (AREA)
- Picture Signal Circuits (AREA)
- Facsimile Image Signal Circuits (AREA)
Abstract
Description
Claims
Priority Applications (6)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US12/297,403 US7894684B2 (en) | 2006-04-19 | 2007-03-27 | Visual processing device, visual processing method, program, display device, and integrated circuit |
JP2008502175A JP4191241B2 (ja) | 2006-04-19 | 2007-03-27 | 視覚処理装置、視覚処理方法、プログラム、表示装置および集積回路 |
KR1020087027977A KR101314453B1 (ko) | 2006-04-19 | 2007-03-27 | 시각 처리 장치, 시각 처리 방법, 프로그램, 표시 장치 및 집적 회로 |
CN2007800142212A CN101427559B (zh) | 2006-04-19 | 2007-03-27 | 视觉处理装置、视觉处理方法、显示装置和集成电路 |
EP07739886.5A EP2012527B1 (en) | 2006-04-19 | 2007-03-27 | Visual processing device, visual processing method, program, display device, and integrated circuit |
US13/005,797 US8406547B2 (en) | 2006-04-19 | 2011-01-13 | Visual processing device, visual processing method, program, display device, and integrated circuit |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2006115176 | 2006-04-19 | ||
JP2006-115176 | 2006-04-19 |
Related Child Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US12/297,403 A-371-Of-International US7894684B2 (en) | 2006-04-19 | 2007-03-27 | Visual processing device, visual processing method, program, display device, and integrated circuit |
US13/005,797 Continuation US8406547B2 (en) | 2006-04-19 | 2011-01-13 | Visual processing device, visual processing method, program, display device, and integrated circuit |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2007122966A1 true WO2007122966A1 (ja) | 2007-11-01 |
Family
ID=38624875
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2007/056448 WO2007122966A1 (ja) | 2006-04-19 | 2007-03-27 | 視覚処理装置、視覚処理方法、プログラム、表示装置および集積回路 |
Country Status (6)
Country | Link |
---|---|
US (2) | US7894684B2 (ja) |
EP (1) | EP2012527B1 (ja) |
JP (2) | JP4191241B2 (ja) |
KR (1) | KR101314453B1 (ja) |
CN (2) | CN102438097B (ja) |
WO (1) | WO2007122966A1 (ja) |
Families Citing this family (51)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9384619B2 (en) | 2006-07-31 | 2016-07-05 | Ricoh Co., Ltd. | Searching media content for objects specified using identifiers |
US8838591B2 (en) | 2005-08-23 | 2014-09-16 | Ricoh Co., Ltd. | Embedding hot spots in electronic documents |
US9373029B2 (en) | 2007-07-11 | 2016-06-21 | Ricoh Co., Ltd. | Invisible junction feature recognition for document security or annotation |
US8385589B2 (en) * | 2008-05-15 | 2013-02-26 | Berna Erol | Web-based content detection in images, extraction and recognition |
US7812986B2 (en) | 2005-08-23 | 2010-10-12 | Ricoh Co. Ltd. | System and methods for use of voice mail and email in a mixed media environment |
US7702673B2 (en) | 2004-10-01 | 2010-04-20 | Ricoh Co., Ltd. | System and methods for creation and use of a mixed media environment |
US8825682B2 (en) | 2006-07-31 | 2014-09-02 | Ricoh Co., Ltd. | Architecture for mixed media reality retrieval of locations and registration of images |
US8510283B2 (en) | 2006-07-31 | 2013-08-13 | Ricoh Co., Ltd. | Automatic adaption of an image recognition system to image capture devices |
US8856108B2 (en) | 2006-07-31 | 2014-10-07 | Ricoh Co., Ltd. | Combining results of image retrieval processes |
US8176054B2 (en) | 2007-07-12 | 2012-05-08 | Ricoh Co. Ltd | Retrieving electronic documents by converting them to synthetic text |
US8868555B2 (en) | 2006-07-31 | 2014-10-21 | Ricoh Co., Ltd. | Computation of a recongnizability score (quality predictor) for image retrieval |
US8600989B2 (en) | 2004-10-01 | 2013-12-03 | Ricoh Co., Ltd. | Method and system for image matching in a mixed media environment |
US9405751B2 (en) | 2005-08-23 | 2016-08-02 | Ricoh Co., Ltd. | Database for mixed media document system |
US8949287B2 (en) | 2005-08-23 | 2015-02-03 | Ricoh Co., Ltd. | Embedding hot spots in imaged documents |
US8156115B1 (en) | 2007-07-11 | 2012-04-10 | Ricoh Co. Ltd. | Document-based networking with mixed media reality |
US8521737B2 (en) | 2004-10-01 | 2013-08-27 | Ricoh Co., Ltd. | Method and system for multi-tier image matching in a mixed media environment |
US8369655B2 (en) | 2006-07-31 | 2013-02-05 | Ricoh Co., Ltd. | Mixed media reality recognition using multiple specialized indexes |
US8156116B2 (en) | 2006-07-31 | 2012-04-10 | Ricoh Co., Ltd | Dynamic presentation of targeted information in a mixed media reality recognition system |
US9530050B1 (en) | 2007-07-11 | 2016-12-27 | Ricoh Co., Ltd. | Document annotation sharing |
US9171202B2 (en) | 2005-08-23 | 2015-10-27 | Ricoh Co., Ltd. | Data organization and access for mixed media document system |
EP2323100A3 (en) * | 2005-10-12 | 2012-03-21 | Panasonic Corporation | Visual processing apparatus, display apparatus, visual processing method, program and integrated circuit |
US7755670B2 (en) * | 2005-10-24 | 2010-07-13 | Nikon Corporation | Tone-conversion device for image, program, electronic camera, and tone-conversion method |
CN102438097B (zh) * | 2006-04-19 | 2015-06-03 | 松下电器(美国)知识产权公司 | 图像处理装置与图像处理方法 |
US7903898B2 (en) * | 2006-04-28 | 2011-03-08 | Panasonic Corporation | Visual processing apparatus, visual processing method, program, recording medium, display device, and integrated circuit |
WO2007139534A1 (en) * | 2006-05-25 | 2007-12-06 | Thomson Licensing | Method and system for weighted encoding |
US8489987B2 (en) | 2006-07-31 | 2013-07-16 | Ricoh Co., Ltd. | Monitoring and analyzing creation and usage of visual content using image and hotspot interaction |
US9063952B2 (en) | 2006-07-31 | 2015-06-23 | Ricoh Co., Ltd. | Mixed media reality recognition with image tracking |
US9020966B2 (en) | 2006-07-31 | 2015-04-28 | Ricoh Co., Ltd. | Client device for interacting with a mixed media reality recognition system |
US8676810B2 (en) | 2006-07-31 | 2014-03-18 | Ricoh Co., Ltd. | Multiple index mixed media reality recognition using unequal priority indexes |
US9176984B2 (en) | 2006-07-31 | 2015-11-03 | Ricoh Co., Ltd | Mixed media reality retrieval of differentially-weighted links |
US8201076B2 (en) | 2006-07-31 | 2012-06-12 | Ricoh Co., Ltd. | Capturing symbolic information from documents upon printing |
JP5132470B2 (ja) * | 2008-08-01 | 2013-01-30 | 三洋電機株式会社 | 画像処理装置 |
JP5491073B2 (ja) * | 2009-05-22 | 2014-05-14 | キヤノン株式会社 | 画像処理装置、画像処理方法及びプログラム |
US8385660B2 (en) | 2009-06-24 | 2013-02-26 | Ricoh Co., Ltd. | Mixed media reality indexing and retrieval for repeated content |
US8861879B2 (en) * | 2009-09-17 | 2014-10-14 | Samsung Electronics Co., Ltd. | Method and apparatus for encoding and decoding image based on skip mode |
EP2485211A4 (en) | 2009-09-29 | 2012-08-29 | Panasonic Corp | DISPLAY DEVICE AND METHOD |
JP5325089B2 (ja) * | 2009-12-25 | 2013-10-23 | 日立コンシューマエレクトロニクス株式会社 | 画像表示装置、それに用いる光源輝度決定回路、およびそれを搭載したlsi |
KR101113483B1 (ko) * | 2010-04-09 | 2012-03-06 | 동아대학교 산학협력단 | 컬러 영상의 가시성 향상 장치 및 방법 |
US8472724B2 (en) * | 2010-06-30 | 2013-06-25 | Samsung Electronics Co., Ltd. | System and method for reducing noise in an image |
US9058331B2 (en) | 2011-07-27 | 2015-06-16 | Ricoh Co., Ltd. | Generating a conversation in a social network based on visual search results |
CN102542562A (zh) * | 2011-11-23 | 2012-07-04 | 首都医科大学 | 一种基于肺结节三正交位ct图像纹理的提取方法和预测肺癌方法 |
US20130207992A1 (en) * | 2012-02-10 | 2013-08-15 | Emil Alexander WASBERGER | Method, apparatus and computer readable medium carrying instructions for mitigating visual artefacts |
KR102113178B1 (ko) * | 2013-09-12 | 2020-05-21 | 삼성디스플레이 주식회사 | 표시 장치 및 액정 표시 장치 |
CN104637028B (zh) * | 2013-11-06 | 2018-06-22 | 联咏科技股份有限公司 | 图像处理装置及其图像优化方法 |
JP6152820B2 (ja) * | 2014-03-31 | 2017-06-28 | ブラザー工業株式会社 | 画像読取装置 |
JP2015231086A (ja) * | 2014-06-04 | 2015-12-21 | 三星ディスプレイ株式會社Samsung Display Co.,Ltd. | 制御装置、およびプログラム |
WO2016056787A1 (en) * | 2014-10-06 | 2016-04-14 | Samsung Electronics Co., Ltd. | Display device and method of controlling the same |
TWI713365B (zh) * | 2019-07-26 | 2020-12-11 | 瑞昱半導體股份有限公司 | 影像處理電路與相關的影像處理方法 |
JP7471832B2 (ja) * | 2020-01-23 | 2024-04-22 | キヤノン株式会社 | 画像処理装置、画像処理方法、及びプログラム |
TWI813181B (zh) * | 2021-09-09 | 2023-08-21 | 大陸商星宸科技股份有限公司 | 影像處理電路與影像處理方法 |
CN116818780B (zh) * | 2023-05-26 | 2024-03-26 | 深圳市大德激光技术有限公司 | 纽扣电池壳体激光焊接后视觉2d和3d检测系统 |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH10208034A (ja) * | 1997-01-17 | 1998-08-07 | Seiko Epson Corp | 画像処理装置および画像処理方法 |
JP2003309763A (ja) * | 2002-04-16 | 2003-10-31 | Olympus Optical Co Ltd | 動画撮像システム |
JP2004312387A (ja) * | 2003-04-07 | 2004-11-04 | Sharp Corp | 画像処理方法、画像処理装置、画像形成装置、撮像装置、及びコンピュータプログラム |
JP2005130484A (ja) * | 2003-10-02 | 2005-05-19 | Nikon Corp | 階調補正装置、および階調補正プログラム |
JP2005295131A (ja) * | 2004-03-31 | 2005-10-20 | Seiko Epson Corp | 画像処理装置、画像処理方法および画像処理プログラム |
JP2006024176A (ja) * | 2003-09-11 | 2006-01-26 | Matsushita Electric Ind Co Ltd | 視覚処理装置、視覚処理方法、視覚処理プログラム、集積回路、表示装置、撮影装置および携帯情報端末 |
Family Cites Families (74)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4667304A (en) * | 1984-11-23 | 1987-05-19 | Digivision, Inc. | Real-time, localized enhancement of a video image using separable two-dimensional filters |
GB2170373B (en) | 1984-12-28 | 1989-03-15 | Canon Kk | Image processing apparatus |
JPH074003B2 (ja) | 1985-12-18 | 1995-01-18 | 松下電器産業株式会社 | 信号圧縮装置 |
JPS63177662A (ja) | 1987-01-19 | 1988-07-21 | Matsushita Electric Ind Co Ltd | 輪郭補正器 |
JPS63182785A (ja) | 1987-01-26 | 1988-07-28 | Canon Inc | カラ−画像処理装置 |
JP2575476B2 (ja) * | 1988-10-20 | 1997-01-22 | 富士写真フイルム株式会社 | 画像信号処理方法およびその装置 |
US5012333A (en) | 1989-01-05 | 1991-04-30 | Eastman Kodak Company | Interactive dynamic range adjustment system for printing digital images |
US5038388A (en) * | 1989-05-15 | 1991-08-06 | Polaroid Corporation | Method for adaptively sharpening electronic images |
JPH0348980A (ja) | 1989-07-18 | 1991-03-01 | Fujitsu Ltd | 輪郭強調処理方式 |
JP2663189B2 (ja) | 1990-01-29 | 1997-10-15 | 富士写真フイルム株式会社 | 画像のダイナミックレンジ圧縮処理方法 |
US5485534A (en) * | 1990-03-28 | 1996-01-16 | Fuji Photo Film Co., Ltd. | Method and apparatus for emphasizing sharpness of image by detecting the edge portions of the image |
JP3003799B2 (ja) * | 1990-03-28 | 2000-01-31 | 富士写真フイルム株式会社 | 画像の鮮鋭度強調方法及びその装置 |
JPH04152788A (ja) | 1990-10-17 | 1992-05-26 | Olympus Optical Co Ltd | コントラスト回路 |
JPH04157592A (ja) | 1990-10-22 | 1992-05-29 | Nec Corp | 自動販売機の状態検知・通知方式 |
JPH0646295A (ja) | 1992-07-27 | 1994-02-18 | Matsushita Electric Ind Co Ltd | 輪郭補正装置 |
BE1007590A3 (nl) | 1993-10-01 | 1995-08-16 | Philips Electronics Nv | Videosignaalverwerkingsschakeling. |
JPH07135667A (ja) | 1993-11-12 | 1995-05-23 | Matsushita Electric Ind Co Ltd | 輪郭強調回路 |
DE69636911T2 (de) * | 1995-03-29 | 2007-11-22 | Fujifilm Corp. | Bildverarbeitungsverfahren und -Vorrichtung |
US5880767A (en) * | 1996-09-11 | 1999-03-09 | Hewlett-Packard Company | Perceptual image resolution enhancement system |
JP3639397B2 (ja) | 1996-12-24 | 2005-04-20 | 株式会社日立製作所 | 像域別カラー画像処理装置、画像出力装置、画像処理方法および記憶媒体 |
US6731400B1 (en) | 1996-11-01 | 2004-05-04 | Hitachi, Ltd. | Color image processing apparatus which performs different image processings depending on region of color image |
US6055340A (en) * | 1997-02-28 | 2000-04-25 | Fuji Photo Film Co., Ltd. | Method and apparatus for processing digital images to suppress their noise and enhancing their sharpness |
JPH11250246A (ja) * | 1998-02-27 | 1999-09-17 | Fuji Photo Film Co Ltd | 画像処理方法および装置 |
US6285798B1 (en) * | 1998-07-06 | 2001-09-04 | Eastman Kodak Company | Automatic tone adjustment by contrast gain-control on edges |
JP3233114B2 (ja) | 1998-11-13 | 2001-11-26 | ソニー株式会社 | 画像処理装置及び画像処理方法 |
US7440612B2 (en) | 1998-11-13 | 2008-10-21 | Sony Corporation | Image processing apparatus and method capable of correcting gradation of image data |
US6323855B1 (en) * | 1998-12-10 | 2001-11-27 | Eastman Kodak Company | Sharpening edge features in digital image providing high frequency edge enhancement |
JP4053185B2 (ja) * | 1999-06-22 | 2008-02-27 | 富士フイルム株式会社 | 画像処理方法および装置 |
JP4556276B2 (ja) * | 2000-03-23 | 2010-10-06 | ソニー株式会社 | 画像処理回路及び画像処理方法 |
US6611627B1 (en) * | 2000-04-24 | 2003-08-26 | Eastman Kodak Company | Digital image processing method for edge shaping |
US6633683B1 (en) * | 2000-06-26 | 2003-10-14 | Miranda Technologies Inc. | Apparatus and method for adaptively reducing noise in a noisy input image signal |
JP4099936B2 (ja) | 2000-09-07 | 2008-06-11 | 富士ゼロックス株式会社 | 画像処理装置、画像処理方法および画像処理プログラムが格納された記録媒体 |
US6735330B1 (en) * | 2000-10-17 | 2004-05-11 | Eastman Kodak Company | Automatic digital radiographic bright light |
US7136538B2 (en) * | 2000-12-21 | 2006-11-14 | Matsushita Electric Industrial Co., Ltd. | Noise reducing apparatus and noise reducing method |
US6847377B2 (en) * | 2001-01-05 | 2005-01-25 | Seiko Epson Corporation | System, method and computer program converting pixels to luminance levels and assigning colors associated with luminance levels in printer or display output devices |
JP2002281313A (ja) | 2001-03-15 | 2002-09-27 | Minolta Co Ltd | 画像処理装置及び当該装置を備える画像形成装置 |
JP4509415B2 (ja) | 2001-04-12 | 2010-07-21 | 株式会社リコー | 画像処理装置 |
JP4649781B2 (ja) * | 2001-06-20 | 2011-03-16 | ソニー株式会社 | 画像処理方法および装置 |
JP2003060913A (ja) | 2001-08-13 | 2003-02-28 | Toyota Central Res & Dev Lab Inc | 画像処理方法及び画像処理装置 |
JP2003110956A (ja) | 2001-09-27 | 2003-04-11 | Toshiba Corp | デジタルテレビジョン受信装置、プリンタ装置、及び画像プリント出力機能付きデジタルテレビジョン受信装置 |
US7130483B2 (en) * | 2001-12-12 | 2006-10-31 | Samsung Electronics Co., Ltd. | Method for enhancing a digital image while suppressing undershoots and overshoots |
JP4021261B2 (ja) | 2002-07-08 | 2007-12-12 | 松下電器産業株式会社 | 画像処理装置 |
CN1303570C (zh) | 2002-02-12 | 2007-03-07 | 松下电器产业株式会社 | 图象处理装置和图象处理方法 |
JP4013699B2 (ja) | 2002-08-20 | 2007-11-28 | 松下電器産業株式会社 | 画像処理装置および画像処理方法 |
JP4147456B2 (ja) | 2002-03-29 | 2008-09-10 | 富士通株式会社 | 赤外線画像信号処理装置 |
JP4096613B2 (ja) | 2002-05-10 | 2008-06-04 | 松下電器産業株式会社 | 画像処理方法及び画像処理装置 |
JP2003337942A (ja) | 2002-05-17 | 2003-11-28 | Canon Inc | 画像処理装置 |
JP4152788B2 (ja) | 2003-03-25 | 2008-09-17 | 旭化成ケミカルズ株式会社 | ゲル状組成物 |
JP4217041B2 (ja) | 2002-09-12 | 2009-01-28 | Hoya株式会社 | フィルタ処理 |
US7274827B2 (en) | 2002-09-12 | 2007-09-25 | Pentax Corporation | Filter process |
US7130485B2 (en) * | 2002-10-02 | 2006-10-31 | Eastman Kodak Company | Enhancing the tonal and color characteristics of digital images using expansive and compressive tone scale functions |
US7280703B2 (en) * | 2002-11-14 | 2007-10-09 | Eastman Kodak Company | Method of spatially filtering a digital image using chrominance information |
JP2004310475A (ja) | 2003-04-08 | 2004-11-04 | Hitachi Ltd | 画像処理装置、画像処理を行う携帯電話、および画像処理プログラム |
JP4271978B2 (ja) * | 2003-04-18 | 2009-06-03 | 株式会社日立製作所 | 映像表示装置 |
SG115540A1 (en) | 2003-05-17 | 2005-10-28 | St Microelectronics Asia | An edge enhancement process and system |
US20050025383A1 (en) | 2003-07-02 | 2005-02-03 | Celartem Technology, Inc. | Image sharpening with region edge sharpness correction |
CN100525380C (zh) * | 2003-07-07 | 2009-08-05 | 致伸科技股份有限公司 | 使用模糊屏蔽法进行影像处理的方法 |
JP4172346B2 (ja) | 2003-07-15 | 2008-10-29 | コニカミノルタビジネステクノロジーズ株式会社 | 画像処理装置及びプログラム |
US7876974B2 (en) | 2003-08-29 | 2011-01-25 | Vladimir Brajovic | Method for improving digital images and an image sensor for sensing the same |
US7274828B2 (en) * | 2003-09-11 | 2007-09-25 | Samsung Electronics Co., Ltd. | Method and apparatus for detecting and processing noisy edges in image detail enhancement |
EP1667066B1 (en) | 2003-09-11 | 2020-01-08 | Panasonic Intellectual Property Corporation of America | Visual processing device, visual processing method, visual processing program, integrated circuit, display device, imaging device, and mobile information terminal |
TWI245557B (en) * | 2003-09-11 | 2005-12-11 | Matsushita Electric Ind Co Ltd | Image compensation apparatus and method for the same |
JP3953994B2 (ja) * | 2003-09-11 | 2007-08-08 | 大日本スクリーン製造株式会社 | 画像処理情報関連付け処理装置、印刷システム、レイアウトデータの出力可能化方法、およびプログラム |
US7466868B2 (en) | 2003-10-03 | 2008-12-16 | Adobe Systems Incorporated | Determining parameters for adjusting images |
US7333673B2 (en) * | 2003-10-30 | 2008-02-19 | Samsung Electronics Co., Ltd. | Method and apparatus for image detail enhancement without zigzagged edge artifact |
JP4402488B2 (ja) | 2004-03-18 | 2010-01-20 | オリンパス株式会社 | 画像処理装置 |
US7880771B2 (en) | 2004-03-16 | 2011-02-01 | Olympus Corporation | Imaging apparatus, image processing apparatus, image processing system and image processing method |
JP4923232B2 (ja) | 2004-07-07 | 2012-04-25 | 国立大学法人東北大学 | 太陽電池パネル |
CN100405400C (zh) * | 2005-06-27 | 2008-07-23 | 同方威视技术股份有限公司 | 一种辐射成像中图像信息增强的方法 |
JP4437150B2 (ja) | 2005-10-12 | 2010-03-24 | パナソニック株式会社 | 視覚処理装置、表示装置、視覚処理方法、プログラムおよび集積回路 |
EP2323100A3 (en) | 2005-10-12 | 2012-03-21 | Panasonic Corporation | Visual processing apparatus, display apparatus, visual processing method, program and integrated circuit |
US7602447B2 (en) * | 2006-01-26 | 2009-10-13 | Vestel Elecktronik Sanayi Ve | Method and apparatus for adjusting the contrast of an image |
CN102438097B (zh) * | 2006-04-19 | 2015-06-03 | 松下电器(美国)知识产权公司 | 图像处理装置与图像处理方法 |
US7903898B2 (en) * | 2006-04-28 | 2011-03-08 | Panasonic Corporation | Visual processing apparatus, visual processing method, program, recording medium, display device, and integrated circuit |
-
2007
- 2007-03-27 CN CN201110306432.1A patent/CN102438097B/zh not_active Expired - Fee Related
- 2007-03-27 US US12/297,403 patent/US7894684B2/en not_active Expired - Fee Related
- 2007-03-27 EP EP07739886.5A patent/EP2012527B1/en not_active Ceased
- 2007-03-27 KR KR1020087027977A patent/KR101314453B1/ko active IP Right Grant
- 2007-03-27 WO PCT/JP2007/056448 patent/WO2007122966A1/ja active Application Filing
- 2007-03-27 JP JP2008502175A patent/JP4191241B2/ja active Active
- 2007-03-27 CN CN2007800142212A patent/CN101427559B/zh not_active Expired - Fee Related
-
2008
- 2008-02-01 JP JP2008023332A patent/JP4558806B2/ja not_active Expired - Fee Related
-
2011
- 2011-01-13 US US13/005,797 patent/US8406547B2/en not_active Expired - Fee Related
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH10208034A (ja) * | 1997-01-17 | 1998-08-07 | Seiko Epson Corp | 画像処理装置および画像処理方法 |
JP2003309763A (ja) * | 2002-04-16 | 2003-10-31 | Olympus Optical Co Ltd | 動画撮像システム |
JP2004312387A (ja) * | 2003-04-07 | 2004-11-04 | Sharp Corp | 画像処理方法、画像処理装置、画像形成装置、撮像装置、及びコンピュータプログラム |
JP2006024176A (ja) * | 2003-09-11 | 2006-01-26 | Matsushita Electric Ind Co Ltd | 視覚処理装置、視覚処理方法、視覚処理プログラム、集積回路、表示装置、撮影装置および携帯情報端末 |
JP2005130484A (ja) * | 2003-10-02 | 2005-05-19 | Nikon Corp | 階調補正装置、および階調補正プログラム |
JP2005295131A (ja) * | 2004-03-31 | 2005-10-20 | Seiko Epson Corp | 画像処理装置、画像処理方法および画像処理プログラム |
Also Published As
Publication number | Publication date |
---|---|
US8406547B2 (en) | 2013-03-26 |
CN102438097B (zh) | 2015-06-03 |
US20090097775A1 (en) | 2009-04-16 |
JP4558806B2 (ja) | 2010-10-06 |
KR101314453B1 (ko) | 2013-10-07 |
KR20090009870A (ko) | 2009-01-23 |
JP4191241B2 (ja) | 2008-12-03 |
EP2012527B1 (en) | 2017-10-25 |
JP2008159071A (ja) | 2008-07-10 |
EP2012527A1 (en) | 2009-01-07 |
JPWO2007122966A1 (ja) | 2009-09-03 |
CN102438097A (zh) | 2012-05-02 |
CN101427559A (zh) | 2009-05-06 |
US7894684B2 (en) | 2011-02-22 |
EP2012527A4 (en) | 2012-05-23 |
US20110109765A1 (en) | 2011-05-12 |
CN101427559B (zh) | 2011-11-30 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP4191241B2 (ja) | 視覚処理装置、視覚処理方法、プログラム、表示装置および集積回路 | |
US8401324B2 (en) | Visual processing apparatus, visual processing method, program, recording medium, display device, and integrated circuit | |
EP3280138B1 (en) | Image processing apparatus, image projection apparatus, and image processing method | |
US7881549B2 (en) | Visual processing device, display device, visual processing method, program, and integrated circuit | |
EP2833317B1 (en) | Image display device and/or method therefor | |
US8368814B2 (en) | Visual processing device, display device, and integrated circuit for adjusting the contrast of an image | |
US8374430B2 (en) | Apparatus and method for feature-based dynamic contrast enhancement | |
JP4437150B2 (ja) | 視覚処理装置、表示装置、視覚処理方法、プログラムおよび集積回路 | |
WO2007094156A1 (ja) | 動画像再生装置および階調補正装置 | |
KR20090068355A (ko) | 윤곽보정방법, 화상처리장치 및 표시장치 | |
JP5410378B2 (ja) | 映像信号補正装置および映像信号補正プログラム | |
US20110115982A1 (en) | Video signal processing device and video display device | |
KR100739139B1 (ko) | 히스토그램 모델링을 이용한 영상의 대조비 개선 장치 | |
JP2008259097A (ja) | 映像信号処理回路および映像表示装置 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
WWE | Wipo information: entry into national phase |
Ref document number: 2008502175 Country of ref document: JP |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 07739886 Country of ref document: EP Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 12297403 Country of ref document: US |
|
WWE | Wipo information: entry into national phase |
Ref document number: 200780014221.2 Country of ref document: CN |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
REEP | Request for entry into the european phase |
Ref document number: 2007739886 Country of ref document: EP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2007739886 Country of ref document: EP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 1020087027977 Country of ref document: KR |