CN101632309A - Image processing device and image processing method - Google Patents
Image processing device and image processing method Download PDFInfo
- Publication number
- CN101632309A CN101632309A CN200880002562A CN200880002562A CN101632309A CN 101632309 A CN101632309 A CN 101632309A CN 200880002562 A CN200880002562 A CN 200880002562A CN 200880002562 A CN200880002562 A CN 200880002562A CN 101632309 A CN101632309 A CN 101632309A
- Authority
- CN
- China
- Prior art keywords
- data
- image
- chromatism
- brightness data
- original image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B5/00—Adjustment of optical system relative to image or object surface other than for focusing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N2101/00—Still video cameras
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Image Processing (AREA)
- Color Television Image Signal Generators (AREA)
- Studio Devices (AREA)
Abstract
Provided is an image processing device using a circuit processing method for actually recovering an image without increasing the device size. In the device, comparison image luminance data YI0' is generated from arbitrary image luminance data YI0 by using change factor data G as a factor of an image change. After this, comparison is made between original image luminance data YImg' to be processed and comparison image luminance data YI0' and the obtained differential luminance data Ydelta is distributed to arbitrary image data YI0 according to the change factor data G so as to generate recovered image luminance data YI0+n. After this, the same process is repeated by using the recovered image luminance data YI0+n instead of the arbitrary image luminance data YI0, thereby generating the luminance data on a basic image before the change (degradation) or the recovered image luminance data YI0+n similar to the luminance data on the basic image.
Description
Technical field
The present invention relates to image processing apparatus and image processing method.
Background technology
As everyone knows, under prior art, utilize the photographic images of shootings such as camera that the situation of image deterioration can take place.As the main cause of this image deterioration, rocking when exist taking, the various aberrations of optical system, the deflection of camera lens etc.
Rocking when taking, the method for the known camera lens that the regulation in the travelling shot camera lens is arranged and the method for carrying out processing of circuit in order to correct.For example, as the method for moving lens, known having by detecting when taking rocked, and the camera lens of regulation is moved corresponding to this detected rocking, thus the method for correcting (with reference to patent documentation 1).
In addition, as the method for carrying out processing of circuit, known having utilizes angular acceleration transducer to detect the change of camera optical axis, the transfer function of the fringe when detected angular speed etc. is obtained expression and taken, and photographic images carried out the inverse transformation of obtained transfer function, thereby with the method (with reference to patent documentation 2) of image restoration.
Patent documentation 1: day disclosure communique, spy open flat 6-317824 number (with reference to specification digest)
Patent documentation 2: day disclosure communique, spy open flat 11-24122 number (with reference to specification digest)
Summary of the invention
Invent problem to be solved
Adopt the camera that rocks rectification of patent documentation 1 record, owing to need the configuration space of the hardware of driving camera lens such as motor to cause maximization.In addition, owing to need this hardware self or drive the drive circuit of this hardware, so cost increases.
In addition, though can solve the above problems a little, there is following such problem in the situation of rocking rectification of patent documentation 2 records.That is, setting up in theory though carry out image restoration by the inverse transformation of obtained transfer function, as practical problem, is difficult because following 2 reasons cause image restoration.
The first, the transfer function that obtains for noise or rock information error etc. very a little less than, these have change slightly, very big change just takes place in the value of transfer function.Therefore, the restored image by inverse transformation obtains differs greatly with the image of taking under the state that does not shake, and in fact can not utilize.Second, under the situation of the inverse transformation of having considered noise etc., also can adopt the singular value decomposition of separating by simultaneous equations etc. to calculate the method for separating, but the calculated value that is used for this reckoning has astronomical figure so big, that in fact can't answer is dangerous high.
As mentioned above, problem of the present invention is to provide a kind of maximization of preventing locking apparatus when restored image, simultaneously, is provided with the image processing apparatus and the image processing method of the processing of circuit method with actuality.
Solve the means of problem
In order to solve above-mentioned problem, image processing apparatus of the present invention, be provided with the handling part of handling coloured image, this handling part, from the original digital image data of data as the original image that becomes process object, isolate original image brightness data and original image chromatism data, and with original image brightness data and original image chromatism data respectively as the data of process object, for the original image brightness data, by carrying out the reprocessing of the same processing of repetition, the base image brightness data of the base image of the image before generation changes as original image, or with the base image brightness data approximate by the restored image brightness data after restoring, wherein, described same being treated to, utilization is as the variation essential factor data of the data of image change main cause, from as the arbitrary image brightness data of image brightness data arbitrarily, generation makes the movement images brightness data of the relatively usefulness after this arbitrary image brightness data changes, obtain difference brightness data as the data of the difference after original image brightness data and movement images brightness data are compared, generation according to the restored image brightness data of above-mentioned variation essential factor data allocations behind the arbitrary image brightness data, replaces the difference brightness data arbitrary image brightness data and uses the restored image brightness data; For the original image chromatism data, by carrying out the reprocessing of the same processing of repetition, the base image chromatism data of the base image of the image before generation changes as original image, or with the base image chromatism data approximate by the restored image chromatism data after restoring, wherein, described same being treated to, utilize and change the essential factor data, from as the arbitrary image chromatism data of pattern colour difference data arbitrarily, generation makes the movement images chromatism data of the relatively usefulness after this arbitrary image chromatism data changes, obtain difference chromatism data as the data of the difference after original image chromatism data and movement images chromatism data are compared, generation according to the restored image chromatism data of above-mentioned variation essential factor data allocations behind the arbitrary image chromatism data, replaces the difference chromatism data arbitrary image chromatism data and uses the restored image chromatism data.
Under the situation of such composing images processing unit, owing to only generate predetermined data by the essential factor information of utilizing image change, and generate and the brightness data of original image and restored image brightness data and the restored image chromatism data that chromatism data is similar to, therefore the increase on the hardware exists hardly, and device can not maximize.In addition, owing to be to make comparison brightness data and comparison colours difference data respectively from restored image brightness data and restored image chromatism data, and repeat the brightness data of the original image of these comparison brightness data and process object is compared such processing, or repeat chromatism data with the original image of comparison colours difference data and process object and compare such processing, and obtain and restored image brightness data and restored image chromatism data the therefore recovery processing operation that becomes a reality gradually as the image approximate before the variation on the basis of original image.Therefore, when handling, the recovery of image can form the image processing apparatus that is provided with processing of circuit method with actuality.
In addition, other invention is on the basis of foregoing invention, carry out restored image brightness data and restored image chromatism data synthetic, the base image data of formation base image or with the base image data approximate by the processing of the restored image data after restoring.
Under the situation of such composing images processing unit, can form the image processing apparatus that is provided with processing of circuit method with actuality.
In addition, other invention is on the basis of foregoing invention, and the original image chromatism data is formed two data about different colours, carries out reprocessing respectively for each data.
Under the situation of such composing images processing unit,, therefore can improve recovery accuracy because different colors is generated the restored image chromatism data respectively.
In addition, other invention is on the basis of foregoing invention, and the original image chromatism data is compressed processing, and the compressed image chromatism data after being compressed is carried out reprocessing and generates the restored image chromatism data.
Under the situation of such composing images processing unit, can seek to restore the high speed of processing.
In addition, other invention is on the basis of foregoing invention, and the boil down to of original image chromatism data is rejected processing with the interval that the data of original image chromatism data carry out rejecting at interval.
Under the situation of such composing images processing unit, can seek to restore the high speed of processing.
In addition, other invention is on the basis of foregoing invention, and the boil down to of pattern colour difference data with generating the processing of restored image chromatism data, is handled with the figure place of lacking than the processing figure place that generates the restored image brightness data.
Under the situation of such composing images processing unit, can seek to restore the high speed of processing.
In order to solve above-mentioned problem, image processing apparatus of the present invention, in the image processing method of handling coloured image, carrying out from original digital image data as the data of the original image that becomes process object, isolate after the step of original image brightness data and original image chromatism data, with original image brightness data and original image chromatism data respectively as the data of process object, for the original image brightness data, by carrying out the reprocessing of the same processing of repetition, the base image brightness data of the base image of the image before generation changes as original image, or with the base image brightness data approximate by the restored image brightness data after restoring, wherein, described same being treated to, carrying out the variation essential factor data of utilizing as the data of image change main cause, from as the arbitrary image brightness data of image brightness data arbitrarily, generation makes the step of the movement images brightness data of the relatively usefulness after this arbitrary image brightness data changes, obtain step as the difference brightness data of the data of the difference after original image brightness data and movement images brightness data are compared, and generate after the step of difference brightness data according to the restored image brightness data of above-mentioned variation essential factor data allocations behind the arbitrary image brightness data, replace the arbitrary image brightness data and use the restored image brightness data; For pattern colour difference image data, by carrying out the reprocessing of the same processing of repetition, the base image chromatism data of the base image of the image before generation changes as original image, or with the base image chromatism data approximate by the restored image chromatism data after restoring, wherein, described same being treated to, carrying out utilization variation essential factor data, from as the arbitrary image chromatism data of pattern colour difference data arbitrarily, generation makes the step of the movement images chromatism data of the relatively usefulness after this arbitrary image chromatism data changes, obtain step as the difference chromatism data of the data of the difference after original image chromatism data and movement images chromatism data are compared, and generate after the step of difference chromatism data according to the restored image chromatism data of above-mentioned variation essential factor data allocations behind the arbitrary image chromatism data, replace the arbitrary image chromatism data and use the restored image chromatism data.
Adopt under the situation of such image processing method, owing to only generate predetermined data by the essential factor information of utilizing image change, and generate and the brightness data of original image and restored image brightness data and the restored image chromatism data that chromatism data is similar to, therefore the increase on the hardware exists hardly, has adopted the device of this method can not maximize.In addition, owing to be to make comparison brightness data and comparison colours difference data respectively from restored image brightness data and restored image chromatism data, and repeat the brightness data of the original image of these comparison brightness data and process object is compared such processing, or repeat the chromatism data of the original image of comparison colours difference data and process object is compared such processing, and little by little obtain with the variation on basis that becomes original image before the restored image brightness data and the restored image chromatism data of image approximate, the therefore restoration processing method that becomes a reality.Therefore, when handling, the recovery of image can form image processing method with actuality.
The invention effect
Adopt words of the present invention, can be formed in the maximization that to prevent locking apparatus when restoring the image that deterioration has taken place, simultaneously, be provided with the image processing apparatus and the image processing method of processing of circuit method with actuality.
Description of drawings
Fig. 1 is the block diagram of the main composition of the image processing apparatus that relates to of expression the invention process form.
Fig. 2 is the stereoscopic figure of the summary of expression image processing apparatus shown in Figure 1, is the figure that is used to illustrate the allocation position of angular-rate sensor.
Fig. 3 is used to illustrate the processing method (handling procedure) that the handling part that utilizes image processing apparatus shown in Figure 1 carries out and is the process chart of basic concept.
Fig. 4 is the figure that is used to illustrate the notion of processing method shown in Figure 3.
Fig. 5 is to be that example specifically describes the figure that processing method shown in Figure 3 is used to rock, and is the table of the concentration of energy when representing not shake.
Fig. 6 is to be that example specifically describes the figure that processing method shown in Figure 3 is used to rock, and is the figure that the luminous energy of the relevant monochrome information when representing not shake distributes.
Fig. 7 is to be that example specifically describes the figure that processing method shown in Figure 3 is used to rock, and is the figure that the luminous energy energy of the relevant monochrome information of expression when having taken place to rock disperses.
Fig. 8 is to be that example specifically describes the figure that processing method shown in Figure 3 is used to rock, and is to be used to illustrate the figure that generates the situation of movement images brightness data from image brightness data arbitrarily.
Fig. 9 is to be that example specifically describes the figure that processing method shown in Figure 3 is used to rock, and is to be used to illustrate movement images brightness data and the brightness data that becomes the fuzzy original image of process object compared and generate the figure of the situation of difference brightness data.
Figure 10 is to be that example specifically describes the figure that processing method shown in Figure 3 is used to rock, and is to be used to illustrate by the difference brightness data being distributed and making an addition to the figure that image brightness data arbitrarily generate the situation of restored image brightness data.
Figure 11 is to be that example specifically describes the figure that processing method shown in Figure 3 is used to rock, be to be used to illustrate by the restored image brightness data that is generated generate new movement images brightness data, and these data and the brightness data that becomes the fuzzy original image of process object compared and generate the figure of the situation of difference brightness data.
Figure 12 is to be that example specifically describes the figure that processing method shown in Figure 3 is used to rock, and is to be used to illustrate that the difference brightness data with newly-generated distributes, and generates the figure of the situation of new restored image brightness data.
Symbol description
1 image processing apparatus
4 handling parts
Img ' original digital image data
YImg ' original image brightness data
UImg ', VImg ' original image chromatism data
G changes the essential factor data
YI
0The arbitrary image brightness data
YI
0' movement images brightness data
Y δ difference brightness data
YI
0+nThe restored image brightness data
YImg base image brightness data
UI
0, VI
0The arbitrary image chromatism data
UI
0', VI
0' movement images chromatism data
U δ, V δ difference chromatism data
UI
0+n, VI
0+nThe restored image chromatism data
UImg, VImg base image chromatism data
Embodiment
Below, with reference to accompanying drawing the image processing apparatus 1 that the present invention's first example relates to is described.In addition, this image processing apparatus 1 is as civilian, the so-called digital camera that uses CCD (Charge CoupledDevice) at shoot part, but, also can be used as at shoot part and use the monitoring camera, TV of the picture pick-up device of CCD etc. camera with other purposes such as camera usefulness, endoscope-use cameras, perhaps also go for microscope with, binoculars with so that for shooting etc. the image diagnosing system of nulcear magnetic resonance (NMR) etc., camera beyond instrument in.In addition, for image processing method, describe in the lump with image processing apparatus 1.
Shoot part 2 is to be provided with the part that the light that will pass through to have the photographic optical system of camera lens or camera lens is converted to the CCD or the CMOS picture pick-up devices such as (Complementary Metal Oxide Semiconductor) of the signal of telecommunication.This shoot part 2 generates and exports the color picture signal of R (red), G (green), B (indigo plant) three looks.Shoot part 2 can be to use one will be according to the stacked type that is arranged in the so-called one-board of the picture pick-up device on the shooting face of the filter that RGB distinguishes, or the photography light that will pass through photographic optical system utilize dichroic prism be separated into each coloured light of RGB three looks, each coloured light all is provided with in the type of so-called three-plate type of picture pick-up device, any one type (one-board/three-plate type).Control system portion 3 is parts of each one in control shoot part 2, handling part 4, recording portion 5, test section 6 and essential factor information storing section 7 etc., the image processing apparatus 1.
Handling part 4 is made of image processor, and is made of the such hardware of ASIC (Application SpecificIntegrated Circuit, application-specific integrated circuit (ASIC)).In this handling part 4, also there is the situation that becomes the image that generates following basis when relatively using the image brightness data (hereinafter referred to as " movement images brightness data ") of image or relatively using the pattern colour difference data (hereinafter referred to as " movement images chromatism data ") of image of preserving.Handling part 4 also can be a formation of utilizing software to handle, rather than constitutes as the such hardware of ASIC.Recording portion 5 is made of semiconductor memory, but also can adopt the magnetic recording means of hard drive etc. or use the optical recording means etc. of DVD etc.
Test section 6 is to be provided with the part of two angular-rate sensors of rotary speed that detection is X-axis, the Y-axis of vertical direction with respect to the Z axle as the optical axis of image processing apparatus 1 as shown in Figure 2.But, rocking when utilizing camera, also can take place to all directions of directions X, Y direction, Z direction move or around the rotation of Z axle, with respect to each change suffered what have the greatest impact is around the rotation of Y-axis with around the rotation of X-axis.These two kinds of changes only change a little, and the image of shooting just can be very fuzzy.Therefore, in this example, only dispose Fig. 2 around X-axis with around two angular-rate sensors of Y-axis.But, more perfect in order to expect, also can further add angular-rate sensor around the Z axle, perhaps additional detected is to the transducer that moves of directions X or Y direction.In addition, also can be angular acceleration transducer as the transducer that uses, rather than angular-rate sensor.
Essential factor information storing section 7 is preserved as the information of the variation essential factor that photographic images is changed and the known variation essential factor data judged before beginning to take.As the information of known variation essential factor, for example be aberration of optical system etc.In addition, in this example, preserve the information of the deflection of the aberration of optical system or camera lens in the essential factor information storing section 7, but when following fuzzy recovery of rocking, do not utilize these information.
Next, the summary to the processing method of the handling part 4 of the image processing apparatus 1 that constitutes as described above describes.
In handling part 4, at first from signal as separation YUV (a kind of colour coding method) the original digital image data Img ' of the captured image data that becomes process object.That is, from original digital image data Img ' separation as the original image brightness data YImg ' of the monochrome information of photographic images, as the original image chromatism data UImg ' of the colour difference information of the relevant blueness of photographic images and as the original image chromatism data VImg ' of relevant red colour difference information.After the treatment step that separates of being correlated with, respectively original image brightness data YImg ', original image chromatism data UImg ' and original image chromatism data VImg ' are carried out recovery processing shown in Figure 3.Fig. 3 is the flow chart that the processing of original image brightness data YImg ' (restore and handle) is described, but also carries out same recovery processing for original image chromatism data UImg ' and original image chromatism data VImg '.
In Fig. 3, " YI
0" be arbitrary image brightness data as the brightness data of arbitrary image, this arbitrary image brightness data YI
0Be stored in the recording portion of handling part 4 in advance." YI
0' " represent this arbitrary image brightness data YI
0The data of modified-image, be the image brightness data (hereinafter referred to as " movement images brightness data ") that are used for comparison." G " is the variation essential factor data that become the information (information of=deterioration essential factor (some transform)) of utilizing the detected variation essential factor of test section 6, is the data that are stored in the recording portion of handling part 4.In addition, original image brightness data YImg ' is the data of separating from captured image data.That is, be from because rocking when taking waited the brightness data that the variation that causes is wanted thereby the original digital image data Img ' (captured image data) that changes separates, this original image brightness data YImg ' is also owing to change and want thereby variation.
" Y δ " is as original image brightness data YImg ' and movement images brightness data YI
0' the difference brightness data of data of difference." k " is based on the distribution ratio that changes essential factor data G.
" YI
0+n" be according to changing the essential factor data allocations with difference brightness data Y δ in arbitrary image brightness data YI
0And newly-generated restored image brightness data." YImg " is the brightness data (hereinafter referred to as " base image brightness data ") about the view data (hereinafter referred to as " base image data ") of the image basis that becomes original digital image data Img ', that change preceding script.At this, the relation of YImg and YImg ' is represented with following formula (1).
YImg′＝YImg×G……(1)
" * " is the operator of expression superposition integral.
In addition, difference brightness data Y δ also can be the simple difference of respective pixel, still, and generally according to the difference that changes essential factor data G and difference is represented with following formula (2).
Yδ＝f(YImg′，YI
0，G)……(2)
The handling procedure of handling part 4 is at first from arbitrary image brightness data YI
0Prepare beginning (step S101) as primary data.Arbitrary image brightness data YI as this primary data
0, can use brightness data as the original digital image data Img ' of the data of photographic images, also can use the brightness data of such image such as complete black, complete white, full ash, chequered with black and white tartan in addition.In step S102, substitute YImg in the formula (1) and substitution arbitrary image brightness data YI
0, obtain this arbitrary image brightness data YI
0According to the movement images brightness data YI that changes after essential factor data G changes
0'.Then, with original image brightness data YImg ' and movement images brightness data YI
0' compare, calculate difference brightness data Y δ (step S103).
Next, judge that in step S104 this difference brightness data Y δ whether more than setting, if more than the setting, then generates new arbitrary image brightness data (=restored image brightness data) YI in step S105
0+nProcessing.That is, difference brightness data Y δ is allocated in arbitrary image brightness data YI according to changing essential factor data G
0, and generate restored image brightness data YI
0 + nThen, with restored image brightness data YI
0+nReplace the arbitrary image brightness data YI among the step S102
0, repeating step S102, S103, S104.
In step S104, in difference brightness data Y δ end process (step S106) during less than setting.Then, with the restored image brightness data YI on the time point of handling that is through with
0+nBe inferred as correct brightness data, promptly the brightness data of the base image data I mg of deterioration do not take place, and this brightness data is recorded in recording portion 5.In addition, also can in recording portion 5, write down arbitrary image brightness data YI in advance
0Or change essential factor data G, and be delivered to handling part 4 as required.
The words that the viewpoint of above processing method is summarized are as described below.That is, in this processing method, not that separating as inverse problem of processing gone to solve, but as obtaining the optimization problem of reasonably separating and solving.When solving, also be possible in theory as the record of patent documentation 2, but be difficult as realistic problem as inverse problem.
Solving as optimization problem, is prerequisite with following condition.
That is, (1) is defined as unique value with respect to the output of input.
(2) if output is identical, then input is also identical.
(3) in order to make output identical,, separate convergence gradually and make by when upgrading input, carrying out repeated treatments.
In other words, shown in Fig. 4 (A), (B), if can generate the movement images brightness data YI approximate with original image brightness data YImg '
0' (YI
0+n'), then become the arbitrary image brightness data YI of the basic data of this generation
0Or restored image brightness data YI
0+n, become with as the approximate data of the base image brightness data YImg on the basis of original image brightness data YImg '.
In addition, in this example, the angular velocity detection transducer just detects angular speed every 5 μ sec.In addition, become the value of the criterion of difference brightness data Y δ, under the situation that each data is represented with eight (0～255), in this example be " 6 ".That is, less than 6, just be 5 when following, end process.In addition, by the initial data of rocking that the angular velocity detection sensor goes out, when the calibration of transducer self is insufficient, be not corresponding with rocking of reality.Therefore, for corresponding, when transducer is not calibrated, must carry out the initial data that goes out by sensor be multiply by the rectification of regulation multiplying power with rocking of reality.
Next, according to Fig. 5, Fig. 6, Fig. 7, Fig. 8, Fig. 9, Figure 10, Figure 11 and Figure 12, the details of Fig. 3 and processing method shown in Figure 4 is described.
(the recovery algorithm that rocks)
When not shaking, in the time for exposure, concentrate on this pixel corresponding to the luminous energy of determined pixel.In addition, owing to rock when image processing apparatus 1 has taken place to flash, luminous energy is scattered in the time for exposure in the pixel of rocking in the time for exposure when taking.And then, owing to, just know the dispersing mode of the luminous energy in the time for exposure, therefore can make unambiguous image from fuzzy image if know rocking in the time for exposure.
Below, describe with horizontal one dimension for easy.Pixel is begun to be made as successively from a left side ..., n-1, n, n+1, n+2, n+3 ..., and note a certain pixel n.Because the luminous energy in the time for exposure does not concentrate on this pixel when shaking, so the concentration degree of luminous energy is " 1.0 ".This state representation is in Fig. 5.The luminous energy distribution table of relevant monochrome information of each pixel of this moment is shown in the table of Fig. 6.The data that this is shown in Figure 6 become the base image brightness data YImg that does not exist because of the relevant monochrome information of the base image data I mg that rocks the deterioration that causes.In addition, each data is with the data representation of eight (0～255).
Exist in time for exposure and rock, and be respectively the time of 50% in the time for exposure and shake in n number pixel, 30% time shakes in n+1 number pixel, and 20% time shakes in n+2 number pixel.The dispersing mode of luminous energy table is as shown in Figure 7 put down in writing.This becomes and changes essential factor data G.
Because rocking all is identical in all pixels, if therefore there is not the top to rock (vertically rocking), the situation of rocking table is as shown in Figure 8 put down in writing.Conduct among Fig. 8 " ideal image " and the expression data, be the base image brightness data YImg of base image data I mg, as " blurred picture " and the data of expression become the original image brightness data YImg ' of original digital image data Img ' as the image that is taken.Specifically, " 120 " of " n-3 " pixel for example, according to the distribution ratio of " 0.5 " " 0.3 " " 0.2 " of the relevant variation essential factor data G that rocks as the image change main cause, in the pixel of " n-3 ", disperse to disperse in the pixel of " 60 ", " n-2 " to disperse " 24 " in the pixel of " 36 ", " n-1 ".Similarly, as the data " 60 " of " n-2 " pixel, in " n-2 ", disperse to disperse among " 30 ", " n-1 " to disperse among " 18 ", " n " " 12 ".By this original image brightness data YImg ' and variation essential factor data G shown in Figure 7, calculate unambiguous photographic images.
As the arbitrary image brightness data YI shown in the step S101
0, can adopt data arbitrarily, when carrying out this explanation, use original image brightness data YImg '.That is, as YI
0=YImg ' and begin to handle." input " in the table of Fig. 9 is equivalent to arbitrary image brightness data YI
0Make variation essential factor data G act on this arbitrary image brightness data YI by step S102
0, be original image brightness data YImg '.That is arbitrary image data YI for example,
0" 60 " of " n-3 " pixel, in the pixel of " n-3 ", distribute respectively in the pixel of distributing " 18 ", " n-1 " in the pixel of " 30 ", " n-2 " and distribute " 12 ".Pixel to other is distributed similarly, generates conduct " output " and the movement images brightness data YI of expression
0'.Consequently, the difference brightness data Y δ of step S103 is shown in one hurdle, bottom of Fig. 9.
After this, judge the size of difference brightness data Y δ by step S104.Specifically, end process when the absolute value of all difference brightness data Y δ becomes less than 5 entirely still, because difference brightness data Y δ shown in Figure 9 does not meet this condition, therefore enters step S105.That is, use variation essential factor data G that difference brightness data Y δ is allocated in arbitrary image brightness data YI
0, generate the restored image brightness data YI that represents as " input next time " among Figure 10
0+nAt this moment, owing to be for the first time, therefore in Figure 10, be expressed as YI as n=1
0+1
The distribution of difference brightness data Y δ is, for example will on the data " 30 " of the pixel of " n-3 ", multiply by the pixel that is allocated in " n-3 " as " 15 " of 0.5 gained of himself (pixel of=" n-3 ") distribution ratio, in addition, be distributed in and multiply by on the data " 15 " of the pixel of " n-2 " as " 4.5 " that should result from distribution ratio 0.3 gained of this " n-2 " pixel, and then, be distributed in " 1.84 " of multiply by on the data " 9.2 " of the pixel of " n-1 " as distribution ratio 0.2 gained of the pixel that should result from this " n-1 ".The total amount that is allocated in the pixel of " n-3 " is " 21.34 ", should be worth and arbitrary image brightness data YI
0(at the original image brightness data YImg ' of this use as the brightness data of photographic images) addition generates restored image brightness data YI
0+1This restored image brightness data YI
0+1Be the data that are equivalent to " input next time " in the table of Figure 10.
As shown in figure 11, this restored image brightness data YI
0+1Become the data (=arbitrary image brightness data YI of the input picture of step S102
0), execution in step S102." input " in the table of Figure 11 is equivalent to restored image brightness data YI
0+1Then, to step S103 transition and obtain new difference brightness data Y δ.Judge the size of the difference brightness data Y δ that this is new by step S104,, new difference brightness data Y δ is allocated in last restored image brightness data YI by step S105 being setting when above
0+1, generate new restored image brightness data YI
0 + 2This restored image brightness data YI
0+2Be the data that are equivalent to " input next time " in the table of Figure 12.Then, by the execution of step S102, by restored image brightness data YI
0+2Generate the new image brightness data Y I that relatively uses
0+2'.Like this, after execution in step S102, S103, enter step S104, and advance or to step S106 transition to step S105 by the judgement among the step S104.Repeat such processing.
In this image processing apparatus 1, when handling, in step S104, can set any one party or both sides in the criterion value of number of processes and difference brightness data Y δ in advance.For example, as number of processes, can set 20 times, 50 inferior number of times arbitrarily.In addition, can will make the value of handling the difference brightness data Y δ stop be set at " 5 " in eight (0～255), the words that become 5 below finish processing, perhaps are set at " 0.5 ", and the words that become below 0.5 make the processing end.Can at random set this set point.Under the both sides' that imported number of processes and criterion value situation, when satisfying any one party, stop to handle.In addition, in the time can carrying out both sides' setting, serve as preferential with the criterion value, when the processing by stipulated number does not enter in the criterion value, also can again repeat the processing of stipulated number.
For original image chromatism data UImg ' and original image chromatism data VImg ', also carry out above-mentioned processing shown in Figure 3 respectively.At this moment, under the situation that original image chromatism data UImg ' is handled, shown in the theing contents are as follows shown in Figure 3 from step S101 to step S105.
At first, in step S101, replace arbitrary image brightness data YI
0And preparation arbitrary image chromatism data UI
0This arbitrary image chromatism data UI
0Can be stored in the recording portion of handling part 4 in advance, at the original image chromatism data UImg ' of this utilization as the chromatism data of original digital image data Img '.
In step S102, make variation essential factor data G act on arbitrary image chromatism data UI
0, obtain movement images chromatism data UI
0'.Then, in step S103, with original image chromatism data UImg ' and movement images chromatism data UI
0' compare, calculate difference chromatism data U δ.
Judge that in step S104 difference chromatism data U δ whether more than setting, if more than the setting, then generates new arbitrary image chromatism data (=restored image chromatism data) UI in step S105
0+1Processing.Then, with restored image chromatism data UI
0+1As the arbitrary image chromatism data UI among the step S102
0, repeating step 102, step 103, step 104.
And, in step S104, in difference chromatism data U δ end process (S106) during less than setting.Will be at the restored image chromatism data UI on the time point that this processing finishes
0+n' be inferred as correct chromatism data, the i.e. data of the colour difference information of the relevant blueness of the base image data I mg of deterioration not, and with this restored image chromatism data UI
0+n' be recorded in recording portion 5.
Then, illustrate original image chromatism data VImg ' is carried out the situation of step S101 shown in Figure 3 to the processing of step S105.
At first, in step S101, replace arbitrary image brightness data YI
0And preparation arbitrary image chromatism data VI
0This arbitrary image chromatism data VI
0Also can be stored in the recording portion of handling part 4 in advance, at the original image chromatism data VImg ' of this utilization as the chromatism data of original digital image data Img '.
In step S102, make variation essential factor data G act on arbitrary image chromatism data VI
0, obtain movement images chromatism data VI
0'.Then, in step S103, with original image chromatism data VImg ' and movement images data VI
0' compare, calculate difference chromatism data V δ.
Judge that in step S104 difference chromatism data V δ whether more than setting, if more than the setting, then generates new arbitrary image chromatism data (=restored image chromatism data) VI in step S105
0+1Processing.Then, with restored image chromatism data VI
0+1As the arbitrary image chromatism data VI among the step S102
0, repeating step 102, step 103, step 104.
And, in step S104, in difference chromatism data V δ end process (S106) during less than setting.Will be at the restored image chromatism data VI on the time point that this processing finishes
0+n' be inferred as correct chromatism data, the i.e. data of the colour difference information of the relevant redness of the base image data I mg of deterioration not, and with this restored image chromatism data VI
0+n' be recorded in recording portion 5.
In addition, the processing of the variation of processing shown in Figure 3 or the original image brightness data that describes with reference to Fig. 4～Figure 12 can intactly be applicable to the processing of original image chromatism data UImg ' and original image chromatism data VImg '.
By being obtained and be recorded in the restored image brightness data YI of recording portion 5 as described above
0+n', restored image chromatism data UI
0+n' and restored image chromatism data VI
0+n' be converted to the signal of RGB and synthesize, and generate the fuzzy restored image data I that is eliminated or roughly is eliminated
0+n'.Then, with this restored image data I
0+n' be inferred as base image data I mg, be shown in the display part of not shown display etc. or be recorded in recording portion 5.
But the signal of YUV (that is, original image brightness data YImg ', original image chromatism data UImg ' and original image chromatism data VImg ') from the separation of original digital image data Img ', is for example undertaken by following formula.
YImg′＝0.29891×R+0.58661×G+0.11448×B…?(3)
UImg′＝-0.16974×R-0.33126×G+0.50000×B…(4)
VImg′＝0.50000×R-0.41869×G+0.08131×B…?(5)
At this, R, G, B are the data of light energy (brightness) of color component of relevant R (red), G (green), the B (indigo plant) of original digital image data Img '.Then, the restored image brightness data YI that will be restored by the processing of above-mentioned Fig. 3
0+n', restored image chromatism data UI
0+n' and restored image brightness data VI
0+n', for example be converted to the signal of RGB by following formula.
R＝YI
0+n′+1.40200×VI
0+n′…(6)
G＝YI
0+n′-0.34414×UI
0+n′-0.71414×VI
0+n′…(7)
B＝YI
0+n′+1.77200×UI
0+n′…(8)
Then, synthesize, obtain restored image I by the signal that will utilize the RGB that above-mentioned formula obtains
0+n'.In addition, above-mentioned formula (3) to (8) is an illustration, also can adopt other change type.
At this, as from rgb signal to the formula (4), (5) of the change type of " UImg ' " and " VImg ' " conversion, have the project of carrying out subtraction.Therefore, have " UImg ' ", " VImg ' " become the situation of negative value.Under this situation, be set at 0～255 o'clock with eight, obstacle appears in the processing of Fig. 3.Therefore, by eight value is set at-128～127, even " UImg ' ", " VImg ' " becomes negative value also can be corresponding.In addition, in the recovery of original image chromatism data UImg ', original image chromatism data VImg ' is handled, for " UI midway in reprocessing
0 + n' " or " VI
0+n' " exceed the situation of-128～127 scope, will exceed the part conduct-128 of minus value side (negative (minus) side) and handle, on the contrary, will exceed on the occasion of the part of side (positive number (plus) side) and handle as 127.In addition, for " YI
0+n' ", when the value that surpasses 255 is restored, also be limited to 255 processing.By such processing, can prevent to be implemented abnormity processing or be restored is strange color.
In addition, in formula (6), (7), (8), according to " UI
0+n' ", " VI
0+n' " value and have the situation that on the calculating formula value of RGB becomes negative value, but in fact the value of the RGB situation that becomes negative value is non-existent.At this moment, for the part that exceeds 0～255 scope, also be will exceed the part of minus value side (negative side) correct be value after 0 as the value of RGB, on the contrary, will exceed on the occasion of the part of side (positive number side) and correct value after being 255, and handle with this RGB as the value of RGB.Perhaps, and then through type (3), (4), (5) are calculated " YImg ' ", " UImg ' ", " VImg ' " by the value of the RGB after correcting, carry out recovery shown in Figure 3 according to these " YImg ' ", " UImg ' ", " VImg ' " and handle, and RGB is calculated in through type (6), (7), (8) once more.Then, also can repeat the value of RGB rectification, based on this handled by the calculating of " YImg ' " of the rgb value after correcting, " UImg ' ", " VImg ' ", recovery shown in Figure 3 and ensuing RGB calculate such processing, until the value of RGB become on the occasion of till.
But people's eyes are for the sensitivity of change color, and it is low to compare the sensitivity that changes for brightness.That is, see the sensation of the people behind the captured image, compare with the sensitivity that changes for brightness, blunt for the sensitivity of change color.Therefore, even have the amount of information that reduces about aberration, the situation that people's vision also can't be distinguished.Therefore, by reaching original image chromatism data VImg ' for original image chromatism data UImg ' as the data relevant with aberration, compressing to handle reduces data volume, and carry out above-mentioned recovery and handle being compressed original image chromatism data UImg ' after the processing and original image chromatism data VImg ', and can accelerate to restore the processing speed of processing.In addition, owing to few, therefore can reduce the recording capacity of the recording portion of recording portion 5 or handling part 4 by compressing the deal with data quantitative change.According to the data after such compression and by the restored image chromatism data UI after the recovery processing
0+n' and restored image brightness data VI
0+n', become the low data of recovery accuracy.
But, for the original image brightness data YImg ' relevant with brightness to people's eyes sensitivity, unreal exert pressure to contract to handle just restore processing.That is restored image data I,
0+n' in the composition about brightness restored accurately.Therefore, according to the restored image data I
0+n' and the image that is shown in people's eyes, can be familiar with as the image that is restored well.
In addition, method as compression, except with respect to original digital image data brightness data YImg ' is handled with eight, original image chromatism data UImg ' is reached original image chromatism data VImg ' with outside six methods of handling figure place reduction such, that make data and handling, also exist processed pixels is carried out the method that (for example, making processed pixels every or every two) rejected at the interval.Processed pixels having been carried out under the situation about rejecting at interval, after being converted to the signal of RGB, utilize processed pixel to replenish the signal of the RGB of not processed pixel.
In addition, in step S104, difference brightness data Y δ and difference chromatism data U δ, V δ are set with under the situation of criterion value, recovery for original image chromatism data UImg ' and original image chromatism data VImg ' is handled, also can be by constituting, even comparing for the criterion value of difference brightness data Y δ for the criterion value of difference chromatism data U δ, V δ is the big value of data of difference, also make and restore processing end (step S106), restore the processing time of handling and seek to shorten.About original image chromatism data UImg ' and original image chromatism data VImg ', owing to be the data relevant with aberration, even without as original image brightness data YImg ', restoring accurately, according to the restored image data I
0+n' and the image of demonstration also can be familiar with as the image that is restored well in people's eyes.Therefore, for example constitute in the above description at difference brightness data Y δ and become end process (step S106) under the situation of less than 5, but the recovery for original image chromatism data UImg ' and original image chromatism data VImg ' is handled, also can become end process (step S106) under the situation of less than 10, and seek the short timeization that the recovery of original image chromatism data UImg ' and original image chromatism data VImg ' is handled by constituting at difference chromatism data U δ, V δ.
In addition, in step S104, set under the situation of number of processes in advance, with respect to original image brightness data YImg ' for example is set at 20 times as number of processes, recovery for original image chromatism data UImg ' and original image chromatism data VImg ' is handled, and also can be set at ten times as number of processes.By such formation, can seek the short timeization that the recovery of original image chromatism data UImg ' and original image chromatism data VImg ' is handled, and then, can shorten time of the recovery processing of original digital image data Img '.In addition, can make also that to return number for the reprocessing of two original image chromatism data UImg ', VImg ' different.
In the explanation of example discussed above, utilize the information be stored in essential factor information storing section 7, but also can use the data of the deflection etc. of known variation essential factor, for example optical aberration or the camera lens that are stored in essential factor information storing section 7.Under this situation, for example in the processing method of example formerly (Fig. 3), make up and change essential factor with the information of the information of will rock and optical aberration and obtain and be treated to good as one, but, utilize the rectification of the information of optical aberration after also can finishing in the processing that the information that utilization is rocked is carried out.In addition, also this essential factor information storing section 7 can be set, and only the dynamic essential factor when taking, for example rock and image is corrected or restored.
More than the related image processing apparatus 1 of example of the present invention is illustrated, but only otherwise it also is possible breaking away from that the various changes of purport of the present invention implement.For example, the processing that utilizes handling part 4 to carry out is made of software, but also can utilize the hardware of being made up of the parts of bearing part processing respectively to constitute.
In addition, except that photographic images, also can be that this photographic images is carried out complementary color or Fourier transform etc., implemented the image of processing as the original image that becomes process object.And then, use view data as a comparison, except that using the data that change essential factor data G generation, also can be used as using the data that change essential factor data G and generate to apply complementary color or carried out the data after the Fourier transform.In addition,, remove owing to rocking the data (information) of the main cause of the image deterioration that causes as changing the essential factor data, also can be for including the information that only makes image change or making the data of the information that image improves on the contrary with deterioration.
In addition, each above-mentioned processing method also can be by sequencing.In addition, also can will be deposited in storage medium by the processing method of sequencing, for example CD, DVD, USB storage, and can read by computer.Under this situation, image processing apparatus 1 has the means of reading in of reading in the program in this storage medium.And then, also can download as required and use being deposited in image processing apparatus 1 external server by the processing method of sequencing.Under this situation, image processing apparatus 1 has the means of communication of downloading the program in this storage medium.
Claims (7)
1. an image processing apparatus is provided with the handling part of handling coloured image, it is characterized in that, and described handling part,
From the original digital image data of data as the original image that becomes process object, isolate original image brightness data and original image chromatism data,
And with described original image brightness data and described original image chromatism data respectively as the data of process object,
For described original image brightness data, by carrying out the reprocessing of the same processing of repetition, the base image brightness data of the base image of the image before generation changes as described original image or with the base image brightness data approximate by the restored image brightness data after restoring, wherein, described same being treated to
Utilization is as the variation essential factor data of the data of image change main cause, from as the arbitrary image brightness data of image brightness data arbitrarily, generates the movement images brightness data that makes the relatively usefulness after this arbitrary image brightness data changes,
Obtain difference brightness data as the data of the difference after described original image brightness data and described movement images brightness data are compared,
Generation with described difference brightness data according to the restored image brightness data of described variation essential factor data allocations behind described arbitrary image brightness data,
Replace described arbitrary image brightness data and use described restored image brightness data;
For described original image chromatism data, by carrying out the reprocessing of the same processing of repetition, the base image chromatism data of the base image of the image before generation changes as described original image or with the base image chromatism data approximate by the restored image chromatism data after restoring, wherein, described same being treated to
Utilize described variation essential factor data,, generate the movement images chromatism data that makes the relatively usefulness after this arbitrary image chromatism data changes from as the arbitrary image chromatism data of pattern colour difference data arbitrarily,
Obtain difference chromatism data as the data of the difference after described original image chromatism data and described movement images chromatism data are compared,
Generation with described difference chromatism data according to the restored image chromatism data of described variation essential factor data allocations behind described arbitrary image chromatism data,
Replace described arbitrary image chromatism data and use described restored image chromatism data.
2. image processing apparatus as claimed in claim 1 is characterized in that,
Carry out described restored image brightness data and described restored image chromatism data synthetic, generate described base image the base image data or with the base image data approximate by the processing of the restored image data after restoring.
3. image processing apparatus as claimed in claim 1 or 2 is characterized in that,
Described original image chromatism data is formed two, two described original image chromatism datas are carried out described reprocessing respectively.
4. as any described image processing apparatus in the claim 1～3, it is characterized in that,
Described original image chromatism data is compressed processing, and the compressed image chromatism data after being compressed is carried out described reprocessing, generate described restored image chromatism data.
5. image processing apparatus as claimed in claim 4 is characterized in that,
The compression of described original image chromatism data is the interval that the data of described original image chromatism data carry out rejecting at interval to be rejected handle.
6. image processing apparatus as claimed in claim 4 is characterized in that,
The compression of described pattern colour difference data is to generate the processing of described restored image chromatism data, to handle with the figure place of lacking than the processing figure place that generates described restored image brightness data.
7. an image processing method is handled coloured image, it is characterized in that,
Carrying out from original digital image data as the data of the original image that becomes process object, isolate after the step of original image brightness data and original image chromatism data,
With described original image brightness data and described original image chromatism data respectively as the data of process object,
For described original image brightness data, by carrying out the reprocessing of the same processing of repetition, the base image brightness data of the base image of the image before generation changes as described original image or with the base image brightness data approximate by the restored image brightness data after restoring, wherein, described same being treated to carried out
Utilization is as the variation essential factor data of the data of image change main cause, from as the arbitrary image brightness data of image brightness data arbitrarily, generates the step of the movement images brightness data that makes the relatively usefulness after this arbitrary image brightness data changes,
Obtain step as the difference brightness data of the data of the difference after described original image brightness data and described movement images brightness data are compared,
And generate with the step of described difference brightness data, afterwards according to the restored image brightness data of described variation essential factor data allocations behind described arbitrary image brightness data
Replace described arbitrary image brightness data and use described restored image brightness data;
For described pattern colour difference image data, by carrying out the reprocessing of the same processing of repetition, the base image chromatism data of the base image of the image before generation changes as described original image or with the base image chromatism data approximate by the restored image chromatism data after restoring, wherein, described same being treated to carried out
Utilize described variation essential factor data,, generate the step of the movement images chromatism data that makes the relatively usefulness after this arbitrary image chromatism data changes from as the arbitrary image chromatism data of pattern colour difference data arbitrarily,
Obtain step as the difference chromatism data of the data of the difference after described original image chromatism data and described movement images chromatism data are compared,
And generate with the step of described difference chromatism data, afterwards according to the restored image chromatism data of described variation essential factor data allocations behind described arbitrary image chromatism data
Replace described arbitrary image chromatism data and use described restored image chromatism data.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2007012339 | 2007-01-23 | ||
| JP012339/2007 | 2007-01-23 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN101632309A true CN101632309A (en) | 2010-01-20 |
Family
ID=39644434
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN200880002562A Pending CN101632309A (en) | 2007-01-23 | 2008-01-22 | Image processing device and image processing method |
Country Status (3)
| Country | Link |
|---|---|
| JP (1) | JPWO2008090858A1 (en) |
| CN (1) | CN101632309A (en) |
| WO (1) | WO2008090858A1 (en) |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH11150682A (en) * | 1997-11-14 | 1999-06-02 | Canon Inc | Image processor, image processing method and storage medium |
| JP2006229392A (en) * | 2005-02-16 | 2006-08-31 | Olympus Imaging Corp | Imaging apparatus and image data display method |
| JP4519001B2 (en) * | 2005-05-30 | 2010-08-04 | 三洋電機株式会社 | Filter processing circuit |
| JP3895357B2 (en) * | 2005-06-21 | 2007-03-22 | 日東光学株式会社 | Signal processing device |
-
2008
- 2008-01-22 CN CN200880002562A patent/CN101632309A/en active Pending
- 2008-01-22 JP JP2008555057A patent/JPWO2008090858A1/en active Pending
- 2008-01-22 WO PCT/JP2008/050748 patent/WO2008090858A1/en active Application Filing
Also Published As
| Publication number | Publication date |
|---|---|
| WO2008090858A1 (en) | 2008-07-31 |
| JPWO2008090858A1 (en) | 2010-05-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR100957261B1 (en) | Image pickup device and chromatic aberration correction method | |
| CN100556082C (en) | The aberration emendation method of photographic images and device, image pickup method and filming apparatus | |
| CN102668537B (en) | Multocular image pickup apparatus and multocular image pickup method | |
| CN103563350A (en) | Image processing device, image processing method, and digital camera | |
| CN101488216A (en) | Image processing device and method, and image sensing apparatus | |
| WO2013080920A1 (en) | Image processing apparatus, image processing method, and image processing program | |
| EP1512123A2 (en) | System and method for electronic correction of optical anomalies | |
| CN103703755A (en) | Panoramic image generation method and imaging device | |
| CN102112918A (en) | Compound-eye imaging device | |
| CN108322650A (en) | Video capture method and apparatus, electronic equipment, computer readable storage medium | |
| JP2020144488A (en) | Image processing method, image processing device, program, image processing system, and method of producing trained model | |
| CN114757831A (en) | High-resolution video hyperspectral imaging method, device and medium based on intelligent space-spectrum fusion | |
| CN101198985B (en) | Image processing apparatus and image processing method | |
| CN115103168B (en) | Image generation method, device, electronic equipment and storage medium | |
| CN114359647A (en) | Image processing method and apparatus, training model generation method, and learning apparatus | |
| CN115578296A (en) | Stereo video processing method | |
| CN101375591A (en) | Image processing device | |
| CN101632309A (en) | Image processing device and image processing method | |
| US20070146515A1 (en) | Image processor | |
| CN100433799C (en) | Apparatus and method for camera shake correction and recording medium recording camera shake correcting program | |
| CN101305598B (en) | Image processing apparatus and method | |
| JP2008160547A (en) | Movement detection device and method, and imaging apparatus | |
| CN101310520B (en) | Image processing device and method | |
| CN102547161B (en) | Image processing apparatus, image processing method and electronic camera | |
| JP5269954B2 (en) | Imaging device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Open date: 20100120 |