CN101401417A - Signal processing apparatus - Google Patents
Signal processing apparatus Download PDFInfo
- Publication number
- CN101401417A CN101401417A CN200780008768.1A CN200780008768A CN101401417A CN 101401417 A CN101401417 A CN 101401417A CN 200780008768 A CN200780008768 A CN 200780008768A CN 101401417 A CN101401417 A CN 101401417A
- Authority
- CN
- China
- Prior art keywords
- mentioned
- data
- restored
- energy
- pixel
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000012545 processing Methods 0.000 title claims abstract description 182
- 238000000034 method Methods 0.000 claims abstract description 68
- 230000008569 process Effects 0.000 claims abstract description 21
- 238000012546 transfer Methods 0.000 claims description 60
- 230000006866 deterioration Effects 0.000 claims description 32
- 230000015572 biosynthetic process Effects 0.000 claims description 20
- 238000005755 formation reaction Methods 0.000 claims description 20
- 238000012958 reprocessing Methods 0.000 claims description 19
- 238000013459 approach Methods 0.000 claims description 12
- 230000004044 response Effects 0.000 claims description 5
- 230000008859 change Effects 0.000 abstract description 22
- 230000003252 repetitive effect Effects 0.000 abstract 4
- 230000015556 catabolic process Effects 0.000 abstract 1
- 238000006731 degradation reaction Methods 0.000 abstract 1
- 238000011084 recovery Methods 0.000 description 18
- 230000006870 function Effects 0.000 description 15
- 238000003672 processing method Methods 0.000 description 15
- 239000011435 rock Substances 0.000 description 15
- 239000006185 dispersion Substances 0.000 description 12
- 230000003287 optical effect Effects 0.000 description 9
- 238000012360 testing method Methods 0.000 description 8
- 230000004075 alteration Effects 0.000 description 5
- 238000010586 diagram Methods 0.000 description 5
- 230000009466 transformation Effects 0.000 description 5
- 230000008901 benefit Effects 0.000 description 3
- 238000001514 detection method Methods 0.000 description 3
- 238000012163 sequencing technique Methods 0.000 description 3
- 230000001133 acceleration Effects 0.000 description 2
- 239000012141 concentrate Substances 0.000 description 2
- 230000007812 deficiency Effects 0.000 description 2
- 239000000203 mixture Substances 0.000 description 2
- 238000005070 sampling Methods 0.000 description 2
- 230000001052 transient effect Effects 0.000 description 2
- 238000004891 communication Methods 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000008676 import Effects 0.000 description 1
- 230000010365 information processing Effects 0.000 description 1
- SYHGEUNFJIGTRX-UHFFFAOYSA-N methylenedioxypyrovalerone Chemical compound C=1C=C2OCOC2=CC=1C(=O)C(CCC)N1CCCC1 SYHGEUNFJIGTRX-UHFFFAOYSA-N 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000035945 sensitivity Effects 0.000 description 1
Images
Classifications
-
- G06T5/73—
Abstract
A signal processing apparatus wherein a changed signal, such as a degraded signal or the like, can be restored with realizability achieved without increasing the apparatus scale. The signal processing apparatus (1) has a processing part (4) that restores a source signal data, which is, for example, a signal before being changed, from an original signal data in which the change, such as degradation, has occurred (and which will be referred to as ''changed data'' hereinafter). There are provided a changed data area in which the changed data is stored and a restored data area in which the signal data as restored is stored each time the restoring process is done. The processing part performs a repetitive processing for obtaining the source signal. When the energy value of the residual data is less than zero during the repetitive processing, some of the energy having already moved to the restored data area is placed, by use of change factor information, back to the changed data area such that the energy value of the residual data becomes equal to or greater than zero. In this way, the repetitive processing is performed such that the data formed in the restored data area after completion of the repetitive processing will be used as the source signal data.
Description
Technical field
The present invention relates to signal processing apparatus.
Background technology
The situation of image deterioration takes place in take pictures regular meeting constantly of the well-known image processing apparatus that utilizes camera etc. under prior art.As the main cause of image deterioration, there are rocking when taking pictures, the various aberrations of optical system, the deflection of camera lens etc.
Rocking when taking pictures in order to correct, the known Method and circuits processing method that moving lens is arranged.For example, as the method for moving lens, known has by detecting rocking of camera, and the camera lens of regulation is moved corresponding to this detected rocking, thus the method for correcting (with reference to patent documentation 1).In addition, as the processing of circuit method, known have a change that utilizes angular acceleration transducer to detect the camera optical axis, the transfer function of the fringe when obtaining expression and take pictures by detected angular speed etc., and photographic images carried out the inverse transformation of obtained transfer function, thereby with the method (with reference to patent documentation 2) of image restoration.
In addition, except that general photographic images, various signals such as sound, X-ray photograph, MIcrosope image, seismic waveform also are well-known owing to the situation of rocking or deterioration or variation take place other reasons.
Patent documentation 1: day disclosure communique, spy open flat 6-317824 number (with reference to specification digest)
Patent documentation 2: day disclosure communique, spy open flat 11-24122 number (with reference to specification digest)
Summary of the invention
Invent problem to be solved
Adopt the camera that rocks rectification of patent documentation 1 record, owing to need the configuration space of the hardware of driving camera lens such as motor to cause maximization.In addition, owing to need this hardware self or drive the drive circuit of this hardware, so cost increases.In addition, under the situation of rocking rectification of patent documentation 2 records,, there is following problem though can address the above problem a little.That is, setting up though carry out image restoration by the inverse transformation of obtained transfer function in theory, as practical problem, is difficult because following two reasons cause image restoration.
The first, obtained transfer function for noise or rock information error etc. very a little less than, these have change slightly, very big change just takes place in transfer function values.Therefore, the correcting image by inverse transformation obtains differs greatly with the image of taking under the state that does not shake, and in fact can not utilize.Second, under the situation of the inverse transformation of having considered noise etc., also can adopt to decompose to wait and calculate the method for separating, still by the singular value of separating (particular value) of simultaneous equations, the calculated value that is used for this reckoning has astronomical figure so big, and that in fact can't answer is dangerous high.
The problems referred to above that produce in the image also come across in the general various data, carry out the recovery of signal by the inverse transformation of transfer function, difficulty that yes when the transfer function that obtains is incorrect, even when correct also inconvenient situation.And, be under the situation of object with the nature, it is impossible obtaining very correct transfer function.
As mentioned above, problem of the present invention is to provide a kind of maximization of preventing locking apparatus when release signal, simultaneously, is provided with the signal processing apparatus of the processing of circuit mode with actuality.
Solve the means of problem
In order to solve above-mentioned problem, signal processing apparatus of the present invention, be provided with handling part, this handling part by the data that the original signal that deterioration etc. changes has taken place (below, be called delta data) data of the signal before restore changing or the approximate signal of the signal that should obtain originally or these signals (below, be called the basis signal data); Wherein, be provided with the delta data zone of storage change data and when restore handling each time, store the restored data zone of these data of being restored the signal of processing (below, be called restored data); What handling part carried out is treated to, utilization becomes the variation essential factor information data that changes main cause, make the energy of delta data generate restored data from the delta data zone to the restored data zone-transfer, will be by this transfer the reprocessing that is replaced as delta data and carries out the same processing of repetition of the remaining data in residual delta data zone; In process repeats under less than zero the situation of the energy value of remaining data, change essential factor information and make a part be back to the delta data zone utilizing so that the energy value of remaining data becomes the processing more than zero to the energy of restored data zone-transfer, carry out reprocessing simultaneously, and the data that will be formed at the restored data zone of reprocessing when finishing are as the basis signal data.
Adopt the words of this invention, owing to be changed to prerequisite according to changing the essential factor information data to delta data with the basis signal data, therefore the variation essential factor information data that becomes same filter (filter) by utilization makes the energy of delta data be transferred to the restored data zone, and the basis signal data are positively restored as restored data in the restored data zone.In addition, owing to can avoid energy value less than zero situation such, that can not take place in theory of the remaining data as a result that shifts as energy, the recovery accuracy of restored data is improved.At this, be stored in the delta data in delta data zone, also can be for delta data having been carried out under the constant situation of the energy state that keep to constitute delta data the data (following identical) of processing etc.In addition, be stored in the restored data in restored data zone, also can be for restored data having been carried out under the constant situation of the energy state that keep to constitute restored data the data (following identical) of processing etc.And then, so-called " transfer " also comprises making situation that energy value moves to restored data zone from the delta data zone and remove this energy from the delta data zone and regenerate the situation (following identical) of this energy in the restored data zone as the meaning of word.And then delta data zone and restored data zone comprise both sides' (following identical) in the zone of the zone of temporary transient formation or permanent formation.
Other inventions under less than zero the situation of energy value of remaining data, make its value become zero above processing on the basis of foregoing invention.The energy value of remaining data becomes zero, just can think that the recovery accuracy by the restored data of delta data recovery becomes very good.
Other inventions are on the basis of foregoing invention, when reprocessing, carry out when this is repeated each time to the energy of restored data zone-transfer and the processing that has been stored in the restored data addition in restored data zone, the energy value of exercising remaining data of going forward side by side approaches zero processing in zero above scope.Remaining data approaches zero in the scope more than zero, the major part of the energy in delta data zone is to the restored data zone-transfer, so restored data approaches the basis signal data.
In order to solve above-mentioned problem, other signal processing apparatus of the present invention, be provided with the handling part that restores the basis signal data of a plurality of key elements formations from the delta data of a plurality of key elements formations, wherein, be provided with the delta data zone of storage change data and when restore handling each time, store the restored data zone of these data of being restored the signal of processing (below, be called restored data); What handling part carried out is treated to, utilization becomes the center-of-gravity value of the response characteristics function that the variation essential factor information data that changes main cause had, make key element energy in the key element of delta data from the delta data zone to the restored data zone-transfer, and utilize variation essential factor information data to remove the key element energy of the key element energy that is equivalent to be transferred from the delta data zone, in addition, also carry out this processing successively for other key elements to a key element, thereby generate restored data in the restored data zone, will be by removing the remaining data in residual delta data zone be replaced as delta data and each key element repeated same processing, carry out when this is repeated each time key element energy and restored data addition to the restored data zone-transfer, thereby generate the processing of new restored data; In these a series of processing procedures, under less than zero the situation of any key element energy value in remaining data, utilize and change essential factor information and make a part be back to the delta data zone so that less than zero key element energy value becomes the processing more than zero to the key element energy of restored data zone-transfer, carry out a series of processing simultaneously, make remaining data in the scope more than zero, approach zero processing, and the restored data in the restored data zone will be formed at the processing end time is as the basis signal data.
Adopt the words of this invention, because the data with basis signal are changed to prerequisite according to changing the essential factor information data to delta data, therefore by utilizing the inverse of center-of-gravity value as the response characteristics function of the variation essential factor information data that the becomes same filter value of concentrated part (energy), make the major part of the energy of delta data be transferred to the restored data zone, and utilize variation essential factor information data to remove the key element energy that is equivalent to shift energy from the delta data zone, thereby can make remaining data energy value (below, be called dump energy) approach zero, the basis signal data are positively restored as restored data in the restored data zone.In addition, owing to can avoid constituting energy value less than zero situation such, that can not take place in theory of any key element of remaining data, the recovery accuracy of restored data is improved as the result that energy shifts.The response characteristics function comprises that function is replied in pulse (impulse) and function etc. is replied by unit (unit).And under with the situation of signal data as view data, the pulse reply function becomes a transform.
The signal processing apparatus that other inventions relate to is on the basis of foregoing invention, and handling part is when generating restored data, and the energy value of remaining data is that the setting of zero above scope is following or just stop processing less than the words of setting.Adopt under the situation of this formation, also do not stop to handle, therefore can prevent long-timeization of handling even dump energy does not become " 0 ".In addition, owing to be set at below the setting, therefore approximate restored data approaches to become the basis signal data delta data basis, that change preceding (before the deterioration etc.) more.And then, having under the situation of noise etc., often in fact to become the situation of " 0 " be impossible take place to dump energy, even but also can unrestrictedly not repeat under these circumstances to handle.
The signal processing apparatus that other inventions relate to is on the basis of foregoing invention, and handling part is when generating restored data, and the words that the number of times of generation restored data reaches stipulated number just stop to handle.Adopt under the situation of this formation, whether dump energy becomes " 0 " all stops to handle, and therefore can prevent long-timeization of handling.In addition, continue to stipulated number owing to make to handle, therefore approximate restored data more approaches to become the basis signal data before such as generation deterioration on delta data basis.And then, having under the situation of noise etc., the situation that dump energy does not become " 0 " taking place in fact easily, still,, therefore can unrestrictedly not repeat to handle even finish under these circumstances with stipulated number yet.
The signal processing apparatus that other inventions relate to is on the basis of foregoing invention, handling part is when generating restored data, the setting that energy value when the number of times that generates restored data reaches stipulated number, remaining data is zero above scope is following or stop processing during less than setting, surpassing setting or being setting when above, carry out the reprocessing of stipulated number once more.In this invention, owing to the number of times that will handle and dump energy combination are handled, therefore, and only number of processes is increased restriction or the situation that dump energy limits is compared, can become the processing that can keep the balance of good and processing time of recovery accuracy between short.
In order to solve above-mentioned problem, other signal processing apparatus of the present invention, be provided with the handling part that restores the basis signal data of a plurality of key elements formations from the delta data of a plurality of key elements formations, wherein, be provided with the delta data zone of storage change data and in each restored data zone of storing these data of being restored the signal of processing (below, be called restored data) when handling of restoring; What handling part carried out is treated to, utilization become energy in the key element that the variation essential factor information data that changes main cause makes delta data from the delta data zone to the restored data zone-transfer, and utilize and change the essential factor information data and remove the energy that is equivalent to shift energy from the delta data zone, in addition, also carry out processing successively for other all key elements, thereby generate restored data in the restored data zone to a key element; During below the value of the remaining data in the delta data zone residual by this transfer is the setting of zero above scope or less than setting, stop processing, and restored data is handled as the basis signal data; In the value of remaining data greater than setting or be that setting is when above, remaining data is replaced as delta data and repeats same processing, thus the processing that generates new restored data to the key element energy and the restored data addition of restored data zone-transfer when carrying out with this each repetition; When any key element energy value deficiency in remaining data is zero, utilize and change essential factor information and make a part be back to the delta data zone so that less than zero the key element energy value of remaining data becomes the processing more than zero to the key element energy of restored data zone-transfer, simultaneously, carry out the comparison of remaining data amount and setting.
Adopt the words of this invention, because the data with basis signal are changed to prerequisite according to changing the essential factor information data to delta data, therefore the variation essential factor information data that becomes same filter by utilization can be transferred to the energy of delta data the restored data zone, and the basis signal data are positively restored in the restored data zone.In addition, owing to can avoid constituting energy value less than zero situation such, that can not take place in theory of any key element of remaining data, the recovery accuracy of restored data is improved as the result that energy shifts.In addition, since utilize to change the essential factor information enable from the delta data zone to the restored data zone-transfer, only the value of the dump energy in each key element in delta data zone surpasses setting or is that setting is when above, remaining data is replaced as delta data and repeats same processing, therefore can promptly restore processing.And then, restore processing from the delta data zone to the restored data zone-transfer by making energy, therefore almost there is not the increase on the hardware, device can not maximize.Therefore, when release signal, can form the signal processing apparatus that is provided with processing of circuit mode with actuality.
The signal processing apparatus that other inventions relate to is on the basis of foregoing invention, and handling part is when generating restored data, and the words that the number of times of generation restored data reaches stipulated number just stop to handle.Adopt under the situation of this formation, all stop to handle, therefore can prevent long-timeization of handling because whether dump energy becomes " 0 ".In addition, continue to stipulated number owing to make to handle, so restored data more approaches the basis signal data.And then, having under the situation of noise etc., the situation that dump energy does not become " 0 " takes place in fact easily, can unrestrictedly repeat under these circumstances to handle, but adopt this formation, such problem can not take place.
The signal processing apparatus that other inventions relate to is on the basis of foregoing invention, and when generating restored data, one or more in maximum, mean value or the total value of the remaining data value that has respectively for each key element carry out the comparison with setting.Adopt under the situation of this formation,, therefore can further improve the degree of approximation of restored data and basis signal data owing to can make the dump energy in each key element that constitutes delta data approach zero.
The signal processing apparatus that other inventions relate to is on the basis of foregoing invention, return processing, when one or many is carried out in the generation of restored data, become with any key element energy value that the key element energy to the restored data zone-transfer is that object carries out before less than that time of zero at remaining data.Adopt under the situation of this formation,, the recovery accuracy of image is improved owing to can avoid energy value less than zero situation such, that can not take place in theory in any key element of the remaining data as a result that shifts as energy.
The signal processing apparatus that other inventions relate on the basis of foregoing invention, with signal data as view data.Thus, even owing to image deterioration has taken place rocking of camera, also can restore the approximate image (below, be called base image) of image before changing or the image that should be taken originally or these images from the original image that deterioration etc. has taken place.
The effect of invention
Adopt words of the present invention, can be provided at and to prevent the maximization of locking apparatus when restoring the signal that variations such as deterioration have taken place, have a signal processing apparatus of actuality simultaneously.
Description of drawings
Fig. 1 is the block diagram of the main composition of the signal processing apparatus that relates to of expression embodiment of the present invention.
Fig. 2 is the stereoscopic figure of the summary of expression signal processing apparatus shown in Figure 1, is the figure that is used to illustrate the allocation position of angular-rate sensor.
Fig. 3 is the process chart that is used to illustrate the handling part handling procedure that carry out, that image restoration processing method (reprocessing) relates to that utilizes signal processing apparatus shown in Figure 1.
Fig. 4 is the figure that is used to illustrate the notion of the processing method that the handling part that utilizes signal processing apparatus shown in Figure 1 carries out.
Fig. 5 is to be that example specifically describes the figure that processing method shown in Figure 3 is used to rock, and is the table of concentrating of the pixel energy when representing not shake.
Fig. 6 is to be that example specifically describes the figure that processing method shown in Figure 3 is used to rock, and is the schematic diagram of the view data when not shaking.
Fig. 7 is to be that example specifically describes the figure that processing method shown in Figure 3 is used to rock, and is the schematic diagram of the dispersion of the pixel energy when shaking.
Fig. 8 is the figure that is used to illustrate an example of the situation of rocking when pixel energy shown in Figure 7 has taken place disperses.
Fig. 9 is with because of rocking the figure that the view data shown in Figure 8 that deterioration takes place is an example explanation processing method shown in Figure 3.
Figure 10 is the concept map of the viewpoint of the method that recomputates in the transfer processing of expression when carrying out processing method shown in Figure 3, branch value.
Figure 11 is with the situation of the view data shown in Figure 8 of the disposal methods among Fig. 3 and is the schematic diagram of the disposition in " n=2 " stage.
Figure 12 is with the situation of the view data shown in Figure 8 of the disposal methods among Fig. 3 and is the schematic diagram of the disposition in " n=3 " stage.
Figure 13 is the figure that is used for illustrating an example of the method that recomputates 2 transfer processing, branch value when carrying out shown in Figure 3 the processing.
Figure 14 is the figure that is used for illustrating an example of the method that recomputates 3 transfer processing, branch value when carrying out shown in Figure 3 the processing.
Figure 15 is the figure that is used for illustrating an example of the method that recomputates 4 transfer processing, branch value when carrying out shown in Figure 3 the processing.
Figure 16 is the process chart that is used to illustrate the handling procedure that the method that recomputates when carrying out processing method shown in Figure 3, branch value relates to.
Symbol description
1 signal processing apparatus
2 acceptance divisions (shoot part)
3 control system portions
4 handling parts
5 recording portion
6 test sections
7 essential factor information storing section
G changes essential factor information data (data of deterioration essential factor information)
The center-of-gravity value of Ga point transform
Img ' original digital image data (image that is taken)
Img is the data of the former correct images of deterioration (base image) not
E original image pixel energy
F
nShift pixel energy
R
nRestored data
The cE corrective energy
E
nDump energy (becoming the energy of process object)
The setting of X dump energy
T
nThe pixel energy of removing from the original digital image data zone
The cE corrective energy
Embodiment
Below, with reference to accompanying drawing the signal processing apparatus 1 that embodiment of the present invention relates to is described.And, this signal processing apparatus 1 becomes image processing apparatus, and be carried out utilization as civilian camera, but, also can be used as monitoring camera, TV camera, perhaps also can be used in the instrument beyond image diagnosing system that microscope, binoculars and then NMR take etc. etc., the camera with other purposes such as camera, lightweight video camera, endoscope cameras.
Fig. 1 represents the summary of the formation of signal processing apparatus 1.Signal processing apparatus 1, be provided with the image of taking personage etc. shoot part 2, drive the control system portion 3 of this shoot part 2 and the handling part 4 that will handle by the image that shoot part 2 is taken.In addition, the signal processing apparatus 1 that this execution mode relates to, and then be provided with the record images portion 5 that processed 4 of record handled, constitute, detect the test section 6 of the variation essential factor information that becomes the main cause that image deterioration etc. changes by angular-rate sensor etc., and preserve the essential factor information storing section 7 that makes the known variation essential factor information that image deterioration etc. takes place.In addition, under the situation that signal processing apparatus 1 is used as the device beyond the image processing apparatus, shoot part 2 becomes the acceptance division 2 that receives various input signals such as voice signal (below, suitably shoot part 2 and acceptance division 2 are separately used).
Shoot part 2 is the parts that are provided with the picture pick-up device of CCD that the photographic optical system by having camera lens or the light behind the camera lens are converted to the signal of telecommunication or C-MOS etc.Each one in control system portion 3 control shoot parts 2, handling part 4, recording portion 5, test section 6 and essential factor information storing section 7 etc., the signal processing apparatus 1.
Handling part 4 is made of image processor, and is made of the such hardware of ASIC (Application SpecificIntegrated Circuit).Handling part 4 in the sampling frequency that the vibration detection of rocking of produce detecting etc. is used, is supplied in test section 6 with this sampling frequency.In addition, handling part 4 is being controlled the beginning and the end of vibration detection.In addition, when signal processing apparatus 1 is used as the device beyond the image processing apparatus, can wait the receiving sensitivity that changes acceptance division 2 according to the size of input signal.
In addition, this handling part 4 also can be used as the formation of utilizing software to handle, rather than constitutes as the such hardware of ASIC.On this handling part 4, for good and all dispose original digital image data zone that becomes the delta data zone and the restored image data area that becomes the restored data zone.In addition, the maximum " E of the dump energy of handling part 4 each pixel of storage aftermentioned
Max".In addition, recording portion 5 is made of semiconductor memory, but also can adopt the magnetic recording means of hard drive etc. or use the optical recording means etc. of DVD etc.In addition, can delta data zone or restored data zone be set, in addition, also can store the maximum " E of dump energy in this recording portion 5
Max".
As shown in Figure 2, test section 6 is provided with two angular-rate sensors of rotary speed that detection is X-axis, the Y-axis of vertical direction with respect to the Z axle as the optical axis of signal processing apparatus 1.But, rocking when utilizing camera to take pictures also can take place to all directions of directions X, Y direction, Z direction move or around the rotation of Z axle, with respect to each change suffered what have the greatest impact is around the rotation of Y-axis with around the rotation of X-axis.These two kinds of changes only change a little, and the image of shooting just can be very fuzzy.Therefore, in this embodiment, only dispose Fig. 2 around X-axis with around two angular-rate sensors of Y-axis.But, more perfect in order to expect, also can further add angular-rate sensor around the Z axle, perhaps additional detected is to the transducer that moves of directions X or Y direction.In addition,, also can not adopt angular-rate sensor, and adopt angular acceleration transducer as employed transducer.
Essential factor information storing section 7 is, preserves the recording portion of the aberration of variation essential factor information, for example optical system of known deterioration essential factor information etc. and/or some transform of calculating according to the vibration that is detected etc. in advance.The point transform of record in the essential factor information storing section 7, for example after this is calculated, take soon, when restoring processing, in handling part 4, be used as the original image of the image that variation such as deterioration have taken place.At this, carry out the period that the recovery of original image is handled, the period of postponing when can be disconnected (OFF), when handling part 4 does not turn round, when the running rate of handling part 4 is low etc., from the period of taking original image for power supply for shooting.Under this situation, be stored in the original digital image data of recording portion 5 and be stored in essential factor information storing section 7, about the variation essential factor information of some transform of this original image etc., preserved for a long time with associated state respectively.Like this, make be the burden of handling part 4 in the time of to alleviate the shooting of following various processing the period of the recovery processing of carrying out original image from the advantage of postponing the period of having taken original image.In addition, under the situation that signal processing apparatus 1 is used as the device beyond the image processing apparatus, therefore by test section 6 detected temperature, humidity etc. the receiving feature of acceptance division 2 or the characteristic of entire system are changed, these can be write down and utilize as changing essential factor information.In addition, response characteristics function of the system that also pulse reply of system etc. can be known in advance etc. is stored in essential factor information storing section 7.
Next, according to Fig. 3 the summary of one example of, image restoration processing method 4 that carry out by the handling part as the image processing apparatus of above such signal processing apparatus that constitutes 1 is described.
Among Fig. 3, " E " is the luminous energy (original image pixel energy) that each pixel of original digital image data Img ' (details aftermentioned) that variations such as deterioration have taken place has respectively, and being stored in becomes the original digital image data in delta data zone zone." F
n" be pixel energy (below, be called and shift pixel energy) from the original digital image data zone-transfer that becomes the n time region of variation to the restored image data area that becomes the restored data zone." E
n" be by n time transfer energy F till associating for the first time to the n time
nTransfer and residue in dump energy as the original digital image data zone in delta data zone, be the energy that becomes process object." R
n" be to be stored in the restored data that becomes the restored image in restored data zone data area, by the carrying out that image restoration shown in Figure 3 is handled, become the approximate data of base image data " Img "." X " is the setting of dump energy En." G " is the data by test section 6 detected variation essential factor information (=deterioration essential factor information (some transform)), is the data that are stored in the recording portion of handling part 4." Ga " is the center-of-gravity value by the some transform of the data of the detected variation essential factor information G (=deterioration essential factor information (some transform)) of test section 6." Img " is base image, and promptly the data of the image that should be taken originally are the basis signal data.And the basis signal data are defined as in this specification, except this base image Img (signal that should obtain originally), also comprise the data of the approximate signal that changes preceding signal or these signals.Original digital image data Img ' is meant the image that is taken, i.e. the data of deterioration image.At this, the relation of Img and Img ' is represented with following formula (1).
Img’＝Img＊G……(1)
At this, " * " is the operator of expression superposition integral.
In addition, " Tn " shown in Figure 3 removes from the original digital image data zone to be equivalent to shift pixel energy F
nThe pixel energy of pixel energy, and shift pixel energy F
nFor measuring together." E
Max" be the maximum of the dump energy of each pixel in the original digital image data zone.At this, the dump energy E of each pixel in the original digital image data zone
nWith transfer pixel energy F
nRelation, represent with following formula (2).That is, shift pixel energy F
n, can pass through to utilize inverse, and draw the dump energy E of each pixel in the original digital image data zone as the center-of-gravity value Ga of the some transform that changes essential factor information data G
n(becoming the energy of process object).At this, " k " be contained in the original digital image data Img ' that is taken specific pixel energy, for the composition ratio of the pixel energy that is equivalent to this specific pixel among the base image Img.In addition, because " k " is unknown, therefore can in the scope of " 0＜k≤1 ", set arbitrarily.
F
n＝k×E
n/Ga……(2)
The handling procedure of the handling part 4 of Fig. 3 is at first extracted (step S101) from the pixel energy of the key element that will constitute original digital image data Img ' out as original image pixel energy E.At this, in present stage (n=0), E
0=E (original digital image data), the restored data R of restored image data area
0=0.Handling in (n=1) for the first time, at first pass through original image pixel energy E=E
0Multiply by the inverse of the center-of-gravity value Ga (changing the maximum of essential factor information data G) of a transform, obtain shifting pixel energy F
1(step S102).Then, make transfer pixel energy F
1Restored data R to the restored image data area
1Shift.That is, will shift pixel energy F
1Restored data R with the restored image data area
0Addition and as primary restored data R
1(step S103).
Then, remove the transfer pixel energy F that shift whereabouts restored image data area from the original digital image data zone
1The pixel energy of part.At this moment, utilize as the some transform that changes essential factor information data G.This is because the deterioration of data is owing to cause by changing the such filter of essential factor information data G, can be in order not conflicting before and after deterioration to remove from the original digital image data zone and to shift pixel energy F
nAt this, remove by shifting pixel energy F from the original digital image data zone
1With the resulting pixel energy T of superposition integral (step S104) that changes essential factor information data G
1, obtain dump energy E as the original digital image data zone of rudimental energy
1(step S105).
With the process of above step S102, S103, S104 and S105, formation is in the original digital image data zone original digital image data Img ', remaining all pixels carry out successively.At this moment, become the ENERGY E of the process object among the step S102
0, for removing transfer pixel energy F in the original digital image data zone from the energy transfer processing of surrounding pixel
nThe time, be removed corresponding to the value after the amount of this pixel that obtains by superposition integral.And, after all pixels are carried out above step S102, S103, S104 and S105, the dump energy E in storage original digital image data zone
1Maximum E
Max(step S106).
Then, judge dump energy E
1Maximum E
MaxNot enough setting X promptly, judges the original image pixel energy E=E that is stored in the original digital image data zone at first
0Major part be transferred to the restored image data area, the restored data R of restored image data area
1Whether can be considered as base image data I mg (step S107).In this example, setting X is set at " 0 " and near the value of " 0 ", judges E in addition
MaxNot enough setting X whether, and be setting X when above is made as (n=n+1)=2 and all pixels is carried out once more the processing of step S102, S103, S104, S105, S106 and S107.In the handling procedure of Fig. 3, " n=n+1 " carries out when carrying out step S106 and S107 after the processing to all pixel end step S102, S103, S104 and S105.That is, the number of processes of integral image is represented as n.In addition, step S107 also can be used as and judges the dump energy E that becomes more than the setting X
nThe step of pixel quantity.Under this situation, even become the above dump energy E of setting X
nPixel exist, but as long as its quantity is few, just can think restored data R
nSufficient approximation is in base image data I mg.
In step S107, to the maximum E of dump energy
MaxFor the processing of setting X when above describes.Because E
MaxTherefore more than setting X, be made as n=n+1 and all pixels carried out the processing of step S102, S103, S104, S105, S106 and S107.That is, by to dump energy E
N-1Multiply by the inverse of the center-of-gravity value Ga (changing the maximum of essential factor information data G) of a transform, obtain shifting pixel energy F
n(step S102).Then, make transfer pixel energy F
nShift to the restored image data area, obtain new restored data R
nThat is the restored data R of the restored image data area of being restored till the near last time (n-1),
N-1With this transfer pixel energy F
nAddition, and as new restored data R
nThen, remove from the original digital image data zone by shifting pixel energy F
nWith the resulting pixel energy T of superposition integral (step S104) that changes essential factor information data G
n, obtain new dump energy E
n(step S105).
With the process of above step S102, S103, S104 and S105, remaining all pixels that are in the original digital image data zone are carried out successively.Then, store the maximum " E of the dump energy in each pixel
Max" (step S106).Then, judge the maximum E of dump energy
MaxNot enough setting X (step S107) whether.E
MaxMore than setting X, be made as " n=n+1 " and the processing of repeating step S102, S103, S104, S105, S106 and S107.E
MaxNot enough setting X is judged as restored data R
nWith base image data I mg sufficient approximation, restore processing and finish (step S108).
Below, according to Fig. 4 the related viewpoint of restoring processing of rocking of this execution mode is described.The data I mg of base image is according to changing the words that essential factor information data G changes to original digital image data Img ', utilization becomes the variation essential factor information data G of same filter, make the original image pixel energy E in all pixels that constitute original digital image data Img ' all be transferred to the restored image data area, the restored data R of restored image data area
nShould approach the data I mg of base image in theory.
Then, according to Fig. 5, Fig. 6, Fig. 7, Fig. 8 and Fig. 9, the details of Fig. 3, the restoration processing method that rocks (reprocessing of step S102, S103, S104, S105, S106 and S107) shown in Figure 4 is described.
(recovery algorithm)
Do not having corresponding to the luminous energy (pixel energy) of determined pixel, in the time for exposure, to concentrate on this pixel when the image deterioration that causes such as rocking.In addition, under the situation that existence is rocked, pixel energy is scattered in the time for exposure in the pixel of rocking.And then, if know rocking in the time for exposure,, therefore can make unambiguous image by fuzzy image just know the dispersing mode of pixel energy in the time for exposure.
Below, for oversimplifying, describe with horizontal one dimension.With pixel begin from a left side in turn to be made as S-1, S, S+1, S+2, S+3 ..., and note a certain pixel S.Because the pixel energy in the time for exposure concentrates on this pixel when the image deterioration that causes such as rocking not having, so the concentration degree of pixel energy is " 1.0 ".This information slip is shown in Fig. 5.In addition, an example of the shooting results when not having image deterioration as shown in Figure 5 is shown in the table of Fig. 6.Data shown in Figure 6 become the correct images data I mg when deterioration does not take place.And each data is with the data representation of eight (0～255).
Suppose to have in the time for exposure image deterioration that causes because of rocking etc., and shake respectively, time of 30% shakes, time of 20% shakes time of 50% in the time for exposure in S+2 number pixel in S+1 number pixel in S number pixel.The dispersing mode of pixel energy table is as shown in Figure 7 put down in writing.This becomes and changes essential factor information data G.In addition because the center-of-gravity value Ga of some transform is the value of the concentrated part of energy, therefore for the time of 50% in the time for exposure shake part value " 0.5 ".
Because rock all is identical in all pixels, do not rock (vertically rocking) if therefore there is the top, and rock is the words of the scope of three pixel portion as shown in Figure 7, the situation of rocking, be each pixel pixel energy the dispersion situation specifically, for example as shown in Figure 8, " 120 " of the pixel of " S-3 ", according to as " α=0.5 " " β=0.3 " " γ=0.2 " the dispersion ratio (Fig. 7) that rocks change in information essential factor information data G, in the pixel of " S-3 ", disperse " 60 ", disperse in the pixel of " S-2 " " 36 ", disperse in the pixel of " S-1 " " 24 ".Similarly, as " 105 " of the pixel energy of " S-2 ", in the pixel of " S-2 ", disperse to disperse in the pixel of " 52.5 ", " S-1 " to disperse " 21 " in the pixel of " 31.5 ", " S ".Disperse pixel energy similarly for other pixels.
As the relation of the pixel energy that is equivalent to this specific pixel among " A " of the energy of the specific pixel of base image data I mg and the original image Img ' that is taken " A ' ", generally represent with following formula (3).
A×Ga＝k×A’……(3)
The center-of-gravity value " Ga " of some transform owing to be the energy value of concentrated part the most, therefore in this example, as shown in Figure 7, is " α=0.5 ".Should " α " be, the energy " A " of the specific pixel of the base image data I mg energy that pixel energy in the original image Img ' that is taken, that be equivalent to this specific pixel " A ' " is disperseed owing to rock disperses ratio, " A ' " except that " A * α ", by with near the energy of other pixels " A ", constitute according to the summation of the dispersed pixel energy of distribution ratio (β Fig. 7 and γ etc.) beyond the α.This formula (3) can certainly be applicable to " α=0.5 " (Fig. 7) in addition α value.In addition, formula (3) also goes in the scope of deficiency three pixel portion shown in Figure 7 or above situation about shaking in the scope of this scope.And then, to suppose to be under the situation of part of " β " shown in Figure 7 or " γ " etc. at the center-of-gravity value Ga of a transform, formula (3) also can be suitable for.
Then, how consideration should make pixel energy specific pixel transfer to the restored image data area from the original digital image data zone.At this, owing in the restored image data area, restore base image data I mg, therefore for the energy " A " of the specific pixel of obtaining base image data I mg, should the specific pixel that is equivalent to " A " to the restored image data area shift from the original digital image data zone.Therefore, through type (3), the specific pixel that is equivalent to " A " to the restored image data area shifts from the original digital image data zone to make " A=k * A '/α ".Then, remove the pixel energy that is equivalent to " A " from the original digital image data zone.At this moment, owing to, remove pixel energy, therefore utilize to change essential factor information data G from the original digital image data zone in order to conflict as a whole and not.For example, the specific pixel that will be equivalent to " A " is made as pixel shown in Figure 7 " S ", then the pixel energy that should remove from the pixel " S " in original digital image data zone is " k * A '/α * α ", the pixel energy that should remove from the pixel " S+1 " in original digital image data zone is " k * A '/α * β ", and the pixel energy that should remove from the pixel " S+2 " in original digital image data zone is " k * A '/α * γ ".Like this, the pixel energy sum that these are removed becomes the pixel energy " A " of the pixel " S " that is transferred to the restored image data area.Be set at " k=0.8 " in this example, below situation that concrete pixel energy is shifted describe.
Original image pixel energy " E " shown in first step S101 of reprocessing is shown among Fig. 8, Fig. 9.In initially treated pixel, this original image pixel energy E is the ENERGY E of process object
0, in step S102 to this ENERGY E
0Multiply by the inverse of the center-of-gravity value Ga of a transform, obtain shifting pixel energy F
nFor example, under the situation of noticed pixel " S-3 ", because the center-of-gravity value Ga of the some transform of original digital image data (photographed data) (" E " among Fig. 9) is " 0.5 ", therefore according to formula (3), the pixel " S-3 " to the restored image data area shifts (step S103) (F Fig. 9 from the original digital image data zone to make " 0.8 * 60/0.5=96 "
1(S-3)).Then, remove the pixel energy of " 96 " from the original digital image data zone.Like this, the restored image data (R among Fig. 9
1(S-3)) be " 96 ", " 0 " ...At this, because changing essential factor information data G is " 0.5 " " 0.3 " " 0.2 " as mentioned above like that, therefore should remove " 96 * 0.5=48 ", remove " 96 * 0.3=28.8 ", removes " 96 * 0.2=19.2 " (T Fig. 9 from pixel " S-1 " from pixel " S-2 " from the pixel " S-3 " in original digital image data zone
1(S-3)).Therefore, remove from the pixel " S-3 " in original digital image data zone that " 48 ", pixel " S-2 " are removed " 28.8 ", pixel " S-1 " is removed the energy (step S104) of " 19.2 ".At this moment, the dump energy E of each pixel in original digital image data zone
nBe removed the transfer part respectively, pixel " S-3 " becomes " 12 ", pixel " S-2 " becomes " 59.7 ", and pixel " S-1 " becomes " 66.3 ", and other pixel then became " 89 " " 117 " " 105 " " 114 " " 142 " (step S105) (" E among Fig. 9 as originally
1(S-3) ").
Next, noticed pixel " S-2 ", the energy of " 59.7 " is as the ENERGY E of process object now
0And it is residual.Carry out and the same processing of above-mentioned pixel " S-3 ", the pixel " S-2 " to the restored image data area shifts the (" F of Fig. 9 to the pixel energy of " 95.52 " from the original digital image data zone
1(S-2) "), the restored data R of the pixel of restored image data area " S-2 "
1Become " 95.52 ", the restored image data (R among Fig. 9
1(S-2)) become " 96 " " 95.52 " " 0 " ...Then, remove " 47.76 ", remove " 28.656 ", remove " 19.104 " from the pixel " S-2 " in original digital image data zone from pixel " S " from pixel " S-1 ".Consequently, photographed data, be the dump energy E of each pixel in original digital image data zone
n, be removed respectively and shift the part (" T among Fig. 9
1(S-2) "); pixel " S-3 " becomes " 12 ", pixel " S-2 " and becomes that " 11.94 ", pixel " S-1 " become " 37.644 ", pixel " S " becomes " 69.896 ", and other pixels are " 117 " " 105 " " 114 " " 142 " (" E of Fig. 9 as original
1(S-2) ").
Next, noticed pixel " S-1 " carries out and the same processing of above-mentioned pixel " S-3 ".The energy of " 37.644 " is as the ENERGY E of process object now
0And it is residual.Then, the pixel " S-1 " to the restored image data area shifts the (" F Fig. 9 to the pixel energy of " 60.23 " from the original digital image data zone
1(S-1) "), the restored data R of the pixel of restored image data area " S-1 "
1Become " 60.23 ", restored image the data (" R among Fig. 9
1(S-1) ") become " 96 " " 95.52 " " 60.23 " " 0 " ....Then, remove " 30.115 ", remove " 18.069 ", remove " 12.046 " from the pixel " S-1 " in original digital image data zone from pixel " S+1 " from pixel " S ".Consequently, photographed data, be the dump energy E of each pixel in original digital image data zone
n, be removed respectively and shift the part (" T among Fig. 9
1(S-1) "); pixel " S-3 " becomes " 12 ", pixel " S-2 " and becomes " 11.94 ", pixel " S-1 " and become that " 7.529 ", pixel " S " become " 51.827 ", pixel " S+1 " becomes " 104.954 ", and other pixel is " 105 " " 114 " " 142 " (" E among Fig. 9 as original
1(S-1) ").
Like this, all pixels are shifted pixel energy successively.Then, in the processing of the first time (n=1), all pixels " S-3 " " S-2 " " S-1 " ... the original image pixel energy E of " S+4 " does not move to the restored image data area, the dump energy E of each pixel in original digital image data zone
nAs higher value and residual.With this dump energy maximum " E
Max" (" 19.02 " in the pixel " S+4 ") be stored in the memory (step S106) of control part 4.Then, judge dump energy maximum E
MaxNot enough setting X (for example, being made as " 5 " in this example) (step S107) whether.More than the result of Chu Liing is E
MaxX, therefore same pixel energy transfer processing was carried out as the second time (n=2).And, repeat same transfer processing afterwards, until satisfying E
Max(the dump energy E in all pixels till the X
nTill " 0 ").
At this, will shift pixel energy F as the specific pixel among Fig. 9
nThere is restored data R in the result who shifts
nSurpass set upper limit value or dump energy E
nBecome the situation of negative value.This situation takes place, and then means and shifts pixel energy F
nBe set to inappropriate value.At this, though below in this case also as a whole and noncontradictory recomputate branch value method describe.
(method that recomputates 1 of branch value)
For the pixel of dump energy, by making the transfer pixel energy F that should move to the restored image data area for bearing
nDo not shift and intactly use the last value of handling and be provided in next time transfer processing, the pixel energy that expectation is removed this moment can not become inappropriate value.Because the dump energy of next time surrounding pixel tails off, from this time shifting the pixel energy value that remove for negative pixel the back, the pixel energy value that promptly is removed is less than this time, thus dump energy to become " 0 " above possibility big.But for example under the situation of the numerical value of pixel " S " before intactly using when becoming negative value, the dump energy of the pixel after pixel " S-2 " " S-1 " etc.s, the processing is not restored and is not restrained all the time during near " 0 ".Therefore, under this situation, good with being recalculated as of the disengaging value of carrying out pixel " S-2 " " S-1 " etc.
(method that recomputates 2 of branch value)
Describe according to concept map shown in Figure 10 viewpoint the method that recomputates after shifting.A part that is transferred to the pixel energy of restored image data area is back to the original digital image data zone as correction section (hereinafter referred to as corrective energy cE), makes dump energy E
nBe more than 0.At this moment, corrective energy cE carries out superposition integral and is back to the original digital image data zone to change essential factor information data G.Like this, can be as a whole and noncontradictory recomputate branch value.
Next, according to above-mentioned viewpoint, to making the dump energy E that becomes negative value
nHandle for recomputating of the branch value of " 0 " and to describe.Specifically, according to the handling procedure of Fig. 3 successively to pixel " S-3 " " S-2 " ... the words that " S+4 " carries out the pixel energy transfer processing of Fig. 9 and this reprocessing is continued, for the third time when n=3 (among Fig. 3) when the pixel " S-3 " in restored data zone is carried out the pixel energy transfer processing, the dump energy E of the pixel in original digital image data zone " S-1 "
nBecome " 0.624 ".As a reference, the disposition during with the n=2 among Fig. 3 is shown in Figure 11, and the disposition during n=3 among Fig. 3 is shown in Figure 12 and (only represents below the decimal point 3.Below, identical during the explanation of Figure 13, Figure 14, Figure 15.)。At this, the processing that the value that makes this " 0.624 " is become " 0 " describes.In this is handled, to bring influence, incorrect to the branch value (that time of n=3) of the pixel " S-3 " of restored image data area according to the dispersing mode of pixel energy shown in Figure 7 to the pixel " S-1 " in original digital image data zone is prerequisite, and carries out following processing.Below, according to the table of Figure 13 this processing is described.
Dump energy E for the pixel " S-1 " that makes the original digital image data zone
n(=-0.624) become " 0 ", make the restored data R of the pixel " S-3 " of corrective energy cE from the restored image data area
n(=119.040) are back to the original digital image data zone.At this, the ratio that the pixel " S-1 " of the pixel energy of the pixel of restored image data area " S-3 " in the original digital image data zone disperseed, the energy dispersion ratio according to Fig. 7 is " γ=0.2 ".Therefore, corrective energy cE, by cE * γ=-E
nAnd become cE=-E
n/ γ=-(0.624)/0.2=3.120.
Corrective energy cE (=3.120) to the pixel " S-3 " of restored image data area, in the pixel " S-1 " in original digital image data zone, " S-2 ", " S-3 ", can think and disperse ratio according to energy shown in Figure 7, pixel energy disperses as described below.
(1) pixel " S-3 ": disperse than being " 0.5 ", therefore 3.120 * 0.5=1.560
(2) pixel " S-2 ": disperse than being " 0.3 ", therefore 3.120 * 0.3=0.936
(3) pixel " S-1 ": disperse than being " 0.2 ", therefore 3.120 * 0.2=0.624
Remove corrective energy cE (=3.120) by the pixel " S-3 " from the restored image zone, and disperse than making this corrective energy be back to the original image zone according to energy shown in Figure 7, the processing of recomputating of branch value finishes.In the method that recomputates 2 of branch value, be with the pixel " S-1 " in original digital image data zone is brought influence, incorrect to the branch value (that time of n=3) of the pixel " S-3 " of restored image data area be that prerequisite is handled, but also can with the pixel " S-1 " in original digital image data zone is brought influence, incorrect to the branch value (that time of n=3) of the pixel " S-2 " of restored image data area be prerequisite, handle according to identical viewpoint.
(method that recomputates 3 of branch value)
For the method that recomputates 3 of branch value, also with the method that recomputates 2 of branch value in the same manner, with the dump energy E of the pixel " S-1 " in the original digital image data zone during n=3 among Fig. 3
nThe situation that becomes " 0.624 " as shown in the table of Figure 14 is made as " 0 ".Therefore, be prerequisite to bring influence, incorrect to the pixel " S-1 " in original digital image data zone, and handle to the branch value of the pixel " S-3 " of restored image data area and " S-2 " according to the dispersing mode of pixel energy shown in Figure 7.Below, according to the table of Figure 14 this processing is described.
Dump energy E for the pixel " S-1 " that makes the original digital image data zone
n(=-0.624) become " 0 ", make the corrective energy cE that derives by following formula (4)
S-3The restored data R of the pixel from the restored image data area " S-3 "
n(=119.040) are back to the original digital image data zone.At this, " cE
S-3" be the restored data R of the pixel " S-3 " in the restored image data area
nCorrective energy, be the gross energy that returns to the original digital image data zone.In addition, make the corrective energy cE that derives by following formula (5)
SRestored data R from pixel " S-2 "
n(=105.408) are back to the original digital image data zone.At this, " cE
S-2" be the restored data R of the pixel " S-2 " in the restored image data area
nCorrective energy, be the gross energy that returns to the original digital image data zone.
cE
S-3＝-E
n×P/(P×γ+Q×β)......(4)
cE
S-2＝-E
n×Q/(P×γ+Q×β)......(5)
At this, establish cE
S-3: cE
S-2=P:Q." β " is the ratio (Fig. 7) that the pixel " S-2 " of pixel energy in the original digital image data zone of the pixel " S-3 " of restored image data area disperseed, and " γ " is the ratio (Fig. 7) that the pixel " S-1 " of pixel energy in the original digital image data zone of the pixel " S-3 " of restored image data area disperseed.
Handle as " P:Q=1:1 " in this example.The ratio of this P and Q can at random be set.For example, also can be made as P:Q=γ: β corresponding to dispersion ratio to the pixel " S-1 " in original digital image data zone.In this example because " β=0.3 ", " γ=0.2 ", so formula (4), formula (5), as shown below.
cE
S-3＝-(-0.624)×1/(1×0.2+1×0.3)＝1.248
cE
S-2＝-(-0.624)×1/(1×0.2+1×0.3)＝1.248
Then, the corrective energy cE of the pixel of restored image data area " S-3 " and " S-2 "
S-3And cE
S-2(=1.248) among the pixel " S-3 " in the original digital image data zone before transfer processing, " S-2 ", " S-1 ", " S ", can think that pixel energy disperses as described below according to the dispersing mode of pixel energy shown in Figure 7.
(1) pixel " S-3 ": cE
S-3Dispersion than for " 0.5 ", therefore 1.248 * 0.5=0.624
(2) pixel " S-2 ": cE
S-3Dispersion than being " 0.3 ", other cE
S-2Dispersion than for " 0.5 ", therefore 1.248 * 0.3+1.248 * 0.5=0.998
(3) pixel " S-1 ": cE
S-3Dispersion than being " 0.2 ", other cE
S-2Dispersion than for " 0.3 ", therefore 1.248 * 0.2+1.248 * 0.3=0.624
(4) pixel " S ": cE
S-2Dispersion than for " 0.2 ", therefore 1.248 * 0.2=0.250
Then, by making corrective energy cE
S-3And cE
S-2As Figure 14 " amount of returning 1 " and " amount of returning 2 " and value, be back to pixel " S-3 ", " S-2 ", " S-1 ", " S " in original digital image data zone respectively, finish the processing of recomputating of branch value.
(method that recomputates 4 of branch value)
The method that recomputates 4 of branch value, with the method that recomputates 2 and 3 of branch value in the same manner, with the dump energy E of the pixel " S-1 " in the original digital image data zone during n=3 among Fig. 3
nThe situation that becomes " 0.624 " as shown in the table of Figure 15 is made as more than " 0 ".Therefore, with the pixel " S-1 " in original digital image data zone is brought influence, incorrect to the branch value " 1.156 " of the pixel " S-1 " of the restored image data area of last (that time of the n=2 among Fig. 3) be prerequisite, carry out method that recomputates 2 and 3 identical processing with above-mentioned branch value.Below, according to the table of Figure 15 this processing is described.
Dump energy E for the pixel " S-1 " that makes the original digital image data zone
n(=-0.624) become " 0 ", make the restored data R of the pixel " S-1 " of corrective energy cE from the restored image data area
nBe back to the original digital image data zone.At this, the ratio that the pixel " S-1 " of the pixel energy of the pixel of restored image data area " S-1 " in the original digital image data zone disperseed, the energy dispersion ratio according to Fig. 7 is " α=0.5 ".Therefore, corrective energy cE, by cE * γ=-E
nAnd become cE=-E
n/ γ=-(0.624)/0.5=1.248.And, in the pixel " S-1 " in original digital image data zone, " S ", " S+1 ", can think that pixel energy disperses as described below according to the dispersing mode of pixel energy shown in Figure 7.
(1) pixel " S-1 ": disperse than being " 0.5 ", therefore 1.248 * 0.5=0.624
(2) pixel " S ": disperse than being " 0.3 ", therefore 1.248 * 0.3=0.374
(3) pixel " S+1 ": disperse than being " 0.2 ", therefore 1.248 * 0.2=0.250
Then, remove corrective energy cE (=1.248), and disperse to finish the processing of recomputating of branch value than making this corrective energy be back to the original image zone according to energy shown in Figure 7 by pixel " S-1 " from the restored image zone.This advantage that recomputates method 4 is, can be made as to the dump energy E in original digital image data zone
nThe branch value that less than zero pixel is same pixel is incorrect, and carries out the processing of recomputating of branch value.
(method that recomputates of other branch value)
Also can recomputate dump energy E according to the method that recomputates 2,3 of above-mentioned branch value and 4 the viewpoint that recomputates processing with original digital image data zone
nThe branch value of all pixel energy transfer processing of the influence of less than 0.In addition, in the method that recomputates 2,3 and 4 of above-mentioned branch value, also can be to the dump energy E in original digital image data zone
nThe data of less than 0 do not make its processing that becomes " 0 ", but conduct surpasses the processing of the value of " 0 ".For example, contain under the situation of noise in the original digital image data zone thinking, good with being treated to of the value that surpasses " 0 " (going up value after adding the noise part) in " 0 ".And then, in the method that recomputates 2,3 and 4 of above-mentioned branch value, can be with the dump energy E of the pixel in the original digital image data zone during n=3 among Fig. 3
nBecoming the negative value conduct is inappropriate prerequisite to the branch value of the pixel of the previous restored image data area of last (during n=3), and carries out recomputating of branch value.
The process chart that Figure 16 represents is used for illustrating the related handling procedure of the method that recomputates when " returning processing " in the method that recomputates 2,3 or 4 of " processing of not shifting " of the method that recomputates 1 of above-mentioned branch value or above-mentioned branch value carried out, branch value in processing shown in Figure 3.After the step S105 in the handling process of Fig. 3, judge dump energy E
nWhether be negative value (step S201).If E
nNot negative value, just carry out the later processing (step S202) of step S106 among Fig. 3.If E
nBe negative value, just carry out the method that recomputates 1,2,3 of above-mentioned branch value or 4 energy branch value and recomputate processing (step S203), enter step S202 afterwards.
In the signal processing apparatus 1 that above-mentioned present embodiment relates to, when handling, in step S104, S107, can set number of processes and dump energy E in advance
nWhether be similar to any one party or both sides in the criterion value of " 0 ".For example, as number of processes, can set 20 times, 50 inferior number of times arbitrarily.In addition, can handle the dump energy E that stops with making
nThe value that whether is similar to the approximation of " 0 " is set at " 5 " in eight (0～255), and the words that become below 5 finish processing, perhaps are set at " 0.5 ", and the words that become 0.5 below make the processing end.Can at random set this set point.Under situation, good when satisfying any one party, just to stop to be treated to as input number of processes and criterion value both sides' formation.And, in the time can carrying out both sides' setting, serve as preferential with the criterion value, when the processing by stipulated number does not enter in the criterion value, also can again repeat the processing of stipulated number.
In description of the present embodiment, do not utilize the information that is stored in essential factor information storing section 7, and used the data of the recording portion that is stored in handling part 4, but also can use the data of the deflection that is stored in known deterioration essential factor, for example optical aberration or camera lens in the essential factor information storing section 7 etc.Under this situation, for example in the processing method (reprocessing) of before example (Fig. 3), make up and be treated to good with the information of the information of will rock and optical aberration as a deterioration essential factor, but, also can rock and utilize the recovery of the information of optical aberration to handle after information processing finishes in utilization.In addition, also this essential factor information storing section 7 can be set, and only the dynamic essential factor when being recorded in the shooting of handling part 4, for example only image revised or restored by rocking.
In addition, automatically or under the situation about being set regularly, also can change the number of times of this setting in signal processing apparatus 1 side in the number of repetition of handling by changing essential factor information data G.For example, owing to rocking under the situation that is scattered in a plurality of pixels, can increase number of repetition, disperse to reduce number of repetition under few situation in the data of certain pixel.
In addition, become the restored data R of output image in generation
nThe time, there is the data conditions that exceeds the image-region of desire recovery owing to the difference that changes essential factor information data G.Under this situation, the data that exceed the zone are transfused to opposition side.In addition, existing under the data conditions that outside the zone, to import, can be taken into this data from opposition side.For example, by be positioned at the zone below the data conditions of the data of the pixel XN1 pixel below being allocated in more under, this position is in outside the zone.Therefore, these data carry out being allocated in the processing that is positioned at uppermost pixel X11 directly over pixel XN1.For the adjacent pixels N2 of pixel XN1, similarly directly over be allocated in the pixel X12 (next door of=pixel X11) that goes up the hurdle most.
In the recovery algorithm of this execution mode, existence can be dwindled the advantage of the data area that signal processing apparatus 1 has.Its reason is that when restoring processing, the data necessary zone only has original digital image data zone and restored image data area just enough.In addition, when restoring processing, in the recovery algorithm of this execution mode, only be to utilize known variation essential factor information data G to repeat moving of pixel energy, therefore can promptly handle.In addition, the data area also can not set permanent zone but handles on the basis of setting temporary transient data area.
More than, the signal processing apparatus 1 of this execution mode is illustrated, but only otherwise breaking away from purport of the present invention can implement various changes.For example, the processing that utilizes handling part 4 to carry out is made of software, still, also can constitute by the hardware of being made up of the parts of bearing part processing respectively.In addition, as changing essential factor information data G, not only be deterioration essential factor information data, also can be for containing the information that only makes image change or making the data of the information that image improves on the contrary with deterioration.And then, when carrying out reprocessing, also can not carry out the dump energy E that each pixel has respectively
nThe maximum E of value
MaxAnd the comparison of setting (X), but carry out and this dump energy E
nMean value or the comparison of total value.By carrying out the processing speed raising like this.And then, also can carry out the dump energy E that each pixel has respectively
nThe maximum E of value
Max, a plurality of in mean value or the total value and correspond respectively to the comparison of a plurality of settings of these values.
In addition, automatically or under the situation about being set regularly, also can change the number of times of this setting in signal processing apparatus 1 side at the number of times of reprocessing by changing essential factor information data G.For example, owing to rocking under the situation that is scattered in a plurality of pixels, can increase the number of times of reprocessing, at the number of times that disperses to reduce under few situation reprocessing in the data of certain pixel.
In the above-described embodiment, will restore object as view data.But these restore viewpoint and the gimmick of handling and recomputate method, can be applicable to that the recovery of all data is handled.For example, can be applicable to the recovery of voice data, the recovery of seismic data etc.In addition, in the above-described embodiment, represented the same example that rocks to take place everywhere in view data, but these viewpoints and gimmick and recomputate method go for also that difference because of location of pixels becomes the different images that rocks or gradation of image is corrected such nonlinear processing.
In addition, above-mentioned each processing method or the method that recomputates also can be by sequencing.In addition, also can will be deposited in recording medium by the processing method of sequencing or the method that recomputates, for example deposit CD (Compact Disc), DVD, USB (Universal Serial Bus) memory in, and can read by computer.Under this situation, signal processing apparatus 1 has the means of reading in of reading in the program in this recording medium.And then, also can deposit the processing method of this sequencing or the method that recomputates in signal processing apparatus 1 external server, download as required and use.Under this situation, signal processing apparatus 1 has the means of communication that the program in this recording medium is downloaded.
Claims (12)
1. signal processing apparatus, be provided with handling part, this handling part by the data that the original signal that deterioration etc. changes has taken place (below, be called delta data) data of the signal before restore changing or the approximate signal of the signal that should obtain originally or these signals (below, be called the basis signal data), it is characterized in that
Be provided with the delta data zone of the above-mentioned delta data of storage and when restore handling each time, store the restored data zone of these data of being restored the signal of processing (below, be called restored data);
What above-mentioned handling part carried out is treated to, utilization becomes the variation essential factor information data that changes main cause, make the energy of above-mentioned delta data generate above-mentioned restored data from above-mentioned delta data zone to above-mentioned restored data zone-transfer, will be by this transfer the reprocessing that is replaced as above-mentioned delta data and carries out the same processing of repetition of the remaining data in residual above-mentioned delta data zone; In above-mentioned process repeats under less than zero the situation of the energy value of above-mentioned remaining data, utilize above-mentioned variation essential factor information to make a part be back to above-mentioned delta data zone so that the energy value of above-mentioned remaining data is the processing more than zero to the above-mentioned energy of above-mentioned restored data zone-transfer, carry out above-mentioned reprocessing simultaneously, and the data that will be formed at the above-mentioned reprocessing above-mentioned restored data zone when finishing are as above-mentioned basis signal data.
2. signal processing apparatus as claimed in claim 1 is characterized in that, under less than zero the situation of energy value of said remaining data, makes its value become zero above processing.
3. signal processing apparatus as claimed in claim 1 or 2, it is characterized in that, when said reprocessing, carry out when this is repeated each time to the above-mentioned energy of above-mentioned restored data zone-transfer and the processing that has been stored in the above-mentioned restored data addition in above-mentioned restored data zone, the energy value of exercising above-mentioned remaining data of going forward side by side approaches zero processing in zero above scope.
4. a signal processing apparatus is provided with the handling part that restores the basis signal data of a plurality of key elements formations from the delta data of a plurality of key elements formations, it is characterized in that,
Be provided with the delta data zone of the above-mentioned delta data of storage and when restore handling each time, store the restored data zone of these data of being restored the signal of processing (below, be called restored data);
What above-mentioned handling part carried out is treated to, utilization becomes the center-of-gravity value of the response characteristics function that the variation essential factor information data that changes main cause had, make key element energy in the key element of above-mentioned delta data from above-mentioned delta data zone to above-mentioned restored data zone-transfer, and utilize variation essential factor information data to remove the key element energy that is equivalent to the above-mentioned above-mentioned key element energy that is transferred from above-mentioned delta data zone, in addition, also carry out this processing successively for other key elements to a key element, thereby in above-mentioned restored data zone, generate above-mentioned restored data, will be by above-mentioned removing the remaining data in residual above-mentioned delta data zone be replaced as above-mentioned delta data and each key element repeated same processing, carry out when this is repeated each time above-mentioned key element energy and above-mentioned restored data addition to above-mentioned restored data zone-transfer, thereby generate the processing of new restored data; In these a series of processing procedures, under less than zero the situation of any key element energy value in above-mentioned remaining data, utilize above-mentioned variation essential factor information to make a part be back to above-mentioned delta data zone to the key element energy of above-mentioned restored data zone-transfer, so that the key element energy value of above-mentioned less than zero becomes zero above processing, simultaneously, carry out above-mentioned a series of processing, make above-mentioned remaining data in the scope more than zero, approach zero processing, and the above-mentioned restored data in the above-mentioned restored data zone will be formed at the processing end time is as above-mentioned basis signal data.
5. as any described signal processing apparatus of claim 1～4, it is characterized in that, said handling part is when generating above-mentioned restored data, and the energy value of above-mentioned remaining data is that the setting of zero above scope is following or just stop processing during less than the afore mentioned rules value.
6. as any described signal processing apparatus of claim 1～4, it is characterized in that said handling part stops when the number of times of above-mentioned restored data reaches stipulated number handling just generate when generating above-mentioned restored data.
7. as any described signal processing apparatus of claim 1～4, it is characterized in that, said handling part is when generating above-mentioned restored data, the setting that energy value when the number of times that generates above-mentioned restored data reaches stipulated number, above-mentioned remaining data is zero above scope is following or just stop processing during less than the afore mentioned rules value, surpassing the afore mentioned rules value or being afore mentioned rules value when above, carry out the reprocessing of stipulated number once more.
8. a signal processing apparatus is provided with the handling part that restores the basis signal data of a plurality of key elements formations from the delta data of a plurality of key elements formations, it is characterized in that,
Be provided with the delta data zone of the above-mentioned delta data of storage and in each restored data zone of storing these data of being restored the signal of processing (below, be called restored data) when handling of restoring;
What above-mentioned handling part carried out is treated to, utilization becomes the variation essential factor information data that changes main cause, make energy in the key element of above-mentioned delta data from above-mentioned delta data zone to above-mentioned restored data zone-transfer, and utilize above-mentioned variation essential factor information data to remove the energy that is equivalent to the above-mentioned above-mentioned energy that is transferred from above-mentioned delta data zone, in addition, also carry out above-mentioned processing successively for other all key elements, thereby in above-mentioned restored data zone, generate above-mentioned restored data a key element; During below the value of the remaining data in the above-mentioned delta data zone residual by this transfer is the setting of zero above scope or less than the afore mentioned rules value, stop processing, and above-mentioned restored data is handled as above-mentioned basis signal data; In the value of above-mentioned remaining data greater than the afore mentioned rules value or be that the afore mentioned rules value is when above, above-mentioned remaining data is replaced as above-mentioned delta data and repeats same processing, thus the processing that generates new restored data to the above-mentioned key element energy and the above-mentioned restored data addition of above-mentioned restored data zone-transfer when carrying out this is repeated each time; Under less than zero the situation of any key element energy value in above-mentioned remaining data, utilize above-mentioned variation essential factor information to make a part be back to above-mentioned delta data zone so that less than zero the key element energy value of above-mentioned remaining data becomes the processing more than zero to the key element energy of above-mentioned restored data zone-transfer, simultaneously, carry out the comparison of above-mentioned remaining data amount and afore mentioned rules value.
9. signal processing apparatus as claimed in claim 8 is characterized in that, said handling part is when generating above-mentioned restored data, and the number of times that generates above-mentioned restored data just stops to handle when reaching stipulated number.
10. signal processing apparatus as claimed in claim 8, it is characterized in that, said handling part is when generating above-mentioned restored data, and one or more in maximum, mean value or the total value of the above-mentioned remaining data value that has respectively for each key element carry out the comparison with the afore mentioned rules value.
11. as claim 4 or 8 described signal processing apparatus, it is characterized in that, saidly return processing when one or many is carried out in the generation of above-mentioned restored data, become with above-mentioned any key element energy value that the key element energy to above-mentioned restored data zone-transfer is that object carries out before less than that time of zero at above-mentioned remaining data.
12. any described signal processing apparatus as claim 1～11 is characterized in that, with above-mentioned signal data as view data.
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP119467/2006 | 2006-04-24 | ||
| JP2006119467 | 2006-04-24 | ||
| PCT/JP2007/054547 WO2007122883A1 (en) | 2006-04-24 | 2007-03-08 | Signal processing apparatus |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101401417A true CN101401417A (en) | 2009-04-01 |
| CN101401417B CN101401417B (en) | 2011-05-04 |
Family
ID=38624797
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN200780008768.1A Expired - Fee Related CN101401417B (en) | 2006-04-24 | 2007-03-08 | Image processing apparatus |
Country Status (3)
| Country | Link |
|---|---|
| JP (1) | JP4982484B2 (en) |
| CN (1) | CN101401417B (en) |
| WO (1) | WO2007122883A1 (en) |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP3348461B2 (en) * | 1993-05-06 | 2002-11-20 | 株式会社ニコン | Image stabilization camera |
| JPH1124122A (en) * | 1997-07-03 | 1999-01-29 | Ricoh Co Ltd | Method and device for correcting camera shake image, and recording medium with recorded program for executing the same method by computer and capable of being read by computer |
| JP2002300459A (en) * | 2001-03-30 | 2002-10-11 | Minolta Co Ltd | Image restoring device through iteration method, image restoring method and its program, and recording medium |
| JP2003060916A (en) * | 2001-08-16 | 2003-02-28 | Minolta Co Ltd | Image processor, image processing method, program and recording medium |
| JP3867680B2 (en) * | 2003-04-01 | 2007-01-10 | ソニー株式会社 | Imaging apparatus and camera shake correction method |
| JP4634752B2 (en) * | 2004-07-09 | 2011-02-16 | Ｈｏｙａ株式会社 | Camera with image blur correction function |
-
2007
- 2007-03-08 JP JP2008512003A patent/JP4982484B2/en not_active Expired - Fee Related
- 2007-03-08 WO PCT/JP2007/054547 patent/WO2007122883A1/en active Application Filing
- 2007-03-08 CN CN200780008768.1A patent/CN101401417B/en not_active Expired - Fee Related
Also Published As
| Publication number | Publication date |
|---|---|
| CN101401417B (en) | 2011-05-04 |
| WO2007122883A1 (en) | 2007-11-01 |
| JP4982484B2 (en) | 2012-07-25 |
| JPWO2007122883A1 (en) | 2009-09-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8723989B2 (en) | Image distortion processing apparatus, and method of operating an image distortion processing apparatus | |
| CN101571947B (en) | Image processing device and image processing method | |
| CN103167237A (en) | Image pickup apparatus and image blur correcting method for performing image blur correction based on at least one of shutter speed and amount of image blur when taking image | |
| CN101198985B (en) | Image processing apparatus and image processing method | |
| CN102422632A (en) | Imaging device and image restoration method | |
| CN100358342C (en) | Image processing apparatus | |
| CN102857694B (en) | Image composition equipment and control method thereof | |
| JP4965179B2 (en) | Image processing device | |
| CN101401417B (en) | Image processing apparatus | |
| CN101305598B (en) | Image processing apparatus and method | |
| JP5133070B2 (en) | Signal processing device | |
| CN101569176B (en) | Signal processing device | |
| CN105100587B (en) | Photographic device and its control method | |
| US7961976B2 (en) | Image data restoration apparatus, imaging apparatus, image data restoration method and computer readable medium storing image data restoration program | |
| JP4598623B2 (en) | Image processing device | |
| CN101310520B (en) | Image processing device and method | |
| CN1678028A (en) | High-precision signal processing circuit and an image capturing apparatus | |
| JP4606976B2 (en) | Image processing device | |
| JP2006324874A (en) | Pixel defect correcting device | |
| JP6812619B1 (en) | Control device, image shake correction device, image pickup device, control method, and program | |
| JP4763419B2 (en) | Image processing device | |
| JP4629537B2 (en) | Image processing device | |
| JPH11150681A (en) | Information processing device and method, information processing system and recording medium | |
| CN101632309A (en) | Image processing device and image processing method | |
| JP2837917B2 (en) | Image restoration device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20110504 Termination date: 20180308 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |