CN1910614A - Measuring method for optical transfer function, image restoring method, and digital imaging device - Google Patents

Measuring method for optical transfer function, image restoring method, and digital imaging device Download PDF

Info

Publication number
CN1910614A
CN1910614A CN 200580002639 CN200580002639A CN1910614A CN 1910614 A CN1910614 A CN 1910614A CN 200580002639 CN200580002639 CN 200580002639 CN 200580002639 A CN200580002639 A CN 200580002639A CN 1910614 A CN1910614 A CN 1910614A
Authority
CN
China
Prior art keywords
image
transfer function
optical transfer
data
photographic means
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN 200580002639
Other languages
Chinese (zh)
Inventor
荒木信博
藁谷克则
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Panasonic Holdings Corp
Original Assignee
Matsushita Electric Industrial Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Matsushita Electric Industrial Co Ltd filed Critical Matsushita Electric Industrial Co Ltd
Publication of CN1910614A publication Critical patent/CN1910614A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Facsimiles In General (AREA)
  • Studio Devices (AREA)

Abstract

In an measuring method for optical transfer function of the invention, irradiating-light froma light source (31) scans an element to be measured within an image sensor of an imaging camera constituted by integrating an imaging optical system and the image sensor. The element to be measured converts sequentially the irradiating-light into an electrical signal and outputs the electrical signal. Further, based on the outputted electrical signal, point spread function data is generated, and subjected to Fourier transform to calculate an optical transfer function. Accordingly, a method is provided for measuring an optical transfer function for properly restoring image degradation due to factors including the position of the imaging optical system within the imaging camera and inter-element cross talk.

Description

The assay method of optical transfer function, image recovery method and digital image capture device
Technical field
The present invention relates to a kind of assay method of optical transfer function, be used for coming the image that generates is proofreaied and correct the image that approaches original image to obtain, also relate to a kind of image recovery method by the image taking photographic means.
Background technology
In recent years, miniaturization of the structure of image taking photographic means and thickness are thinner.Therefore, the total length of image taking optical system is shortened, and the quantity of compound lens (constituentlense) has also reduced.This be miniaturized and the image taking photographic means of thickness attenuation in, owing to reasons such as camera lens aberration have caused the deterioration of image, and be difficult to improve the resolution performance of image taking optical system.In the image taking photographic means of traditional miniaturization and thickness attenuation, the resolution of imageing sensor is improved, but the resolution performance of image taking optical system still is not improved.Therefore, can't realize and the corresponding high resolution image of the improvement of image sensor resolutions.
The image of deterioration is returned to the technology that approaches original image as a kind of being used for, a kind of known technology has been arranged so far, be used for by use be specifically designed to the image taking photographic means the image taking optical system optical transfer function and deconvolution handled be applied to the image of deterioration, thereby the image after obtaining to recover.Described deconvolution is handled to open among 2002-24816 and the Te Kai 2000-206446 etc. for example Jap.P. open source literature spy and is disclosed.In conventional art, the opticator that uses in the image taking photographic means for example camera lens is placed in the sensing equipment.In the view field of described sensing equipment, projection a figure with spatial frequency of the element spacing that is equal to or greater than imageing sensor, measure MTF (modulation transfer function) whereby.The MTF measured value that records is used as optical transfer function.In described deconvolution was handled, by as the optical transfer function of image deterioration factor information the image of deterioration being carried out convolution integral, the image of wherein said deterioration was owing to the image taking Performance of Optical System causes smudgy.The image that described deconvolution is handled deterioration reverts to the high-contrast image that approaches original image.
But along with the raising of the resolution of image picking-up apparatus, the quantity that constitutes the element of imaging region also can increase, and each size of component has also reduced simultaneously.Like this, as the reason of image deterioration, the crosstalking of described imageing sensor increased and reached the degree that can't ignore.At the above-mentioned traditional assay method that is used for optical transfer function, have only the image taking optical system of image taking photographic means to be placed on the sensing equipment, in order to measure MTF.In traditional image recovery method, calculate MTF, wherein said MTF only represents the deterioration factor that the image taking optical system owing to the image taking photographic means causes, and the MTF that is calculated is used as optical transfer function; Described imageing sensor is crosstalked and is not considered to a factor of image deterioration.When in fact described image taking optical system is installed in the image taking photographic means, because may being different from when the image taking optical system, the relation of the position between image taking optical system and the imageing sensor, focus state be placed on situation in the sensing equipment.As mentioned above since when measuring optical transfer function different factor, therefore the image that obtains by the actual image capture photographic means may deterioration.Therefore, just can not handle and verily recover described image by carrying out deconvolution, wherein said process of convolution have been utilized the optical transfer function that calculates by said method.
Further, measure the method for optical transfer function in traditional being used for, described image taking optical system must be taken out from the image taking photographic means, and is placed in the sensing equipment subsequently.In order to obtain optical transfer function, the described image taking photographic means of need taking apart and reset.Therefore, be not the mensuration that just can carry out optical transfer function easily.
Handle the required calculated amount of correcting image proportional by deconvolution with the power of the pixel count of the image (calibration object image) that will be corrected.Along with the pixel count quantitative change of digital image capture device is big, the treatment capacity that described deconvolution is handled also can increase.When treatment capacity increases, described digital image capture matching requirements high-speed CPU and mass storage, and consume more power simultaneously.When described digital image capture device is during by battery-driven portable set, the increase of power attenuation also can bring problem.
In order to solve the problem of conventional art, realized the present invention, and one object of the present invention just provides a kind of method that is used to measure optical transfer function, and wherein said optical transfer function can generate an optical transfer function at an easy rate, is used for verily recovering original image.Another object of the present invention just provides a kind of method for correcting image, is used for the image that the digital picture filming apparatus obtains is proofreaied and correct, and can not increases the treatment capacity of digital image capture device.
Summary of the invention
According to an aspect of the present invention, the method that is used to measure optical transfer function comprises: scanning step, be used for going out irradiates light and described irradiates light being scanned detected element from light emitted, wherein detected element is an element in the imageing sensor of image taking photographic means, and described image taking photographic means constitutes by image taking optical system and imageing sensor are integrated in one; The opto-electronic conversion step is used for by described detected element, sequentially irradiates light being converted to electric signal along with the scan operation of scanning step to described element, and exports described electric signal subsequently; And calculation procedure, be used for calculating optical transfer function according to the electric signal exported in the opto-electronic conversion step, wherein said optical transfer function is used to handle to recovering by the deterioration of using the image that the image taking photographic means generates by deconvolution.
According to this structure, the image taking optical system and the imageing sensor that in fact are arranged in the image taking photographic means are used to the calculating optical transport function.Therefore, just can calculate such optical transfer function, described optical transfer function reflects image deterioration factor that occurs in the image taking optical system and the image deterioration factor that is caused by crosstalking of inner member.Also have, the element of composing images being taken the imaging region of photographic means by the light of the image taking optical system incident in being arranged on the image taking photographic means scans, and according to calculating optical transfer function by scanning the image that obtains.Therefore, can calculate optical transfer function at an easy rate, and need not disassemble described image taking photographic means.
According to another aspect of the present invention, in calculation procedure, can calculate the optical transfer function of detected element according to the spread function data, wherein said spread function data are that the scanning by irradiates light generates in scanning step, and have represented the distribution by the electric signal that described detected element conversion is obtained.
According to this structure, for each detected element all generates the spread function data.When the degree of image deterioration according to imageing sensor in the position of detected element when changing, just can measure the optical transfer function that changes according to described position.
According to another aspect of the present invention, in scanning step, can under conjugate condition, launch on imaging region and to produce the irradiates light that is similar to projected image a little, make that paraxonic (paraxial) diameter of image of irradiates light is equal to or less than half of element spacing on described imaging region; And in calculation procedure, can calculate optical transfer function according to point spread function data, wherein generate described point spread function data as the spread function data.
According to this structure, obtained the point spread function data of detected element, and can calculate optical transfer function according to described point spread function data.
According to another aspect of the present invention, in scanning step, can under conjugate condition, launch on imaging region the irradiates light that produces the linear projection image, make on the described imaging region width of the paraxonic image of irradiates light be equal to or less than half of element spacing; And in calculation procedure, can calculate optical transfer function according to described line spread function data, wherein generate described line spread function data as the spread function data.
According to this structure, obtained the line spread function data of detected element, and can go out optical transfer function according to described line spread function data computation.Also have,, can measure the line spread function data of a plurality of detected element simultaneously by using the irradiates light that on imaging region, produces the linear projection image.Therefore, can calculate the optical transfer function of the detected element of greater number at short notice.
According to another aspect of the present invention, in scanning step, described irradiates light can scan a plurality of detected element; And described calculation procedure can comprise: carry out interpolation by the optical transfer function that uses a plurality of detected element, and therefore calculate the optical transfer function of the element except detected element.
According to this structure, the processing burden that has reduced the processing burden that is used for calculating the spread function data and be used for generating from described spread function data optical transfer function so just can shorten the mensuration required time of optical transfer function.Also have, carry out interpolation processing, can calculate the optical transfer function of other elements by the spread function data of using a plurality of detected element.Therefore, even when the image deterioration degree changes according to the position in the imageing sensor, also can obtain to reflect the optical transfer function of this unevenness with respect to whole elements of imageing sensor.
According to another aspect of the present invention, described assay method may further include the distorted characteristic data and generates step, is used for by using the spread function data and generating distorted characteristic data relevant with image fault on imaging region corresponding to the positional information of the detected element of described spread function data.
According to this structure, can generate the data that are used to proofread and correct, described data not only can be used to proofread and correct by the restriction of the resolution performance of described image taking optical system and the deterioration of the image that causes, but also can proofread and correct the image fault that is caused by described image taking optical system.
According to another aspect of the present invention, described scanning step can comprise the change step, is used for changing at described irradiates light to the irradiating angle of image taking photographic means and at least one of irradiation position, makes described irradiates light scan detected element.
According to this structure,, also can scan with irradiates light though described image taking photographic means is in stationary state.
According to another aspect of the present invention, described scanning step can comprise the change step, is used for changing the angle of described image taking photographic means and at least one of position, makes described irradiates light scan detected element.
According to this structure, move with respect to imaging region by making irradiates light, just can scan by enough described irradiates lights.
According to another aspect of the present invention, image recovery method comprises determination step, is used for measuring optical transfer function by each above-mentioned assay method; And the step of recovering to handle, the optical transfer function that is used for recording by use recovers to handle to the view data that is obtained by the image taking photographic means.
Therefore, can access high-resolution recovery image.
According to another aspect of the present invention, a kind of portable telephone apparatus or digital image capture device comprise: the image taking photographic means is used to catch the image of the body that is taken and generates view data; Memory storage is used for the storing optical transport function; And transmitting device, be used for and will be stored in the optical transfer function in the described memory storage and transmit as one group of data by the view data that the image taking photographic means generates; Wherein measure described optical transfer function by a kind of assay method, described method comprises: scanning step, be used for going out irradiates light from light emitted, and described irradiates light is scanned the detected element in the imageing sensor of image taking photographic means, the imageing sensor of wherein said image taking photographic means and image taking optical system integrate; The opto-electronic conversion step is used for by described detected element, and sequentially the irradiates light that will scan in scanning step is converted to electric signal, and exports described electric signal subsequently; And calculation procedure, being used for coming the calculating optical transport function according to the electric signal exported in the opto-electronic conversion step, wherein said optical transfer function is used to handle by deconvolution the deterioration of the image that generated by the image taking photographic means is recovered.
According to this structure, the optical transfer function that records by the said determination method and the view data of the body that is taken are used as one group of data transmission.Like this, described recipient just is easy to recover to handle by using the optical transfer function that is transmitted to carry out view data.
According to a further aspect of the invention, a kind of portable telephone apparatus or digital image capture device comprise: the image taking photographic means is used to catch the image of the body that is taken and generates view data; The mark generating apparatus, be used for the additional view data that generates by the image taking photographic means of giving of the document number of data file, described data file has comprised the optical transfer function that records by an assay method, wherein said assay method comprises: scanning step, be used for going out irradiates light from light emitted, and described irradiates light is scanned the detected element in the imageing sensor of image taking photographic means, the imageing sensor of wherein said image taking photographic means and image taking optical system integrate; The opto-electronic conversion step is used for by described detected element, and the irradiates light that sequentially will scan described element in scanning step is converted to electric signal, and exports described electric signal subsequently; And calculation procedure, being used for coming the calculating optical transport function according to the electric signal exported in the opto-electronic conversion step, wherein said optical transfer function is used to handle by deconvolution the deterioration of the image that generated by the image taking photographic means is recovered.
According to this structure, the document number mark that will contain the data file of optical transfer function adds to view data.Like this, even for example during image correcting device, also can from the mixed file of external device (ED), select optical transfer function to external device (ED) exactly, handle with the recovery of carrying out view data corresponding to described image when the image data transmission that will have mark.
According to another aspect of the present invention, a kind of method for correcting image comprises: a step, be used for making by the digital image capture device image that the image capturing of body generates that is taken relevant with deterioration factor information, described deterioration factor information is used for the deterioration of image that the image capturing device by the digital image capture device is caused proofreaies and correct, and from described digital image capture device output relevant information; And another step, be used for by using the deterioration factor information relevant with described image, make the image rectification server apparatus carry out deconvolution and handle image from the output of digital image capture device.
According to this structure, it is whole that the digital image capture device is carried out is to make deterioration factor information be associated with the image that is generated by image capturing device, and export described information, described deterioration factor information is used for being proofreaied and correct by the deterioration of the image that image capturing device caused; Carrying out deconvolution by the image rectification server apparatus handles.Like this, just can access the image of proofreading and correct through the deconvolution processing, and can not increase the treatment capacity of digital image capture device.
According to another aspect of the present invention, the digital image capture device comprises: image capturing device is used to catch and generate the image of body of being taken; The deterioration factor information-storing device is used to store deterioration factor information, and described deterioration factor information is used for being proofreaied and correct by the deterioration of the image that image capturing device caused; And output unit, be used to export the deterioration factor information relevant with described image.
According to this structure, output is relative to each other from the digital image capture device calibration object image and deterioration factor information.Therefore, externally in the equipment calibration object image is proofreaied and correct, and the image after can obtaining proofreading and correct, and can not be increased the treatment capacity of digital image capture device.
According to another aspect of the present invention, described digital image capture device may further include receiving trap, is used to receive the image the deterioration factor information of exporting from output unit by use is proofreaied and correct the correction that obtains to image after.
According to this structure, described receiving trap receives the image after the correction.Therefore, the image after can obtaining to proofread and correct by the digital image capture device, and can not increase the treatment capacity of digital image capture device.
According to another aspect of the present invention, the deterioration factor information-storing device can be stored in the optical transfer function of use in the deconvolution processing as deterioration factor information.
According to this structure, can come externally to carry out the deconvolution processing in the equipment by the optical transfer function that use is stored in the deterioration factor information-storing device.
According to a further aspect in the invention, described output unit can be transmitting device, is used to transmit the deterioration factor information relevant with image.
According to this structure, described transmitting device can be used for the positive object images of high-ranking officers and deterioration factor information transmission and give and be used to carry out the equipment that deconvolution is handled.
According to a further aspect in the invention, described output unit can be a writing station, and the said write device is used for the deterioration factor information relevant with described image is written to the recording medium relevant with described image.
According to this structure, can from the recording medium of an equipment, read calibration object image and deterioration factor information, be used to carry out deconvolution and handle.
According to another aspect of the present invention, a kind of image rectification server apparatus comprises: receiving trap, be used for receiving image and deterioration factor information from the digital image capture device, wherein said image is by making the be taken image capturing of body of described digital image capture device generate, and described deterioration factor information is to be used for being proofreaied and correct by the deterioration of the image that image capturing device caused of digital image capture device; Image correction apparatus is used to use described deterioration factor information that image is carried out deconvolution and handles; And transmitting device, be used to transmit by carrying out the image after the correction that obtains is handled in deconvolution.
According to this structure, can obtain along with each digital image capture device different and different deterioration factor information and the image of catching, as one group of data with the digital image capture device; And so just can suitably proofread and correct.Also have, in the image rectification server apparatus, carry out deconvolution and handle, and so can handle image after obtaining proofreading and correct, and can not increase the treatment capacity of digital image capture device by the use deconvolution.
According to another aspect of the present invention, described receiving trap can receive transmission destination information and described image and deterioration factor information, and described transmission destination information has been specified the transmission destination of the image after proofreading and correct; Described transmitting device can transfer to the image after proofreading and correct the transmission destination by the appointment of described transmission destination information.
According to this structure, do not need to increase the treatment capacity of digital image capture device, just can handle proofreading and correct, and transmit it to any given transmission destination by deconvolution by making the digital image capture device carry out the image that image capturing obtains.
According to another aspect of the present invention, a kind of image correction system comprises: digital image capture device and image rectification server apparatus, and wherein said digital image capture device comprises image capturing device, is used to catch and generate the image of body of being taken; Specified device is used to specify the transmission destination of proofreading and correct the back image; And transmitting device, be used for the destination information relevant with the image that is generated by described image capturing device is transferred to image rectification server apparatus and related transmitting information, wherein said transmission destination information representation is by using the specified transmission destination of specified device; And described image rectification server apparatus comprises: image correction apparatus and transmitting device, described image correction apparatus is used for that the image from the output of digital image capture device is carried out deconvolution to be handled, with the image after the acquisition correction, image after the correction that described transmitting device is used for obtaining by the use image correction apparatus is transferred to transmission destination, and described transmission destination is represented by the transmission destination information relevant with described image.
According to this structure, can not increase the treatment capacity of digital image capture device, and handle to proofread and correct, and transmit it to any given transmission destination carry out the image that image capturing obtains by the digital image capture device by deconvolution.
According to another aspect of the present invention, a kind of program that makes the bearing calibration of computing machine carries out image, comprise receiving step, be used for the input of received data file, comprise image and deterioration factor information in the wherein said data file, described image is by making the be taken image capturing of body of digital image capture device generate, and described deterioration factor information is used for being proofreaied and correct by the deterioration of the image that image capturing device caused of described digital image capture device; And image rectification step, be used for by using deterioration factor information to come to carry out deconvolution from the image of the data file of digital image capture device output and handle being included in, wherein said deterioration factor information is included in the described data file with described image.
According to this structure, the processing that the digital image capture device the is carried out image that to be output generated by image capturing device and be used for deterioration factor information to proofreading and correct by the deterioration of the image that image capturing device caused; And the deconvolution processing is carried out in the image rectification server apparatus.Like this, just can access the image of proofreading and correct through the deconvolution processing, and can not increase the treatment capacity of digital image capture device.
According to the present invention, calculate the optical transfer function of image taking photographic means, wherein said image taking photographic means has image taking optical system and the imageing sensor that is integrated with each other.Therefore, can calculate optical transfer function, wherein said optical transfer function reflects the image deterioration factor of crosstalking between the image deterioration factor that taken place and the inner member owing to imageing sensor in the actual image taking optical system that is arranged in the image taking photographic means, and also can calculate each optical transfer function easily and not need to disassemble described image taking photographic means simultaneously.
According to the present invention, to be associated with deterioration factor information by the image that the digital image capture device generates, and be output subsequently, described deterioration factor information is used for being proofreaied and correct by the deterioration of the caused image of image capturing device of digital image capture device, and proofreaies and correct in the image rectification server apparatus of output destination.Therefore, beneficial effect of the present invention is exactly to handle image after just can obtaining to proofread and correct by carrying out deconvolution, and can not increase the treatment capacity of digital image capture device.
Description of drawings
Fig. 1 is the structural drawing according to the spread function sensing equipment of first embodiment of the invention;
Fig. 2 is the key diagram according to the scan operation of the imageing sensor of first embodiment of the invention;
Fig. 3 is the block scheme according to the image recovery system of first embodiment of the invention;
Fig. 4 shows the point spread function data that is generated in the spread function data generating unit according to first embodiment of the invention;
Fig. 5 shows the optical transfer function that calculates in the optical transfer function computing unit according to first embodiment of the invention;
Fig. 6 is the structural drawing according to the spread function sensing equipment of second embodiment of the invention;
Fig. 7 is the structural drawing according to the spread function sensing equipment of third embodiment of the invention;
Fig. 8 is the key diagram according to the scan operation of the imageing sensor of third embodiment of the invention;
Fig. 9 is the block scheme according to the image recovery system of fourth embodiment of the invention;
Figure 10 is the structural drawing according to the image recovery system of fifth embodiment of the invention;
Figure 11 is the structural drawing according to the image recovery system of sixth embodiment of the invention;
Figure 12 is the block scheme according to the image correction system of seventh embodiment of the invention;
Figure 13 is the synoptic diagram according to the point spread function of the portable telephone apparatus of seventh embodiment of the invention;
Figure 14 is the synoptic diagram according to the optical transfer function of the portable telephone apparatus of seventh embodiment of the invention;
Figure 15 is the process flow diagram that is used to illustrate according to the operation of the image correction system of seventh embodiment of the invention;
Figure 16 is the block scheme according to the image correction system of eighth embodiment of the invention;
Figure 17 is the process flow diagram that is used to illustrate according to the operation of the image correction system of eighth embodiment of the invention;
Figure 18 is the block scheme according to the image correction system of ninth embodiment of the invention; And
Figure 19 is the process flow diagram that is used to illustrate according to the operation of the image correction system of ninth embodiment of the invention.
The preferred forms of invention
Below with reference to accompanying drawings specific embodiments of the invention are described.
(first embodiment)
Fig. 1 is the diagrammatic sketch according to the spread function sensing equipment of first embodiment of the invention.Referring to Fig. 1, described spread function sensing equipment 30 comprises that light source 31, pinhole plate 32, the outer paraboloidal mirror 33 of axle and photographic means fix (maintenance) mechanism 34.Described spread function sensing equipment 30 is the equipment that is used to measure the spread function of image taking photographic means, and wherein said image taking photographic means has image taking optical system and imageing sensor, for example CCD or cmos sensor.Light source 31 sends the light with wavelength characteristic, wherein comprises the particular characteristics of the image taking photographic means of measurand in this wavelength characteristic.With pinhole plate 32 be arranged on light source 31 near.After the pin hole that passes pinhole plate 32, this irradiates light incides on the outer paraboloidal mirror 33 of axle as divergent rays.After paraboloidal mirror 33 reflections, become does not have parallel (collimation) of chromatic aberration light to this irradiates light outside axle.This directional light incides on the image taking optical system of the image taking photographic means 11 that is fixed in the photographic means fixed mechanism 34.
Fig. 2 is the figure of the image (pin hole image) that is used to illustrate the irradiates light on the imaging region that projects to image taking photographic means 11.This pinhole plate 32 is positioned at a such position, on this position, satisfy conjugate condition, make pin hole image 71 have the paraxial ray size on the imaging region of image taking photographic means 11, wherein this image taking photographic means 11 is fixed in the photographic means fixed mechanism 34.As shown in Figure 2, the diameter of this pin hole is arranged so that the diameter of pin hole image 71 is equal to or less than half size of the element spacing of the imageing sensor on the imaging region of image taking photographic means 11.Half the reason that the diameter of pin hole image 71 is set to be less than or equal to element spacing is exactly that pointolite in measuring by optical transfer function makes and is equal to image information by photographic means from the spread function that radiation source forms.
This photographic means fixed mechanism 34 is the mechanisms that are used for fixing the image taking photographic means 11 of measurand.This photographic means fixed mechanism 34 comprises rotating mechanism, is used to allow X-axis and the Y-axis rotation of this image taking photographic means 11 that is fixed around imageing sensor.As shown in Figure 2, by rotating around X-axis, this pin hole image is in the Y direction relative motion of imaging region upper edge.By rotating around Y-axis, this pin hole image is in the X-direction relative motion of imaging region upper edge.When by this this image taking photographic means 11 of rotating mechanism stepping ground rotation of use, on the direction of X-axis or Y-axis, the imageing sensor of this image taking photographic means is scanned by irradiates light.The stepping amount of rotation is set to certain width, and this width makes this pin hole image in fact less than the element spacing of imageing sensor, for example is set to about 1/10th of element spacing.The imageing sensor of this image taking photographic means 11 all carries out opto-electronic conversion for each rotation stepping, to generate electric signal.
Fig. 3 is the block scheme according to the structure of the image recovery system 10 of first embodiment.As shown in Figure 3, this image recovery system 10 comprises that image taking photographic means 11, image restore data generate equipment 12 and image correcting device 13.This image taking photographic means 11 comprises image taking optical system, imageing sensor and A/D converter.When in the photographic means fixed mechanism 34 that is placed on spread function sensing equipment 30, this image taking photographic means 11 will be exported to electric signal 81 the image restore data and generate equipment 12, and wherein this electric signal 81 is being undertaken obtaining in the opto-electronic conversion by imageing sensor.In common image capture operation, the electric signal that this image taking photographic means 11 can will obtain in imageing sensor is exported to image correcting device 13 as view data 82.Carry out data transmission/reception by the wired or wireless communication that generates between equipment 12 and the image correcting device 13 in image taking photographic means 11, image restore data.Replace above-mentioned each communication mode, also can carry out data transmission by between each equipment, using portable recording medium.
This image restore data generates equipment 12 and comprises spread function data generating unit 14, optical transfer function computing unit 15, distorted characteristic data generating unit 16 and data file creating unit 17.The function of this spread function data generating unit 14 is to use the electric signal 81 of image taking photographic means 11 outputs from be placed on spread function sensing equipment 30 to come for each detected element generates spread function data 83, and the spread function data 83 of output generation.According to the spread function data generating unit 14 of present embodiment, it generates point spread function data as the spread function data.The function of this optical transfer function computing unit 15 is that the spread function data 83 of each detected element are carried out Fourier transform, and calculate optical transfer function 84 for each detected element, wherein these spread function data 83 are from 14 outputs of spread function data generating unit, and this optical transfer function 84 is made of fourier spectrum and phase propetry.
The function of this distorted characteristic data generating unit 16 is to use the distorted characteristic data 85 that generate the presentation video distortion from the spread function data 83 of a plurality of detected element of spread function data generating unit 14 outputs.The function of this data file creating unit 17 is to create image restore data file 86 and with its output.The distorted characteristic data that this image restore data file 86 comprises the optical transfer function of all detected element and generates in distorted characteristic data generating unit 16.
This image correcting device 13 comprises pixel intensity converting unit 18, image restore data interpolating unit 19, deconvolution processing unit 20, distortion correction unit 21 and recovers image output unit 22.The function of this pixel intensity converting unit 18 is to carrying out intensity-conversion from the view data of image taking photographic means 11 outputs, to generate image intensity data 87.The function of this image restore data interpolating unit 19 is to carry out interpolation processing by the optical transfer function that uses detected element, and calculates the optical transfer function of the element except detected element whereby.The optical transfer function that is used by image restore data interpolating unit 19 is included in from the image restore data file of image restore data generation equipment 12 outputs.By this interpolation processing, this image restore data interpolating unit 19 has been created the optical transfer function 88 of all elements.The function of this image restore data interpolating unit 19 is that the distorted characteristic data that are included in the image restore data are changed, to generate distortion correction data 89.
The function of this deconvolution processing unit 20 is the optical transfer functions that generate in the image restore data interpolating unit 19 by being used in, the image intensity data 87 that generated by pixel intensity converting unit 18 are carried out deconvolution handle, and generate the view data 90 after recovering thus.The function of this distortion correction unit 21 is the distortion correction datas 89 that generate in image restore data interpolating unit 19 by using, view data 90 after the recovery that generates in deconvolution is handled is carried out distortion correction, and generate distortion correction view data 91 thus.The effect of output unit 22 is these distortion correction view data 91 of output.
To describe the spread function sensing equipment 30 with said structure and the operation of image recovery system 10 below.Below will be respectively to generation include optical transfer function and distorted characteristic data image restore data file 86 operation and describe by the operation of using 86 pairs of view data 82 of image restore data file to proofread and correct.
At first, will the operation that generate image restore data file 86 be described.In order to create image restore data file, at first, this image taking photographic means 11 is placed in the photographic means fixed mechanism 34 of spread function sensing equipment 30.In this case, this image taking photographic means 11 is placed on such direction: promptly, make the image taking optical system of this image taking photographic means 11 receive the reflected light from the outer paraboloidal mirror 33 of axle.Light source 31 sends irradiates light.This irradiates light passes the pin hole of pinhole plate 32, by outer paraboloidal mirror 33 calibrations of axle, and is reflected towards the image taking photographic means 11 that is fixed in the photographic means fixed mechanism 34.This reflected light passes the image taking optical system of image taking photographic means 11, and is radiated on the imaging region.In this state, irradiates light scans imageing sensor.
When the pin hole image was projected on the imageing sensor of imaging region, this photographic means fixed mechanism 34 steppings ground was around Y-axis rotation (referring to Fig. 1).Therefore, this irradiates light image scans along the direction of the X-axis element (detected element) to the composing images sensor.Also have, when photographic means fixed mechanism 34 rotated around X-axis, this irradiates light was along this element of scanning direction of Y-axis.Each rotation stepping, the imageing sensor of this image taking photographic means 11 all carries out opto-electronic conversion to irradiates light.This imageing sensor will be exported to the spread function data generating unit 14 that the image restore data generates equipment 12 by carrying out the resulting electric signal 81 of opto-electronic conversion.To each stepping when image taking photographic means 11 receives electric signal, this spread function data generating unit 14 generates spread function data 83 by using this electric signal 81.
Fig. 4 is a synoptic diagram of having showed the spread function data 83 that generated by spread function data generating unit 14.In the figure of Fig. 4, horizontal ordinate is a scanning angle, and ordinate is the intensity from the electric signal of detected element output.When the scanning angle of spread function data is converted into the focal length of image taking optical system, just obtained the spatial spread function data.
As shown in Figure 4, because aberration, the distribution shape of these spread function data 83 is not point-symmetric.In the present embodiment, as shown in Figure 4, when scanning by irradiates light on the direction in Y-axis, the distribution that this distribution will be when scanning by irradiates light on the direction of X-axis is wideer.This represents that this irradiates light image has formed ellipse on imaging region; (oval) major axis is a Y direction, and minor axis is an X-direction.
This spread function sensing equipment 30 and image recovery system 10 be by measuring spread function to a plurality of elements in the enterprising line scanning of X-direction, and by a plurality of elements are measured spread function in the enterprising line scanning of Y direction.At this, all carry out at per five elements along the scanning on the X-direction and along the mensuration that the scanning on the Y direction is carried out.From imageing sensor, select element to be determined equably.Spread function data generating unit 14 generates the spread function data for each detected element, and outputs it to optical transfer function computing unit 15 and distorted characteristic data generating unit 16.This optical transfer function computing unit 15 carries out Fourier transform with spatial frequency to the spread function data 83 from tested each element of spread function data generating unit 14 output, and calculates the optical transfer function 84 of each detected element thus.
Fig. 5 is a synoptic diagram, shows in optical transfer function computing unit 15, by the spread function data of being exported by spread function data generating unit 14 83 are carried out the optical transfer function 84 that Fourier transform obtains.As shown in Figure 5, this optical transfer function 84 is made up of fourier spectrum and phase propetry.According to present embodiment, in spread function data generating unit 14,10 spread function data 83 have been generated corresponding to 10 detected element.Like this, this optical transfer function computing unit 15 can carry out Fourier transform to these spread function data 83, and calculates 10 optical transfer functions 84 thus.
This distorted characteristic data generating unit 16 receives from the spread function data 83 of spread function data generating unit 14 outputs.According to these spread function data 83, this distorted characteristic data generating unit 16 is calculated scanning angle (maximum intensity angle) for each detected element, has maximal value in this scanning angle place pixel intensity.Then, according to the maximum intensity angle of each detected element and about the information of the position of these detected element, this distorted characteristic data generating unit 16 has peaked scanning angle for the element that does not become determination object calculates pixel intensity.The maximum intensity angle-data of each element of Sheng Chenging is equivalent to the distorted characteristic of the intensity center of gravity of each element in this manner.These distorted characteristic data generating unit 16 these data of output are as distorted characteristic data 85.
This data file creating unit 17 is created image restore data file 86, and export this image restore data file 86, comprise in this image restore data file 86 from the optical transfer function 84 of each element of optical transfer function computing unit 15 output and from the distorted characteristic data 85 of distorted characteristic data generating unit 16 outputs.
To come the operation of image correcting data 82 to describe to using image restore data file 86 now.At first, image restore data interpolating unit 19 receives the image restore data file 86 that generates equipment 12 outputs from the image restore data.As mentioned above, according to present embodiment, this image restore data file 86 includes only 10 optical transfer functions 84 corresponding to 10 detected element.This image restore data interpolating unit 19 uses these 10 optical transfer functions 84 to carry out interpolation processing, and calculates the optical transfer function of the element except those detected element.For interpolation processing, can adopt known technology, for example spline interpolation (spline interpolation).Can calculate the optical transfer function 88 of all elements on the imaging region by this interpolation processing.
The distorted characteristic data 85 that this 19 pairs of image restore data interpolating unit is included in the image restore data file 86 are changed, and generate distortion correction data 89 thus.The optical transfer function 88 and the distortion correction data 89 of the generation of these image restore data interpolating unit 19 all elements of storage.
Now to using image restore data file to come the operation of image correcting data to describe.Pass the image taking optical system of image taking photographic means 11 and be projected on the imaging region from the light of the body that is taken.Then, imageing sensor carries out opto-electronic conversion to the light from the body that is taken and generates and output image data 82.Because the factor such as crosstalk of image taking optical system aberration and inner member and the view data 82 of deterioration will be proofreaied and correct by image correcting device 13 for example.
This image correcting device 13 receives from the view data 82 of image taking photographic means 11 outputs.In image correcting device 13,18 pairs of view data of pixel intensity converting unit 82 are carried out intensity-conversion, and generate image intensity data 87 thus.Subsequently, 20 pairs of image intensity data 87 that generate in pixel intensity converting unit 18 of deconvolution processing unit are carried out the deconvolution processing.This deconvolution processing unit 20 uses the optical transfer function 88 that is stored in the image restore data interpolating unit 19, and carries out deconvolution thus and handle.
Function below this deconvolution processing unit 20 uses as deconvolution handle recover wave filter M (u, v).
[formula 1]
M ( u , v ) = H * ( u , v ) S ff ( u , v ) S ff ( u , v ) | H ( u , v ) | 2 + S vv ( u , v )
= 1 H ( u , v ) | H ( u , v ) | 2 | H ( u , v ) | 2 + [ S vv ( u , v ) / S ff ( u , v ) ]
In the equation above, (u v) is an optical transfer function to H; S FfBe the spectral density of input signal (i.e. the image intensity data of exporting from pixel intensity converting unit 18 87); S Vv(u v) is a noise spectrum density.
When original image f (x, y), the image g of deterioration (x, y) and the image f^ after recovering (x, two-dimension fourier transform y) be respectively F (u, v), G (u, v) and F^ (u, in the time of v),
F^ (u, v)=(H (and u, v) * M (u, v)) * F (u, v), and
F^(u，v)＝M(u，v))*G(u，v)
Wherein " * " represents convolution integral.Deconvolution processing unit 20 by recover wave filter M (u, v) to the deterioration image carry out two-dimension fourier transform G (u, convolution integral v), with calculate F^ (u, v), and then to F^ (u v) carries out inverse-Fourier transform, with calculate image f^ after recovering (x, y).This deconvolution processing unit 20 according to the noise properties of view data for each to carry out view data that deconvolution handles create recover wave filter M (u, v).
View data 90 is exported to distortion correction unit 21 after the recovery that this deconvolution processing unit 20 will generate.In the view data 90 after recovery, there are the deterioration vestiges that cause owing to image fault.Distortion correction data 89 is read in this distortion correction unit 21 from image restore data interpolating unit 19.In order to generate distortion correction view data 91, this distortion correction unit 21 uses the view data 90 after 89 pairs of recoveries of distortion correction data to carry out distortion correction; This distortion correction is made of coordinate conversion and interpolation processing.This distortion correction unit 21 is by output unit 22 output distortion image correcting datas 91.The output destination of this distortion correction view data 91 can be storer, portable storage media or the monitor in the image correcting device 13.Optionally, this output unit 22 can output to communication line with distortion correction view data 91 and gets on.
According to the method for the mensuration optical transfer function of present embodiment,, also can carry out the mensuration of spread function though image taking optical system and imageing sensor are mounted in the image taking photographic means 11.Therefore, obtained the spread function data, these spread function data comprise the influence that focus state, the interelement of image taking photographic means 11 are crosstalked or the like.In image correcting device 13, the optical transfer function that obtains from the spread function data is used to carry out deconvolution and handles.Therefore, not only can reduce the deterioration of the image that the restriction owing to the resolution performance of image taking optical system causes, can also reduce the deterioration of the image that causes owing to influence that focus state and interelement are crosstalked, so just can obtain the view data after the high-resolution recovery.
According to present embodiment, for each element calculates the spread function data, to calculate optical transfer function.Therefore,, also can suitably proofread and correct, to obtain the view data after the high-resolution recovery to the image deterioration of this degree even when the degree of image deterioration changes according to incoming position.Because for each element calculates spread function, so when identifying the peak value of spread function, just can calculate the scanning angle when inciding sensor central when irradiates light from light source.Therefore, just can generate distortion correction data, be used for the image fault that causes owing to the image taking optical system is proofreaied and correct.When this distortion correction data is used to image correcting data, can obtain to have the view data after the recovery that has reduced image fault, this image fault is caused by the image taking optical system.
(second embodiment)
To describe the second embodiment of the present invention now.
According to above-mentioned first embodiment, the rotation of image taking photographic means 11 relatively moves irradiates light on the imaging region of imageing sensor, scan detected element whereby.According to present embodiment, image taking photographic means 11 is maintained fixed, and the position of irradiates light changes, and scans detected element whereby.
Fig. 6 is the structural drawing according to the spread function sensing equipment of present embodiment.As shown in Figure 6, in spread function sensing equipment 40, the light that irradiates from light source 41 passes the pin hole of pinhole plate 42, and is reflected by the outer paraboloidal mirror 43 of axle and become parallel (collimation) light.Then this parallel radiation light mirror 45 reflections that are reflected, and incide on the image taking optical system of the image taking photographic means 11 that is fixed in the photographic means fixed mechanism 44.
This catoptron 45 can be around X-axis in the minute surface or Y-axis rotation.Make this catoptron 45 around X-axis or the rotation of Y-axis stepping ground by the rotary drive mechanism (not shown).When catoptron 45 rotated around Y-axis, the image of irradiates light direction along X-axis on imaging region moved.When catoptron 45 rotated around X-axis, the image of irradiates light direction along Y-axis on imaging region moved.In this way, by making catoptron 45 rotations, irradiates light can be along X-direction and Y direction scanning detected element.
The scanning detected element is all identical with first embodiment with the processing of the processing that generates spread function data 83 for each detected element and generation optical transfer function 84 subsequently and distorted characteristic data 85.The processing that recovers view data 82 by use image correcting device 13 is also similar with first embodiment.According to present embodiment, also can obtain similar beneficial effect with first embodiment.
(the 3rd embodiment)
To describe the third embodiment of the present invention now.
In spread function sensing equipment 30 according to above-mentioned first embodiment, with pinhole plate 32 be arranged in light source 31 near, will be similar to a little irradiates light image projection whereby on imaging region.According to present embodiment, replace pinhole plate 32, slit plate is provided, come scanning image sensor by linear irradiates light whereby.
Fig. 7 is the structural drawing according to the spread function sensing equipment of present embodiment.As shown in Figure 7, in spread function sensing equipment 50, slit plate 52 is positioned near the light source 51.This slit plate 52 is fixed in the slit fixed mechanism 56.This slit fixed mechanism 56 has the mechanism of this slit plate 52 of rotation, makes the longitudinal direction of slit to be adjusted into vertical or horizontal direction.The irradiates light that sends from light source 51 passes the slit of slit plate 52, and is reflected by the outer paraboloidal mirror 53 of axle and become directional light.
By being fixed on the image taking optical system of the image taking photographic means 11 in the photographic means fixed mechanism 54, this directional light is projected on the imaging region of imageing sensor.The slit width of this slit plate 52 is set, makes the paraxonic picture traverse of the image on the imageing sensor be projected in image taking photographic means 11 be equal to or less than half of element spacing of imageing sensor.Half the reason that the paraxonic picture traverse is set to be equal to or less than element spacing is, makes to be equal to the image that is formed by line source from radiation source by the line spread function that photographic means forms in optical transfer function is measured.
The basic structure and first embodiment according to the image recovery system 10 of present embodiment are similar.In the present embodiment, slit photoscanning detected element.Therefore, in spread function data generating unit 14, can obtain the spread function data of a plurality of detected element simultaneously.
Below will be to describing according to the spread function sensing equipment 50 of the 3rd embodiment with said structure and the operation of image recovery system 10.At first, this slit fixed mechanism 56 is fixed this slit plate 52, makes the longitudinal direction of this slit be adjusted to longitudinal direction.As mentioned above, pass the slit of slit plate 52, and by an outer paraboloidal mirror 53 reflections of axle, and become the directional light of slit-shaped and incide on the image taking photographic means of in photographic means fixed mechanism 54, fixing 11 from the irradiates light of light source 51.Then, the image taking optical system by this image taking photographic means 11 with this slit optical projection on imaging region.
Fig. 8 is the figure that is used to illustrate the image (slit image) of the slit light that is projected on the imaging region.When slit is fixed in a longitudinal direction, obtain slit image 72a.In this state, 54 steppings of photographic means fixed mechanism image taking photographic means 11 is rotated around Y-axis.Therefore, this slit image 72a is in a plurality of detected element that are arranged on the Y direction of scanning on the X-direction.When scanning image sensor on Y direction, this slit fixed mechanism 56 revolves slit plate 52 and turn 90 degrees, and makes the longitudinal direction of slit 52 be adjusted to horizontal direction.Therefore, parallel with X-axis slit image 72b is projected on the imaging region.In this state, when 54 steppings of photographic means fixed mechanism when image taking photographic means 11 is rotated around X-axis, this slit image 72b moves along Y direction.
The imageing sensor of image taking photographic means 11 carries out opto-electronic conversion to the projected light of each stepping, obtaining electric signal 81, and this electric signal 81 is exported to the spread function data generating unit 14 that the image restore data generates equipment 12.When image taking photographic means 11 receives the electric signal 81 of each stepping, this spread function data generating unit 14 uses these electric signal 81 to generate spread function data 83.According to present embodiment, spread function data generating unit 14 generates the line spread function data as spread function data 83.
The generation optical transfer function 84 that is carried out after the spread function data 83 of a plurality of detected element that obtain imageing sensor and the processing and first embodiment of distorted characteristic data 85 are similar.Also similar to the processing that the view data 82 that generates by image taking photographic means 11 is recovered with first embodiment.
In the above example, change the slit direction of light by the direction that changes slit plate 52, this slit light scans detected element on the direction of X-axis and Y-axis whereby.Replacement to what the direction of slit plate 52 changed is, also can the direction of image taking photographic means 11 be revolved to turn 90 degrees by photographic means fixed mechanism 54 to change the direction that is projected in the slit image on the imaging region.
According to present embodiment, also can obtain similar beneficial effect with first embodiment.In the present embodiment, slit light scans imageing sensor, to measure the spread function of a plurality of elements simultaneously.Like this, just might increase the quantity of measuring point or shorten minute.Especially, when becoming bigger in no aberration (aplanatism) scope of slit length paraboloidal mirror 53 outside axle of slit plate 52, this beneficial effect is better.
(the 4th embodiment)
Now the fourth embodiment of the present invention is described.The structure and first embodiment according to the spread function sensing equipment of the 4th embodiment are similar.In the present embodiment, the structure of image recovery system 10 is different with the foregoing description.
Fig. 9 is the block scheme of having showed according to the structure of the image recovery system of the 4th embodiment.In Fig. 9, identical reference number is represented the image recovery system 10 similar ingredients with first embodiment, and has omitted the explanation to it.As described in Figure 9, image recovery system 10 comprises that image taking photographic means 11, image restore data generate equipment 12 and image correcting device 13.The image restore data generates equipment 12 and comprises spread function data generating unit 14, optical transfer function computing unit 15, distorted characteristic data generating unit 16 and data file creating unit 17.Similar with first embodiment, this image restore data generates equipment 12 and generates image restore data file 86, comprises the optical transfer function 84 and the distorted characteristic data 85 of a plurality of detected element in this image restore data file 86.Further, data file creating unit 17 according to present embodiment is given mark of image restore data file 86 affixs, this mark represents to be used to specify the document number of image restore data file 86, to generate and to export the image restore data file 92 that has mark.
After receiving the image restore data file 92 that has mark, this image taking photographic means 11 carries out a processing, is used for coming log file number by image correcting device 13.In this was handled, the image restore data file 92 that image taking photographic means 11 will have mark sent to image correcting device 13.In this image correcting device 13, when receiving the image restore data file 92 that has mark, this image restore data interpolating unit 19 is carried out and similar interpolation processing of first embodiment and conversion process, with optical transfer function 88 and the distortion correction data 89 that generates all elements.The optical transfer function 88 of all elements that this image restore data interpolating unit 19 will generate and distortion correction data 89 be associated by the represented document number of each mark, and store them.
Now to using image restore data file to come the operation of image correcting data to describe.This image taking photographic means 11 is caught the image of the body that is taken.This image taking photographic means 11 is for by carrying out mark of view data affix that image capturing obtains, and this mark represents to be used to specify the document number of image restore data file, to generate and output has the view data 93 of mark.The markd view data 93 of these image correcting device 13 receiving belts, and use and come view data is carried out deconvolution processing and distortion correction by corresponding optical transfer function 88 of the represented document number of this mark and distortion correction data 89.
According to present embodiment, even when the optical transfer function and the distortion correction data of various image taking photographic means 11 all is stored in the image correcting device 13, with respect to the view data that is obtained, also can prevent to have used mistakenly optical transfer function and distortion correction data, these optical transfer functions and distortion correction data should be used by deconvolution processing unit 20 and distortion correction unit 21.
(the 5th embodiment)
To describe the fifth embodiment of the present invention now.Figure 10 is the synoptic diagram of having showed according to the image recovery system 10 of present embodiment.This image recovery system 10 comprises mobile telephone equipment 60 and image correcting device 13.This mobile telephone equipment 60 comprises image taking photographic means 11.Similar with the image taking photographic means 11 of first embodiment, this mobile telephone equipment 60 is placed in the photographic means fixed mechanism 34 of spread function sensing equipment 30, and this image taking photographic means 11 is created image restore data file 86, and this image restore data file 86 is made up of the optical transfer function and the distorted characteristic data of tested each element.This mobile telephone equipment 60 is stored in image restore data file 86 in the internal storage 61.
This mobile telephone equipment 60 comprises data transmission unit 62.After generating view data 82 by the image that makes the image taking photographic means 11 of mobile telephone equipment 60 catch the body that is taken, view data 82 and image restore data file 86 that this mobile telephone equipment 60 will be stored in the internal storage 61 are given image correcting device 13 as one group of data transmission.This image correcting device 13 has the similar structure with first embodiment.When this image correcting device 13 received view data 82 and image restore data file 86, the operator of image correcting device 13 can use the 86 pairs of view data of image restore data file 82 that receive to carry out deconvolution processing and distortion correction.
According to above-mentioned structure, the image restore data file that view data and being used to is recovered view data receives as one group of data, makes it possible to recover at an easy rate in image correcting device original image.
(the 6th embodiment)
To describe the sixth embodiment of the present invention now.Figure 11 is the synoptic diagram of having showed according to the image recovery system 10 of the 6th embodiment.This image recovery system 10 comprises mobile telephone equipment 60 and image correcting device 13.This mobile telephone equipment 60 comprises image taking photographic means 11.Similar with the image taking photographic means 11 of first embodiment, this mobile telephone equipment 60 is placed in the photographic means fixed mechanism 34 of spread function sensing equipment 30, and create image restore data file 86, and this image restore data file 86 is made up of optical transfer function 84 and distorted characteristic data 85.This mobile telephone equipment 60 is stored in image restore data file 86 in the internal storage 61.
This mobile telephone equipment 60 comprises mark generation unit 63.When image taking photographic means 11 captures the image of the body that is taken and generates view data 82, this mark generation unit 63 will be given mark of this view data affix, this mark represents to be used to specify the document number of the image restore data file 86 that is stored in the internal storage 61, and generates the view data 92 that has mark thus.
This mobile telephone equipment 60 comprises data transmission unit 62.This data transmission unit 62 will have the mark that generates in mark generation unit 63 view data 92 is transferred to image correcting device 13.This image correcting device 13 has the image correcting device 13 similar structures with the 4th embodiment.When the markd view data of these image correcting device 13 receiving belts, the operator uses and carries out deconvolution processing and distortion correction by the represented 86 pairs of view data that obtain of the corresponding image restore data of this article piece number file of this mark.
According to above-mentioned structure, will represent that by mark generation unit 63 mark of document number is additional to view data, have the view data of mark with generation, and transmit the view data that this has mark.Therefore, this image correcting device 13 can be handled, and can not select the image restore data mistakenly from mixed file.Need not carry out timing, all, so just reduce the traffic from mobile telephone equipment 60 images restore data files in each 13 pairs of view data that receive from mobile telephone equipment 60 of this image correcting device.
It should be noted that, in the above description, described image restore data generates 12 optical transfer functions 84 that calculate detected element of equipment, and the image restore data interpolating unit 19 of image correcting device 13 is carried out interpolation processing, calculate the optical transfer function of each element except those detected element thus, but the present invention is not limited to this.This image restore data generates equipment 12 can carry out interpolation processing, and generates the optical transfer function of all elements thus.In the above description, this image restore data generates the distorted characteristic data 85 that equipment 12 generates the distorted characteristic of presentation video photographing optical system, and 19 pairs of distorted characteristic data 85 of image restore data interpolating unit of image correcting device 13 are changed, to generate distortion correction data 89.The present invention is not limited to this, and described image restore data generates equipment 12 can generate distortion correction data.
In the above description, some elements of selecting the composing images sensor are as detected element, and the spread function data 83 of generation detected element, to calculate optical transfer function.Each element for except these detected element comes the calculating optical transport function by interpolation processing.The present invention is not limited to this, can scan all elements by irradiates light, generating the spread function data of all elements, and can calculate the optical transfer function of all elements, and not need to carry out any interpolation processing.
In the above description, in the spread function sensing equipment, the irradiates light that passes pin hole or slit is converted into directional light by the outer paraboloidal mirror reflection of axle.But, also can transmit this irradiates light by the printing opacity system, wherein the aberration of this printing opacity system is corrected, to be converted into directional light.
In the above description, scan detected element by image rotating shooting photographic means or catoptron.But, can scan detected element by image taking photographic means or catoptron are moved abreast.
In the above description, an example has been described, the document number that wherein is used to specify data file is used as label information.Also can use another kind of information.For example, the filename of the data file of photo-optics apparatus system, configuration information etc. such as zoom condition and F number/aperture etc., can be used as label information.
(the 7th embodiment)
Figure 12 is the synoptic diagram of having showed according to the image correction system of the 7th embodiment.Referring to Figure 12, this image correction system 110 comprises portable telephone apparatus 101 and the image rectification server apparatus 102 that has photographic means, and they can intercom mutually by network 103.
This network 103 for example is the Internet.Data transmission/reception by network 103 can be the transmission by Email.Optionally, can wait transmitting/receiving data by the CGI (CGI (Common Gateway Interface)) that uses Web server/client-side technology.
This portable telephone apparatus 101 comprises image taking optical system 111, two-dimensional image sensor 112 and graphics processing unit 113.This image taking optical system 111 is the universal focus lens system.This two-dimensional image sensor 112 by solid state image sensor for example CCD constitute, and its function is to carry out opto-electronic conversion by 111 pairs of light from the body that is taken of image taking optical system.The function of this graphics processing unit 113 is that the electric signal that generates carrying out opto-electronic conversion by two-dimensional image sensor 112 carries out following processing, for example AD conversion, DCT conversion, quantization and entropy coding, and generate the image that compresses according to jpeg format thus.This portable telephone apparatus 101 is equivalent to digital image capture device of the present invention.Image capturing device of the present invention is made of image taking optical system 111, two-dimensional image sensor 112 and graphics processing unit 113.
When portable telephone apparatus 101 had the structure of thickness attenuation and miniaturization, the focal length of image taking optical system 111 also was shortened.Like this, the F number is exaggerated and the fuzzy volume image that is taken is projected on the two-dimensional image sensor 112.Therefore, the image quality in images that obtains in graphics processing unit 113 is because the former thereby deterioration of image taking optical system 111.To be described this image deterioration below.
Have not a particle of youngster's aberration even work as image taking optical system 111, the optical transfer function and the threshold frequency that have defined the resolution of this image taking optical system 111 also depend on the F number.More specifically, when the F of image taking optical system 111 number became big, point spread function (PSF) was very wide, and optical transfer function and threshold frequency have been lowered, and the resolution of image taking optical system 111 has also worsened.
Figure 13 is a synoptic diagram of having showed point spread function.Referring to Figure 13, dotted line is represented the point spread function of the image taking optical system that the F number is big.Solid line is represented the point spread function of the image taking optical system that the F number is little.As can be seen from Figure 13, when the F number was big, point spread function was wide.When point spread function was wide, Rayleigh (Rayleigh) the resolution performance (ra=1.22 λ F) of differentiating two given arbitrarily points had increased.
Figure 14 is the synoptic diagram that is used to represent to increase as the Fourier transform of point spread function by optical transfer function the Rayleigh resolution performance.Referring to Figure 14, dotted line is represented the situation that the F number is little, and solid line is represented the situation that the F number is big.In the big image taking optical system of F number, under the situation of identical spatial frequency, very little as the MTF (modulation transfer function) of the absolute value of optical transfer function, and further, when not having aberration, threshold frequency is very little and represent with Uc=1/ (λ F).
Therefore, select focal length and entrance pupil to make that directly the F number is fully reduced usually.But in having the portable telephone apparatus of photographic means, thickness is lowered and number of lenses is restricted, and therefore can't reduce the F number.In this case, when the F number increases, the aberration effect more likely occurs, so just reduced the radio-frequency component in the mtf value.Even Here it is why the pixel count of two-dimensional image sensor 112 increased the reason that also can't improve picture quality.
When this problem is described to be described below by optical transfer function being carried out Fourier transform when obtaining the problem of point spread function.That is, in the big image taking optical system of F number, point spread function is very wide with respect to pel spacing.Therefore, can't fully approximating two points be differentiated the degree of Rayleigh resolution performance, and the resolution performance that will not represent to differentiate two points is brought up to the degree that pixel count increases in two-dimensional image sensor.
Pixel count in the increase two-dimensional image sensor causes the increase of spatial sampling frequency.When pixel count increased, the space Nyquist frequency also increased, and under the situation of identical aperture ratio, and MTF has high value when reaching more high spatial frequency.Therefore, when the pixel count in the two-dimensional image sensor increased, MTF can significantly reduce at certain spatial frequency place, and this spatial frequency can not cause any problem in the big image taking optical system of F number before pixel count increases.As mentioned above, along with the increase of portable telephone apparatus attenuation and pixel count, deterioration has taken place in the image that the image capturing device that is made of image taking optical system 111, two-dimensional image sensor 112 and graphics processing unit 113 by use obtains.
Be back to Figure 12, this portable telephone apparatus 101 comprises image storage unit 114 and display unit 115.This image storage unit 114 stores the image that generates in graphics processing unit 113.The function of this display unit 115 is to show the image that is stored in the image storage unit 114.
This portable telephone apparatus 101 further comprises operating unit 116, optical transfer function storage unit 117, data file creating unit 118 and wireless transmission/receive unit 119.This operating unit 116 comprises the button that is used to receive from user's various inputs.The optical transfer function of these optical transfer function storage unit 117 storage portable telephone apparatus 101.Usually, this optical transfer function storage unit 117 is the different optical transfer function of each independent portable telephone apparatus storage.
Optical transfer function is used to handle by deconvolution as hereinafter described the calibration object image is proofreaied and correct.Usually, in order to measure the optical transfer function of digital photographing apparatus, must on the imaging surface of the image taking optical system of digital photographing apparatus, special-purpose optical transfer function sensing equipment be installed, in order to measure.In order to carry out this mensuration, the operation that just need disassemble and reset digital photographing apparatus.Usually, the user of digital photographing apparatus does not have this sensing equipment, and the disassembling and reset and be not easy and carry out of digital photographing apparatus.Further, for domestic consumer, not only will solve the MTF of image taking optical system separately, but also will solve the MTF of the whole digital photographing apparatus that comprises two-dimensional image sensor, this is very difficult.
Therefore, there has been a kind of basis to come the method for calculating optical transport function, and do not needed extra sensing equipment by the image that the image capturing of digital photographing apparatus generates.This method of calculating the MTF of whole digital photographing apparatus according to the image that obtains by digital photographing apparatus is side by side estimated the MTF and the single MTF of image taking optical system of two-dimensional image sensor, so this method is a kind of technology of great use for the MTF that calculates digital photographing apparatus.As this MTF computing technique, for example, known a kind of technology, this technology is used the resoliving power test target of ISO-12233, and the Fourier transform of the differential by use edge of a knife image (knife-edgeimage) comes the calculating optical transport function.Also have, known a kind of technology, this technology is used sinusoidal wave test pattern, and calculates the mtf value at each spatial frequency place thus according to resulting contrast (contrast) behind the image capturing.
But, in the technology of using sinusoidal wave test pattern, must use test pattern with sinusoidal contrast.This test pattern is very expensive, and can't be used by domestic consumer at an easy rate.Further, calculating mtf value itself from this test pattern also is not easy to carry out.As mentioned above, for domestic consumer, it all is very difficult obtaining the required MTF of deconvolution processing with any method.
When the deconvolution that does not need MTF is handled, known that blind deconvolution processing is used to recover the blurred picture of Hubble Telescope.It not is that domestic consumer can stablize and easy-to-use technology that but this blind deconvolution is handled.In this blind deconvolution is handled, estimate optical transfer function and deconvolution image simultaneously by process of iteration, so calculated amount is very big, and further, the reliability of result of calculation is also very low.
Therefore, this blind deconvolution is handled only effective under given conditions.These specified conditions mean, for example, under this condition, can suppose, in actual observation, as the situation of recovering picture rich in detail from the blurred picture of Hubble Telescope, the point spread function of measuring from celestial image arrives such degree: celestial body can be assumed to be desirable pointolite.Under the situation of common image, be difficult to stable and this blind deconvolution processing of use easily.Like this, have only when optical transfer function can't be found the solution and simultaneously the character of original image be when knowing in advance to a certain extent, this blindness deconvolution is only effectively.As the situation of present embodiment, the portable telephone apparatus 101 of the photographic means of catching any given image is handled and is not suitable for having in this blind deconvolution.
Like this, according to present embodiment,, measure optical transfer function, and the optical transfer function of this portable telephone apparatus 101 is stored in advance in the optical transfer function storage unit 117 in the fabrication phase of the portable telephone apparatus 101 that has photographic means.Therefore, when buying this portable telephone apparatus 101, this user just can also obtain the optical transfer function of this image capturing device when obtaining being used to catch the image capturing device of image.
When this image taking optical system 111 has zoom function, will be stored in the optical transfer function storage unit 117 with the corresponding a plurality of optical transfer functions of variation in zoom or focusing.Also have, under the situation of coloured image, come measuring point spread function or MTF with respect to each color of RGB.It should be noted that the reasons such as aberration owing to the image taking optical system, point spread function is general to be changed according to the position in image, and the mtf value that solves with test pattern changes between the central authorities of imaging region and four angles.Imaging region is divided into a plurality of zonules and is each zonule storing optical transport function, is effectively thereby image deconvolution processing is carried out in each zonule.For different point spread functions is calculated in each zonule, point spread function can be defined as the function of position, to carry out interpolation.
This data file creating unit 118 is read the image by user's appointment according to the user instruction from operating unit 116 from image storage unit 114, as the calibration object image, and read optical transfer function from optical transfer function storage unit 117 simultaneously.The function of this data file creating unit 118 is to create data file, in this data file, and image that will be corrected and the optical transfer function connection that is relative to each other.In this data file, can define optical transfer function for a calibration object image singlely; For example, two groups of data (calibration object image and optical transfer function) are become files, perhaps the part of two data titles is shared.
The function of this wireless transmission/receive unit 19 is that the data file that will create in data generating unit 118 wirelessly is sent to network 103, and by network 103 this data file is transferred to image rectification server apparatus 102.Be used in this manner create data file and its structure that is transferred to image rectification server apparatus 102 is equivalent to output unit of the present invention or transmitting device.It should be noted that except above-mentioned function, portable telephone apparatus 101 also has such as functions such as telephone communication that is undertaken by unshowned structure and Web browsers.
This image rectification server apparatus 102 comprises transmission unit 121 and deconvolution processing unit 122.The function of this transmission unit 121 is to receive the data file of sending from portable telephone apparatus 101, and the image after the correction that will obtain in deconvolution processing unit 122 sends it back portable telephone apparatus 101.This transmission unit 121 is equivalent to receiving trap of the present invention and transmitting device.The function of this deconvolution processing unit 122 is to use the optical transfer function that is included in the data file to come the image that is included in this data file is carried out the deconvolution processing, and wherein this data file is received by transmission unit 121.This deconvolution processing unit 122 is equivalent to image correction apparatus of the present invention.
Below with reference to Figure 15 the operation of high resolution image system 110 with said structure is described.At first, two-dimensional image sensor 112 receives light from the body that is taken by image taking optical system 112, and the light that receives is carried out opto-electronic conversion, with the output electric signal.113 pairs of electric signal from two-dimensional image sensor 112 outputs of this graphics processing unit are handled, to create image.The image of being created by graphics processing unit 113 is stored in (step S41) in the image storage unit 114.Then, the user handles this operating unit 116, specifies a calibration object image thus in a plurality of images from be stored in image storage unit 114 and provides the instruction (step S42) of carrying out image rectification.This data file creating unit 118 is read appointed calibration object image from image storage unit 114, read optical transfer function from optical transfer function storage unit 117, and makes both relevant to create a data file (step S43).
Then, wireless transmission/receive unit 119 will be transferred to image rectification server apparatus 102 (step S44) by the data file that data file creating unit 118 is created.This image rectification server apparatus 102 receives the data file (step S45) that transmits from portable telephone apparatus 101.This image rectification server apparatus 102 is included in optical transfer function in this data file by use, the calibration object image is carried out deconvolution handle (step S46).
To describe the deconvolution of carrying out in image rectification server apparatus 102 among the step S46 below handles.At first, the function below this deconvolution processing unit 122 uses as deconvolution handle recover wave filter M (u, v).
[formula 2]
M ( u , v ) = H * ( u , v ) S ff ( u , v ) S ff ( u , v ) | H ( u , v ) | 2 + S vv ( u , v )
= 1 H ( u , v ) | H ( u , v ) | 2 | H ( u , v ) | 2 + [ S vv ( u , v ) / S ff ( u , v ) ]
In the equation above, (u v) is an optical transfer function to H; S FfSpectral density for input signal; S Vv(u v) is a noise spectrum density.This deconvolution processing unit 122 use the optical transfer function that is included in from the data file that portable telephone apparatus 101 transmits as this optical transfer function H (u, v).This deconvolution processing unit 122 is according to the noise properties of each image, for each to carry out image creation that deconvolution handles recover wave filter M (u, v).
When the image of original image, deterioration and the image after recovering be respectively f (x, y), g (x, y) and f^ (x, in the time of y), and ought two-dimension fourier transform separately be respectively F (u, v), G (u, v) and F^ (u, in the time of v),
F^ (u, v)=(H (and u, v) * M (u, v)) * F (u, v), and
F^(u，v)＝M(u，v)*G(u，v)
The wherein multiplying in " * " expression frequency space.(x, y), wherein this data file is to transmit from the portable telephone apparatus 101 that has photographic means to image g after this deconvolution processing unit 122 uses the calibration object image that is included in the data file as this deterioration.
These deconvolution processing unit 122 usefulness are recovered wave filter M (u, v) to the two-dimension fourier transform G (u of calibration object image, v) carry out convolution integral, Fourier transform F^ (u with image behind the calculation correction, v), and then it is carried out inverse-Fourier transform, with calculate image f^ after the recovery (x, y).(x is y) as the image after proofreading and correct for image f^ after this this recovery of deconvolution processing unit 122 outputs.
As mentioned above, after the image after single 122 calculation corrections are handled in deconvolution, the image after this transmission unit 121 will be proofreaied and correct sends back to portable telephone apparatus 101 (step S47).Image (step S48) after the wireless transmission/receive unit 119 of this portable telephone apparatus 101 receives this and proofreaies and correct from network 103.
In above-mentioned operation, the user provides after the instruction of carrying out image rectification in step S42, and this portable telephone apparatus 101 and image rectification server apparatus 102 automatically carry out the processing of step S42 to S48.Therefore, the user of portable telephone apparatus 101 can obtain the operability that is equal to the operability of carrying out being obtained when deconvolution is handled in portable telephone apparatus 101.Owing to used the image rectification server apparatus 102 that is actually external unit, even therefore when the many images with a large amount of pixels being carried out deconvolution and handle, improved operation also is possible.
According to the such image correction system 110 of seventh embodiment of the invention, for the image that is obtained by the portable telephone apparatus 101 that has photographic means is proofreaied and correct, the positive object images of this portable telephone apparatus 101 high-ranking officers is transferred to image rectification server apparatus 102.This image rectification server apparatus 102 is handled by deconvolution and is proofreaied and correct, and therefore need not to be provided for carrying out in portable telephone apparatus 101 structure that deconvolution is handled.
In the image correction system 110 of the 7th embodiment, when the positive object images of portable telephone apparatus 101 high-ranking officers was transferred to image rectification server apparatus 102, the optical transfer function of this calibration object image and portable telephone apparatus 101 was relative to each other and is transmitted.Therefore, this image rectification server apparatus 102 can obtain the optical transfer function that will use at an easy rate in the deconvolution of this calibration object image is handled.According to present embodiment, the fabrication phase at the portable telephone apparatus 101 that has photographic means, determine each optical transfer function, and these optical transfer functions of this portable telephone apparatus 101 are stored in the optical transfer function storage unit 117 in advance.But, optionally, have photographic means portable telephone apparatus 101 model or can be stored in advance in the optical transfer function storage unit 117 about the information of zoom mode etc., and can select optical transfer function according to the fragment of these information subsequently.
(the 8th embodiment)
Describe with reference to Figure 16 and 17 pairs of eighth embodiment of the present invention below.
Figure 16 is the synoptic diagram of having showed according to the image correction system of present embodiment.Referring to Figure 16, high resolution image system 120 comprises: have portable telephone apparatus 101, image rectification server apparatus 102 and the terminal device 104 of photographic means, they communicate by network 103 each other.
The structure of this portable telephone apparatus 101 and the 7th embodiment are similar.It should be noted that, except optical transfer function, this data file creating unit 118 has further been created by the data file that makes information (transmission destination information) and calibration object image be associated and obtain, wherein the transmission destination of the image of this information representation after the correction of operating unit 116 input.More specifically, created such data file, included in this data file: calibration object image, optical transfer function and about the information of the image transmission destination after proofreading and correct according to the data file creating unit 118 of present embodiment.Can specify the transmission destination of a plurality of transmission destinations as the image after proofreading and correct.
The same with the 7th embodiment, this image rectification server apparatus 102 comprises transmission unit 121 and deconvolution processing unit 122.This transmission unit 121 and deconvolution processing unit 122 have with the 7th embodiment in similar function.Image rectification server apparatus 102 according to present embodiment also comprises destination designating unit 123.The function of this purpose designating unit 123 is that represented transmission destination is appointed as the transmission destination that transmission unit 121 carries out data transmission in the transmission destination information that will be included in the data file.The function of this terminal device 104 is the images that receive after the correction of transmitting from image rectification server apparatus 102, and shows the image after this correction.
With reference to Figure 17 the operation of high resolution image system 120 with said structure is described below.At first, the same with the 7th embodiment, the portable telephone apparatus 101 that has photographic means obtains the volume image that is taken (step S61).Then, have the image rectification instruction (step S62) of portable telephone apparatus 101 receptions of photographic means from operating unit 116.This operating unit 116 receives to the appointment of the transmission destination of the image after proofreading and correct and to the appointment of calibration object image.This data file creating unit 118 is created such data file (step S63), this data file obtains by calibration object image, optical transfer function and transmission destination information are associated, the transmission destination that this transmission destination information representation receives in step S62.This wireless transmission/receive unit 119 is transferred to image rectification server apparatus 102 (step S64) with this data file.The operation that can come the appointment calibration object image among the replacement step S62 with the operation of specifying the image that to be transmitted; Therefore, can carry out processing and subsequent treatment in step S63, and can not make the user recognize image rectification.
In image rectification server apparatus 102, the same with the 7th embodiment, come transmission data file (step S65) by transmission unit 121.This deconvolution processing unit 122 uses the optical transfer function that is included in the data file to come that the calibration object image is carried out deconvolution and handles (step S66).After the image that deconvolution processing unit 122 is created after proofreading and correct, destination designating unit 123 is specified a transmission destination represented in transmission destination information, and wherein this transmission destination information is included in from the data file that the portable telephone apparatus 101 that has photographic means receives.Image (step S67) after this transmission unit this correction of 121 transmission.This terminal device 104 that is designated as transmission destination receives image (step S68) after these corrections by network 103.
Also have, this image correction system 120 according to eighth embodiment of the invention, the same with the image correction system 110 of the 7th embodiment, for the image that obtains by the portable telephone apparatus 101 that has photographic means is proofreaied and correct, send the calibration object images from portable telephone apparatus 101, and handle by the deconvolution in the image rectification server apparatus 102 and to proofread and correct.Therefore, this portable telephone apparatus 101 does not need to comprise the structure that is used to carry out the deconvolution processing.
In image correction system 120, when the positive object images of portable telephone apparatus 101 high-ranking officers is transferred to image rectification server apparatus 102, with the optical transfer function of this calibration object image and portable telephone apparatus 101 be relative to each other connection and transmission.Therefore, this image rectification server apparatus 102 can obtain at an easy rate will be in the deconvolution of calibration object image be handled employed optical transfer function.
Image after this image rectification server apparatus 102 will be proofreaied and correct directly is transferred to terminal device 104.Therefore, compare with following situation, can obtain to reduce the beneficial effect of the traffic between portable telephone apparatus 101 and the image rectification server apparatus 102, this situation is: the image after will proofreading and correct is after image rectification server apparatus 102 sends back to portable telephone apparatus 101, and the image after further will proofreading and correct is transferred to terminal device 104 from portable telephone apparatus 101.
(the 9th embodiment)
Now with reference to Figure 18 and 19 ninth embodiment of the present invention is described.
Figure 18 is the synoptic diagram of having showed according to the image correction system of present embodiment.Referring to Figure 18, this image correction system 130 comprises digital photographing apparatus 105 and personal computer 106, and they communicate by network each other.
Similar with the portable telephone apparatus 101 according to the 7th and the 8th embodiment, this digital photographing apparatus 105 comprises: image taking optical system 111, two-dimensional image sensor 112, graphics processing unit 113, display unit 115, operating unit 116, optical transfer function storage unit 117 and data file creating unit 118.These functions and the 7th embodiment are similar.This digital photographing apparatus 105 is equivalent to digital image capture device of the present invention.This digital photographing apparatus 105 also comprises read/write cell 151 and communication interface 152.
The function of this read/write cell 151 is to write data into recording medium 171, for example in the flash card, and from this recording medium 171 reading of data.This communication interface 152 is USB (USB (universal serial bus)) interface.The function of this communication interface is to outside equipment transmission data or from outer equipment receiving data by USB cable 172.
According to present embodiment, this read/write cell 151 will be written in the recording medium 171 by the image that graphics processing unit 113 generates.The function of this data file creating unit 118 is to receive the image that is read from recording medium 171 by read/write cell 151.The function of this communication interface 152 is that the image that will be read from recording medium 171 by read/write cell 151 is transferred to external unit.The function of this read/write cell 151 is from data file creating unit 118 received data files and is written into the recording medium 171; This function is equivalent to output unit of the present invention.Further, the function of this communication interface 152 is to receive to transmit from the data file of data file creating unit 118 and to it; This function is equivalent to output unit of the present invention or transmitting device.
This personal computer 106 comprises: read/write cell 161, communication interface 162 and deconvolution processing unit 122.The function of deconvolution processing unit 122 is identical with the 7th embodiment's.Read/write cell 161 and communication interface 162 have read/write cell 151 and communication interface 152 identical functions with digital photographing apparatus 105.In personal computer 106, realize this deconvolution processing unit 122 by on operating system, carrying out from the program of read/write cell 161 or communication interface 162 inputs.
With reference to Figure 19 the operation of image correction system 130 with said structure is described below.At first, similar with the portable telephone apparatus 101 according to the 7th embodiment, digital photographing apparatus 105 is caught and is taken volume image and obtains the image (step S81) that captures.This operating unit 116 receives the instruction (step S82) that creates data file.With the 7th embodiment in receive in instruction (the step S42 of Figure 15) similar operation of image rectification, specified the calibration object image.
When the instruction imported by operating unit 116 along with the data file that the appointment of calibration object image is created, this data file creating unit 118 is read into the image of this appointment the read/write cell 151 from recording medium 171, and receives the image of this appointment thus.This data file creating unit 118 receives optical transfer functions from optical transfer function storage unit 117, the image of this appointment is associated with this optical transfer function, and creates a data file (step S83).This read/write cell 151 will be written in the recording medium 171 by the data file that data file creating unit 118 is created.This communication interface 152 is transmitted (step S84) by 172 pairs of these data files of USB cable.
In personal computer 106, from recording medium 171 read data files, perhaps receive this data file by communication interface 162 by USB cable 172 by read/write cell 161.When from instruction that user's input picture is proofreaied and correct (step S86), this deconvolution processing unit 122 uses the optical transfer function that is included in the data file that the calibration object image is carried out deconvolution and handles (step S87) and create image after proofreading and correct.
Also have, image correction system 130 according to ninth embodiment of the invention, the same with the image correction system 110 of the 7th embodiment, for the image that obtains by digital photographing apparatus 105 is proofreaied and correct, the calibration object image is written in the recording medium 171, or be sent to telecommunication cable 172, and carry out deconvolution by 102 pairs of calibration object images of image rectification server apparatus and handle.Therefore, the structure that is used to carry out the deconvolution processing need be installed in digital photographing apparatus 105.
In the image correction system 130 of the 9th embodiment, when the positive object images of digital photographing apparatus 105 high-ranking officers is transferred to personal computer 106, with the optical transfer function of this calibration object image and digital photographing apparatus 105 be relative to each other connection and output.Therefore, personal computer 106 can obtain at an easy rate will be in deconvolution that the calibration object image is carried out be handled employed optical transfer function.
In the above description, such example has been described, wherein portable telephone apparatus 101 and digital photographing apparatus 105 make optical transfer function and the calibration object image is interrelated and they are transmitted.Point spread function can be stored in portable telephone apparatus 101 and the digital photographing apparatus 105 in advance, and this portable telephone apparatus 101 and digital photographing apparatus 105 can be so that point spread function and calibration object image be interrelated and they are transmitted.Carrying out contravariant by the two-dimension fourier transform to point spread function brings and obtains optical transfer function; These two functions can be changed mutually.This optical transfer function and point spread function are equivalent to deterioration factor information of the present invention.
The portable telephone apparatus 101 of the 7th and the 8th embodiment can be the digital photographing apparatus with communication function, and its photographic means function is a major function.The digital photographing apparatus 105 of the 9th embodiment can be the portable telephone apparatus that has photographic means (this photographic means have image is written to function in the recording medium); Or having the portable telephone apparatus of photographic means, it has the function of image being exported to personal computer by USB cable.
The industry practicality
As mentioned above, according to the method for mensuration optics transfer function of the present invention, can pass through phase The image that integrates mutually takes optical system and the image sensor calculates image shooting photograph The optics transfer function of device. Therefore, just obtained following advantage: can the calculating optical transmission Function, and simultaneously can calculate this optics transfer function with being easy to and not need to disassemble this Image is taken the photograph device, and wherein this optics transfer function has reflected because the actual image that is installed in Take that image in the photograph device is taken optical system and the figure image degradation factor that causes and by The figure image degradation factor of between the element of image sensor, crosstalking and causing. As a kind of for survey Dingan County is contained in the image of miniaturization in the portable phone equipment or thickness attenuation and takes the photograph device Deng the method for optics transfer function, the present invention is very useful.
In image correction method according to the present invention, this numeral image is taken device so that by figure It is relevant with deterioration factor information and export this deterioration factor information that picture is taken image that device generates, This deterioration factor information is used for the image of the deterioration that is caused by image shooting device is proofreaied and correct, And carrying out deconvolution in image correction server equipment processes. Therefore, can obtain as follows Advantage: can obtain by carrying out the image after the correction obtain is processed in deconvolution, and can not Increase digital image and take the treating capacity of device. As a kind of for to by with the dress of taking a picture The side that the image that carries out image to catch in the equipment such as the portable phone of putting and obtain is proofreaied and correct Method, the present invention is very useful.

Claims (23)

1. the assay method of an optical transfer function comprises:
Scanning step, be used for going out irradiates light and making described irradiates light scan to detected element from light emitted, wherein said detected element is the element in the imageing sensor of image taking photographic means, and described image taking photographic means constitutes by image taking optical system and described imageing sensor are integrated;
The opto-electronic conversion step is used for by described detected element, sequentially described irradiates light being converted to electric signal with in the scan operation of described scanning step to described detected element, and exports described electric signal subsequently; And
Calculation procedure, be used for calculating optical transfer function according to the electric signal exported in described opto-electronic conversion step, wherein said optical transfer function is used to handle to recovering by the deterioration of using the image that described image taking photographic means generates by deconvolution.
2. the assay method of optical transfer function according to claim 1, wherein in described calculation procedure, calculate the described optical transfer function of described detected element according to the spread function data, wherein said spread function data generate by described irradiates light scanning in described scanning step, and described spread function data representation is by changing the distribution of the electric signal that obtains in described detected element.
3. the assay method of optical transfer function according to claim 2, wherein:
In described scanning step, under conjugate condition, launch on imaging region and to produce the irradiates light that is similar to projected image a little, make half that is equal to or less than described element spacing at the diameter of the paraxonic image of described the above irradiates light of imaging region; And
In described calculation procedure, calculate described optical transfer function according to described point spread function data, wherein generate described point spread function data as described spread function data.
4. the assay method of optical transfer function according to claim 2, wherein:
In described scanning step, under conjugate condition, launch on imaging region the irradiates light that produces the linear projection image, make half that is equal to or less than described element spacing at the width of the paraxonic image of described the above irradiates light of imaging region; And
In described calculation procedure, calculate described optical transfer function according to described line spread function data, wherein generate described line spread function data as described spread function data.
5. according to the assay method of any one described optical transfer function in the claim 1 to 4, wherein:
In described scanning step, described irradiates light scans a plurality of detected element; And
Described calculation procedure comprises: carry out interpolation processing by the optical transfer function that uses a plurality of described detected element, and therefore calculate the optical transfer function of the element except described detected element.
6. according to the assay method of any one described optical transfer function in the claim 2 to 5, comprise that further the distorted characteristic data generate step, be used for by using described spread function data and generating the distorted characteristic data relevant with the distortion of described imaging region epigraph with the positional information of the corresponding described detected element of described spread function data.
7. the assay method of optical transfer function according to claim 1, wherein said scanning step comprises such step, described step is used for changing described irradiates light to the irradiating angle of described image taking photographic means and at least one of irradiation position, makes described irradiates light scanning detected element thus.
8. the assay method of optical transfer function according to claim 1, wherein said scanning step comprises such step, described step is used for changing the angle of described image taking photographic means and at least one of position, makes described irradiates light scanning detected element thus.
9. image recovery method comprises:
By measuring optical transfer function according to any one described assay method in the claim 1 to 8; And
By using measured optical transfer function that the view data that is obtained by described image taking photographic means is recovered to handle.
10. portable telephone apparatus comprises:
The image taking photographic means, be used to catch be taken body image and generate view data;
Memory storage is used for the storing optical transport function; And
Transmitting device is used for and will is stored in the described optical transfer function of described memory storage and is transmitted as one group of data by the described view data that described image taking photographic means generates;
Wherein measure described optical transfer function with assay method, this assay method comprises:
Scanning step, be used for going out irradiates light from light emitted, and with described irradiates light the detected element in the imageing sensor of described image taking photographic means is scanned, the described imageing sensor and the image taking optical system of wherein said image taking photographic means integrate;
The opto-electronic conversion step is used for will sequentially being converted to electric signal at the described irradiates light that described scanning step scans and exporting described electric signal subsequently by described detected element; And
Calculation procedure, be used for calculating described optical transfer function according to the electric signal exported in described opto-electronic conversion step, wherein said optical transfer function is used to handle by deconvolution the deterioration of the image that generated by described image taking photographic means is recovered.
11. a digital image capture device comprises:
The image taking photographic means, be used to catch be taken body image and generate view data;
Memory storage is used for the storing optical transport function; And
Transmitting device is used for and will is stored in the described optical transfer function of described memory storage and is transmitted as one group of data by the view data that described image taking photographic means generates;
Wherein measure described optical transfer function with assay method, described assay method comprises:
Scanning step, be used for going out irradiates light from light emitted, and described irradiates light is scanned the detected element in the imageing sensor of described image taking photographic means, wherein described imageing sensor and the image taking optical system with described image taking photographic means integrates;
The opto-electronic conversion step is used for by described detected element, and the described irradiates light that will scan in described scanning step sequentially is converted to electric signal and exports described electric signal subsequently; And
Calculation procedure, be used for calculating described optical transfer function according to the electric signal exported in described opto-electronic conversion step, wherein said optical transfer function is used to handle by deconvolution the deterioration of the image that generated by described image taking photographic means is recovered.
12. a portable telephone apparatus comprises:
The image taking photographic means, be used to catch be taken body image and generate view data;
The mark generating apparatus is used for the additional described view data that is generated by described image taking photographic means of giving of the document number of data file, and described data file comprises the optical transfer function that records by assay method, and described assay method comprises:
Scanning step, be used for going out irradiates light from light emitted, and described irradiates light is scanned the detected element in the imageing sensor of described image taking photographic means, wherein described imageing sensor and the image taking optical system with described image taking photographic means integrates;
The opto-electronic conversion step is used for by described detected element, and the irradiates light that will scan described element in described scanning step sequentially is converted to electric signal and exports described electric signal subsequently; And
Calculation procedure, be used for coming the calculating optical transport function according to the described electric signal exported in described opto-electronic conversion step, wherein said optical transfer function is used to handle by deconvolution the deterioration of the image that generated by described image taking photographic means is recovered.
13. a digital image capture device comprises:
The image taking photographic means, be used to catch be taken body image and generate view data;
The mark generating apparatus is used for the additional described view data that is generated by described image taking photographic means of giving of the document number of data file, and described data file comprises the optical transfer function that records by assay method, and described assay method comprises:
Scanning step, be used for going out irradiates light from light emitted, and described irradiates light is scanned the detected element in the described imageing sensor of described image taking photographic means, wherein described imageing sensor and the image taking optical system with described image taking photographic means integrates;
The opto-electronic conversion step is used for by described detected element, and the irradiates light that will scan described element in described scanning step sequentially is converted to electric signal and exports described electric signal subsequently; And
Calculation procedure, be used for calculating described optical transfer function according to the described electric signal exported in described opto-electronic conversion step, wherein said optical transfer function is used to handle by deconvolution the deterioration of the image that generated by described image taking photographic means is recovered.
14. a method for correcting image may further comprise the steps:
Make and to catch the image that generates and be associated with deterioration factor information by the digital image capture device volume image that is taken, and export described relevant information from described digital image capture device, wherein said deterioration factor information is used for the image of deterioration that the image capturing device by described digital image capture device is caused and proofreaies and correct; And
Make the image rectification server apparatus by using the described deterioration factor information relevant, the described image from described digital image capture device output is carried out deconvolution handle with described image.
15. a digital image capture device comprises:
Image capturing device is used to catch and generate the image of body of being taken;
The deterioration factor information-storing device is used to store deterioration factor information, and described deterioration factor information is used for being proofreaied and correct by the deterioration of the image that described image capturing device caused; And
Output unit is used to export the described deterioration factor information relevant with described image.
16. digital image capture device according to claim 15, further comprise receiving trap, be used to receive by using described deterioration factor information to come described image is proofreaied and correct image after the correction that obtains, wherein said deterioration factor information is exported from described output unit.
17. according to claim 15 or 16 described digital image capture devices, wherein said deterioration factor information-storing device has been stored as optical transfer function described deterioration factor information, that use in deconvolution is handled.
18. according to any one described digital image capture device in the claim 15 to 17, wherein said output unit is a transmitting device, is used to transmit the described deterioration factor information relevant with described image.
19. according to any one described digital image capture device in the claim 15 to 17, wherein said output unit is a writing station, is used for the described deterioration factor information relevant with described image is written to the recording medium relevant with described image.
20. an image rectification server apparatus comprises:
Receiving trap, be used for receiving image and deterioration factor information from the digital image capture device, wherein said image is by making the be taken image capturing of body of described digital image capture device generate, and described deterioration factor information is used for being proofreaied and correct by the image of the caused deterioration of image capturing device of described digital image capture device;
Image correction apparatus is used to use described deterioration factor information that described image is carried out deconvolution and handles; And
Transmitting device is used to transmit by carrying out the image after the correction that obtains is handled in deconvolution.
21. image rectification server apparatus according to claim 20, wherein:
Described receiving trap receives transmission destination information and described image and described deterioration factor information, and wherein said transmission destination information has been specified the transmission destination of the image after proofreading and correct;
The image of described transmitting device after with described correction sends the transmission destination by the appointment of described transmission destination information to.
22. an image correction system comprises digital image capture device and image rectification server apparatus, wherein:
Described digital image capture device comprises image capturing device, be used to catch and generate the image of body of being taken, specified device, be used to specify the transmission destination of proofreading and correct the back image, and transmitting device, be used for the destination information relevant with the image that is generated by described image capturing device is transferred to described image rectification server apparatus and transmits described relevant information, wherein said transmission destination information representation is with the specified transmission destination of described specified device; And
Described image rectification server apparatus comprises image correction apparatus, being used for that the image from described digital image capture device output is carried out deconvolution handles, with the image after the acquisition correction, and transmitting device, be used for by using the image after the correction that described image correction apparatus obtains to be transferred to by the represented transmission destination of transmission destination information relevant with described image.
23. a program that makes the bearing calibration of computing machine carries out image comprises:
Receiving step, be used for the input of received data file, comprise image and deterioration factor information in the wherein said data file, wherein said image is by making the be taken image capturing of body of digital image capture device generate, and proofreaies and correct and described deterioration factor information is used for the image of deterioration that the image capturing device by described digital image capture device is caused; And
The image rectification step, be used for by using deterioration factor information to come to handle carrying out deconvolution at the image that described data file comprised from described digital image capture device output, wherein said deterioration factor information is included in the described data file with described image.
CN 200580002639 2004-01-15 2005-01-13 Measuring method for optical transfer function, image restoring method, and digital imaging device Pending CN1910614A (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JP008056/2004 2004-01-15
JP2004008056 2004-01-15
JP023349/2004 2004-01-30

Publications (1)

Publication Number Publication Date
CN1910614A true CN1910614A (en) 2007-02-07

Family

ID=37700850

Family Applications (1)

Application Number Title Priority Date Filing Date
CN 200580002639 Pending CN1910614A (en) 2004-01-15 2005-01-13 Measuring method for optical transfer function, image restoring method, and digital imaging device

Country Status (1)

Country Link
CN (1) CN1910614A (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102055914A (en) * 2009-10-28 2011-05-11 索尼公司 Signal processing apparatus, signal processing method and computer program
CN102165761A (en) * 2008-09-30 2011-08-24 佳能株式会社 Image processing method, image processing apparatus, and image pickup apparatus
CN102932583A (en) * 2012-07-19 2013-02-13 中国人民解放军国防科学技术大学 Refraction-reflection whole-focusing imaging device and refraction-reflection whole-focusing imaging method
CN103188499A (en) * 2011-12-27 2013-07-03 鸿富锦精密工业（深圳）有限公司 3D imaging module and 3D imaging method
CN104854858A (en) * 2012-09-26 2015-08-19 富士胶片株式会社 Image processing device, imaging device, computer, and program
CN106464809A (en) * 2014-05-29 2017-02-22 奥林巴斯株式会社 Image pickup apparatus and image processing method
CN107872661A (en) * 2013-08-16 2018-04-03 杜比实验室特许公司 System and method for the ligh field model technology of more modulation displays
CN110411716A (en) * 2019-08-05 2019-11-05 昆明北方红外技术股份有限公司 Method for measuring U-shaped thermal imaging system optical transfer function of turning back

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102165761A (en) * 2008-09-30 2011-08-24 佳能株式会社 Image processing method, image processing apparatus, and image pickup apparatus
CN102165761B (en) * 2008-09-30 2013-08-14 佳能株式会社 Image processing method, image processing apparatus, and image pickup apparatus
CN102055914A (en) * 2009-10-28 2011-05-11 索尼公司 Signal processing apparatus, signal processing method and computer program
CN103188499B (en) * 2011-12-27 2016-05-04 鸿富锦精密工业（深圳）有限公司 3D imaging modules and 3D formation method
CN103188499A (en) * 2011-12-27 2013-07-03 鸿富锦精密工业（深圳）有限公司 3D imaging module and 3D imaging method
CN102932583A (en) * 2012-07-19 2013-02-13 中国人民解放军国防科学技术大学 Refraction-reflection whole-focusing imaging device and refraction-reflection whole-focusing imaging method
CN102932583B (en) * 2012-07-19 2015-05-06 湖南源信光电科技有限公司 Refraction-reflection whole-focusing imaging method
CN104854858A (en) * 2012-09-26 2015-08-19 富士胶片株式会社 Image processing device, imaging device, computer, and program
CN104854858B (en) * 2012-09-26 2017-11-07 富士胶片株式会社 Image processing apparatus, camera device, computer
CN107872661A (en) * 2013-08-16 2018-04-03 杜比实验室特许公司 System and method for the ligh field model technology of more modulation displays
CN107872661B (en) * 2013-08-16 2020-01-07 杜比实验室特许公司 System and method for light field modeling techniques for multi-modulation displays
CN106464809A (en) * 2014-05-29 2017-02-22 奥林巴斯株式会社 Image pickup apparatus and image processing method
CN110411716A (en) * 2019-08-05 2019-11-05 昆明北方红外技术股份有限公司 Method for measuring U-shaped thermal imaging system optical transfer function of turning back
CN110411716B (en) * 2019-08-05 2021-03-16 昆明北方红外技术股份有限公司 Method for measuring optical transfer function of U-shaped deflection thermal imager

Similar Documents

Publication Publication Date Title
CN1910614A (en) Measuring method for optical transfer function, image restoring method, and digital imaging device
CN1260673C (en) 2-D code reading method and reading device, digital camera and its portable terminal
CN1245825C (en) Picture element defect tester for solid imaging device
CN1742483A (en) Image processing device and method, recording medium, and program
US8059155B2 (en) System and method for measuring field of view of digital camera modules
CN101076085A (en) Method and apparatus for image capturing and electronic apparatus using the same
JP6031587B2 (en) Imaging apparatus, signal processing method, and signal processing program
CN1835569A (en) Time-shift image distribution system, time-shift image distribution method, time-shift image requesting apparatus, and image server
CN1701595A (en) Image pickup processing method and image pickup apparatus
CN1823523A (en) Projector apparatus, inclination angle obtaining method, and projection image correction method
CN1670630A (en) Image color correction method and image forming apparatus
CN1738364A (en) Image capture apparatus and control method therefor
CN1271233A (en) Controlling device and method for camera
CN1671176A (en) Image processing apparatus for correcting distortion of image and image shooting apparatus for correcting distortion of shot image
CN1586008A (en) Light detection device, imaging device and distant image acquisition device
CN1496535A (en) Image processing apparatus and image processing meethod, storage medium, and computer program
CN1717006A (en) Be used for improving the equipment and the method for picture quality at imageing sensor
CN1280739A (en) Sensor system
CN1834582A (en) Image processing method, three-dimensional position measuring method and image processing apparatus
CN1928692A (en) Camera apparatus having a plurality of image pickup elements
CN1497940A (en) Imaging equipment, image processing method and recording medium
CN1960431A (en) Image processing device, image processing method, program for the same, and memory medium for storing the program
CN101056354A (en) Image capturing apparatus, control method therefor, image processing apparatus, and image processing method
CN101080921A (en) Image pickup device
CN1358028A (en) Image codec method, image coder and image decoder

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C02 Deemed withdrawal of patent application after publication (patent law 2001)
WD01 Invention patent application deemed withdrawn after publication