CN1305006C

CN1305006C - Method and system for profviding promated information to image processing apparatus

Info

Publication number: CN1305006C
Application number: CNB028139518A
Authority: CN
Inventors: 布鲁诺·列日; 弗雷德里克·吉查德
Original assignee: DO Labs SA
Current assignee: Dxo Labs SA; Lens Correction Technologies SAS
Priority date: 2001-07-12
Filing date: 2002-06-05
Publication date: 2007-03-14
Anticipated expiration: 2022-06-05
Also published as: US20140099042A1; JP2005509333A; CN1535448A; WO2003007240A1; EP2015247A3; WO2003007241A1; KR20040043154A; CN1273931C; JP4367757B2; DE60239061D1; CN1316427C; CN1527989A; JP2004534491A; JP4295612B2; ES2311061T3; DE60227374D1; JP4020262B2; US20120308160A1; US20050008242A1; WO2003007242A2

Abstract

The invention concerns a system and a method for correcting chromatic aberrations (1) of a colour image (3) consisting of several digitised colour planes (4). Said colour image (3) is assumed to have been produced with an optical system (5). The invention is characterised in that it consists in modelling and correcting, at least partly, geometrical anomalies of said digitised colour planes (4), so as to obtain corrected digitised colour planes (17); then in combining the corrected digitised colour planes (17), so as to obtain a corrected colour image (19), completely or partly, free of chromatic aberrations (1). The invention is applicable to photographic or video image processing, in optical devices, industrial controls, robotics, metrology and the like.

Description

The method and system of formatted message is provided to image-processing system

Technical field

The present invention relates to a kind of method and system that the formatted message of standard format is provided to image-processing system.

Solution

Method

The present invention relates to a kind ofly to image-processing system, especially software and/or element provide the method for the formatted message of standard format.Described formatted message is relevant with the defective of device chain.Described device chain comprises at least one image trapping device and/or an image recovery device particularly.Image-processing system uses this formatted message to change the image quality that at least one width of cloth was derived from or was sent to described device chain.This formatted message comprises the defective that characterizes image trapping device, the data of distortion characteristic especially, and/or characterize the data of defective, the especially distortion characteristic of visual recovery device.

This method comprises the process of filling at least one field of described standard format with formatted message.This field is specified by field name.Described field comprises at least one field value.

Preferably, the method according to this invention makes described field relevant with the sharpness defective of image trapping device and/or image recovery device.And method of the present invention makes described field comprise at least one and the relevant value of sharpness defective of image trapping device and/or image recovery device.

Preferably, the method according to this invention makes described field relevant with the colorimetry defective of image trapping device and/or image recovery device.And method of the present invention makes described field comprise at least one and the relevant value of colorimetry defective of image trapping device and/or image recovery device.

Preferably, the method according to this invention makes described field relevant with geometry deformation defective and/or how much chromatic aberration defects of image trapping device and/or image recovery device.And this method makes described field comprise at least one and the geometry deformation defective of image trapping device and/or image recovery device and/or how much relevant values of chromatic aberration defect.

Preferably, the method according to this invention makes described field relevant with the geometry vignetting defective and/or the contrast defective of image trapping device and/or image recovery device.And this method makes described field comprise at least one and the how much vignetting defectives and/or the relevant value of contrast defective of image trapping device and/or image recovery device.

Preferably, the method according to this invention makes described field comprise at least one value relevant with deviation.

Preferably, according to the present invention, described formatted message to small part is made up of the parameter of the transformation model of a parameterisable, the sharpness defective of its representing images acquisition equipment and/or image recovery device.This method makes that be included in relate to the sharpness defective in the described field one or more is worth to small part and is made up of the parameter of the transformation model of this parameterisable.Combination to technical characterictic obtains: image-processing system can use the parameter of the transformation model of this parameterisable to calculate the correction shape of an image point or proofread and correct the recovery shape.

Preferably, according to the present invention, described formatted message to small part is made up of the parameter of a parameterisable transformation model, the colorimetry defective of its representing images acquisition equipment and/or image recovery device.This method makes that be included in relate to the colorimetry defective in the described field one or more is worth to small part and is made up of the parameter of this parameterisable transformation model.Combination to technical characterictic obtains: image-processing system can use the parameter of this parameterisable transformation model to calculate the correction of color of an image point or proofread and correct the recovery color.

Preferably, the method according to this invention, this formatted message to small part is made up of the parameter of a parameterisable transformation model, the geometry deformation defective of this model representing images acquisition equipment and/or image recovery device and/or how much chromatic aberration defects.This method makes that be included in relate to geometry deformation defective and/or how much chromatic aberration defects in the described field one or more is worth to small part and is made up of the parameter of this parameterisable transformation model.Combination to technical characterictic obtains: image-processing system can use the parameter of this parameterisable transformation model to calculate the correction position of an image point or proofread and correct the recovery position.

Preferably, the method according to this invention, this formatted message to small part is made up of the parameter of a parameterisable transformation model, the geometry vignetting defective and/or the contrast defective of this model representing images acquisition equipment and/or image recovery device.This method makes described being made up of the parameter of this parameterisable transformation model one or more the value to small part that relates to how much vignetting defectives and/or contrast defective in the described field that be included in.Combination to technical characterictic obtains: image-processing system can use the parameter of this parameterisable transformation model to calculate the correction intensity of an image point or proofread and correct recovery intensity.

The contact of formatted message and image

Preferably, according to the present invention, for the formatted message of standard format is provided to image-processing system, this method also comprises contact formatted message and visual step in addition.

Preferably, according to the present invention, transmit this image with the form of file.And this document comprises formatted message.

Variable focal length

Preferably, according to the present invention, image trapping device and/or image recovery device comprise at least one alterable features, especially focal length of depending on image.At least one defective of image trapping device and/or image recovery device, particularly the geometry deformation defective depends on this alterable features.This method makes that at least one value that has at least a field to comprise is the function that depends on the alterable features of image.Combination to technical characterictic obtains: image-processing system can be handled image as the function of alterable features.

The formatted message that records

Preferably, according to the present invention, described formatted message to small part is (measured) formatted message that records.Thus, in this alternative embodiment, defective is very little.

Preferably, according to the present invention, described formatted message to small part is the formatted message of expansion.Thus, in this alternative embodiment, formatted message only takies very little internal memory, and image processing calculating can be faster.

Image can comprise colour plane.Preferably, according to the present invention, in this alternative embodiment, formatted message to small part relates to colour plane.Combination to technical characterictic obtains: can be decomposed into processing operation to each colour plane to the processing of this image.Combination to technical characterictic obtains: by before handling image being decomposed into colour plane, just might obtain positive pixel value in colour plane.

System

The present invention relates to a kind of for image-processing system, especially for the system that the formatted message of standard format is provided to software and/or element.This formatted message relates to the defective of a device chain.Described device chain comprises at least one image trapping device and/or an image recovery device particularly.Image-processing system uses this formatted message to change the quality that at least one width of cloth was derived from or was sent to the image of this device chain.Described formatted message comprises the data of the defective that characterizes image trapping device, particularly distortion characteristic, and/or the data of the defective of presentation image recovery device, particularly distortion characteristic.

Native system comprises the data processing tools of filling at least one field of standard format with formatted message.This field is bright by the field name calibration.This field comprises at least one field value.

Preferably, system according to the present invention makes described field relate to the sharpness defective of image trapping device and/or image recovery device.This system makes described field comprise the value that at least one relates to the sharpness defective of image trapping device and/or image recovery device.

Preferably, system according to the present invention makes field relate to the colorimetry defective of image trapping device and/or image recovery device.Described system makes field comprise the value that at least one relates to the colorimetry defective of image trapping device and/or image recovery device.

Preferably, system according to the present invention makes field relate to geometry deformation defective and/or how much chromatic aberration defects of image trapping device and/or image recovery device.And this system makes field comprise the value of at least one geometry deformation defective that relates to image trapping device and/or image recovery device and/or how much chromatic aberration defects.

Preferably, system according to the present invention makes this field relate to the geometry vignetting defective and/or the contrast defective of image trapping device and/or image recovery device.This system makes this field comprise at least one the geometry vignetting defective that relates to image trapping device and/or image recovery device and/or the value of contrast defective.

Preferably, system according to the present invention makes this field comprise the value that at least one relates to deviation.

Preferably, according to the present invention, described formatted message to small part is made up of the parameter of a parameterisable transformation model, the sharpness defective of this model representing images acquisition equipment and/or image recovery device.This system makes that be included in one or more in this field relevant with the sharpness defective is worth to small part and is made up of the parameter of this parameterisable transformation model.

Preferably, according to the present invention, this formatted message to small part is made up of the parameter of a parameterisable transformation model, the colorimetry defective of this model representing images acquisition equipment and/or image recovery device.This system makes that be included in one or more in the described field relevant with the colorimetry defective is worth to small part and is made up of the parameter of this parameterisable transformation model.

Preferably, according to the present invention, described formatted message to small part is made up of the parameter of a parameterisable transformation model, the geometry deformation defective of this model representing images acquisition equipment and/or image recovery device and/or how much chromatic aberration defects.This system makes one or more the value to small part be included in the described field relevant with geometry deformation defective and/or the colored chromatic aberration defect of geometry be made up of the parameter of this parameterisable transformation model.

Preferably, according to the present invention, this formatted message to small part is made up of the parameter of a parameterisable transformation model, the geometry vignetting defective and/or the contrast defective of this model representing images acquisition equipment and/or image recovery device.This system makes that be included in one or more in the described field relevant with geometry vignetting defective and/or contrast defective is worth to small part and is made up of the parameter of this parameterisable transformation model.

The contact of formatted message and image

Preferably, according to the present invention, for the formatted message of standard format is provided to image-processing system, this system also comprises contact formatted message and visual data processing equipment in addition.

Preferably, according to the present invention, this system comprises the transmitting device that is used for document form transmission image.Described file comprises this formatted message again.

Variable focal length

Image trapping device and/or image recovery device can comprise at least one and depend on this visual alterable features, particularly focal length.At least one defective of image trapping device and/or image recovery device, particularly the geometry deformation defective depends on this alterable features.Preferably, in alternative embodiment according to the present invention, this system makes that at least one value that has at least a field to comprise is the function that depends on the alterable features of image.

Alternative formatted message

Preferably, according to the present invention, described formatted message to small part is the formatted message that records.

Preferably, according to the present invention, this formatted message to small part is the formatted message of expansion.

Described image can be made up of some colour planes.Preferably, in this alternative embodiment according to the present invention, this formatted message to small part relates to colour plane.

Describe in detail

By following description to alternative embodiment of the present invention and accompanying drawing, further feature of the present invention and advantage can become obviously, and wherein, described description to embodiment is not restrictive, but illustrative.

-Fig. 1 is the synoptic diagram that presentation image is caught.

-Fig. 2 is the synoptic diagram that presentation image recovers.

-Fig. 3 is the synoptic diagram of presentation image pixel.

-Fig. 4 a and 4b are two synoptic diagram of a reference scene.

-Fig. 5 is the organization chart that can be used to the method for difference between computational mathematics (mathematical) image and the calibration image.

-Fig. 6 be can be used to obtain an image recovery device the optimal recovery conversion method organize block diagram.

-Fig. 7 represents to form the synoptic diagram of the key element of system of the present invention.

-Fig. 8 is the synoptic diagram of the field of presentation format information.

-Fig. 9 a represents the schematic front elevation of a mathematics point.

-Fig. 9 b is the schematic front elevation of the actual point of expression one image.

-Fig. 9 c represents the simple side view of a mathematics point.

-Fig. 9 d represents the schematic sectional view of the actual point of an image.

-Figure 10 is the synoptic diagram of representation feature lattice array.

-Figure 11 is the organization chart that expression can be used to obtain the method for formatted message.

-Figure 12 is the organization chart of the method for the expression best transition that can be used to obtain image trapping device.

-Figure 13 be expression can be used to change from or be used for the organization chart of method for quality of the image of device chain.

-Figure 14 represents to comprise the document instance of formatted message.

-Figure 15 presentation format information instances.

-Figure 16 represents the parameter of parameterisable model.

-Figure 17 is the organization chart of the method for the expression best transition that can be used to obtain to be used for the image recovery device.

Fig. 1 illustrates the scene 3 that comprises object 107, sensor 101 and sensor surface 110, optical centre 111 is positioned at the observation station 105 on the sensor surface 110, pass the observed ray 106 of observation station 105, optical centre 111 and scene 3, and with the surface 10 of sensor surface 110 geometric correlations.

Fig. 2 illustrates image 103, image recovery device 19, and at the recovery image 191 that recovers to obtain on the medium 190.

Fig. 3 illustrates scene 3, image trapping device 1 and the image of being made up of pixel 104 103.

Fig. 4 a and 4b illustrate two alternative reference scenes 9.

Fig. 5 illustrates an organization chart, this organization chart comprises: scene 3, mathematical projection 8, it provides the mathematics image 70 of scene 3, actual projection 72, it is provided for the image 103 of the scene 3 of employed feature 74, the transformation model 12 of parameterisable, it provides the corrected image 71 of image 103, and this corrected image 71 is compared with mathematics image 70 and be there are differences 73.

Fig. 6 illustrates an organization chart, this organization chart comprises: image 103, actual recovery projection 90, for employed recovery feature 95, it provides the recovery image 191 of image 103, and parameterisable recovers transformation model 97, it provides the correction of image 103 to recover image 94, mathematics recovers projection 96, and it provides proofreaies and correct the mathematics that recovers image 94 and recover image 92, and with recover image 191 and compare to exist and recover difference 93.

Fig. 7 illustrates the system that comprises an image trapping device 1, and this image trapping device 1 is by optical system 100, and sensor 101 and electronic unit 102 are formed.Fig. 7 also illustrates the memory block 16 that comprises image 103, the database 22 that comprises formatted message 15, and the device 18 of the image of finishing to calculation element 17 transmission 120, wherein, the described image of finishing 120 is made up of image 103 and formatted message 15, and calculation element 17 comprises imgae processing software 4.

Fig. 8 illustrates the formatted message 15 that is made of field 91.

Fig. 9 a illustrates mathematics image 70 to 9d, and image 103 is compared mathematics position 40 of any and mathematical shape 41 with the physical location 50 of this image respective point with true form 51.

Figure 10 illustrates unique point array 80.

Figure 11 illustrates an organization chart, and this organization chart comprises image 103, the feature 74 of use and the database 22 of feature.This formatted message 15 is obtained by the feature of using 74, and is stored in the database 22.This image of finishing 120 is obtained by image 103 and formatted message 15.

Figure 12 illustrates an organization chart, and it comprises reference scene 9, mathematical projection 8, and it provides the composite image class 7 of reference scene 9, actual projection 72, the reference picture 11 that it provides reference scene 9, the feature 74 that is used to use.This organization chart also comprises parameterisable transformation model 12, and it provides the conversion image 13 of reference picture 11.This conversion image 13 demonstration deviation 14 of comparing with composite image class 7.

Figure 17 illustrates an organization chart, it comprises that recovery is with reference to 209, actual recovery projection 90, it provides the described recovery reference 211 that recovers with reference to 209, be used for 95, one parameterisables of used feature and recover transformation model 97, it provides the described calibration reference that recovers with reference to 209 and recovers image 213, the contrary transformation model 297 that recovers of parameterisable, it recovers image 213 by described calibration reference and generates described recovery with reference to 209.This organization chart also comprises a mathematics and recovers projection 96, and it provides the synthetic recovery image 307 that this calibration reference recovers image 213.Described synthetic recovery image 307 is compared with reference to 211 with recovery and is shown recovery deviation 214.

Definition and detailed description

By reading following content, further feature of the present invention and advantage can be more obvious:

-the definition to the technical term that adopted of hereinafter setting forth, these definition are with reference to the embodiment of Fig. 1 to Figure 17, and these embodiment only are used to describe the present invention, and the present invention are not construed as limiting,

The description of-Fig. 1 to Figure 17.

Scene

Scene 3 is defined as a place in the three dimensions, comprises the object 107 that is illuminated by light source.

Image trapping device, image, catching image

In conjunction with Fig. 3 to Fig. 7, the existing description what is meant by image trapping device 1 and image 103.Image trapping device 1 is defined as by optical system 100,101, one electronic units 102 of one or more sensors and the device that memory block 16 constitutes.By described image trapping device 1, may obtain from scene 3 and be recorded in the region of memory 16, or be transferred to the digital image 103 static or animation of an external unit.Animated image is made of the still image sequence of arranging by the time.The concrete form of described image trapping device 1 can be a camera, video camera, link to each other or integrated camera with PC, link to each other or integrated camera with personal digital assistant, link to each other or integrated camera video conference device, surveying camera with phone, or to the device of the wavelength sensitive beyond the visible light, for example Camera Thermique.

Catching image is defined as image trapping device 1 and is used for the method for computational picture 103.

Be equipped with under the situation of a plurality of interchangeable components at a device, particularly in optical system 100, image trapping device 1 is defined as a kind of particular arrangement of this device.

The image recovery device recovers image, image recovery

In conjunction with Fig. 2, the existing description what is meant by image recovery device 19.The concrete form of this image recovery device 19 can be visual indicator screen, TV screen, flat screen, projector, virtual reality eyepiece, and printer.

This image recovery device 19 is made up of following element:

-one electronic unit,

-one or more light sources, electron source or ink source,

-one or more regulators; Be used for light, the conditioning equipment of electronics or ink,

-one focusing mechanism, its concrete form can be an optical system in light projector, can be electron beam focusing coil in the CRT screen, can be filtrator in flat screen,

-one recovers medium 190, and its concrete form can be screen at the CRT screen in plane screen or the projector, can be the print media that prints thereon in printer, is virtual surface in the virtual image projector.

By using described image recovery device 19, can obtain at the recovery image 191 that recovers on the medium 190 from an image 103.

Animated image is made up of the still image sequence of arranging by the time.

Image recovery is defined as that image recovery device 19 is used for showing or the method for print image.

At the assembly that recovery device 19 is equipped with a plurality of interchangeable components maybe can move relative to each other, particularly recover under the situation of medium 190, image recovery device 19 is defined as a kind of particular arrangement.

Sensor surface, optical centre, focal length

In conjunction with Fig. 1, the definition of sensor surface 110 is described now.

Sensor surface 110 is defined as when catching image, the spatial form that the sensing surface of the sensor 101 of image trapping device obtains.This surface is the plane normally.

Optical centre 111 is defined as related with visual 103 in a catching image time space point.At sensor surface 110 is under the situation on plane, and focal length is defined as the distance between this point 111 and the surface 110.

Pixel, pixel value, time shutter

In conjunction with Fig. 3, the definition of pixel 104 and pixel value is described now.

Pixel 104 is defined as by in the elementary cell zone of creating on the sensor surface 110 on the detection plane that the grid be generally rule obtains on 110.Pixel value is defined as a numeral related with this pixel 104.

Catching image is defined as the value of determining each pixel 104.This group pixel value constitutes image 103.

In the catching image process, pixel value obtains by the following method: on the surface of pixel 104, during a period of time is the time shutter, carries out integration to being derived from the partial luminous flux of scene 3 by optical system 100, and the result of this integration is converted to a numerical value.To the integration of luminous flux and/or this integral result is converted to digital value finishes by electronic unit 102.

This definition of pixel value notion can be applicable to the situation of black and white or color image 103, no matter they are static or or animation.

But, with the difference of concrete condition, also can obtain the partial luminous flux of current discussion by following different modes:

A) under the situation of color image 103, sensor surface 110 is made of multiple pixel 104 usually, and described polytype pixel 104 interrelates with the luminous flux of different wave length respectively, and is for example red, green and blue pixel.

B) under the situation of color image 103, also have many sensors arranged side by side 101, each receiving unit luminous flux.

C) under the situation of color image 103, the color of use may be different from redness, and is green and blue, the more than three kinds of colors of for example North America ntsc television, and possibility.

D) last, under interlacing television scanning camera scenario, the animated image of generation is alternately to be made of image 103 that comprises even number line and the image 103 that comprises odd-numbered line.

Used configuration, used adjusting, used feature

Used configuration definition is the tabulation of the movable-component of image trapping device 1, and for example: optical system 100, it is installed on the image trapping device 1, if it is interchangeable.Used configuration is specifically characterized by following feature:

The type of-optical system 100,

The sequence number of-optical system 100 or other sign.

Used adjusting is defined as:

The used configuration of-above definition, and

-the craft or the self-regulating value of visual 103 contents of available influence in used configuration.These adjustings can be provided with by the user, mode particularly by touching the button, or calculate by image trapping device 1.These adjustings may be stored in the device, particularly are stored on the removable medium, or are stored on any equipment that is connected to device.These regulators can comprise specifically that focusing regulates, and to the adjusting of the aperture and the focal length of optical system 100, the time shutter is regulated, and white balance is regulated, and composite image handles and regulate, Digital Zoom for example, compression and contrast.

A used feature 74 or a used stack features 74 are defined as:

A) relate to the parameter of the inherent technology feature of image trapping device 1, described parameter is to determine in the design phase of image trapping device 1.For example, these parameters can comprise the scheme (formula) of the optical system 100 of used configuration, and this scheme can influence the geometrical defect and the sharpness of the image that obtains; Optical system 100 schemes of used configuration specifically comprise the shape of lens in the optical system 100, arrange and material.

These parameters can also comprise:

The geometrical property of-sensor 101, just sensor surface 110 and on this surface the shape and relative arrangement of pixel 104,

The noise that-electronic unit 102 produces,

-conversion regime from the luminous flux to the pixel value.

B) with the parameter of the inherent technology feature association of image trapping device 1, described parameter is to determine in the fabrication phase of image trapping device 1, specifically comprises:

The accurate location of lens in the optical system 100 of-used configuration,

-optical system 100 is with respect to the accurate location of sensor 101.

C) parameter related with the technical characterictic of image trapping device 1, described parameter are to determine in the moment of obtaining image 103, specifically comprise:

-sensor surface 110 is with respect to the position and the direction of scene 3,

-used adjusting,

-the external factor that exerts an influence, for example temperature.

D) user's the used colour temperature of preferential selection, particularly image recovery.For example, the mode definite preferential selection of user by touching the button.

Observation station, observed ray

In conjunction with Fig. 1, now provide the definition of observation station 105 and observed ray 106.

Mathematics surface 10 is defined as a surface with sensor surface 110 geometric correlations.For example, if sensor surface is smooth, then mathematics surface 10 just might overlap with sensor surface.

Observed ray 106 is defined as in the scene 3 straight line that one point union at least passes optical centre 111.Observation station 105 is defined as the point of crossing on observed ray 106 and surface 10.

The observation color, observed strength

In conjunction with Fig. 1, the existing definition of describing observation color and observed strength.The observation definitions of color for by described scene 3 sometime along observed ray 106 send, transmission or reflection, and the color of the light that observes from described observation station 105.Observed strength is defined as by described scene 3 and sends along described observed ray 106 in the same moment, and the intensity of the light that observes from described observation station 105.

The light intensity that color can be used as function of wavelength particularly characterizes, and perhaps also can be characterized by two numerical value for example measuring with colorimeter.Intensity can be represented with a value, for example use the value of photometer measurement.

Described observation color and described observed strength specifically depend on the relative position of object 107 in scene 3, current lighting source, and when observation object 107 transparency and reflectance signature.

Mathematical projection, the mathematics image, the mathematics point, the mathematical color of point,

The mathematics intensity of point, the mathematical shape of point, the mathematics position of point

In conjunction with Fig. 1,5,9a, 9b, 9c and 9d now describe following notion: mathematical projection 8, mathematics image 70, mathematics point, the mathematical color of point, the mathematics intensity of point, the mathematics position 40 of the mathematical shape 41 of point and point.

In conjunction with Fig. 5, the existing mathematical projection of how describing by the appointment of at least one scene 38 forms mathematics image 70 on mathematics surface 10.

The notion of specifying mathematical projection 8 is at first described.

The mathematical projection 8 of an appointment makes mathematics image 70 and following every interrelating:

-obtain visual scene 3 at 103 o'clock,

-and used feature 74.

The mathematical projection 8 of an appointment is a kind of conversion, and scene 3 when obtaining image with cause and used feature 74 are determined the feature of each point of mathematics image 70.

Preferably, mathematical projection 8 uses following mode to define:

The mathematics position 40 of this point is defined as the position of observation station 105 on mathematics surface 10.

The mathematical shape 41 of this point is defined as the shape of point-like of the geometry of observation station 105.

The mathematical color of this point is defined as the observation color.

The mathematics intensity of this point is defined as observed strength.

The mathematics point is defined as the mathematics position 40 of observation station 105, mathematical shape 41, the contact of mathematical color and mathematics intensity.Mathematics image 70 is organized described mathematics point by this and is constituted.

The mathematical projection 8 of scene 3 is mathematics images 70.

Actual projection, actual point, the actual color of point,

The actual strength of point, the true form of point, the physical location of point

In conjunction with Fig. 3,5,9a, 9b, 9c and 9d now describe following notion: actual projection 72, actual point, the actual color of point, the actual strength of point, the physical location 50 of the true form 51 of point and point.

In the catching image process, image trapping device 1 connects the image 103 of scene 3 with used feature 74.Be derived from scene 3, pass optical system 100, arrive sensor surface 110 along the light of observed ray 106.

For described observed ray, obtain defined actual point this moment, and it is compared with the mathematics point and there are differences.

To 9d, the difference of actual point and mathematics point is described now in conjunction with Fig. 9 a.

The true form 51 related with described observed ray 106 is not a point that is positioned on the sensor surface, and the similar cloud of its shape in three dimensions intersects with one or more pixels 104.The concrete reason that causes these differences is: commatic aberration, and spherical aberration, astigmatism is divided into 104 groups of pixels, colored aberration, depth of field, diffraction, passive reflection, and the field curvature of image trapping device 1.They produce, and image 103 blurs or the impression of unclarity.

In addition, the physical location 50 related with described observed ray 106 compared with the mathematics position 40 of point and be there are differences.The reason that causes this difference is a geometry deformation, and this can produce the impression of distortion: for example, vertical wall looks and has buckled.Also have a fact to cause this difference: promptly the number of pixel 104 is limited, so physical location 50 can only have limited numerical value.

In addition, the actual strength related with described observed ray 106 compared with the mathematics intensity of point and be there are differences.The reason that causes these differences is gamma and vignetting: for example, the edge of image 103 seems colour-darkening.In addition, may be added with noise in the signal.

At last, the actual color relevant with described observed ray 106 compared with the mathematical color of point and be there are differences.The reason that causes these differences is gamma and colour cast.In addition, may be added with noise in the signal.

Actual point is defined as the physical location 50 of the observed ray 106 of current consideration, true form 51, the contact of actual color and actual strength.

The actual projection 72 of scene 3 is made up of this group actual point.

The parameterisable transformation model, parameter, corrected image

Parameterisable transformation model 12 (or abbreviating parameterisable conversion 12 as) is defined as the mathematics conversion that can obtain corrected image 71 by image 103 and parameter value.As mentioned below, described parameter can calculate by used feature 74.

By described parameterisable conversion 12, each actual point for image 103, might pass through parameter value, physical location by described actual point, and the pixel value of passing through image 103, determine that the correction of described actual point puts the calibration color of described actual point, the correction shape of the correction intensity of described actual point and described actual point.For example, can come the calculation correction position by the fixed number of times polynomial expression as the physical location function, this polynomial coefficient depends on the value of described parameter.For example, correction of color and correction intensity can be the weighted sums of pixel value, and described coefficient perhaps also can be the nonlinear function of the pixel value of image 103 by parameter value and physical location decision.

Parameterisable inverse conversion model 212 (or abbreviating parameterisable inverse conversion 212 as) is defined as the mathematics conversion that obtains image 103 by corrected image 71 and parameter value.As mentioned below, described parameter can be calculated by used feature 74 as described below.

By described parameterisable inverse conversion 212, each point for corrected image 71, might be by the value and the corrected image 71 of described parameter, determine specifically to comprise the intensity of the color of the position of described actual point, described actual point, described actual point and the shape of described actual point corresponding to the actual point of the image 103 of the described point of corrected image 71.For example, the position of actual point can draw by the fixed number of times polynomial computation as the function of this position of corrected image 71, and this polynomial coefficient is determined by parameter value.

Described parameter specifically can comprise: the focal length or the correlation of the optical system 100 of used configuration, the position of one group of lens for example, the focusing or the correlation of the optical system 100 of used configuration, the position of one group of lens for example, the aperture or the correlation of the optical system 100 of used configuration, for example position of diaphragm (diaphragm).

Difference between mathematics image and the corrected image

In conjunction with Fig. 5, for given scene 3 and used feature 74, the difference between mathematics image 70 and the corrected image 71 is defined as: by the definite one or more values of the numerical value of the position, color, intensity and the shape that characterize all or part of check point and all or part of mathematics point.

For example, for given scene 3 and used feature 74, the difference between mathematics image 70 and the corrected image 71 can be defined as:

-there is the unique point select, for example can be the point of the orthogonal array 80 that constitutes of regularly arranged point, as shown in figure 10.

-for example,, can come calculated difference 73 by the absolute value sum of the difference between per two numerical value of trying to achieve correction position, correction of color, correction intensity and the correction shape of representing check point and mathematics point respectively to each unique point.The summing function of the absolute value of above-mentioned difference can replace with other function, for example averages, and square summation and other can make up the function of these numerical value.

Reference scene

Reference scene 9 is defined as the known scene of some feature 3.For example, Fig. 4 a shows a reference scene 9, and it is made up of a paper that comprises the solid black circle of regular distribution.Fig. 4 b shows other a piece of paper, comprises same circle, also has colored lines and zone.Circle is used for measuring the physical location 50 of a point, and lines are used for measuring the true form 51 of a point, and colored region is used for measuring the actual color and the actual strength of a point.This reference scene 9 can be made of the other materials except paper.

Reference picture

In conjunction with Figure 12, the notion of reference picture 11 is described now.Reference picture 11 is defined as the image that uses the reference scene 9 that image trapping device 1 obtains.

Composite image, the composite image class

In conjunction with Figure 12, the notion of composite image 207 and composite image class 7 is described now.Composite image 207 is defined as the mathematics image 70 that the mathematical projection 8 by a reference scene 9 obtains.Composite image class 7 is defined as the one group of mathematics image 70 that obtains by the mathematical projection 8 to one or more reference scenes 9 of being used for one or more groups used feature 74.Having only a reference scene 9 and only using under the situation of a stack features 74, composite image class 7 includes only a composite image 207.

The conversion image

In conjunction with Figure 12, the existing notion of describing conversion image 13.Conversion image 13 is defined as by parameterisable transformation model 12 is applied to the corrected image that reference picture 11 obtains.

The conversion image approaching with the composite image class, deviation

In conjunction with Figure 12, the existing description and the notion of the approaching conversion image 13 of composite image class 7 and the notion of deviation 14.

Difference between conversion image 13 and the composite image class 7 is defined as the minimum difference between any one composite image 207 of described conversion image 13 and described composite image class 7.

In conjunction with Figure 12, first algorithm is below described, under the different situation of reference scene 9 and used feature 74, use this algorithm can in a plurality of parameterisable transformation models 12, select to can be used to each reference picture 11 is converted to and transformation model corresponding to the approaching conversion image 13 of the composite image class 7 of the reference scene 9 of described reference picture 11.

-under the related situation of given reference scene 9 and one group of used feature 74, can select parameterisable conversion 12 (and its parameters), be used for converting reference picture 11 to composite image class 7 difference minimums conversion image 13.Like this, composite image class 7 and conversion image 13 will be very approaching.Deviation 14 is defined as described difference.

-under the related situation of the used given feature of the related and many groups of given one group of reference scene 74, can select the function of parameterisable conversion 12 (and its parameters) as the difference between the composite image class 7 of each reference scene 9 of the conversion visual 13 of each reference scene 9 and current consideration.There are parameterisable conversion 12 (and its parameters) select, are used for converting reference picture 11 to conversion image 13, that make described difference and minimum.This summing function can replace with another function, for example asks the product function.Like this, just think that composite image class 7 and conversion image 13 are close.Deviation 14 is defined as, for example the value that obtains from described difference by calculating mean value.

-under some used feature 74 condition of unknown, might determine these features by a plurality of reference pictures 11 that obtain at least one reference scene 9.In this case, determine this unknown characteristics and parameterisable conversion 12 (and parameters) simultaneously, reference picture 11 can be converted to conversion image 13 by this conversion, that make described difference and minimum, particularly by iterative computation, perhaps find the solution about described difference and and/or the equation of other appropriate combination of product and/or described difference.Like this, just think that composite image class 7 and conversion image 13 are approaching.For example, unknown characteristics can be the relative position and the direction of the reference scene 9 of sensor surface 110 and current consideration.Deviation 14 is defined as the value that obtains from described difference, for example by calculating the value that its mean value obtains.In conjunction with Figure 12, second computational algorithm is now described, use this algorithm to make a choice in following scope:

-in one group of parameterisable transformation model,

-in one group of parameterisable inverse conversion model,

-be combined in the image one,

-in one group of reference scene and one group conversion image.

This select based on:

-reference scene 9, and/or

-conversion image 13, and/or

-parameterisable transformation model 12 uses this transformation model to be converted to conversion image 13 with catch the reference picture 11 that reference scene 9 obtains by means of image trapping device 1, and/or

-be used for and will change the parameterisable inverse conversion model 212 that image 13 is converted to reference picture 11, and/or

-composite image 207 obtaining from reference scene 9 and/or reference picture 11.

The selection of being adopted is the selection that makes the difference minimum of conversion image 13 and composite image 207.Like this, just think that composite image 207 and conversion image 130 minutes are approaching.Deviation 14 is defined as described difference.

Preferably, according to the present invention, might select a mathematical projection 8 in one group of mathematical projection by means of second computational algorithm, described mathematical projection is used for generating composite image 207 from reference scene 9.

In conjunction with Figure 12, the 3rd computational algorithm now described, may further comprise the steps:

At least one reference scene 9 of-selection,

-obtain at least one reference picture 11 of each reference scene 9 by means of image trapping device 1.

The 3rd algorithm also is included in one group of parameterisable transformation model and and is combined into the step of selecting following content in the image:

-be used for reference picture 11 is converted to the parameterisable transformation model 12 of changing image 13, and/or

-the composite image 207 that obtains from reference scene 9 and/or reference picture 11,

The selection of being adopted is the selection that makes the difference minimum between conversion image 13 and the composite image 207.Like this, just think that composite image 207 and conversion image 13 are approaching.Deviation 14 is defined as described difference.

Preferably, according to the present invention, might select a mathematical projection 8 in one group of mathematical projection by the 3rd computational algorithm, described mathematical projection is used to generate composite image 207 from reference scene 9.

Best transition

Best transition is defined as:

A kind of conversion in the-parameterisable transformation model 12, by this conversion, each reference picture 11 can be converted to corresponding to the approaching conversion image 13 of the composite image class 7 of the reference scene 9 of described reference picture 11, and/or

-parameterisable transformation model 12, parameterisable transformation model is wherein for example changed image 13 near composite image 207, and/or

-parameterisable inverse conversion model 212, parameterisable inverse conversion model wherein, for example conversion image 13 is near composite image 207.

Calibration

Calibration is defined as a kind of method, by this method, for one or more used configurations, obtains relating to the data of the inherent feature of image trapping device 1, and wherein, every kind of configuration all comprises the optical system 100 related with image trapping device 1.

Situation 1: this situation only comprises a kind of configuration, said method comprising the steps of:

-the step of the described optical system 100 of installation in described image trapping device 1,

The step of the one or more reference scenes 9 of-selection,

The step of several used features 74 of-selection,

-be the step that described used feature is obtained the image of described reference scene 9,

-be step corresponding to each group reference scene 9 calculating optimums conversion of identical used feature 74.

Situation 2: this situation is considered to said method comprising the steps of corresponding to all configurations of given image trapping device 1 and all optical systems 100 of the same type:

The step of the one or more reference scenes 9 of-selection;

The step of several used features 74 of-selection;

-by for example calculating the software of this optical system by ray trace, from used feature 74, particularly from the scheme of the optical system 100 of used configuration, and from the step of the value computational picture 103 of parameter,

Situation 3: this situation is considered to said method comprising the steps of corresponding to all configurations of given optical system 100 and all image trapping devices 1 of the same type:

-step of described optical system 100 is installed on the image trapping device 1 of the type of current consideration,

The step of the one or more reference scenes 9 of-selection,

The step of several used features 74 of-selection,

Preferably, can calibrate each device and configuration in the situation 1 by the manufacturer of image trapping device 1.This method is more accurate, but more restriction is arranged, and being specially adapted to optical system 100 is not interchangeable situation.

Perhaps, can calibrate every kind of type of device in the situation 2 and configuration by the manufacturer of image trapping device 1.This method does not have second kind accurately, but simpler.

Perhaps, can calibrate every kind of type of device in the situation 3 and optical system 100 by the manufacturer of image trapping device 1 or third party.This is a kind of compromise method, wherein, can use an optical system 100 in all image trapping devices 1 of same type, and does not need to repeat calibration for the combination of each image trapping device 1 and optical system 100.Comprise at image trapping device 1 under the situation of not interchangeable optical system, the device that this method allows for each given type only carries out primary calibration.

Perhaps, to each image trapping device and the configuration in the situation 1, can calibrate by device dealer or setter.

Perhaps, to each optical system 100 and the every kind of means in the situation 3, can calibrate by the dealer or the setter of device.

Perhaps, to each device and the configuration in the situation 1, can calibrate by the user of device.

Perhaps, to each optical system 100 and the every kind of means in the situation 3, can calibrate by the user of device.

The design of digit optical system

The design of digit optical system is defined as the method for the cost that is used for reducing optical system 100, reduces cost and realizes by following means:

One of-design has defective, and particularly actual point is located the optical system 100 of defective, or selects said system from catalogue,

The quantity of-minimizing lens, and/or

The shape of-simplification lens, and/or

-use cheap material, handle operation or production run.

Said method comprising the steps of:

-select the step of acceptable difference (in the intended scope of above-mentioned qualification),

The step of the one or more reference scenes 9 of-selection,

The step of several used features 74 of-selection,

The repetition that described method is further comprising the steps of:

-select the step of an optical plan, this scheme specifically comprises the shape of lens, material and arrangement,

-by adopting, for example by the software of ray trace calculating optical system, or by prototype is measured, from used feature 74, particularly from the step of the computation schemes image 103 of the optical system 100 of used configuration,

-be step corresponding to each group reference scene 9 calculating optimums conversion of identical used feature 74,

Whether-checking difference acceptable step, till difference can be accepted.

Formatted message

The formatted message 15 related with visual 103, or formatted message 15 are defined as all or part of of following data:

-relate to the data of the inherent technology feature, particularly distortion characteristic of image trapping device 1, and/or

-relating to the data of the technical characterictic of image trapping device 1 when obtaining image, described technical characterictic is the time shutter particularly, and/or

-relate to described user priority to select, the data of colour temperature particularly, and/or

-relate to the data of deviation 14.

Property data base

Property data base 22 is defined as the database that comprises formatted message 15, the corresponding one or more image trapping devices 1 and one or more visual 103 of this formatted message.

Described property data base 22 can centralized stores or distributed store, particularly can:

-be integrated into image trapping device 1,

-be integrated into optical system 100,

-be integrated into a movable memory equipment,

-in the catching image process, be integrated into PC or be connected to other computing machine of other element,

Be integrated into PC after-catching image finishes or be connected to other computing machine of other element,

-be integrated into other computing machine that PC maybe can read the storage medium of sharing with image trapping device 1,

-being integrated into a remote server that is connected with PC or other computing machine, itself is connected with other catching image element.

Field

In conjunction with Fig. 8, the definition of existing description field 91.The formatted message 15 related with visual 103 be record in a variety of forms, and is configured to one or more forms.But it logically corresponding to all or part field 91, comprising:

(a) focal length,

(b) depth of field,

(c) geometrical defect.

Described geometrical defect comprises image 103 geometrical defect, and the parameterisable conversion of the feature of image trapping device 1 characterizes when being taken by parameter related with taking feature 74 and representative.By described parameter and the conversion of described parameterisable, the correction position of a point of just possible computational picture 103.

Described geometrical defect also comprises vignetting, and the parameterisable conversion of the feature of image trapping device 1 characterizes when being taken by parameter related with taking feature 74 and representative.By described parameter and the conversion of described parameterisable, the correction intensity of a point of just possible computational picture 103.

Described geometrical defect also comprises colour cast, and the parameterisable conversion of the feature of image trapping device 1 characterizes when being taken by parameter related with taking feature 74 and representative.By described parameter and the conversion of described parameterisable, the correction of color of a point of just possible computational picture 103.

Described field 91 also comprises the sharpness of (d) image 103.

Described sharpness is included in the unintelligibility of image 103 in differentiating, and the parameterisable conversion of the feature of image trapping device 1 characterizes when being taken by parameter related with taking feature 74 and representative.By described parameter and the conversion of described parameterisable, the correction shape of a point of just possible computational picture 103.Unintelligibility specifically comprises: commatic aberration, and spherical aberration, astigmatism is divided into 104 groups of pixels, colored aberration, depth of field, diffraction, passive reflection, and field curvature.

Described sharpness also comprises the unintelligibility in the depth of field, particularly spherical aberration, commatic aberration, astigmatism.Described unintelligibility depends on point in the scene 3 with respect to the distance of image trapping device 1, and the parameterisable conversion of the feature of image trapping device 1 characterizes when being taken by parameter related with taking feature 74 and representative.By described parameter and the conversion of described parameterisable, the correction shape of a point of just possible computational picture 103.

Described field 91 also comprises the parameter of (e) quantization method.Described parameter depends on the geometrical property and the physical characteristics of sensor 101, the architecture of electronic unit 102 and operable any one process software.

Described parameter comprises the function that the intensity of representing pixel 104 changes with wavelength that is derived from described scene 3 and luminous flux.Described function specifically comprises gamma information.

Described parameter also comprises:

The geometrical property of-described sensor 101, the shape of the sensitive element of particularly described sensor 101, relative position and quantity,

The function that the room and time of the noise of-presentation image acquisition equipment 1 distributes,

-presentation image is caught the value of time shutter.

Described field 91 also comprises the digital processing operation, the particularly parameter of Digital Zoom and compression that (f) carried out by image trapping device 1.These parameters depend on the process software of image trapping device 1 and user's adjusting.

Described field 91 also comprises:

(g) expression user's the parameter of preferential selection is particularly about the fog-level and the resolution of image 103.

(h) deviation 14.

The calculating of formatted message

Formatted message 15 can calculate in a plurality of stages and be stored in the database 22.

A) design of image trapping device 1 ending.

By this stage, might obtain the inherent technology feature of image trapping device 1, particularly:

The room and time of the noise that-electronic unit 102 produces distributes,

-conversion plan from the luminous flux to the pixel value.

The geometrical property of-sensor 101.

B) calibration of digit optical system or design ending.

By this stage, might obtain other inherent technology feature of image trapping device 1, particularly for the relevant conversion of optimum and the dependent deviation 14 of the used eigenwert of some.

C) user selects the preferential stage of selecting by button, menu, removable medium or with being connected of miscellaneous equipment.

D) the catching image stage

By this stage (d), might obtain image trapping device 1 technical characterictic when obtaining image, particularly time shutter, it is determined by automatic adjusting manual or that carried out.

By stage (d), also may obtain focal length.Focal length passes through

-to the measurement of position of this group lens of variable focal length of optical system 100 in the used configuration, or

One set-point of-input positioning motor, or

The value that-manufacturer provides is if focal length is calculating of fixing.

At this moment, can determine described focal length by the content of analyzing image 103.

By stage (d), also might obtain depth of field.Depth of field passes through

-to the measurement of position of this group focusing lens of optical system 100 in the used configuration, or

One setting value of-input positioning motor, or

The value that-manufacturer provides is if depth of field is determining of fixing.

By stage (d), also might obtain geometrical defect and sharpness defective.Geometrical defect is consistent with a conversion with the sharpness defective, and this conversion draws by means of the combination calculation of a plurality of conversions of the database 22 of the feature that obtains in stage (b) ending.This combination is selected to be used for representing parameter value corresponding to used feature 74, and described feature is focal length particularly.

By stage (d), also might obtain parameter by the digital processing of image-processing system 1 execution.These parameters are to determine by automatic adjusting manual or that carried out.

According to the stage (a) to (d), can be by carry out calculating with lower device or software to formatted message 15:

-be integrated into the equipment or the software of image trapping device 1, and/or

Drive software in-PC or other computing machine, and/or

Software in-PC or other computing machine, and/or

-above three combination.

Can be with following form storage aforementioned stages (b) and the conversion (d):

-general mathematical formulae,

The mathematical formulae of-corresponding each point,

The mathematical formulae of-corresponding some unique point,

This mathematical formulae can pass through following content description:

-one row coefficient;

-one row coefficient and coordinate;

By these diverse ways, can be used for reaching compromise between the computing power of storing the memory size of formula and can be used for calculation correction image 71.

In addition, for retrieve data, also to write down the identifier relevant in the database 22 with these data.These identifiers specifically comprise:

The type of-image trapping device 1 and the identifier of index,

If-optical system can be the type of optical system 100 and the identifier of index for movably,

The type of-other any displaceable element and index identifier, described displaceable element is linked to canned data.

The identifier of-image 103,

The identifier of-formatted message 15,

Finish image

As shown in figure 11, finish image 120 and be defined as the image 103 related with formatted message 15.Preferably, this finishes image 120 can have the form of file P100, as shown in figure 14.This finishes image 120 can also be divided into a plurality of files.

Can calculate by image trapping device 1 and finish image 120.Can also pass through external computing device, for example a computing machine calculates and finishes image.

Imgae processing software

Imgae processing software 4 is defined as accepts one or more images 120 of finishing as input, and these images are carried out the software of handling operation.These are handled operation and specifically can comprise:

Corrected image 71 of-calculating,

-in reality, measure,

-make up several images,

The visual fidelity of-raising with respect to reality,

The subjective quality of-raising image,

-detecting object or person 107 in scene 3,

-adding object or person 107 in scene 3,

-in scene 3, replace or modification object or person 107,

-from scene 3, delete shade,

-in scene 3, add shade,

-in image library, search for object.

Described imgae processing software can:

-be integrated into image trapping device 1,

-can in calculation element 17, move, this calculation element is connected to image trapping device 1 by transmitting device 18.

The digit optical system

Digit optical system definition is image trapping device 1, property data base 22, and the combination of calculation element 17, and this makes up permission:

-obtain the image 103,

-calculate and finish image,

-calculation correction image 71,

Preferably, the user directly obtains corrected image 71.If desired, the user can require to forbid from normal moveout correction.

Property data base 22 can:

-be integrated into image trapping device 1,

-after catching image finishes, be integrated into PC or be connected to other computing machine of other element,

-be integrated into the computing machine that PC or other can read the storage medium of sharing with image trapping device 1,

-being integrated into the remote server that links with PC or other computing machine, database itself is connected with other catching image element.

Calculation element 17 can:

-be integrated into an assembly with sensor 101,

-be integrated into an assembly with the part of electronic unit 102,

-be integrated into image trapping device 1,

-being integrated into the remote server that is connected with PC or other computing machine, calculation element itself is connected with other catching image element.

The processing of complete chain

Above paragraph has proposed the accurate description to notion basically, and according to the present invention, provides the method and system of the formatted message 15 of the feature that relates to image trapping device 1 to imgae processing software 4.

In following paragraph, provide these conception expansion definition, and also supplementary notes provide the method and system of the formatted message 15 of the feature that relates to image recovery device 19 according to the present invention to imgae processing software 4.The processing of complete chain will be set forth by this way.

By processing, possible to complete chain:

-improvement in the defective of corrected image acquisition equipment 1 and image recovery device 19, obtains to recover image 191 from the quality of the image 103 of the end to end of this chain, and/or

-in video projector, in conjunction with the software service property (quality) and all lower optical system of cost that improve image quality.

The definition related with the image recovery device

In conjunction with Fig. 2,17 and 6, now be described in the formatted message 15, how to consider image recovery device 19, for example the feature of printer, visual display unit screen or projector.

The definition that provides from the situation of using image trapping device 1, these those skilled in the art can infer under the situation of using image recovery device 19 how this definition is replenished and revises by the method for analogizing.But, existing in order to illustrate this method specifically in conjunction with Fig. 6 and Figure 17, main replenishing or revising described.

By employed recovery feature 95, specified the inherent feature of image recovery device 19, in the image recovery feature of visual recovery device 19 constantly, and user's preferential selection during image recovery.Specifically under the situation of projector, used recovery feature 95 comprises the shape and the position of used screen.

Recover transformation model 97 (or abbreviating parameterisable recovery conversion 97 as) by parameterisable, specify and the 12 similar mathematics conversions of parameterisable transformation model.By the contrary transformation model 297 (or abbreviating the contrary recovery conversion 297 of parameterisable as) that recovers of parameterisable, specify and the 212 similar mathematics conversions of parameterisable inverse conversion model.

Recover image 94 by proofreading and correct, specify by parameterisable being recovered conversion 97 and be applied to image 103 images that obtain.

Recover projection 96 by mathematics, specify a mathematical projection, this mathematical projection makes mathematics recover image 92 to recover image 94 and be associated with proofreading and correct, and described mathematics recovers image 92 with to recover the mathematics recovery that medium 190 gets in touch for how much lip-deep.This mathematics recovers the shape of the mathematics recovery point on surface, and color and intensity calculate from proofreading and correct recovery image 94.

By reality recovery projection 90, specify contact to recover the projection of image 191 and image 103.The pixel value of image 103 is converted to the signal of the modulator that drives recovery device 19 by the electronic unit of recovery device 19.Recovering to obtain actual recovery point on the medium 190.The feature of described actual recovery point comprises shape, color, intensity and position.Above-described phenomenon of in the situation of image trapping device 1 pixel 104 being divided into groups can not occur in the situation of image recovery instrument.But, a kind of opposite phenomenon can appear, and it is stepped that concrete outcome is that straight line can present.

Recover difference 93 and be appointed as the difference of recovering between image 191 and the mathematics recovery image 92.This recovery difference 93 is analogized from difference 73 and is obtained.

By recovering to specify an image 103 with reference to 209, in this image, the value of known pixel 104.By the reference 211 after recovering, specify mathematics to recover the recovery image 191 that projection 90 obtains by recovering with reference to 209.Recover image 213 by calibration reference, specify, be used for parameterisable and recover transformation model 97 and/or the contrary correction recovery visual 94 that recovers transformation model 297 of parameterisable corresponding to recovery reference 209.By the synthetic image 307 that recovers, specify the mathematics that recovers image 213 by calibration reference to recover the mathematics that projection 96 obtains and recover image 92.

Specify by the optimized database restore conversion:

-for recovering reference 209 and used recovery feature 95, can be used to convert image 103 to one and proofread and correct recovery image 94, make its mathematics recover projection 92 and compare the recovery difference 93 that shows minimum with recovery image 191, and/or

-a plurality of parameterisables recover the parameterisable recovery conversion 97 in the transformation model, and feasible recovery back reference 211 is compared with synthetic recovery visual 307 and shown minimum recovery difference 93, and/or

Parameterisable inverse conversion 297 in-a plurality of parameterisable inverse conversion models is compared the recovery difference 93 that shows minimum with reference to 211 with synthetic recovery image 307 after feasible the recovery.

Like this, just think that recovery back reference 211 and synthetic recovery image 307 are approaching.

The recovery calibration steps of digit optical recovery system and method for designing can be with in the situations of image trapping device 1, and the bearing calibration of figure adjustment system is compared with method for designing.But, there are differences in some stage, particularly with the next stage:

-select to recover the stage of reference 209;

The recovery execute phase of-described recovery reference;

-calculate the stage of optimized database restore conversion.

Preferably, according to the present invention, this method comprises the 4th algorithm, is used for computation scheme information 15.Might in following scope, make a choice by the 4th algorithm:

-in the recovery transformation model of one group of parameterisable,

-recover in the transformation model at the contrary of one group of parameterisable,

-recover in the projection at one group of mathematics,

-recover in the image in one group of recovery reference and one group of calibration reference.

The selection of making by the 4th algorithm based on:

-recover with reference to 209 and/or

-calibration reference recover image 213 and/or

-be used for being converted to the recovery transformation model 97 that calibration reference recovers the parameterisable of image 213 with recovering reference 209, and/or

-be used for that calibration reference is recovered image 213 to be converted to the contrary transformation model 297 that recovers of the parameterisable that recovers reference 209, and/or

-being used for recovering the synthetic mathematics that recovers image 307 of image 213 formation from calibration reference recovers projection 96.

The 4th algorithm makes one's options by this way, promptly makes this synthetic image 307 that recovers approach to use 19 pairs of recoveries of image recovery device with reference to reference 211 after 209 recoveries that recover to obtain.Compare existence with reference to 211 with synthetic recovery image 307 after recovering and recover difference 214.

According to an alternative embodiment of the present invention, this method comprises the 5th algorithm, is used for computation scheme information.The 5th algorithm may further comprise the steps:

-select at least one to recover with reference to 209,

-will recover to revert to the recovery back with reference to 211 by image recovery device 19 with reference to 209.

By the 5th algorithm, also may recover to select in transformation model and one group of mathematics recovery projection at one group of parameterisable:

-be used for recovering visual 213 parameterisable recovery transformation model 97 with recovering to be converted to calibration reference with reference to 209, and/or

-being used for recovering the synthetic mathematics that recovers image 307 of image 213 formations from calibration reference recovers projection 96.

Select by this way by the 5th algorithm, promptly make the synthetic image 307 that recovers approach to recover the back with reference to 211.Deviation 214 is recovered with reference to comparing to exist with this synthetic recovery image 307 in this recovery back.By the contrary transformation model 297 that recovers of parameterisable, calibration reference may be recovered image 213 and be converted to recovery with reference to 209.

According to another alternative embodiment of the present invention, this method comprises and is used for the 6th algorithm of computation scheme information.The 6th algorithm comprises the step of selecting calibration reference to recover image 213.The 6th algorithm also is included in one group of parameterisable recovery transformation model and one group of mathematics recovers in the projection and the step of selecting in one group of recovery reference.This select based on:

-recover with reference to 209 and/or

-being used for recovering the synthetic mathematics that recovers image 307 of image 213 formation from this calibration reference recovers projection 96.

The 6th algorithm makes one's options by this way, and the promptly feasible synthetic image 307 that recovers approaches by 19 pairs of recoveries of image recovery device with reference to reference 211 after 209 recoveries that recover to obtain.Compare existence with reference to 211 with synthetic recovery image 307 after recovering and recover deviation.

Preferably, according to the present invention, this method comprises the 7th algorithm, is used for calculating recovery deviation 214.The 7th algorithm may further comprise the steps:

-calculate and recover back reference 211 and the synthetic recovery difference of recovering between the image 307 214,

-recovery difference 214 is associated with formatted message 15.

The combination of technical characterictic makes possible, during making this device, verifies that automatically this method has produced the formatted message of tolerance in allowed band.

The formatted message 15 that relates to image trapping device 1 and relate to image recovery device 19 can be used for same image end to endly.

Under the situation of geometric distortion, the formatted message 15 that also might will be referred to each device combines, and obtains to relate to the formatted message 15 of this device chain, for example by increasing a vector field.

Above be given in the notion of field under the situation of using image trapping device 1.This notion also can be extrapolated under the situation of using image recovery device 19.But the parameter of quantization method will replace to the parameter of signal reconstruction method, just: geometrical property and the position thereof, the time of the noise of presentation image recovery device 19 and the function of space distribution that recover medium 190.

According to an alternative embodiment of the present invention, recovery device 19 is got in touch with image trapping device 1, so that recover the recovery back with reference to 211 with digital form from recovering reference 209.This method makes: for the formatted message 15 that produces the defective P5 that relates to recovery device 19, use relates to the formatted message 15 of the image trapping device related with this recovery device 1, so that for example the defective of corrected image acquisition equipment 1 by this way promptly makes and recovers the back with reference to 211 defective P5 that comprise recovery device 19.

Notion is promoted

The present invention comprises, the technical characterictic that in claims, indicates, and by the image trapping device of reference number type, the device that just produces digital image has carried out qualification, description and example.Be readily appreciated that, same technical characterictic is applicable to the situation for the image trapping device that makes up with lower device: based on the device (using responsive silver halide film, the photography of egative film or reversible film or film device) of silver-colored technology and the combination that produces the scanner of digital image from the sensitive film of developing and printing.Certainly, in this case, can suitably arrive and revise some employed definition.These are modified within those skilled in the art's the limit of power.For showing the apparent property of this modification, only need mention: under situation based on the combination of the device of silver-colored technology and scanner, after by means of the fundamental region digitizing of scanner, must be applied to this fundamental region in conjunction with the notion of pixel shown in Fig. 3 and pixel value with the film surface.The transposition of this definition is self-evident, can expand in the notion of used configuration.For example, in the tabulation of the movable-component of the image trapping device 1 that comprises in the used configuration, can also replenish the photographic roll film type of effectively using based in the silver-colored technique device.

By reading definition and the embodiment that describes below in conjunction with Fig. 1 to 17, further feature of the present invention and advantage can become obviously, and described definition and embodiment are illustratives but not determinate.

Device

Specifically in conjunction with Fig. 2,3 and 13, the notion of existing tracing device P25.In intended scope of the present invention, device P25 can be specifically:

-image trapping device 1, disposable camera device for example, digital camera, reflection unit, scanner, facsimile recorder, endoscope, camcorder, monitor camera, game machine, be integrated into or be connected to the camera of phone, personal digital assistant or computing machine, heat energy camera, or ultrasonography device

-image recovery device 19 or image recovery instrument 19, screen for example, projector, televisor, virtual reality eyepiece or printer,

-a kind of device comprises its installation, projector for example, and screen and their locator meams,

-observer is with respect to the location of image recovery device 19, and it specifically causes parallax,

-defects of vision are arranged, for example San Guang people or observer,

-a kind of be expected to can be imitated device, for example look the image that is similar to the image that the leca camera device produced in order to produce,

-image processing facility that increases fuzzy edge effect arranged, zoom software for example,

-with the virtual bench of multiple arrangement P25 equivalence,

Can consider complicated apparatus P25 more, scanning/fax/Printing machine for example, the photo prints flushing device, video conference device is as device P25 or multiple arrangement P25.

The device chain

In conjunction with Figure 13, the notion of existing tracing device chain P3.Device chain P3 is defined as one group of device P25.The notion that also can comprise order in the notion of device chain P3.

Following example has been formed device chain P3:

-single assembly P25,

-image trapping device 1 and image recovery device 19,

-photo the device in the photo prints flushing device for example, scanner or printer,

-for example digital camera in the photo prints flushing device or printer,

-the scanner in computing machine for example, screen or printer,

-screen or projector, and human eye,

-a kind of device and another kind are expected to imitated device,

-one camera and a scanner,

-one image trapping device and imgae processing software,

-imgae processing software and image recovery device 19,

The combination of-above each example,

-another group device P25.

Defective

In conjunction with Figure 13, the notion of defective P5 is described now.The defective P5 of device P25 is defined as the defective that relates to optical system and/or sensor and/or electronic unit and/or be integrated into the Characteristic of Software among the device P25; The example of defective P5 comprises: geometrical defect, sharpness defective, colorimetry defective, the geometry deformation defective, how much chromatic aberration defects, how much vignetting defectives, contrast defective, the colorimetry defective, particularly the colour developing (rendering of color) and colour cast, the flash of light uniform defect, sensor noise, granularity, astigmatism defect and spherical aberration defective.

Image

In conjunction with Fig. 2,5,6 and 13, the existing notion of describing image 103.Image 103 is defined as the digital image that is obtained, revises or recovered by device P25.Image 103 can derive from a device P25 among the device chain P3.Image 103 can be a device P25 among the indicator device chain P3 of address.Situation more generally is, image 103 can from and/or address indicator device chain P3.At the animated image of forming by the static image of arranging in chronological order, for example in the video image, visual 103 width of cloth static images that are defined as in the image sequence.

Formatted message

In conjunction with Fig. 7,8,10 and 13, the notion of existing descriptor format information 15.Formatted message 15 is defined as the data that relate to the defective P5 of one or more device P25 among defective P5 or the characterization apparatus chain P3, and by considering the defective of device P25, these data make image-processing system P1 can improve the quality of image 103.

Produce formatted message 15, can use multiple based on measurement and/or simulation and/or Calibration Method and system, for example above-described calibration steps.

Want transmission formatting information 15, can use one to comprise the file P100 that finishes image 120.For example, image trapping device 1 for example digital camera can produce a plurality of files, and described file comprises image 103, the formatted message 15 that duplicates, and the data that comprise the Exif form of used adjusting from device's memory.

Produce formatted message 15, might use the method and system of describing in the international patent application of for example applying on the same day with name and the application of Vision IQ, this application is called " generation relates to the method and system of the formatted message of geometry deformation ".The production method that relates to the formatted message of device P25 in the device chain 3 has been described in this application.Device chain P3 specifically comprises at least one image trapping device 1 and/or at least one image recovery device 19.The method comprises that generation relates to the step of the formatted message 15 of the geometry deformation of at least one device P25 in this chain.

Preferably, device 25 images that may obtain or recover on the medium.Device 25 is different according to image, comprises at least one fixed character and/or an alterable features.Fixed character and/or alterable features can be associated with one or more eigenwerts, for example the eigenwert of focal length and/or focusing feature and individual features.The method comprises the step that produces the formatted message of the geometry deformation that relates to this device that records from the field that records.Formatted message 15 can comprise the formatted message that records.

Produce formatted message 15, may use the method and system of for example describing in the international patent application of applying on the same day with Vision IQ name and the application, this application is by name: " generation relates to the method and system of the formatted message that at least one device defect particularly blurs in the device chain ".This application has been described the method that relates to the formatted message 15 of device P25 in the device chain 3 that produces.Device chain P3 specifically comprises at least one image trapping device 1 and/or at least one image recovery device 19.This method comprises that generation relates to the step of the formatted message 15 of the defective P5 of at least one device P25 in the chain.Preferably, can be used to obtain or the device 25 that recovers image according to image (I) difference, comprise at least one fixed character and/or an alterable features.Fixed character and/or alterable features can be associated with one or more eigenwerts, for example the eigenwert of focal length and/or focusing feature and correlated characteristic.This method comprises the step that produces the formatted message that records of the defective P5 that relates to device P25 from a field that records.Formatted message 15 can comprise the formatted message that records.

Produce formatted message 15, can use the method and system of describing in the international patent application of for example applying on the same day with Vision IQ name and the application, this application is by name: " reducing the method and system of image-processing system renewal frequency ".This application has been described the method, particularly software of reduction image-processing system P1 renewal frequency and/or the renewal frequency of assembly.Image-processing system make might change from or be used for the quality of the digital image of device chain P3.Device chain P3 specifically comprises at least one image trapping device 1 and/or at least one image recovery device 19.Image-processing system P1 uses the formatted message 15 that relates to the defective P5 of at least one device among the device chain P3.This formatted message 15 depends at least one variable.Formatted message 15 makes it possible to set up contact between a part of variable and a part of identifier.By means of identifier,, might determine value corresponding to the variable of this identifier by considering identifier and image.The combination of technical characterictic makes particularly can't obtain the value that might determine variable under the situation of this variable importance and/or content before image-processing system P1 distributes.The combination of technical characterictic also makes it possible to separate from the space time between twice renewal of correction software.The combination of technical characterictic also makes a plurality of economic participant (economic player) of process units and/or image-processing system can be independent of other economic participants to upgrade their product, even the latter has changed the characteristic of product fully or can not force client's upgrading products.The combination of technical characterictic also makes it possible at first begin with economic participant of minority and advanced user, brings into use new function then gradually.

Be search formatted message 15, might use the method and system of describing in the international patent application of for example applying on the same day with Vision IQ name and the application, this application is by name: " change at least one from or be used for the method and system of the image quality of device chain ".This application described change at least one from or be used for the method for quality of the image 103 of device chain.This specified device chain comprises at least one image trapping device 1 and/or at least one image recovery device 19.Image trapping device and/or the image recovery device introduced gradually by economic activity participant independently on market belong to undetermined one group of device.Device P25 in this group device exists can be by the defective P5 of formatted message 15 signs.For the image of being discussed, this method may further comprise the steps:

-step that directory editing is carried out in the formatted message source that relates to the device P25 in this group device,

-automatic search relates to the step of the specific formatted message of specified device chain in the formatted message of editing in this way 15,

-when considering the specific format information that obtains in this way, revise this visual step automatically by imgae processing software and/or image processing assembly.

Be using form information 15, can use the method and system of describing in the international patent application of for example applying on the same day with Vision IQ name and the application, this application is by name: " calculating the visual method and system of conversion from digital image and the formatted message that relates to geometric transformation ".This application is described the method for calculating the conversion image from digital image and the formatted message 15 that relates to geometric transformation, especially relates to the distortion of device chain P3 and/or the formatted message 15 of aberration.This method comprises the step of calculating the conversion image from the method for approximation of geometric transformation.Can draw this calculating thus with regard to memory source, the storer band leads to and computing power is economical, also is economical with regard to power consumption therefore.Also can draw thus in use subsequently, there is not tangible or tedious defective in the conversion image.

Be using form information 15, can use the method and system of describing in the international patent application of for example applying on the same day with Vision IQ name and the application, this application is by name: " revising the method and system of digital image under the situation of considering its noise ".This application has been described the method for calculating the conversion image from the formatted message 15 of digital image and the defective P5 that relates to device chain P3.Device chain P3 comprises image trapping device and/or image recovery device.Device chain P3 comprises a device P25 at least.This method comprises the step of determining characteristic from formatted message 15 and/or digital image automatically.The combination of technical characterictic makes that in use subsequently there is not tangible or tedious defective in the conversion image, particularly relates to the defective of noise.

Image-processing system

In conjunction with Fig. 7 and 13, the notion of image-processing system P1 is described now.In intended scope of the present invention, image-processing system P1 is defined as, for example imgae processing software 4 and/or assembly and/or equipment and/or a system, they can revise the quality of image 103 so that produce the image of revising by utilizing formatted message 15, and for example corrected image 71 or correction recover image 97.Amended image can be used for the 3rd device of device chain P3, and this device can be identical or different with P25, for example install among the chain P3 with lower device.

The modification of image quality being carried out by image-processing system P1 for example is:

The defective P5 that one or more device P25 of device chain P3 cause in-elimination or the weakening image 103, and/or

-revise image 103, so that increase at least one the defective P5 of one or more device P25 among the device chain P3, make amended image class be similar to the image that obtains with one or more device P25, and/or

-revise image 103, increase at least one the defective P5 of one or more device P25 among the device chain P3, make the recovery of revising the back image is similar to the image that recovers with one or more device P25, and/or

-revise image 103 by considering the formatted message 15 relate to the defects of vision P5 of human eye P25 among the device chain P3, make that for all or part defective P5 human eye has been perceived the recovery of revising the back image through overcorrect.

Correcting algorithm is defined as the method that image-processing system P1 is used for revising the image quality that depends on defective P5.

Image-processing system P1 can take the multiple the application's of being subordinated to form.

Image-processing system P1 can be integrated among the device P25 wholly or in part, as in following example:

-produce to revise the image trapping device of back image, for example wherein integrated digital camera of image-processing system P1,

-show or print the image recovery device 19 of modification back image, for example wherein comprised the video projector of image-processing system P1,

-can proofread and correct the mixing arrangement of its element defective, for example scanning/printing/fax all-in-one has wherein comprised image-processing system P1,

-produce the image trapping device of the specialty of revising the back image, for example endoscope wherein comprises image-processing system P1.

Under image-processing system P1 was integrated into situation among the device P25, in fact device P25 proofreaied and correct the defective P5 of oneself.The device P25 of this device chain P3 can design in scanner and the printer to determine by for example at facsimile recorder.But, the user can only operative installations chain P3 in the part of device P25, for example, under facsimile recorder also can the situation as the printer of a platform independent.

Image-processing system P1 can be integrated in the computing machine wholly or in part, for example in the following manner:

-in an operating system, for example in Windows or Mac operating system, for revise automatically from or be used for the quality of the image of multiple arrangement P25, this image may be with image 103 or is changed in time, P1 for example is a scanner, camera and printer; From normal moveout correction can be for example with visual 103 input systems the time, perhaps when asking to print, the user carries out,

-in an image processing is used, for example at Photoshop ^TMIn, for automatically revise from or be used for the image quality of multiple arrangement P25, the quality of described image may be with image 103 or is changed in time, P1 for example is scanner, camera and printer.From normal moveout correction can be to activate Photoshop for example user ^TMIn carry out during filter command.

-in a photo prints device (for example photograph developing service or English described miniature darkroom), for automatically revising the quality of a plurality of images that obtain from a plurality of photographic means P25, described image quality may be with image 103 or is changed in time, P1 for example is disposable camera, digital camera and CD.Can consider camera and integrated scanner and printer from normal moveout correction, and proofread and correct and when the initialization print job, to carry out.

-on a station server, for example at the station server on the Internet, for revising the quality from a plurality of images of multiple arrangement P25 automatically, described image quality may be with image 103 or is changed in time, and P1 for example is disposable camera, digital camera.Can consider this camera and printer from normal moveout correction, and proofread and correct and can be on server to carry out during recording picture 103, or when the initialization print job, carry out.

Under image-processing system P1 is integrated into situation in the computing machine, for practicality, image-processing system P1 and multiple arrangement P25 compatibility, and have at least a device P25 between an images 103 and another width of cloth, to change among the device chain P3.

For the formatted message 15 of standard format is provided to image-processing system P1, this formatted message 15 is associated with image 103

-in file P100,

-identifier by device P25 among the operative installations chain P3, data of Exif form among the file P100 for example so that in property data base 22 retrieval format information 15.

Alterable features

In conjunction with Figure 13, the notion of alterable features P6 is described now.According to the present invention, alterable features P6 is defined as one can measure factor, this factor can change between an images 103 and another images that obtains, revises or recover by same device P25, and the defective of the image that device P25 is obtained, revises or recovers exerts an influence.Particularly:

-to given visual 103 being overall alterable features of fixing, the feature of device P25 when obtaining or recover this image for example, its adjusting with the user is relevant or relevant with the automatic operation of device P25, focal length for example,

-locally variable feature, in given visual 103, this feature is variable, the x in the image for example, y or ρ, the θ coordinate allows image-processing system P1 to use the Local treatment that changes with image region.

Difference with device P25 changes, but for being the factor measured of fixing from an image 103 to another image that is obtained, revises or recovered by same device P25, is not counted as alterable features P6 usually.The focal length that for example has the device P25 of fixed focal length.

Used adjusting described above is the example of alterable features P6.

Formatted message 15 can be dependent at least one alterable features P6.

By alterable features P6, specifically be understood that

The focal length of-optical system,

-redefine size (digital zoom coefficient: the amplification of partial images to what image carried out; And/or owe to take a sample: the minimizing of image pixel number),

-non-linear intensity correction, for example gamma is proofreaied and correct,

-profile strengthens, and for example installs the fuzzy cancellation grade that P25 uses,

The noise of-sensor and electronic unit,

The aperture of-optical system,

-focussing distance,

Frame number on the-film,

-under-exposed or over-exposed,

The sensitivity of-film or sensor,

The sheet type that-printer uses,

The position of center sensor in the-image,

-visual rotation with respect to sensor,

-projector is with respect to the position of screen,

The white balance of-use,

The activation of-flash of light and/or its power supply,

-the time shutter,

-sensor gain,

-compression,

-contrast,

Another adjusting that the user of-device P25 uses, operator scheme for example,

Another automatic adjusting of-device P25,

Another measurement that-device P25 carries out.

Under the situation of recovery device 19, alterable features P6 also can be defined as variable recovery feature.

The alterable features value

In conjunction with Figure 13, the notion of alterable features value P26 is described now.Alterable features value P26 is defined as and obtains, revises or the value of alterable features P6 when recovering to specify image, and this value for example can obtain from the Exif formatted data the file P100.Image-processing system P1 just can handle the quality of image 103 or revise as the function of alterable features P6 then, described processing or revise the formatted message 15 that depends on alterable features P6 by use, and by the value P26 that determines alterable features image quality is carried out.

In recovery device 19, the value of alterable features P6 also can be defined as variable recovery feature.

The formatted message that records, the formatted message of expansion

As shown in figure 15, formatted message 15 or part formatted message 15 can comprise the formatted message P101 that records so that an original measurement to be described, for example relate to a mathematics field in the geometry deformation defective at the unique point place of the some of array 80.As shown in figure 15, this formatted message 15 or part formatted message 15, for example by to the actual point of array 80 but not unique point insert, can comprise the formatted message P102 of expansion, the formatted message P102 of this expansion can be calculated by the formatted message P101 that records.From as can be seen above-mentioned, formatted message item 15 can depend on alterable features P6.According to the present invention, combination P120 is defined as the combination that the value P26 by alterable features P6 and alterable features forms, for example by focal length, and focusing, the aperture of the diaphragm, acquisition speed, the combination P120 of aperture etc. and correlation composition.Be difficult to imagine how to calculate the formatted message 15 that relates to various combination P120, especially because some feature of combination P120, for example focal length and more like this apart from can constantly changing.

The present invention regulation is carried out interpolation by the formatted message P101 that records certainly, and to come form of calculation be the formatted message 15 of extended format information P102, and the described formatted message P101 that records relates to the previously selected combination P120 of known variable feature P6.

For example, the formatted message P101 that records that relates to following combination P120 is used for calculating the extended format information P102 of dependence as the focal length of alterable features P6: comprise the combination of " focal length=2; distance=7; acquisition speed=1/100 ", comprise the combination of " focal length=10, distance=7; acquisition speed=1/100 ", comprise the combination of " focal length=50, distance=7, acquisition speed=1/100 ".By this extended format information P102, specifically might determine to relate to the formatted message of following combination: " focal length=25, distance=7, acquisition speed=1/100 ".

Can there be interpolation deviation P121 in formatted message P101 that records and extended format information P102.The present invention can comprise and selects 0, the step of one or more alterable features P6, makes the interpolation deviation P121 of extended format information P102 of this method of alterable features P6 select with to(for) being used for of being obtained less than a predetermined threshold value of inserting.In fact, some alterable features P6 is little to the influence of the influence comparison other defect that defective P5 produces, and regards these alterable features P6 as mistake that constant introduces approx and may reach minimum.For example, focusing is regulated the vignetting defective is only produced slight influence, so can not be as the part of selected alterable features P6.Alterable features P6 can select in the moment that produces formatted message 15.The combination of technical characterictic can be so that simple calculating be adopted in the modification of image quality.The combination of technical characterictic can also make that extended format information P102 is intensive.The combination of technical characterictic can also make the alterable features P6 that the eliminated minimum that influences to defective P5.The combination of technical characterictic can also make and can revise image quality by designated precision by formatted message 15.

In recovery device 19, combination 120 can also be defined as and recover combination.

In recovery device 19, the formatted message P101 that records can also be defined as the format recovering information that records.

In recovery device 19, extended format information P102 can also be defined as the format recovering information of expansion.

In recovery device 19, interpolation deviation P121 also can be defined as interpolation and recover deviation.

The parameterisable model, parameter

In conjunction with Fig. 5,6 and 16, the notion of existing characterising parameter P9 and parameterisable model P10.In intended scope of the present invention, parameterisable model P10 is defined as the mathematical model that can be dependent on variable P6 and relate to one or more defectives of one or more device P25; Above-described parameterisable transformation model 12, parameterisable inverse conversion model 212, parameterisable recovery transformation model 97 and the contrary recovery of parameterisable transformation model 297 are the example of parameterisable model P10; For example, a parameterisable model P10 can relate to:

The sharpness defective of-digital camera or fuzzy,

-be expected to how much vignetting defectives of imitated camera,

The geometry deformation defective of-projector and how much chromatic aberration defects,

-with the sharpness defective or the fuzzy defective of the disposable camera of scanner combination.

The formatted message 15 that relates to the defective P5 of device P25 can be expressed as the form of the parameter P9 of the parameterisable model P10 that depends on alterable features P6.By the parameter P9 of parameterisable model P10, may for example determine a mathematical function P16 in the multivariable polynomial at one group of mathematical function; By this mathematical function P16, image quality might be made amendment as the function of alterable features P6 designated value.

By this method, image-processing system P1 can use the parameter P9 of parameterisable transformation model P10 to calculate amended image, and for example the correction intensity of a point or correction recover intensity in the computational picture.

Colour plane

Specifically, the notion of the colour plane P20 of color image 103 is described now in conjunction with Figure 15.Image 103 can be decomposed into a plurality of colour plane P20 in several ways: colour plane number (1,3 or more), the power of precision (8 no symbol, 16 symbol, floating number etc. are arranged) and colour plane (with respect to the Standard Colors space).Can be decomposed into a plurality of colour plane P20 with image 103 this moment by several different methods: by the red face that red pixel point is formed, and green face, blue face (RGB), intensity, saturation degree, tone etc.; On the other hand, may have for example color space of PIM, maybe may be negative pixel value, so that can represent to lose lustre, described losing lustre can not be represented with positive RGB; At last, might use 8,16 or floating point values that pixel value is encoded.Illustrate and how to make formatted message 15 relevant with colour plane P20: the sign for red face, green face and blue face sharpness defective can be different, thus the sharpness defective that allows image-processing system P1 to calibrate each colour plane P20 in different ways.

Formatted message is provided

Specifically in conjunction with Fig. 8,13,15 and 16, an alternative embodiment of the present invention is now described.For the formatted message 15 of standard format is provided to image-processing system P1, native system comprises data processing tools, and this method comprises the step of filling at least one field 91 in the standard format with formatted message 15.91 of fields can specifically comprise:

-relate to the value of defective P5, be the form of parameter P9 for example, make image-processing system P1 revise image quality by considering defective P5 by operation parameter P9, and/or

-relate to the value of sharpness defective, be the form of parameter P9 for example, make image-processing system P1 can operation parameter P9 by considering that the sharpness defective revise image quality, and in can computational picture a point the correction shape or proofread and correct and recover shape, and/or

-relate to the value of colorimetry defective, be the form of parameter P9 for example, make image-processing system P1 can operation parameter P9 by considering that the colorimetry defective considers to revise image quality, and in can computational picture a point correction of color or proofread and correct and recover color, and/or

-relate to the value of geometry deformation defective and/or how much chromatic aberration defects, it for example is the form of parameter P9, make image-processing system P1 revise image quality by considering geometry deformation defective and/or how much chromatic aberration defects by operation parameter P9, and the correction position of a point or proofread and correct and recover the position in can computational picture, and/or

-relate to the value of how much vignetting defectives, it for example is the form of parameter P9, make image-processing system P1 can operation parameter P9 by considering that how much vignetting defectives revise image quality, and in can computational picture a point correction intensity or proofread and correct and recover intensity, and/or

-relate to the value of deviation 14, and/or

-be the value of the function that depends on image 103 alterable features P6, for example depend on polynomial coefficient and item corresponding to the alterable features P6 of focal length, use this coefficient and item the correction intensity of a point in the image might be calculated as the function that this puts excentric distance, by this method, image-processing system can obtain arbitrary value that calibration intensity that image moment of 103 calculates any is used for any focal length of image trapping device.

-relating to the value of formatted message, this formatted message relates to colour plane P20 again,

-relate to the value of formatted message,

-relate to the value of the formatted message that records,

-relate to the value of extended format information.

Produce formatted message

In conjunction with Fig. 7,12 and 17, an alternative embodiment of the present invention is now described.The present invention can use above-described data processing equipment and second algorithm and/or the 3rd algorithm and/or the 3rd algorithm and/or first algorithm and/or the 5th algorithm and/or the 4th algorithm and/or the 5th algorithm and/or the 6th algorithm, produces the formatted message 15 that relates to the defective P5 of device P25 among the device chain P3.

Using the present invention reduces cost

Reducing cost is defined as the method and system of the optical system cost that installs in the cost that reduces device P25 among the device chain P3, particularly device or the device chain, and this method is:

-minimizing lens number, and/or

-simplification lens shape, and/or

Defective P5 of-design is greater than the optical system of device or device chain desired defect, or from catalogue, select this defective greater than the product of desired defect and/or

-lower and increase material, assembly, processing operation or the manufacture method of defective P5 to device or device chain use cost.

The method according to this invention and system can be used for reducing the cost of device or device chain: might design a digital optical system, generation relates to the formatted message 15 of the defective P5 of device or device chain, use this formatted message can make integrated or non-integrated image-processing system P1 can revise from or be used for this device or the device chain image quality, thereby make the combination of this device or device chain and this image-processing system obtain, to revise or to recover to have the image of prospective quality with lower cost.

Claims

1. one kind provides the method for the formatted message (15) of standard format to image-processing system (P1), and described formatted message (15) relates to the defective (P5) of device chain (P3); Described device chain (P3) specifically comprises at least one image trapping device (1) and/or an image recovery device (19); Described image-processing system (P1) uses described formatted message (15) to change the quality that is derived from described device chain (P3) or is sent at least one images (103) of described device chain;

Described formatted message (15) comprising:

-characterize the data of the defective (P5) of described image trapping device (1); And/or

The data of the defective (P5) of the described image recovery device of-sign;

Described method comprises uses described formatted message (15) to fill the step of at least one field (91) of described standard format; Described field (91) is specified by a field name; Described field (91) comprises at least one field value.

2. method according to claim 1, described method make described field (91) relate to the sharpness defective (P5) of described image trapping device (1) and/or described image recovery device (19); Described method makes described field (91) comprise a value that relates to the sharpness defective (P5) of described image trapping device (1) and/or described image recovery device (19) at least.

3. method according to claim 1 and 2, described method make described field (91) relate to the colorimetry defective (P5) of described image trapping device (1) and/or described image recovery device (19); Described method makes described field (91) comprise a value that relates to the colorimetry defective (P5) of described image trapping device (1) and/or described image recovery device (19) at least.

4. method according to claim 1, described method make described field (91) relate to geometry deformation defective (P5) and/or how much chromatic aberration defects (P5) of described image trapping device (1) and/or described image recovery device (19); Described method makes described field (91) comprise the value of a geometry deformation defective (P5) that relates to described image trapping device (1) and/or described image recovery device (19) and/or how much chromatic aberration defects (P5) at least.

5. method according to claim 1, described method make described field (91) relate to the geometry vignetting defective (P5) and/or the contrast defective (P5) of described image trapping device (1) and/or described image recovery device (19); Described method makes described field (91) comprise at least one the geometry vignetting defective (P5) that relates to described image trapping device (1) and/or described image recovery device (19) and/or the value of contrast defective (P5).

6. method according to claim 1, described method make described field (91) comprise the value that at least one relates to deviation (14).

7. method according to claim 2, described formatted message (15) to small part is made up of the parameter (P9) of the parameterisable transformation model (12) of the sharpness defective (P5) of representing images acquisition equipment (1) and/or image recovery device (19); Described method makes that be included in described one or more in the described field (91) that relates to sharpness defective (P5) is worth to small part and is made up of the parameter (P9) of described parameterisable transformation model (12);

Thus, described image-processing system (P1) can use the described parameter (P9) of described parameterisable transformation model (12) to come in the computational picture (103) the correction shape of any or proofread and correct and recover shape.

8. method according to claim 3, described formatted message (15) to small part is made up of the parameter (P9) of the parameterisable transformation model (12) of the colorimetry defective (P5) of representing images acquisition equipment (1) and/or image recovery device (19); Described method makes that be included in described one or more in the described field (91) that relates to colorimetry defective (P5) is worth to small part and is made up of the parameter (P9) of described parameterisable transformation model (12);

Thus, described image-processing system (P1) can use the described parameter (P9) of described parameterisable transformation model (12) to come in the computational picture (103) correction of color of any or proofread and correct and recover color.

9. method according to claim 4, described formatted message (15) to small part is made up of the parameter (P9) of the parameterisable transformation model (12) of the geometry deformation defective (P5) of representing images acquisition equipment (1) and/or image recovery device (19) and/or how much chromatic aberration defects (P5); Described method makes that be included in described one or more in the described field (91) that relates to geometry deformation defective (P5) and/or how much chromatic aberration defects (P5) is worth to small part and is made up of the parameter (P9) of described parameterisable transformation model (12);

Make described image-processing system (P1) can use the described parameter (P9) of described parameterisable transformation model (12) to come in the computational picture (103) correction position of any or proofread and correct and recover the position thus.

10. method according to claim 5, described formatted message (15) to small part is made up of the parameter (P9) of the parameterisable transformation model (12) of how much vignetting defectives (P5) of representing images acquisition equipment (1) and/or image recovery device (19) and/or contrast defective (P5); Described method makes that be included in described one or more in the described field (91) that relates to how much vignetting defectives (P5) and/or contrast defective (P5) is worth to small part and is made up of the parameter (P9) of described parameterisable transformation model (12);

Thus, described image-processing system (P1) can use the described parameter (P9) of described parameterisable transformation model (12) to come in the computational picture (103) correction intensity of any or proofread and correct and recover intensity.

11. method according to claim 1, for the described formatted message (15) of standard format is provided to described image-processing system (P1), described method also comprises the step that described formatted message (15) is associated with described image (103).

12. method according to claim 11, described image (103) is with the form transmission of file (P100), and described file (P100) comprises described formatted message (15) again.

13. method according to claim 1, described image trapping device (1) and/or described image recovery device (19) comprise at least one alterable features that depends on image (103) (P6); At least one described defective (P5) of described image trapping device (1) and/or described image recovery device (19) depends on described alterable features (P6); At least one value that described method makes at least one described field (91) comprise is the function that depends on the described alterable features (P6) of image (103);

Thus, image-processing system (P1) can be handled described image (103) as the function of described alterable features (P6).

14. method according to claim 1, described formatted message (15) to small part are the formatted messages (P101) that records.

15. method according to claim 1, described formatted message (15) to small part are the formatted messages (P102) of expansion.

16. method according to claim 1, described image (103) is made up of colour plane (P20), and described formatted message (15) to small part relates to described colour plane (P20).

17. one kind provides the system of the formatted message (15) of standard format to image-processing system (P1), described formatted message (15) relates to the defective (P5) of device chain (P3); Described device chain (P3) specifically comprises at least one image trapping device (1) and/or an image recovery device (19); Described image-processing system (P1) uses described formatted message (15) to change the quality that at least one width of cloth is derived from described device chain (P3) or is sent to the image (103) of described device chain;

Described formatted message (15) comprising:

The data of the defective (P5) of the described image recovery device of-sign (19);

Described system comprises the data processing equipment of filling at least one field (91) of described standard format with described formatted message (15), and described field (91) is specified by a field name, and described field (91) comprises at least one field value.

18. system according to claim 17, described system make described field (91) relate to the sharpness defective (P5) of image trapping device (1) and/or image recovery device (19); Described system makes described field (91) comprise a value that relates to the sharpness defective (P5) of described image trapping device (1) and/or described image recovery device (19) at least.

19. according to the system described in claim 17 or 18, described system makes described field (91) relate to the colorimetry defective (P5) of described image trapping device (1) and/or image recovery device (19); Described system makes described field (91) comprise a value that relates to the colorimetry defective (P5) of described image trapping device (1) and/or image recovery device (19) at least.

20. system according to claim 17, described system make described field (91) relate to geometry deformation defective (P5) and/or how much chromatic aberration defects (P5) of described image trapping device (1) and/or described image recovery device (19); Described system makes described field (91) comprise the value of a geometry deformation defective (P5) that relates to described image trapping device (1) and/or described image recovery device (19) and/or how much chromatic aberration defects (P5) at least.

21. system according to claim 17, described system make described field (91) relate to the geometry vignetting defective (P5) and/or the contrast defective (P5) of described image trapping device (1) and/or described image recovery device (19); Described system makes described field (91) comprise at least one the geometry vignetting defective (P5) that relates to described image trapping device (1) and/or described image recovery device (19) and/or the value of contrast defective (P5).

22. system according to claim 17, described system make described field (91) comprise the value that at least one relates to deviation (14).

23. system according to claim 18, described formatted message (15) to small part is made up of the parameter (P9) of the parameterisable transformation model (12) of the sharpness defective (P5) of representing images acquisition equipment (1) and/or image recovery device (19); Described system makes that be included in described one or more in the described field (91) that relates to sharpness defective (P5) is worth to small part and is made up of the parameter (P9) of described parameterisable transformation model (12).

24. system according to claim 19, described formatted message (15) to small part is made up of the parameter (P9) of the parameterisable transformation model (12) of the colorimetry defective (P5) of representing images acquisition equipment (1) and/or image recovery device (19); Described system makes that be included in described one or more in the described field (91) that relates to colorimetry defective (P5) is worth to small part and is made up of the parameter (P9) of described parameterisable transformation model (12).

25. system according to claim 20, described formatted message (15) to small part is made up of the parameter (P9) of the parameterisable transformation model (12) of the geometry deformation defective (P5) of representing images acquisition equipment (1) and/or image recovery device (19) and/or how much chromatic aberration defects (P5); Described system makes that be included in described one or more in the described field (91) that relates to geometry deformation defective (P5) and/or how much chromatic aberration defects (P5) is worth to small part and is made up of the parameter (P9) of described parameterisable transformation model (12).

26. system according to claim 21, described formatted message (15) to small part is made up of the parameter (P9) of the parameterisable transformation model (12) of how much vignetting defectives (P5) of representing images acquisition equipment (1) and/or image recovery device (19) and/or contrast defective (P5); Described system makes that be included in described one or more in the described field (91) that relates to how much vignetting defectives (P5) and/or contrast defective (P5) is worth to small part and is made up of the parameter (P9) of described parameterisable transformation model (12).

27. system according to claim 17, for the described formatted message (15) of standard format is provided to described image-processing system (P1), described system also comprises makes described formatted message (15) and the related data processing equipment of described image (103).

Transmit the transmitting device of described image (103) 28. system according to claim 27, described system comprise with file (P100) form, described file (P100) comprises described formatted message (15) again.

29. system according to claim 17, described image trapping device (1) and/or image recovery device (19) comprise at least one alterable features that depends on image (103) (P6); At least one described defective (P5) of described image trapping device (1) and/or described image recovery device (19) depends on described alterable features (P6); Described system makes that at least one value that has at least a described field (91) to comprise is the function that depends on the described alterable features (P6) of image (103).

30. system according to claim 17, described formatted message (15) to small part are the formatted messages (P101) that records.

31. system according to claim 17, described formatted message (15) to small part are the formatted messages (P102) of expansion.

32. system according to claim 17, described image (103) is made up of colour plane (P20); Described formatted message (15) to small part relates to described colour plane (P20).