EP1839433A2 - Procede de realisation d'un appareil de capture et/ou de restitution d'images et appareil obtenu par ce procede - Google Patents

Procede de realisation d'un appareil de capture et/ou de restitution d'images et appareil obtenu par ce procede

Info

Publication number
EP1839433A2
EP1839433A2 EP06709409A EP06709409A EP1839433A2 EP 1839433 A2 EP1839433 A2 EP 1839433A2 EP 06709409 A EP06709409 A EP 06709409A EP 06709409 A EP06709409 A EP 06709409A EP 1839433 A2 EP1839433 A2 EP 1839433A2
Authority
EP
European Patent Office
Prior art keywords
optical system
processing means
image
sensor
image processing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
EP06709409A
Other languages
German (de)
English (en)
French (fr)
Inventor
Frédéric Guichard
Bruno Liege
Jérôme MENIERE
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Dxo Labs SA
Original Assignee
Dxo Labs SA
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Dxo Labs SA filed Critical Dxo Labs SA
Publication of EP1839433A2 publication Critical patent/EP1839433A2/fr
Ceased legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/60Noise processing, e.g. detecting, correcting, reducing or removing noise
    • H04N25/61Noise processing, e.g. detecting, correcting, reducing or removing noise the noise originating only from the lens unit, e.g. flare, shading, vignetting or "cos4"
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/67Focus control based on electronic image sensor signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/10Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths

Definitions

  • the invention relates to a method for producing an image capture and / or reproduction device which comprises an optical system for capturing and / or restoring images, a sensor and / or an image generator, and / or a servo system, the image being processed for improvement by digital image processing means.
  • the invention aims in particular to optimize the opening of the optical system of an image capture and / or reproduction device.
  • the invention also relates to an apparatus obtained by such an embodiment method.
  • Known techniques for designing or producing such apparatus for capturing and / or restoring images consist in first selecting the properties physical elements of the apparatus, in particular the optical viewing or projection system, the image sensor or generator and the servo system. Then, if necessary, digital image processing means are provided to correct the defects of at least one of the hardware elements of the apparatus.
  • a specification is first established, that is to say that the space requirement, the focal length ranges, the opening ranges, the Covered field, the performances expressed, either in size of image spot, or in value of FTM (modulation transfer function), and the cost.
  • optical system is selected and, with the aid of an optical calculation software tool, such as the "Zemax" tool, the parameters of this system are selected which make it possible to comply with better the specifications of the specifications.
  • an optical calculation software tool such as the "Zemax” tool
  • This development of the optical system is carried out interactively.
  • an optical system is designed to have the best quality in the center of the image and usually the quality at the edges of the image is of a lower level.
  • the usual techniques are such that the optical system is designed to achieve a certain level of distortion, vignetting, and blur, so that the optical system can be compared to other optical systems.
  • the characteristics of the sensor are also specified, namely: pixel quality, pixel area, number of pixels, microlens matrix, anti-alias filters, pixel geometry , and the arrangement of the pixels.
  • the usual technique is to select the sensor of an image capture apparatus independently of the other elements of the apparatus and, in particular, the image processing system.
  • Capture apparatus and / or image generators also typically include one or more servo systems such as an exposure system and / or a point system ("autofocus").
  • servo systems such as an exposure system and / or a point system ("autofocus").
  • the measurement modes are determined, in particular the areas of the image on which the exposure will be measured are determined. as well as the weight assigned to each zone.
  • the number and position of the areas of the image that will be used to focus are determined.
  • a motor displacement instruction is also specified. In all cases, these specifications are performed independently of the presence or absence of digital image processing means.
  • the invention is based on the observation that these conventional techniques for designing or producing apparatus do not make it possible to take full advantage of the possibilities offered by digital image processing means.
  • the invention generally relates to a method for producing an image capture and / or reproduction device which comprises an optical system for capturing and / or restoring images, and a sensor and / or or image generator, and / or a servo system, the image being processed, for improvement, by digital image processing means; method in which the parameters of the optical system and / or the sensor and / or the image generator, and / or the servo system are determined or selected from the capabilities of the digital image processing means, so that to minimize the costs of implementation and / or to optimize the performance of the camera for capturing and / or restoring images.
  • optimizing the opening of an optical system of a camera for taking pictures or restoring images is meant, compared to a conventional device, increase the opening without increasing the price, or maintain a correct opening while reducing the price of the device or, in general, be able to choose at will the parameters opening, price and performance.
  • the invention relates to a method for producing the image capture and / or reproduction device which comprises an optical system for capturing and / or restoring images, a sensor and or image generator, the image being processed, for the purpose of improvement, by digital image processing means, the method being such that the digital image processing means comprise correction means suitable for correcting the image; at least one of the features included in the group including the blur, the variable blur as a function of the position in the field of the image, the depth of field, the variable depth of field as a function of the position in the field. image, and the vignetting, and the method being such as optimizes the opening of the optical system, in particular with fixed focal length, to take account of the correction means.
  • the method is such that the digital image processing means further comprise, in a manner known per se, distortion correction means.
  • the method according to the invention can use distortion correction means, it concerns the production of an apparatus in which at least one parameter of the optical system is determined or selected. or the sensor and / or the image generator and / or the servo system from the capabilities of the digital image processing means other than the distortion correction.
  • the optical system is of variable focal length
  • the method is further such that: the digital image processing means comprise means for correcting lateral chromatic aberrations and / or blur, and / or vignetting, and / or noise and / or parallax compensation, and determining or selecting at least one parameter of this optical system taking into account the digital means image processing unit in the group comprising the following parameters: the number of optical elements of the system, the nature of the materials composing the optical elements of the optical system, the cost of the materials of the optical system, the treatment of the optical surfaces, the color of optical system materials, assembly tolerances, parallax value as a function of focal length, and focus characteristics.
  • the invention relates to such a method of producing an image capture and / or rendering apparatus which comprises an optical system. capturing and / or reproducing images, a sensor and / or image generator, and / or a servo system, the image being processed with a view to its improvement by digital image processing means, the method being such that at least one parameter of the sensor and / or the image generator and / or the servo system is determined or selected from the capabilities of the digital image processing means.
  • An image capture device is, for example, a disposable camera, a digital camera, a DSLR camera (digital or not), a scanner, a fax machine, an endoscope, a camera, a camcorder, a video camera, surveillance, a toy, a camera or a camera integrated or connected to a telephone, a personal assistant or a computer, a thermal camera, an ultrasound machine, an MRI (magnetic resonance) imaging apparatus, a X-ray radiography.
  • An image rendering apparatus is, for example, a screen, a projector, a television set, virtual reality glasses, or a printer.
  • An image capture and rendering apparatus is, for example, a scanner / fax / printer, a mini lab for printing photos, a video conferencing apparatus.
  • optical image capture system is meant the optical means for rendering images on a sensor.
  • optical image restoration system is meant the optical means for forming images on a screen or to restore to the observer an image already existing on a screen. It is also possible to do without screen to render an image.
  • screen is meant any physical medium on which an image can be formed.
  • image sensor mechanical, chemical, or electronic means for capturing and / or recording an image.
  • image generator is meant, for example, the circuits of a television receiver, a liquid crystal screen, the printing means of a printer, the control systems of a micro mirror projection means.
  • servo system is meant mechanical, chemical, electronic, or computer type means allowing elements or parameters of the device to meet a set point. This includes the autofocus system
  • digital image processing means for example, a software and / or component and / or equipment and / or a system for modifying the quality of the image.
  • the digital image processing means can take various forms depending on the application.
  • the digital image processing means may be integrated wholly or partly into the apparatus, as in the following examples:
  • An image capture apparatus which produces modified images, for example a digital camera which incorporates image processing means.
  • An image rendering apparatus which displays or prints modified images, for example a video projector or a printer including image processing means.
  • a mixed device that corrects the defects of its elements, for example a scanner / printer / fax including image processing means.
  • a professional image capture apparatus which produces modified images, for example an endoscope including image processing means.
  • the digital image processing means are integrated into the apparatus, in practice the apparatus corrects its own defects.
  • the digital image processing means may be integrated wholly or partly into a computer for example as follows:
  • an operating system for example a Windows or Mac OS brand
  • an image processing application for example Photoshop TM, for automatically modifying the quality of images from, or intended for, several image - and / or time - variant cameras, for example scanners, cameras photos, printers. Automatic correction can occur for example when the user activates a filter command in Photoshop TM.
  • a photo printing apparatus for example "Photofinishing” or “Minilab” in English
  • Autocorrect can take into account cameras, the built - in scanner and printer, and be done when the print jobs are started.
  • a server for example on the Internet, to automatically change the quality of images from multiple cameras that vary in image and / or time, such as disposable cameras or digital cameras; the automatic correction can take into account the cameras as well as, for example, a printer and take place at the moment the images are saved on the server, or at the moment when print jobs are started.
  • the processing means are integrated in a computer
  • the processing means images are compatible with multiple devices, and at least one device in a chain of devices may vary from one image to another.
  • the performance level of the optical system and / or the image sensor and / or generator, and / or the servo system is adjusted in terms of the performance of the digital image processing .
  • the desired levels of performance are fixed in advance according to the capabilities of the digital image processing means and the choice is made.
  • the optical system, the sensor or generator and / or the servo system having lower performances but making it possible to achieve the performances determined from the digital image processing means.
  • the performance of a device includes, but is not limited to, its cost, its size, the minimum amount of light that it can receive or transmit, the quality of the image, and the technical characteristics of the optics, the sensor, and the enslavement.
  • the performances of the digital image processing means are the limits of the capacities of these means.
  • the digital image processing means comprise means for improving the image quality by acting on at least one of the parameters of the group comprising: the geometric distortions of the optical system, the chromatic aberrations of the optical system, the compensation of the image; parallax, depth of field, vignetting of the optical system and / or of the sensor and / or image generator, lack of sharpness of the optical system and / or the sensor and / or the image generator, noise, Moire phenomena, and / or contrast, and / or at least one determined or selected parameter of the optical system is chosen from the group comprising: the number of optical elements of the system, the nature of the materials composing the optical elements of the optical system, the cost of the materials of the optical system, the optical surface treatment, the assembly tolerances, the parallax value as a function of the focal length, the aperture characteristics, the aperture mechanisms, the range of possible focal lengths, the focusing characteristics, the mechanisms debugging, anti-alias filters, size, depth of field, focal length and focus characteristics, geometric distortions, chromatic aber
  • the quality of the pixels is chosen from the group comprising: the quality of the pixels, the area of the pixels, the number of pixels, the matrix of microlenses, the anti filters - alias, the geometry of the pixels, the arrangement of the pixels,
  • the digital image processing means are, for example, defined as follows:
  • the maximum value of the number of pixels between the various colored spots, which can be corrected by the digital image processing means, is specified.
  • Parallax compensation is the maximum value of parallax that can be corrected by the digital processing means. This value is, for example, expressed in number of pixels. It is recalled that when the focal length varies, the position of the optical center can change and thus induce a change of parallax. Parallax is the variation of the position of the optical center that occurs when the focal length varies.
  • the sharpness is measured, for example, by a value called BXU which is a measure of the area of blur spot, as described in the article published in the "Proceedings of IEEE, International Conference of Image Processing, Singapore 2004", and entitled “Uniqueness of Blur Measure” by Jércons BUZZI and Frédéric GUICHARD.
  • the blur of an optical system is measured from the image, called "impulse response", of an infinitely small point located in the plane of sharpness.
  • the BXU parameter is the variance of the impulse response (ie its average surface). Processing capabilities can be limited to a maximum value of BXU.
  • the digital processing means may be specified to distinctly correct the various causes of the lack of sharpness, particularly to account for the symmetry of blur spots. For example, an astigmatic blur spot has two perpendicular axes of symmetry, whereas a "coma" blur spot has only one axis of symmetry.
  • Depth of field is defined as the distance between the nearest object plane and the farthest object plane for which the blur spot does not exceed predetermined dimensions.
  • the digital image processing means reduce the size of the blur spot. Vignetting is the variation of brightness in the field of the image. For example, we specify the maximum percentage of vignetting allowed in the image.
  • the noise is specified for example by its standard deviation, its shape, the size of the noise spot, as well as its coloration. Moire phenomena appear at high spatial frequencies. They are corrected with anti-alias filters.
  • the digital processing means are specified by the parameters of the anti-alias filters. It should be noted that anti-alias filtering can be carried out either by optical means or by digital means.
  • the digital processing means is specified by the minimum value of the magnitude of the contrast variations that can be improved.
  • the decentering is a property of the optical system that corrects the perspective effects.
  • pixel quality is understood to mean the sensitivity, the output and the noise produced by each pixel, as well as all the colors that can be captured. and / or reproduced reliably.
  • the dynamics of the signals captured by the pixels is also a quality of the latter.
  • the focusing can be carried out in various ways, in particular by controlling the position of moving elements of the optical system or by controlling the geometry of elements. deformable optics.
  • At least one parameter of the image sensor or generator is determined or selected from the digital image processing means which comprise means for reducing the noise. It is thus possible to obtain a given noise level for a given amount of light, by reducing the cost of the sensor.
  • the conventional technique of designing a capture and / or image generation apparatus consists of choosing an optical system and a sensor or generator and then reducing the noise but within the limit of the computing power available. .
  • the characteristics of the apparatus and the optical system are determined, in particular the dimensions, the blur, the color, contrast and noise characteristics.
  • the characteristics of the optics are determined secondly taking into account the image processing capabilities, as well as the characteristics of the image sensor or generator, in particular the number of pixels.
  • the optical system is preferably fixed focal and its aperture is optimized to take account of the digital image processing means which comprise blur correction means, in particular variables as a function of the position in the field of the image. image, and / or depth of field correction means, in particular variable as a function of the position in the field of the image, and / or vignetting correction means, and / or distortion correction means.
  • the digital image processing means which comprise blur correction means, in particular variables as a function of the position in the field of the image.
  • image, and / or depth of field correction means in particular variable as a function of the position in the field of the image
  • vignetting correction means in particular variable as a function of the position in the field of the image
  • distortion correction means in particular variables as a function of the position in the field of the image.
  • the apparatus comprises a servo control system in particular for controlling the focusing, and the digital image processing means comprising fuzziness correction means and / or depth of field correction means, the parameters of the optical system, in particular the position of the image plane as a function of the focusing distance and / or the focal length, are determined or selected so that the sharpness of the images is substantially homogeneous in the field of the image.
  • the focus plane is substantially independent of the focus area of the image whereas usually, due to the variation of curvature of the image field, Focus distance varies with the focus area.
  • the focus measure takes into account the subsequent correction.
  • the measurement takes into account the position in the field and the level of blur correction function of the position in the field. It is then sought to obtain maximum clarity not for the raw measurement as in a conventional device but for the measurement thus corrected.
  • the focus instruction also takes into account the correction capabilities. We can admit a certain level of blur that depends on the focal length and the known correction capabilities, and not seek, as in a conventional camera, to obtain the maximum sharpness during the development. The maximum level of the blur in the field is thus lower, and the minimum level in the field can be higher than in a conventional apparatus and is adapted to the capabilities of the image processing means.
  • the apparatus comprises an exposure control system and the exposure parameters of this servo system are determined or selected taking into account the correction capability of noise correction algorithms and / or or contrast and / or motion blur forming part of the digital image processing means, for example to obtain, after correction, a given level of quality in terms of noise, contrast and blur.
  • the exposure measurement taking into account the subsequent correction capabilities which, for example, reduces the noise by four, can be set a shorter exposure time to avoid camera shake and / or set a gain of higher sensor to allow views in low light or to decrease the aperture and increase the depth of field.
  • the advantages are a greater latitude of choice of the exposure parameters. In short, compared to existing systems, shorter exposure times, more closed apertures, and higher gains in the amount of light given in the scene can be chosen.
  • contrast correction for the same image quality, it may be necessary to have a lower sensitivity compared to a situation where contrast correction is not used.
  • contrast correction the exposure measurement taking into account the subsequent correction capabilities, may use a lower sensor gain for images with dark areas than for images that do not have, as long as the parts in the dark areas can be corrected by the contrast correction algorithm at the cost of an increase in noise.
  • the digital image processing means comprise means for correcting lateral chromatic aberration and / or blurring, and / or distortion, and / or vignetting, and / or noise, and / or parallax compensation,
  • the optical system is of variable focal length
  • the parameters of this optical system are determined or chosen in the group comprising the following parameters: the number of optical elements of the system, the nature of the materials optical system components, cost of optical system materials, optical surface treatment, color of optical system materials, assembly tolerances, parallax value as a function of focal length, and of focus.
  • the digital image processing means making a priori appropriate corrections and / or compensations, it is possible to optimize, in particular to minimize, the number of optical elements of the optical system, it is possible to optimize the nature of the optical system materials, we can reduce their cost, and we can optimize the treatment of optical surfaces.
  • the color of the optical system materials can be chosen at will, provided that color correction means are provided. Assembly tolerances can be released. The permissible range of parallax variations as a function of the focal length can be increased, and the focus characteristics can also be released.
  • a zoom type objective makes it possible to obtain variable focal lengths while preserving, for various focal lengths, the same focus.
  • a zoom lens is therefore relatively expensive since it must respect this constraint to keep the focus with the various values of focal lengths.
  • the invention by releasing the focus characteristics, makes it possible to achieve a less expensive zoom with the same performance, the characteristics of the setting. point being compensated by the digital image processing means.
  • the dimensions of the apparatus are determined according to the capabilities of the digital image processing means. In particular, the dimensions of the apparatus can be minimized.
  • the senor may be of reduced dimensions. It is possible to reduce the size of pixels, within the limits of the capacity of the digital image processing means to correct the defects resulting from a smaller pixel size and in particular the increase in noise that results therefrom. Similarly, it is possible to reduce the size of the pixels and to increase the aperture of the optics within the limits of the capabilities of the digital image processing means to correct the defects resulting from an increase in the aperture of the optics and in particular the increase of the resulting blur. Similarly, the size of the optical system can be minimized by providing a number of lenses such that the space requirement is less than the focal length, provided that the digital image processing means are provided to correct defects resulting from a high number of optical elements.
  • the dimensions of the servo system can also be reduced, the digital image processing means making it possible, for example, to minimize the displacement of the optical elements of the optical system and therefore the energy consumption, which leads to a reduction in the volume of the images.
  • the digital image processing means are at least partially included in the image capture and / or reproduction apparatus.
  • the digital image processing means may also be at least partially separated from the capture apparatus and / or restitution of images as is the case, for example, as explained above, when these digital means are in a computer.
  • the choice of the parameters of the optical system consists in selecting the optical system among pre-existing optical systems.
  • the sensor or generator parameters can also be selected by selecting the sensor or generator from among pre-existing generators or sensors.
  • the digital processing means compensating for the defects that result from the simplicity of the optical system.
  • the digital image processing means comprise means for acting on the lack of sharpness of the optical system and / or of the sensor and / or the image generator, and these means are such that they make it possible to achieve an apparatus for capturing and / or reproducing images without a servo system enabling the focusing.
  • digital image processing means which reduce the size of the blur spot so as to obtain the desired result.
  • digital image processing means which reduce the size of the blur spot can be produced by a larger aperture capture apparatus, for example from 2, 8 to 1. , 4, while maintaining the same depth of field.
  • a global specification of the apparatus is defined, and correlatively, interactively inter alia, specifications of the optical system and / or specifications of the sensor and / or image generator are established, and / or a specification of the servo system, and a specification of the digital image processing means according to the global specifications, so that the performance of the specifications of the system can be transferred.
  • optical, and / or specifications of the sensor and / or image generator, and / or the specifications of the servo system to the specifications of the digital image processing means, and / or so that the process makes it possible to reduce the production costs of the apparatus.
  • the specifications for a device, or one of its components, or digital image processing means all the technical specifications that the device, its components or the digital processing means must comply with. of images.
  • the image capture and / or reproduction apparatus comprises a servo system and at least one parameter of the sensor and / or the image generator and / or the servo system is determined or selected. from the capabilities of the digital image processing means.
  • the optical system is of variable focal length
  • the digital image processing means comprise means for correcting at least one of the characteristics included in the group comprising blurring, vignetting, noise and compensation. of parallax, and at least one parameter of this optical system is determined or chosen from the group comprising: the number of optical elements of the system, the nature of the materials composing the optical elements of the optical system, the cost of the optical system materials, the optical surface treatment, the color of the optical system materials, the assembly tolerances, the value of the parallax according to focal length, and focus characteristics.
  • the digital image processing means comprise means for improving the image quality by acting on at least one of the parameters of the group comprising: the vignetting of the sensor and / or the image generator, the lack of sharpness of the sensor and / or the image generator, noise, moire phenomena, and / or contrast,
  • the quality of the pixels comprising: the quality of the pixels, the area of the pixels, the number of pixels, the matrix of microlenses, the anti-reflection filters, alias, the geometry of the pixels, the arrangement of the pixels,
  • the focus measurement relating to at least one element of the group comprising: the focus measurement, the exposure measurement, the white balance measurement, the set point debugging, the opening set point, the set time setpoint, the sensor gain setpoint.
  • At least one parameter of the sensor or image generator relative to the dimensions of the sensor or generator is determined or selected, the digital image processing means comprising noise reduction means making it possible to minimize the dimensions of the sensor or image generator.
  • At least one parameter of the optical system in particular the position of the image plane depending on the focusing distance and / or the focal distance, is determined or selected. so that the sharpness of the images is homogeneous in the field of the image, the servo system taking into account the position of the image plane depending on the focus distance and / or focal length.
  • the apparatus comprises a servo system
  • at least one parameter of this servo system, in particular the exposure parameters is determined or selected taking into account the correction capacity of correction algorithms.
  • noise and / or contrast and / or motion blur being part of the digital image processing means.
  • the digital image processing means comprise means for acting on the lack of sharpness of the optical system and / or the sensor and / or the image generator, these means being such that they make it possible to perform a apparatus for capturing and / or reproducing images without a focus servo system.
  • the dimensions of the apparatus are determined according to the capabilities of the digital image processing means.
  • the digital image processing means are at least partially included in the image capture and / or reproduction apparatus.
  • the digital image processing means are at least partially separated from the image capture or rendering apparatus.
  • the optical system is selected from pre-existing optical systems.
  • the sensor or generator is selected from pre-existing sensors or generators.
  • the digital image processing means includes means for improving the image quality by acting on at least one of the parameters of the group including: vignetting of the optical system and / or sensor and / or image generator, lack of sharpness of the optical system and / or sensor and / or image generator, noise, moire phenomena, and / or contrast.
  • the invention also relates to an apparatus for capturing and / or restoring images obtained by the embodiment method defined above.
  • FIG. 1 is a diagram of an apparatus obtained by the method according to the invention.
  • FIG. 2 is a diagram showing steps of the method according to the invention
  • FIG. 3 shows a mode of adjustment according to FIG.
  • FIGS. 4a and 4b form a set of diagrams showing adjustments used in the context of the invention
  • FIGS. 5, 5a and 5b illustrate a property of an image capture apparatus according to the invention and of a conventional apparatus
  • FIGS. 6a to 6d are diagrams showing the properties of an optical system of an apparatus according to the invention and of a conventional apparatus
  • FIGS. 7a and 7b are diagrams showing an example of optical system selection for an apparatus according to the invention.
  • FIG. 1 is a diagram illustrating the architecture of a device for capturing or restoring images.
  • Such an apparatus for example of image capture, comprises, on the one hand, an optical system 22, in particular with one or more optical elements such as lenses, intended to form an image on a sensor 24.
  • this sensor may be of another type, for example a photographic film in the case of a so-called "film camera”.
  • Such an apparatus also comprises a servo-control system 26 acting on the optical system 22 and / or on the sensor 24 in order to focus so that the image plane is on the sensor 24, and / or for the amount of light received on the sensor is optimal by setting the exposure time and / or opening, and / or that the colors obtained are correct, by performing a control of the white balance.
  • the apparatus comprises digital image processing means 28.
  • these digital image processing means are separated from the apparatus 20. It is also possible to provide a portion of the image processing means in the apparatus 20 and a portion outside the apparatus 20.
  • the digital processing of the image is performed after the image is recorded by the sensor 24.
  • An image rendering apparatus has a structure analogous to an image capture apparatus. Instead of a sensor 24, there is provided a generator 24 'of images receiving images of digital image processing means 28' and supplying the images to an optical system 22 ', such as a projection optical system .
  • the invention is based on the capabilities of the digital image processing means 28, 28 'for determining or selecting the parameters of the optical system 22, 22', and / or the image sensor or generator 24, 24 'and / or or the servo system 26.
  • the performance level achievable with each of the components of the apparatus when associated with digital image processing means is shown in the diagram of Figure 2. . These levels are represented by the broken line 30 for the optical system, the broken line 32 for the sensor, the line 34 for the servo, and the dashed line 36 for the device.
  • the level of performance of the optical system can be set at 30 '
  • the levels of the performance of the sensor and the servo system can be set at the levels 32' and 34 ', respectively.
  • the level of performance of the apparatus would be at the lowest level, for example the level 36 'corresponding to the lowest level 30' for the optical system.
  • the digital image processing means are preferably those described in the following documents:
  • Patent Application EP 02751241.7 entitled “Method and system for producing formatted information related to device faults in a chain of formatted apparatus and information for image processing means".
  • Patent Application EP 02743349.9 for: "Method and system for modifying the qualities of at least one image originating from or intended for a chain of appliances".
  • Patent Application EP 02747504.5 for: "Method and system for reducing the frequency of updates of image processing means”.
  • Patent Application EP 02748934.3 for: "Method and system for correcting the chromatic aberrations of a color image produced by means of an optical system".
  • Patent application EP 02743348.1 for: “Method and system for producing formatted information related to geometric distortions”
  • Patent application EP 02748933.5 for: “Method and system for providing, in a standard format, information formatted to means of image processing” .
  • Patent Application EP 02747506.0 for: "Method and system for producing formatted information related to the defects of at least one device of a chain, in particular to blur".
  • Patent application EP 02745485.9 for: "Method and system for modifying a digital image by taking into account its noise”.
  • Patent Application PCT / FR 2004/050455 for: "Method and system for modifying a digital image in a differentiated and quasi-regular manner by pixel".
  • an optical system can distort the images so that a rectangle can be deformed into a cushion, with a convex shape of each of the sides or in a barrel with a concave shape of each of the sides.
  • chromatic aberrations of the optical system if an object point is represented by three colored spots having Precise positions relative to each other, chromatic aberration results in a variation of position of these spots relative to each other, the aberrations being, in general, all the more important as one moves away from the center. of the image .
  • Parallax when an adjustment is made by deformation or displacement of an optical element of the optical system, the image obtained on the image plane can move.
  • the setting is, for example, a focal length adjustment, or a focus adjustment.
  • This defect is illustrated in FIG. 3, in which there is shown an optical system 40 with three lenses in which the center of the image has position 42 when the lens 44 has the position shown in solid lines. When the lens 44 moves to take the position 44 ', shown in phantom, the center of the image takes the position 42'.
  • Depth of field when the optical system is focused on a specific object plane, the images of this plane remain clear as well as the images of the objects close to this plane.
  • depth of field is the distance between the nearest object plane and the farthest object plane for which the images remain sharp.
  • vignetting in general, the brightness of the image is maximum in the center and decreases as one moves away from the center. Vignetting is measured by the difference, in percent, between the brightness at a point and the maximum brightness.
  • the sound of the image is generally defined by its standard deviation, its shape, and the size of the noise spot and its coloration.
  • the moiré phenomenon is an image distortion that occurs when there are high spatial frequencies. Moiré is corrected by setting the anti-alias filters.
  • the contrast is the ratio between the highest and the lowest brightness values of the image for which details of the image are still visible.
  • the contrast (FIG. 4a) of an image can be improved, that is, extended
  • the image surface of an object plane does not constitute a perfect plane but presents a curvature, called a curvature of field.
  • This curvature varies according to various parameters including focus and focus.
  • the position of the image plane 50 depends on the area on which the focus is made.
  • the plane 50 corresponds to a focus in the center 52 of the image.
  • the image plane 56 is closer to the optical system 22 than the image plane 50.
  • the image plane is positioned at a position 58, intermediate between the positions 54 (corresponding to a focus on an area near the edge of the image), and 50 ( corresponding to a focus on an area in the center of the image).
  • the combination of the digital image processing means 28 with the focus servocontrol 26 makes it possible to limit the displacement of the plane 58 for focusing, which reduces the energy consumption of the servo system and enables reduce the volume of its components.
  • FIG. 5a shows the blur properties with a conventional focus servo system in which the maximum sharpness is obtained at the center of the image.
  • the field of the image is plotted on the abscissa and the value of blur on the ordinate expressed in BXU.
  • the blur is, in the center, 1, 3 and at the edge of the image, 6, 6.
  • FIG. 5b is a diagram similar to that of FIG.
  • the digital image processing means comprise means of improving the sharpness such that they make it possible to dispense with focusing servocontrol.
  • FIGS. 6a, 6b, 6c and 6d show the characteristics of an apparatus obtained according to the conventional technique and those of an apparatus obtained with the method according to the invention.
  • the conventional apparatus is a digital photography apparatus integrated with a mobile phone having a VGA sensor, ie, a 640 x 480 resolution without a focus system.
  • the conventional apparatus has an opening of 2, 8 while the apparatus obtained with the process according to the invention has an opening of 1, 4.
  • FIG. 6a which corresponds to the conventional apparatus, is a diagram on which the percentage of field of the image is represented on the abscissa, the origin corresponding to the center of the image.
  • FIG. 6b is a similar diagram for an apparatus obtained according to the invention.
  • the vignetting reaches the value 0, 7 at the edge of the image while in the diagram of FIG. 6b shows that the optical system of the apparatus according to the invention has a substantially larger vignetting, of the order of 0.3.
  • the correction limit of the algorithm used is 0, 25. In other words, thanks to the correction algorithm it is possible to use a substantially larger vignetting optics.
  • FIG. 6c is a diagram representing, on the ordinate, the blur, expressed in BXU, as a function of the field of the image (in abscissas) for a conventional apparatus.
  • the blur characteristic is 1.5 in the center and 4 at the edge of the image.
  • the diagram of FIG. 6d also shows the blur for the optics of the apparatus obtained with the method according to the invention.
  • the field of the image is also represented and on the ordinate the blur expressed in BXU.
  • the blur in the center of the image is of the order of 2, 2. It is therefore greater than the blur of the diagram of Figure 6c.
  • a blur of about 3 was chosen, taking into account the limit of the correction algorithm.
  • degraded optics have been chosen with regard to sharpness in the center, whereas the same results are obtained as with the conventional apparatus, with, in addition, an upper aperture.
  • the optics of the apparatus according to the invention represent a quality analogous to that of conventional optics, this result being obtainable due to the degradation of the vignetting with respect to the classic optics.
  • the optical system provides a small image spot 100.
  • This system has a Modulation Transfer Function (MTF) represented by a diagram where the spatial frequencies are in abscissa.
  • the value of the cutoff frequency is fc.
  • the FTM function comprises a level 110 in the vicinity of the zero frequencies and a part decreasing rapidly towards the value fc.
  • the optic represented by the diagram of FIG. 7b has an image spot 114 of dimensions substantially greater than the image spot 100 and its FTM has the same cutoff frequency fc as in the case of FIG. 7a.
  • the variation of this MTF as a function of the spatial frequency is different: this frequency decreases relatively regularly from the origin towards the cutoff frequency.
  • the optics shown in FIG. 7b will provide more detail than the optics shown in FIG. 7a, and this despite the fact that the image spot is larger than in the case of Figure 7a. We will therefore choose the optics corresponding to Figure 7b.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Studio Devices (AREA)
  • Image Processing (AREA)
  • Television Signal Processing For Recording (AREA)
  • Image Input (AREA)
  • Facsimile Heads (AREA)
EP06709409A 2005-01-19 2006-01-18 Procede de realisation d'un appareil de capture et/ou de restitution d'images et appareil obtenu par ce procede Ceased EP1839433A2 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
FR0550163A FR2881011B1 (fr) 2005-01-19 2005-01-19 Procede de realisation d'un appareil de capture et/ou restitution d'images et appareil obtenu par ce procede
PCT/FR2006/050022 WO2006077344A2 (fr) 2005-01-19 2006-01-18 Procede de realisation d'un appareil de capture et/ou de restitution d'images et appareil obtenu par ce procede

Publications (1)

Publication Number Publication Date
EP1839433A2 true EP1839433A2 (fr) 2007-10-03

Family

ID=34953034

Family Applications (1)

Application Number Title Priority Date Filing Date
EP06709409A Ceased EP1839433A2 (fr) 2005-01-19 2006-01-18 Procede de realisation d'un appareil de capture et/ou de restitution d'images et appareil obtenu par ce procede

Country Status (8)

Country Link
US (1) US20080107350A1 (zh)
EP (1) EP1839433A2 (zh)
JP (1) JP5633882B2 (zh)
KR (2) KR20120125399A (zh)
CN (1) CN101107841B (zh)
CA (1) CA2594977C (zh)
FR (1) FR2881011B1 (zh)
WO (1) WO2006077344A2 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104217700A (zh) * 2013-06-03 2014-12-17 天钰科技股份有限公司 显示控制系统及方法

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2463480A (en) * 2008-09-12 2010-03-17 Sharp Kk Camera Having Large Depth of Field
JP5075795B2 (ja) 2008-11-14 2012-11-21 株式会社東芝 固体撮像装置
JP5374217B2 (ja) * 2009-04-22 2013-12-25 キヤノン株式会社 画像処理装置およびその方法
US8496179B2 (en) * 2009-09-30 2013-07-30 Ncr Corporation Methods and apparatus for imaging bar code scanning
CN102257822B (zh) 2009-10-27 2014-01-08 松下电器产业株式会社 摄像装置和使用它的测距装置
JP5576739B2 (ja) 2010-08-04 2014-08-20 オリンパス株式会社 画像処理装置、画像処理方法、撮像装置及びプログラム
JP5898481B2 (ja) * 2011-12-13 2016-04-06 キヤノン株式会社 撮像装置及び焦点検出方法
JP5983373B2 (ja) * 2012-12-07 2016-08-31 富士通株式会社 画像処理装置、情報処理方法及びプログラム
JP7091048B2 (ja) * 2017-10-11 2022-06-27 キヤノン株式会社 撮像装置およびその制御方法

Family Cites Families (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3713730A (en) * 1970-11-20 1973-01-30 M Kaplan Image reconstitution system
JPH06288864A (ja) 1993-04-06 1994-10-18 Hitachi Ltd 光及び構造の複合解析システム
JP3260929B2 (ja) * 1993-10-15 2002-02-25 オリンパス光学工業株式会社 映像処理装置
JP3275010B2 (ja) * 1995-02-03 2002-04-15 ザ・リジェンツ・オブ・ザ・ユニバーシティ・オブ・コロラド 拡大された被写界深度を有する光学システム
JPH08338945A (ja) 1995-06-13 1996-12-24 Canon Inc 光学系の収差図表示装置
JP3519825B2 (ja) 1995-06-19 2004-04-19 オリンパス株式会社 電子撮像装置のシミュレーション方法および装置
US5751863A (en) 1996-06-18 1998-05-12 Hewlett Packard Company Method and system having relaxed front end distortion requirements
JPH116959A (ja) 1997-06-18 1999-01-12 Minolta Co Ltd ズーム光学系の設計方法
WO1999067743A1 (fr) * 1998-06-22 1999-12-29 Yoshikazu Ichiyama Procede de correction d'images et dispositif d'entree d'images
US7365326B2 (en) * 2000-12-26 2008-04-29 Honeywell International Inc. Camera having distortion correction
JP2002267926A (ja) 2001-03-08 2002-09-18 Olympus Optical Co Ltd 光学系の設計手法
CN1273931C (zh) 2001-07-12 2006-09-06 杜莱布斯公司 改进图象质量的方法和系统
JP4159986B2 (ja) 2001-07-12 2008-10-01 ドゥ ラブズ デジタル画像から変換された画像を計算するための方法およびシステム
JP2003076743A (ja) 2001-08-30 2003-03-14 Ricoh Co Ltd 画像読取装置シミュレーションシステムおよび画像読取装置シミュレーション方法
US20030158503A1 (en) * 2002-01-18 2003-08-21 Shinya Matsumoto Capsule endoscope and observation system that uses it
US7379613B2 (en) * 2002-02-27 2008-05-27 Omnivision Cdm Optics, Inc. Optimized image processing for wavefront coded imaging systems
JP2003279853A (ja) 2002-03-25 2003-10-02 Olympus Optical Co Ltd 光学系の設計手法
US7227573B2 (en) * 2002-07-29 2007-06-05 Hewlett-Packard Development Company, L.P. Apparatus and method for improved-resolution digital zoom in an electronic imaging device
JP4053442B2 (ja) 2003-02-28 2008-02-27 シャープ株式会社 照明系および撮像系のシステム設計装置
US7260251B2 (en) * 2003-03-31 2007-08-21 Cdm Optics, Inc. Systems and methods for minimizing aberrating effects in imaging systems
JP2004325880A (ja) 2003-04-25 2004-11-18 Olympus Corp 光学系の設計方法
FR2860089B1 (fr) 2003-09-23 2005-11-11 Do Labs Procede et systeme pour modifier une image numerique de maniere differenciee et quasi reguliere par pixel
TWI231606B (en) * 2003-11-10 2005-04-21 Shih-Hsien Tseng Image pickup device and a manufacturing method thereof
CN1898590A (zh) * 2003-12-01 2007-01-17 Cdm光学有限公司 用于优化光学和数字系统设计的系统和方法
US20060093234A1 (en) * 2004-11-04 2006-05-04 Silverstein D A Reduction of blur in multi-channel images

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
None *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104217700A (zh) * 2013-06-03 2014-12-17 天钰科技股份有限公司 显示控制系统及方法

Also Published As

Publication number Publication date
JP5633882B2 (ja) 2014-12-03
FR2881011A1 (fr) 2006-07-21
WO2006077344A3 (fr) 2006-12-14
CN101107841B (zh) 2010-11-10
JP2008533550A (ja) 2008-08-21
KR101226423B1 (ko) 2013-01-24
CN101107841A (zh) 2008-01-16
US20080107350A1 (en) 2008-05-08
FR2881011B1 (fr) 2007-06-29
CA2594977C (en) 2016-06-28
KR20120125399A (ko) 2012-11-14
KR20070114717A (ko) 2007-12-04
CA2594977A1 (en) 2006-07-27
WO2006077344A2 (fr) 2006-07-27

Similar Documents

Publication Publication Date Title
WO2006077344A2 (fr) Procede de realisation d'un appareil de capture et/ou de restitution d'images et appareil obtenu par ce procede
US11774751B2 (en) Digital camera with in-camera software for image correction
EP0897549B1 (fr) Dispositif de formation d'une image autostereoscopique et systeme le comprenant
CA2600185C (fr) Procede pour commander une action, notamment une modification de nettete, a partir d'une image numerique en couleurs
EP1523730B1 (fr) Procede et systeme pour calculer une image transformee a partir d'une image numerique
EP2780763B1 (fr) Procede et systeme de capture de sequence d'images avec compensation des variations de grandissement
EP3657784B1 (fr) Procédé d'estimation d'un défaut d'un système de capture d'images et systèmes associés
EP2374270B1 (fr) Système de capture d'images et utilisation associée pour améliorer la qualité des images acquises
EP2465255A1 (fr) Système et procédé de capture d'images avec deux modes de fonctionnement
US9124876B2 (en) Pupil-dividing imaging apparatus
US20060104627A1 (en) Apparatus and method for excluding vignetting in a digital camera
FR2880958A1 (fr) Procede d'amelioration de la nettete d'au moins une couleur d'une image numerique
JP2017535807A (ja) 光学素子を有するモバイルデバイス

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20070710

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR

DAX Request for extension of the european patent (deleted)
17Q First examination report despatched

Effective date: 20130424

REG Reference to a national code

Ref country code: DE

Ref legal event code: R003

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN REFUSED

18R Application refused

Effective date: 20180122