US20080165258A1 - Method of Controlling an Image Capturing System, Image Capturing System and Digital Camera - Google Patents

Method of Controlling an Image Capturing System, Image Capturing System and Digital Camera Download PDF

Info

Publication number
US20080165258A1
US20080165258A1 US11/913,819 US91381905A US2008165258A1 US 20080165258 A1 US20080165258 A1 US 20080165258A1 US 91381905 A US91381905 A US 91381905A US 2008165258 A1 US2008165258 A1 US 2008165258A1
Authority
US
United States
Prior art keywords
array
image
intensity values
intensity
pixel
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US11/913,819
Other languages
English (en)
Inventor
Andrew Augustine Wajs
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Active Optics Pty Ltd
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Publication of US20080165258A1 publication Critical patent/US20080165258A1/en
Assigned to ACTIVE OPTICS PTY. LTD. reassignment ACTIVE OPTICS PTY. LTD. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: WAJS, ANDREW AUGUSTINE
Abandoned legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/95—Computational photography systems, e.g. light-field imaging systems
    • H04N23/951—Computational photography systems, e.g. light-field imaging systems by using two or more images to influence resolution, frame rate or aspect ratio
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70—Circuitry for compensating brightness variation in the scene
    • H04N23/72—Combination of two or more compensation controls
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/40—Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled
    • H04N25/42—Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled by switching between different modes of operation using different resolutions or aspect ratios, e.g. switching between interlaced and non-interlaced mode
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/40—Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled
    • H04N25/44—Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled by partially reading an SSIS array
    • H04N25/443—Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled by partially reading an SSIS array by reading pixels from selected 2D regions of the array, e.g. for windowing or digital zooming
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/40—Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled
    • H04N25/46—Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled by combining or binning pixels
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N3/00—Scanning details of television systems; Combination thereof with generation of supply voltages
    • H04N3/10—Scanning details of television systems; Combination thereof with generation of supply voltages by means not exclusively optical-mechanical
    • H04N3/14—Scanning details of television systems; Combination thereof with generation of supply voltages by means not exclusively optical-mechanical by means of electrically scanned solid-state devices
    • H04N3/15—Scanning details of television systems; Combination thereof with generation of supply voltages by means not exclusively optical-mechanical by means of electrically scanned solid-state devices for picture signal generation
    • H04N3/155—Control of the image-sensor operation, e.g. image processing within the image-sensor
    • H04N3/1562—Control of the image-sensor operation, e.g. image processing within the image-sensor for selective scanning, e.g. windowing, zooming

Definitions

  • the invention relates to a method of controlling an image capturing system comprising an interface for receiving an external trigger to capture an image, and an image capturing device provided with a photosensitive area and an array of pixel cells, each pixel cell including a device for generating a signal indicative of the intensity of light falling on an associated part of the photosensitive area, which image capturing device is further provided with readout circuitry for generating an array of pixel values to capture an image frame at a set spatial resolution, such that each pixel value represents an integral of the signal or signals generated in at least one of the pixel cells in an associated one of a number of areas over an exposure time interval, the number of areas being determined by the set spatial resolution, the areas together covering a region of the photosensitive area corresponding to a region in the image.
  • the invention also relates to an image capturing system.
  • the invention also relates to a method of forming a combined final image from a plurality of image frames, including the steps of: obtaining a first and at least one further array of intensity values, each array of intensity values encoding light intensity levels at each of a respective number of pixel positions in the respective image frame, the number determining the spatial resolution of the image frame concerned, generating a set of derived arrays of intensity values, each derived array being based on a respective one of the obtained arrays of intensity levels and encoding light intensity levels at each of a common number of pixel positions in at least a region of overlap of the respective image frames, generating an array of combined intensity values, each element in the array based on a sum of intensity values represented by the corresponding element in each of the respective derived arrays of intensity values, and providing an array of intensity values encoding the combined final image, the array being based on the array of combined intensity values.
  • the invention also relates to an image processing system.
  • the invention also relates to a digital camera.
  • the invention also relates to a computer program.
  • the aforementioned application describes a digital camera.
  • the camera can be used in a substantially stationary position to capture a sequence of images and to derive a sequence of corresponding frames of pixel values representing the images.
  • Each image is underexposed on purpose.
  • the images are adjusted prior to forming them into a combined final image.
  • the combined final image is formed by summing the values of corresponding pixels in the adjusted images.
  • the combined final image may therefore be formed from underexposed images, but is itself sufficiently bright, as well as having good spatial resolution.
  • the adjustment is used to prevent the combined final image from being blurred.
  • a problem associated with capturing a series of underexposed image frames for later combination is due to the types of image capturing devices available for use. Generally, these either have pixel cells comprising Charge Coupled Devices (CCDs) or are made with Complementary Metal Oxide Semiconductor (CMOS) sensors, in both cases with associated read-out circuitry.
  • CCDs Charge Coupled Devices
  • CMOS Complementary Metal Oxide Semiconductor
  • the readout time i.e. the time needed by the read-out circuitry to generate the array of pixel values encoding a frame, is very long. The time needed to capture a series of consecutive image frames for subsequent formation of a combined image, is thus even longer.
  • aspects of the invention include methods and systems of the type defined above, that results in image frames for formation into a combined final image with a relatively low noise level whilst requiring a relatively short overall image capture time.
  • a method in one embodiment, includes receiving an external trigger to capture the image, and, in response to the external trigger, directing the image capturing device to capture at least two image frames by generating respective arrays of pixel values representing integrals over respective consecutive exposure time intervals, wherein the spatial resolutions of at least two of the captured image frames are set to different values.
  • the captured image frames have different spatial resolutions, there is always at least one image frame with a higher and at least one with a lower resolution. Capturing an image frame with a higher resolution ensures that information with a high spatial frequency is present in the combined final image. Because not all image frames have the same, higher, resolution, the total time needed to capture and read out all the image data is relatively low, however. Because the external trigger, e.g. a user command, results directly in the capture of at least two image frames, the image frames in the series follow each other as closely as possible, saving additional time. The change in settings to set a different resolution is also accomplished automatically in response to the external trigger. Because the image frames are captured separately in such a manner that they may be combined into a combined final image by summation, the combined final image may be composed of image frames with relatively short exposure times, leading to a combined final image with little blur.
  • the external trigger e.g. a user command
  • At least the lower of the spatial resolution values is set by directing the image capturing device to generate an array of pixel values in such a manner that each pixel value is representative of the integral of the sum of the signals generated by at least two devices in pixel cells.
  • Such a technique is commonly referred to as ‘binning’, and has the effect of increasing sensitivity, because the two or more devices in pixel cells effectively occupy a larger part of the photosensitive area. Furthermore, the captured image frame has a lower noise level.
  • the method includes retrieving a desired exposure time for a combined final image, determining the number of image frames to be captured, and for each image frame, calculating settings determining an exposure level applicable to the image frame, the settings including the length of the exposure time interval, wherein the settings are calculated so that the sum of the lengths of the exposure time intervals over the number of image frames is equal to or less than the desired exposure time.
  • Each of the captured images is underexposed when viewed alone.
  • the combined final image is not, however, because it is based on the combined total of image frames.
  • This embodiment has the advantage that it enables addition of intensity levels representative of pixel values in the various image frames to generate one combined final image with a correct exposure.
  • An embodiment includes the step of generating a set of arrays of pixel values, each based on one of the captured image frames, in such a manner that each encodes at least a region of an adjusted frame at the same spatial resolution.
  • This embodiment increases the suitability of the captured image frames for generating a combined final image by summing corresponding pixel values in at least the regions of the adjusted frames.
  • an image capturing system comprising an interface for receiving an external trigger to capture an image, an image capturing device provided with a photosensitive area and an array of pixel cells, each pixel cell including a device for generating a signal indicative of the intensity of light falling on an associated part of the photosensitive area, which image capturing device is further provided with readout circuitry for generating an array of pixel values to capture an image frame at a set spatial resolution, such that each pixel value represents an integral of the signal or signals generated in at least one of the pixel cells in an associated one of a number of areas over an exposure time interval, the number of areas being determined by the set spatial resolution, the areas together covering a region of the photosensitive area corresponding to a region in the image, which image capturing system comprises a control system for controlling the operation of the image capturing device and for processing commands received through the interface, wherein the control system is configured to, in response to the external trigger, direct the image capturing device to capture at least two image frames by generating respective arrays of
  • the image capturing system is configured to execute a method of capturing an image according to an aspect of the invention.
  • the method of forming a combined final image from a plurality of image frames includes the steps of: obtaining a first and at least one further array of intensity values, each array of intensity values encoding light intensity levels at each of a respective number of pixel positions in the respective image frame, the number determining the spatial resolution of the image frame concerned, generating a set of derived arrays of intensity values, each derived array being based on a respective one of the obtained arrays of intensity levels and encoding light intensity levels at each of a common number of pixel positions in at least a region of overlap of the respective image frames, generating an array of combined intensity values, each element in the array based on a sum of intensity values represented by the corresponding element in each of the respective derived arrays of intensity values, and providing an array of intensity values encoding the combined final image, the array being based on the array of combined intensity values, wherein a first array of intensity values encoding at least the region of overlap at a higher resolution than the further arrays of intensity values is
  • the method has the advantage of resulting in a combined final image with a relatively high resolution without requiring a large number of image frames of the same resolution. Because each element in the array of combined intensity values is based on a sum of intensity values represented by the corresponding element in each of the respective derived arrays of intensity values, the step of generating this array of combined intensity values removes noise. Because the array of intensity values is based on the array of combined intensity values, at least partially, the beneficial effect extends to the combined final image. Therefore, the combined final image has at once a relatively high spatial resolution and low noise level.
  • a first embodiment of the method includes obtaining first and further arrays of intensity values in which each intensity value represents a light level in an area surrounding a pixel position, wherein at least one derived array of intensity values is obtained by adjusting the number of intensity values in an array by a multiplication factor, such that each derived array encodes at least the region of overlap at the same spatial resolution.
  • This embodiment has the effect of enabling the step of generating an array of combined intensity values to be performed by straightforward summation in the space-domain.
  • the number of intensity values in at least one array based on an obtained further array of intensity values is adjusted by a multiplication factor larger than one.
  • At least one low-resolution image frame is converted to a higher resolution.
  • This is an effective way of ensuring that the array of intensity values encoding the combined final image is based on a sufficient number of intensity values in the first array of intensity values, since a sub-set, or in one embodiment all, of the intensity values in the first obtained array can simply be added to their counterparts in the arrays obtained by adjustment to obtain a weighted average.
  • the array of combined intensity values also encodes the final image.
  • each derived array of intensity values is generated by transforming an image frame encoded by an array of intensity values based on one of the obtained arrays of intensity values and in which each intensity value represents a light level in an area surrounding a pixel position in an image frame, into the spatial frequency domain, such that each intensity value in a derived array of intensity values represents an intensity of a spatial frequency component of the image frame.
  • each derived array of intensity values includes low-frequency components of the image frames that are derivable from each of the obtained image frames. Relatively few additions are thus required to generate the array of intensity values encoding at least the region of overlap in the combined final image.
  • the step of providing the array of intensity values encoding the combined final image includes replacing at least one intensity value representing a low spatial frequency component in the derived array of intensity values based on the first obtained array of intensity values by an intensity value based at least partly on the intensity value representing the corresponding spatial frequency component in the array of combined intensity values.
  • Each replacement value may be based on the value it replaces, in order to prevent the occurrence of a ringing effect.
  • this variant is a particularly efficient way to arrive at a combined final image based on a sufficient number of intensity values in the first array of intensity values to encode the region of overlap at a higher resolution than the further arrays of intensity values. It suffices to transform the derived array based on the first array back to the space-domain subsequent to replacing the intensity values representing low spatial frequency components.
  • the high-frequency information is derived from the first array, whereas the low-frequency information is a combination of the low-frequency information in the first and further arrays
  • the transformation is carried out by a co-processor comprising at least a partial implementation in hardware of an image compression algorithm or by a digital signal processor programmed to implement an image compression algorithm.
  • This variant is particularly suited to implementation in a digital camera or other type of image processing equipment, which commonly comprise such a co-processor. Since many compression algorithms involve the use of a form of entropy coding for which transformation into the spatial frequency domain is required, this variant is very efficient.
  • the step of generating an array of combined intensity values is preceded by a step of aligning the image frames, such that each derived array encodes light intensity levels at each of substantially corresponding pixel position in at least the region of overlap.
  • At least one array of intensity values based on an obtained array of intensity values encoding at least the region of overlap in the respective image frame at a higher spatial resolution than at least one further array of intensity values, is subjected to a digital filter operation having a characteristic of passing high spatial frequency components of the image encoded by the array.
  • the higher resolution image also has a higher noise level, but is only really needed to provide image information with a high spatial frequency, the noise level of the combined final image at lower frequencies is thus reduced. This is advantageous because the human eye is most sensitive at relatively low spatial frequencies.
  • an aspect of the invention provides an image processing system for forming a combined final image from a plurality of image frames, which image processing system includes an arrangement for loading a first and at least one further array of intensity values, each array of intensity values encoding light intensity levels at each of a respective number of pixel positions in the respective image frame, the number determining the spatial resolution of the image frame concerned, and a data processing arrangement for processing the intensity values, wherein the system is configured to direct the data processing arrangement to perform the steps of generating a set of derived arrays of intensity values, each derived array being based on a respective one of the obtained arrays of intensity levels and encoding light intensity levels at each of a common number of pixel positions in at least a region of overlap of the respective image frames, generating an array of combined intensity values, each element in the array based on a sum of intensity values represented by the corresponding element in each of the respective derived arrays of intensity values, and providing an array of intensity values encoding the combined final image, the array being based on the array
  • the image processing system is configured to direct the processor to execute a method according of forming a combined final image according to an aspect of the invention.
  • the invention provides a computer program configured, when loaded into a programmable processing device to enable the programmable processing device to carry out a method according to an aspect of the invention.
  • the invention provides a digital camera comprising an image capturing system and/or an image processing system according to an aspect of the invention.
  • FIG. 1 shows schematically the layout of an exemplary digital camera
  • FIG. 2 shows in very schematic fashion some components of an image capturing device in the camera
  • FIG. 3 is a flow diagram illustrating a method of capturing image frames and forming a combined final image
  • FIGS. 4A-4C show in very schematic fashion arrays of intensity values illustrating how the combined final image is formed in one embodiment
  • FIG. 5 is an illustration of noise levels of the image frames relative to the sensitivity of the human eye.
  • One example of an image processing system usable in the context of the methods outlined herein is a digital camera 1 .
  • Other examples include a photocopier or scanning device.
  • the digital camera 1 comprises a lens system 2 for focusing on one or more objects in a scene.
  • a shutter 3 When a shutter 3 is opened, the scene is projected through an aperture 4 onto a photosensitive area 5 ( FIG. 2 ) of an image-capturing device 6 .
  • the shutter time is controllable, as is the diameter of the aperture.
  • the image capturing device could be electronically controlled to provide the same effect (electronic shutter).
  • the image-capturing device 6 can be device implemented in Complementary Metal-Oxide Semiconductor (CMOS) technology, or a Charge-Coupled Device (CCD) sensor.
  • CMOS Complementary Metal-Oxide Semiconductor
  • CCD Charge-Coupled Device
  • each pixel cell 7 includes a device for generating a signal indicative of the intensity of light to which the area that it occupies within the photosensitive area 5 , is exposed.
  • the device is, as stated, in one embodiment, a CCD sensor. It is noted that the devices occupying the pixel cells 7 a - i are generally provided as components of one integrated circuit.
  • An integral of the signal generated by a device is formed during exposure, for example by accumulation of photocurrent in a capacitor. Subsequent to exposure of the photo-sensitive area 5 for the duration of an exposure time interval, the values of the integrals of the generated signals are read out by means of row selection circuit 8 and column selection and readout circuit 9 .
  • the output of the column select and read-out circuit 9 is provided in the form of one or more analog signals to an Analog-to-Digital converter (A/D-converter) 10 .
  • the A/D-converter 10 samples and quantises the signals received from the image capturing device 6 , i.e. records it on a scale with discrete levels, the number of which is determined by the number of bits of resolution of the digital words provided as output by the A/D converter 10 .
  • the A/D converter 10 provides as output an array of pixel values encoding a captured image frame.
  • a Digital Signal Processor (DSP) 11 performs such features as interpolation between pixels and optionally compression of the image. Each exposure of the image-capturing device during an exposure time interval results in at least one frame.
  • the digital camera 1 comprises a storage device 12 for storing the image data encoding the captured images or image frames.
  • the storage device can be any usual type of storage device, e.g. built-in flash memory, inserted flash memory modules, a disk drive with a floppy disk, a PCMCIA-format hard disk, or an optical disk drive.
  • a microprocessor 13 controls the operation of the digital camera 1 , by executing instructions stored in non-volatile memory, in this example a Read-Only Memory (ROM) 14 .
  • ROM Read-Only Memory
  • the instructions in ROM 14 in some embodiments in combination with routines programmed for execution by DSP 11 , enable the digital camera 1 to execute the image processing and capturing methods outlined in the present application.
  • the microprocessor 13 communicates with a co-processor 15 in which at least part of an image compression algorithm is implemented in hardware. Algorithms to compress images in accordance with the JPEG-standard are usable, for example. As part of the compression algorithm, the image data is transformed into the spatial frequency domain. The co-processor 15 executes at least this transformation, using a Discrete Cosine Transform (DCT) in most cases.
  • DCT Discrete Cosine Transform
  • Indications of the operating conditions and settings of the digital camera 1 are provided on an output device 16 , for example a Liquid Crystal Display, possibly in combination with a sound-producing device (not illustrated separately).
  • an output device 16 for example a Liquid Crystal Display, possibly in combination with a sound-producing device (not illustrated separately).
  • An input device 17 is shown schematically as being representative of the controls by means of which the user of the digital camera provides commands.
  • the digital camera 1 illustrated in FIG. 1 comprises a flash driver circuit 18 for providing appropriate driving signals to one or more sources of flash lighting.
  • the illustrated digital camera 1 also comprises a motion sensor 19 , for providing a signal representative of the movement of the digital camera 1 , and thus of the image-capturing device 6 .
  • the digital camera 1 comprises an exposure metering device 20 .
  • the purpose of the exposure metering device 20 is to measure the strength of the ambient light, so that the microprocessor 13 can determine the intensity of light to be emitted by any connected flash, in combination with the correct values for the settings determining the exposure, which include the exposure time interval for each captured image frame, as will be elaborated on below.
  • the density of the areas occupied by the pixel cells 7 a - i determines the maximum attainable spatial resolution of a captured image frame.
  • the readout time depends on the number of pixel cells. It can be relatively long in embodiments such as the one illustrated in FIG. 2 , because each row is selected in turn using row selection circuit 8 , whereupon the column selection and readout circuit 9 senses the values of the accumulated photocharge stored in the photodevices in the pixel cells in that row. To reduce the total time involved in repeatedly exposing the photosensitive area and capturing an image frame, the spatial resolution is set to a different value between exposures.
  • the microprocessor 13 defines a number of cluster areas 21 , which together cover a region corresponding to a region of interest in the combined final image.
  • the number is smaller than the number of pixel cells 7 a - i that together cover the region.
  • a cluster of pixel cells occupies each defined cluster area 21 , as is schematically illustrated in FIG. 2 .
  • FIG. 2 For the sake of clarity, not all pixel cells 7 are shown.
  • one pixel value per cluster area 21 is read out.
  • the microprocessor 13 may alternatively or additionally define a number of overlapping areas which together cover a region of the photosensitive area 5 corresponding to the region of interest. Alternatively, areas may be defined with a slight spacing between them. To avoid having to carry out compensatory processing, the defined areas each can surround regularly distributed pixel positions.
  • the microprocessor 13 controls the image-capturing device 6 in such a manner that the one pixel value read out per cluster area 21 represents an integral of the signal generated in one of the pixel cells 7 that lie within the cluster area 21 .
  • This embodiment has the virtue that it can be used with any type of image-capturing device 6 .
  • the image-capturing device 6 has the capability to “bin” the outputs of multiple pixel cells.
  • the microprocessor 13 directs the image-capturing device 6 to generate an array of pixel values (each value being associated with one of the defined cluster areas 21 ) in such a manner that each pixel value is representative of the integral of the sum of the signals generated by at least two device in pixel cells that occupy the same defined cluster area 21 .
  • this could mean that the pixel value for one cluster area 21 is the sum, or alternatively the average, of the integrals of the signal generated by all nine of the shown pixel cells 7 a - 7 i.
  • This embodiment is advantageous, because it increases the sensitivity.
  • each pixel value represents the amount of light that fell on the whole of a defined cluster area 21 , instead of just on the area occupied by one pixel cell 7 .
  • SNR Signal-to-Noise-Ratio
  • the binning capability is a function of the image-capturing device that is implemented in hardware, it does not add appreciably to the read out time.
  • the number of image frames that are captured at the highest resolution is equal to, but in some cases lower than, the number of image frames captured at lower spatial resolutions. A combined final image formed on the basis of such a series of image frames will have a good SNR.
  • the microprocessor 13 upon receiving a command from a user to capture an image, controls the digital camera 1 to carry out a series of steps 22 - 25 .
  • the command is alternatively received from a device (not shown) connected to the digital camera 1 through a suitable interface. This device issues an external trigger to start the execution of the illustrated steps.
  • a user of the digital camera 1 may input a desired exposure time for a combined final image, together with settings determining the amount of flash light, the diameter of aperture 4 and the sensitivity of the photodevices in the pixel cells 7 .
  • the microprocessor determines one or more of these values automatically, using a signal output by the exposure metering device 20 , and possibly one or more pre-defined combinations of values.
  • the microprocessor 13 upon receiving a command actually to capture the combined final image, executes a first step 22 of capturing a number of image frames.
  • This step 22 comprises retrieving the desired exposure time for the combined final image, determining the number of image frames to be captured and, for each image frame, calculating exposure settings determining an exposure level applicable to the image frame.
  • the settings include the exposure time interval for the frame. In some cases, the other settings are determined such as to result in exposure time intervals for the image frames that, together, are shorter than the desired exposure time for the combined final image. It is noted that the embodiment in which “binning” is carried out allows a reduction in the exposure time interval applicable to the image frames, because binning increases the sensitivity.
  • the microprocessor 13 advantageously takes account of this. It calculates the length of the exposure time interval applicable to the image frame at a lower spatial resolution value in dependence on the spatial resolution value, i.e. the amount of ‘binning’.
  • the microprocessor 13 When calculating the settings determining the exposure levels applicable to the image frames, the microprocessor 13 preferably implements one or more of the methods outlined in international patent application PCT/EP04/051080. That is, they are calculated such that the total exposure level that is determined as desirable for the combined final image is unevenly distributed over the image frames.
  • PCT/EP04/051080 The passages in that application relating to the stepping of exposure levels are hereby incorporated by reference, and recapitulated briefly.
  • the exposure level is determined by the exposure time, aperture, (flash) lighting intensity, and the amplifier gain in a pixel cell. It is further determined by the A/D conversion threshold of the A/D converter 10 . Stepping the amplification used to amplify an output of the photodevice in each pixel cell 7 has the advantage of easy implementation.
  • the exposure time for image frames of the same resolution is varied.
  • the maximum intensity of light admitted onto the photosensitive area is varied per image frame, for example by adjusting the size of the aperture 4 , or the intensity of the flash controlled through the flash driver circuit 18 .
  • the size of the aperture 4 are kept constant between exposures.
  • the desired exposure time for the combined final image is unevenly distributed over the image frames.
  • the number of image frames is selected to keep the exposure time interval for each image frame below a certain threshold level. For instance, this threshold level is pre-determined at 1/60 second, as this is considered the lowest shutter speed to capture a steady image for the average photographer.
  • the exposure time is varied randomly between frames.
  • settings of the image capturing system in this case the exposure time, are adjusted before several further captures of a frame in such a manner that at least a maximum of the scale on which intensity values for each pixel are recorded changes substantially uniformly in value with each adjustment. This has the advantage of resulting in a more accurate capture of the colour and tonal depth in the combined final image.
  • the impact on the exposure level is taken into account.
  • the size of the aperture 4 is adjusted between two successive captures of an image frame in such a manner that at least a maximum of the scale on which intensity values for each pixel are recorded changes substantially uniformly in value with each adjustment.
  • the exposure level is stepped down in equal increments by adjusting the aperture area. If no binning is applied, then the aperture area is stepped down in equal increments. Otherwise it is scaled with the multiplication factor resulting from basing each pixel value on the signals from multiple pixel cells.
  • the intensity of artificial light used to illuminate a scene to which the image-capturing device 6 is exposed is decreased in steps. Where the resolution decreases simultaneously, the intensity of artificial light is decreased by increasing amounts.
  • the arrays of pixel values encoding the image frames are cached in a second step 23 . Following the second step 23 , they are aligned and processed in a third step 24 . The combined final image resulting from the third step is stored in storage device 12 in a final step 25 .
  • the third and fourth steps 24 , 25 could be carried out in a separate image processing system, for example a personal computer or workstation. In that case, the second step would involve committing the generated arrays of pixel values to storage in the storage device 12 or transferring them to the computer via a data link (not shown).
  • arrays of intensity values are obtained as input.
  • the arrays of intensity values encode light intensity values at each of a respective number of pixel positions in the respective image frame, the number determining the spatial resolution of the image frame concerned.
  • a set of derived arrays of intensity values is generated, each derived array being based on a respective one of the obtained arrays of intensity levels and encoding light intensity levels at each of a common number of pixel positions in at least a region of overlap of the respective image frames.
  • the derived arrays encode the image frame in the space domain; in the second embodiment, the derived arrays encode the image frame in the spatial frequency domain.
  • the term ‘derived array’ is not intended to signify that an array of values is stored as a data construct in memory. It is sufficient that corresponding elements of a notional array are available for summation at a certain point in time. Thus, each i th element of each derived array should be available concurrently. This allows for the generation of an array of combined intensity values, in which each i th element is based on a sum—which may be a weighted sum—of the i th elements of the derived arrays. The values of the latter represent intensity values in the space or spatial frequency domain, as the case may be.
  • the derived arrays may correspond fully to the obtained arrays. This would be the case if the obtained arrays are already in the right domain for summation, and encode respective image frames that are already aligned, for instance. Both embodiments further have in common that an array of intensity values encoding the combined final image is provided as output, this array being based on the array of combined intensity values obtained by summation. In some embodiments, it is actually identical to the array of combined intensity values.
  • the set of captured image frames is converted in a set of adjusted image frames encoded by a corresponding set of arrays of pixel values.
  • each pixel value in an array of intensity values encoding a captured image frame represents a light level in an area 21 surrounding one of a number of pixel positions. The number of pixel positions is proportional to the spatial resolution of the image frame, because the sizes of the respective image frames are the same.
  • Each array of intensity values derived subsequently encodes an adjusted image frame based on one of the captured image frames. Each is generated in such a manner that each encodes at least a region of an adjusted frame at a desired resolution that is the same for each of the derived arrays.
  • the region may correspond to the entire image frame, incidentally.
  • Each array encoding an adjusted image frame is generated in such a manner that corresponding pixel values encoding the region in the arrays represent respective light level in an area surrounding substantially the same pixel position. That is to say, the i th pixel value of the pixel values of each array that encode the same region of interest corresponds to the same pixel position in each array for all values of i corresponding to a pixel position in the region of interest.
  • the spatial resolution of at least one of them must be adjusted by a multiplication factor, at least in the region of interest. Otherwise, it would not be possible to achieve the characteristic that each array of pixel values encoding an adjusted frame encodes at least the region of interest at the same spatial resolution.
  • the resolution of the lower-resolution frames is increased. This results in a combined final image with the highest possible perceived spatial resolution when the pixel values encoding the region are summed to form the combined final image. Any known technique to increase the spatial resolution may be applied, for instance interpolation.
  • each element in this array is the sum of the corresponding elements of the derived arrays.
  • the sum is a weighted sum.
  • the weights may be inversely related to the exposure times of the image frames.
  • each combined pixel value is an average of the corresponding pixel values. The thus formed array is provided as output.
  • FIGS. 4A-4C A second embodiment of the method of forming a combined final image is illustrated in FIGS. 4A-4C .
  • a first array 26 of pixel values encodes light intensity levels at each of a respective number of pixel positions in a first image frame. Each intensity value represents a light level in an area surrounding a pixel position. The same is true for a second array 27 of pixel values, encoding a second image frame.
  • the first and second image frames represent the same captured scene. It will be assumed herein that the image frames encoded by the first and second arrays 26 , 27 have previously been aligned. There are known methods for aligning images to sub-pixel resolution, for example using sample points.
  • the first array 26 of pixel values is divided into four blocks 28 - 31 .
  • the second array 27 of pixel values is divided into the same number of blocks 32 - 35 .
  • a first block 28 in the first array 26 corresponds to a first block 32 in the second array 27 , i.e. represents a substantially overlapping section of the respective image frame.
  • a second block 29 in the first array 26 corresponds to a second block 33 in the second array
  • a third block 30 corresponds to a third block 34 and a fourth block 31 to a fourth block 35 in the second array 27 .
  • Each of the blocks 32 - 35 in the second array 27 will be proportionally smaller in terms of the number of pixel values comprised therein than the corresponding one of the blocks 28 - 31 in the first array 26 .
  • the low-resolution image frame is represented by the second array 27 comprising blocks of 2 ⁇ 2 pixel values
  • the high-resolution image frame is represented by the first array 26 , having 8 ⁇ 8 pixel values per block 28 - 31 . Only the pixel values in the first blocks 28 , 32 are shown in FIG. 4A .
  • a discrete cosine transform into the spatial frequency domain is performed on a block-by-block basis.
  • a first array 36 of DCT coefficients ( FIG. 4B ) is obtained by performing the DCT on the first array 26 representing the first image frame in the space domain.
  • a second array 37 of DCT coefficients is obtained by performing a DCT on the second array 27 .
  • the first array 36 and second array 37 of DCT coefficients encode light intensity levels at each of a respective number of pixel positions in the respective image frame, only then in the spatial frequency domain. The number of DCT coefficients determines the spatial resolution.
  • each derived array represents light intensity levels at each of a common number of pixel positions in the first and second image frames.
  • each derived array comprises four elements.
  • an array 40 of DCT coefficients encoding a combined image (in the spatial frequency domain) is generated.
  • the array 40 is also divided into four blocks 41 - 44 .
  • a first block 41 is based on the first blocks 28 , 32 , a second block 42 on the second blocks 29 , 33 , a third block 43 on the third blocks 30 , 34 , and a fourth block 44 is based on the values in the fourth blocks 31 , 35 .
  • Four DCT coefficients 45 a - d represent the lowest frequency components of the section of the combined final image encoded by the first block 41 .
  • the combined final image is encoded at a higher resolution than the image frame represented by the second array 27 of pixel values.
  • the spatial resolution of the combined final image corresponds to that of the first image frame. In alternative embodiments, it has a value in between that of the first and second image frames.
  • FIGS. 4A-4C has a number of features that make implementation in the digital camera 1 attractive. There is no need to scale up the second array 27 of pixel values to the same number of pixel values as the first array 26 .
  • the interpolation that is thus avoided is particularly processing intensive, requiring a relatively powerful microprocessor 13 .
  • the number of additions required to carry out summation of intensity values is also relatively limited, as only the derived arrays of DCT coefficients 38 a - d, 39 a - d are added. Nevertheless, the combined final image is encoded at a resolution that is higher than that at which the low-resolution images on which it is based are encoded. This is the case because it is based on a sufficient number of the pixel values in the first array 26 .
  • the transformation into the spatial frequency domain is carried out by using the co-processor 15 .
  • the co-processor 15 comprises an implementation in hardware of an image compression algorithm, for example to generate JPEG-compressed images.
  • the microprocessor 13 is thus spared from having to compute the DCT coefficients in the first and second arrays 36 , 37 .
  • the co-processor 15 converts the first and second arrays 26 , 27 to the JPEG-format, whereupon the array of combined intensity values is generated.
  • the co-processor 15 returns the DCT coefficients, with the microprocessor 13 carrying out the remaining steps in the method.
  • the DCT coefficients are obtained by passing a null coefficient table for the entropy coding that is normally part of the image compression algorithm.
  • each derived array encoding an adjusted image frame is generated in such a manner that corresponding intensity values encoding the region in the arrays represent light levels in an area surrounding the same pixel position
  • alignment using one or more of the methods outlined in PCT/EP04/051080 is advantageously applied. This applies equally to both embodiments of the combination method presented above. Relevant passages of that document are herein incorporated by reference.
  • the step of alignment precedes the summation step in both embodiments illustrated herein. In the second embodiment, it generally precedes also the transformation into the spatial frequency domain.
  • the arrays of intensity values encoding the region in the adjusted image frames could still be said to have the property that they encode light levels in areas surrounding substantially the same one of a number of pixel positions, only the degree of correspondence in pixel position is slightly less due to the effect of camera shake.
  • the combined final image is formed. This is done by forming an array of pixel values encoding the region in a combined final image, such that each pixel value in the formed array is the sum of the corresponding pixel values in the arrays of pixel values encoding the region in the adjusted image frames.
  • FIG. 5 which also illustrates the advantageous effects of a noise shaping technique that can be used.
  • the dashed line surrounding a left-most area 46 delimits the boundaries of the range of frequency information contained in the binned, lower-resolution image, as well as indicating the noise level.
  • the dashed and dotted line surrounding a right-most area 47 does the same for a higher resolution image to which a high-pass digital filter has been applied.
  • the digital high-pass filter may be applied prior to adjustment of the spatial resolution and/or alignment, or subsequent thereto.
  • a continuous curve 48 representing the sensitivity of the eye of a human (or animal for that matter), demonstrates that the noise level of the higher-resolution image frame at lower frequencies would have been perceptible.
  • the noise shaping achieved by means of capturing separate low-resolution image frames and high-resolution image frames and by subjecting the latter to a high-pass filter results in a combined final image with an acceptable noise level at all spatial frequencies.
  • the invention is not limited to the embodiments described above, which may be varied within the scope of the attached claims.
  • the number of different levels of spatial resolution employed to capture the image frames for one combined final image can be two or higher.
  • High-pass filtering and summation of pixel values may be carried out in an image processing system external to the digital camera 1 .
  • all steps prior to the actual summation of pixel values to form the array of pixel values encoding the combined final image may be carried out in the digital camera.
  • Such adjusted image frames are then stored in the digital camera 1 for subsequent transfer to a computer or other image processing system.
  • the gain of an amplifier between the output of the image capturing device (CCD or CMOS) and the A/D converter can be set very high. This results in an image with visible noise.
  • the exposure is “correct”, but the image has a lower quality than would be the case with a slower exposure.
  • the methods outlined above improve the image quality in such an embodiment

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computing Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Studio Devices (AREA)
  • Transforming Light Signals Into Electric Signals (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
US11/913,819 2005-05-10 2005-05-10 Method of Controlling an Image Capturing System, Image Capturing System and Digital Camera Abandoned US20080165258A1 (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/EP2005/052121 WO2006119802A1 (en) 2005-05-10 2005-05-10 Method of controlling an image capturing system, image capturing system and digital camera

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2005/052121 A-371-Of-International WO2006119802A1 (en) 2005-05-10 2005-05-10 Method of controlling an image capturing system, image capturing system and digital camera

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US13/052,333 Division US8619156B2 (en) 2005-05-10 2011-03-21 Image capturing system and method of controlling the same utilizing exposure control that captures multiple images of different spatial resolutions

Publications (1)

Publication Number Publication Date
US20080165258A1 true US20080165258A1 (en) 2008-07-10

Family

ID=34980093

Family Applications (2)

Application Number Title Priority Date Filing Date
US11/913,819 Abandoned US20080165258A1 (en) 2005-05-10 2005-05-10 Method of Controlling an Image Capturing System, Image Capturing System and Digital Camera
US13/052,333 Expired - Fee Related US8619156B2 (en) 2005-05-10 2011-03-21 Image capturing system and method of controlling the same utilizing exposure control that captures multiple images of different spatial resolutions

Family Applications After (1)

Application Number Title Priority Date Filing Date
US13/052,333 Expired - Fee Related US8619156B2 (en) 2005-05-10 2011-03-21 Image capturing system and method of controlling the same utilizing exposure control that captures multiple images of different spatial resolutions

Country Status (6)

Country Link
US (2) US20080165258A1 (de)
EP (2) EP1883902B1 (de)
JP (1) JP4838302B2 (de)
CN (1) CN101203884B (de)
AT (1) ATE519180T1 (de)
WO (1) WO2006119802A1 (de)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080192064A1 (en) * 2007-02-08 2008-08-14 Li Hong Image apparatus with image noise compensation
US20090160937A1 (en) * 2007-12-21 2009-06-25 Seung Nam Son Camera control method for vehicle entramce control system
US20100289745A1 (en) * 2009-05-14 2010-11-18 Avago Technologies Ecbu Ip (Singapore) Pte. Ltd. System and method for automatically adjusting light source drive current during optical navigation operation
US20120274814A1 (en) * 2005-10-12 2012-11-01 Active Optics Pty Limited Method of forming an image based on a plurality of image frames, image processing system and digital camera
US20140218553A1 (en) * 2009-08-31 2014-08-07 Intellectual Ventures Fund 83 Llc Using captured high and low resolution images
US9204143B2 (en) 2013-03-15 2015-12-01 Samsung Electronics Co., Ltd. Image sensor, operation method thereof, and system including the same
US20170272630A1 (en) * 2016-03-16 2017-09-21 Canon Kabushiki Kaisha Flash band determination device for detecting flash band, method of controlling the same, storage medium, and image pickup apparatus
US20170294033A1 (en) * 2016-04-06 2017-10-12 Varex Imaging Corporation Dose efficient x-ray detector and method
CN111164670A (zh) * 2017-08-10 2020-05-15 罗伯特·博世有限公司 低功率和低数据速率成像仪
US11159736B2 (en) * 2017-06-27 2021-10-26 Conti Temic Microelectronic Gmbh Camera device and method for capturing a region surrounding a vehicle in a surroundings-adapted manner

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2006119802A1 (en) 2005-05-10 2006-11-16 Andrew Augustine Wajs Method of controlling an image capturing system, image capturing system and digital camera
JP4991602B2 (ja) * 2008-03-07 2012-08-01 富士フイルム株式会社 撮像装置
US8963949B2 (en) * 2009-04-22 2015-02-24 Qualcomm Incorporated Image selection and combination method and device
WO2010149844A1 (en) 2009-06-24 2010-12-29 Nokia Corporation Device and method for processing digital images captured by a binary image sensor
JP2015088786A (ja) * 2013-10-28 2015-05-07 キヤノン株式会社 撮像装置、撮像システム、撮像装置の制御方法、撮像システムの制御方法、及びプログラム
JP6289184B2 (ja) * 2014-03-14 2018-03-07 オリンパス株式会社 画像認識装置および画像認識方法
EP3416307B1 (de) * 2017-06-12 2022-07-27 STMicroelectronics (Research & Development) Limited Fahrzeugkommunikation mit sichtbarer lichtkommunikation
US11284011B2 (en) * 2017-09-11 2022-03-22 Signify Holding B.V. Detecting coded light with rolling-shutter cameras
US20230262322A1 (en) * 2020-10-22 2023-08-17 Qualcomm Incorporated Mechanism for improving image capture operations
DE102020129908A1 (de) * 2020-11-12 2022-05-12 Mekra Lang Gmbh & Co. Kg Indirektes Schichtsystem und Verfahren zum Anpassen einer Bildwiederholungsrate
US11252337B1 (en) * 2020-12-29 2022-02-15 Himax Imaging Limited Method and apparatus of performing automatic exposure control for image sensor with context switching

Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5025394A (en) * 1988-09-09 1991-06-18 New York Institute Of Technology Method and apparatus for generating animated images
US5657402A (en) * 1991-11-01 1997-08-12 Massachusetts Institute Of Technology Method of creating a high resolution still image using a plurality of images and apparatus for practice of the method
US6084229A (en) * 1998-03-16 2000-07-04 Photon Vision Systems, Llc Complimentary metal oxide semiconductor imaging device
US20020012065A1 (en) * 2000-04-27 2002-01-31 Ricoh Company, Ltd Exposure control apparatus and method thereof
US20020060744A1 (en) * 2000-11-21 2002-05-23 Akira Fukushima Iris control method and apparatus for television camera for controlling iris of lens according to video signal, and television camera using the same
US20030108252A1 (en) * 2001-12-11 2003-06-12 James J. Carrig Resolution enhancement for images stored in a database
US6590198B1 (en) * 1998-03-16 2003-07-08 Photon Vision Systems, Inc. Video bus for high speed multi-resolution imagers
US6750903B1 (en) * 1998-03-05 2004-06-15 Hitachi, Ltd. Super high resolution camera
US20040160525A1 (en) * 2003-02-14 2004-08-19 Minolta Co., Ltd. Image processing apparatus and method
US20050013509A1 (en) * 2003-07-16 2005-01-20 Ramin Samadani High resolution image reconstruction
US7502053B2 (en) * 2005-07-29 2009-03-10 Japan Science And Technology Agency Information-processing device and information-processing system

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4647975A (en) * 1985-10-30 1987-03-03 Polaroid Corporation Exposure control system for an electronic imaging camera having increased dynamic range
CA2055867C (en) 1990-11-22 1998-06-09 Canon Kabushiki Kaisha Image pick up device
JPH04207581A (ja) * 1990-11-30 1992-07-29 Canon Inc 撮像装置
US5929908A (en) * 1995-02-03 1999-07-27 Canon Kabushiki Kaisha Image sensing apparatus which performs dynamic range expansion and image sensing method for dynamic range expansion
US6429895B1 (en) * 1996-12-27 2002-08-06 Canon Kabushiki Kaisha Image sensing apparatus and method capable of merging function for obtaining high-precision image by synthesizing images and image stabilization function
US6639626B1 (en) * 1998-06-18 2003-10-28 Minolta Co., Ltd. Photographing apparatus with two image sensors of different size
US7038716B2 (en) * 1999-07-30 2006-05-02 Pixim, Inc. Mobile device equipped with digital image sensor
JP4554094B2 (ja) * 2001-01-26 2010-09-29 オリンパス株式会社 撮像装置
US7298402B2 (en) 2000-10-26 2007-11-20 Olympus Corporation Image-pickup apparatus with expanded dynamic range capabilities
WO2003047234A2 (en) * 2001-11-30 2003-06-05 Yissum Research Development Company Of The Hebrew University Of Jerusalem System and method for providing multi-sensor super-resolution
EP1518333A2 (de) * 2002-03-25 2005-03-30 The Trustees of Columbia University in the city of New York Verfahren und system zur verbesserung der datenqualität
JP4207581B2 (ja) 2002-11-06 2009-01-14 日立化成デュポンマイクロシステムズ株式会社 耐熱感光性樹脂組成物、レリーフパターンの製造方法及び電子部品
WO2005122084A1 (en) 2004-06-09 2005-12-22 Active Optics Pty Ltd. Method of motion correction in sequence of images
JP3988760B2 (ja) * 2004-08-17 2007-10-10 松下電器産業株式会社 固体撮像装置
WO2006119802A1 (en) 2005-05-10 2006-11-16 Andrew Augustine Wajs Method of controlling an image capturing system, image capturing system and digital camera

Patent Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5025394A (en) * 1988-09-09 1991-06-18 New York Institute Of Technology Method and apparatus for generating animated images
US5657402A (en) * 1991-11-01 1997-08-12 Massachusetts Institute Of Technology Method of creating a high resolution still image using a plurality of images and apparatus for practice of the method
US6750903B1 (en) * 1998-03-05 2004-06-15 Hitachi, Ltd. Super high resolution camera
US6084229A (en) * 1998-03-16 2000-07-04 Photon Vision Systems, Llc Complimentary metal oxide semiconductor imaging device
US20020134911A1 (en) * 1998-03-16 2002-09-26 Zarnowski Jeffrey J. Method and apparatus for independent readout and reset of pixels within a CMOS image sensor
US6590198B1 (en) * 1998-03-16 2003-07-08 Photon Vision Systems, Inc. Video bus for high speed multi-resolution imagers
US20020012065A1 (en) * 2000-04-27 2002-01-31 Ricoh Company, Ltd Exposure control apparatus and method thereof
US20020060744A1 (en) * 2000-11-21 2002-05-23 Akira Fukushima Iris control method and apparatus for television camera for controlling iris of lens according to video signal, and television camera using the same
US20030108252A1 (en) * 2001-12-11 2003-06-12 James J. Carrig Resolution enhancement for images stored in a database
US20040160525A1 (en) * 2003-02-14 2004-08-19 Minolta Co., Ltd. Image processing apparatus and method
US20050013509A1 (en) * 2003-07-16 2005-01-20 Ramin Samadani High resolution image reconstruction
US7502053B2 (en) * 2005-07-29 2009-03-10 Japan Science And Technology Agency Information-processing device and information-processing system

Cited By (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120274814A1 (en) * 2005-10-12 2012-11-01 Active Optics Pty Limited Method of forming an image based on a plurality of image frames, image processing system and digital camera
US8624923B2 (en) * 2005-10-12 2014-01-07 Silvercrest Investment Holdings Limited Method of forming an image based on a plurality of image frames, image processing system and digital camera
US7889207B2 (en) * 2007-02-08 2011-02-15 Nikon Corporation Image apparatus with image noise compensation
US20080192064A1 (en) * 2007-02-08 2008-08-14 Li Hong Image apparatus with image noise compensation
US20090160937A1 (en) * 2007-12-21 2009-06-25 Seung Nam Son Camera control method for vehicle entramce control system
US20100289745A1 (en) * 2009-05-14 2010-11-18 Avago Technologies Ecbu Ip (Singapore) Pte. Ltd. System and method for automatically adjusting light source drive current during optical navigation operation
US8537109B2 (en) * 2009-05-14 2013-09-17 Avago Technologies General Ip (Singapore) Pte. Ltd. System and method for automatically adjusting light source drive current during optical navigation operation
US9955071B2 (en) 2009-08-31 2018-04-24 Monument Peak Ventures, Llc Using captured high and low resolution images
US20140218553A1 (en) * 2009-08-31 2014-08-07 Intellectual Ventures Fund 83 Llc Using captured high and low resolution images
US9407818B2 (en) * 2009-08-31 2016-08-02 Intellectual Ventures Fund 83 Llc Using captured high and low resolution images
US9661218B2 (en) 2009-08-31 2017-05-23 Monument Peak Ventures, Llc Using captured high and low resolution images
US9204143B2 (en) 2013-03-15 2015-12-01 Samsung Electronics Co., Ltd. Image sensor, operation method thereof, and system including the same
US20170272630A1 (en) * 2016-03-16 2017-09-21 Canon Kabushiki Kaisha Flash band determination device for detecting flash band, method of controlling the same, storage medium, and image pickup apparatus
US10187559B2 (en) * 2016-03-16 2019-01-22 Canon Kabushiki Kaisha Flash band determination device for detecting flash band, method of controlling the same, storage medium, and image pickup apparatus
US10594912B2 (en) 2016-03-16 2020-03-17 Canon Kabushiki Kaisha Flash band determination device for detecting flash band, method of controlling the same, storage medium, and image pickup apparatus
US20170294033A1 (en) * 2016-04-06 2017-10-12 Varex Imaging Corporation Dose efficient x-ray detector and method
US11159736B2 (en) * 2017-06-27 2021-10-26 Conti Temic Microelectronic Gmbh Camera device and method for capturing a region surrounding a vehicle in a surroundings-adapted manner
CN111164670A (zh) * 2017-08-10 2020-05-15 罗伯特·博世有限公司 低功率和低数据速率成像仪

Also Published As

Publication number Publication date
CN101203884A (zh) 2008-06-18
EP1883902A1 (de) 2008-02-06
CN101203884B (zh) 2010-12-29
US20110228139A1 (en) 2011-09-22
EP2273777A2 (de) 2011-01-12
EP1883902B1 (de) 2011-08-03
JP2008541584A (ja) 2008-11-20
EP2273777A3 (de) 2011-03-02
ATE519180T1 (de) 2011-08-15
JP4838302B2 (ja) 2011-12-14
WO2006119802A1 (en) 2006-11-16
US8619156B2 (en) 2013-12-31

Similar Documents

Publication Publication Date Title
US8619156B2 (en) Image capturing system and method of controlling the same utilizing exposure control that captures multiple images of different spatial resolutions
US7548689B2 (en) Image processing method
CN101816171B (zh) 用于增强图像动态范围的多重曝光模式
US8896712B2 (en) Determining and correcting for imaging device motion during an exposure
KR101205842B1 (ko) 복수 개의 이미지 프레임들에 기초하여 이미지를 형성하기위한 방법, 이미지 처리 시스템, 및 디지털 카메라
KR101348262B1 (ko) 복수 개의 이미지 프레임들을 기초로 하여 결합 이미지를형성하기 위한 방법
US5745808A (en) Camera exposure control system using variable-length exposure tables
JP4424292B2 (ja) 撮像装置、露出制御方法およびプログラム
US8582814B2 (en) Image processing method and system
US6882754B2 (en) Image signal processor with adaptive noise reduction and an image signal processing method therefor
JPWO2006049098A1 (ja) イメージセンサ
JP2002064754A (ja) 撮像装置の有効ダイナミックレンジを拡張する方法及び装置
WO2019187901A1 (ja) 撮像装置、撮像方法、およびプログラム
US20070139530A1 (en) Auto-Adatpvie Frame Rate for Improved Light Sensitivity in a Video System
JP2011100204A (ja) 画像処理装置、画像処理方法、画像処理プログラム、撮像装置及び電子機器
JP5144739B2 (ja) 画像取り込みシステムを制御する方法、画像取り込みシステム、および、デジタルカメラ
JP4814749B2 (ja) 固体撮像装置

Legal Events

Date Code Title Description
AS Assignment

Owner name: ACTIVE OPTICS PTY. LTD., AUSTRALIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:WAJS, ANDREW AUGUSTINE;REEL/FRAME:022954/0405

Effective date: 20090119

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION