CN101662593B - Image pickup apparatus, image pickup method - Google Patents

Image pickup apparatus, image pickup method Download PDF

Info

Publication number
CN101662593B
CN101662593B CN2009101601974A CN200910160197A CN101662593B CN 101662593 B CN101662593 B CN 101662593B CN 2009101601974 A CN2009101601974 A CN 2009101601974A CN 200910160197 A CN200910160197 A CN 200910160197A CN 101662593 B CN101662593 B CN 101662593B
Authority
CN
China
Prior art keywords
signal
image
frame
memory
exposure
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN2009101601974A
Other languages
Chinese (zh)
Other versions
CN101662593A (en
Inventor
大槻博树
Original Assignee
Sony Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Corp filed Critical Sony Corp
Publication of CN101662593A publication Critical patent/CN101662593A/en
Application granted granted Critical
Publication of CN101662593B publication Critical patent/CN101662593B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70Circuitry for compensating brightness variation in the scene
    • H04N23/73Circuitry for compensating brightness variation in the scene by influencing the exposure time
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/60Noise processing, e.g. detecting, correcting, reducing or removing noise
    • H04N25/63Noise processing, e.g. detecting, correcting, reducing or removing noise applied to dark current
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/60Noise processing, e.g. detecting, correcting, reducing or removing noise
    • H04N25/67Noise processing, e.g. detecting, correcting, reducing or removing noise applied to fixed-pattern noise, e.g. non-uniformity of response

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Studio Devices (AREA)
  • Transforming Light Signals Into Electric Signals (AREA)

Abstract

The invention discloses an image pickup apparatus, an image pickup method, a program and a recording medium. The image pickup apparatus includes a frame operation unit configured to perform addition to or subtraction from a frame and a storage unit configured to store a result of an operation performed by the frame operation unit. A data bus including two channels, one for writing to the storage unit and the other for reading from the storage unit, is provided between the frame operation unit and the storage unit.

Description

Image-pickup device and image acquisition method
Technical field
The present invention relates to image-pickup device, image acquisition method, program and recording medium.Particularly, the present invention relates to preferably be applied to image-pickup device, image acquisition method, program and the recording medium of the processing relevant with multiexposure, multiple exposure (multiple exposure).
Background technology
Exist a kind of shooting technology that is called as multiexposure, multiple exposure with in the camera that is used in pickup image.In multiexposure, multiple exposure, single frame by multiexposure, multiple exposure in single object or the corresponding light of a plurality of object, and a plurality of image is applied to produce combination image.Particularly, in the multiexposure, multiple exposure that uses slow shutter or Bulb shutter, have a long time for exposure was taken pictures, multiexposure, multiple exposure had realized having taking pictures of the scene at night, fireworks of height artistry effect etc.
In using the film camera of film as recording medium, it is that the multi-pass operation shutter is realized under the situation of film winding operation not that multiexposure, multiple exposure is taken pictures.In recent widely used digital picture capturing apparatus such as Digital Still Camera and digital camera, multiexposure, multiple exposure is not that the same treatment that adopts in utilization and the film camera realizes.Yet, similar with film camera, be necessary to make the digital picture capturing apparatus to have the multiexposure, multiple exposure function, and this digital picture capturing apparatus become and can buy gradually.
In order in the digital picture capturing apparatus, to realize the multiexposure, multiple exposure function, be necessary to preserve a plurality of images to generate combination image.The a large amount of capacity storage equipment of this preservation action need (for example being used to preserve the memory of a plurality of images), this has caused increasing the size and the cost of image-pickup device.Particularly, along with the recent tendency of pixel count increase and image capture device miniaturization, this mass-memory unit possibly cause the increase of plant bulk.
In addition, the increase of memory span possibly increase bandwidth of memory.The increase of bandwidth of memory possibly cause and memory-aided other functions are clashed, and this can obviously influence the handling property of the whole system of image-pickup device, the speed of for example taking pictures.
In addition, in having the multiexposure, multiple exposure of long time for exposure since with solid-state image pickup device in increase and the generation of fixed pattern noise of the relevant picture black of so-called dark current, the sensitivity of image capture device possibly reduce and dynamic range reduces.This dark current is to be caused by the electron-hole pair that generates because of semi-conductive thermal excitation.The effect of dark current raises along with temperature and the increase of charge storage time and strengthening.
Japan not substantive examination public announcement of a patent application No.2001-28726 discloses a kind of multiexposure, multiple exposure photographic method.In the method, through from a plurality of images, extracting the corresponding image of difference between master object part and record and two the continuous main image signals, generate main image signal.Therefore, can reduce like this and be used to generate the necessary memory span of combination image.
Summary of the invention
Not in the disclosed above method of substantive examination public announcement of a patent application No.2001-28726, be necessary to provide the autonomous device such as the image acquiring apparatus and the first and second master image save sets in Japan.Thereby, possibly can't realize the miniaturization of whole device, and image extraction processing possibly reduce processing speed.In addition, above method possibly can't solve the problem that the sensitivity reduction relevant with the multiexposure, multiple exposure with long time for exposure and dynamic range reduce.
Consider that above situation has proposed the present invention.Therefore; In the multiexposure, multiple exposure of in the digital picture capturing apparatus such as Digital Still Camera, carrying out, need a kind ofly to be used for the enhancement process performance, to save memory span and bandwidth of memory and suppress the technology that long exposure medium sensitivity reduces and dynamic range reduces simultaneously.
According to embodiments of the invention; When through with single frame multiexposure, multiple exposure when generating combination image from the light of single body or a plurality of objects and a plurality of images that superpose, image-pickup device comprises the frame operating means and the storage device that is configured to the operating result of storage frame operating means that is configured to frame is carried out addition or subtraction.In image-pickup device, comprise that the data/address bus of two passages is arranged between frame operating means and the storage device, a passage is used to be written to storage device, and another passage is used for reading from storage device.
In the image-pickup device according to the embodiment of the invention, the frame operating means can comprise the offset minus subtraction unit, is configured to from the signal of image capture device, deduct predetermined shifted signal from providing.
In image-pickup device according to the embodiment of the invention; Between the saturated exposure period before of output signal level of image capture device, carry out the operation of reading signal, and the offset minus subtraction unit can be carried out the operation that from the signal of image capture device, deducts the shifted signal component from reading from the image capture device.
In image-pickup device according to the embodiment of the invention; Provide signal from the raw data format of frame operating means to be compressed then and be stored in the storage device, and provide compressed signal from storage device to be extracted to be condensed to raw data format and be provided for the frame operating means then.
In the image-pickup device according to the embodiment of the invention, in frame addition and frame subtraction, the frame operating means can be carried out the frame operational processes with the image that reads from the image capture device side by side reading from storage device.
In image-pickup device according to the embodiment of the invention; When through with single frame multiexposure, multiple exposure when generating combination image from the light of single body or a plurality of objects and a plurality of images that superpose; Comprise that (passage is used to be written to storage device to two passages; Another passage is used for reading from storage device) data/address bus be arranged between frame operating means and the storage device; Wherein the frame operating means is configured to frame is carried out addition or subtraction, and storage device is configured to store the result of the operation of being carried out by the frame operating means.
According to embodiments of the invention; A kind of image acquisition method that is used for image-pickup device is disclosed; This image-pickup device comprises the image capture device at least, be configured to store from the storage device of the signal of image capture device and be configured to be used to from the signal of image capture device and be stored in the operating means of the signal executable operations in the storage device; This method may further comprise the steps: storage signal in storage device, this signal are when the image of predetermined object is absorbed, to obtain from the image capture device; When from another signal of image capture device acquisition, operating means reads the signal that is stored in the storage device, and another signal is added to the signal in the storage device that is stored in that is read, and addition result is stored in the storage device; After the phase add operation is repeated pre-determined number; Operating means obtains the black signal from the image capture device; This black signal is to obtain through carrying out with the exposure of identical duration of time for exposure used when obtaining said signal; Read the signal that is stored in the storage device, from this signal, deduct black signal, and subtraction result is stored in the storage device; And repeat this subtraction pre-determined number.
Image acquisition method according to the embodiment of the invention also can comprise the step that from the signal of image capture device, deducts the predetermined migration signal component from providing.
In image acquisition method according to the embodiment of the invention; Between the saturated exposure period before of output signal level of image capture device, carry out the operation of reading signal, and carry out from reading the operation that from the signal of image capture device, deducts the shifted signal component from the image capture device.
In addition; A kind of computer-readable program that makes that image-pickup device is carried out and handled is disclosed; This image-pickup device comprises the image capture device at least, be configured to store from the storage device of the signal of image capture device and be configured to be used to from the signal of image capture device and be stored in the operating means of the signal executable operations in the storage device; This processing may further comprise the steps: storage signal in storage device, this signal are when the image of predetermined object is absorbed, to obtain from the image capture device; When from another signal of image capture device acquisition, operating means reads the signal that is stored in the storage device, and another signal is added to the signal in the storage device that is stored in that is read, and addition result is stored in the storage device; After the phase add operation is repeated pre-determined number; Operating means obtains the black signal from the image capture device; This black signal is to obtain through carrying out with the exposure of identical duration of time for exposure used when obtaining said signal; Read the signal that is stored in the storage device, from this signal, deduct black signal, and subtraction result is stored in the storage device; And repeat this subtraction pre-determined number.
In addition; Disclosing a kind of record makes image-pickup device carry out the recording medium of the computer-readable program of handling; This image-pickup device comprises the image capture device at least, be configured to store from the storage device of the signal of image capture device and be configured to be used to from the signal of image capture device and be stored in the operating means of the signal executable operations in the storage device; This processing may further comprise the steps: storage signal in storage device, this signal are when the image of predetermined object is absorbed, to obtain from the image capture device; When from another signal of image capture device acquisition, operating means reads the signal that is stored in the storage device, and another signal is added to the signal in the storage device that is stored in that is read, and addition result is stored in the storage device; After the phase add operation is repeated pre-determined number; Operating means obtains the black signal from the image capture device; This black signal is to obtain through carrying out with the exposure of identical duration of time for exposure used when obtaining said signal; Read the signal that is stored in the storage device, from this signal, deduct black signal, and subtraction result is stored in the storage device; And repeat this subtraction pre-determined number.
In image acquisition method and program according to the embodiment of the invention; When from another signal of image capture device acquisition; The signal that provides from the image capture device, when the image of the predetermined object of picked-up, obtain is stored, and the signal that is read is read and be added to institute's signal stored.Resulting signal is deposited back in storage device.After add operation is repeated pre-determined number, obtain black signal, and read the signal that is stored in the storage device, this black signal is that the exposure of identical duration of time for exposure used when carrying out with acquisition from the signal of image capture device obtains.From the signal that reads, deduct black signal, and resulting signal is deposited and is got back to storage device.Subtraction is repeated pre-determined number.Through this processing, generated the multiexposure, multiple exposure image.
According to embodiments of the invention, in the multiexposure, multiple exposure of in the digital picture capturing apparatus such as Digital Still Camera, carrying out, can reduce essential memory span and bandwidth of memory.In addition,, the multiexposure, multiple exposure operation of the handling property of enhancing be can realize having, long exposure reduction of medium sensitivity and reducing of dynamic range suppressed simultaneously according to embodiments of the invention.
Description of drawings
Fig. 1 illustrates the multiexposure, multiple exposure configuration of devices according to the embodiment of the invention;
Fig. 2 illustrates the internal configurations of camera signal processing unit;
Fig. 3 illustrates the internal configurations of frame operational processes part;
Fig. 4 A and 4B illustrate dynamic range;
Fig. 5 A to 5C illustrates dynamic range;
Fig. 6 A to 6C illustrates and the processing relevant according to the multiexposure, multiple exposure of prior art;
Fig. 7 A to 7C illustrates and the processing relevant according to the multiexposure, multiple exposure of prior art;
Fig. 8 A illustrates and the processing relevant according to the multiexposure, multiple exposure of prior art with 8B;
Fig. 9 A to 9C illustrates and the processing relevant according to the multiexposure, multiple exposure of the embodiment of the invention;
Figure 10 A illustrates and the processing relevant according to the multiexposure, multiple exposure of the embodiment of the invention with 10B;
Figure 11 illustrates the another kind configuration of multiexposure, multiple exposure equipment;
Figure 12 is the flow chart of diagram by the processing of multiexposure, multiple exposure equipment execution; And
Figure 13 illustrates the Hardware configuration of personal computer.
Embodiment
Below with reference to accompanying drawing the preferred embodiments of the present invention are described.
Fig. 1 illustrates the multiexposure, multiple exposure configuration of devices according to the embodiment of the invention.This multiexposure, multiple exposure equipment can be applied to the digital picture capturing apparatus such as Digital Still Camera and digital camera or be incorporated in this digital picture capturing apparatus.
Multiexposure, multiple exposure equipment shown in Fig. 1 comprises lens 1, motor 2, motor driver 3, diaphragm 4, drive circuit 5, image capture device 6, drive circuit 7, front end (F/E) processor 8, signal processor 9, system controller 10, Memory Controller 11 and memory 12.Signal processor 9 comprises synchronizing signal generation unit 21, camera signal processing unit 22, control operation processing unit 23 and resolution conversion unit 24.
Lens 1 are collected from the light of light source incident and the light that reflects from object.Motor 2 under the control of motor driver 3 by being driven, and the position of regulating lens 1 according to the focal length and the focal position of object.Motor driver 3 is according to operating from the control signal of system controller 10.The magnification ratio that motor driver 3 carries out in response to the user changes and confirms focal length (that is, zoom position), and controls motor 2 according to definite result.
Diaphragm 4 is driven by drive circuit 5.Diaphragm 4 is carried out such as the processing of regulating aperture and so on according to the brightness of object with to definite result of the light quantity (luminous intensity, i.e. exposure) of passing lens 1.The light signal that image capture device 6 utilizes 7 pairs of drive circuits to pass diaphragm 4 is carried out opto-electronic conversion, and downstream unit is exported the charge signal that obtains.Image capture device 6 can be formed by the device such as CCD (charge coupled device) and CMOS (complementary metal oxide semiconductors (CMOS)).
F/E processor 8 carry out such as noise reductions with amplify the processing the charge simulation signal and be digital signal conversion of signals.Although not shown in Fig. 1, F/E processor 8 comprise be used for to input signal sampling and preserve resulting sampled value (sample preservation) CDS (correlated-double-sampling) unit, be used to carry out the automatic gain control unit of processing and amplifying and be used to carry out analog-to-digital A/D (analog/digital) converting unit.Notice that F/E processor 8 can be located on the same plate image sensor architecture that adopts that row AD changes the mechanism etc. to form with image capture device 6.
9 pairs of image signal execution treatment for correcting that converted into digital signal by F/E processor 8 of signal processor.This treatment for correcting depends on lens 1, diaphragm 4, image capture device 6 or the like.Signal processor 9 is carried out the camera control and treatment, and for example AWB (AWB) handles, AE (automatic exposure) handles and AF (automatic focus) handles, to generate and the corresponding picture signal of object (luminance signal and carrier chrominance signal).
Signal processor 9 is made up of synchronizing signal generation unit 21, camera signal processing unit 22, control operation processing unit 23 and resolution conversion unit 24.Synchronizing signal generation unit 21 generation levels and vertical synchronizing signal and various clock signal.Camera signal processing unit 22 is carried out control and treatment according to the control signal of sending here from system controller 10 and is generated and the corresponding picture signal of object.Control operation processing unit 23 is carried out and is used to control the necessary various operational processes of image signal.24 pairs of resolution conversion unit are carried out the processing such as conversion of resolution and distortion correction with the corresponding picture signal of object.
Treated picture signal is transported to the video signal preprocessor (not shown) in signal processor 9, and this video signal preprocessor utilizes the compression scheme such as JPEG (JPEG) and MPEG (Motion Picture Experts Group) to come the carries out image compression.
Transfer of data between Memory Controller 11 control signal processors 9 and the memory 12.Picture signal can be the form (for example, the primary signal of being made up of R (red), G (green) and B (indigo plant), i.e. initial data) of the input signal that comes that provides from image capture device 6, and can be the form of luminance signal and carrier chrominance signal.Memory 12 is the storage devices that for example are used to preserve with the corresponding picture signal of object.
Signal processor 9 can use integrated circuit (hardware) to realize.System controller 10 can use CPU (CPU) to realize.
Fig. 2 is the block diagram of the configuration example of the camera signal processing unit 22 shown in the pictorial image 1.Camera signal processing unit 22 comprises camera signal pretreatment component 41 and camera signal after-treatment components 42.Camera signal pretreatment component 41 comprises frame operational processes part 51.
Camera signal pretreatment component 41 utilizes the various synchronizing signals sent here from synchronizing signal generation unit 21 (Fig. 1) to handle carrying out from the image signal of the picked-up of F/E processor 8.These processing comprise proofreaies and correct shade, noise and picture element flaw, and these defectives depend on lens 1, diaphragm 4 and image capture device 6.Particularly, when the multiexposure, multiple exposure of executive chairman's time for exposure, the frame arithmetic that frame operational processes part 51 is carried out such as frame addition and frame subtraction.
Camera signal after-treatment components 42 generates the picture signal of being made up of luminance signal and carrier chrominance signal according to what handle through camera signal pretreatment component 41 with the corresponding pickup image signal of object.41 outputs of camera signal pretreatment component are from the picture signal of the input signal format (raw data format) of image capture device 6, and the picture signal of camera signal after-treatment components 42 output brightness/chroma signal formats.These output signals are transported to memory 12 (Fig. 1) via Memory Controller 11 (Fig. 1).
Fig. 3 is the block diagram of the configuration example of the frame operational processes part 51 shown in the pictorial image 2.Frame operational processes part 51 comprises skew subtraction part 71, frame addition section 72, frame subtraction part 73 and output signal selection part 74.
Skew subtraction part 71 deducts predetermined shifted signal component from providing from the received image signal of image capture device 6; To suppress because the reduction of sensitivity and reducing of dynamic range that the increase of picture black causes, the increase of this picture black be since especially in long the exposure dark current of generation cause.Skew subtraction part 71 also receives via Memory Controller 11 and is stored in the picture signal in the memory 12, and carries out another subtraction that from the picture signal that is received from memory 12, deducts offset component.The inhibition principle that the dynamic range that is realized by skew subtraction part 71 reduces will be described below.
72 pairs of frame addition section have experienced skew subtraction in the skew subtraction part 71 each (received image signal from image capture device 6 is called as the pickup device received image signal, is called as the memory received image signal from the received image signal of memory 12) from the received image signal of image capture device 6 and memory 12 and have carried out multiexposure, multiple exposure image combined treatment.For the fixed pattern noise that reduces to cause owing to the dark current that in the exposure (long exposure) of long time for exposure, generates, frame subtraction part 73 deducts the black signal of input from image capture device 6 from importing from the image signal of memory.Black signal obtains in the following manner: in the exposure of carrying out the identical duration used with absorbing image, cover the image capture light from object.This processing has reduced the fixed pattern noise that caused by dark current.
Output signal selection part 74 is always divided 71, is selected an output signal in the output signal of frame addition section 72 and frame subtraction part 73 from the subtraction portion that squints, and selected signal is outputed to the downstream unit.
Describe referring now to Fig. 4 A and 4B and Fig. 5 A and 5B and how to utilize skew subtraction part 71 to suppress dynamic range to reduce.Fig. 4 A does not schematically illustrate (not being under long exposure status) under the normal exposure situation and incides the light intensity and the output signal level of image capture device 6.When normal exposure, can realize enough dynamic ranges, because the influence that the picture black that does not cause because of dark current increases.
On the other hand, shown in Fig. 4 B, when long exposure, because dark current causes picture black to increase, and the dynamic range of therefore exporting signal reduces.The reducing of dynamic range in the long exposure carried out the operation of reading signal from image capture device 6 between the exposure period before output signal level is saturated.Then, after the corresponding offset component of the picture black that therefrom deducts Yu increase owing to dark current, the signal that is read is stored in the memory 12.Subsequently, during the exposure of carrying out successive frame (from these frames, having deducted offset component) and addition, read similarly.This processing can fully suppress reducing of dynamic range in the long exposure.
In Fig. 5 A to 5C, schematically illustrate above processing.Fig. 5 A and Fig. 5 B illustrate and the dynamic range of the corresponding output signal of time phase (Fig. 5 A and Fig. 5 B) read of output signal between exposure period.From the output signal, deduct the operation of offset component and carry out frame addition (shown in Fig. 5 C) through carrying out, can obtain the dynamic range of enough output signals, the same wide in this dynamic range and the normal exposure.
To be described in the processing of carrying out in the multiexposure, multiple exposure operation according to the embodiment of the invention below.Before this is described; With the processing of carrying out usually in the multiexposure, multiple exposure operation that is described in according to prior art, to clarify the difference between processing of in multiexposure, multiple exposure, carrying out and the processing of in multiexposure, multiple exposure, carrying out according to prior art according to the embodiment of the invention.
To be described in the processing of carrying out in the multiexposure, multiple exposure according to prior art with reference to figure 6A to Fig. 8 B.Fig. 6 A schematically illustrates the configuration of the camera signal treatment system (multiexposure, multiple exposure equipment) according to prior art.Shown in Fig. 6 A, the camera signal treatment system comprises image capture device 100, camera signal processing unit 101, Memory Controller 102 and memory 103.
Image capture device 100, camera signal processing unit 101, Memory Controller 102 and memory 103 correspond respectively to shown in Figure 1 according to the image capture device 6 in the multiexposure, multiple exposure equipment of the embodiment of the invention, camera signal processing unit 22, Memory Controller 11 and memory 12.
Yet the multiexposure, multiple exposure equipment shown in Fig. 1 and Fig. 6 A differs from one another in configuration.Have one according to the multiexposure, multiple exposure equipment of the embodiment of the invention shown in Fig. 1 and contain twin-channel bus, to be used for the transfer of data between camera signal processing unit 22 and the memory 12.In addition, the data transmission bus that is located between Memory Controller 11 and the memory 12 also comprises two passages.On the other hand, have one according to the multiexposure, multiple exposure equipment of prior art shown in Fig. 6 A and contain three-channel bus, to be used for the transfer of data between camera signal processing unit 101 and the Memory Controller 102.In addition, the data transmission bus that is located between Memory Controller 102 and the memory 103 also comprises three passages.
And; Multiexposure, multiple exposure equipment according to prior art shown in Fig. 6 A does not have to be equipped with the processing section that has identical function with skew subtraction part 71 (Fig. 3); This skew subtraction part 71 deducts the shifted signal component that the increase owing to picture black produces, and the increase of this picture black is to be caused by the dark current that in long exposure, generates.
The processing of in multiexposure, multiple exposure, carrying out according to the multiexposure, multiple exposure equipment of prior art will be described below, with the reason of explanation according to the multiexposure, multiple exposure equipment needs triple channel bus of prior art.
Shown in Fig. 6 B, in the multiexposure, multiple exposure equipment according to prior art, image signal RAW1 is read from image capture device 100, and is written to memory 103 via Memory Controller 102.Then, shown in Fig. 6 C, carry out reading of image signal RAW2 once more in the d/d while of shutter.The signal that is read is written in the memory 103 and the regional different zone that stores image signal RAW1.At this moment, image signal RAW1 and RAW2 are stored in the memory 103.
When these two images were stored in the memory 103 as stated, image signal RAW1 and image signal RAW2 were read from memory 103 through Memory Controller 102, shown in Fig. 7 A.Then, the image signal is carried out the frame addition, and in camera signal processing unit 101, generate combined picture signal (RAW1+RAW2).Combined picture signal (RAW1+RAW2) is stored in the memory 103 and the regional different zone that stores image signal RAW1 and image signal RAW2.
Like this, two subject image signals in the memory 103 are read and combined picture signal is stored in the memory 103 owing to be stored in, so multiexposure, multiple exposure equipment must be provided with the triple channel bus.
As stated; In long exposure; From the image signal (being RAW1 and RAW2 under above situation) of memory, deducted from input from the black signal of image capture device input, black signal be through carry out with the exposure of absorbing the identical duration of image in the image capture light that covers from object obtain.This subtraction process can reduce the fixed pattern noise that caused by dark current.
In subtraction process, shown in Fig. 7 A, cover the black signal BLACK1 quilt that the image capture light from object obtains in the exposure through identical duration when carrying out and transported out from image capture device 100 with picked-up image (Fig. 6 B).Then, black signal BLACK1 is written in the memory 103 and the regional different zone that stores the combined picture signal (RAW1+RAW2) corresponding to object via Memory Controller 102.
In addition; Shown in Fig. 7 C; Cover the black signal BLACK2 quilt that the image capture light from object obtains in the exposure through (Fig. 6 C) identical duration when carrying out and read, and be written in the memory 103 and the regional different zone that stores combined picture signal (RAW1+RAW2) and black signal BLACK1 from image capture device 100 with the picked-up image.
Then, shown in Fig. 8 A, read black signal BLACK1 and black signal BLACK2 from memory 103 via Memory Controller 102.Camera signal processing unit 101 is carried out the frame addition to generate combination black signal (BLACK1+BLACK2).Combination black signal (BLACK1+BLACK2) is stored in the memory 103 and the regional different zone that stores combined picture signal (RAW1+RAW2).
Subsequently, shown in Fig. 8 B, read combined picture signal (RAW1+RAW2) and combination black signal (BLACK1+BLACK2) from memory 103, and in camera signal processing unit 101, carry out the frame subtraction via Memory Controller 102.Resulting signal is set to final combined picture signal ((RAW1+RAW2)-(BLACK1+BLACK2)).When the final combined picture signal ((RAW1+RAW2)-(BLACK1+BLACK2)) that generates by this way when being written to memory 103, finally generated the multiexposure, multiple exposure image under the long exposure.
Although in above example, generated single image, also can generate single image through multiplexing picture signal similarly more than two through multiplexing two picture signals (RAW1 and RAW2).That is to say, after normal picture picked-up operation, absorb picture black, and the image that picture black is added to picked-up in normal picture picked-up operation is so that generate multiplexing image.
In use carrying out the multiexposure, multiple exposure photographic method according to the multiexposure, multiple exposure equipment of prior art of above processing, need the memory span of a great deal of obviously.In above multiexposure, multiple exposure was taken pictures processing, the memory span that need be used at least three frames was to obtain final multiexposure, multiple exposure image.Therefore, along with the increase of impression in the multiexposure, multiple exposure (combination image number), essential frame number also increases.The memory size that therefore, possibly need increase.
In addition, because according to impression memory image signal in memory 103, so handling property possibly worsen and the processing time possibly increase.In addition; In the frame addition and the operation the frame subtraction in camera signal processing unit 101, carried out; Used and had three-channel data transmission bus: one is used to be written to memory 103, and two are used for reading from memory 103 in addition, and this possibly increase bandwidth of memory.
In addition, in long exposure, along with the increase of the picture black that is caused by dark current, the dynamic range of output signal reduces.Utilization is according to the method for prior art; Can be through from memory input image signal, deducting the picture black that pickup device input black signal reduces to increase, this pickup device input black signal is to obtain through the image capture light that in the exposure of carrying out identical duration when absorbing image, covers from object.Yet this method may not make dynamic range become big.
That below description will be carried out according to the embodiment of the invention operates relevant processing with multiexposure, multiple exposure.Fig. 9 A illustrates in the multiexposure, multiple exposure equipment shown in Figure 1 a part essential for following description.As stated, the binary channels bus is used to the data communication between camera signal processing unit 22 and the Memory Controller 11, and the binary channels bus also is used to the data communication between Memory Controller 11 and the memory 12.The processing of in multiexposure, multiple exposure, being carried out by the multiexposure, multiple exposure equipment that has the binary channels bus according to the embodiment of the invention will be described below.
Shown in Fig. 9 B, read out in the image signal RAW1 that obtains the normal picture picked-up operation from image capture device 6.This image signal RAW1 is written to memory 12 via Memory Controller 11.
In long exposure, carry out the operation of reading signal between the exposure period before output signal level is saturated especially from image capture device 6.Then, the skew subtraction part 71 (Fig. 3) in frame operational processes part 51 therefrom deduct with the corresponding offset component of picture black that increases owing to dark current after, the signal that is read is written to memory 12.
Subsequently, shown in Fig. 9 C,, carries out at shutter the normal picked-up operation of image when still being released and reading image signal RAW2 from image capture device 6 once more.With read side by side, read the image signal RAW1 that has before obtained and stored via Memory Controller 11 from memory 12, and it be transported to camera signal processing unit 22.Image signal RAW1 and image signal RAW2 are transported to the frame operational processes part 51 (Fig. 3) of camera signal processing unit 22.
In frame operational processes part 51, frame addition section 72 is carried out the frame addition to generate combined picture signal (RAW1+RAW2).This combined picture signal (RAW1+RAW2) is written to memory 12 via Memory Controller 11.
In long exposure, carry out the operation of reading signal between the exposure period before output signal level is saturated especially from image capture device 6.Then, the skew subtraction part 71 (Fig. 3) in frame operational processes part 51 therefrom deduct with the corresponding offset component of picture black that increases owing to dark current after, the signal that is read is written to memory 12.Notice that combined picture signal (RAW1+RAW2) can be written to the identical storage area with image signal RAW1.
Subsequently, shown in Figure 10 A, read black signal BLACK1 from image capture device 6, this black signal BLACK1 obtains through the image capture light that in the exposure of the used identical duration of execution and (Fig. 9 B) picked-up image, covers from object.With read side by side, read combined picture signal (RAW1+RAW2) via Memory Controller 11 from memory 12.Black signal BLACK1 that is read and combined picture signal (RAW1+RAW2) all are transported to frame operational processes part 51.
Then, frame operational processes part 51 utilizes frame subtraction part 73 to carry out the frame subtraction to generate combined picture signal (RAW1+RAW2-BLACK1).That is to say that frame subtraction part 73 deducts black signal BLACK1 and resulting signal is outputed to output signal selection part 74 from combined picture signal (RAW1+RAW2).Output signal selection part 74 is selected to output to Memory Controller 11 from the signal of frame subtraction part 73 inputs and with selected signal.Through this processing, from combined picture signal (RAW1+RAW2), deduct the combined picture signal (RAW1+RAW2-BLACK1) that black signal (BLACK1) obtains and be written to memory 12.
In long exposure, carry out the operation of reading signal between the exposure period before output signal level is saturated especially from image capture device 6.Then, the skew subtraction part 71 in frame operational processes part 51 therefrom deduct with the corresponding offset component of picture black that increases owing to dark current after, the signal that is read is written to memory 12.Notice that combined picture signal (RAW1+RAW2-BLACK1) can be written to and the identical storage area of image signal (RAW1+RAW2).
In addition, shown in Figure 10 B, read from image capture device 6 through the black signal BLACK2 quilt that the image capture light that in the exposure of carrying out with the used identical duration of (Fig. 9 C) picked-up image, covers from object obtains.With read side by side, read combined picture signal (RAW1+RAW2-BLACK1) through Memory Controller 11 from memory 12.Black signal BLACK2 that is read and combined picture signal (RAW1+RAW2-BLACK1) are transported to frame operational processes part 51.
Frame operational processes part 51 utilizes frame subtraction part 73 to carry out the frame subtraction with generation combined picture signal ((RAW1+RAW2)-(BLACK1+BLACK2)), and this combined picture signal is outputed to output signal selection part 74.Output signal selection part 74 is selected to output to Memory Controller 11 from the signal of frame subtraction part 73 inputs and with selected signal.Through this processing, from combined picture signal (RAW1+RAW2-BLACK1), deduct the combined picture signal ((RAW1+RAW2)-(BLACK1+BLACK2)) that black signal (BLACK2) obtains and be written to memory 12.
Through carrying out above processing, be stored in the memory 12 as the combined picture signal ((RAW1+RAW2)-(BLACK1+BLACK2)) of growing the final multiexposure, multiple exposure picture signal in the exposure.
In long exposure, carry out the operation of reading signal between the exposure period before output signal level is saturated especially from image capture device 6.Then, the skew subtraction part 71 in frame operational processes part 51 therefrom deduct with the corresponding offset component of picture black that increases owing to dark current after, the signal that is read is written to memory 12.Notice that combined picture signal ((RAW1+RAW2)-(BLACK1+BLACK2)) can be written to and the regional identical storage area that stores composition image signal (RAW1+RAW2-BLACK1).
As stated, in the processing of in according to the multiexposure, multiple exposure equipment of the embodiment of the invention and multiexposure, multiple exposure equipment, carrying out, in order to obtain final multiexposure, multiple exposure image, only the memory span of at least one frame is essential.Thereby, can realize reducing of necessary memory span.For example, find out in the example shown in Fig. 9 C that image signal RAW1 and combined picture signal (RAW1+RAW2) are stored in the memory 12.Yet combined picture signal (RAW1+RAW2) can be written to the zone that has stored image signal RAW1 at image signal RAW1 after reading.Therefore, as long as in memory 12, be provided with the only memory span of a frame, just can carry out above processing.
In addition, even when the impression in the multiexposure, multiple exposure (combination image number) increases, also there is no need to increase frame memory.Above example shows the situation of twice execution exposure.Yet, even under situation more than twice execution exposure, for handling also only the memory span of a frame be essential, this is because signal stored is read and newly-generated signal is written to and stores the zone of reading signal.
And, with side by side, the picture signal that reads from memory 12 is carried out the frame operational processes such as frame addition and frame subtraction from image capture device reading images signal.Thereby, there is no need to preserve picture signal, and thereby can suppress the deterioration (increase in processing time) of handling property according to impression.
In addition; In frame operation (operation of for example describing) with reference to figure 9C, Figure 10 A and Figure 10 B; Only there is the data/address bus that carries two passages (is used to be written to 12, one of memories and is used for reading from memory 12) to be used to the transfer of data between camera signal processing unit 22 and the memory 12.Thereby, can reduce bandwidth of memory.
In addition; In long exposure; Carry out the operation of reading signal between the exposure period before output signal level is saturated, and the skew subtraction part 71 in the frame operational processes part 51 deducts from read signal and the corresponding offset component of picture black that increases owing to dark current from image capture device 6.This can suppress to export the reducing of dynamic range of signal.
The another kind configuration of the multiexposure, multiple exposure equipment of the capacity that is used to save memory 12 will be described with reference to Figure 11 now.Except the assembly of multiexposure, multiple exposure equipment shown in Figure 1, the multiexposure, multiple exposure equipment shown in Figure 11 is provided with the compressing original data/decompression unit 151 between camera signal processing unit 22 and Memory Controller 11.
This compressing original data/decompression unit 151 has compression section and conciliates compression section; Compression section (for example is used to compress so-called raw data form; The primary signal of being made up of R (red), G (green) and B (indigo plant)) the data from the input signal format of image capture device 6, the part that decompresses is used for the compressed signal decompress(ion) of sending here from memory 12 is condensed to initial data.
This compressing original data/decompression unit 151 is regular length or variable-length with the word length compression and decompression of original data signal.For example, compressing original data/decompression unit 151 is with word length boil down to 8 bits of each pixel 12 bit.
The compression and decompression of the initial data of fixing or variable-length for example can adopt Japan not among the substantive examination public announcement of a patent application No.2007-228515 disclosed technology carry out.
When adopt the arranged for executing shown in Figure 11 via Memory Controller 11 to memory 12 write signals or when memory 12 reads the operation of signal, original data signal is by 151 compressions of compressing original data/decompression unit or decompress.This shows the size that is stored in the picture signal in the memory 12 size less than original data signal.Thereby, through compressing original data/decompression unit 151 is provided, can realize the further saving of the memory span of memory 12.
Processing the decompression of the signal that comes is provided except the compression of the signal that will offer memory 12 carried out by compressing original data/decompression unit 151 with from memory 12 and relates to reference to the processing of the described multiexposure, multiple exposure of figure 9A to 19B and carrying out similarly, and thereby its description will be omitted.Owing to carry out with reference to the described processing of figure 9A to 10B, even so clearly when employing compressing original data/decompression unit 151, also can realize above-mentioned various effects.
The processing procedure of in multiexposure, multiple exposure, carrying out below with reference to the flow chart description shown in Figure 12 according to the embodiment of the invention.
At step S100, confirm that in image capture device 6 exposure mode that is provided with is a normal exposure pattern or from the pattern of covering of the image capture light crested of object.When exposure mode in step S100 is confirmed as when not being normal exposure (it is to cover pattern that exposure mode is confirmed as), process proceeds to step S101.At step S101, the shutter closure to be covering the image capture light from object, and the exposure of identical duration in execution and the normal exposure.This processing perhaps obtains the processing (describing with reference to figure 10A and Figure 10 B respectively) of black signal BLACK2 corresponding to the processing that obtains black signal BLACK1.
On the other hand, if in step S100 exposure mode to be confirmed as be normal mode, perhaps when the finishing dealing with of the complete black exposure among the step S101, processing procedure proceeds to step S102.At step S102, confirm whether the exposure mode that in image capture device 6, is provided with is long exposure mode.If to be confirmed as be long exposure mode to exposure mode in step S102, then processing procedure proceeds to step S103.At step S103, carry out the operation of reading signal between the exposure period before output signal level is saturated from image capture device 6.Then, at step S104, the skew subtraction part 71 of frame operational processes part 51 is carried out the subtraction that from the signal of image capture device 6, deducts with the corresponding offset component of picture black that increases owing to dark current from reading.
On the other hand, if exposure mode is confirmed as and is not long exposure mode in step S102, then carry out operation from the 6 normal read numbers of winning the confidence of image capture device at step S105.Normally read and refer to the processing of reading of between exposure period, not reading signal from image capture device 6.
When the finishing dealing with of the processing of step S104 or step S105, processing procedure proceeds to step S106.At step S106, the definite frame number that will handle, and confirm whether the frame of just handling is first frame.Be not first frame if the frame that is processed is confirmed as, then processing procedure proceeds to step S107.At step S107, carry out confirming once more to the exposure mode that in image capture device 6, is provided with.If to be confirmed as be the normal exposure pattern to exposure mode in step S107, then processing procedure proceeds to step S108.
At step S108, frame addition section 72 is carried out the frame addition to generate combined picture signal.This is for example handled corresponding to reference to reference to the described processing of figure 9C, and wherein multiplexing image signal (RAW1 and RAW2) is added in together.In the flow chart of Figure 12; Process through from step S100 to step S107 has obtained the image signal from image capture device 6; Obtained the image signal through the process till step S115 (this will be described below) from memory 12, and these image signals are added in together in step S108.
On the other hand, if exposure mode is confirmed as and is not normal exposure pattern (that is, it is to cover pattern that exposure mode is confirmed as) in step S107, then processing procedure proceeds to step S109.At step S109, frame subtraction part 73 is carried out the frame subtraction to generate combined picture signal.This is handled for example corresponding to the processing shown in the processing shown in Figure 10 A or Figure 10 B.In with reference to the described processing of figure 10A, from combined picture signal (RAW1+RAW2), deduct black signal BLACK1, and generate combined picture signal (RAW1+RAW2-BLACK1).According to the flow chart among Figure 12; Black signal is to obtain from image capture device 6 through the process from step S100 to S107; Combined picture signal is to obtain through the process till step S115 (this will be described below), and in step S109, these signals is carried out subtraction.
On the other hand, if confirm that in step S106 the frame of just handling is first frame, then processing procedure proceeds to step S110.The processing of step S110 also is after the finishing dealing with of the processing of step S108 or step S109, to carry out.At step S110, output signal selection part 74 is divided 71, is selected an output signal the signal of frame addition section 72 and frame subtraction part 73 from the subtraction portion that squints from output, and selected signal is outputed to Memory Controller 11.In the selection of this step S110 is handled, after it is the processing of and then step S106, carry out the time, output signal selection part 74 is selected the output signal from skew subtraction part 71.After the processing of step S110 is the processing of and then step S108 or step S109, carry out the time, output signal selection part 74 is selected the output signal from frame addition section 72 or frame subtraction part 73 respectively.
When being configured to have the multiexposure, multiple exposure equipment of compressing original data/decompression unit 151 shown in employing Figure 11,, the original data signal of being selected by output signal selection part 74 is carried out processed compressed at step S111.Then, at step S112, compressed signal is written to memory 12 via controller 11.
At step S113, confirm whether the multiexposure, multiple exposure operation stops.If in step S113, confirm also not carry out the exposure of predetermined number, then processing procedure turns back to step S100 with repeating step S100 and subsequent processing procedure.Repeating in the processing of step S100 execution in step S114 and subsequent processing.Obtain image signal or black signals through repeating from the processing procedure of step S100 from the image capture device 6, and simultaneously, through execution in step S114 and subsequent handle and read signal from memory 12.That is to say, read original data signal via Memory Controller 11 from memory 12, and decompress at 151 pairs of original data signals that read from memory 12 of step S115 compressing original data/decompression unit at step S114.
Signal after the decompression is imported into frame operational processes part 51.Then, S107 confirms exposure mode in step, and carries out predetermined frame operational processes.More than handle being repeated, up to executed till the exposure of predetermined number.
On the other hand, if confirm executed predetermined number exposure and thereby multiexposure, multiple exposure finish dealing with, then processing procedure stops.
As stated, according to embodiments of the invention, in order to obtain final multiexposure, multiple exposure image, only the memory span of at least one frame is essential.Thereby, can realize the saving of memory span.In addition, even when impression (combination image number) increases, also there is no need to increase frame memory.Through adopting compressing original data/decompression unit 151, can realize the further saving of memory span.
And, and read signal side by side from image capture device 6, the picture signal of reading from memory 12 is carried out the frame operational processes.Thereby, owing to there is no need in memory 12, to preserve the picture signal that reads, therefore can prevent the deterioration (increase in processing time) of handling property according to the impression in the multiexposure, multiple exposure.
In addition, in above frame operational processes, the data/address bus that only carries two passages (is used to be written to 12, one of memories and is used for reading from memory 12) is used to the transfer of data between memory 12 and the camera signal processing unit 22.Thereby, can realize the processing that bandwidth of memory reduces.
In addition; In long exposure; Carry out the operation of reading signal between the exposure period before output signal level is saturated, and the skew subtraction part 71 in the frame operational processes part 51 deducts from read signal and the corresponding offset component of picture black that increases owing to dark current from the image capture device.Therefore, can suppress to export the deterioration of the dynamic range of signal.
Although the above example of the embodiment of the invention illustrates the situation of double exposure (two frames), though have three times or the situation of the multiexposure, multiple exposure of more times exposure under also can realize similar effect.
In the above example of the embodiment of the invention, signal processor 9 is made up of integrated circuit (hardware).Yet whole in the said modules or some can utilize computer etc. to be embodied as software.Equally in this case, can realize with above example in similar effects.
When processing procedure during by software executing, the program that constitutes software is installed in the computer that combines the specialized hardware from program recorded medium, and perhaps being installed to can be through installing in the general purpose personal computer that various programs carry out various functions.
Figure 13 is the block diagram of Hardware configuration that diagram is used for carrying out according to program the personal computer of above processing procedure.
In personal computer, CPU (CPU) 201, ROM (read-only memory) 202 and RAM (random access storage device) 203 are via bus 204 interconnection.
Bus 204 is also connected to input/output interface 205.Input/output interface 205 is connected to the input unit 206 that is made up of keyboard, mouse, microphone etc.; The output unit 207 that constitutes by display, loud speaker etc.; The memory cell 208 that constitutes by hard disk, nonvolatile memory etc.; The communication unit 209 that constitutes by network interface etc., and the driver 210 that is used to drive removable medium 211 (for example disk, CD, magneto optical disk and semiconductor memory).
In having the computer of above configuration, CPU 201 for example is loaded into RAM 203 via the program that input/output interface 205 and bus 204 will be stored in the memory cell 208, thereby carries out above processing procedure.
To be stored in the removable media 211 as encapsulation medium by the program that computer (CPU 201) is carried out, for example disk (comprising flexible disk), CD (comprising CD-ROM (compact disk-read-only memory), DVD (digital versatile disc)), magneto optical disk and semiconductor memory.Perhaps, this program can provide through wired or wireless transmission (for example local area network (LAN), internet and digital satellite broadcasting).
When removable media 211 was installed in the driver 210, program can be installed in the memory cell 208 through input/output interface 205.Program can also be received by communication unit 209 through wired or wireless transmission medium, is installed in then in the memory cell 208.Perhaps, program can be installed in ROM 202 or the memory cell 208 in advance.
To can carry out in chronological order according to above-mentioned processing sequence by the program that computer is carried out, perhaps can executed in parallel.Program is (for example in response to calling) execution where necessary also.
In this manual, term " system " refers to the whole device that is made up of a plurality of assemblies.
The application comprises Japan of submitting to Japan Patent office with on August 27th, 2008 relevant theme of patent application JP 2008-218010 formerly, and the full content of above-mentioned application is incorporated into this by reference.
Should be appreciated that and to carry out various modifications, and do not depart from the scope of the present invention.

Claims (5)

1. image-pickup device comprises:
The frame operating means, be configured to when through with single frame multiexposure, multiple exposure when generating combination image from the light of single body or a plurality of objects and a plurality of images that superpose, this frame is carried out addition or subtraction; And
Storage device is configured to store the result of the operation that said frame operating means carries out,
Wherein a data/address bus is arranged between said frame operating means and the said storage device, and this bus comprises two passages, and a passage is used to be written to said storage device, and another passage is used for reading from said storage device.
2. image-pickup device as claimed in claim 1,
Wherein said frame operating means comprises: the offset minus subtraction unit is configured to from the signal of image capture device, deduct predetermined shifted signal component from providing.
3. image-pickup device as claimed in claim 2,
Wherein between the saturated exposure period before of output signal level of said image capture device, carry out the operation of reading signal, and said offset minus subtraction unit is carried out from reading the operation that from the signal of said image capture device, deducts the shifted signal component from said image capture device.
4. image-pickup device as claimed in claim 1,
Wherein provide signal from the raw data format of said frame operating means to be compressed and be stored in then in the said storage device, and provide compressed signal from said storage device to be extracted to be condensed to raw data format and be provided for said frame operating means then.
5. image-pickup device as claimed in claim 1,
Wherein, in frame addition and frame subtraction, said frame operating means is carried out the frame operational processes with the image that reads side by side from said image capture device reading from said storage device.
CN2009101601974A 2008-08-27 2009-07-30 Image pickup apparatus, image pickup method Expired - Fee Related CN101662593B (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JP2008218010A JP4735994B2 (en) 2008-08-27 2008-08-27 Imaging apparatus and method, program, and recording medium
JP2008218010 2008-08-27
JP2008-218010 2008-08-27

Publications (2)

Publication Number Publication Date
CN101662593A CN101662593A (en) 2010-03-03
CN101662593B true CN101662593B (en) 2012-05-30

Family

ID=41724814

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2009101601974A Expired - Fee Related CN101662593B (en) 2008-08-27 2009-07-30 Image pickup apparatus, image pickup method

Country Status (3)

Country Link
US (1) US8368782B2 (en)
JP (1) JP4735994B2 (en)
CN (1) CN101662593B (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
NO334845B1 (en) * 2011-05-04 2014-06-16 Aker Well Service As Method and apparatus for cleaning the upper portion of a well
JP6021465B2 (en) * 2011-07-11 2016-11-09 キヤノン株式会社 Image processing apparatus and image processing apparatus control method
JP6351271B2 (en) * 2014-01-17 2018-07-04 オリンパス株式会社 Image composition apparatus, image composition method, and program

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1489862A (en) * 2001-10-03 2004-04-14 ���ṫ˾ Image pick-up device and image quality conection method

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0918793A (en) * 1995-06-26 1997-01-17 Nikon Corp Image pickup device
JP2001028726A (en) 1999-07-13 2001-01-30 Canon Inc Electronic camera, photographing method and storage medium
JP2001189886A (en) * 1999-12-28 2001-07-10 Canon Inc Image pickup device, information processor, system and method for processing image and storage medium
JP2002135647A (en) * 2000-10-19 2002-05-10 Canon Inc Unit/method for imaging apparatus computer-readable storage medium
JP3864407B2 (en) * 2001-01-22 2006-12-27 富士フイルムホールディングス株式会社 Digital camera
JP3861808B2 (en) * 2002-12-25 2006-12-27 ソニー株式会社 Imaging device
JP4342926B2 (en) * 2003-12-24 2009-10-14 三菱電機株式会社 Image input method and image input apparatus
JP2006345454A (en) * 2005-06-10 2006-12-21 Canon Inc Image encoding apparatus, image decoding apparatus, methods therefor, program and storage medium
JP2007166024A (en) * 2005-12-09 2007-06-28 Canon Inc Imaging apparatus and control method thereof
JP2009017078A (en) * 2007-07-03 2009-01-22 Fujifilm Corp Digital still camera and its operation controlling method

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1489862A (en) * 2001-10-03 2004-04-14 ���ṫ˾ Image pick-up device and image quality conection method

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
JP特开2002-218313A 2002.08.02
JP特开2006-345454A 2006.12.21
JP特开2007-166024A 2007.06.28
JP特开平9-18793A 1997.01.17

Also Published As

Publication number Publication date
US20100053374A1 (en) 2010-03-04
JP2010056733A (en) 2010-03-11
JP4735994B2 (en) 2011-07-27
US8368782B2 (en) 2013-02-05
CN101662593A (en) 2010-03-03

Similar Documents

Publication Publication Date Title
EP1947842B1 (en) Image sensors with blooming reduction mechanisms
EP1143707A2 (en) Multiple sampling via a time-indexed method to achieve wide dynamic ranges
JP2006197393A (en) Solid-state imaging device, driving method thereof and camera
US20080239129A1 (en) Method and device for driving solid-state imaging device, imaging apparatus, and image synthesizing method
JP2007020156A (en) Imaging apparatus and imaging system
CN106134183B (en) Image pickup assembly, control method and image pickup device
JP5223953B2 (en) Solid-state imaging device, driving method of solid-state imaging device, and imaging device
US10021325B2 (en) Image sensor and image capturing apparatus
JP6282303B2 (en) Imaging device and imaging apparatus
JP2007096633A (en) Video signal processing device and digital camera
JP2010050538A (en) Image device, smear reduction method, and program
CN101662593B (en) Image pickup apparatus, image pickup method
JP2007208885A (en) Imaging unit and image sensor
JP6190243B2 (en) Imaging apparatus and control method thereof
WO2017101562A1 (en) Image sensor, terminal having same, and imaging method
JP5627728B2 (en) Imaging apparatus and imaging system
JP2007134806A (en) Solid-state imaging element
JP2004363193A (en) Cmos solid-state imaging device
JP2015109502A (en) Image sensor and operation method of image sensor, imaging apparatus, electronic apparatus and program
JPH0750786A (en) Dynamic range expanding method for image pickup element
JP6302217B2 (en) Imaging apparatus and control method thereof
JP2010206719A (en) Imaging device, method of controlling the same, and camera
JP2008034913A (en) Imaging apparatus, and smear false color reduction method thereof
JP6706138B2 (en) Imaging device
JP4088898B2 (en) Imaging device

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20120530

Termination date: 20150730

EXPY Termination of patent right or utility model