CN101365930B - System and method for image sensor element or array with photometric and realtime reporting capabilities - Google Patents
System and method for image sensor element or array with photometric and realtime reporting capabilities Download PDFInfo
- Publication number
- CN101365930B CN101365930B CN2006800421964A CN200680042196A CN101365930B CN 101365930 B CN101365930 B CN 101365930B CN 2006800421964 A CN2006800421964 A CN 2006800421964A CN 200680042196 A CN200680042196 A CN 200680042196A CN 101365930 B CN101365930 B CN 101365930B
- Authority
- CN
- China
- Prior art keywords
- report
- pixel
- response
- exposure
- groups
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Abstract
A solid-state pixel structure or pixel array includes integrated exposure control provided within the pixel structure and/or pixel array. Including exposure control within the pixel structure and/or array allows optimal exposure to be achieved in real time. Optimal exposure is achieved by measuring the response of pixel structures to received electromagnetic radiation, and using the response information, in conjunction with knowledge regarding the pixel structure capabilities and photometric thresholds, to determine when the pixel structure is operating optimally. Tight control of the exposure of the pixel structure to the electromagnetic radiation allows the pixel structure to operate optimally in order to provide an optimal captured image.
Description
Technical field
The present invention relates generally to the electronic imaging field, particularly relate to a kind of method and apparatus that uses photometric measurement and report to strengthen image taking.
Background technology
Shooting is the effect imaging process that relies on light.Normally used light, the frequency in its electromagnetic radiation are in the visible scope of human eye.From object reflection or the light type that sends through the exposure of certain hour by an image recording sensor.Imageing sensor in nature chemistry, for example photographic negative; CCD and cmos image sensor that also solid-state, for example digital camera and video camera use.
Thereby digital camera has a series of energy focused rays to generate the lens of the image of a scene.But unlike traditional camera, light is focused on the egative film but light is focused on and can convert the electromagnetic radiation of light on the solid state image sensor of electric charge to.The atomic element of this imageing sensor is called pictorial element, i.e. and " pixel ", and the real image sensor of digital vedio recording typically has a large amount of pixels.Electric charge is represented the relative intensity of the electromagnetic radiation that perceived by imageing sensor, and generally is used for a light intensity value and pixel and connects.
A purpose of shooting provides the image that image that an energy sees human eye shows exactly.Yet human eye has different light sensitivity to all wavelengths of light.Therefore, imageing sensor must be adjusted to consistent with the human vision light sensitivity to the response of inciding the electromagnetic radiation on the imageing sensor.This adjusting will humanly be carried out the light sensitivity of different wave length to compensate the exposure of electromagnetic radiation by adjusting imageing sensor usually.
Yet, usually be difficult to determine one accurately exposure to offer imageing sensor; The photographic composition of imageing sensor is failed to determine and the electromagnetic radiation exposure amount accurately of applying will cause deterioration to captured image.These deteriorations are exactly " overexposure " or " under-exposure " often mentioned.Overexposure takes place during greater than this optical wavelength optimised quantity in the amount of electromagnetic radiation that is exposed when photographic composition.Overexposure usually causes having lacked highlighted level part in captured image.
Figure 1A has illustrated the response curve of an imageing sensor overexposure.Horizontal ordinate represents that electromagnetic radiation incides the light intensity on the sensor.Ordinate presentation video sensor respective output voltages.For low intensity radiation, the growth that the voltage of image photographic composition is linear along with the growth of electromagnetic radiation light intensity.Yet, surpassed threshold value To (dotted line is pointed in as Figure 1A) when the light intensity of electromagnetic radiation increases, image photographic composition output voltage will correspondingly not change, but with its levels out at some maximum voltage.Therefore, the image photosensitive device can not show accurately that electromagnetic radiation intensity levels surpasses the image of threshold value To, and the image that is write down is called as overexposure.
Figure 1B has illustrated the response curve of an imageing sensor under-exposure.When under-exposure occurs in amount when the image photographic composition is placed under the electromagnetic radiation exposure and is lower than optimised quantity.Under-exposure usually causes having lacked the shadow level part in captured image.Shown in Figure 1B, for low intensity values, the voltage of image photographic composition does not change with the variation of electromagnetic radiation light intensity.Only after surpassing minimum intensity of light amount threshold value Tu, light intensity makes just that linearity increases along with the intensity of electromagnetic radiation for the voltage of image photographic composition.Therefore, the image photosensitive device can not show accurately that electromagnetic radiation intensity levels does not surpass the level part or the color of the image of threshold value Tu, and the image that is write down is called under-exposure.
Fig. 1 C has illustrated that has reflected the transfer function of imageing sensor to the accurate exposure of electromagnetic radiation.Accurately exposure occurs in when an image is taken by the best, not only in the high intensity levels section of electromagnetic radiation, and in the low intensity levels section of electromagnetic radiation all levels part is arranged all.Accurately exposure allows the highlights and the dash area of original image can both accurately be illustrated in the electronic image of the image that is taken.
Fig. 2 A-2C has illustrated the histogram of the pixel light intensity of exposure image, and wherein being exposed image all has one from 0 to 255 potential pixel range of light intensity.Fig. 2 A is the histogram of the pixel light intensity of an overexposure image, for example the transfer function exposure process of usefulness such as Figure 1A explanation.Fig. 2 B is the histogram of the pixel light intensity of a under-exposed image, for example the image that apparatus is taken just like the transfer function of Figure 1B.Fig. 2 C is the histogram of the pixel light intensity of an accurate exposure image, for example uses the transfer function of Fig. 1 C.The distribution situation of the histogram pixels illustrated standard of luminous intensityization of Fig. 2 C, the image of an overexposure of Fig. 2 A explanation has the pixel light intensity that is compressed in maximum image sensor output value (" 255 "), and the image of a under-exposure has the pixel light intensity that is compressed in minimum image sensor output value (" 0 ").
An image that arrives pel array has comprised thorough dark portion and highlights zone inequality on light intensity, and therefore causes image to have wide dynamic range.Although the dynamic range of image is within the pel array dynamic range, the calculating of exposure still must be very accurate.The limited dynamic range of actual pixels array combine with the wide dynamic range of typical image make must accurately make exposure calculating become one very the difficulty task.
The many calculation exposure time method of existing technical approval.A known method is to set photographic images with a time shutter of estimating, and observes the histogram of pixel output, arrives a new time shutter estimated value and with this new time shutter estimated value photographic images.Because this method will be to each image taking twice, so waste very much energy.Although secondary time shutter estimated value is better than primary, it still is coarse, is still an approximate value, and many pixels outside pixel dynamic range will be exposed by light intensity.
Another method is the research entire image, the mean value of measurement image light intensity and calculating a time shutter that is based upon on this value basis.Yet such method is coarse, because it does not consider the actual distribution of light intensity in the image.There is too many pixel outside pixel dynamic range to be exposed like this by light intensity.
Determine that by photometric measurement exposure is more complicated accurately.Photometric measurement is the science of measuring of a kind of visible light, especially its intensity, and can describe image intensity with it according to the brightness that human vision is perceived.As eyes the function factor of how many susceptibilitys is arranged at a wavelength place with one, by being weighting in the determined light intensity of this light wave, photometric measurement can be used to illustrate the different light sensitivity of human vision to light wave.
Be designed to be used as the electromagnetic radiation photosensitive device of special photometric measurement function by use, representationally done photometric measurement and proposed report.Electromagnetic sensitive device can be that for example, a charge-coupled device (CCD) (CCD) or a complementary metal oxide semiconductor (CMOS) (CMOS) install.Fig. 3 has illustrated a pel array 10, and it has comprised dot structure group for example dot structure 12 and for example photometric measurement structure of photometric measurement structural group 14.Use the typical pixel structure of such photometric measuring apparatus that photometric measurement is used in the subregion of one or more image that is taken.So the measurement of numerous subimages is to be processed into to determine that this image photosensitive material should be subjected to the exposure of electromagnetic radiation.The processing stage that image having passed through for the second time, wherein image exposes by solid-state image sensing device is put under the incidence electromagnetic radiation, is taken through calculating the good time shutter in advance.
Yet because the sub-fraction that photometric measurement is taken from the picture point that photographs usually proposes, it often is not best; Any perceptual property and/or pseudo-shadow are to be used to calculate an exposure that is applied to entire image in the sampling spot.Therefore, from the time shutter that such measurement gets often be coarse, and the processed image that obtains normally is damaged.The another one shortcoming of said method is not consider the performance of imageing sensor.For instance, imageing sensor may produce different responses to the electromagnetic radiation of different light intensity.Be that the gain characteristic of not considering imageing sensor may make the problem worse that a desirable output image is provided to weighting factor of image sensor application blindly.
Summary of the invention
A solid-state pixel structure among the present invention has comprised an imageing sensor, is used for the measurement image sensor to the device of the response of the electromagnetic radiation that receives be used for the status report of imageing sensor response is given the device of exposure control unit.
020 according to another aspect of the present invention, and a pel array has comprised an exposure control unit and at least one group of dot structure group that links to each other with exposure control unit.Every group of dot structure group comprises at least one dot structure.Dot structure comprises an imageing sensor, is used for the measurement image sensor to the device of the electromagnetic radiation that receives response be used for reporting to exposure control unit the device of its responsive state.Exposure control unit is analyzed this responsive state (or a plurality of state) to determine whether responsive state (or a plurality of state) is indicated exposure to stop trigger event and taken place.
021 according to another aspect of the present invention, and a kind of exposure method of dot structure group under electromagnetic radiation of controlling is provided.The dot structure group is made up of at least one dot structure, and each dot structure has an imageing sensor.This method is included in this pixel groups at least one dot structure and measures the step of an imageing sensor that is associated to the response that receives electromagnetic radiation, and analyze the state that at least one dot structure receives from group, this state step relevant, analyze to determine whether responsive state indicates exposure to stop that trigger event has taken place and according to the step of exposing of exposure termination incident termination dot structure group under electromagnetic radiation with the response that the imageing sensor of at least one dot structure has measured.
022 has so a kind of configuration, and pixel structure exposure can be controlled in real time so that optimized image is taken.Other advantage of the present invention will embody by accompanying drawing shown in the combination in the explanation of reading the back.
Description of drawings
Shown in Figure 1A-1C, dot structure is respectively to overexposure, the under-exposed and accurate transport function of exposure status response.
Shown in Fig. 2 A-2C, to photographic images respectively to overexposure, under-exposure, the accurately histogram of the pixel light distribution of exposure.
Shown in Figure 3, a picture element array structure of using prior art.
Shown in Figure 4, there is the function equivalent block diagram of the typical pixel structure of ADC (digital to analog converter) and DSP (digital signaling system) back.
Shown in Figure 5, the function equivalent circuit diagram of a typical pixel structure.
Shown in Figure 6, figure who has the solid-state pixel array of integrated exposure control among the present invention.
Shown in Figure 7, the element that the solid-state pixel structure of an explanation among the present invention also may comprise and the block diagram of transmission path flow process.
Shown in Figure 8, circuit and the frame circuit diagram of an embodiment of a solid-state pixel structure of representing as Fig. 7.
Shown in Figure 9, an explanation can be used in the functional flow diagram of the step of exposure control procedure among the present invention.
Shown in Figure 10, among the present invention, in conjunction with second embodiment of solid-state pixel array of integrated exposure control.
Shown in Figure 11, among the present invention, in conjunction with the 3rd embodiment of solid-state pixel array of integrated exposure control.
Shown in Figure 12, among the present invention, in conjunction with the 4th embodiment of solid-state pixel array of integrated exposure control.
Embodiment
According to one aspect of the present invention, a kind of solid-state pixel structure or pel array comprise the integrated exposure control that is arranged in dot structure and/or the pel array.The exposure control that is included within dot structure and/or the array can obtain optimum exposure in real time.By measuring the response of dot structure to the electromagnetic radiation that receives.And use this response message, in conjunction with about the ability of dot structure and the threshold value knowledge of photometric measurement, just can obtain optimum exposure when to determine that pixel structure operation is best.
In one embodiment, each solid-state pixel structure can be carried out photometric measurement.The feature of dot structure to the electromagnetic radiation response represented in this measurement.By within solid-state pixel structure, comprise photometric measurement capability during image taking, pixel exposure is monitored and is tightly being controlled.This solid-state pixel structure has comprised the report logical circuit, and this logical circuit is used for the exposure resonse characteristic is reported to exposure control unit.When the exposure response characteristic showed that the image of optimum exposure has been taken, exposure control unit will stop exposure.Consider the real-time response of dot structure, the measurement of this solid-state pixel structure and report logical circuit provide dynamic feedback to the exposure control logic circuit, are used for guaranteeing that dot structure is by the optimum exposure of electromagnetic radiation.Because the exposure measurement can be controlled in the image shoot process rather than as an independent process, can reduce the complicacy and the energy consumption of exposure like this.
Advantage of the present invention can by with Fig. 4, typical pixel structure operation is compared shown in 5, and by best showing.For instance, Fig. 4 explanation is included in the block diagram of each parts in the Typical Digital image capturing device.A signal source 20 is connected to and has comprised integrator 21, the signal processing chain of analog to digital converter (ADC) 22 and digital signal processor (DSP) 23.Signal source 20 is light intensity sensors that produce the electroresponse of response electromagnetic radiation, just as the core of light from typical cmos pixel structure shines above it, and sensor 20 and integrator 21 then.Sensor 20 can be used in time control occasion, for example digital camera applications, and this moment, sensor was subjected to the irradiation of light in being commonly referred to the special time of time shutter.Integration is carried out in the response of the sensor 20 that all photons that integrator received in the 21 pairs of time shutter cause becomes a value, and for example magnitude of voltage is read after the time shutter finishes.
Shown in Figure 5, a more detailed typical image sensor module circuit.Signal source 30 is optical sensors, is a photodiode in order to we can say it as an example.Capacitor 34 is simple integrators.The output that is input as signal source 30 of integrator.Capacitor is resetted by the switch 35 that is in before integral process begins under the closure state.When integral process began, the input signal that switch 35 is opened and the voltage responsive at capacitor 34 two ends comes from signal source 30 began to change.Switch 33 is closed and to the Vout sampling of integrator output 36 when integral process finishes.
As the pixel dynamic range that is subjected to the integrator restriction, when setting the time shutter, want careful consideration.A too short time shutter will stop the output of one or more pixels to rise to enough height, and on lowest noise.An oversize time shutter will cause the output of one or more pixels saturated.
Mentioned about Fig. 1 C and 2C, when all pixelated array (unsaturation) in their linear output area operate and produce a output voltage on minimum electrical noise, can obtain best array running.In order to be created in the output voltage on the minimum electrical noise face, when the minimum value by the electromagnetic radiation light intensity working range of appointment illuminated, the gain of dot structure should be enough high to produce enough output voltage.This has determined the light sensitivity of dot structure.For dot structure can operate in its range of linearity and when having peaked electromagnetic radiation light intensity irradiation in by the structure operational range, its output is unsaturated, the dynamic range of dot structure should be enough big.
The present invention approves at dot structure, the integrated value of the exposure control in pel array or its combination.As described below, the exposure control integration that enters dot structure and/or pel array has been created condition for taking the optimized image with minimal complexity and energy consumption.The present invention can be with many multi-form, and different pixels set marshalling is implemented.All embodiment are representative sub-fractions among the embodiment of equal value among the present invention, and the present invention is not restricted to the embodiment that is showed.
Fig. 6 illustrates, an embodiment among the present invention, but wherein each pixel such as pixel 101 combine the accessory logic circuit that can report when pixel output has reached specific report condition.Showed by logical circuit, but should report condition be a kind of problem of design selection, and may include, but are not limited to, such state as: the pixel output level has reached KB required; The pixel output level is the value of reaching capacity; The pixel output level has reached first particular state higher but lower than saturation value than KB required; The pixel output level reached second lower than KB required height ratio saturation value, and be different from first particular state; The pixel output level has reached first combination of above-mentioned each state, and/or the pixel output level has reached second combination of above-mentioned each state.
Status information enters functional module 102., functional module 102 keeps communication by 103 pairs of system components external of interface bus to pel array 100.Functional module 102 helps dynamically programmableization, although this is not requirement.In one embodiment, functional module is programmed and is used for detecting exposure termination trigger condition.Can stop trigger condition exposing and be chosen in before the picture-taking, or can be aptly according to selecting from introducing information in the image shoot process.For instance, the exposure termination situation of possible prior adjustment comprises but is unrestricted: the indication that the previous the longest time shutter of setting has reached; All pixel reports have reached minimum output voltage and a pixel is reported the indication of the value of reaching capacity of its output voltage; The indication that report has reached the output saturation voltage value is counted in preestablishing of pixel; The indication that report minimum output voltage value has reached is counted in preestablishing of pixel; Some pixel reports greater than first predetermined threshold value have reached output saturation voltage, and have reached the indication of minimum output voltage greater than some pixel reports of second predetermined threshold value; The indication that has taken place with the combination of exposure termination situation.
Shown in Figure 7, may comprise the block diagram of parts among the present invention in the solid-state pixel structure.As shown in Figure 7, dot structure has comprised a device, to signal source 50 with comprised the device that integrator 51 that status report of necessary generation is delivered to functional module 102 responds.Status report can be got the form of any kind of, and this just depends on and the desired information that has of communicating by letter between pixel and functional module.For example, in simple embodiment, status report may comprise a trigger pip when this signal determines to point out that pixel has reached a specific state, and this signal itself is pointed out again to expose and stopped the existence of triggering situation.At one more in the complex embodiments, signal may be encoded, on a series of or many bit bus based on the previous communication protocol of determining.The technology of other communication datas between 2 of any arrays may be substituted when not influencing scope of the present invention.
Fig. 8 provides the block diagram of embodiment of a solid-state pixel structure 62 among a more detailed the present invention.Structure 62 is described similar with Fig. 5, but has comprised photometric measurement among the present invention and report logical circuit 63.But photometric measurement among embodiment and report logical circuit are dynamic programmings, and used functional module comprises the ability of the exposure activation threshold value of the performance that finishes by outside input 55 customization exposure standards and logical circuit 63.This measurement and report logical circuit 63 can be specifically designed to a pixel or be used for more than a pixel.When measuring and report that logical circuit 63 is used for more than a pixel, the indication of the additional data of additional pixel state data is imported in measurement and the report logical circuit 63 by additional interface.Interface 68 and 69 is that representative interface is brought the additional pixel state data data in measurement and the report logical circuit 63 into.When measuring and report that logical circuit 63 is used for more than a pixel, the quantity of additional interface changes according to the details of embodiment.Photometric measurement and report logical circuit 63 can be according to setting in advance or suitable algorithm running.When the cost of running and easy when becoming main consideration item, measure and the running of report logical circuit 63 can be set in advance and is not subjected to the domination that changes.When the excellent images sensor performance was major consideration, the running of measurement and report logical circuit 63 can be to change from the response of fitting and be vulnerable to external command.Input end 55 response external orders play a part to change measures and 63 runnings of report logical circuit.The pattern of measurement and 63 runnings of report logical circuit can change by the selection between the good operating mode of many prior programmings or by writing a new operating mode.In a typical embodiment, measure and report logical circuit 63 has been monitored pixel output signal voltage and reset/in the startup command one or both.Based on one of them or both combinations in both combinations, and on the trigger condition that structure has been programmed, measure and report logical circuit 63 provide status signal to functional module 102 with indication the existing of some characteristic in solid-state structure, characteristic wherein can be a voltage level, voltage level is to the ratio of saturation level, or the like.The trigger condition of having programmed will be considered the data of photometric measurement when determining activation threshold value.
Therefore, Fig. 8 illustrates, and how to make measurement and reporting capabilities be incorporated into the cmos image sensor as Fig. 5.Yet the present invention is not limited only to use cmos image sensor, or does not limit in this respect and digital image sensor.On the contrary, measure the notion of electromagnetic radiation response, and use together with the measuring of knowledge, it is to control the knowledge of exposure that this knowledge comprises about sensor row, can get in touch any image sensing apparatus and together use.In one embodiment of the invention, a dot structure comprises a sensor device that comprises high resolving power and wide dynamic range, as what in patent application serial number (attorney docket 680-008U), describe, be entitled as " system and method for wide dynamic range photosensitive sensor element or array " and belong to Davidovich, for referencial use in this combined usefulness.In another embodiment, a dot structure has comprised a sensor device, as disclosed in patent application serial number (attorney docket 680-010), " wide dynamic range have the photosensitive sensor element of gain control or the system and method for array " belongs to Davidovich, filed same date, for referencial use in this combined usefulness.
Shown in Figure 9, comprise a pair of operational flowchart, not only can occur in representative communication between the element in order to explanation, and also have the step that can carry out by the measurement and the report logical circuit of functional module 102 and pixel 101.Flow process 70 comprised the step that can be carried out by functional module 102, and flow process 80 illustrated can be measured and step that report logical circuit 80 is carried out.Should be noted that Fig. 9's is an illustrative example, do not have restrictedly that explanation can be taked many multi-form equivalence, and has by hardware, software, or the part of both binding energy control.
When pixel structure exposure began, function block process was in step 72 beginning, for example when camera shutter is pressed.Functional module proceeds to step 73, and this place has gathered the status report from pixel groups, and every group comprises one or more pixels.
In step 82, during the imageing sensor running, measurement and reporting modules begin operation.For example, it can detect the voltage from imageing sensor.In step 84, but the measurement of sensor is monitored or collection goes to determine when dot structure is in report condition.When but definite dot structure was in report condition, this state was reported to the step 88 of functional module.
Functional module 102,240,340,440 analyze the status report that receives from one or more dot structures takes place to determine when an exposure termination trigger event.When trigger event takes place, functional module just stops exposure in step 76.Functional module can stop exposure to one or more pixels in the pel array based on trigger condition, and Here it is, and the present invention is not restricted to any collection of pixels marshalling exposure is stopped.In step 78, captured image is recorded in the storage medium.
In sum, about the assay method of time shutter following major advantage is arranged, when image was taken (or acquisition), time shutter settings finished, so reaches maximum accuracy.When image shoot process is carried out, determine the dirigibility of exposure end condition, have the advantage that the characteristic that makes time shutter and the image that is taken adapts and is complementary.
About embodiment shown in Figure 6, it has comprised photometric measurement and report in each dot structure, because the pel array that can buy on the market has wherein comprised a large amount of pixels, it becomes quite complicated.As the situation in digital camera photograph or video camera, significant image is the object of image taking normally, shows a high correlation between neighbor.High correlation between neighbor reflects that many data of reporting pixel output are excessive.
Figure 10 illustrates, another embodiment of the present invention, and one of them pel array 200 usefulness is less than all pixels of reporting their output states and arranges.The report pixel for example pixel 230,210 and 220 can entire pixel array with a rule or a pattern at random arrange.The high correlation of neighbor is used to limit the quantity of the report pixel that has minimal degradation in the image shoot process.Like this, the lower limit of report pixel quantity can be one, and the upper limit of report pixel quantity can equal the size of array.
Shown in Figure 11, another embodiment of the present invention is described, compare with Fig. 6 and Figure 10 and reduced complicacy.In Figure 11, pel array 300 pro-rata pixel groups are so that the collection of pixels marshalling that can report their output states.One group can the report output state pixel can comprise few to two and as many as can with the number of pixels that comprises in the array as many, yet all groups comprise the pixel of similar number.The report pixel groups of being made example by pixel groups 330,310 and 320 has comprised four pixels, they can entire pixel array with a rule or a pattern at random arrange.The lower limit of report pixel quantity can be one, and the upper limit of report pixel quantity can equal array size half.
Shown in Figure 12, the another one embodiment of also having of the present invention is described, wherein the collection of pixels that can report their output states time group.One group can the report output state pixel can comprise few to one and as many as can with the number of pixels that comprises in the array as many.Embodiment among Figure 12 is different among Figure 11, because each group can be different on size dimension.The report pixel groups of being made example by pixel groups 430,410 and 420 comprises one respectively, four and more than four pixel, and can entire pixel array with a rule or a pattern at random arrange.The lower limit of report pixel groups quantity can be one, and the upper limit of report pixel groups quantity can equal the size of array.
Therefore, a kind of usefulness has the dot structure of integrated exposure control and array and is used to control pixel array exposure time method and device and shows in various embodiments and describe.Thereby the present invention is by providing one to comprise that the improved image sensor of photometric measurement and reporting capabilities has overcome the difficult problem of prior art.Measurement and reporting capabilities can be used for the exposure of control chart image-position sensor under electromagnetic radiation, therefore, can allow exposure stop when imageing sensor has reached optimum exposure point or some other activation threshold value level.In addition, it allows in exposure is controlled in real time, rather than a secondary process of carrying out on image after the shooting.
The present invention has many advantages.First advantage is the intrinsic degree of accuracy of institute's describing method, and the data that are used for determining pixel array exposure obtain from the image just taken and shooting process simultaneously.Second advantage is that photometric measurement capability is incorporated in the dot structure, and this part thing itself guarantees just to consider the gain characteristic of any solid state image sensor when determining the correct exposure magnitude.Reducing energy consumption is the 3rd advantage, and this is because eliminated owing in a normally used method, require shooting process twice in order to determine the time shutter.Plurality of advantages of the present invention is conspicuous for this area those skilled in the art.
In describing numerous embodiments of the invention, that is to understand easily, and above-mentioned exactly many legends are the methods according to one embodiment of the present of invention, the flowchart text of device (system) and computer program product.The combination of block diagram in the block diagram of each flowchart text and the flowchart text can all be understood easily by performed these of computer program instructions.These computer program instructions can be loaded in the computer or in other programmable data treating apparatus to make a machine, like this so that the method that is used for being implemented in the specified function of one or more FB(flow block) has been set up in the instruction of carrying out in computer or other programmable data treating apparatus.These computer program instructions also can be stored in the reservoir of computer-readable, can order computer or other programmable data treating apparatus under specific mode, work, produce a kind of manufacturing a product of the instruction method of in one or more FB(flow block), realizing specified function that include so that be stored in instruction in the reservoir of computer-readable like this.Computer program instructions also can be loaded onto in computer or other programmable data treating apparatus and cause the step of a series of runnings in computer or other programmable devices to be performed, to produce a computer implementation so that the instruction of carrying out in computer or other programmable devices provides in one or more FB(flow block) the step that realizes specified function.
This area those skilled in the art should understand easily, the function that program limits among the present invention can be transmitted into computer in a variety of forms, include but not limited to: (a) for good and all be stored in the storing media that can not write information (for example, ROM (read-only memory) in the computer, as ROM or the CD-ROM CD that reads by computer I/O port), (b) (for example can be stored in the information that to write in the storing media with revising, floppy disk and hard disk drive) or (c) be transferred to the information of computer by telecommunication media, for example use baseband signal or broadband signal technology, comprised such as in computer by modulator-demodular unit or the carrier signal technology on the telephone network.
More than description and legend have comprised various treatment steps and parts, with the performed operation of explanation the present invention.Yet, should be noted that although some parts and step have been described, this explanation only is representative, other functional descriptions or additional step and parts can be added by this area those skilled in the art, therefore the invention is not restricted to described concrete all embodiment.In addition, should be noted that the hardware that various representative key elements can be moved is realized in software or both combinations on a computer.
By the described the present invention of above-mentioned all exemplary embodiments, those of ordinary skill in the art should understand easily, and the embodiment in the marginal data can make amendment in not departing from the inventive concept scope of being showed and change.Therefore, except the scope and essence of accessory claim, this invention should not be regarded as restricted.
Claims (38)
1. a pixel array (300,400) comprises:
A plurality of dot structures (12) comprise a plurality of dot structure report groups (310,320,330,410,420,430), and each group in the described dot structure report group all comprises at least one report dot structure, comprising:
An imageing sensor,
The device (63) that is used for the output that the measurement image sensor generates in response to the electromagnetic radiation that receives, this device comprise the measurement and the report logical circuit of the report (54) of the state that is used to generate sign pixel output signal voltage, and
Exposure control unit, this exposure control unit is connected to reception from a plurality of dot structure report groups (310,320,330,410,420,430) a plurality of reports, and the state in response to the output of report dot structure in a plurality of reception reports (54) determines whether that an exposure stops trigger event and takes place, and satisfies the state that exposure stops trigger event in response to the output of report dot structure, stops the exposure of pixel array.
2. by the described pixel array of claim 1 (300,400), it is characterized in that described exposure control unit is integrated into pixel array (300,400) and handles the described report that receives (54) to determine whether that an exposure stops trigger event and takes place.
3. by the described pixel array (300 of claim 1,400), it is characterized in that described exposure control unit and pixel array (300,400) link together and handle the described report that receives (54) to determine whether that an exposure stops trigger event and takes place.
4. by the described pixel array of claim 1 (300,400), it is characterized in that each pixel report group (310,320,330,410,420,430) provides a report to this exposure control unit.
5. by the described pixel array of claim 1 (300,400), it is characterized in that described state is selected from least one the group that comprises in following: output reaches the minimum essential requirement level; Export the level that reaches capacity; Output valve is in first predetermined state that is higher than described minimum level and is lower than described saturated level; Output valve is in and is higher than described minimum level, is lower than described saturated level and is different from second predetermined state of described first predetermined state.
6. by the described pixel array of claim 4 (300,400), it is characterized in that described report group (310,320,330,410,420,430) comprise a plurality of dot structures, and the only state of the response of a pixel in the pixel of this report group has been reported in the report of described report group.
7. by the described pixel array of claim 4 (300,400), it is characterized in that described report group (310,320,330,410,420,430) comprise a plurality of dot structures, and the state more than the response of a pixel in the pixel of this report group has been reported in the report of described report group.
8. by the described pixel array of claim 1 (300,400), it is characterized in that this exposure control unit has taken place in response to an exposure termination of expression trigger event and this trigger event is the termination that exposure is controlled in programmable report.
9. by the described pixel array of claim 1 (300,400), but it is characterized in that the described device that is used to generate report is a dynamic programming.
10. by the described pixel array of claim 8 (300,400), at least two reports providing by at least two report groups that are associated are provided, reported response from different number of pixels in described at least two report groups that are associated.
11., it is characterized in that each group in a plurality of pixel report groups (310,320,330,410,420,430) can provide one group of many parts of report to this exposure control unit by the described pixel array of claim 1 (300,400).
12. by the described pixel array of claim 11 (300,400), it is characterized in that this exposure control unit handles one group of many parts of report to determine the exposure to this pixel array.
13. by the described pixel array of claim 12 (300,400), it is characterized in that one group of many parts of report has comprised one to the report in the response of one of them pixel of the pixel groups that is associated.
14. by the described pixel array of claim 12 (300,400), it is characterized in that one group of many parts of report has comprised a report more than the state of the response of a pixel in the pixel groups that is associated.
15. by the described pixel array of claim 11 (300,400), many parts of reports that it is characterized in that the many groups of this exposure control unit processing are to determine the exposure to this pixel array.
16., it is characterized in that a report in the many parts of reports has comprised a report in the response of one of them pixel of the pixel groups that is associated by the described pixel array of claim 15 (300,400).
17. by the described pixel array of claim 15 (300,400), it is characterized in that a report in the many parts of reports has comprised a report more than the response of a pixel in the pixel groups that is associated.
18. by the described pixel array of claim 15 (300,400), it is characterized in that more than at least two part of report providing by at least two groups that are associated, reported response from the pixel of different numbers in these at least two groups that are associated.
19. by the described pixel array (300 of claim 1,400), it is characterized in that this exposure control unit handles to determine whether to have taken place trigger event described report, and wherein, described trigger event has comprised at least one in the following indication: reached the indication of a maximum exposure time of setting in advance; All report pixels in the pixel array have been reported the indication that reaches a minimum output signal; At least one pixel has been reported the indication of the output saturation value that reaches it; Adjust the pixel of number in advance and reported the indication that reaches the output signal saturation value; Adjust the pixel of number in advance and reported the indication that reaches minimum output signal; Reported greater than the certain number of pixels of first prior preset threshold and to have reached the output signal saturation value and to have reported the indication that reaches minimum output signal greater than the certain number of pixels of second prior preset threshold; Or the indication that taken place of combination of exposure end condition.
20. a method of controlling pixel array exposure, described pixel array has comprised a plurality of dot structure groups (310,320,330,410,420,430), and wherein each at least one group comprises a report dot structure, and the step that this method comprises has:
At each report dot structure place, by measuring and the report logical circuit is measured the output that the electromagnetic radiation in response to receiving of the imageing sensor of this report dot structure generates, and the report (54) that generates the state of pixel output signal voltage;
At least one report that processing is received from least one the dot structure winding that has comprised a report dot structure takes place to determine whether an exposure termination trigger event, and
The state that exposure stops trigger event is satisfied in output in response to the report dot structure, stops the exposure of pixel array.
21. by the described method of claim 20, each pixel groups that it is characterized in that comprising a report pixel produces a report.
22. by the described method of claim 21, it is characterized in that described state is selected from least one the group that comprises in following: output reaches the minimum essential requirement level; Export the level that reaches capacity; Output valve is in first predetermined state that is higher than described minimum level and is lower than described saturated level; Output valve is in and is higher than described minimum level, is lower than described saturated level and is different from second predetermined state of described first predetermined state.
23. by the described method of claim 22, it is characterized in that a report (54) reported the response of a pixel in all pixels in this pixel groups.
24. by the described method of claim 22, it is characterized in that a report (54) reported the response more than a pixel in all pixels in this pixel groups.
25. by the described method of claim 21, it is characterized in that stopping step of exposing is the response that the report more than that receives from all pixel groups that comprise a report dot structure is made.
26. by the described method of claim 25, it is characterized in that the response of a pixel in a plurality of pixels at least one report (54) has been reported with this at least one report is associated the pixel groups.
27. by the described method of claim 25, it is characterized in that at least one report (54) has been reported with this at least one report is associated the pixel groups the response in a plurality of pixels more than one pixel.
28. by the described method of claim 25, it is characterized in that having reported response from the pixel of different numbers in described at least two groups that are associated by at least two reports that at least two groups that are associated provide.
29. by the described method of claim 20, it is characterized in that at least one group of Zhu Zuzhong comprised a large amount of report pixels, and wherein stop step of exposing and operate in response to a group or more groups of many parts of reports that receive from one or more pixel groups.
30. by the described method of claim 29, it is characterized in that stopping step of exposing only in response to operating from more than one group part of report of a pixel groups.
31., it is characterized in that one group of many parts of report has comprised a report to the response of a pixel in the pixel groups that is associated by the described method of claim 30.
32. by the described method of claim 30, it is characterized in that one group of many parts of report has comprised one to the report more than the response of a pixel in the pixel groups that is associated.
33. by the described method of claim 28, it is characterized in that stopping step of exposing and the exposure of this pixel array operated determining in response to many parts of reports of many groups.
34., it is characterized in that one group of many parts of report has comprised a report to the response of a pixel in the pixel groups that is associated at this by the described method of claim 33.
35. by the described method of claim 33, it is characterized in that one group of many parts of report has comprised one to the report more than the response of a pixel in the pixel groups that is associated at this.
36. by the described method of claim 33, it is characterized in that many parts of reports of at least two groups of providing by at least two groups that are associated, reported response from the pixel of different numbers in described at least two groups that are associated.
37., it is characterized in that described trigger event has comprised at least one in the following indication: reached the indication of a maximum exposure time of setting in advance by the described method of claim 20; All report pixels have been reported the indication that reaches a minimum output signal value in the pixel array; At least one pixel has been reported the indication of the output signal saturation value that reaches it; Adjust the pixel of number in advance and reported the indication that reaches the output signal saturation value; Adjust the pixel of number in advance and reported the indication that reaches minimum output signal value; Reported greater than the certain number of pixels of first prior preset threshold and to have reached the output signal saturation value and to have reported the indication that reaches minimum output signal greater than the certain number of pixels of second prior preset threshold; Or the indication that taken place of combination of exposure end condition.
38. a report dot structure, this report dot structure comprises:
An imageing sensor;
Be used to measure the device of described imageing sensor to the response of the electromagnetic radiation that receives;
Be used for providing the device of report of state of the response of imageing sensor to exposure control unit; And
Be used in response to input signal from described exposure control unit, stop the device of described imageing sensor to the exposure of the described electromagnetic radiation that receives, wherein, the described input signal that receives is generated in response to a plurality of reports that receive from a plurality of report dot structures by described exposure control unit.
Applications Claiming Priority (9)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US71930405P | 2005-09-21 | 2005-09-21 | |
| US71930505P | 2005-09-21 | 2005-09-21 | |
| US71930605P | 2005-09-21 | 2005-09-21 | |
| US60/719,306 | 2005-09-21 | ||
| US60/719,305 | 2005-09-21 | ||
| US60/719,304 | 2005-09-21 | ||
| US72789705P | 2005-10-18 | 2005-10-18 | |
| US60/727,897 | 2005-10-18 | ||
| PCT/US2006/036793 WO2007035860A2 (en) | 2005-09-21 | 2006-09-21 | System and method for image sensor element or array with photometric and realtime reporting capabilities |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101365930A CN101365930A (en) | 2009-02-11 |
| CN101365930B true CN101365930B (en) | 2011-08-17 |
Family
ID=40391451
Family Applications (4)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2006800421413A Expired - Fee Related CN101454901B (en) | 2005-09-21 | 2006-09-21 | Broad dynamic range light-sensitive element or array system and method with gain control |
| CN2006800421964A Expired - Fee Related CN101365930B (en) | 2005-09-21 | 2006-09-21 | System and method for image sensor element or array with photometric and realtime reporting capabilities |
| CN2006800421343A Expired - Fee Related CN101454649B (en) | 2005-09-21 | 2006-09-21 | System and method for a high dynamic range sensitive sensor element array |
| CN200680042054.8A Expired - Fee Related CN101512543B (en) | 2005-09-21 | 2006-09-21 | High resolution and wide dynamic range integrator |
Family Applications Before (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2006800421413A Expired - Fee Related CN101454901B (en) | 2005-09-21 | 2006-09-21 | Broad dynamic range light-sensitive element or array system and method with gain control |
Family Applications After (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2006800421343A Expired - Fee Related CN101454649B (en) | 2005-09-21 | 2006-09-21 | System and method for a high dynamic range sensitive sensor element array |
| CN200680042054.8A Expired - Fee Related CN101512543B (en) | 2005-09-21 | 2006-09-21 | High resolution and wide dynamic range integrator |
Country Status (1)
| Country | Link |
|---|---|
| CN (4) | CN101454901B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9347890B2 (en) * | 2013-12-19 | 2016-05-24 | Kla-Tencor Corporation | Low-noise sensor and an inspection system using a low-noise sensor |
| CN111345032B (en) * | 2019-05-15 | 2021-12-31 | 合刃科技（深圳）有限公司 | Image sensor, light intensity sensing system and method |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6809358B2 (en) * | 2002-02-05 | 2004-10-26 | E-Phocus, Inc. | Photoconductor on active pixel image sensor |
Family Cites Families (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4419692A (en) * | 1981-12-31 | 1983-12-06 | Texas Medical Instruments, Inc. | High speed infrared imaging system |
| US4629879A (en) * | 1984-06-11 | 1986-12-16 | Eastman Kodak Company | Light beam intensity controlling apparatus |
| US5416616A (en) * | 1990-04-06 | 1995-05-16 | University Of Southern California | Incoherent/coherent readout of double angularly multiplexed volume holographic optical elements |
| KR100396203B1 (en) * | 1993-06-17 | 2003-12-31 | 소니 가부시끼 가이샤 | Exposure apparatus and method, video camera having the exposure apparatus |
| WO1996021270A1 (en) * | 1994-12-30 | 1996-07-11 | Philips Electronics N.V. | Circuit and method for generating accurate quadrature signals |
| CA2238534C (en) * | 1996-09-27 | 2001-10-09 | Markus Bohm | Local autoadaptive optical sensor |
| US6188056B1 (en) * | 1998-06-24 | 2001-02-13 | Stmicroelectronics, Inc. | Solid state optical imaging pixel with resistive load |
| US6757018B1 (en) * | 1998-12-18 | 2004-06-29 | Agilent Technologies, Inc. | CMOS image sensor with pixel level gain control |
| US6821245B2 (en) * | 2000-07-14 | 2004-11-23 | Xillix Technologies Corporation | Compact fluorescence endoscopy video system |
| JP3852324B2 (en) * | 2001-02-20 | 2006-11-29 | ティアック株式会社 | Signal processing circuit and signal processing method |
| US6867693B1 (en) * | 2001-07-25 | 2005-03-15 | Lon B. Radin | Spatial position determination system |
-
2006
- 2006-09-21 CN CN2006800421413A patent/CN101454901B/en not_active Expired - Fee Related
- 2006-09-21 CN CN2006800421964A patent/CN101365930B/en not_active Expired - Fee Related
- 2006-09-21 CN CN2006800421343A patent/CN101454649B/en not_active Expired - Fee Related
- 2006-09-21 CN CN200680042054.8A patent/CN101512543B/en not_active Expired - Fee Related
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6809358B2 (en) * | 2002-02-05 | 2004-10-26 | E-Phocus, Inc. | Photoconductor on active pixel image sensor |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101454901A (en) | 2009-06-10 |
| CN101512543B (en) | 2013-04-24 |
| CN101454649B (en) | 2011-04-27 |
| CN101454901B (en) | 2011-04-27 |
| CN101512543A (en) | 2009-08-19 |
| CN101365930A (en) | 2009-02-11 |
| CN101454649A (en) | 2009-06-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US7800669B2 (en) | System and method for image sensor element or array with photometric and realtime reporting capabilities | |
| EP3611916B1 (en) | Imaging control method and electronic device | |
| US9357138B2 (en) | Image capture apparatus, method of controlling image capture apparatus, and electronic device | |
| US8988567B2 (en) | Multiple image high dynamic range imaging from a single sensor array | |
| CN104301635B (en) | Produce the method and imaging system of digital picture | |
| US8767091B2 (en) | Determining a final exposure setting automatically for a solid state camera without a separate light metering circuit | |
| CN101399923B (en) | Imaging apparatus, imaging method | |
| CN102396235B (en) | Producing full-color image with reduced motion blur | |
| US7176976B2 (en) | Autoexposure methodology in a digital camera | |
| JP2009509474A5 (en) | ||
| CN101662586A (en) | Image capturing apparatus capable of displaying live preview image | |
| JP2007259450A (en) | Method and apparatus for capturing interleaved image | |
| US20110150357A1 (en) | Method for creating high dynamic range image | |
| CN112118388B (en) | Image processing method, image processing device, computer equipment and storage medium | |
| CN104025574A (en) | Imaging apparatus and image processing method | |
| CN101841653A (en) | Filming apparatus and angle-of-view adjusting method | |
| US7193650B2 (en) | Image sensing apparatus | |
| CN101365930B (en) | System and method for image sensor element or array with photometric and realtime reporting capabilities | |
| US8063979B2 (en) | Digital camera displaying moving image and exposure control method thereof | |
| US6295138B1 (en) | Electronic image sensing apparatus | |
| JP2018005161A (en) | Control device, image capturing device, control method, program, and storage medium | |
| CN111345032B (en) | Image sensor, light intensity sensing system and method | |
| JPH05110954A (en) | Image pickup device | |
| CN115134498A (en) | Image sensor, camera module, electronic equipment and image processing method | |
| JP2006352433A (en) | Digital camera and control method thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20110817 Termination date: 20160921 |