CN108282623A - Image-forming component, imaging device and image information processing method - Google Patents
Image-forming component, imaging device and image information processing method Download PDFInfo
- Publication number
- CN108282623A CN108282623A CN201810079401.9A CN201810079401A CN108282623A CN 108282623 A CN108282623 A CN 108282623A CN 201810079401 A CN201810079401 A CN 201810079401A CN 108282623 A CN108282623 A CN 108282623A
- Authority
- CN
- China
- Prior art keywords
- current
- pixel
- electric current
- image
- forming component
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/40—Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/70—SSIS architectures; Circuits associated therewith
Abstract
This application involves a kind of image-forming components, including：Multiple sensor devices of pixel are arranged as, for receiving the light from imaging object and the light being converted to switching current；Electric current unit for scaling, for being zoomed in and out to the switching current to obtain processes pixel electric current；Spill current acquiring unit, N times of the average value of the processes pixel electric current of the surrounding pixel for the processes pixel electric current for being directed to each pixel to be subtracted to the pixel to obtain spill current；And AD conversion unit, for carrying out analog-to-digital conversion based on the spill current to obtain the side information of the imaging object.In this way, the side information of object directly, can be obtained quickly and correctly.
Description
Technical field
This application involves imaging fields, more specifically, be related to the side information for obtaining object image-forming component,
Imaging device and image information processing method.
Background technology
Current era, the surge development of artificial intelligence, affects the production and life of people, while also pushing in all its bearings
The development and progress in the world.
And a critically important aspect in artificial intelligence, it is exactly the automatic identification of image or video.How standard is quickly obtained
The image or video data really refined is a major challenge of sensor field in order to which neural network carries out automatic identification.
Therefore, it is necessary to improved image-forming component, imaging device and the image information processing methods for obtaining image information.
Invention content
In order to solve the above-mentioned technical problem, it is proposed that the application.Embodiments herein provides image-forming component, imaging is set
Standby and image information processing method can directly, quickly and correctly obtain the side information of object.
According to the one side of the application, a kind of image-forming component is provided, including：Multiple sensor devices of pixel are arranged as,
For receiving the light from imaging object and the light being converted to switching current；Electric current unit for scaling, for described
Switching current is zoomed in and out to obtain processes pixel electric current；Spill current acquiring unit, for that will be directed at the pixel of each pixel
Reason electric current subtracts N times of the average value of the processes pixel electric current of the surrounding pixel of the pixel to obtain spill current；And modulus
Converting unit, for carrying out analog-to-digital conversion based on the spill current to obtain the side information of the imaging object.
In above-mentioned image-forming component, the sensor devices are sensor devices for being directly realized by opto-electronic conversion or are used for
The sensor devices of opto-electronic conversion are realized indirectly.
In above-mentioned image-forming component, the light from imaging object is the light or institute that the imaging object is sent out
State the light of imaging object reflection.
In above-mentioned image-forming component, further comprise at least one of lens unit and filter unit；And it is described more
A sensor devices be used to receive via at least one of the lens unit and filter unit transmit from imaging object
Light.
In above-mentioned image-forming component, the switching current includes at least one of leakage current and bias current.
In above-mentioned image-forming component, the current conversion unit includes one of following：Current mirror, for scaling
Switching current is stated to obtain processes pixel electric current；Conversion circuit is zoomed in and out for the switching current to be converted to voltage
To obtain processes pixel electric current；With circuit is directly scaled, for directly zooming in and out the switching current to obtain at pixel
Manage electric current.
In above-mentioned image-forming component, the conversion circuit is used for：The switching current is converted into voltage；And with institute
It states voltage and generates amplification electric current to obtain the processes pixel electric current.
In above-mentioned image-forming component, the conversion circuit comprises only source device, or including active device and passive device
Both parts.
In above-mentioned image-forming component, the processes pixel electric current includes the leakage current and mistake that the electric current unit for scaling generates
Spill current and the bias current of addition.
In above-mentioned image-forming component, the spill current acquiring unit is used for by described in one way in which below acquisition
Spill current：By the processes pixel electric current of the surrounding pixel of the pixel be added again divided by the number M of the surrounding pixel multiplied by with
N；1/M times of the processes pixel electric current of the surrounding pixel of the pixel is added multiplied by with N；And it will be around the pixel
N/M times of the processes pixel electric current of pixel is added.
In above-mentioned image-forming component, the N is integer or decimal.
In above-mentioned image-forming component, further comprise：Spill current unit for scaling, for the spill current zoom in and out with
Spill current after being scaled；And the AD conversion unit is used to carry out analog-to-digital conversion to the spill current after the scaling
To obtain the side information of the imaging object.
In above-mentioned image-forming component, the multiple sensor devices are with the arrangement shape similar with the photoreceptor of biological retina
Formula is arranged.
According to the another aspect of the application, a kind of imaging device is provided, including：Image-forming component as described above；And
Processing unit carries out image procossing for the side information based on the imaging object.
According to the application's in another aspect, providing a kind of image information processing method, including：It receives and comes from imaging object
Light；The light is converted to switching current by multiple sensor devices to be arranged as pixel；The switching current is carried out
Scaling is to obtain processes pixel electric current；The picture of the surrounding pixel of the pixel will be subtracted for the processes pixel electric current of each pixel
N times of the average value of element processing electric current is to obtain spill current；And it is described to obtain based on spill current progress analog-to-digital conversion
The side information of imaging object.
In above-mentioned image information processing method, the sensor devices are the sensor devices for being directly realized by opto-electronic conversion
Or the sensor devices for realizing opto-electronic conversion indirectly.
In above-mentioned image information processing method, the light from imaging object is the light that the imaging object is sent out
Line or the light of imaging object reflection.
In above-mentioned image information processing method, receiving the light from imaging object includes：It receives via lens unit
With the light from imaging object of at least one of filter unit transmission.
In above-mentioned image information processing method, the switching current includes at least one in leakage current and bias current
It is a.
In above-mentioned image information processing method, the switching current is zoomed in and out includes to obtain processes pixel electric current
One of below：The switching current is scaled to obtain processes pixel electric current by current mirror；The switching current is turned
It is changed to voltage and zooms in and out to obtain processes pixel electric current；With directly the switching current is zoomed in and out to obtain pixel
Handle electric current.
In above-mentioned image information processing method, the switching current is converted into voltage and is zoomed in and out to obtain pixel
Handling electric current includes：The switching current is converted into voltage by conversion circuit；And amplification electric current is generated with the voltage
To obtain the processes pixel electric current.
In above-mentioned image information processing method, the conversion circuit comprises only source device, or including active device
Both with passive device.
In above-mentioned image information processing method, the processes pixel electric current include the switching current is zoomed in and out and
The leakage current and error current of generation and the bias current of addition.
In above-mentioned image information processing method, the spill current is obtained by one way in which below：It will be described
The processes pixel electric current of the surrounding pixel of pixel is added again divided by the number M of the surrounding pixel is multiplied by with N；By the pixel
1/M times of the processes pixel electric current of surrounding pixel is added multiplied by with N；And by the processes pixel of the surrounding pixel of the pixel
N/M times of electric current is added.
In above-mentioned image information processing method, the N is integer or decimal.
In above-mentioned image information processing method, further comprise after obtaining the spill current：To the spill current
It zooms in and out with the spill current after being scaled；And analog-to-digital conversion is carried out to obtain the imaging object based on the spill current
The side information of body includes：Analog-to-digital conversion is carried out to the spill current after the scaling with the edge for obtaining the imaging object to believe
Breath.
In above-mentioned image information processing method, the multiple sensor devices are with similar with the photoreceptor of biological retina
Arrangement form arrangement.
Compared with prior art, using the image-forming component, imaging device and Image Information Processing according to the embodiment of the present application
Method can directly, quickly and correctly obtain the side information of object.
Description of the drawings
By reading the detailed description in hereafter preferred embodiment, the application various other advantage and benefit
Those of ordinary skill in the art will become clear.Figure of description only for the purpose of illustrating preferred embodiments,
And it is not considered as the limitation to the application.It should be evident that drawings discussed below is only some embodiments of the present application,
For those of ordinary skill in the art, without creative efforts, it can also be obtained according to these attached drawings
Other attached drawings.And throughout the drawings, identical component is presented with like reference characters.
Fig. 1 illustrates the schematic block diagrams according to the image-forming component of the embodiment of the present application.
Fig. 2 illustrates the contrast schematic diagram that human eye retina experiences pattern and artificial imitative retina circuit model.
Fig. 3 illustrates the circuit diagram of each pixel unit in the image-forming component according to the embodiment of the present application.
Fig. 4 illustrates the schematic block diagram of the imaging device according to the embodiment of the present application.
Fig. 5 illustrates the schematic flow chart of the image information processing method according to the embodiment of the present application.
Specific implementation mode
In the following, example embodiment according to the application will be described in detail by referring to the drawings.Obviously, described embodiment is only
Only it is a part of the embodiment of the application, rather than the whole embodiments of the application, it should be appreciated that the application is not by described herein
The limitation of example embodiment.
Application is summarized
As described above, in image or video identification, need to be imaged object, and obtains corresponding image letter
Breath.
Imaging sensor is generally divided into charge coupling device (CCD) sensor and complementary metal oxide semiconductor (CMOS)
Sensor.Wherein, ccd sensor has power consumption high, and ratio of defects is high, the shortcomings of being not easy to integrate with processing circuit.And CMOS is passed
Sensor has many advantages, such as low in energy consumption, easily integrates, becomes more and more popular with processing circuit.
The basic functional principle of cmos sensor is：Light sensitive diode is reset to a certain voltage Vrst, then starts to expose
Light；The light of reception is converted into electric current by photodiode, and to itself, parasitic capacitance discharges；Deng a period of time exposure knot
Beam, the voltage of light sensitive diode is Vo at this time；Δ V=Vrst-Vo is calculated, Δ V is quantified, the brightness of pixel is finally obtained.
But above-mentioned cmos sensor still has defect.First, image information redundancy, data volume is big；Second, Qiang Guang
Lower easily saturation；Third, it is very big that shooting speed is illuminated by the light intensity effect；4th, quantify due to the use of row scanning sample, so shooting
Speed is difficult to improve.
In view of the above technical problems, the basic conception of the embodiment of the present application be propose a kind of image-forming component, imaging device and
Image information processing method can only extract the brightness space gradient signal of object, and directly to the analog current of photosensitive element
It is operated.Therefore, by only extracting the brightness space gradient signal of object, data redundancy can be significantly reduced, to not
While reducing the performances such as discrimination, required data transfer bandwidth is correspondingly reduced, the working efficiency of system is improved.And
And by directly being operated to the analog current of photosensitive element, and the step of intermediate conversion is at voltage is omitted, eliminates light
Strong limitation.In addition, since sample rate is unrelated with light intensity, high-speed capture can be kept under strong light, weak light.Moreover, by with mould
Quasi- circuit is directly realized by analog current and poor calculating, avoids the Design of Digital Circuit of follow-up complexity, reduces image-forming component
Power consumption and area.
Here, image can be used for according to the image-forming component of the embodiment of the present application, imaging device and image information processing method
Shooting, video record, so as to be widely used in artificial intelligence field, such as image recognition, video identification is driven automatically
It sails, unmanned aerial vehicle (UAV) control etc..
After describing the basic principle of the application, carry out the specific various non-limits for introducing the application below with reference to the accompanying drawings
Property embodiment processed.
Exemplary image-forming component
Fig. 1 illustrates the schematic block diagrams according to the image-forming component of the embodiment of the present application.
As shown in Figure 1, the image-forming component 100 according to the embodiment of the present application includes：It is arranged as multiple sensor devices of pixel
110, for receiving the light from imaging object and the light being converted to switching current；Electric current unit for scaling 120, is used for
The switching current generated to the sensor devices 110 is zoomed in and out to obtain processes pixel electric current；Spill current acquiring unit
130, the surrounding pixel for the electric current unit for scaling 120 to be subtracted to the pixel for the processes pixel electric current of each pixel
N times of average value of processes pixel electric current to obtain spill current；And AD conversion unit 140, for based on the difference electricity
It flows the spill current that acquiring unit 130 obtains and carries out analog-to-digital conversion to obtain the side information of the imaging object.
Therefore, the brightness space gradient signal that object can be only extracted according to the image-forming component of the embodiment of the present application 100, from
And significantly reduce data redundancy.Because in image or video identification, the side information of object eliminates incoherent information,
And remain the important structure attribute of image.Therefore, by obtaining the side information of object, the property such as discrimination can not reduced
In the case of energy, required data transfer bandwidth is reduced, and improves the working efficiency of system.
In addition, directly the analog current of photosensitive element is operated according to the image-forming component 100 of the embodiment of the present application, and
It is not to be converted into voltage to be operated again so that do not limited by light intensity.Moreover, because sample rate is unrelated with light intensity, in strong light
High-speed capture can be kept under dim light.
In the image-forming component 100 according to the embodiment of the present application, the spill current acquiring unit 130 can be by simulating electricity
Road, specifically, analog current adder and analog current subtracter are directly realized by analog current and poor calculating.In this way, keeping away
The Design of Digital Circuit for having exempted from follow-up complexity also correspondingly reduces the power consumption and area of image-forming component.
Moreover, in the image-forming component 100 according to the embodiment of the present application, the multiple sensor devices 110 for being arranged as pixel are real
The parallel synchronous sampling of all pixels is showed, this can significantly improve frame number.
Here, sensor devices 110 can be the sensor devices for being directly realized by opto-electronic conversion, for example, photodiode or
Person's phototriode.Alternatively, sensor devices 110 can also be the sensor devices for realizing opto-electronic conversion indirectly, for example, it is photosensitive
Resistance.It, can be with it will be understood by those skilled in the art that during according to the realization of the image-forming component 100 of the embodiment of the present application
The sensor devices of selection appropriate type are required according to specific requirement, such as actual process.
In the image-forming component 100 according to the embodiment of the present application, sensor devices 110 receive the light from imaging object,
Here, the light from imaging object can be that light that the imaging object is sent out or the imaging object are anti-
The light penetrated.
Also, the light from imaging object can be from imaging object direct irradiation on sensor devices 110 light
Line can also be to be radiated at the light on sensor devices 110 via other optical devices, such as lens or optical filter etc..And
And here, the light from imaging object can be visible light, can also be infrared or ultraviolet equal non-visible lights,
Can be other rays.
Therefore, in the image-forming component 100 according to the embodiment of the present application, it may further include lens unit and filter single
At least one of member；And the multiple sensor devices 110 are for receiving via in the lens unit and filter unit
The light from imaging object of at least one transmission.
The sensor devices 110 by the light during being converted to switching current, in addition to being converted by the light
And the electric current itself come is outer, it is also possible to introduce some other leakage currents.Furthermore it is possible to which some biasings are added in switching current
Electric current so that component is operated in suitable operation interval, the error introduced with the difficulty and technique that reduce circuit design.
Therefore, in the image-forming component 100 according to the embodiment of the present application, the switching current of the generation of the sensor devices 110
Including leakage current and/or bias current.
The electric current unit for scaling 120 be used for the switching current that the sensor devices 110 generate zoom in and out with
Processes pixel electric current is obtained, also, in the image-forming component 100 according to the embodiment of the present application, the electric current unit for scaling 120 can
With there are many ways of realization.
Specifically, the electric current unit for scaling 120 may include current mirror, for contracting to the switching current
It puts to obtain processes pixel electric current.In addition, the electric current unit for scaling 120 may include conversion circuit, it is used for the conversion
Electric current is converted to voltage, then is zoomed in and out to the voltage, and the voltage after scaling is converted to electric current to obtain pixel again later
Handle electric current.Certainly, the electric current unit for scaling 120 can also include directly scaling circuit, for directly to conversion electricity
Stream is zoomed in and out to obtain processes pixel electric current.
Wherein, in the case where the switching current is converted to voltage using conversion circuit, can turn first by described
It changes electric current and is converted to voltage, then the voltage by being converted to generates amplification electric current, finally obtains the processes pixel electric current.And
And the conversion circuit can comprise only source device, can also not only include active device but also include passive device.
Since under different illumination conditions, the curent change range of sensor devices 110 is very big, therefore according to the application
In the image-forming component 100 of embodiment, electric current unit for scaling 120 is needed to contract come the switching current generated to sensor devices 110
It puts.Specifically, in the case where illumination is very weak, sensor devices 110 generate switching current it is too small, it is not easy to be used directly into
Row is effectively treated, and needs Current amplifier difficulty and the complexity etc. to reduce subsequent processes circuit at this time；In addition, illumination very
In the case of strong, the switching current that sensor devices 110 generate is excessive, needs to reduce collected electric current again to reduce power consumption at this time
Deng.
Therefore, by the electric current unit for scaling 120, the influence that the illumination of light is brought can be minimized.
Also, during the switching current that zooms in or out is to obtain the processes pixel electric current, the electricity
Stream unit for scaling 120 can also introduce leakage current and error current.Correspondingly, in the processes pixel electric current of acquisition, also may be used
To add bias current or voltage, to reduce the error of the difficulty and technique introducing of circuit design.
Therefore, in the image-forming component 100 according to the embodiment of the present application, the processes pixel electric current includes the electric current contracting
Put the leakage current and error current and the bias current of addition that unit 120 generates.
The spill current acquiring unit 130 is used to be directed to each pixel, its processes pixel electric current is subtracted the pixel
N times of the average value of the processes pixel electric current of surrounding pixel is to obtain spill current.That is, the spill current acquiring unit
130 obtain the processes pixel electric current corresponding to the sensor devices 110 of each pixel (that is, the sensor devices 110 convert light
For switching current it is scaled after obtain) and corresponding to the pixel surrounding pixel sensor devices 110 processes pixel
Spill current between electric current.Also, the spill current is that the processes pixel electric current of the sensor devices 110 subtracts surrounding sense
N times of the average value of the processes pixel electric current of optical device is the electric current performance of the brightness space gradient information of object.
In the image-forming component 100 according to the embodiment of the present application, the arrangement shape of sensor devices 110 can be set as required
Shape, such as triangle, quadrangle, pentagon, hexagon etc. possibly even only include one or two of up and down or left and right
A neighboring photosensitive device.In addition, the adjacent pixel about some pixel, either the pixel of direct neighbor, in can also be
Between between be separated with other pixels indirect neighbor pixel, this can determine according to the complexity of circuit and the fineness at edge
Justice.Specifically, M can be the arbitrary number between 1 to 10000.
Wherein, the N is integer or decimal.Here, the value of N is determined by pixel size and process characteristic, to
It reduces the complexity of subsequent conditioning circuit and improves picture quality.Specifically, N can be the arbitrary number between 0.01 to 10000.
Specifically, the spill current acquiring unit 130 can obtain the spill current in several ways.For example, institute
Can first the processes pixel electric current of the surrounding pixel of the pixel be added by stating spill current acquiring unit 130, then divided by the week
The number M of pixel is enclosed to obtain the average value, is finally multiplied by N to obtain the spill current.In addition, the spill current obtains list
1/M times of the processes pixel electric current of the surrounding pixel of the pixel can be added to obtain the average value by member 130, multiplied by with
N is to obtain the spill current.Also, the spill current acquiring unit 130 can also be directly by the surrounding pixel of the pixel
N/M times of processes pixel electric current is added, to obtain the spill current.It, can be according to design during concrete implementation
Actual needs chooses corresponding analog circuit, to directly carry out operation to analog current.
The AD conversion unit 140 directly carries out current mode analog-to-digital conversion to the spill current, to obtain the imaging
The side information of object, to realize the side information digitlization of object.
Further optionally, in the image-forming component 100 according to the embodiment of the present application, it may further include spill current contracting
Unit is put, for being zoomed in and out to the spill current with the spill current after being scaled.Also, the AD conversion unit 140
For carrying out analog-to-digital conversion to the spill current after the scaling to obtain the side information of the imaging object.
It is similar with above-mentioned switching current, if spill current is too small, it is not easy to be used directly to be effectively treated, need at this time
Spill current is amplified into difficulty and the complexity etc. to reduce subsequent processes circuit；And if spill current is excessive, it is likely to result in
Unnecessary power consumption will carry out diminution processing at this time.
As described above, the image-forming component 100 according to the embodiment of the present application can be applied to artificial intelligence field, with to image
It is identified with video.Therefore, in one example, human eye can be copied according to the image-forming component of the embodiment of the present application 100
Modified Retinal Model is arranged.
Fig. 2 illustrates the contrast schematic diagram that human eye retina experiences pattern and artificial imitative retina circuit model.Such as Fig. 2 institutes
Show, the light sensitive diode, analog current adder, electric current scaling element and analog current in artificial imitative retina circuit model subtract
Musical instruments used in a Buddhist or Taoist mass corresponds respectively to photoreceptor, ganglion cell, Beale's ganglion cells and horizontal cell in human eye.
Also, it will be understood by those skilled in the art that the image-forming component 100 according to the embodiment of the present application cannot be only used for imitating
According to human eye retina, the retina for copying other biologies can be used for.
Therefore, in the image-forming component 100 according to the embodiment of the present application, the multiple sensor devices 110 with biology to regard
The arrangement form that the photoreceptor of nethike embrane is similar is arranged.
As described above, in order to directly, quickly and correctly obtain object side information, according to the embodiment of the present application at
Element 100 is realized with analog circuit.Fig. 3 illustrates the electricity of each pixel unit in the image-forming component according to the embodiment of the present application
Road schematic diagram.
As shown in figure 3, the photosensitive element PD of corresponding Mr. Yu's pixel0And the photosensitive element PD corresponding to its surrounding pixel1、
PD2、...、PDnSwitching current I is obtained respectivelyd0、Id1、Id2、...、Idn.Wherein, switching current Id1、Id2、...、IdnVia electricity
It passes through after current amplifier Amp conversions and is summed by analog current adder, such as obtainSubtract again via analog current
Musical instruments used in a Buddhist or Taoist mass and electric current Id0Subtract each other, to obtain
Spill current Δ I, i.e. the electric current performance of the brightness space gradient signal of object.Then, via current mode analog-to-digital conversion
Device ADC digital finally obtains the side information D of image0。
Exemplary imaging device
Fig. 4 illustrates the schematic block diagram of the imaging device according to the embodiment of the present application.
As shown in figure 4, the imaging device 200 according to the embodiment of the present application includes：Image-forming component 210 is received for passing through
The light is simultaneously converted to electric current and obtains the side information of the imaging object by the light from imaging object；And processing
The side information of unit 220, the imaging object for being obtained based on the image-forming component 210 carries out image procossing.
It here, can be based on the imaging object according to the processing unit 220 of the imaging device of the embodiment of the present application 200
Side information carry out image procossing, including but not limited to object detection, Object identifying, to image tracing etc..
Specifically, the image-forming component 210 includes：Multiple sensor devices of pixel are arranged as, carry out self-contained for receiving
As object light and the light is converted into switching current；Electric current unit for scaling, for contracting to the switching current
It puts to obtain processes pixel electric current；Spill current acquiring unit, it is described for subtracting the processes pixel electric current for being directed to each pixel
N times of the average value of the processes pixel electric current of the surrounding pixel of pixel is to obtain spill current；And AD conversion unit, it is used for
Analog-to-digital conversion is carried out to obtain the side information of the imaging object based on the spill current.
In one example, in above-mentioned imaging device 200, the sensor devices are for being directly realized by opto-electronic conversion
Sensor devices or sensor devices for realizing opto-electronic conversion indirectly.
In one example, in above-mentioned imaging device 200, the light from imaging object is the imaging object
The light sent out or the light of imaging object reflection.
In one example, in above-mentioned imaging device 200, the image-forming component 210 further comprise lens unit and
At least one of filter unit；And the multiple sensor devices are for receiving via the lens unit and filter unit
At least one of transmission the light from imaging object.
In one example, in above-mentioned imaging device 200, the switching current includes in leakage current and bias current
It is at least one.
In one example, in above-mentioned imaging device 200, the current conversion unit includes one of following：
Current mirror, for scaling the switching current to obtain processes pixel electric current；Conversion circuit, for converting the switching current
It is zoomed in and out for voltage to obtain processes pixel electric current；With, directly scale circuit, for directly to the switching current carry out
Scaling is to obtain processes pixel electric current.
In one example, in above-mentioned imaging device 200, the conversion circuit is used for：The switching current is converted
For voltage；And amplification electric current is generated to obtain the processes pixel electric current with the voltage.
In one example, in above-mentioned imaging device 200, the conversion circuit comprises only source device, or including
Both active device and passive device.
In one example, in above-mentioned imaging device 200, the processes pixel electric current includes the electric current unit for scaling
The leakage current and error current of generation and the bias current of addition.
In one example, in above-mentioned imaging device 200, the spill current acquiring unit be used for by it is below wherein
A kind of mode obtains the spill current：The processes pixel electric current of the surrounding pixel of the pixel is added again divided by the surrounding picture
The number M of element is multiplied by with N；1/M times of the processes pixel electric current of the surrounding pixel of the pixel is added multiplied by with N；And it will
N/M times of the processes pixel electric current of the surrounding pixel of the pixel is added.
In one example, in above-mentioned imaging device 200, the N is integer or decimal.
In one example, in above-mentioned imaging device 200, the image-forming component 210 further comprises：Spill current scales
Unit, for being zoomed in and out to the spill current with the spill current after being scaled；And the AD conversion unit for pair
Spill current after the scaling carries out analog-to-digital conversion to obtain the side information of the imaging object.
In one example, in above-mentioned imaging device 200, the multiple sensor devices are with the light sensation with biological retina
The similar arrangement form arrangement of receptor.
Here, it will be understood by those skilled in the art that therewith according to other details of the imaging device of the embodiment of the present application
Relevant details described in the preceding image-forming component about according to the embodiment of the present application are identical, here just not in order to avoid redundancy
It repeats again.
Example images information processing method
Fig. 5 illustrates the schematic flow chart of the image information processing method according to the embodiment of the present application.
As shown in figure 5, the image information processing method according to the embodiment of the present application includes：S310 is received from imaging object
The light of body；The light is converted to switching current by S320, multiple sensor devices to be arranged as pixel；S330, to described
Switching current is zoomed in and out to obtain processes pixel electric current；S340, it is described by being subtracted for the processes pixel electric current of each pixel
N times of the average value of the processes pixel electric current of the surrounding pixel of pixel is to obtain spill current；And S350, it is based on the spill current
Analog-to-digital conversion is carried out to obtain the side information of the imaging object.
In above-mentioned image information processing method, the sensor devices are the sensor devices for being directly realized by opto-electronic conversion
Or the sensor devices for realizing opto-electronic conversion indirectly.
In above-mentioned image information processing method, the light from imaging object is the light that the imaging object is sent out
Line or the light of imaging object reflection.
In above-mentioned image information processing method, receiving the light from imaging object includes：It receives via lens unit
With the light from imaging object of at least one of filter unit transmission.
In above-mentioned image information processing method, the switching current includes at least one in leakage current and bias current
It is a.
In above-mentioned image information processing method, the switching current is zoomed in and out includes to obtain processes pixel electric current
One of below：The switching current is scaled to obtain processes pixel electric current by current mirror；The switching current is turned
It is changed to voltage and zooms in and out to obtain processes pixel electric current；With directly the switching current is zoomed in and out to obtain pixel
Handle electric current.
In above-mentioned image information processing method, the switching current is converted into voltage and is zoomed in and out to obtain pixel
Handling electric current includes：The switching current is converted into voltage by conversion circuit；And amplification electric current is generated with the voltage
To obtain the processes pixel electric current.
In above-mentioned image information processing method, the conversion circuit comprises only source device, or including active device
Both with passive device.
In above-mentioned image information processing method, the processes pixel electric current include the switching current is zoomed in and out and
The leakage current and error current of generation and the bias current of addition.
In above-mentioned image information processing method, the spill current is obtained by one way in which below：It will be described
The processes pixel electric current of the surrounding pixel of pixel is added again divided by the number M of the surrounding pixel is multiplied by with N；By the pixel
1/M times of the processes pixel electric current of surrounding pixel is added multiplied by with N；And by the processes pixel of the surrounding pixel of the pixel
N/M times of electric current is added.
In above-mentioned image information processing method, the N is integer or decimal.
In above-mentioned image information processing method, further comprise after obtaining the spill current：To the spill current
It zooms in and out with the spill current after being scaled；And analog-to-digital conversion is carried out to obtain the imaging object based on the spill current
The side information of body includes：Analog-to-digital conversion is carried out to the spill current after the scaling with the edge for obtaining the imaging object to believe
Breath.
In above-mentioned image information processing method, the multiple sensor devices are with similar with the photoreceptor of biological retina
Arrangement form arrangement.
Here, it will be understood by those skilled in the art that according to the other of the image information processing method of the embodiment of the present application
Details is identical previously with regards to relevant details described in the image-forming component according to the embodiment of the present application, here in order to avoid
Redundancy just repeats no more.
The brightness that object can be only extracted according to the image-forming component, imaging device and image information processing method of the application is empty
Between gradient signal, to significantly reduce data redundancy.Therefore, it in the case where not reducing the performances such as discrimination, reduces required
Data transfer bandwidth, and improve the working efficiency of system.
It can be directly to the mould of photosensitive element according to the image-forming component, imaging device and image information processing method of the application
Quasi- electric current is operated, rather than is converted into voltage and is operated again so that is not limited by light intensity.Moreover, because sample rate
It is unrelated with light intensity, high-speed capture can be kept under strong light, weak light.
It can be directly real by analog circuit according to the image-forming component, imaging device and image information processing method of the application
Existing analog current and poor calculating.In this way, avoiding the Design of Digital Circuit of follow-up complexity, image-forming component is also correspondingly reduced
Power consumption and area.
It can be by being arranged as the more of pixel according to the image-forming component, imaging device and image information processing method of the application
A sensor devices realize the parallel synchronous sampling of all pixels, can significantly improve frame number.
The basic principle of the application is described above in association with specific embodiment, however, it is desirable to, it is noted that in this application
The advantages of referring to, advantage, effect etc. are only exemplary rather than limitation, must not believe that these advantages, advantage, effect etc. are the application
Each embodiment is prerequisite.In addition, detail disclosed above is merely to exemplary effect and the work being easy to understand
With, and it is unrestricted, it is that must be realized using above-mentioned concrete details that above-mentioned details, which is not intended to limit the application,.
The block diagram of device, device, equipment, system involved in the application only as illustrative example and is not intended to
It is required that or hint must be attached in such a way that box illustrates, arrange, configure.As those skilled in the art will appreciate that
, it can be connected by any way, arrange, configure these devices, device, equipment, system.Such as "include", "comprise", " tool
" etc. word be open vocabulary, refer to " including but not limited to ", and can be used interchangeably with it.Vocabulary used herein above
"or" and " and " refer to vocabulary "and/or", and can be used interchangeably with it, unless it is not such that context, which is explicitly indicated,.Here made
Vocabulary " such as " refers to phrase " such as, but not limited to ", and can be used interchangeably with it.
It may also be noted that in the device of the application, device and method, each component or each step are can to decompose
And/or reconfigure.These decompose and/or reconfigure the equivalent scheme that should be regarded as the application.
The above description of disclosed aspect is provided so that any person skilled in the art can make or use this
Application.Various modifications in terms of these are readily apparent to those skilled in the art, and are defined herein
General Principle can be applied to other aspect without departing from scope of the present application.Therefore, the application is not intended to be limited to
Aspect shown in this, but according to the widest range consistent with principle disclosed herein and novel feature.
In order to which purpose of illustration and description has been presented for above description.In addition, this description is not intended to the reality of the application
It applies example and is restricted to form disclosed herein.Although already discussed above multiple exemplary aspects and embodiment, this field skill
Art personnel will be recognized that its certain modifications, modification, change, addition and sub-portfolio.
Claims (15)
1. a kind of image-forming component, including：
Multiple sensor devices of pixel are arranged as, for receiving the light from imaging object and the light being converted to conversion
Electric current；
Electric current unit for scaling, for being zoomed in and out to the switching current to obtain processes pixel electric current；
Spill current acquiring unit, the picture of the surrounding pixel for the processes pixel electric current for being directed to each pixel to be subtracted to the pixel
N times of the average value of element processing electric current is to obtain spill current；And
AD conversion unit, for carrying out analog-to-digital conversion based on the spill current to obtain the side information of the imaging object.
2. image-forming component according to claim 1, wherein the sensor devices are the senses for being directly realized by opto-electronic conversion
Optical device or sensor devices for realizing opto-electronic conversion indirectly.
3. image-forming component according to claim 1, wherein the light from imaging object is the imaging object hair
The light gone out or the light of imaging object reflection.
4. image-forming component according to claim 1, further comprises at least one of lens unit and filter unit；With
And
The multiple sensor devices come from for receiving via what at least one of the lens unit and filter unit transmitted
The light of imaging object.
5. image-forming component according to claim 1, wherein the switching current include in leakage current and bias current extremely
It is one few.
6. image-forming component according to claim 1, wherein the electric current unit for scaling includes one of following：
Current mirror, for scaling the switching current to obtain processes pixel electric current；
Conversion circuit is zoomed in and out for the switching current to be converted to voltage to obtain processes pixel electric current；With
Circuit is directly scaled, for directly being zoomed in and out to the switching current to obtain processes pixel electric current.
7. image-forming component according to claim 6, wherein the conversion circuit is used for：
The switching current is converted into voltage；And
Amplification electric current is generated to obtain the processes pixel electric current with the voltage.
8. image-forming component according to claim 7, wherein the conversion circuit comprises only source device, or includes
Both source device and passive device.
9. image-forming component according to claim 1, wherein the processes pixel electric current includes the electric current unit for scaling life
At leakage current and error current and the bias current of addition.
10. image-forming component according to claim 1, wherein the spill current acquiring unit be used for by it is below wherein
A kind of mode obtains the spill current：
The processes pixel electric current of the surrounding pixel of the pixel is added again divided by the number M of the surrounding pixel is multiplied by with N；
1/M times of the processes pixel electric current of the surrounding pixel of the pixel is added multiplied by with N；And
N/M times of the processes pixel electric current of the surrounding pixel of the pixel is added.
11. image-forming component according to claim 1, wherein the N is integer or decimal.
12. image-forming component according to claim 1, further comprises：
Spill current unit for scaling, for being zoomed in and out to the spill current with the spill current after being scaled；And
The AD conversion unit is used to carry out analog-to-digital conversion to the spill current after the scaling to obtain the imaging object
Side information.
13. image-forming component according to claim 1, wherein the multiple sensor devices are with the light sensation with biological retina
The similar arrangement form arrangement of receptor.
14. a kind of imaging device, including：
Image-forming component as described in any one of claim 1-13；And
Processing unit carries out image procossing for the side information based on the imaging object.
15. a kind of image information processing method, including：
Receive the light from imaging object；
The light is converted to switching current by multiple sensor devices to be arranged as pixel；
The switching current is zoomed in and out to obtain processes pixel electric current；
The average value of the processes pixel electric current of the surrounding pixel of the pixel will be subtracted for the processes pixel electric current of each pixel
N times to obtain spill current；And
Analog-to-digital conversion is carried out to obtain the side information of the imaging object based on the spill current.
Priority Applications (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810079401.9A CN108282623B (en) | 2018-01-26 | 2018-01-26 | Image-forming component, imaging device and image information processing method |
| PCT/CN2018/115225 WO2019144678A1 (en) | 2018-01-26 | 2018-11-13 | Imaging element, imaging device and image information processing method |
| JP2020522333A JP6918390B2 (en) | 2018-01-26 | 2018-11-13 | Image sensor, image sensor and image information processing method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810079401.9A CN108282623B (en) | 2018-01-26 | 2018-01-26 | Image-forming component, imaging device and image information processing method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108282623A true CN108282623A (en) | 2018-07-13 |
| CN108282623B CN108282623B (en) | 2019-10-11 |
Family
ID=62805430
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810079401.9A Active CN108282623B (en) | 2018-01-26 | 2018-01-26 | Image-forming component, imaging device and image information processing method |
Country Status (3)
| Country | Link |
|---|---|
| JP (1) | JP6918390B2 (en) |
| CN (1) | CN108282623B (en) |
| WO (1) | WO2019144678A1 (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2019144678A1 (en) * | 2018-01-26 | 2019-08-01 | 北京灵汐科技有限公司 | Imaging element, imaging device and image information processing method |
| WO2021128535A1 (en) * | 2019-12-24 | 2021-07-01 | 清华大学 | Pixel readout system of dual-modality bionic vision sensor |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112600996B (en) * | 2020-12-03 | 2022-12-09 | 清华大学 | Ultraviolet bionic vision sensor |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6628330B1 (en) * | 1999-09-01 | 2003-09-30 | Neomagic Corp. | Color interpolator and horizontal/vertical edge enhancer using two line buffer and alternating even/odd filters for digital camera |
| US20090161756A1 (en) * | 2007-12-19 | 2009-06-25 | Micron Technology, Inc. | Method and apparatus for motion adaptive pre-filtering |
| CN103262524A (en) * | 2011-06-09 | 2013-08-21 | 郑苍隆 | Auto-focus image system |
| CN107295236A (en) * | 2017-08-11 | 2017-10-24 | 深圳市唯特视科技有限公司 | A kind of snapshot Difference Imaging method based on time-of-flight sensor |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH08275059A (en) * | 1995-03-31 | 1996-10-18 | Mitsubishi Electric Corp | Light receiving element circuit, light receiving element circuit array and method for configuring the light receiving element circuit |
| JPH11225289A (en) * | 1997-11-04 | 1999-08-17 | Nikon Corp | Edge detection solid-state image pickup device and edge detection method by driving the solid-state image pickup device |
| JP5728821B2 (en) * | 2010-04-12 | 2015-06-03 | 株式会社ニコン | Imaging apparatus and electronic camera |
| CN108282623B (en) * | 2018-01-26 | 2019-10-11 | 北京灵汐科技有限公司 | Image-forming component, imaging device and image information processing method |
-
2018
- 2018-01-26 CN CN201810079401.9A patent/CN108282623B/en active Active
- 2018-11-13 WO PCT/CN2018/115225 patent/WO2019144678A1/en active Application Filing
- 2018-11-13 JP JP2020522333A patent/JP6918390B2/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6628330B1 (en) * | 1999-09-01 | 2003-09-30 | Neomagic Corp. | Color interpolator and horizontal/vertical edge enhancer using two line buffer and alternating even/odd filters for digital camera |
| US20090161756A1 (en) * | 2007-12-19 | 2009-06-25 | Micron Technology, Inc. | Method and apparatus for motion adaptive pre-filtering |
| CN103262524A (en) * | 2011-06-09 | 2013-08-21 | 郑苍隆 | Auto-focus image system |
| CN107295236A (en) * | 2017-08-11 | 2017-10-24 | 深圳市唯特视科技有限公司 | A kind of snapshot Difference Imaging method based on time-of-flight sensor |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2019144678A1 (en) * | 2018-01-26 | 2019-08-01 | 北京灵汐科技有限公司 | Imaging element, imaging device and image information processing method |
| WO2021128535A1 (en) * | 2019-12-24 | 2021-07-01 | 清华大学 | Pixel readout system of dual-modality bionic vision sensor |
Also Published As
| Publication number | Publication date |
|---|---|
| JP6918390B2 (en) | 2021-08-11 |
| JP2020537456A (en) | 2020-12-17 |
| WO2019144678A1 (en) | 2019-08-01 |
| CN108282623B (en) | 2019-10-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105611124B (en) | Imaging sensor, imaging method, imaging device and terminal | |
| CN108282623B (en) | Image-forming component, imaging device and image information processing method | |
| CN105611123B (en) | imaging method, image sensor, imaging device and electronic device | |
| JP2022509034A (en) | Bright spot removal using a neural network | |
| CN103686134B (en) | Image pick-up device, system and control method and image processing apparatus | |
| CN107079087A (en) | Camera device and object recognition methods | |
| Sandini et al. | A retina-like CMOS sensor and its applications | |
| KR101822661B1 (en) | Vision recognition apparatus and method | |
| CN102103754A (en) | Subject tracking apparatus, subject region extraction apparatus, and control methods therefor | |
| CN107770521B (en) | Camera shooting mode method of adjustment | |
| CN102984448A (en) | Method of controlling an action, such as a sharpness modification, using a colour digital image | |
| CN102982518A (en) | Fusion method of infrared image and visible light dynamic image and fusion device of infrared image and visible light dynamic image | |
| KR20200094741A (en) | Imaging apparatus, imaging method and imaging element | |
| US20210392304A1 (en) | Compressed acquisition of microscopic images | |
| WO2023138629A1 (en) | Encrypted image information obtaining device and method | |
| Wang et al. | Stereoscopic dark flash for low-light photography | |
| JP2017229033A (en) | Imaging apparatus and control method thereof and program | |
| CN105430360B (en) | Imaging method, imaging sensor, imaging device and electronic installation | |
| CN113449623B (en) | Light living body detection method based on deep learning | |
| CN111881924B (en) | Dark-light vehicle illumination identification method combining illumination invariance and short-exposure illumination enhancement | |
| WO2019218140A1 (en) | Object identification method and computer readable storage medium | |
| Brückner | Microoptical multi aperture imaging systems | |
| US20100271534A1 (en) | Document camera | |
| CN106973205A (en) | A kind of camera, camera imaging method and mobile terminal | |
| CN113920354A (en) | Action recognition method based on event camera |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |