CN102348069B - Method for acquiring high dynamic image with fixed frame rate from image sensor and apparatus thereof - Google Patents
Method for acquiring high dynamic image with fixed frame rate from image sensor and apparatus thereof Download PDFInfo
- Publication number
- CN102348069B CN102348069B CN201010240370.4A CN201010240370A CN102348069B CN 102348069 B CN102348069 B CN 102348069B CN 201010240370 A CN201010240370 A CN 201010240370A CN 102348069 B CN102348069 B CN 102348069B
- Authority
- CN
- China
- Prior art keywords
- integration
- row
- time
- short time
- frame
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 27
- 230000010354 integration Effects 0.000 claims description 483
- 238000006243 chemical reaction Methods 0.000 claims description 4
- 230000000694 effects Effects 0.000 abstract description 4
- 238000003491 array Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 238000009825 accumulation Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000005070 sampling Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
Landscapes
- Transforming Light Signals Into Electric Signals (AREA)
Abstract
A method for acquiring a high dynamic image with a fixed frame rate from an image sensor and an apparatus thereof, which belong to the image sensor field, are disclosed. The method comprises the following steps: distributing long integral time and short integral time for a light-sensitive pixel array; determining a long integral time row reset starting position of a current frame and a reading starting position, a short integral time row reset starting position and a reading starting position, a long integral time row reset starting position of a next frame according to long integral time T1 of the current frame, the short integral time T2 of the current frame, the long integral time T3 of the next frame and a maximum value M of the short integral time, and simultaneously determining, in one frame, a long integral time reading row of the current frame, a long integral time reset row, a short integral time reset row, a short integral time reading row, the long integral time reset row of the next frame; outputting an obtained integral-row integral signal. The light-sensitive pixel array performs an integral operation as a fixed frame length so as to achieve an effect of outputting the complete and correct image data with the fixed frame rate.
Description
Technical field
The invention belongs to field of image sensors, be specifically related to obtain method and the device of fixing frame per second high-dynamics image in imageing sensor.
Background technology
The method of obtaining at present high-dynamics image frame is: within a certain period of time all row of photosensitive pixel array are carried out to time exposure, obtain the time exposure signal of whole picture frame; And all row of photosensitive pixel array are carried out to short time exposure, obtain the short time exposure signal of whole picture frame; The short time exposure signal of acquisition and time exposure signal are synthesized.
For imageing sensor, above-mentioned exposure is to lead to photosensitive pixel array to grow and reset the time of integration and read and reset the short time of integration and read out realization, and the principle that realizes integration is just first all pel array row to be resetted line by line by particular order within a certain period of time, uniformly-spaced after a period of time, by this reseting sequence, particular row is read line by line again; In the time obtaining high-dynamics image, in one of them picture frame, the short time of integration consistent, all row is consistent the long time of integration of all row.
Due to whole time of integration, the realization of principle need to reset to photosensitive pixel array at a upper counting frame, then read at next counting frame, like this, one frame image data is from resetting to complete reading the time that just needs two counting frames, for improving frame per second and realizing the time of integration that length is less than a frame, conventionally the method adopting is in a line time, not only to read but also reset simultaneously, make in a counting frame time, except completing the reading and reset of current image frame, can also to start the reset of next picture frame.One of them picture frame time (frame length) comprises effective frame time (effectively frame length) and idle frame time (idle frame length); Due to a line that only resets in a line time, therefore in the time changing from small to big the time of integration, if its variable quantity is greater than the idle frame length in current image frame, in order to ensure that current image frame and all provisional capitals of next picture frame can reset completely, interval time after need to making between a picture frame and current image frame valid data is elongated, thereby make frame length become large, image frame per second diminishes.
Fig. 1 is the sequential chart of realizing the embodiment of high dynamic mode image output under prior art condition: existing algorithm is as follows:
10 start present frame photosensitive pixel array to reset line by line according to the long integration 10 of the present frame count signal Line_counter that is expert at; Then before current frame data is read, for example row count signal Line_counter is 1 o'clock, the long time of integration of present frame 10 and the long time of integration 100 of next frame are compared, for avoiding the long horizontal reset generation time of integration of present frame and a rear frame overlapping, ensure that all effective provisional capitals complete reset, the frame length of present frame 1020 is adjusted into 1110 by what give tacit consent to; After can making like this present frame short time of integration of row and current frame length integration horizontal reset completely, just start the reset of next the frame length row time of integration, i.e. T1 and T3, T2 and T3 do not conflict; So-called conflict refers to that effective row addresses more than two row need to reset within a certain count line time simultaneously, and in addition, T1 is that 10, T2 is 2, and both are even number, also do not clash.
Be that 1110 beginnings are read the integration of the present frame photosensitive pixel array long time of integration of row view data successively from row count signal Line_counter, then be 5 according to the maximum short time of integration, known from row count signal Line_counter be 1105 beginnings successively the picture signal of the short time of integration of the row of integration to present frame photosensitive pixel array read, and be 2 the short time of integration of present frame, should be therefore 1017 to start that present frame photosensitive pixel array is carried out to short time of integration row and reset line by line from row count signal Line_counter.Make like this in the time that row count signal line_counter is even number, carry out the reset of current frame length row time of integration view data and read, and row count signal line_counter is while being odd number, carries out the reset of the present frame short time of integration of row view data and reads.Finally, 100 start a rear frame photosensitive pixel array to reset line by line according to the long integration 100 of the rear frame count signal Line_counter that is expert at.The capable viewdata signal of long and short integration obtaining is exported on request.
The count signal Line_counter that is expert at is that the 2nd row of 1106 o'clock integrations to described present frame photosensitive pixel array is grown when the time of integration, row was read: at the 7th row long time of integration of the row of this horizontal reset present frame photosensitive pixel array; And according to maximum short time of integration be 5, determine that the count signal Line_counter that is expert at 1105 reads the 0th row short time of integration of row view data of the integration of present frame photosensitive pixel array, be 2 to determine that the count signal Line_counter that are expert at are the 1st row short time of integration of row of 1105 reset present frame photosensitive pixel arrays according to present frame the short time of integration simultaneously; The present frame long and short time of integration of the row that resets at of the rear frame length row time of integration just starts after reading to reset, and just no longer sets forth at this.In addition, above-mentioned to photosensitive pixel array reset and the process of read operation in, have present frame to read the current frame length of the row address short reset line time of integration of 0 < present frame address 1 < the short time of integration and read the row address current frame length reset line time of integration of 2 < address 7 time of integration.
In prior art, frame length has become 1110 by 1020, frame per second is slack-off, can not meet NTSC (NatioNal TeleviSioN StaNdardS Committee, NTSC) or PAL (PhaSe AlterNatiNg LiNe, line-by-line inversion) when output system need be satisfied the fixing requirement of image frame per second.In addition, if output high-dynamics image, need first in a frame time, to export the view data that is equivalent to general mode two frames, wherein frame data are realized the long time of integration, it is time exposure, another frame data are realized the short time of integration, if desired obtain the high-dynamics image frame data that the long and short time of integration, row data were alternately read, in order to avoid, long and short integration is capable need to be resetted in same a line, strange, the even property that need to ensure the long and short time of integration in same frame is identical, but can not ensure that like this output realizes the high-dynamics image data of any long and short time of integration.
Summary of the invention
The technical problem to be solved in the present invention is:
1, the dynamic image that imageing sensor obtains cannot keep the problem of fixing frame per second;
The problem that need to limit strange, the even characteristic of the long and short integration in same frame while 2, exporting high-dynamics image;
3, solve the problem of the fixing frame per second output of high-dynamics image.
For solving the problems of the technologies described above, the present invention proposes the method for obtaining fixing frame per second high-dynamics image in imageing sensor, described imageing sensor comprises the photosensitive pixel array that is arranged as row and column, the method comprises the steps:
A: photosensitive pixel array is distributed to the long time of integration and the short time of integration;
B: according to present frame long time of integration T1 long time of integration horizontal reset original position start present frame photosensitive pixel array to reset line by line;
C: read original position from the current frame length row time of integration and start successively the integration of the present frame photosensitive pixel array long time of integration of row view data to be read, then according to present frame short time of integration T2 and short time of integration maximum M determine short time of integration of horizontal reset original position, described short time of integration, maximum M was odd number, short time of integration horizontal reset original position start present frame photosensitive pixel array to reset line by line; According to short time of integration, maximum M determines that short time of integration, row was read original position, then from short time of integration row read original position and start the short time of integration of the row view data of integration to present frame photosensitive pixel array successively and read; Long time of integration row view data and short time of integration row view data alternately read; Next according to a rear frame long time of integration T3 size determine next frame length horizontal reset time of integration original position, and start a rear frame photosensitive pixel array to reset line by line in next frame length horizontal reset time of integration original position;
D: maximum M determines in a frame arbitrarily in the count line time that current frame length reads row, long time of integration reset line, short time of integration reset line, the short time of integration time of integration and read row, next frame length reset line time of integration according to the current frame length T1 time of integration, the present frame short time of integration of T2, next frame length T3 time of integration, short time of integration;
E: circulation execution step A, B, C, D, by integrated signal the output capable integration obtaining.
For solving the problems of the technologies described above, the invention allows for the device that obtains fixing frame per second high-dynamics image in imageing sensor, comprising:
Photosensitive pixel array;
Calculate and allocation units the time of integration, calculates the long and short time of integration, and distribute to photosensitive pixel array according to output image information; Length integral processing unit, according to present frame long time of integration T1 long time of integration horizontal reset original position start present frame photosensitive pixel array to reset line by line;
Reading original position from the current frame length row time of integration starts successively the view data of the integration of the present frame photosensitive pixel array long time of integration of row to be read, then according to present frame short time of integration T2 and short time of integration maximum M determine short time of integration of horizontal reset original position, described short time of integration, maximum M was odd number, short time of integration horizontal reset original position start present frame photosensitive pixel array to reset line by line, according to short time of integration, maximum M determines that short time of integration, row was read original position, then from short time of integration row read original position and start the view data of the short time of integration of the row of integration to present frame photosensitive pixel array successively and read, long time of integration row view data and short time of integration row view data alternately read, next according to a rear frame long time of integration T3 size determine next frame length horizontal reset time of integration original position, and start a rear frame photosensitive pixel array to reset line by line in next frame length horizontal reset time of integration original position,
According to the current frame length T1 time of integration, the present frame short time of integration of T2, next frame length T3 time of integration, short time of integration, maximum M determines in a frame that current frame length in count line time arbitrarily reads row, long time of integration reset line, short time of integration reset line, the short time of integration time of integration and read row, next frame length reset line time of integration.
The proposed by the invention method and the device that in imageing sensor, obtain fixing frame per second high-dynamics image, determine long time of integration of the horizontal reset original position of present frame according to the current frame length T1 time of integration, the length row time of integration is read original position, according to the present frame short time of integration of T2, short time of integration, maximum M determined short time of integration of the horizontal reset original position of present frame, short time of integration, row was read original position, determine long time of integration of the horizontal reset original position of next frame the time of integration according to next frame length, the no matter size of the current frame length T3 time of integration and next frame length T1 time of integration gap, the current frame length T1 time of integration, the present frame short time of integration of T2, the odd even feature of next the frame length T3 time of integration, can ensure photosensitive pixel array with anchor-frame progress row integration operation time, present frame and next frame all can reset completely, reached thus when ensureing picture quality, frame per second is complete, the effect of correct output to fix to have ensured image.
Brief description of the drawings
Fig. 1 for the current frame length T1 time of integration that prior art provides be 10, short time of integration, T2 was 2, maximum short time of integration, M was 5, the rear frame length T3 time of integration is the sequential chart of the reset integration of 100 o'clock;
Fig. 2 is the method flow diagram that obtains fixing frame per second high-dynamics image in imageing sensor provided by the invention;
Fig. 3 is the device schematic diagram that obtains fixing frame per second high-dynamics image in imageing sensor provided by the invention;
Fig. 4 for the current frame length T1 time of integration that the embodiment of the present invention provides be 10, short time of integration, T2 was 3, maximum short time of integration, M was 5, the rear frame length T3 time of integration is the sequential chart of the reset integration of 100 o'clock;
Fig. 5 is the partial enlarged drawing of Fig. 4;
Fig. 6 for the current frame length T1 time of integration that the embodiment of the present invention provides be 10, short time of integration, T2 was 2, maximum short time of integration, M was 5, the rear frame length T3 time of integration is the sequential chart of the reset integration of 1014 o'clock;
Fig. 7 is the partial enlarged drawing of Fig. 6.
Embodiment
In order to make technical problem solved by the invention, technical scheme and beneficial effect clearer, below in conjunction with drawings and Examples, the present invention is further elaborated.Should be appreciated that specific embodiment described herein, only in order to explain the present invention, is not intended to limit the present invention.
In imageing sensor, obtain fixing frame per second high-dynamics image, first need the size of the current frame length T1 time of integration, next the frame length T3 time of integration to compare.
By present frame long time of integration T1 and long time of integration of the T3 of a rear frame compare: if the current frame length T1 time of integration is less than present frame frame length, long time of integration of the T3 of a rear frame is greater than long time of integration of the T1 of present frame, and the difference of the rear frame length T3 time of integration and the current frame length T1 time of integration is while being greater than the frame free time T4 of present frame time.Utilize following algorithm in imageing sensor, to obtain fixing frame per second high-dynamics image.
The method of obtaining fixing frame per second high-dynamics image in imageing sensor, as shown in Figure 2, comprises step:
A: photosensitive pixel array is distributed to the long time of integration and the short time of integration;
B: according to present frame long time of integration T1 long time of integration horizontal reset original position start present frame photosensitive pixel array to reset line by line;
C: read original position from the current frame length row time of integration and start successively the integration of the present frame photosensitive pixel array long time of integration of row view data to be read, then according to present frame short time of integration T2 and short time of integration maximum M determine short time of integration of horizontal reset original position, described short time of integration, maximum M was odd number, short time of integration horizontal reset original position start present frame photosensitive pixel array to reset line by line; According to short time of integration, maximum M determines that short time of integration, row was read original position, then from short time of integration row read original position and start the short time of integration of the row view data of integration to present frame photosensitive pixel array successively and read; Long time of integration row view data and short time of integration row view data alternately read; Next according to a rear frame long time of integration T3 size determine next frame length horizontal reset time of integration original position, and start a rear frame photosensitive pixel array to reset line by line in next frame length horizontal reset time of integration original position;
D: maximum M determines in a frame that current frame length in count line time arbitrarily reads row, long time of integration reset line, short time of integration reset line, the short time of integration time of integration and read row, next frame length reset line time of integration according to the current frame length T1 time of integration, the present frame short time of integration of T2, next frame length T3 time of integration, short time of integration;
E: circulation execution step A, B, C, D, by integrated signal the output capable integration obtaining.
In said method, the current frame length horizontal reset time of integration, short time of integration, horizontal reset, next frame length horizontal reset time of integration were all every two row gate time reset a line, the current frame length row time of integration reads, short time of integration row to read be also that every two row gate times are read a line, reach long time of integration of row view data and the short object that the time of integration, row view data was alternately read.
In step C long time of integration row picture signal and short time of integration row picture signal alternately read can make short time of integration row view data before reading, can first read (the M+1)/2 row long time of integration of row view data, and after the length row data reading time of integration is complete, need to continue to read (the M+1)/2 row short time of integration of row view data.Those are not had to the actual long and short row that the time of integration, row view data was read, black row or a certain address that does not need output row are pointed to in its address.
In the above-mentioned method of obtaining fixing frame per second high-dynamics image in imageing sensor, the present frame short time of integration of horizontal reset original position is after current frame length horizontal reset time of integration original position, but early than next frame length horizontal reset time of integration original position.While reading, first read long time of integration of the row view data of present frame, after the row of (M+1)/2, start to read short time of integration of the row view data of present frame.
Describing current frame length horizontal reset time of integration original position in said method, long time of integration row below in detail reads original position, short time of integration horizontal reset original position, short time of integration row and reads the position relationship of original position, next frame length horizontal reset time of integration original position.
Capable long when the time of integration, row view data was read at the N of the integration to described present frame photosensitive pixel array in described step D: to read present frame photosensitive pixel array (the 2N+1-M)/2 row short time of integration of the row view data of integration at the capable gate time of ensuing unit; If T1 is even number, at (N+T1/2) of this line time reset present frame photosensitive pixel array row long time of integration of row; If T1 is odd number, at (N+ (T1+1)/2) of the ensuing unit capable gate time reset present frame photosensitive pixel array row long time of integration of row; If T2 is even number, at (N-(M-T2-1)/2) of the ensuing unit capable gate time reset present frame photosensitive pixel array row short time of integration of row; If T2 is odd number, at (N-(M-T2)/2) of this line time reset present frame photosensitive pixel array row short time of integration of row; Determine it is at this line time or at the capable gate time reset of the ensuing unit capable length of the S row time of integration of a frame photosensitive pixel array afterwards according to the rear frame length T3 time of integration.
Wherein S <=((2N+1-M)/2) < ((N-(M-T2-1)/2) or (N-(M-T2)/2)) <=N < ((N+T1/2) or (N+ (T1+1)/2)), represent for a certain effective row address in photosensitive pixel array, the address (N+T1/2) of the current frame length reset line time of integration or (N+ (T1+1)/2) are greater than current frame length and read capable address N the time of integration, current frame length is read capable address N and be more than or equal to the short reset line time of integration of present frame address (N-(M-T2-1)/2) or (N-(M-T2)/2) time of integration, the short reset line time of integration of present frame address (N-(M-T2-1)/2) or (N-(M-T2)/2) are greater than present frame and read row address (2N+1-M)/2 the short time of integration), present frame is read row address (2N+1-M)/2 the short time of integration) be more than or equal to the address of next the frame length reset line time of integration.
Further, after described step e, also comprise: the step that is data image signal by described integrated signal analog-to-digital conversion, the step of described data image signal being carried out to picture signal processing output.Described picture signal is treated to synthesizes into a frame image data by long and short time of integration of the row view data of identical row address in same frame.
Further, this algorithm also comprises: in a frame time, long time of integration of the T1 of effective row view data that in photosensitive pixel array, all needs are read is all identical, and short time of integration, T2 was all identical.Long time of integration, T1 was more than or equal to short time of integration of T2.In addition, for high-dynamics image, in a frame time, need to read the data that are equivalent to normal image twice, in a frame all long times of integration row data and all short times of integration row data all can generate respectively the image that a frame is complete; And long and short time of integration horizontal reset and corresponding address and order all should be identical while reading, the different original positions that just resets and read, facilitates so long and short time of integration of the row data of identical row address is synthesized.
Further, this algorithm also comprises: in a frame time, after effective row of photosensitive pixel array is completed and reads or reset, to the horizontal reset of advancing of not using.
The row address of not using is without the row address of reading in photosensitive pixel array, generally because front end has been realized and got window or image zooming function and occur, exert an influence for avoiding these not read effective row that capable integral charge reads the need that are adjacent, need to reset to it, to empty the electric charge of its accumulation.
Described in this algorithm, effective row comprises the row of space.For example, while doing image scaling, when the row address of sampling, there is between any two interval.
Described in this algorithm, effectively row comprises adjacent row.For example, when, getting window or realize AD HOC, photosensitive pixel array top and the bottom have the row of much not using.
The method of obtaining fixing frame per second high-dynamics image in imageing sensor proposed by the invention, determine long time of integration of the horizontal reset original position of present frame according to the current frame length T1 time of integration, the length row time of integration is read original position, according to the present frame short time of integration of T2, short time of integration, maximum M determined short time of integration of the horizontal reset original position of present frame, short time of integration, row was read original position, determine long time of integration of the horizontal reset original position of next frame the time of integration according to next frame length, the no matter size of the current frame length T3 time of integration and next frame length T1 time of integration gap, the current frame length T1 time of integration, the present frame short time of integration of T2, the odd even feature of next the frame length T3 time of integration, can ensure photosensitive pixel array with anchor-frame progress row integration operation time, present frame and next frame all can reset completely, reached thus when ensureing picture quality, frame per second is complete, the effect of correct output to fix to have ensured energy image.
In addition, the present invention also provides the device that obtains fixing frame per second high-dynamics image in imageing sensor, as shown in Figure 3, comprising: photosensitive pixel array 1, the calculating time of integration and allocation units 2, length integral processing unit 3.
Calculate and allocation units 2 time of integration, calculates the long and short time of integration, and distribute to photosensitive pixel array 1 according to output image information; Length integral processing unit 3, according to present frame long time of integration T1 long time of integration horizontal reset original position start present frame photosensitive pixel array to reset line by line;
Reading original position from the current frame length row time of integration starts successively the view data of the integration of the present frame photosensitive pixel array long time of integration of row to be read, then according to present frame short time of integration T2 and short time of integration maximum M determine short time of integration of horizontal reset original position, described short time of integration, maximum M was odd number, short time of integration horizontal reset original position start present frame photosensitive pixel array to reset line by line, according to short time of integration, maximum M determines that short time of integration, row was read original position, then from short time of integration row read original position and start the view data of the short time of integration of the row of integration to present frame photosensitive pixel array successively and read, long time of integration row view data and short time of integration row view data alternately read, next according to a rear frame long time of integration T3 size determine next frame length horizontal reset time of integration original position, and start a rear frame photosensitive pixel array to reset line by line in next frame length horizontal reset time of integration original position,
According to the current frame length T1 time of integration, the present frame short time of integration of T2, next frame length T3 time of integration, short time of integration, maximum M determines in a frame that current frame length in count line time arbitrarily reads row, long time of integration reset line, short time of integration reset line, the short time of integration time of integration and read row, next frame length reset line time of integration.
Further, the device that obtains fixing frame per second high-dynamics image in imageing sensor also comprises:
AD conversion unit 4: in order to described integrated signal is converted to data image signal;
Image signal processing unit 5: in order to described data image signal is carried out to picture signal processing output, described picture signal is treated to synthesizes into a frame image data by long and short time of integration of the row view data of identical row address in same frame.
Further, in a frame time, long time of integration of the T1 of all row of photosensitive pixel array is all identical, and short time of integration, T2 was all identical, and long time of integration, T1 was more than or equal to short time of integration of T2.In addition, for high dynamic mode, in a frame time, need to read the data that are equivalent to general mode twice, in a frame all long times of integration row data and all short times of integration row data all can generate respectively the image that a frame is complete; And long and short time of integration horizontal reset and corresponding address and order all should be identical while reading, the different original positions that just resets and read, convenient long and short time of integration of the row data by identical row address are synthesized.
Further, in a frame time, after effective row of photosensitive pixel array is completed and reads or reset, to the horizontal reset of advancing of not using along band reset unit.
The row address of not using is without the row address of reading in photosensitive pixel array, generally because front end has been realized and got window or image zooming function and occur, exert an influence for avoiding these not read effective row that capable integral charge reads the need that are adjacent, need to reset to it, to empty the electric charge of its accumulation.
Further described effective row comprises the row of space.For example, while doing image scaling,, there is interval in the row address of sampling between any two while reading row address.
Further, described effective row comprises adjacent row.For example, when, getting window or realize AD HOC, photosensitive pixel array top and the bottom have the row of much not using.
The proposed by the invention device that obtains fixing frame per second high-dynamics image in imageing sensor, determine long time of integration of the horizontal reset original position of present frame according to the current frame length T1 time of integration, the length row time of integration is read original position, according to the present frame short time of integration of T2, short time of integration, maximum M determined short time of integration of the horizontal reset original position of present frame, short time of integration, row was read original position, determine long time of integration of the horizontal reset original position of next frame the time of integration according to next frame length, the no matter size of the current frame length T3 time of integration and next frame length T1 time of integration gap, the current frame length T1 time of integration, the present frame short time of integration of T2, the odd even feature of next the frame length T3 time of integration, can ensure photosensitive pixel array with anchor-frame progress row integration operation time, present frame and next frame all can reset completely, reached thus when ensureing picture quality, frame per second is complete, the effect of correct output to fix to have ensured energy image.
Further, be convenient to understand in order to make the present invention, below in conjunction with Fig. 4, Fig. 5, Fig. 6, Fig. 7 is to the current frame length T1 time of integration, short time of integration T2, next frame length T3 time of integration, maximum short time of integration, M determined in algorithm the original position that resets the long time of integration, the length view data time of integration is read original position, original position resets the short time of integration, short time of integration, view data was read original position, next frame length original position that resets the time of integration, determine the current frame length reset line time of integration for reading a certain long time of integration row view data, short time of integration reset line, read row the short time of integration, next frame length reset line time of integration.
In Fig. 4, Fig. 5, Fig. 6, Fig. 7, Line_counter is row count signal, Reset_line_address is the current frame length row address time of integration, Short_int_reset_line_address is the present frame short time of integration of row address, Double_reset_line_address is next frame length row address time of integration, and Scan_line_address is that the length row time of integration is read address.
Fig. 4 is the sequential chart of the integral control of the embodiment of the present invention; Be worth M the maximum short time of integration is 5, and the current frame length T1 time of integration is 10, and the present frame short time of integration of T2 is 3, and next frame length time of integration is 100.
The long time of integration of present frame 10 and the long time of integration 100 of a rear frame are compared; Because be less than current frame length 1020 current frame length time of integration 10; Be greater than current frame length time of integration 10 rear frame length time of integration 100, and (100-10) be greater than frame ineffective time 44 of present frame, and 10 and 100 are even number, therefore in the situation that not changing frame length, the reset of the current frame length row time of integration and the rear frame length row time of integration can occur overlapping, i.e. conflict.Present frame short time of integration is 3 in addition, and therefore the reset between the present frame long and short time of integration of row and between the short time of integration of present frame and the rear frame length row time of integration also can occur overlapping; For example, the count signal Line_counter that is expert at is 100 o'clock, to the horizontal reset of advancing current frame length time of integration the 465th, again to the horizontal reset of advancing next frame length time of integration the 0th, also to the horizontal reset of advancing present frame short time of integration the 458th.
10 start present frame photosensitive pixel array to reset line by line according to the long integration 10 of the present frame count signal Line_counter that is expert at; Be that 1020 beginnings are read the picture signal of the integration of the present frame photosensitive pixel array long time of integration of row successively from row count signal Line_counter, then be 1018 to start present frame photosensitive pixel array to reset line by line according to the short time of integration 3 of present frame, the maximum short time of integration 5 from row count signal Line_counter, according to the maximum 5 of the short time of integration from row count signal Line_counter be 1015 beginnings successively the picture signal of the short time of integration of the row of integration to present frame photosensitive pixel array read.Then according to rear frame length time of integration 100 from row count signal Line_counter be 100 start to a frame photosensitive pixel array reset line by line.
As shown in Figure 5, the count signal Line_counter that is expert at is that the 460th row of 100 o'clock integrations to described present frame photosensitive pixel array is grown when the time of integration, row was read, at the 465th row long time of integration of the row of this horizontal reset present frame photosensitive pixel array; The count signal Line_counter that is expert at is the 458th row short time of integration of the row view data of reading the integration of present frame photosensitive pixel array at 99 o'clock, simultaneously determines the 459th row short time of integration of the row at this horizontal reset present frame photosensitive pixel array the short time of integration 3 according to present frame; According to rear the 0th row long time of integration of the row of determining a frame photosensitive pixel array after this horizontal reset frame length time of integration 100.
In addition, above-mentioned to photosensitive pixel array reset and the process of read operation in, after having, a frame length reset line time of integration address 0 < present frame is read the current frame length of the row address short reset line time of integration of 458 < present frame address 459 < the short time of integration and is read the row address current frame length reset line time of integration of 460 < address 465 time of integration.
Fig. 6 is the sequential chart of another integral control of the embodiment of the present invention; Be worth M the maximum short time of integration is 5, and the current frame length T1 time of integration is 10, and the present frame short time of integration of T2 is 3, and next frame length time of integration is 1014.
The long time of integration of present frame 10 and the long time of integration 1014 of a rear frame are compared; Because be less than current frame length 1020 current frame length time of integration 10; Be greater than current frame length time of integration 10 rear frame length time of integration 1014, and (1014-10) be greater than frame ineffective time 44 of present frame, 10 and 1014 are even number, therefore in the situation that not changing frame length, the reset of the current frame length row time of integration and the rear frame length row time of integration can occur overlapping, i.e. conflict; Present frame short time of integration is 3 in addition, and therefore the reset between the present frame long and short time of integration of row and between the short time of integration of present frame and the rear frame length row time of integration also can occur overlapping; For example, the count signal Line_counter that is expert at is 1014 o'clock, the current frame length eighth row time of integration is resetted, again to the horizontal reset of advancing next frame length time of integration the 0th, also to the horizontal reset of advancing present frame short time of integration the 2nd.
Start present frame photosensitive pixel array to reset line by line at 10 o'clock according to the long integration 10 of the present frame count signal Line_counter that is expert at; Be that 1020 beginnings are read the picture signal of the integration of the present frame photosensitive pixel array long time of integration of row successively from row count signal Line_counter, then be 1018 to start present frame photosensitive pixel array to reset line by line according to the short time of integration 3 of present frame, the maximum short time of integration 5 from row count signal Line_counter, according to the maximum 5 of the short time of integration from row count signal Line_counter be 1015 beginnings successively the picture signal of the short time of integration of the row of integration to present frame photosensitive pixel array read.Then according to rear frame length time of integration 1014 from row count signal Line_counter be 1014 start to a frame photosensitive pixel array reset line by line.
As shown in Figure 7, the count signal Line_counter that is expert at is that the 3rd row of the integration of 1014 pairs of described present frame photosensitive pixel arrays is grown when the time of integration, row was read, at the eighth row long time of integration of the row of this horizontal reset present frame photosensitive pixel array; The count signal Line_counter that is expert at is the 1st row short time of integration of the row view data of reading the integration of present frame photosensitive pixel array at 1013 o'clock, simultaneously determines that according to present frame the count signal Line_counter that is expert at resets the 2nd row short time of integration of row of present frame photosensitive pixel array at 1014 o'clock the short time of integration 3; Be the 0th row long time of integration of the row of 1014 o'clock rear frame photosensitive pixel arrays of reset according to rear frame length definite count signal Line_counter that is expert at times of integration 1014.
In addition, above-mentioned to photosensitive pixel array reset and the process of read operation in, after having, a frame length reset line time of integration address 0 < present frame is read the current frame length of the row address short reset line time of integration of 1 < present frame address 2 < the short time of integration and is read the row address current frame length reset line time of integration of 3 < address 8 time of integration.
The foregoing is only preferred embodiment of the present invention, not in order to limit the present invention, all any amendments of doing within the spirit and principles in the present invention, be equal to and replace and improvement etc., within all should being included in protection scope of the present invention.
Claims (13)
1. the method for obtaining fixing frame per second high-dynamics image in imageing sensor, described imageing sensor comprises the photosensitive pixel array that is arranged as row and column, it is characterized in that, the method comprises the steps:
A: photosensitive pixel array is distributed to the long time of integration and the short time of integration;
B: according to present frame long time of integration T1 long time of integration horizontal reset original position start present frame photosensitive pixel array to reset line by line;
C: read original position from the current frame length row time of integration and start successively the integration of the present frame photosensitive pixel array long time of integration of row view data to be read, then according to present frame short time of integration T2 and short time of integration maximum M determine short time of integration of horizontal reset original position, described short time of integration, maximum M was odd number, short time of integration horizontal reset original position start present frame photosensitive pixel array to reset line by line; According to short time of integration, maximum M determines that short time of integration, row was read original position, then from short time of integration row read original position and start the short time of integration of the row view data of integration to present frame photosensitive pixel array successively and read; Long time of integration row view data and short time of integration row view data alternately read; Next according to next frame long time of integration T3 size determine next frame length horizontal reset time of integration original position, and start next frame photosensitive pixel array to reset line by line in next frame length horizontal reset time of integration original position;
D: maximum M determines in a frame arbitrarily in the count line time that current frame length reads row, long time of integration reset line, short time of integration reset line the time of integration, reads row, next frame length reset line time of integration the short time of integration according to the current frame length T1 time of integration, the present frame short time of integration of T2, next frame length T3 time of integration, short time of integration, and T1, T2 and T3 are the integer that is greater than zero;
E: circulation execution step A, B, C, D, by integrated signal the output capable integration obtaining.
2. the method for obtaining fixing frame per second high-dynamics image in imageing sensor as claimed in claim 1, it is characterized in that: described step C is in current line count signal is read the integration of the described present frame photosensitive pixel array long time of integration of row view data, capable long when the time of integration, row view data was read to the N of integration, N is zero or positive integer:
Read present frame photosensitive pixel array (the 2N+1-M)/2 row short time of integration of the row view data of integration at next row count signal;
If T1 is even number, at (N+T1/2) of the current line count signal reset present frame photosensitive pixel array row long time of integration of row;
If T1 is odd number, in (N+(T1+1)/2 of next row count signal reset present frame photosensitive pixel array) the row long time of integration of row;
If T2 is even number, in (N-(M-T2-1)/2 of next row count signal reset present frame photosensitive pixel array) the row short time of integration of row;
If T2 is odd number, in (N-(M-T2)/2 of current line count signal reset present frame photosensitive pixel array) the row short time of integration of row;
Determine it is at current line count signal or at the S of next row count signal reset next frame photosensitive pixel array capable long time of integration of row according to next frame length T3 time of integration, S is zero or positive integer.
3. the method for obtaining fixing frame per second high-dynamics image in imageing sensor as claimed in claim 1, is characterized in that:
After described step e, also comprise: the step that is data image signal by described integrated signal analog-to-digital conversion, the step of described data image signal being carried out to picture signal processing output.
4. the method for obtaining fixing frame per second high-dynamics image in imageing sensor as claimed in claim 1, is characterized in that:
In one frame time, long time of integration of the T1 of all row of photosensitive pixel array is identical, and short time of integration of the T2 of all row is identical.
5. the method for obtaining fixing frame per second high-dynamics image in imageing sensor according to claim 1, is characterized in that: be also included in a frame time, after effective row of photosensitive pixel array is completed and reads or reset, to the horizontal reset of advancing of not using.
6. the method for obtaining fixing frame per second high-dynamics image in imageing sensor according to claim 5, is characterized in that: described effective row comprises the row of space.
7. the method for obtaining fixing frame per second high-dynamics image in imageing sensor according to claim 5, is characterized in that: described effective row comprises adjacent row.
8. the device that obtains fixing frame per second high-dynamics image in imageing sensor, is characterized in that, comprising:
Photosensitive pixel array;
Calculate and allocation units the time of integration, calculates the long and short time of integration, and distribute to photosensitive pixel array according to output image information;
Length integral processing unit, according to present frame long time of integration T1 long time of integration horizontal reset original position start present frame photosensitive pixel array to reset line by line;
Reading original position from the current frame length row time of integration starts successively the view data of the integration of the present frame photosensitive pixel array long time of integration of row to be read, then according to present frame short time of integration T2 and short time of integration maximum M determine short time of integration of horizontal reset original position, described short time of integration, maximum M was odd number, short time of integration horizontal reset original position start present frame photosensitive pixel array to reset line by line, according to short time of integration, maximum M determines that short time of integration, row was read original position, then from short time of integration row read original position and start the view data of the short time of integration of the row of integration to present frame photosensitive pixel array successively and read, long time of integration row view data and short time of integration row view data alternately read, next according to next frame long time of integration T3 size determine next frame length horizontal reset time of integration original position, and start next frame photosensitive pixel array to reset line by line in next frame length horizontal reset time of integration original position,
According to the current frame length T1 time of integration, the present frame short time of integration of T2, next frame length T3 time of integration, short time of integration, maximum M determines in a frame that current frame length in count line time arbitrarily reads row, long time of integration reset line, short time of integration reset line, the short time of integration time of integration and read row, next frame length reset line time of integration, and by integrated signal the output capable integration obtaining, T1, T2 and T3 are the integer that is greater than zero.
9. the device that obtains fixing frame per second high-dynamics image in imageing sensor according to claim 8, is characterized in that: also comprise:
AD conversion unit: in order to described integrated signal is converted to data image signal;
Image signal processing unit: in order to described data image signal is carried out to picture signal processing output.
10. the device that obtains fixing frame per second dynamic image in imageing sensor according to claim 8 or claim 9, is characterized in that: in a frame time, long time of integration of the T1 of all row of photosensitive pixel array is identical, and short time of integration of the T2 of all row is identical.
11. devices that obtain fixing frame per second high-dynamics image in imageing sensor according to claim 8 or claim 9, it is characterized in that: be also included in a frame time, after effective row of photosensitive pixel array is completed and reads or reset, to the horizontal reset of advancing of not using along band reset unit.
12. devices that obtain fixing frame per second high-dynamics image in imageing sensor according to claim 11, is characterized in that: described effective row comprises the row of space.
13. devices that obtain fixing frame per second high-dynamics image in imageing sensor according to claim 11, is characterized in that: described effective row comprises adjacent row.
Priority Applications (5)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201010240370.4A CN102348069B (en) | 2010-07-27 | 2010-07-27 | Method for acquiring high dynamic image with fixed frame rate from image sensor and apparatus thereof |
| EP10840469.0A EP2520080B1 (en) | 2009-12-30 | 2010-12-01 | Method for reading out high dynamic range image frame in image sensor and device using the same |
| PCT/CN2010/079357 WO2011079680A1 (en) | 2009-12-30 | 2010-12-01 | Method for reading out high dynamic range image frame in image sensor and device using the same |
| KR1020127020133A KR101386313B1 (en) | 2009-12-30 | 2010-12-01 | Method for reading out high dynamic range image frame in image sensor and device using the same |
| US12/972,923 US8836807B2 (en) | 2009-12-30 | 2010-12-20 | Method for reading out a high dynamic range image and device using the same |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201010240370.4A CN102348069B (en) | 2010-07-27 | 2010-07-27 | Method for acquiring high dynamic image with fixed frame rate from image sensor and apparatus thereof |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102348069A CN102348069A (en) | 2012-02-08 |
| CN102348069B true CN102348069B (en) | 2014-11-05 |
Family
ID=45546313
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201010240370.4A Active CN102348069B (en) | 2009-12-30 | 2010-07-27 | Method for acquiring high dynamic image with fixed frame rate from image sensor and apparatus thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102348069B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111638756B (en) * | 2020-05-29 | 2022-03-22 | Oppo广东移动通信有限公司 | Control method, control device, electronic terminal, and computer-readable storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2006105707A (en) * | 2004-10-04 | 2006-04-20 | Yokogawa Electric Corp | Pressure detector and diagnostic method of clogging in pressure detector |
| CN101047786A (en) * | 2006-03-27 | 2007-10-03 | 精工爱普生株式会社 | Image sensing apparatus, image sensing system, and image sensing method |
| CN101455074A (en) * | 2006-05-24 | 2009-06-10 | 汤姆森特许公司 | Circuit and method for reading out and resetting pixels of an image sensor |
| CN101957986A (en) * | 2010-10-11 | 2011-01-26 | 华中科技大学 | Method for realizing infrared image enhancement by controlling long and short integrals |
| TW201130303A (en) * | 2009-09-16 | 2011-09-01 | Altasens Inc | Image sensor with wide dynamic range |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR101495895B1 (en) * | 2008-07-08 | 2015-02-25 | 삼성전자주식회사 | Photo-electricity converter having wide dynamic range and method thereof |
-
2010
- 2010-07-27 CN CN201010240370.4A patent/CN102348069B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2006105707A (en) * | 2004-10-04 | 2006-04-20 | Yokogawa Electric Corp | Pressure detector and diagnostic method of clogging in pressure detector |
| CN101047786A (en) * | 2006-03-27 | 2007-10-03 | 精工爱普生株式会社 | Image sensing apparatus, image sensing system, and image sensing method |
| CN101455074A (en) * | 2006-05-24 | 2009-06-10 | 汤姆森特许公司 | Circuit and method for reading out and resetting pixels of an image sensor |
| TW201130303A (en) * | 2009-09-16 | 2011-09-01 | Altasens Inc | Image sensor with wide dynamic range |
| CN101957986A (en) * | 2010-10-11 | 2011-01-26 | 华中科技大学 | Method for realizing infrared image enhancement by controlling long and short integrals |
Non-Patent Citations (6)
| Title |
|---|
| 周建康.积分时间可调的CCD相机驱动时序设计与实现.《光学学报》.2008,第37卷(第11期),2300-2304. * |
| 王天盛.高性能大动态范围CMOS图像传感器控制电路的设计.《天津大学硕士学位论文》.2005,第3.2节. * |
| 积分时间可调的CCD相机驱动时序设计与实现;周建康;《光学学报》;20081130;第37卷(第11期);2300-2304 * |
| 陈敏思.高性能大动态范围CMOS图像传感器时序控制电路的设计.《天津大学硕士学位论文》.2006,第三章. * |
| 高性能大动态范围CMOS图像传感器控制电路的设计;王天盛;《天津大学硕士学位论文》;20050315;第三章 * |
| 高性能大动态范围CMOS图像传感器时序控制电路的设计;陈敏思;《天津大学硕士学位论文》;20060615;第3.2节 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102348069A (en) | 2012-02-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8891017B2 (en) | Video processing apparatus, display apparatus, and video processing method | |
| US20140333804A1 (en) | Display control device | |
| JP6336286B2 (en) | IMAGING DEVICE, IMAGING SYSTEM, IMAGING DEVICE CONTROL METHOD, AND IMAGING DEVICE HAVING IMAGING DEVICE | |
| KR100618014B1 (en) | Image pickup device | |
| US20130229553A1 (en) | Imaging device employing rolling shutter system | |
| KR20140008415A (en) | Acquiring and displaying images in real-time | |
| JP2007180734A (en) | Image processor, camera system, image processing method and moving image display method | |
| CN104168487B (en) | A kind of vision signal frame synchornization method and its device | |
| CN103945135A (en) | Solid-state imaging device | |
| CN104243864B (en) | The image data read method of imaging sensor | |
| JP2008301360A (en) | Imaging apparatus and method, and integrated circuit | |
| CN102348069B (en) | Method for acquiring high dynamic image with fixed frame rate from image sensor and apparatus thereof | |
| US8836807B2 (en) | Method for reading out a high dynamic range image and device using the same | |
| CN104349076A (en) | Solid-state imaging device | |
| CN1168310C (en) | Signal processing apparatus and method | |
| JP2004040317A (en) | Timing signal generating apparatus, system, and imaging apparatus | |
| CN102118585B (en) | Method and device for acquiring dynamic image with fixed frame rate in image sensor | |
| CN201623774U (en) | Device for obtaining fixed-frame-rate high dynamic range image in image sensor | |
| CN101296303A (en) | High-definition picture processing method and device | |
| JP2004165912A (en) | Method and device for driving area imaging element | |
| CN204316623U (en) | High-speed imaging system based on pixel optimization coding exposure | |
| TWI689204B (en) | Image pickup apparatus and image pickup method for image upscaling | |
| CN204145649U (en) | A kind of video signal collection and synthesis system | |
| US10389962B2 (en) | Image pickup apparatus and method utilizing the same line rate for upscaling and outputting image | |
| JP2003046878A (en) | Timing signal generator |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20191129 Address after: 518119 1 Yanan Road, Kwai Chung street, Dapeng New District, Shenzhen, Guangdong Patentee after: SHENZHEN BYD MICROELECTRONICS Co.,Ltd. Address before: BYD 518118 Shenzhen Road, Guangdong province Pingshan New District No. 3009 Patentee before: BYD Co.,Ltd. |
|
| CP01 | Change in the name or title of a patent holder | ||
| CP01 | Change in the name or title of a patent holder |
Address after: 518119 No.1 Yan'an Road, Kuiyong street, Dapeng New District, Shenzhen City, Guangdong Province Patentee after: BYD Semiconductor Co.,Ltd. Address before: 518119 No.1 Yan'an Road, Kuiyong street, Dapeng New District, Shenzhen City, Guangdong Province Patentee before: BYD Semiconductor Co.,Ltd. |
|
| CP03 | Change of name, title or address | ||
| CP03 | Change of name, title or address |
Address after: 518119 No.1 Yan'an Road, Kuiyong street, Dapeng New District, Shenzhen City, Guangdong Province Patentee after: BYD Semiconductor Co.,Ltd. Address before: 518119 No.1 Yan'an Road, Kwai Chung street, Dapeng New District, Shenzhen City, Guangdong Province Patentee before: SHENZHEN BYD MICROELECTRONICS Co.,Ltd. |