CN116801120A - Image data bubble squeezing method of image sensor - Google Patents
Image data bubble squeezing method of image sensor Download PDFInfo
- Publication number
- CN116801120A CN116801120A CN202310345076.7A CN202310345076A CN116801120A CN 116801120 A CN116801120 A CN 116801120A CN 202310345076 A CN202310345076 A CN 202310345076A CN 116801120 A CN116801120 A CN 116801120A
- Authority
- CN
- China
- Prior art keywords
- data
- pixel data
- pixel
- line
- image sensor
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 30
- 230000005540 biological transmission Effects 0.000 claims abstract description 8
- 238000001125 extrusion Methods 0.000 claims description 16
- 230000005587 bubbling Effects 0.000 claims description 9
- 238000005096 rolling process Methods 0.000 claims description 3
- 230000009286 beneficial effect Effects 0.000 abstract description 2
- 239000012472 biological sample Substances 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 238000001514 detection method Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 238000003384 imaging method Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 239000000523 sample Substances 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/40—Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/50—Control of the SSIS exposure
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/70—SSIS architectures; Circuits associated therewith
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Facsimile Scanning Arrangements (AREA)
Abstract
The invention discloses a method for squeezing bubbles of image data of an image sensor, when the image sensor works in a windowing mode, the position and the number of windows are set through the configuration of an upper computer before the first row of exposure is started, at the moment, each row of pixel data is divided into a plurality of units and the mask type of each row of pixel units is calculated, a foundation is laid for completing the squeezing bubbles of the subsequent each row of pixel data, after each row of exposure is finished, the pixel data is stored in a plurality of FIFOs, when the last FIFO has the pixel data, the pixel data in all FIFOs are taken out simultaneously, and the data of each 100 pixels are divided into 2 groups for mask processing, and the method has the beneficial effects that: the image sensor is guaranteed to only read and transmit the image data in the window area, and the efficiency of the image sensor for processing the whole pixel array data is improved; meanwhile, under the condition of ensuring that target individuals and other features which are focused in the image data are accurately and precisely detected, the frame transmission rate of the image data can be improved.
Description
Technical Field
The invention relates to the technical field of image sensors, in particular to a method for squeezing bubbles in image data of an image sensor.
Background
The image sensor is a photoelectric imaging device which converts an optical image collected on an internal photosensitive surface into an electronic signal capable of being effectively transmitted after splitting processing. Because the image sensor has the advantages of high cost performance, small volume, long service life and the like, the image sensor is widely applied to a plurality of high-end fields such as automatic driving, medical detection, aerospace, security monitoring and the like in modern markets.
When the medical instrument detects a biological sample, in order to quickly acquire a target individual and characteristics thereof which are focused in the sample, when the image sensor is started to enter a normal working state, a subsampling working mode is started first, and after the focused target individual is found, a windowing scanning detection mode is started to extract target characteristics in a window area. Therefore, the image sensor applied to the medical instrument only scans the row pixels and the column pixels of the window area in the pixel array on the whole photosurface, and further obtains the accurate characteristic image of the target individual in the biological sample.
With the development of modern science and technology, image sensors with pixels reaching tens of millions are gradually appeared in the high-end field, and even the field of medical apparatuses reaches the level of X hundred million. When detecting biological samples, the X hundred million-level image sensor needs to quickly adjust the position of a window in a pixel array according to the position change of a target individual focused in the samples, so as to ensure that the characteristics of the target individual are accurately captured. The image sensor with the X hundred million-level pixels can finish the work of capturing single or multiple target individuals and the characteristics thereof according to application scenes, and when the capturing task of the multiple target individuals and the characteristics thereof is carried out, a plurality of window areas are required to be opened in a pixel array of the image sensor, and column pixels in all the window areas in each frame of image are required to be scanned. In the prior art, a method for only reading pixel data in a multi-window area for an X hundred million-level image sensor does not exist, and when the existing method is applied to the X hundred million-level image sensor, the efficiency of processing optical image data acquired on an internal photosurface cannot be improved, and the frame transmission rate of the image data cannot be improved under the condition of accurately detecting a target individual and the characteristics of the target individual which are focused in the image data.
Disclosure of Invention
The present invention is directed to a method for squeezing bubbles in image data of an image sensor, so as to solve the above-mentioned problems in the prior art.
In order to achieve the above purpose, the present invention provides the following technical solutions: a method of image data bubbling for an image sensor, comprising the steps of:
step one: when each frame of image starts, judging whether the exposure mode is a global exposure mode, a normal rolling exposure mode or a windowing mode;
step two: when the image sensor works in a windowing mode, before the first line of exposure starts, window positions and the number are set through configuration of an upper computer, at the moment, pixel data of each line are divided into a plurality of units in a halving mode, mask types of pixel units of each line are obtained through calculation, and a foundation is laid for completing bubble extrusion of the pixel data of each line in the follow-up process;
step three: when the exposure of the first line is finished, respectively storing the first line into a plurality of FIFOs according to the reading sequence of original pixel data, when the last FIFO is provided with the pixel data, starting to simultaneously take out the pixel data in all the FIFOs, and carrying out alternative placement on the corresponding pixel data according to the mask type obtained by previous calculation to a multi-bit buffer register to splice and complete the data bubble extrusion function, when all bits of the register store valid pixel data or all the pixel data of the first line are processed, writing the data in the current buffer register into a new FIFO for use and transmission of a subsequent module;
step four: starting exposure of the next line, finishing the bubble extrusion of the pixel data of the current line in the same pixel data bubble extrusion process of the first line when the exposure of the current line is finished, and performing pixel data choosing and splicing on the pixel units of the current line according to the corresponding mask type until all the pixel data of the current line are subjected to bubble extrusion, and reading out the pixel data in the new FIFO for a subsequent module to use and transmit;
step five: repeating the fourth step until the processing of the current frame image is completed;
step six: repeating the steps one to five until each frame of image processing is completed.
Further, in the second step, after the upper computer system configures the set window positions and numbers, the pixel data of each row is calculated, and each 100 pixels is a unit.
Further, the mask type includes all valid data, all invalid data, valid left data, valid right data, valid both sides and invalid intermediate data, and each pixel unit is divided into 2 groups at the time of mask processing.
Further, in the third step, after each line of exposure is completed and the pixel data is stored in the plurality of FIFOs, when the pixel data is in the last FIFO, the pixel data in all FIFOs are simultaneously fetched, and the data of each 100 pixels is divided into 2 groups for mask processing.
Further, in the fourth step, when all bits of the buffer register are valid pixel data or all pixel data of the first row are processed, new data obtained after data bubble squeezing is written into the subsequent FIFO for reading and transmission of the subsequent module.
Further, in step three, whether the current pixel is valid or not is judged according to the mask type, if not, the current pixel data is discarded, and if not, the current pixel data is reserved and spliced in the buffer register.
Further, in step three, if each bit in the buffer register contains pixel data, the bubble is determined to be complete and the pixel data after the bubble is written into the new FIFO, otherwise, the original pixel data is continuously read from the original FIFO again.
Compared with the prior art, the invention has the beneficial effects that: by setting the window positions and the number in the windowing mode and then determining the mask types of a plurality of pixel units in each row, the image sensor is ensured to only read and transmit the image data in the window area, and the efficiency of the image sensor for processing the whole pixel array data is improved; meanwhile, under the condition of ensuring that target individuals and other features which are focused in the image data are accurately and precisely detected, the frame transmission rate of the image data can be improved.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings that are needed for the description of the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a schematic view of a pixel array of an image sensor according to the present invention in a windowed mode;
FIG. 2 is a schematic diagram of mask types during bubble squeezing of a pixel unit according to the present invention;
FIG. 3 is a schematic diagram illustrating a bubble squeezing process of pixel data according to the present invention;
fig. 4 is a diagram showing a data bubble squeezing process of the image sensor according to the present invention.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
Referring to fig. 1-4, in an embodiment of the present invention, a method for squeezing bubbles in image data of an image sensor includes the following steps:
step one: when each frame of image starts, judging whether the exposure mode is a global exposure mode, a normal rolling exposure mode or a windowing mode;
step two: when the image sensor works in a windowing mode, before the first line of exposure starts, window positions and the number are set through configuration of an upper computer, at the moment, pixel data of each line are divided into a plurality of units in a halving mode, mask types of pixel units of each line are obtained through calculation, and a foundation is laid for completing bubble extrusion of the pixel data of each line in the follow-up process;
step three: when the exposure of the first line is finished, respectively storing the first line into a plurality of FIFOs according to the reading sequence of original pixel data, when the last FIFO is provided with the pixel data, starting to simultaneously take out the pixel data in all the FIFOs, and carrying out alternative placement on the corresponding pixel data according to the mask type obtained by previous calculation to a multi-bit buffer register to splice and complete the data bubble extrusion function, when all bits of the register store valid pixel data or all the pixel data of the first line are processed, writing the data in the current buffer register into a new FIFO for use and transmission of a subsequent module;
step four: starting exposure of the next line, finishing the bubble extrusion of the pixel data of the current line in the same pixel data bubble extrusion process of the first line when the exposure of the current line is finished, and performing pixel data choosing and splicing on the pixel units of the current line according to the corresponding mask type until all the pixel data of the current line are subjected to bubble extrusion, and reading out the pixel data in the new FIFO for a subsequent module to use and transmit;
step five: repeating the fourth step until the processing of the current frame image is completed;
step six: repeating the steps one to five until each frame of image processing is completed.
Examples
As shown in fig. 1, taking a 300×300 pixel array as an example, in the window mode, the blue area is a window area, and yellow represents an out-of-window ineffective pixel area;
as shown in fig. 2, after the upper computer system configures and sets the window positions and the number, each row of pixel data is calculated, each 100 pixels is a pixel unit, and the mask types during the bubble squeezing process include all valid data, all invalid data, all valid left data, all valid right data, both valid sides and invalid intermediate data, and each pixel unit is divided into 2 groups during the mask process;
as shown in fig. 3, taking the mask type of the first 100 pixels as three and the mask of the first 100 pixels as four and the mask of the last 100 pixels as valid, continuing to process the last 100 pixels if the mask type of the last 100 pixels is five and the masks of the 98 th and 99 th pixels are invalid, writing the first pixel into a buffer register after the mask processing of the first 100 pixels, continuing to process the mask of the last 100 pixels if the register does not reach valid pixel data of all bits, writing the last pixel data of the last 100 pixels into the buffer register, splicing the last pixel data with the first pixel of the first 100 pixels, continuing to process the last 100 pixels if the register does not reach valid pixel data of all bits, discarding the last 100 pixels and the last two pixels of the last 100 pixels, writing the rest pixels into the buffer register, and performing data splicing if all bits of the buffer register are valid pixel data, thus completing the data bubble extrusion processing of 300 pixels.
It will be evident to those skilled in the art that the invention is not limited to the details of the foregoing illustrative embodiments, and that the present invention may be embodied in other specific forms without departing from the spirit or essential characteristics thereof. The present embodiments are, therefore, to be considered in all respects as illustrative and not restrictive, the scope of the invention being indicated by the appended claims rather than by the foregoing description, and all changes which come within the meaning and range of equivalency of the claims are therefore intended to be embraced therein. Any reference sign in a claim should not be construed as limiting the claim concerned.
Furthermore, it should be understood that although the present disclosure describes embodiments, not every embodiment is provided with a separate embodiment, and that this description is provided for clarity only, and that the disclosure is not limited to the embodiments described in detail below, and that the embodiments described in the examples may be combined as appropriate to form other embodiments that will be apparent to those skilled in the art.
Claims (7)
1. A method for bubbling image data of an image sensor, comprising the steps of:
step one: when each frame of image starts, judging whether the exposure mode is a global exposure mode, a normal rolling exposure mode or a windowing mode;
step two: when the image sensor works in a windowing mode, before the first line of exposure starts, window positions and the number are set through configuration of an upper computer, at the moment, pixel data of each line are divided into a plurality of units in a halving mode, mask types of pixel units of each line are obtained through calculation, and a foundation is laid for completing bubble extrusion of the pixel data of each line in the follow-up process;
step three: when the exposure of the first line is finished, respectively storing the first line into a plurality of FIFOs according to the reading sequence of original pixel data, when the last FIFO is provided with the pixel data, starting to simultaneously take out the pixel data in all the FIFOs, and carrying out alternative placement on the corresponding pixel data according to the mask type obtained by previous calculation to a multi-bit buffer register to splice and complete the data bubble extrusion function, when all bits of the register store valid pixel data or all the pixel data of the first line are processed, writing the data in the current buffer register into a new FIFO for use and transmission of a subsequent module;
step four: starting exposure of the next line, finishing the bubble extrusion of the pixel data of the current line in the same pixel data bubble extrusion process of the first line when the exposure of the current line is finished, and performing pixel data choosing and splicing on the pixel units of the current line according to the corresponding mask type until all the pixel data of the current line are subjected to bubble extrusion, and reading out the pixel data in the new FIFO for a subsequent module to use and transmit;
step five: repeating the fourth step until the processing of the current frame image is completed;
step six: repeating the steps one to five until each frame of image processing is completed, and stopping exposure.
2. The method of image sensor image data bubbling in accordance with claim 1, wherein: in the second step, after the upper computer system configures the set window positions and numbers, each row of pixel data is calculated, and each 100 pixels is a unit.
3. The method of image sensor image data bubbling in accordance with claim 1, wherein: the mask type includes data all valid, data all invalid, left side data valid, right side data valid, both sides valid and middle data invalid, and each pixel unit is divided into 2 groups at the time of mask processing.
4. The method of image sensor image data bubbling in accordance with claim 1, wherein: in the third step, after each line of exposure is finished and the pixel data are stored in a plurality of FIFOs, when the pixel data are in the last FIFO, the pixel data in all FIFOs are taken out simultaneously, and each 100 pixels of data are divided into 2 groups for mask processing.
5. The method of image sensor image data bubbling in accordance with claim 1, wherein: in the fourth step, when all bits of the buffer register are valid pixel data or all pixel data of the first row are processed, new data obtained after data bubbling is written into the subsequent FIFO for reading and transmission of the subsequent module.
6. The method of image sensor image data bubbling in accordance with claim 1, wherein: in the third step, whether the current pixel is effective or not is judged according to the mask type, if not, the current pixel data is discarded, and if not, the current pixel data is reserved and spliced in a buffer register.
7. The method of image sensor image data bubbling in accordance with claim 1, wherein: in step three, if each bit in the buffer register contains pixel data, the bubble is determined to be complete and the pixel data after the bubble is written into a new FIFO, otherwise, the original pixel data is continuously read from the original FIFO again.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310345076.7A CN116801120A (en) | 2023-04-03 | 2023-04-03 | Image data bubble squeezing method of image sensor |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310345076.7A CN116801120A (en) | 2023-04-03 | 2023-04-03 | Image data bubble squeezing method of image sensor |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116801120A true CN116801120A (en) | 2023-09-22 |
Family
ID=88046958
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310345076.7A Pending CN116801120A (en) | 2023-04-03 | 2023-04-03 | Image data bubble squeezing method of image sensor |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116801120A (en) |
-
2023
- 2023-04-03 CN CN202310345076.7A patent/CN116801120A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20030123726A1 (en) | Scene change detection apparatus | |
| US20070058056A1 (en) | Method and apparatus for real time identification and correction of pixel defects for image sensor arrays | |
| JPH07167649A (en) | Distance measuring equipment | |
| CN116342894B (en) | GIS infrared feature recognition system and method based on improved YOLOv5 | |
| RU2363018C1 (en) | Method of selecting objects on remote background | |
| CN116071294A (en) | Optical fiber surface defect detection method and device | |
| CN101520590B (en) | Camera and self portrait method | |
| CN116801120A (en) | Image data bubble squeezing method of image sensor | |
| JP2007259428A (en) | Imaging device, imaging apparatus, imaging system, imaging method, motion data generation system, motion data generation program and motion data generation method | |
| CN110717441B (en) | Video target detection method, device, equipment and medium | |
| CN112288686B (en) | Model training method and device, electronic equipment and storage medium | |
| CN112734719B (en) | Dead pixel detection method of image sensor, storage medium and shooting device | |
| TW201007162A (en) | Optical carriage structure of inspection apparatus and its inspection method | |
| US8072451B2 (en) | Efficient Z testing | |
| JPH0979946A (en) | Inspection device for display device | |
| CN111238829A (en) | Method and device for determining moving state, computer equipment and storage medium | |
| KR101076478B1 (en) | Method of detecting the picture defect of flat display panel using stretching technique and recording medium | |
| CN117671472B (en) | Underwater multi-target group identification method based on dynamic visual sensor | |
| WO2023176488A1 (en) | Moving bodies measurement method | |
| CN100508563C (en) | Digital image processing method and apparatus for CMOS imaging sensor | |
| US20240114242A1 (en) | Photographing method, electronic device and storage medium | |
| JPH09245166A (en) | Pattern matching device | |
| CN112954241A (en) | Image data reading system of image sensor and reading and organizing method | |
| CN117376720A (en) | Exposure time adjusting method and system applied to high-speed camera | |
| CN114694247A (en) | Pedestrian behavior detection system of subway station |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |