CN111182240A - Temperature drift self-compensation method for image sensor - Google Patents
Temperature drift self-compensation method for image sensor Download PDFInfo
- Publication number
- CN111182240A CN111182240A CN201911338962.7A CN201911338962A CN111182240A CN 111182240 A CN111182240 A CN 111182240A CN 201911338962 A CN201911338962 A CN 201911338962A CN 111182240 A CN111182240 A CN 111182240A
- Authority
- CN
- China
- Prior art keywords
- temperature
- image sensor
- pixel
- value
- temperature drift
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 35
- 230000000630 rising effect Effects 0.000 claims description 13
- 238000004590 computer program Methods 0.000 claims description 4
- 238000013507 mapping Methods 0.000 claims description 3
- 238000003860 storage Methods 0.000 claims description 2
- 230000007613 environmental effect Effects 0.000 abstract 1
- 238000001816 cooling Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000017525 heat dissipation Effects 0.000 description 1
- 238000009776 industrial production Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000009423 ventilation Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/40—Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled
- H04N25/46—Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled by combining or binning pixels
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Studio Devices (AREA)
- Transforming Light Signals Into Electric Signals (AREA)
- Image Input (AREA)
Abstract
The invention discloses a temperature drift self-compensation method of an image sensor, which solves the problem of distortion of an output pixel value of the image sensor caused by higher ambient temperature by the linearization processing of an acquired image and real-time temperature pixel drift compensation, enables the image sensor to normally work in a high-temperature narrow space for a long time and improves the environmental applicability of the image sensor. The invention has scientific principle, automatic operation and higher efficiency, has universal applicability to any image sensor influenced by temperature and increases the application environment of the image sensor.
Description
Technical Field
The invention relates to the field of acquisition and processing of industrial cameras and image sensors, in particular to a temperature drift self-compensation method for an image sensor.
Background
The development of science and technology promotes the wide application of image sensors in daily life and industrial production, and compared with daily life, the industrial environment has severer use conditions. The industrial environment has a serious influence on the quality of images acquired by an image sensor due to limited space and high temperature and humidity. Image sensor temperature impact compensation becomes a key technology for ensuring image quality.
The traditional technology has the following technical problems:
the traditional physical temperature compensation method is to increase the heat dissipation surface of the operating equipment or increase physical measures such as ventilation and the like to cool so that the equipment normally operates at the working temperature. However, for an industrial environment with limited space and high ambient temperature, the traditional physical cooling method not only loses the original function, but also is possible to add extra heat to the running equipment.
Disclosure of Invention
The invention aims to provide a temperature drift self-compensation method for an image sensor. The method can compensate the influence of temperature on the pixels through algorithm processing, and further enhance the image quality on the premise of ensuring that the image does not lose the original information. The method automatically acquires the temperature drift self-compensation coefficient of the image sensor and compensates the pixel by matching the temperature drift self-compensation coefficient with the working temperature of the image sensor, and the pixel is compensated and then subjected to histogram enhancement to complete the temperature drift self-compensation of the image sensor, thereby ensuring that the quality of the acquired image is not influenced by the temperature.
In order to solve the above technical problem, the present invention provides a temperature drift self-compensation method for an image sensor, comprising:
in the case of no temperature influence, the output pixel of the image sensor is equal to the original pixel, in the case of temperature influence, the output pixel of the image sensor is formed by superposing the pixel value of the corresponding position of the image and the temperature drift value thereof, and if the pixel affected by the temperature is to be corrected, the pixel value of the output image of the image sensor is subtracted by the temperature drift value of the corresponding position, that is:
I(x，y)+T(x，y)＝P(x，y)(formula 1)
P(x，y)-T(x，y)＝O(x，y)(formula 2)
Wherein: i (x, y) is an original pixel under the condition that the (x, y) pixel point is not influenced by temperature, T (x, y) is a pixel temperature drift value of the (x, y) point which rises along with the rise of the temperature, P (x, y) is a CMOS output pixel value of the (x, y) point after the influence of the temperature, and O (x, y) is a processed pixel value of the (x, y) point;
the temperature drift self-compensation coefficient is the pixel rising average value of the original image under the influence of temperature, namely:
P(x，y)-Tc＝O(x，y)(formula 3)
Wherein: tc represents the pixel rising average value of the original image under the influence of temperature, namely a temperature drift self-compensation coefficient;
reading the calibrated temperature drift self-compensation coefficient, determining a corresponding temperature drift compensation coefficient value according to the working temperature of the current image sensor, and carrying out the operation of the formula 3 on the effective pixel value in the current frame; selecting the maximum value and the minimum value of the pixel dynamic range to carry out the formula 4 enhancement;
wherein g (x, y) represents the pixel value after mapping; MIN and MAX represent the minimum and maximum values of the pixel dynamic range.
In one embodiment, the image sensor is a CMOS.
In one embodiment, the image sensor is a CCD.
In one embodiment, the method for obtaining the operating temperature of the current image sensor and the corresponding temperature drift compensation coefficient value is as follows:
the image sensor is now placed in a dark environment; reading a temperature register value of an image sensor, simultaneously calculating a pixel rising average value of a current frame image as a temperature drift self-compensation coefficient of the current temperature, continuously rising the temperature of an industrial environment where the image sensor is located, and repeating the steps to obtain the pixel rising average value of the current frame image at different temperatures as the temperature drift self-compensation coefficient of the current temperature; and when the temperature is kept for the preset time, the temperature is considered to reach the upper limit, namely the temperature of the industrial environment where the image sensor is located is considered not to change, and the temperature drift compensation coefficients corresponding to different temperature values are stored.
In one embodiment, the predetermined time is 20 minutes.
In one embodiment, the method is automated.
In one embodiment, the method has general applicability to image sensors that are subject to temperature.
Based on the same inventive concept, the present application also provides a computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the steps of any of the methods when executing the program.
Based on the same inventive concept, the present application also provides a computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of any of the methods.
Based on the same inventive concept, the present application further provides a processor for executing a program, wherein the program executes to perform any one of the methods.
The invention has the beneficial effects that:
the invention provides a temperature drift self-compensation method for an image sensor. Compared with physical cooling, the method enables the camera to be more suitable for industrial environments with limited space and higher temperature. The temperature drift self-compensation coefficient of the image sensor is automatically acquired and matched with the working temperature of the image sensor to compensate the pixel, and the pixel is subjected to histogram enhancement after compensation to complete the temperature drift self-compensation of the image sensor, so that the quality of the acquired image is not influenced by temperature.
Drawings
FIG. 1 is a flow chart of the temperature drift self-compensation method of the image sensor of the present invention.
Detailed Description
The present invention is further described below in conjunction with the following figures and specific examples so that those skilled in the art may better understand the present invention and practice it, but the examples are not intended to limit the present invention.
As shown in the flowchart of fig. 1, a method for self-compensating for temperature drift of an image sensor. The method automatically acquires the temperature drift self-compensation coefficient of the image sensor and compensates the pixel by matching the temperature drift self-compensation coefficient with the working temperature of the image sensor, and the pixel is compensated and then subjected to histogram stretching to complete the temperature drift self-compensation of the image sensor, thereby ensuring that the quality of the acquired image is not influenced by temperature.
An image sensor temperature drift self-compensation method comprises the following steps:
under the condition of no temperature influence, the CMOS output pixel is equal to the original pixel, under the condition of temperature influence, the CMOS output pixel is formed by superposing the pixel value of the corresponding position of the image and the temperature drift value of the image, and if the pixel affected by the temperature is corrected, the temperature drift value of the corresponding position is subtracted from the pixel value of the CMOS output image, namely:
I(x，y)+T(x，y)＝P(x，y)(formula 1)
P(x，y)-T(x，y)＝O(x，y)(formula 2)
Wherein: i (x, y) is an original pixel under the condition that the (x, y) pixel point is not influenced by temperature, T (x, y) is a pixel temperature drift value of the (x, y) point which rises along with the rise of the temperature, P (x, y) is a CMOS output pixel value of the (x, y) point which is influenced by the temperature, and O (x, y) is a processed pixel value of the (x, y) point.
The influence of the temperature on the sensing unit in each CMOS image sensor is different, but the influence can be considered to be the same because the manufacturing process is consistent, and the temperature drift self-compensation coefficient can be approximated to the pixel rising average value of the original image under the influence of the temperature, namely:
P(x，y)-Tc＝O(x，y)(formula 3)
Wherein: tc represents the pixel rise average value of the original image under the influence of temperature, namely the temperature drift self-compensation coefficient.
The system is divided into two states of self-compensation and temperature drift coefficient acquisition.
And when the system is powered on every time, the system defaults to enter a self-compensation state, the main control processor reads the calibrated temperature drift self-compensation coefficient from the external memory, determines the corresponding temperature drift compensation coefficient value according to the working temperature of the current image sensor, and performs the operation of the formula 3 on the effective pixel value in the current frame. The pixel dynamic range maximum and minimum are selected for enhancement of equation 4.
Wherein g (x, y) represents the pixel value after mapping; MIN and MAX represent the minimum and maximum values of the pixel dynamic range and are adjustable with the number of bits, since the pixel consists of an 8-bit binary, where the initial MAX is 255 dynamic maximum values and MIN is 0 dynamic minimum values.
And when the system receives the temperature drift coefficient acquisition command, the system enters a temperature drift coefficient acquisition state. The image sensor is now placed in a dark environment. The main control processor reads the temperature register value of the image sensor as a basis value of the temperature drift self-compensation method, simultaneously calculates the pixel rising average value of the current frame image as the temperature drift self-compensation coefficient of the current temperature, the temperature of the industrial environment where the image sensor is located continuously rises, and repeats the steps, namely the pixel rising average value of the current frame image at different temperatures is obtained as the temperature drift self-compensation coefficient of the current temperature. And when the temperature is kept for a preset time, for example, 20 minutes, the temperature is considered to reach the upper limit, namely the temperature of the industrial environment where the image sensor is located is considered not to change, and the temperature drift compensation coefficients corresponding to different temperature values are stored in the external memory to quit the temperature drift self-compensation coefficient acquisition state.
The above-mentioned embodiments are merely preferred embodiments for fully illustrating the present invention, and the scope of the present invention is not limited thereto. The equivalent substitution or change made by the technical personnel in the technical field on the basis of the invention is all within the protection scope of the invention. The protection scope of the invention is subject to the claims.
Claims (10)
1. An image sensor temperature drift self-compensation method is characterized by comprising the following steps:
under the condition of no temperature influence, the output pixel of the image sensor is equal to the original pixel, under the condition of temperature influence, the output pixel of the image sensor is formed by superposing the pixel value of the corresponding position of the image and the temperature drift value of the pixel value, and if the pixel affected by the temperature is corrected, the pixel value of the output image of the image sensor is subtracted by the temperature drift value of the corresponding position, namely.
I(x，y)+T(x，y)＝P(x，y)(formula 1)
P(x，y)-T(x，y)＝O(x，y)(formula 2)
Wherein: i (x, y) is an original pixel under the condition that the (x, y) pixel point is not influenced by temperature, T (x, y) is a pixel temperature drift value of the (x, y) point which rises along with the rise of the temperature, P (x, y) is a CMOS output pixel value of the (x, y) point after the influence of the temperature, and O (x, y) is a processed pixel value of the (x, y) point;
the temperature drift self-compensation coefficient is the pixel rising average value of the original image under the influence of temperature, namely:
P(x，y)-Tc＝O(x，y)(formula 3)
Wherein: tc represents the pixel rising average value of the original image under the influence of temperature, namely a temperature drift self-compensation coefficient;
reading the calibrated temperature drift self-compensation coefficient, determining a corresponding temperature drift compensation coefficient value according to the working temperature of the current image sensor, and carrying out the operation of the formula 3 on the effective pixel value in the current frame; selecting the maximum value and the minimum value of the pixel dynamic range to carry out the formula 4 enhancement;
wherein g (x, y) represents the pixel value after mapping; MIN and MAX represent the minimum and maximum values of the pixel dynamic range.
2. The image sensor temperature drift self-compensation method of claim 1, wherein the image sensor is a CMOS.
3. The image sensor temperature drift self-compensation method of claim 1, wherein the image sensor is a CCD.
4. The method for self-compensating the temperature drift of the image sensor according to claim 1, wherein the method for obtaining the current operating temperature of the image sensor and the corresponding temperature drift compensation coefficient value is as follows:
the image sensor is now placed in a dark environment; reading a temperature register value of an image sensor, simultaneously calculating a pixel rising average value of a current frame image as a temperature drift self-compensation coefficient of the current temperature, continuously rising the temperature of an industrial environment where the image sensor is located, and repeating the steps to obtain the pixel rising average value of the current frame image at different temperatures as the temperature drift self-compensation coefficient of the current temperature; and when the temperature is kept for the preset time, the temperature is considered to reach the upper limit, namely the temperature of the industrial environment where the image sensor is located is considered not to change, and the temperature drift compensation coefficients corresponding to different temperature values are stored.
5. The image sensor temperature drift self-compensation method of claim 4, wherein the preset time is 20 minutes.
6. The image sensor temperature drift self-compensation method of claim 1, wherein the method has automation performance.
7. The method of claim 1, wherein the method is universally applicable to image sensors affected by temperature.
8. A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the steps of the method of any of claims 1 to 7 are implemented when the program is executed by the processor.
9. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the method according to any one of claims 1 to 7.
10. A processor, characterized in that the processor is configured to run a program, wherein the program when running performs the method of any of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911338962.7A CN111182240B (en) | 2019-12-23 | 2019-12-23 | Temperature drift self-compensation method for image sensor |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911338962.7A CN111182240B (en) | 2019-12-23 | 2019-12-23 | Temperature drift self-compensation method for image sensor |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111182240A true CN111182240A (en) | 2020-05-19 |
| CN111182240B CN111182240B (en) | 2021-12-28 |
Family
ID=70621528
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911338962.7A Active CN111182240B (en) | 2019-12-23 | 2019-12-23 | Temperature drift self-compensation method for image sensor |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111182240B (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113452937A (en) * | 2021-05-24 | 2021-09-28 | 中国科学院西安光学精密机械研究所 | Self-adaptive driving signal satellite-borne CCD hyperspectral imaging circuit and method |
| CN113763485A (en) * | 2021-09-28 | 2021-12-07 | 北京的卢深视科技有限公司 | Temperature drift coefficient acquisition method, electronic device, storage medium, and image correction method |
| PL442191A1 (en) * | 2022-09-02 | 2024-03-04 | Politechnika Warszawska | Suspension of a photosensitive array and method for repetitively controlling and compensating for temperature drift of the photosensitive array image |
| CN117714905A (en) * | 2024-02-06 | 2024-03-15 | 长光卫星技术股份有限公司 | Precise correction method for radiation response characteristic of CMOS image sensor |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102129673A (en) * | 2011-04-19 | 2011-07-20 | 大连理工大学 | Color digital image enhancing and denoising method under random illumination |
| CN105578082A (en) * | 2016-01-29 | 2016-05-11 | 深圳市高巨创新科技开发有限公司 | adaptive black level correction method |
| US20180061056A1 (en) * | 2016-08-30 | 2018-03-01 | Microsoft Technology Licensing, Llc | Temperature Compensation for Structured Light Depth Imaging System |
| CN109767402A (en) * | 2019-01-17 | 2019-05-17 | 中科威晟(天津)光电科技有限公司 | A kind of uncooled ir thermal imagery self organizing maps method based on statistics with histogram |
| US20190154510A1 (en) * | 2016-06-30 | 2019-05-23 | Robert Bosch Gmbh | Method for Determining a Temperature without Contact and Infrared Measuring System |
| CN109903241A (en) * | 2019-01-31 | 2019-06-18 | 武汉市聚芯微电子有限责任公司 | A kind of the depth image calibration method and system of TOF camera system |
| CN110519537A (en) * | 2019-07-30 | 2019-11-29 | 北京安酷智芯科技有限公司 | A kind of image sensor array and its temperature drift compensation method |
-
2019
- 2019-12-23 CN CN201911338962.7A patent/CN111182240B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102129673A (en) * | 2011-04-19 | 2011-07-20 | 大连理工大学 | Color digital image enhancing and denoising method under random illumination |
| CN105578082A (en) * | 2016-01-29 | 2016-05-11 | 深圳市高巨创新科技开发有限公司 | adaptive black level correction method |
| US20190154510A1 (en) * | 2016-06-30 | 2019-05-23 | Robert Bosch Gmbh | Method for Determining a Temperature without Contact and Infrared Measuring System |
| US20180061056A1 (en) * | 2016-08-30 | 2018-03-01 | Microsoft Technology Licensing, Llc | Temperature Compensation for Structured Light Depth Imaging System |
| CN109767402A (en) * | 2019-01-17 | 2019-05-17 | 中科威晟(天津)光电科技有限公司 | A kind of uncooled ir thermal imagery self organizing maps method based on statistics with histogram |
| CN109903241A (en) * | 2019-01-31 | 2019-06-18 | 武汉市聚芯微电子有限责任公司 | A kind of the depth image calibration method and system of TOF camera system |
| CN110519537A (en) * | 2019-07-30 | 2019-11-29 | 北京安酷智芯科技有限公司 | A kind of image sensor array and its temperature drift compensation method |
Non-Patent Citations (3)
| Title |
|---|
| JORGE MARIN∗ ETC.: "A compact force sensor with low temperature drift design using a standard CMOS process", 《IEEE 44TH EUROPEAN SOLID STATE CIRCUITS CONFERENCE (ESSCIRC)》 * |
| 汪民等: "一种非制冷焦平面阵列图像漂移的双温度补偿新方法", 《红外技术》 * |
| 黄本雄 等: "红外图像自适应的非均匀校正算法", 《华 中 科 技 大 学 学 报(自然科学版)》 * |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113452937A (en) * | 2021-05-24 | 2021-09-28 | 中国科学院西安光学精密机械研究所 | Self-adaptive driving signal satellite-borne CCD hyperspectral imaging circuit and method |
| CN113452937B (en) * | 2021-05-24 | 2023-12-08 | 中国科学院西安光学精密机械研究所 | Adaptive driving signal satellite-borne CCD hyperspectral imaging circuit and method |
| CN113763485A (en) * | 2021-09-28 | 2021-12-07 | 北京的卢深视科技有限公司 | Temperature drift coefficient acquisition method, electronic device, storage medium, and image correction method |
| CN113763485B (en) * | 2021-09-28 | 2022-07-26 | 合肥的卢深视科技有限公司 | Temperature drift coefficient acquisition method, electronic device, storage medium, and image correction method |
| PL442191A1 (en) * | 2022-09-02 | 2024-03-04 | Politechnika Warszawska | Suspension of a photosensitive array and method for repetitively controlling and compensating for temperature drift of the photosensitive array image |
| CN117714905A (en) * | 2024-02-06 | 2024-03-15 | 长光卫星技术股份有限公司 | Precise correction method for radiation response characteristic of CMOS image sensor |
| CN117714905B (en) * | 2024-02-06 | 2024-04-16 | 长光卫星技术股份有限公司 | Method for correcting radiation response characteristic of CMOS image sensor |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111182240B (en) | 2021-12-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111182240B (en) | Temperature drift self-compensation method for image sensor | |
| US9578211B2 (en) | Image de-noising methods and apparatuses using the same | |
| KR100735561B1 (en) | Method and apparatus for reducing noise from image sensor | |
| EP2224726A2 (en) | Image processing apparatus, image processing method, and program | |
| CN113902641B (en) | Data center hot zone judging method and system based on infrared image | |
| CN105865329B (en) | The acquisition system and method for the bundled round steel end face center coordinate of view-based access control model | |
| CN105740856A (en) | Method for reading readings of pointer instrument based on machine vision | |
| JP2010258628A5 (en) | ||
| KR20090061927A (en) | Defect and noise removal method | |
| JP6624827B2 (en) | Information processing apparatus, information processing method, and computer program | |
| CN107305695B (en) | Automatic image dead pixel correction device and method | |
| US20130141595A1 (en) | Method for detecting dead pixels and computer program roduct thereof | |
| JP2016218815A (en) | Calibration device and method for line sensor camera | |
| TW201601538A (en) | Image capture apparatus and image compensating method thereof | |
| CN112393804B (en) | Image correction method and device | |
| WO2017107395A1 (en) | Image processing method and system | |
| CN105654474A (en) | Mechanical arm positioning method based on visual guidance and device thereof | |
| TWI711005B (en) | Method for adjusting luminance of images and computer program product | |
| CN112734689A (en) | Gasket quality detection method, system, device and storage medium | |
| JP2021122106A (en) | Imaging apparatus, learning apparatus, imaging apparatus control method, learning method, learned model, and program | |
| JP2009100302A (en) | Image processing device, image processing method, program, imaging apparatus, and imaging method | |
| CN113763485B (en) | Temperature drift coefficient acquisition method, electronic device, storage medium, and image correction method | |
| CN114881978A (en) | Target detection method, electronic device and intelligent control system | |
| JP2018160024A (en) | Image processing device, image processing method and program | |
| SE533649C2 (en) | Method for compensating turbulence when recording movie sequences |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |