US20160371839A1 - Color calibration method of camera module - Google Patents
Color calibration method of camera module Download PDFInfo
- Publication number
- US20160371839A1 US20160371839A1 US15/049,749 US201615049749A US2016371839A1 US 20160371839 A1 US20160371839 A1 US 20160371839A1 US 201615049749 A US201615049749 A US 201615049749A US 2016371839 A1 US2016371839 A1 US 2016371839A1
- Authority
- US
- United States
- Prior art keywords
- color
- camera module
- parameter values
- spd
- sample
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G06T7/0018—
-
- G06T7/408—
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N17/00—Diagnosis, testing or measuring for television systems or their details
- H04N17/002—Diagnosis, testing or measuring for television systems or their details for television cameras
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
- H04N23/84—Camera processing pipelines; Components thereof for processing colour signals
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10024—Color image
Definitions
- the present invention belongs to the field of color calibration, and particularly relates to a color calibration method of a camera module.
- the performance test of the camera module includes multiple test items including resolution ratio, white balance, gray scale and color, etc., where color calibration of the camera module is a very important item, and colors of images, such as sky blue, grass green and etc., can be accurately expressed only after color calibration.
- the traditional color calibration method of a camera module includes photographing a standard color chart under the standard lighting cabinet, analyzing the relation between imaging data and the standard value of the standard color chart, and establishing a calibration module, thereby realizing the color calibration of the camera model.
- the traditional method has the following disadvantages: a standard lighting cabinet and a standard color chart are needed, the stability of the standard lighting cabinet is poor, the maintenance cost of the standard lighting cabinet is high, a considerably experienced operator is needed during the whole calibration process, the process is time-consuming, and color samples needed by a user cannot be customized for color calibration.
- the present invention provides a color calibration method of a camera module, characterized by a high degree of automation, improved light source stability and great flexibility.
- the present invention adopts the technical scheme as follows:
- n is an integer from 1 to 10; meanwhile providing a multiplication result of a spectral power distribution SPD ( ⁇ ) and a spectral reflectance R ( ⁇ ) of each color sample, and a brightness of each color sample in the color chart in a standard lighting environment;
- the color chart is laid in a certain standard lighting environment and is photographed by using the camera module under certain settings, so that multiple reference parameter values of each color sample in the color chart are obtained after processing; meanwhile, in the standard lighting environment, the multiplication result of the spectral power distribution SPD ( ⁇ ) and the spectral reflectance R ( ⁇ ) of each color sample, and the brightness of each color sample in the color chart are measured by using corresponding measurement device.
- n 3
- the reference parameter values X 1 to X 3 are RGB values
- the computational formulas thereof are as follows:
- the whole color calibration process needs to be done in a dark space without any other environmental lighting.
- the standard color chart or user-defined color chart in the step 1) comprises frequently-used 24-color X-Rite ColorChecker Classic, X-Rite ColorCheck Digital SG a color chart used in other industries, a user-defined color chart and a user-defined virtual color chart.
- the camera module in the step 4) includes a professional single-lens reflex camera, a consumer digital camera, an industrial camera, and mobile device camera modules and other imaging devices.
- the color calibration model in the step 5) is selected from one of the following models: a linear model, an exponential model, a polynomial model, a logarithmic model, a power model and a table lookup method.
- the present invention firstly multiple reference parameter values of each color sample in a color chart are set, or a photograph and a measurement are performed on a standard color chart or a user-defined color chart in a certain standard lighting environment, multiple reference parameter values, SPD ( ⁇ ) ⁇ R ( ⁇ ) and brightness of each color sample are obtained. Then the SPD ( ⁇ ) ⁇ R ( ⁇ ) and the brightness of each color sample are reproduced by using a spectral tunable lighting source. Then each reproduced color sample is photographed by using the camera under the same settings to obtain multiple reproduced parameter values of each color sample. The two groups of parameter values are compared and a color calibration model is established. Finally color calibration of each batch of camera modules is implemented without the helping of a color chart and standard lighting environment.
- the present invention has the characteristics of high automation degree, high flexibility and adaptability, and high convenience in color changing and color sample calibrating, and thus has an extremely high practical value.
- FIG. 1 is a flowchart according to Embodiment I;
- FIG. 2 is a diagram of a 24-color X-Rite ColorChecker Classic standard color chart adopted in the Embodiment I;
- FIG. 3 is a diagram of spectral power distribution of standard daylight D65 defined by International Commission on illumination according to the Embodiment I;
- FIG. 4 is diagram of spectral reflectance supplied officially by the X-Rite ColorChecker Classic color chart according to the Embodiment I;
- FIG. 5 is a setting diagram for the camera module photographing each color sample reproduced by a spectral tunable lighting source according to the Embodiment I;
- FIG. 6 is a diagram of polynomial calibration model of a red channel according to the Embodiment I;
- FIG. 7 is a diagram of polynomial calibration model of a green channel according to the Embodiment I.
- FIG. 8 is a diagram of polynomial calibration model of a blue channel according to the Embodiment I;
- FIG. 9 is a flowchart according to an Embodiment II.
- FIG. 10 is a diagram of photograph setting of a standard color chart under a standard lighting cabinet using D50 according to the Embodiment II;
- FIG. 11 is a diagram of measurement setting of a standard color chart under a standard lighting cabinet using D50 according to the Embodiment II;
- FIG. 12 is a diagram of a measured SPD ( ⁇ ) ⁇ R ( ⁇ ) of each color sample according to the Embodiment II;
- FIG. 13 is a diagram of linear calibration model of a red channel according to the Embodiment II.
- FIG. 14 is a diagram of linear calibration model of a green channel according to the Embodiment II.
- FIG. 15 is a diagram of linear calibration model of a blue channel according to the Embodiment II.
Abstract
Description
- The present invention belongs to the field of color calibration, and particularly relates to a color calibration method of a camera module.
- With the rapid development of mobile Internet, mobile devices have also been widely applied to all fields of people's lives, and as a camera module serves as a very important component of a mobile device, increasing attention is paid to the imaging quality of the camera module.
- The performance test of the camera module includes multiple test items including resolution ratio, white balance, gray scale and color, etc., where color calibration of the camera module is a very important item, and colors of images, such as sky blue, grass green and etc., can be accurately expressed only after color calibration.
- The traditional color calibration method of a camera module includes photographing a standard color chart under the standard lighting cabinet, analyzing the relation between imaging data and the standard value of the standard color chart, and establishing a calibration module, thereby realizing the color calibration of the camera model. The traditional method has the following disadvantages: a standard lighting cabinet and a standard color chart are needed, the stability of the standard lighting cabinet is poor, the maintenance cost of the standard lighting cabinet is high, a considerably experienced operator is needed during the whole calibration process, the process is time-consuming, and color samples needed by a user cannot be customized for color calibration.
- In order to solve the disadvantages of the traditional calibration method of a camera module, the present invention provides a color calibration method of a camera module, characterized by a high degree of automation, improved light source stability and great flexibility. The present invention adopts the technical scheme as follows:
- 1) selecting a standard color chart or a user-defined color chart;
- 2) providing multiple reference parameter values of each color sample in the color chart, the multiple reference parameter values are denoted as X1 to Xn, wherein n is an integer from 1 to 10; meanwhile providing a multiplication result of a spectral power distribution SPD (λ) and a spectral reflectance R (λ) of each color sample, and a brightness of each color sample in the color chart in a standard lighting environment;
- 3) reproducing the multiplication result of the spectral power distribution SPD (λ) and the spectral reflectance R (λ) of each color sample, and the brightness of each color sample by means of a spectral tunable lighting source;
- 4) sequentially photographing the each reproduced SPD (λ)×R (λ) and the brightness of each color sample in step 3) by the camera module, and obtaining multiple reproduced parameter values after processing, which are denoted as X1′ to Xn′;
- 5) respectively establishing a color calibration model by comparing each reference parameter values X1 to Xn with those X1′ to Xn′;
- 6) processing the parameter values X1′ to Xn′ obtained through photographing of each camera module by means of the color calibration models established in the step 5), so as to obtain corresponding calibrated parameter values X1″ to Xn″, thereby accomplishing color calibration of the camera module.
- Preferably, in the step 2), the color chart is laid in a certain standard lighting environment and is photographed by using the camera module under certain settings, so that multiple reference parameter values of each color sample in the color chart are obtained after processing; meanwhile, in the standard lighting environment, the multiplication result of the spectral power distribution SPD (λ) and the spectral reflectance R (λ) of each color sample, and the brightness of each color sample in the color chart are measured by using corresponding measurement device.
- Preferably, n=3, the reference parameter values X1 to X3 are RGB values, and the computational formulas thereof are as follows:
-
R=Σr (λ)×SPD(λ)×R(λ) -
G=Σg (λ)×SPD(λ)×R(λ) -
B=Σb (λ)×SPD(λ)×R(λ) -
- wherein,
r (λ),g (λ) andb (λ) are spectral sensitivity curves of red, green and blue channels of the camera module, SPD (λ) is the spectral power distribution of a standard lighting environment, R (λ) is the spectral reflectance of the color sample, and λ is a wavelength.
- wherein,
- Preferably, the whole color calibration process needs to be done in a dark space without any other environmental lighting.
- Preferably, the standard color chart or user-defined color chart in the step 1) comprises frequently-used 24-color X-Rite ColorChecker Classic, X-Rite ColorCheck Digital SG a color chart used in other industries, a user-defined color chart and a user-defined virtual color chart.
- Preferably, the camera module in the step 4) includes a professional single-lens reflex camera, a consumer digital camera, an industrial camera, and mobile device camera modules and other imaging devices.
- Preferably, the color calibration model in the step 5) is selected from one of the following models: a linear model, an exponential model, a polynomial model, a logarithmic model, a power model and a table lookup method.
- According to the present invention, firstly multiple reference parameter values of each color sample in a color chart are set, or a photograph and a measurement are performed on a standard color chart or a user-defined color chart in a certain standard lighting environment, multiple reference parameter values, SPD (λ)×R (λ) and brightness of each color sample are obtained. Then the SPD (λ)×R (λ) and the brightness of each color sample are reproduced by using a spectral tunable lighting source. Then each reproduced color sample is photographed by using the camera under the same settings to obtain multiple reproduced parameter values of each color sample. The two groups of parameter values are compared and a color calibration model is established. Finally color calibration of each batch of camera modules is implemented without the helping of a color chart and standard lighting environment. The present invention has the characteristics of high automation degree, high flexibility and adaptability, and high convenience in color changing and color sample calibrating, and thus has an extremely high practical value.
-
FIG. 1 is a flowchart according to Embodiment I; -
FIG. 2 is a diagram of a 24-color X-Rite ColorChecker Classic standard color chart adopted in the Embodiment I; -
FIG. 3 is a diagram of spectral power distribution of standard daylight D65 defined by International Commission on illumination according to the Embodiment I; -
FIG. 4 is diagram of spectral reflectance supplied officially by the X-Rite ColorChecker Classic color chart according to the Embodiment I; -
FIG. 5 is a setting diagram for the camera module photographing each color sample reproduced by a spectral tunable lighting source according to the Embodiment I; -
FIG. 6 is a diagram of polynomial calibration model of a red channel according to the Embodiment I; -
FIG. 7 is a diagram of polynomial calibration model of a green channel according to the Embodiment I; -
FIG. 8 is a diagram of polynomial calibration model of a blue channel according to the Embodiment I; -
FIG. 9 is a flowchart according to an Embodiment II; -
FIG. 10 is a diagram of photograph setting of a standard color chart under a standard lighting cabinet using D50 according to the Embodiment II; -
FIG. 11 is a diagram of measurement setting of a standard color chart under a standard lighting cabinet using D50 according to the Embodiment II; -
FIG. 12 is a diagram of a measured SPD (λ)×R (λ) of each color sample according to the Embodiment II; -
FIG. 13 is a diagram of linear calibration model of a red channel according to the Embodiment II; -
FIG. 14 is a diagram of linear calibration model of a green channel according to the Embodiment II; and -
FIG. 15 is a diagram of linear calibration model of a blue channel according to the Embodiment II. - The present invention will be explained in detail in combination with the embodiments and the drawings as follows.
- Taking the setting of RGB values, SPD (λ)×R (λ), brightness of each color sample and a Canon EOS 650D three-channel RGB camera as an example, the flowchart is as shown in
FIG. 1 , and the specific steps are as follows: - 1) adopting a 24-color X-Rite ColorChecker Classic color chart as shown in
FIG. 2 ; - 2) adopting officially provided RGB values of each color sample in the standard color chart as reference parameter values; meanwhile, adopting the multiplication result of spectral power distribution SPD (λ) of standard daylight D65 defined by International Commission on illumination and officially provided spectral reflectance R (λ) of each color sample of the standard color chart as SPD (λ)×R (λ) (as shown in
FIG. 3 andFIG. 4 ); setting the brightness of each color sample; - 3) reproducing the SPD (λ)×R (λ) and the brightness of each color sample through a spectral tunable lighting source;
- 4) sequentially photographing the each reproduced SPD (λ)×R (λ) and brightness of each color sample through the camera with certain settings (f-number 5.6, exposure time 1/60 and ISO100) as shown in
FIG. 5 , and obtaining reproduced RGB values of each color sample after processing, which are denoted as R′G′B′; - 5) establishing a color calibration model by using a polynomial model by comparing RGB and R′G′B′ (as shown in
FIGS. 6-8 ); and - 6) obtaining corresponding calibrated R″G″B″ values by performing processing on the R′G′B′ values obtained by camera modules by means of the color calibration module established in the step 5), thereby accomplishing the color calibration of the camera modules.
- Taking obtaining RGB values of each color sample of a Canon EOS 650D three-channel RGB camera through photographing and measurement and obtaining the SPD (λ)×R (λ) and the brightness of each color sample through measurement as an example, the flowchart is as shown in
FIG. 9 , and the specific steps are as follows: - 1) adopting a 24-color X-Rite ColorChecker Classic standard color chart;
- 2) as shown in
FIG. 10 , laying the color chart in the standard lighting cabinet using 0/45 geometry with daylight D50, photographing the color chart through a Canon EOS 650D single-lens reflex camera (f-number 5.6, exposure time 1/60 and ISO100), and obtaining the preference RGB values of each color sample in the color chart after processing; meanwhile, directly measuring the SPD (λ) (the spectral power distribution of the standard lighting cabinet D50)×R (λ) (the spectral reflectance) and the brightness of the color sample with a spectroradiometer (as shown inFIG. 11 ), wherein the measured SPD λ)×R (λ) of each color sample is as shown inFIG. 12 ; - 3) accurately reproducing the SPD (λ)×R (λ) and the brightness of each color sample through a spectral tunable lighting source;
- 4) sequentially photographing the each reproduced SPD (λ)×R (λ) and brightness of each color sample by means of the camera module under the same settings (as shown in
FIG. 5 ), and obtaining reproduced RGB values of each color sample after processing, which are denoted as R′G′B′; - 5) establishing a color calibration model by means of a linear model by comparing RGB with R′G′B′ (as shown in
FIGS. 13-15 ); and - 6) obtaining corresponding calibrated R″G″B″ values by processing the R′G′B′ values obtained by camera modules by means of the color calibration module established in the step 5), thereby accomplishing the color calibration of the camera module.
- The aforementioned contents specifically explain the embodiments of the present invention, but the present invention is not limited to the embodiments, those skilled in the art can further make various equivalent modifications or substitutions on the promise that the creativity of the present invention is not violated, and the modifications or substitutions are all included in the range limited by the claims of this application.
Claims (7)
R=Σ
G=Σ
B=Σ
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN20150332640.7 | 2015-06-16 | ||
CN201510332640.7A CN104897374B (en) | 2015-06-16 | 2015-06-16 | A kind of color calibration method of camera module |
CN20150332640 | 2015-06-16 |
Publications (2)
Publication Number | Publication Date |
---|---|
US9514535B1 US9514535B1 (en) | 2016-12-06 |
US20160371839A1 true US20160371839A1 (en) | 2016-12-22 |
Family
ID=54030180
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/049,749 Active US9514535B1 (en) | 2015-06-16 | 2016-02-22 | Color calibration method of camera module |
Country Status (2)
Country | Link |
---|---|
US (1) | US9514535B1 (en) |
CN (1) | CN104897374B (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11058282B2 (en) * | 2017-03-17 | 2021-07-13 | Dentsply Sirona Inc. | Colour reference for calibrating a dental colour camera |
Families Citing this family (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107131955A (en) * | 2016-02-26 | 2017-09-05 | 富泰华工业(深圳)有限公司 | Optical measuring device and measuring method |
CN105806484A (en) * | 2016-03-08 | 2016-07-27 | 常州千明智能照明科技有限公司 | Method for obtaining device-independent response value of object color based on spectrum-adjustable LED light source |
JP2017163241A (en) * | 2016-03-08 | 2017-09-14 | 日本放送協会 | Chart device |
CN106060533B (en) * | 2016-06-01 | 2018-03-23 | 歌尔股份有限公司 | A kind of method and device of camera color debugging |
CN108012142A (en) * | 2017-10-20 | 2018-05-08 | 上海与德科技有限公司 | Camera testing system, method, terminal and computer-readable recording medium |
CN109474809B (en) * | 2018-11-07 | 2021-06-11 | 深圳六滴科技有限公司 | Chromatic aberration correction method, device and system, panoramic camera and storage medium |
EP3964034A1 (en) * | 2019-04-30 | 2022-03-09 | Signify Holding B.V. | Luminance distribution determination |
TWI766162B (en) * | 2019-05-24 | 2022-06-01 | 易學科技股份有限公司 | Chromatic aberration correcting method for digital image capturing device and screen and the devices thereof |
CN112019833B (en) * | 2019-05-31 | 2022-09-02 | 易学科技股份有限公司 | Digital image capturing device and color difference correction method and device of screen |
CN110336952B (en) * | 2019-06-06 | 2020-11-17 | 华为技术有限公司 | Spectral curve acquisition method, electronic device and chip |
CN112243584A (en) * | 2019-09-18 | 2021-01-19 | 深圳市大疆创新科技有限公司 | Image color correction method, shooting device and image color correction system |
US11375181B2 (en) * | 2020-11-10 | 2022-06-28 | Samsung Electronics Co., Ltd. | Camera module test apparatus, camera module test method and image generating device |
CN112165616B (en) * | 2020-11-13 | 2023-05-02 | 歌尔光学科技有限公司 | Camera module testing method and device, electronic equipment and storage medium |
CN113390831B (en) * | 2021-05-20 | 2023-03-24 | 常州千明智能照明科技有限公司 | Full-appearance bidirectional reflection distribution characteristic measuring method |
Family Cites Families (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5668596A (en) * | 1996-02-29 | 1997-09-16 | Eastman Kodak Company | Digital imaging device optimized for color performance |
JP2002267574A (en) * | 2001-03-14 | 2002-09-18 | Hitachi Ltd | Colorimetry device for color display device, colorimetry, image quality adjustment/inspection device, and image quality adjustment/inspection method |
WO2003029766A2 (en) * | 2001-10-04 | 2003-04-10 | Digieye Plc | Apparatus and method for measuring colour |
JP2004109098A (en) * | 2002-09-13 | 2004-04-08 | Rigio Waki | Color characteristics detection for eye, light source and instrument |
CN101409045B (en) * | 2007-10-08 | 2011-03-16 | 中华映管股份有限公司 | Chrominance compensation method and illumination method for display device |
JP2011220823A (en) * | 2010-04-09 | 2011-11-04 | Seiko Epson Corp | Color measuring device and color measuring method |
JP6154153B2 (en) * | 2013-02-14 | 2017-06-28 | 大塚電子株式会社 | Standard light source and measurement method |
-
2015
- 2015-06-16 CN CN201510332640.7A patent/CN104897374B/en active Active
-
2016
- 2016-02-22 US US15/049,749 patent/US9514535B1/en active Active
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11058282B2 (en) * | 2017-03-17 | 2021-07-13 | Dentsply Sirona Inc. | Colour reference for calibrating a dental colour camera |
Also Published As
Publication number | Publication date |
---|---|
US9514535B1 (en) | 2016-12-06 |
CN104897374B (en) | 2016-04-13 |
CN104897374A (en) | 2015-09-09 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9514535B1 (en) | Color calibration method of camera module | |
US11635671B2 (en) | Techniques for creating characterization matrices for reflectance, illuminance, or sensor response | |
CN107197225B (en) | Color digital camera white balance correcting based on chromatic adaptation model | |
US10088364B2 (en) | Colorimetry system for display testing | |
CN104168475B (en) | A kind of imaging type of digital camera changeable parameters obtains the method for color tristimulus values | |
RU2369035C2 (en) | Method and device for calibration of colours in chamber and/or display design, and for correction of digital image colour defects | |
EP3888345B1 (en) | Method for generating image data for machine learning based imaging algorithms | |
CN109506781B (en) | Chrominance measuring method and device | |
JP2015127680A (en) | Measuring device, system and program | |
CN109459136B (en) | Method and device for measuring chromaticity | |
CN106605400B (en) | Digital system and method for paint color matching | |
CN105336308A (en) | Color calibration method and system for display equipment | |
CN104933706A (en) | Imaging system color information calibration method | |
Varghese et al. | Colorimetric calibration of high dynamic range images with a ColorChecker chart | |
JP2019020311A (en) | Color measurement method and color measurement device | |
Pointer et al. | Practical camera characterization for colour measurement | |
US20130329056A1 (en) | Color calibration of an image capture device in a way that is adaptive to the scene to be captured | |
KR101570616B1 (en) | Colorimetry method using mobile app | |
CN204859430U (en) | Gather colored imaging system of object standard colour information | |
CN105744267B (en) | Acquisition tristimulus values method based on quantic digital camera changeable parameters | |
CN106896068A (en) | The commodity color for solving net purchase cross-color is obtained and reproducting method and its system | |
Guarnera et al. | Turning a Digital Camera into an Absolute 2D Tele‐Colorimeter | |
JP5509053B2 (en) | Color temperature component analyzer | |
Kamath et al. | Prediction of illuminance on the work plane using low dynamic unprocessed image data | |
Sim et al. | Artwork Reproduction Through Display Based on Hyperspectral Imaging |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: THOUSAND LIGHTS LIGHTING (CHANGZHOU) LIMITED, CHIN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:LUO, MING RONNIER;WANG, BINYU;REEL/FRAME:037788/0592 Effective date: 20160126 |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
FEPP | Fee payment procedure |
Free format text: SURCHARGE FOR LATE PAYMENT, SMALL ENTITY (ORIGINAL EVENT CODE: M2554); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YR, SMALL ENTITY (ORIGINAL EVENT CODE: M2551); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY Year of fee payment: 4 |