WO2023240650A1

WO2023240650A1 - Color correction matrix calibration method and apparatus for camera module

Info

Publication number: WO2023240650A1
Application number: PCT/CN2022/099623
Authority: WO
Inventors: 张超; 龚瑶
Original assignee: 北京小米移动软件有限公司
Priority date: 2022-06-17
Filing date: 2022-06-17
Publication date: 2023-12-21
Also published as: CN117616749A

Abstract

A color correction matrix calibration method and apparatus for a camera module. The method comprises: determining a plurality of camera modules, wherein the models of the plurality of camera modules are the same, and component parameters of one or more camera modules are different; with regard to each camera module, determining a color correction matrix of the camera module according to a spectral response of the camera module; and according to color correction matrixes of the plurality of camera modules, determining a calibration matrix between a non-reference camera module and a reference camera module from among the plurality of camera modules, wherein on the basis of the calibration matrix, when the color correction matrix of the reference camera module is changed, the difference between color restoration indexes of the non-reference camera module and the reference camera module is maintained within a preset difference range.

Description

Color correction matrix calibration method and device for camera module

Technical field

The present disclosure relates to the field of camera technology, and in particular, to a color correction matrix calibration method and device for a camera module.

Background technique

At present, the main way to determine the color correction matrix of a camera module is to select a reference camera module from multiple camera modules of the same model; for the reference camera module, the reference camera module is used to compare the standard color card under various light sources. Shoot and obtain each image; for the image under each light source, process the image according to the image processing strategy, and then perform color space conversion to determine the color correction matrix of the reference camera module; use the color correction matrix as multiple cameras The module's color correction matrix.

In the above solution, among multiple camera modules of the same model, different camera modules have different component parameters. That is to say, there are errors in component parameters between different camera modules, resulting in the use of the same color correction matrix. When doing this, the color reproduction effects of different camera modules are inconsistent.

Contents of the invention

The present disclosure provides a color correction matrix calibration method and device for a camera module.

According to a first aspect of an embodiment of the present disclosure, a color correction matrix calibration method for a camera module is provided. The method includes: determining a plurality of camera modules; wherein the models of the plurality of camera modules are all the same, and One or more of the camera modules have different component parameters; for each camera module, determine the color correction matrix of the camera module according to the spectral response of the camera module; according to a plurality of the camera modules The color correction matrix determines the calibration matrix between the non-reference camera module and the reference camera module among the plurality of camera modules, wherein, based on the calibration matrix, the color correction matrix of the reference camera module occurs When changing, the difference between the color reproduction indicators of the non-reference camera module and the reference camera module is maintained within a preset difference range.

In one embodiment of the present disclosure, the number of color correction matrices of the camera module is multiple, corresponding to different light sources; and based on the color correction matrices of multiple camera modules, multiple cameras are determined. The calibration matrix between the non-reference camera module and the reference camera module in the module includes: for each non-reference camera module in the multiple camera modules, for each light source, obtain the non-reference camera The first color correction matrix of the module under the light source, and the second color correction matrix of the reference camera module under the light source; perform the first color correction matrix and the second color correction matrix. Ratio processing is performed to obtain the calibration matrix between the non-reference camera module and the reference camera module under the light source.

In one embodiment of the present disclosure, the method further includes: for each non-reference camera module, writing the calibration matrix between the non-reference camera module and the reference camera module into the non-reference camera module. In the first memory of the reference camera module, wherein the first memory does not allow changes to the written data; write the color correction matrix of the non-reference camera module into the non-reference camera module. in the second memory.

In one embodiment of the present disclosure, the method further includes: when the color correction matrix of the reference camera module is changed, obtaining the changed color correction matrix of the reference camera module; for each non-reference camera A module that determines the changed color of the non-reference camera module based on the changed color correction matrix of the reference camera module and the calibration matrix between the non-reference camera module and the reference camera module. Correction matrix: update the color correction matrix stored in the non-reference camera module according to the changed color correction matrix.

In one embodiment of the present disclosure, the modified color correction matrix of the reference camera module is determined based on the images captured by the reference camera module on the standard color card under various light sources; according to the specified image The processing strategy processes the image to obtain an image in the sRGB color space; performs color space conversion on the image in the sRGB color space to obtain an image in the Lab color space; determines the reference camera based on the image in the Lab color space The module's post-change color correction matrix.

In one embodiment of the present disclosure, the camera module includes: a lens, a sensor, a back-end image processing chip and software; correspondingly, the component parameters include at least one of the following: lens parameters, sensor parameters, rear End image processing chip parameters and soft board parameters.

According to a second aspect of the embodiment of the present disclosure, a color correction matrix calibration device for a camera module is also provided. The device includes: a first determination module for determining a plurality of camera modules; wherein a plurality of the cameras The models of the modules are all the same, and the component parameters of one or more of the camera modules are different; the second determination module is used to determine the camera for each camera module according to the spectral response of the camera module. The color correction matrix of the module; the third determination module is used to determine the calibration between the non-reference camera module and the reference camera module in the plurality of camera modules according to the color correction matrix of the plurality of camera modules. Matrix, wherein, based on the calibration matrix, when the color correction matrix of the reference camera module is changed, the difference between the color restoration indicators of the non-reference camera module and the reference camera module is maintained at a preset value. within the difference range.

In one embodiment of the present disclosure, the number of color correction matrices of the camera module is multiple, corresponding to different light sources; the third determination module is specifically configured to target each of the plurality of camera modules. A non-reference camera module, for each light source, obtain the first color correction matrix of the non-reference camera module under the light source, and the second color correction matrix of the reference camera module under the light source. ; Perform ratio processing on the first color correction matrix and the second color correction matrix to obtain a calibration matrix between the non-reference camera module and the reference camera module under the light source.

In one embodiment of the present disclosure, the device further includes: a writing module, configured to write, for each non-reference camera module, the calibration matrix between the non-reference camera module and the reference camera module. , written into the first memory of the non-reference camera module, wherein the first memory does not allow changes to the written data; write the color correction matrix of the non-reference camera module into the in the secondary memory of the non-reference camera module.

In one embodiment of the present disclosure, the device further includes: an acquisition module, a fourth determination module and an update module; wherein the acquisition module is configured to: when the color correction matrix of the reference camera module changes, Obtain the changed color correction matrix of the reference camera module; the fourth determination module is used for each non-reference camera module, according to the changed color correction matrix of the reference camera module, and the non-reference camera module The calibration matrix between the reference camera module and the reference camera module is used to determine the changed color correction matrix of the non-reference camera module; the update module is used to calculate the modified color correction matrix according to the changed color correction matrix. The color correction matrix stored in the non-reference camera module is updated.

According to a third aspect of an embodiment of the present disclosure, an electronic device is further provided, including: a processor; a memory for storing instructions executable by the processor; wherein the processor is configured to execute the instructions to Implement the color correction matrix calibration method of the camera module as described above.

According to a fourth aspect of the embodiment of the present disclosure, a non-transitory computer-readable storage medium is also provided, which when instructions in the storage medium are executed by a processor, enables the processor to execute the above-described camera module. Color correction matrix calibration method.

The technical solutions provided by the embodiments of the present disclosure at least bring the following beneficial effects:

By determining multiple camera modules; among them, the models of the multiple camera modules are the same, and the component parameters of one or more camera modules are different; for each camera module, the camera is determined according to the spectral response of the camera module. The color correction matrix of the module; based on the color correction matrices of multiple camera modules, determine the calibration matrix between the non-reference camera module and the reference camera module in the multiple camera modules, where, based on the calibration matrix, in the reference camera When the color correction matrix of the module changes, the difference between the color reproduction indicators of the non-reference camera module and the reference camera module is maintained within the preset difference range, so that the color correction matrix of the reference camera module changes. When combined with the calibration matrix, different color correction matrices for camera modules of the same model and different component parameters can be accurately and quickly determined to ensure consistent color restoration effects of different camera modules.

It should be understood that the foregoing general description and the following detailed description are exemplary and explanatory only, and do not limit the present disclosure.

Description of the drawings

The drawings herein are incorporated into and constitute a part of this specification, illustrate embodiments consistent with the disclosure, and together with the description are used to explain the principles of the disclosure, and do not constitute undue limitations on the disclosure.

Figure 1 is a flow chart of a color correction matrix calibration method of a camera module according to an embodiment of the present disclosure;

Figure 2 is a flow chart of a color correction matrix calibration method of a camera module according to another embodiment of the present disclosure;

Figure 3 is a schematic structural diagram of a color correction matrix calibration device of a camera module according to an embodiment of the present disclosure;

FIG. 4 is a structural block diagram of an electronic device according to an exemplary embodiment of the present disclosure.

Detailed ways

In order to allow ordinary people in the art to better understand the technical solutions of the present disclosure, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the accompanying drawings.

It should be noted that the terms "first", "second", etc. in the description and claims of the present disclosure and the above-mentioned drawings are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It is to be understood that the data so used are interchangeable under appropriate circumstances so that the embodiments of the disclosure described herein can be practiced in sequences other than those illustrated or described herein. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with aspects of the disclosure as detailed in the appended claims.

FIG. 1 is a flow chart of a color correction matrix calibration method of a camera module according to an embodiment of the present disclosure. It should be noted that the color correction matrix calibration method of the camera module in this embodiment is executed by the color correction matrix calibration device of the camera module. The color correction matrix calibration device of the camera module can be implemented by software and/or hardware. , the color correction matrix calibration device of the camera module can be configured in an electronic device, which can include a terminal device with a camera such as a mobile terminal (such as a mobile phone), a tablet computer, or a camera device. The following description takes the execution subject as an electronic device as an example.

As shown in Figure 1, the method includes the following steps:

Step 101: Determine multiple camera modules; wherein the models of the multiple camera modules are the same, and one or more camera modules have different component parameters.

In the embodiment of the present disclosure, the camera module mainly consists of the following components: lens, sensor, backend image processing chip (Backend IC), and flexible circuit board (FPC). Among them, the lens is used to focus the light to the sensor. Sensors are used to convert light signals into electrical signals. The back-end image processing chip is used for image processing of images in the form of electrical signals. The soft board is used to carry the back-end image processing chip. Correspondingly, the component parameters may include at least one of the following: lens parameters, sensor parameters, back-end image processing chip parameters, and soft board parameters.

In some embodiments, the models of multiple camera modules are the same, which means that the models of corresponding components in the multiple camera modules are the same. For example, taking lenses as an example, the lens model of one camera module is different from that of another camera module. The lenses in the group are of the same model. The component parameters of one or more camera modules are different, which means that the component parameters of some camera modules in multiple camera modules are different, and the component parameters of some camera modules are the same; or, all camera modules in multiple camera modules The component parameters are different.

Among them, taking the different component parameters of two camera modules as an example, it means that some component parameters in the two camera modules are the same and some component parameters are different; or, all component parameters in the two camera modules are different. For example, the parameters of the lenses in the two camera modules are different. This difference is caused by errors in the manufacturing process or production line production during the lens manufacturing process.

In some embodiments, for each component in the camera module, all possible component parameters of the component can be determined; and then for each component, one possible component parameter of each component is combined to obtain multiple combinations, That is, multiple camera modules with the same model and different component parameters.

Step 102: For each camera module, determine the color correction matrix of the camera module according to the spectral response of the camera module.

In the embodiment of the present disclosure, the method of obtaining the spectral response of the camera module may be to obtain the spectral response obtained by performing spectral measurement on the camera module with a spectrometer; or, calling the spectrometer to perform spectral measurement on the camera module to obtain the spectral response of the camera module. spectral response.

Among them, there are multiple spectral responses, corresponding to different light sources. In other words, the camera module has a spectral response corresponding to each light source.

Among them, the image processing process of the captured image by the camera module can be, for example, performing Demosaic color interpolation processing and automatic white balance AWB processing on the captured RAW color space image to obtain an RGB color space image; The image is converted using a color correction matrix to obtain an image in the sRGB color space; the image in the sRGB color space is sequentially subjected to CV processing and 2DLut processing to obtain an image in the HSV color space, and then subsequent display processing is performed.

In the above image processing process, the color correction matrix is used to convert the image in the RGB color space to obtain the image in the sRGB color space.

Step 103: Determine the calibration matrix between the non-reference camera module and the reference camera module in the multiple camera modules based on the color correction matrices of the multiple camera modules, wherein based on the calibration matrix, the color of the reference camera module When the correction matrix is changed, the difference between the color reproduction indicators of the non-reference camera module and the reference camera module remains within the preset difference range.

In the embodiment of the present disclosure, in order to reduce the number of calibration matrices, one camera module can be selected from multiple camera modules as a reference camera module. For example, the reference camera module can be a golden camera among the multiple camera modules. Mods.

In some embodiments, the number of color correction matrices of the camera module is multiple, corresponding to different light sources. Correspondingly, the process of the electronic device performing step 103 may be, for example, the process of determining the calibration matrix between the non-reference camera module and the reference camera module, for example, for each non-reference camera module in the plurality of camera modules. , for each light source, obtain the first color correction matrix of the non-reference camera module under the light source, and the second color correction matrix of the reference camera module under the light source; perform the first color correction matrix and the second color correction matrix Ratio processing is performed to obtain the calibration matrix between the non-reference camera module and the reference camera module under the light source.

Among them, for a non-reference camera module, different light sources correspond to different calibration matrices. Therefore, a non-reference camera module can have multiple calibration matrices, and the number of calibration matrices is consistent with the number of light sources. It should be noted that the light sources here are multiple prescribed standard light sources.

In some embodiments, based on the calibration matrix, the difference position between the color restoration indicators of the non-reference camera module and the reference camera module is within the preset difference range, which means based on the calibration matrix and the color correction matrix of the reference camera module. , the color correction matrix of the non-reference camera module can be determined; based on the color correction matrix, the non-reference camera module performs image processing (including color restoration processing) on the captured image to obtain the first color restoration of the image Index; refer to the second color restoration index of the image obtained by performing image processing on the captured image by the camera module; the difference between the first color restoration index and the second color restoration index is maintained within the preset difference range.

In some embodiments, after step 103, the electronic device may also perform the following process: for each non-reference camera module, write the calibration matrix between the non-reference camera module and the reference camera module into the non-reference camera module. In the first memory, the first memory does not allow modification of the written data; write the color correction matrix of the non-reference camera module into the second memory of the non-reference camera module.

The first memory may be, for example, an OTP (One Time Programmable) type memory, which can only be programmed once. In other words, after programs or data are written to this type of memory, they cannot be changed or cleared again, thus ensuring the security of important data in the camera module.

The color correction matrix calibration method of the camera module according to the embodiment of the present disclosure determines multiple camera modules; wherein the models of the multiple camera modules are the same, and the component parameters of one or more camera modules are different; for each determine the color correction matrix of the camera module based on the spectral response of the camera module; determine the non-reference camera module and the reference camera module among the multiple camera modules based on the color correction matrices of multiple camera modules Wherein, based on the calibration matrix, when the color correction matrix of the reference camera module changes, the difference between the color restoration indicators of the non-reference camera module and the reference camera module is maintained within the preset difference range , so that when the color correction matrix of the reference camera module changes, it can be combined with the calibration matrix to accurately and quickly determine the different color correction matrices of the same model of camera modules with different component parameters, ensuring that the color restoration effects of different camera modules are consistent.

FIG. 2 is a flow chart of a color correction matrix calibration method of a camera module according to another embodiment of the present disclosure. As shown in Figure 2, based on the embodiment shown in Figure 1, for each non-reference camera module, the calibration matrix between the non-reference camera module and the reference camera module is written into the non-reference camera module In the first memory; after writing the color correction matrix of the non-reference camera module into the second memory of the non-reference camera module, the electronic device can also perform the following steps:

Step 201: When the color correction matrix of the reference camera module changes, obtain the changed color correction matrix of the reference camera module.

In the embodiment of the present disclosure, the modified color correction matrix of the reference camera module is determined based on the images captured by the reference camera module on the standard color card under various light sources; and the images are processed according to the specified image processing strategy. , obtain an image in the sRGB color space; perform color space conversion on the image in the sRGB color space to obtain an image in the Lab color space; determine the changed color correction matrix of the reference camera module based on the image in the Lab color space. The standard color card may be, for example, a ColorChecker standard color card.

Among them, changes in the color correction matrix of the reference camera module can indicate changes in the image processing strategy, for example, changes in Demosaic color interpolation processing, changes in automatic white balance AWB processing, etc.

Step 202: For each non-reference camera module, determine the modified color correction matrix of the non-reference camera module based on the modified color correction matrix of the reference camera module and the calibration matrix between the non-reference camera module and the reference camera module. Color correction matrix.

In the embodiment of the present disclosure, the electronic device performs step 202, for example, by multiplying the changed color correction matrix and the calibration matrix of the reference camera module. The resulting matrix is the changed color of the non-reference camera module. correction matrix. Among them, the calculation formula of the color correction matrix after the change of the non-reference camera module can be as shown in the following formula (1):

M _limit ＝M _golden ×H (1)

Among them, M _limit represents the changed color correction matrix of the non-reference camera module; M _golden represents the changed color correction matrix of the reference camera module; H represents the calibration matrix between the non-reference camera module and the reference camera module.

Step 203: Update the color correction matrix stored in the non-reference camera module according to the changed color correction matrix.

The color correction matrix calibration method of the camera module according to the embodiment of the present disclosure determines multiple camera modules; wherein the models of the multiple camera modules are the same, and the component parameters of one or more camera modules are different; for each determine the color correction matrix of the camera module based on the spectral response of the camera module; determine the non-reference camera module and the reference camera module among the multiple camera modules based on the color correction matrices of multiple camera modules calibration matrix between; when the color correction matrix of the reference camera module changes, obtain the changed color correction matrix of the reference camera module; for each non-reference camera module, perform color correction according to the changed color of the reference camera module matrix, and the calibration matrix between the non-reference camera module and the reference camera module to determine the changed color correction matrix of the non-reference camera module; based on the changed color correction matrix, correct the color stored in the non-reference camera module The matrix is updated, so that when the color correction matrix of the reference camera module changes, the calibration matrix can be combined with the calibration matrix to accurately and quickly determine the different color correction matrices of camera modules of the same model with different component parameters, ensuring the color accuracy of different camera modules. The restoration effect is consistent.

FIG. 3 is a schematic structural diagram of a color correction matrix calibration device of a camera module according to an embodiment of the present disclosure.

As shown in Figure 3, the color correction matrix calibration device of the camera module may include: a first determination module 301, a second determination module 302 and a third determination module 303;

Wherein, the first determination module 301 is used to determine multiple camera modules; wherein the models of the multiple camera modules are the same, and the component parameters of one or more of the camera modules are different;

The second determination module 302 is configured to determine, for each camera module, the color correction matrix of the camera module according to the spectral response of the camera module;

The third determination module 303 is configured to determine the calibration matrix between the non-reference camera module and the reference camera module in the plurality of camera modules according to the color correction matrices of the plurality of camera modules, wherein based on the According to the calibration matrix, when the color correction matrix of the reference camera module is changed, the difference between the color restoration indicators of the non-reference camera module and the reference camera module is maintained within a preset difference range.

In one embodiment of the present disclosure, in an embodiment of the present disclosure, the number of color correction matrices of the camera module is multiple, corresponding to different light sources; the third determination module 303 is specifically used for For each non-reference camera module in the plurality of camera modules, for each light source, obtain the first color correction matrix of the non-reference camera module under the light source, and the reference camera module under The second color correction matrix under the light source; performing ratio processing on the first color correction matrix and the second color correction matrix to obtain the non-reference camera module and the reference camera module under the light source calibration matrix between.

In one embodiment of the present disclosure, the device further includes: an acquisition module, a fourth determination module and an update module; wherein the acquisition module is configured to: when the color correction matrix of the reference camera module changes, Obtain the modified color correction matrix of the reference camera module; the fourth determination module is used for each non-reference camera module, according to the modified color correction matrix of the reference camera module, and the non-reference camera module The calibration matrix between the reference camera module and the reference camera module is used to determine the changed color correction matrix of the non-reference camera module; the update module is used to calculate the modified color correction matrix according to the changed color correction matrix. The color correction matrix stored in the non-reference camera module is updated.

The color correction matrix calibration device of the camera module according to the embodiment of the present disclosure determines multiple camera modules; wherein the models of the multiple camera modules are the same, and the component parameters of one or more camera modules are different; for each determine the color correction matrix of the camera module based on the spectral response of the camera module; determine the non-reference camera module and the reference camera module among the multiple camera modules based on the color correction matrices of multiple camera modules Wherein, based on the calibration matrix, when the color correction matrix of the reference camera module changes, the difference between the color restoration indicators of the non-reference camera module and the reference camera module is maintained within the preset difference range , so that when the color correction matrix of the reference camera module changes, it can be combined with the calibration matrix to accurately and quickly determine the different color correction matrices of the same model of camera modules with different component parameters, ensuring that the color restoration effects of different camera modules are consistent.

According to a third aspect of the embodiment of the present disclosure, an electronic device is also provided, including: a processor; and a memory for storing instructions executable by the processor, wherein the processor is configured to execute the instructions to implement the above camera module Color correction matrix calibration method.

In order to implement the above embodiments, the present disclosure also proposes a storage medium.

When the instructions in the storage medium are executed by the processor of the electronic device, the electronic device is enabled to perform the above method.

In order to implement the above embodiments, the present disclosure also provides a computer program product.

Wherein, when the computer program product is executed by the processor of the electronic device, the electronic device can perform the above method.

FIG. 4 is a structural block diagram of an electronic device according to an exemplary embodiment. The electronic device shown in FIG. 4 is only an example and should not impose any limitations on the functions and scope of use of the embodiments of the present disclosure.

As shown in Figure 4, the electronic device 1000 includes a processor 111, which can be loaded into a random access memory (RAM, Random Access Memory) 113 according to a program stored in a read-only memory (ROM, Read Only Memory) 112 or from a memory 116 perform various appropriate actions and processing according to the program in it. In the RAM 113, various programs and data required for the operation of the electronic device 1000 are also stored. The processor 111, ROM 112 and RAM 113 are connected to each other through a bus 114. An input/output (I/O, Input/Output) interface 115 is also connected to bus 114 .

The following components are connected to the I/O interface 115: a memory 116 including a hard disk, etc.; and a communication section 117 including a network interface card such as a Local Area Network (LAN) card, a modem, etc., which is executed via a network such as the Internet. Communication processing; driver 118 is also connected to I/O interface 115 as needed.

In particular, according to embodiments of the present disclosure, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program carried on a computer-readable medium, the computer program containing program code for performing the method illustrated in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network via the communication section 117 . When the computer program is executed by the processor 111, the above-described functions defined in the method of the present disclosure are performed.

In an exemplary embodiment, a storage medium including instructions, such as a memory including instructions, which can be executed by the processor 111 of the electronic device 1000 to complete the above method is also provided. Optionally, the storage medium may be a non-transitory computer-readable storage medium. For example, the non-transitory computer-readable storage medium may be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc. .

In this disclosure, a computer-readable storage medium may be any tangible medium that contains or stores a program for use by or in connection with an instruction execution system, apparatus, or device. In the present disclosure, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code therein. Such propagated data signals may take many forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium that can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device . Program code embodied on a computer-readable medium may be transmitted using any suitable medium, including but not limited to: wireless, wire, optical cable, RF, etc., or any suitable combination of the foregoing.

Other embodiments of the disclosure will be readily apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the disclosure that follow the general principles of the disclosure and include common knowledge or customary technical means in the technical field that are not disclosed in the disclosure. . It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.

It is to be understood that the present disclosure is not limited to the precise structures described above and illustrated in the accompanying drawings, and various modifications and changes may be made without departing from the scope thereof. The scope of the disclosure is limited only by the appended claims.

Claims

A color correction matrix calibration method for a camera module, characterized in that the method includes:

Determine multiple camera modules; wherein the models of the multiple camera modules are the same, and the component parameters of one or more of the camera modules are different;

For each camera module, determine the color correction matrix of the camera module according to the spectral response of the camera module;

According to the color correction matrices of a plurality of the camera modules, a calibration matrix between a non-reference camera module and a reference camera module in a plurality of the camera modules is determined, wherein based on the calibration matrix, in the reference When the color correction matrix of the camera module is changed, the difference between the color reproduction indicators of the non-reference camera module and the reference camera module is maintained within the preset difference range.
The method according to claim 1, characterized in that the number of color correction matrices of the camera module is multiple, corresponding to different light sources;

Determining the calibration matrix between the non-reference camera module and the reference camera module in the plurality of camera modules based on the color correction matrices of the plurality of camera modules includes:

For each non-reference camera module in the plurality of camera modules, for each light source, obtain the first color correction matrix of the non-reference camera module under the light source, and the reference camera module a second color correction matrix under said light source;

Perform ratio processing on the first color correction matrix and the second color correction matrix to obtain a calibration matrix between the non-reference camera module and the reference camera module under the light source.
The method according to claim 1 or 2, characterized in that, the method further includes:

For each non-reference camera module, write the calibration matrix between the non-reference camera module and the reference camera module into the first memory of the non-reference camera module, where the first A memory does not allow changes to written data;

Write the color correction matrix of the non-reference camera module into the second memory of the non-reference camera module.
The method of claim 3, further comprising:

When the color correction matrix of the reference camera module is changed, obtain the changed color correction matrix of the reference camera module;

For each non-reference camera module, determine the non-reference camera according to the changed color correction matrix of the reference camera module and the calibration matrix between the non-reference camera module and the reference camera module The module's post-change color correction matrix;

According to the changed color correction matrix, the color correction matrix stored in the non-reference camera module is updated.
The method according to claim 4, characterized in that the modified color correction matrix of the reference camera module is determined by:

Images captured by the reference camera module on standard color cards under various light sources;

Process the image according to the specified image processing strategy to obtain an image in the sRGB color space;

Perform color space conversion on the image in the sRGB color space to obtain the image in the Lab color space;

According to the image in the Lab color space, the modified color correction matrix of the reference camera module is determined.
The method according to claim 1, characterized in that the camera module includes: a lens, a sensor, a back-end image processing chip and software;

Correspondingly, the component parameters include at least one of the following: lens parameters, sensor parameters, back-end image processing chip parameters and soft board parameters.
A color correction matrix calibration device for a camera module, characterized in that the device includes:

The first determination module is used to determine multiple camera modules; wherein the models of the multiple camera modules are the same, and the component parameters of one or more of the camera modules are different;

a second determination module, configured to determine, for each camera module, the color correction matrix of the camera module according to the spectral response of the camera module;

The third determination module is configured to determine the calibration matrix between the non-reference camera module and the reference camera module in the plurality of camera modules according to the color correction matrices of the plurality of camera modules, wherein based on the Calibration matrix, when the color correction matrix of the reference camera module is changed, the difference between the color restoration indicators of the non-reference camera module and the reference camera module is maintained within a preset difference range.
The device according to claim 7, characterized in that the number of color correction matrices of the camera module is multiple, corresponding to different light sources;

The third determination module is specifically used to:

For each non-reference camera module in the plurality of camera modules, for each light source, obtain the first color correction matrix of the non-reference camera module under the light source, and the reference camera module a second color correction matrix under said light source;

Perform ratio processing on the first color correction matrix and the second color correction matrix to obtain a calibration matrix between the non-reference camera module and the reference camera module under the light source.
The device according to claim 7 or 8, characterized in that the device further includes: a writing module, configured to, for each non-reference camera module, compare the non-reference camera module and the reference camera module. The calibration matrix between groups is written into the first memory of the non-reference camera module, wherein the first memory does not allow changes to the written data;

Write the color correction matrix of the non-reference camera module into the second memory of the non-reference camera module.
The device according to claim 9, characterized in that the device further includes: an acquisition module, a fourth determination module and an update module;

Wherein, the acquisition module is used to acquire the changed color correction matrix of the reference camera module when the color correction matrix of the reference camera module is changed;

The fourth determination module is used for each non-reference camera module, according to the changed color correction matrix of the reference camera module, and the difference between the non-reference camera module and the reference camera module. Calibration matrix to determine the changed color correction matrix of the non-reference camera module;

The update module is configured to update the color correction matrix stored in the non-reference camera module according to the changed color correction matrix.
The device according to claim 10, wherein the modified color correction matrix of the reference camera module is determined by:

Images captured by the reference camera module on standard color cards under various light sources;

Process the image according to the specified image processing strategy to obtain an image in the sRGB color space;

Perform color space conversion on the image in the sRGB color space to obtain the image in the Lab color space;

According to the image in the Lab color space, the modified color correction matrix of the reference camera module is determined.
The device according to claim 7, wherein the camera module includes: a lens, a sensor, a back-end image processing chip and software;

Correspondingly, the component parameters include at least one of the following: lens parameters, sensor parameters, back-end image processing chip parameters and soft board parameters.
An electronic device, characterized by including:

processor;

memory for storing instructions executable by the processor;

Wherein, the processor is configured to execute the instructions to implement the color correction matrix calibration method of the camera module according to any one of claims 1 to 6.
A non-transitory computer-readable storage medium that, when instructions in the storage medium are executed by a processor, enables the processor to execute the color correction matrix of the camera module according to any one of claims 1 to 6 Calibration method.