CN110928552B

CN110928552B - Image quality regulation and control processing method and system of camera module

Info

Publication number: CN110928552B
Application number: CN201911200145.5A
Authority: CN
Inventors: 张晓丹; 刘旭国; 彭绍平
Original assignee: Lenovo Beijing Ltd
Current assignee: Lenovo Beijing Ltd
Priority date: 2019-11-29
Filing date: 2019-11-29
Publication date: 2021-07-16
Anticipated expiration: 2039-11-29
Also published as: CN110928552A

Abstract

The application relates to a picture quality regulation and control processing method and system of a camera module, a supplier processing device and a terminal device, which are combined with relevant regulations of SW authentication standards of operating system software, separate picture quality debugging data from picture quality processing logic codes of an original picture quality debugging file, test and optimize the separated code part in a targeted manner in a development period of the operating system software to obtain stable picture quality processing logic codes, and then send test authentication to the operating system software and control the camera module based on the stable picture quality processing logic codes; and for the image quality debugging data, continuously testing and optimizing the image quality debugging data after the image quality debugging data is sent and tested, and importing the optimized data result into the certified operating system software. The method and the device separate the test optimization process (or at least part of the test optimization process) of the picture quality debugging data from the baseline of the operating system software in the picture quality test work, thereby effectively shortening the development period of the operating system software.

Description

Image quality regulation and control processing method and system of camera module

Technical Field

The application belongs to the technical field of software development and information customization, and particularly relates to a method and a system for regulating and controlling image quality of a camera module.

Background

In the development process of OS system software of terminal devices such as tablet and mobile phone, the development of the function of the Camera module is involved, the Camera module develops the software function (including the whole software processing process of pressing the shutter → generating the command → responding the command control module to collect the image information → processing the image information to generate the visible image) and also has a very independent task of image quality debugging (Camera IQ tuning, for short, Camera tuning) of the Camera module, and the Camera tuning aims to enable the Camera module to achieve a general and better output effect (image quality effect) of the bottom layer picture when taking pictures or shooting pictures.

The image quality debugging of the camera module can be generally carried out only when the function of the camera module is perfect and stable to a certain degree. As shown in fig. 1, in the current OS system software development process, the image quality debugging period exists in the baseline original development period of the OS system software, which is specifically represented by the need of an image quality debugging file (a tuning file in fig. 1) output by a camera image quality debugging team, the image quality test is performed in the baseline of the OS system software, and the process is iterated, the debugging period slightly changes according to the module difference, but generally needs more than 3 months and lasts longer, which causes the image quality debugging of the camera module to become a key path of the current OS system software development process, and the debugging period of more than 3 months of the camera module is difficult to compress, thereby becoming a bottleneck in shortening the OS system software development period.

Disclosure of Invention

In view of this, the present application provides a method and a system for image quality adjustment and control processing of a camera module, which are used to strip image quality debugging data from an image quality debugging file of the camera module, so as to support separation of a test optimization process (or at least part of the test optimization process) for the image quality debugging data in a debugging period from OS baseline, thereby achieving the purpose of shortening the software development period of the OS system.

Therefore, the application discloses the following technical scheme:

a picture quality regulation and control processing method of a camera module comprises the following steps:

acquiring an original image quality debugging file of a camera module;

stripping image quality debugging data from the original image quality debugging file to obtain a data file containing the image quality debugging data and an image quality debugging file after the image quality debugging data is removed;

respectively importing the data file and the image quality debugging file into operating system software;

processing the data file and the image quality debugging file in operating system software to obtain stable image quality processing logic codes;

and controlling the camera module according to the stable image quality processing logic code.

In the method, it is preferable that the step of stripping the picture quality debugging data from the original picture quality debugging file includes:

and stripping the image quality parameter values from the original image quality debugging file in the form of the dynamic connection library to obtain a data file comprising the image quality parameter values and the image quality debugging file after removing the image quality parameter values.

In the method, it is preferable that the processing in the operating system software based on the data file and the image quality debugging file to obtain a stable image quality processing logic code includes:

performing image quality test on a camera module aiming at the image quality processing logic code in the image quality debugging file in the operating system software based on the image quality parameter value in the data file;

determining whether the image quality processing logic code needs to be adjusted based on a test result;

if so, acquiring a next image quality debugging file obtained after the image quality processing logic code is adjusted, and importing the next image quality debugging file into operating system software to perform image quality test on the camera module so as to complete iteration of the image quality test of the camera module;

if not, ending the image quality testing process of the camera module, and taking the corresponding image quality processing logic code when the image quality testing process of the camera module is ended as the stable image quality processing logic code;

the controlling the camera module according to the stable image quality processing logic code comprises:

generating a test version of operating system software based on the stable image quality processing logic code;

and carrying out transmission and test authentication on the operating system software of the transmission and test version so as to control the camera module according to the stable image quality processing logic code in the process of authenticating the operating system software of the transmission and test version or after passing the authentication.

Preferably, the method further includes controlling the camera module according to the stable image quality processing logic code, and further includes:

after generating and testing the operating system software of the testing version, performing image quality testing on the camera module in the operating system software copy on the basis of the stable image quality processing logic code in the operating system software copy of the testing version according to the image quality parameter value in the data file;

determining whether the image quality parameter values in the data file need to be adjusted based on the test result;

if so, acquiring a next version data file obtained after adjusting the image quality parameter value, and importing the next version data file into the operating system software copy to perform image quality test of the camera module so as to complete iteration of the image quality test of the camera module;

if not, the image quality test process of the camera module is ended, and a set of image quality parameter values corresponding to the image quality test is led into the operating system software which passes the authentication.

after the operating system software passing the authentication is put into use, if the picture quality parameter value needs to be upgraded, generating a picture quality parameter value of an upgraded version; or if the customized function of the image quality parameter values needs to be provided, generating a plurality of sets of image quality parameter values and/or customized constraint information of customized versions;

and pushing the image quality parameter values of the upgrading version or the image quality parameter values of the plurality of sets of customized versions and/or customized constraint information to a server so that the terminal equipment can upgrade or customize the image quality parameter values in the operating system software, and controlling the camera module according to the stable image quality processing logic codes in the terminal equipment and the upgraded or customized image quality parameter values.

if the image quality parameter value of the camera module in the terminal equipment needs to be upgraded, downloading the image quality parameter value of the upgraded version from the server on the terminal equipment, and upgrading the image quality parameter value in the terminal equipment by using the image quality parameter value of the upgraded version;

if the image quality parameter values of the camera module in the terminal equipment need to be customized, one set of customized image quality parameter values are appointed from a plurality of sets of customized image quality parameter values provided by the server and downloaded, and the customization of the image quality parameter values is completed on the terminal equipment based on the downloaded customized image quality parameter values, or the customized image quality parameter values are configured based on the customized constraint information provided by the server and the customization of the image quality parameter values is completed on the terminal equipment based on the configured customized image quality parameter values;

and controlling the camera module according to the stable image quality processing logic code in the terminal equipment and the upgraded or customized image quality parameter value.

Preferably, the downloading, at the terminal device, the upgraded image quality parameter value from the server, or selecting and downloading one set of customized image quality parameter values from a plurality of sets of customized image quality parameter values provided by the server, includes:

downloading the image quality parameter value of the upgrade version provided by the server or a set of customized image quality parameter value appointed in a plurality of sets of customized image quality parameter values provided by the server to a preset firmware of a camera module on the terminal equipment;

the upgrading of the image quality parameter value in the terminal device by using the image quality parameter value of the upgraded version, or the customizing of the image quality parameter value on the terminal device based on the downloaded customized image quality parameter value, or the customizing of the image quality parameter value on the terminal device based on the configured customized image quality parameter value, includes:

and loading the image quality parameter value of the upgrading version in the preset firmware or the customized image quality parameter value into an image quality processing logic code in the camera module.

A supplier processing apparatus, comprising:

a first memory for storing at least one set of instructions;

a first processor for calling and executing the set of instructions in the first memory, the execution of the set of instructions performing the following:

acquiring an original image quality debugging file of a camera module;

A terminal device, comprising:

a second memory for storing at least one set of instructions;

a second processor for calling and executing the set of instructions in the second memory, the execution of the set of instructions performing the following:

An image quality regulation and control processing system of a camera module comprises:

the supplier processing equipment is used for pushing the generated image quality parameter values of the upgrading version or the image quality parameter values of a plurality of sets of customized versions and/or customized constraint information to the server by executing the image quality regulation and control processing method of the camera module;

the server is used for providing upgrading service or customization service of the image quality parameter values of the camera module for the terminal equipment based on the image quality parameter values of the upgrading versions pushed by the processing equipment of the supplier or the image quality parameter values and/or the customization constraint information of the plurality of sets of customized versions;

the terminal device is used for upgrading or customizing the image quality parameter value of the camera module in the terminal device by executing the image quality regulation and control processing method of the camera module, and controlling the camera module according to the stable image quality processing logic code in the terminal device and the upgraded or customized image quality parameter value.

According to the image quality regulation and control processing method of the camera module, separation of image quality debugging data and image quality processing logic codes is carried out on an original image quality debugging file, the separated code parts are tested and optimized in a targeted mode within the development period of operating system software to obtain stable image quality processing logic codes, and then the operating system software is sent to test and authenticate and the camera module is controlled based on the stable image quality processing logic codes; according to the relevant regulations of SW certification standards of the operating system software, the image quality debugging data does not influence the sending and testing certification of the operating system software even if the image quality debugging data is not subjected to test optimization, so that the image quality debugging data can be continuously tested and optimized by using a copy of the sending and testing version of the operating system software after being sent and tested, and finally, the image quality debugging data obtained after optimization can be imported into the certified operating system software.

Obviously, the test optimization process (or at least part of the process) aiming at the image quality debugging data in the image quality test task is separated from the baseline of the operating system software, so that the time consumed by the test optimization process (or at least part of the process) aiming at the image quality debugging data in the image quality test task does not occupy the time length of the original development cycle of the baseline of the operating system software any more, the development cycle of the operating system software can be effectively shortened, and the image quality test optimization method follows the relevant regulations of the SW certification standard of the operating system software, and cannot generate any influence on the sending test certification of the operating system software.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings needed to be used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are only embodiments of the present application, and it is obvious for those skilled in the art that other drawings can be obtained according to the provided drawings without creative efforts.

FIG. 1 is a diagram illustrating a conventional image quality test performed during a development cycle of operating system software;

fig. 2 is a flowchart of a method for adjusting and controlling image quality of a camera module according to an embodiment of the present disclosure;

fig. 3 is a schematic diagram illustrating that image quality debugging data is stripped from an original image quality debugging file and the image quality debugging data and the image quality debugging file are respectively imported into operating system software according to an embodiment of the present application;

FIG. 4 is a schematic diagram illustrating an image quality test performed during a development cycle of an operating system software and after the operating system software is tested;

fig. 5 is another flowchart of a method for adjusting and controlling image quality of a camera module according to an embodiment of the present disclosure;

fig. 6 is another flowchart of the image quality adjustment and control processing method of the camera module according to the embodiment of the present disclosure;

fig. 7 is a schematic flowchart illustrating an upgrade/customization process of image quality parameter values at the provider side according to an embodiment of the present disclosure;

fig. 8 is a schematic flowchart of upgrading/customizing image quality parameter values on the terminal device side according to an embodiment of the present disclosure;

fig. 9 is a schematic diagram of logic for performing upgrading/customizing of image quality parameter values according to an embodiment of the present disclosure;

FIG. 10 is a schematic structural diagram of a supplier processing apparatus provided in an embodiment of the present application;

fig. 11 is a schematic structural diagram of a terminal device provided in an embodiment of the present application;

fig. 12 is a schematic structural diagram of a system for adjusting and controlling image quality of a camera module according to an embodiment of the present disclosure.

Detailed Description

For the sake of reference and clarity, the technical terms, abbreviations or abbreviations used in the following or in the drawings are to be interpreted in summary as follows:

EVT is the abbreviation of Engineering Verification Test, which means Engineering Verification Test;

DVT: the Design Verification Test is short for meaning Design Verification Test;

PVT: is short for Pilot-run Verification Test, and means a small batch process Verification Test.

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

The application discloses a method and a system for regulating and controlling the image quality of a camera module, a supplier processing device and a terminal device, and aims to break through the bottleneck of the current development cycle of operating system software and shorten the development cycle of the operating system software.

In the conventional image quality testing work of the camera module, image quality debugging data and image quality processing logic codes in an original image quality debugging file output by a camera image quality debugging team are subjected to image quality testing-based optimization processing in a baseline original development period of operating system software, and the whole optimization work of the two information contents in the image quality debugging file is completed before the operating system software is sealed and sent to test certification, so that the development period of the operating system software is correspondingly prolonged.

In view of the above-mentioned drawbacks of the conventional technology, the inventor of the present application has found, by studying the sw (software) certification standard of the operating system software, that the standard strictly certifies the code portion of the operating system software, and requires all processing logic codes (algorithm functions) to participate in certification, so that any change/modification of the logic codes (algorithm functions) will result in re-signing and delivery test certification of the operating system software, and the data portion (such as values of different parameters related to the algorithm functions) does not have the certification, that is, the modification of the data portion will not result in re-signing and delivery test certification of the operating system software.

Based on the above findings, the present application provides a technical idea of speeding up the development process of the operating system software and shortening the development cycle of the operating system software by stripping the image quality debugging data from the image quality debugging file of the camera module and separating the test optimization process (or at least part of the process) of the image quality debugging data in the image quality debugging operation from the baseline original development cycle of the operating system software. The following describes, with reference to this idea, a method and a system for adjusting and controlling image quality of a camera module, a supplier processing device, and a terminal device according to the present application.

In an optional embodiment of the present application, a method for adjusting and controlling image quality of a camera module is provided, which may be applied to, but not limited to, processing devices of product suppliers such as operating system software or camera modules, for example, a portable computer, a desktop computer, a large and medium-sized computer, or even a server in a general/special computing or configuration environment of the product supplier.

Referring to the flowchart of the image quality adjusting and controlling method of the camera module shown in fig. 2, the method may include the following steps:

step 201, obtaining an original image quality debugging file of the camera module.

In the conventional technology, the image quality debugging file of the camera module not only provides specific values of image quality parameters, but also comprises image quality processing logic codes for correspondingly processing the values of the image quality parameters so that the camera module can generate corresponding image quality effects.

The original image quality debugging file is an image quality debugging file output by a camera image quality debugging team of the camera module, and comprises integrated image quality debugging data and image quality processing logic codes.

The image quality debugging data comprises parameter values of a series of image quality parameters, such as, but not limited to, parameter values of parameters including automatic white balance, automatic focusing, automatic exposure, color, hue, brightness, saturation, color deviation and/or brightness deviation, and is used as a data base for image quality processing of a bottom layer picture of the camera module; the image quality processing logic code provides a series of processing algorithms for processing the image quality of the camera module, and specifically provides computer program language representation of the algorithms, and the data base for executing the image quality processing is the image quality debugging data, namely the parameter values of the image quality parameters.

In practical application, the camera image quality debugging team embeds the determined parameter value of each image quality parameter into the corresponding statement position of the corresponding algorithm function of the image quality processing logic code to form an original image quality debugging file comprising integrated image quality debugging data and the image quality processing logic code, and outputs the original image quality debugging file so as to subsequently develop image quality testing work based on the original image quality debugging file.

Step 202, stripping the image quality debugging data from the original image quality debugging file to obtain a data file comprising the image quality debugging data and an image quality debugging file after removing the image quality debugging data.

After obtaining the original image quality debugging file of the camera module, the present application does not directly import the original image quality debugging file into the operating system software, and performs the image quality test-based optimization processing on the image quality debugging data and the image quality processing logic code therein, but combines the technical ideas, as shown in fig. 3, first stripping the image quality debugging data in the original image quality debugging file, that is, separating the image quality debugging data from the image quality processing logic code in the original image quality debugging file, and correspondingly obtaining a data file including the image quality debugging data and an image quality debugging file after removing the image quality debugging data.

The image quality debugging file after removing the image quality debugging data does not carry image quality debugging data any more than the original image quality debugging file, and in the following description, the image quality debugging file after removing the image quality debugging data is represented by an image quality debugging file so as to realize the simplification of description and effectively distinguish the image quality debugging file from the original image quality debugging file.

Step 203, importing the data file and the image quality debugging file into operating system software respectively.

After finishing stripping the image quality debugging data and respectively forming a new file by the data part and the code part in the original image quality debugging file, respectively importing the formed data file and the image quality debugging file into operating system software, and then further compiling and updating the operating system software imported with the files so as to prepare for testing and debugging the image quality processing logic code in the operating system environment in an early stage.

And step 204, processing the data file and the image quality debugging file in the operating system software to obtain stable image quality processing logic codes.

After the preliminary preparation is made, in the development period of the operating system software and in the operating system environment, the image quality test of the image pickup module is performed on the image quality processing logic codes (algorithm functions) in the image quality debugging file, and the image quality test process of the image pickup module is iterated to continuously adjust the image quality processing logic codes so as to optimize the image quality and improve the corresponding image quality.

The data file is a data basis of the image quality processing logic code, and in the image quality testing process, the data file needs to be loaded, and effective image quality processing on the camera module is realized by effectively butting (parameter assignment) data in the data file with the image quality processing logic code.

Different from the prior art, the image quality processing logic code in the image quality debugging file is continuously adjusted and optimized based on the iterative test of the image quality before the version sealing and the sending test certification of the operating system software, and the adjustment and optimization work of the image quality processing logic code is completed before the version sealing and the sending test certification, so that the stable image quality processing logic code is obtained.

As shown in fig. 4, the tuning of the image quality processing logic code is conventionally completed at the PVT1 stage of the baseline development cycle of the os software, and is individually completed after the PVT2 stage. For the tuning work of the image quality debugging data, even if the tuning work is not adjusted and optimized according to the SW authentication standard of the operating system software, the sending and testing authentication of the operating system software cannot be influenced, so that the tuning work of the image quality debugging data is not carried out in the developing period of the operating system, namely, the tuning work of the image quality debugging data is separated from the original baseline developing period of the operating system software, certainly, the tuning work is not limited to the original baseline developing period, a part but not all of the tuning work of the image quality debugging data can be executed in the original baseline developing period of the operating system software, and the aims of accelerating the developing flow of the operating system software and shortening the developing period of the operating system software can be achieved.

And step 205, controlling the camera module according to the stable image quality processing logic code.

After the stable image quality processing logic code is obtained, the camera module can be controlled based on the stable image quality processing logic code.

The image quality debugging data in the data file is not optimized (or not completely optimized) but does not influence the transmission and test authentication of the operating system software, so that after stable image quality processing logic codes are obtained and some other necessary test processes (such as PVT) before the operating system software is sealed are completed, the operating system software can be sealed without considering the optimization of the image quality debugging data and is authenticated by an authenticator, and the camera module is controlled based on the stable image quality processing logic codes in the authentication process.

And for the image quality debugging data in the data file, after the version of the operating system software is sealed and the sending and testing authentication is carried out, the image quality debugging data can be continuously adjusted and optimized based on the copy of the sending and testing version of the operating system software.

In summary, the present embodiment separates the test optimization process (or at least part of the process) for the image quality debugging data in the image quality test task from the baseline of the operating system software, so that the time consumed by the test optimization process (or at least part of the process) for the image quality debugging data in the image quality test task does not occupy the original development cycle time of the baseline of the operating system software, thereby effectively shortening the development cycle of the operating system software.

Referring to the image quality adjusting and controlling method of the camera module provided in fig. 5, the method can be further implemented by the following processing procedures:

and step 501, acquiring an original image quality debugging file of the camera module.

The original image quality debugging file is an image quality debugging file output by a camera image quality debugging team of the camera module and comprises integrated image quality debugging data and image quality processing logic codes. As described above, the image quality adjustment data includes, but is not limited to, parameter values of a series of image quality parameters such as auto white balance, auto focus, auto exposure, color, hue, brightness, saturation, color deviation, and brightness deviation.

Step 502, stripping the image quality parameter values from the original image quality debugging file in the form of the dynamic connection library to obtain a data file containing the image quality parameter values and an image quality debugging file after removing the image quality parameter values.

The original image quality debugging file output by the camera image quality debugging team is usually in a dynamic link library form, and after the original image quality debugging file in the dynamic link library form is obtained, parameter values of parameters such as automatic white balance, automatic focusing, automatic exposure, color, hue, brightness, saturation, color deviation and/or brightness deviation are stripped from the original image quality debugging file.

Each image quality parameter in the original image quality debugging file is usually a variable, the variable corresponds to a corresponding assignment, namely a parameter value of the image quality parameter, in order to strip the image quality parameter value in the original image quality debugging file, variable values of each image quality parameter in the original image quality debugging file of the dynamic link library can be firstly traversed and read, the values of each parameter variable are organized in a set file according to a certain data organization form to form a data file comprising the image quality parameter value, the file is stored in a corresponding position, meanwhile, in order to facilitate the butt joint of the image quality debugging file and the image quality parameter value when the image quality of a camera module is controlled in the subsequent process, the position information of each parameter variable value in the data file and/or the data file can be recorded according to needs.

After the image quality parameter values in the original image quality debugging file of the dynamic link library are read and stored, the embodiment further erases the values of the image quality parameters in the original image quality debugging file.

Optionally, a value of each image quality parameter in the original image quality debugging file may be replaced by an intermediate variable, and a corresponding relationship between each intermediate variable and an image quality parameter value in the data file is constructed, so that when the image quality debugging file and the data file are subsequently loaded (to control the camera module), data in the data file may be assigned to the corresponding image quality parameter based on the intermediate variable; optionally, the actual address information of each image quality parameter value in the data file may be reassigned to the corresponding image quality parameter variable in the original image quality debugging file in a pointer data type manner, so as to obtain the image quality debugging file with the image quality parameter value removed. Then, when the image quality debugging file is loaded and operated, data can be directly read from a storage position pointed by address information carried in the file and taken as a value of a parameter variable.

Step 503, importing the data file and the image quality debugging file into operating system software respectively.

Step 504, performing, in the operating system software, an image quality test on the image capturing module according to the image quality processing logic code in the image quality debugging file based on the image quality parameter value in the data file.

Specifically, based on the image quality parameter values in the data file, the image quality testing of the image pickup module is realized by operating the image quality processing logic codes in the image quality debugging file to control the image pickup module to generate an image/video picture with corresponding image quality.

In the embodiment of the present application, the image quality test of the camera module executed in the baseline development period of the operating system software only aims at or focuses on the image quality processing logic codes in the image quality debugging file, and accordingly only completes the tuning of the image quality processing logic codes in the baseline development period of the operating system software, so as to obtain stable image quality processing logic codes, but does not include the tuning and optimization of the image quality parameter values in the data file, or only executes part of the tuning and optimization of the image quality parameter values in the data file, rather than all of the tuning and optimization, that is, the tuning and optimization determination process (or at least part of the tuning and optimization determination process) of the stable image quality parameter values is not in the baseline original development period of the operating system software.

When the image quality of the camera module is tested according to the image quality processing logic codes in the image quality debugging file, each image quality parameter variable in the image quality processing logic codes can be endowed with a corresponding exact value by means of the intermediate variable or pointer type address data, and an algorithm function in the image quality processing logic codes combines the values of the image quality parameters to control the camera module from multiple angles such as focusing, exposure, color, hue, brightness, saturation and the like, and generate an image/video picture with a corresponding image quality effect. And (3) the testers find and position the picture quality control and the problems of the picture quality effect by combining the subjective and objective evaluation standards of the camera image and/or the shooting level of the industrial equipment camera. The subjective and objective evaluation criteria and the specific image quality testing process in the industry are specifically known standards or techniques in the art, and are not described in detail herein.

Step 505, determining whether the image quality processing logic code needs to be adjusted based on the test result.

Step 506, if yes, acquiring a next image quality debugging file obtained after the image quality processing logic code is adjusted, and importing the next image quality debugging file into operating system software to perform image quality test of the camera module so as to complete iteration of the image quality test of the camera module.

And step 507, if not, ending the image quality test process of the camera module, and taking the corresponding image quality processing logic code when the image quality test process of the camera module is ended as the stable image quality processing logic code.

Continuously finding the defects, bugs or problems of the image quality processing logic codes in the image quality debugging file through the iterative execution of the image quality testing process, when the defects, bugs or problems of the image quality processing logic codes in the image quality debugging file are found to cause the image quality effect of the camera module to be not up to the standard, the codes of the matched algorithm functions are adjusted according to specific image quality defects (such as focus blur, insufficient image saturation, abnormal hue and the like), and finally, obtaining a next image quality debugging file, continuously carrying out image quality test based on the next image quality debugging file, and optimizing codes of the next image quality debugging file until the image quality of the camera module reaches a standard to end the image quality test process, wherein the image quality processing logic codes at the moment are the stable image quality processing logic codes.

The next image quality debugging file may be a version obtained by adjusting corresponding codes in a current image quality debugging file that does not include image quality parameter values, or, as shown in fig. 4, may be a version obtained by first performing code adjustment on an image quality debugging file in which parameter data in a dynamic link library and processing logic codes are integrated by a camera image quality debugging team based on an image quality test result to obtain a dynamic link library file (tuning file) including parameter data and in which image quality processing logic codes are optimized, and then continuously stripping image quality parameter values in the dynamic link library file (so as to remove them) by relevant personnel, thereby obtaining the next image quality debugging file.

When the image quality debugging data is stripped and the image quality test is performed on the image quality processing logic code in the operating system software, the test and the optimization of the image quality processing logic code can be completed generally at the stage of PVT1 in the development cycle of the operating system software baseline, so as to obtain stable image quality processing logic code, and the test and the optimization of the image quality processing logic code can be completed after the stage of PVT2 under individual conditions.

Step 508, generating a test version of the operating system software based on the stable image quality processing logic code.

Although the image quality debugging data in the data file is not optimized in the baseline development period of the operating system software (or only a part of the optimization work is executed, and the optimization is not completed), the sending and testing authentication of the operating system software is not influenced, so that after stable image quality processing logic codes are obtained and some other necessary test processes (such as PVT and the like) before the version of the operating system software is sealed, the version of the operating system software can be sealed without considering the optimization of each image quality parameter value (namely image quality debugging data) in the data file, and the operating system software of the sending and testing version is generated.

The tested version of the operating system software obviously includes the stable image quality processing logic code and image quality parameter values that are not adjusted or not adjusted completely.

Step 509, performing transmission and test authentication on the transmission and test version of the operating system software, so that the camera module is controlled according to the stable image quality processing logic code during the authentication of the transmission and test version of the operating system software or after the authentication is passed.

And finally, the operating system software obtained by the plate sealing can be submitted to an authenticator for authentication, and the image quality of the camera module is controlled based on the obtained stable image quality processing logic code in the authentication process.

Compared with the prior art, after the image quality debugging data is stripped from the original image quality debugging file, namely after the image quality parameter values are stripped, only the complete image pickup module image quality test process aiming at the image quality processing logic codes is carried out in the baseline development period of the operating system software, so that the adjustment and optimization of the image quality processing logic codes are completed, the image is sealed to obtain the image pickup module image quality test process aiming at the image quality parameter values, or at least part of the image pickup module image quality test process, the image pickup module image quality test process is separated from the baseline development period of the operating system software, and the image pickup module test process aiming at the image quality parameter values is continuously completed by using the copy of the image pickup module image quality parameter values after the image quality software is sealed and tested.

As shown in fig. 6, the process of continuing the image quality test of the camera module according to the image quality parameter value by using the copy of the test version os software after testing the os software version includes:

step 510, after generating and testing the os software of the testing version, performing an image quality test on the camera module in the os software copy with respect to the image quality parameter values in the data file based on the stable image quality processing logic code in the os software copy of the testing version.

Similar to the process of testing the image quality of the image capturing module according to the image quality processing logic code, in this embodiment, when the image quality of the image capturing module is tested according to the image quality parameter value, the image quality parameter value in the current data file to be tested and the image quality processing logic code in the copy of the version-sending and testing operating system software can be docked by means of the above-mentioned intermediate variable or pointer-type address data, each image quality parameter variable in the image quality processing logic code is given a corresponding exact value by using the image quality parameter value in the data file to be tested, and the image capturing module is controlled from multiple angles, such as focusing, exposure, color, hue, brightness, saturation and the like, by combining the value of the image quality parameter in the image quality processing logic code, and an image/video picture with a corresponding image quality effect is generated.

And (3) the testers find and position the picture quality control and the problems of the picture quality effect by combining the subjective and objective evaluation standards of the camera image and/or the shooting level of the industrial equipment camera. And continuously iterating the process to continuously find out improper and unreasonable values of the image quality parameter values.

Step 511, determining whether the image quality parameter value in the data file needs to be adjusted based on the test result.

And step 512, if so, acquiring a next version data file obtained after adjusting the image quality parameter value, and importing the next version data file into the operating system software copy to perform image quality test of the camera module so as to complete iteration of the image quality test of the camera module.

Step 513, if not, ending the image quality test process of the camera module, and importing a set of image quality parameter values corresponding to the image quality test into the authenticated operating system software.

If the image quality effect of the camera module can not reach the standard after the image quality test, the matched image quality parameter value is adjusted and optimized in a targeted way aiming at specific image quality defects and substandard parts (such as focus blur, insufficient image saturation, abnormal hue and the like), a next version data file with the optimized image quality parameter value is correspondingly obtained, then the image quality test of the camera module is continued based on the next version data file, so that the image quality test process aiming at the image quality parameter value is iterated continuously, the image quality parameter value in the data file is optimized continuously in the process of the iterative execution of the image quality test process until the image quality effect of the camera module reaches the standard, the image quality test process is ended, the image quality parameter value at the moment is a stable and available image quality parameter value, and the stable parameter value is matched with a stable image quality processing logic code obtained in a baseline development period of operating system software, the camera module can achieve a universal and better bottom layer picture output effect (image quality effect) when in shooting or shooting.

The final data file including the stable image quality parameter values may be used for production and distribution of the os software, as shown in fig. 4, only by importing the final data file obtained after tuning into a product when the os software is finally produced, that is, by loading the final data file including the stable image quality parameter values into the certified os software.

The embodiment separates the test optimization process (or at least part of the process) aiming at the picture quality parameter values in the picture quality test task from the baseline of the operating system software, so that the time consumed by the test optimization process (or at least part of the process) aiming at the picture quality parameter values in the picture quality test task does not occupy the original development cycle time of the baseline of the operating system software any more, thereby effectively shortening the development cycle of the operating system software.

In the conventional technology, after an original image quality debugging file is integrated into an operating system and applied to a corresponding device (such as a mobile terminal, a computer, etc.), since the original image quality debugging file includes integrated image quality processing logic codes and image quality debugging data, a change in the image quality debugging data will cause a change in the entire image quality debugging file, and since code-level data in operating system software can only be updated by means of a flash/reinstallation of the operating system, the entire operating system software can only be upgraded based on an OTA (Over the Air) technology, and the image quality debugging data can be upgraded by means of flash, reinstallation of the operating system, etc., the upgrading method is essentially an image quality upgrade at an APK (application package) level, and once flash or the operating system is installed, the image quality debugging data (image quality parameter value) therein is fixed, the image quality debugging data cannot be updated by means other than OTA, a flash/reinstall operating system, and the like, and the image quality parameter values cannot be customized freely by the user as required during the use of the device.

After the image quality debugging data is stripped from the original image quality debugging file, the image quality debugging data is separated from the image quality processing logic code, so that the image quality debugging data of the camera module can be upgraded without reinstalling/reinstalling an operating system of the equipment, and correspondingly, the user can freely customize the image quality debugging data according to the requirement in the using process of the equipment.

Thus, referring to fig. 7, when the image capture module is controlled according to the stable image quality processing logic code, the method for adjusting and controlling the image quality of the image capture module may further perform the following processing:

step 701, after the operating system software passing the authentication is put into use, if the picture quality parameter value needs to be upgraded, generating a picture quality parameter value of an upgraded version; alternatively, if a customized function of the image quality parameter values is required, a plurality of sets of customized versions of the image quality parameter values and/or customized constraint information are generated.

The image quality parameter value of the upgraded version may include, but is not limited to, a parameter value obtained after any one or more values of auto white balance, auto focus, auto exposure, color, hue, brightness, saturation, color deviation, and/or brightness deviation are changed and required adjustment is performed.

When providing the customized function of the image quality parameter values for the user, as an optional implementation manner, multiple sets of image quality parameter values of customized versions may be directly provided for the user to select one set for use, specifically, for example, setting image quality parameter values of different tone styles for different target people: the method is characterized in that the method comprises the steps of middle-aged people, teenagers, and neutral people, wherein the hue style is related to values of image quality parameters such as saturation, brightness, color and balance, so that different matching values of saturation, brightness, color and balance can be provided in image quality parameter values of different sets of customized versions respectively, and different user groups can freely select the values according to requirements.

As another alternative, the reasonable value-taking section of each image quality parameter may be determined in advance based on experiments and/or experiences to form customized constraint information of the image quality parameters, and then, the user may configure the required image quality parameter value based on the customized constraint information of each image quality parameter value, it is easy to understand that the value of each image quality parameter configured by the user obviously meets the standard requirement of the customized constraint information on the image quality parameter value.

The image quality parameter values of the upgraded version, or the image quality parameter values of the customized version and the customized constraint information are usually provided by a supplier and a server of related products such as a camera module, operating system software and the like.

Step 702, pushing the image quality parameter values of the upgraded version, or the image quality parameter values of the plurality of sets of customized versions and/or customized constraint information to a server, so that the terminal device can upgrade or customize the image quality parameter values in the operating system software, and control the camera module according to the stable image quality processing logic codes in the terminal device and the upgraded or customized image quality parameter values.

After obtaining the image quality parameter values, or the image quality parameter values of the customized version and the customized constraint information, the information can be pushed to a server.

And then, the user can download the image quality parameter value of the upgrade version in the server according to the actual upgrade requirement, and because the image quality parameter value does not comprise code level data, the image quality parameter value can be directly downloaded to a corresponding storage position of the camera module of the equipment operating system to realize upgrade on the premise of not flashing/reinstalling the operating system.

Similarly, the user can select one of the image quality parameter values of the plurality of sets of customized versions provided by the server according to the actual customization requirement, or configure the values of all the image quality parameters based on the customized constraint information provided by the server, and directly download the values to the corresponding storage positions of the camera module of the equipment operating system to realize the customization of the image quality parameter values on the premise of not flashing/reinstalling the operating system.

Subsequently, when the camera module of the equipment is used, the upgraded or customized image quality parameter values can be loaded to assign values to all image quality parameters in the image quality debugging file of the camera module, and then the camera module is controlled.

In the embodiment, based on the characteristic that the image quality debugging data is separated from the image quality processing logic code, the upgrading of the image quality debugging data can be realized directly through technologies such as data downloading and loading on the premise of not reinstalling/reinstalling the operating system, meanwhile, the free and flexible customization of the image quality parameter values by a user under the condition of not needing the reinstalling/reinstalling the operating system is realized, and for the user, the camera module of the equipment can achieve different bottom-layer image output effects without a complicated process of reinstalling/reinstalling the operating system, so that the upgrading of the image quality parameters with deeper and finer granularity than the APK level is realized.

The image quality control processing method of the camera module provided in the above embodiments is applied to a processing device of a supplier, and in a matching manner, the embodiment also provides an image quality control processing method of a camera module applied to a terminal device, where the terminal device may be, but is not limited to, a mobile device such as a mobile phone and a tablet of a user, or a computer terminal such as a desktop computer, a notebook computer, and an all-in-one computer.

Referring to the flowchart of the image quality adjustment and control processing method of the camera module shown in fig. 8, the method may include:

step 801, if the image quality parameter value of the camera module in the terminal equipment needs to be upgraded, downloading the image quality parameter value of the upgraded version from the server on the terminal equipment, and upgrading the image quality parameter value in the terminal equipment by using the image quality parameter value of the upgraded version.

In the embodiment, the product supplier uploads the image quality parameter value (image quality debugging data) of the upgraded version, the image quality parameter value of the customized version and/or the customized constraint information to a server, which is referred to as a resource server, and when a user needs to upgrade the image quality parameter value of the camera module in the terminal device, the image quality parameter value of the upgraded version can be downloaded from the resource server to the terminal device through a network server as shown in fig. 9. The resource server and the network server may be the same server or different servers.

Referring to fig. 9, the image quality parameter value of the upgraded version provided by the server may be downloaded to a parameter area of a predetermined firmware (e.g., a camera parameter storage firmware) of the camera module on the terminal device, and when the image quality parameter value of the upgraded version is downloaded to the parameter area of the predetermined firmware of the camera module, the original image quality parameter value in the parameter area is covered, so as to upgrade the image quality parameter value of the camera module on the terminal device.

Step 802, if the image quality parameter values of the camera module in the terminal device need to be customized, a set of customized image quality parameter values are appointed from a plurality of sets of customized image quality parameter values provided by the server and downloaded, and the customization of the image quality parameter values is completed on the terminal device based on the downloaded customized image quality parameter values, or the customized image quality parameter values are configured based on the customized constraint information provided by the server, and the customization of the image quality parameter values is completed on the terminal device based on the configured customized image quality parameter values.

Similarly, when the user has a demand for customizing the image quality parameter value of the camera module in the terminal device, as an optional implementation manner, as shown in fig. 9, the user may call up a customized configuration page of the image quality parameter value provided by the resource server through the web server, the configuration page is provided with a plurality of sets of image quality parameter values of different styles (such as cold, warm, and neutral color styles), and the user may select one of the sets according to the customized demand, download the selected set to a parameter area of predetermined firmware (such as camera parameter storage firmware) of the camera module on the terminal device, and simultaneously cover the original image quality parameter value in the parameter area.

As another optional implementation, the user may also call up another customized configuration page of the image quality parameter values provided by the resource server through the network server, the configuration page is provided with customized constraint information maintained by the resource server, the user may configure required image quality parameter values, such as saturation, brightness, color, balance, and the like required by the configuration, on the page according to the customized requirement, and the values of each image quality parameter configured by the user meet the specification requirement of the customized constraint information on the image quality parameter values, and after configuring the required image quality parameter values, download the required image quality parameter values to a parameter area of predetermined firmware (such as camera parameter storage firmware) of the camera module on the terminal device, and simultaneously cover the original image quality parameter values in the parameter area.

And 803, controlling the camera module according to the stable image quality processing logic code in the terminal equipment and the upgraded or customized image quality parameter value.

As shown in fig. 9, when the terminal device uses the camera module to take a picture or photograph, the image quality parameter value of the upgraded version in the firmware parameter area of the camera module or the customized image quality parameter value is loaded and imported into the platform camera software system of the camera module, and each image quality parameter value is specifically assigned to a corresponding image quality parameter in the image quality debugging file, that is, to a corresponding image quality parameter in the stable image quality processing logic code, so that the camera module is controlled based on the image quality parameter value of the upgraded/customized version and the stable image quality processing logic code.

In the embodiment, when the image quality parameter value is upgraded or customized, because the image quality parameter value of the camera module in the terminal device is separated from the image quality processing logic code, correspondingly, the upgraded version/customized image quality parameter value only forms an independent data file without code level data, so that the upgraded version/customized image quality parameter value can be directly downloaded to the firmware parameter area of the camera module on the basis of technologies such as data downloading, importing and the like on the premise of not flashing/reinstalling an operating system, the effect of flexibly and freely upgrading or customizing the bottom layer image output effect of the camera module by a user is realized under the condition of not needing a flashing/reinstalling operating system, and the upgrading of the image quality parameter with a deeper level and a finer granularity than an APK level is realized.

Corresponding to the above image quality control processing method applied to the camera module of the supplier processing device, the present application also discloses a supplier processing device, which may be, but is not limited to, a portable computer, a desktop computer, a large and medium-sized computer, or even a server, etc. in a general/special computing or configuration environment of a product supplier such as an operating system software or a camera module.

Referring to fig. 10, the supplier processing apparatus may include:

a first memory 1001 for storing at least one set of instructions;

a first processor 1002, configured to call and execute the instruction set in the first memory, and by executing the instruction set, perform the following processing:

acquiring an original image quality debugging file of a camera module;

After obtaining the original image quality debugging file of the camera module, in the present application, in combination with the above technical ideas, as shown in fig. 3, first, the image quality debugging data in the original image quality debugging file is stripped, that is, the image quality debugging data in the original image quality debugging file is separated from the image quality processing logic code, and accordingly, a data file including the image quality debugging data and an image quality debugging file after removing the image quality debugging data are obtained.

In an alternative embodiment of the present application, the first processor 1002 may further implement its functions through the following processes:

acquiring an original image quality debugging file of a camera module;

stripping image quality parameter values from an original image quality debugging file in a form of a dynamic connection library to obtain a data file comprising the image quality parameter values and the image quality debugging file after the image quality parameter values are removed;

The original image quality debugging file output by the camera image quality debugging team is usually in a dynamic link library form, and after the original image quality debugging file in the dynamic link library form is obtained, parameter values of parameters such as automatic white balance, automatic focusing, automatic exposure, color, tone, brightness, saturation, color deviation and/or brightness deviation are stripped from the original image quality debugging file.

Through the iterative execution of the image quality testing process, the defects, the holes or the problems of the image quality processing logic codes in the image quality debugging file are continuously found, when the defects, the holes or the problems of the image quality processing logic codes in the image quality debugging file are found, and the image quality effect of the camera module is not up to the standard, the codes of the matched algorithm functions are adjusted and optimized according to specific image quality defects (such as focusing blurring, insufficient image saturation, abnormal hue and the like) in a targeted mode until the image quality of the camera module reaches the standard, and the image quality testing process is ended until the image quality of the camera module is up to the standard, wherein the image quality processing logic codes at the moment are the stable image quality processing logic codes.

The process of the first processor 1002, after testing the version of the os software, continuing the image quality test of the camera module for the image quality parameter value by using the copy of the testing version os software includes:

if not, the image quality test process of the camera module is ended, and a set of image quality parameter values corresponding to the image quality test is imported into the operating system software after the authentication is finished.

Specifically, the tester performs picture quality control and problem finding and positioning on the picture quality effect by combining subjective and objective evaluation standards of the camera image and/or the shooting level of the camera in the industry. And continuously iterating the process to continuously find out improper and unreasonable values of the image quality parameter values.

In an optional embodiment of the present application, when controlling the image capturing module according to the stable image quality processing logic code, the first processor 1002 may further perform the following processing:

When the customized function of the image quality parameter values is provided for the user, as an optional implementation mode, a plurality of sets of customized versions of the image quality parameter values can be directly provided for the user to select one set for use, as another optional implementation mode, a reasonable value-taking interval of each image quality parameter can be determined in advance based on experiments and/or experience to form customized constraint information of the image quality parameters, and then, the required image quality parameter values can be configured by the user based on the customized constraint information of each image quality parameter value.

Corresponding to the image quality regulation and control processing method applied to the camera module of the terminal device, the application also discloses the terminal device, and the terminal device can be but is not limited to mobile devices such as mobile phones and tablets of users, or computer terminals such as desktops, notebooks and all-in-one machines.

As shown in fig. 11, the terminal device may include:

a second memory 1101 for storing at least one set of instructions;

a second processor 1102, configured to invoke and execute the set of instructions in the second memory, and by executing the set of instructions, perform the following:

When a user has a need to upgrade the image quality parameter value of the camera module in the terminal device, as shown in fig. 9, the image quality parameter value of the upgraded version may be downloaded from the resource server to the terminal device through the network server. The resource server and the network server may be the same server or different servers.

In an optional embodiment of the present application, a system for adjusting and controlling image quality of a camera module is further provided, and as shown in fig. 12, the system includes the provider processing device 1201 provided in the above embodiment, the server 1202, and the terminal device 1203 provided in the above embodiment.

The provider processing device 1201 is configured to push the generated image quality parameter values of the upgraded version or the image quality parameter values of the plurality of sets of customized versions and/or the customized constraint information to the server by executing corresponding image quality adjustment and control processing of the camera module;

and the server 1202 is used for providing upgrading service or customization service of the image quality parameter values of the camera module for the terminal equipment based on the image quality parameter values of the upgrading version pushed by the processing equipment of the supplier or the image quality parameter values and/or customization constraint information of the plurality of sets of customized versions.

The server 1202 may be a resource server as described above, which may be the same server as the network server described above or a different server.

The terminal device 1203 is configured to upgrade or customize the image quality parameter value of the camera module in the terminal device by executing corresponding image quality adjustment and control processing of the camera module based on the upgrade service or the customized service of the image quality parameter value provided by the server, and control the camera module according to the stable image quality processing logic code in the terminal device and the upgraded or customized image quality parameter value.

For specific functions or processing procedures of the provider processing device 1201, the server 1202, and the terminal device 1203, please refer to the related description of the above embodiments, which is not described herein again.

It should be noted that, in the present specification, the embodiments are all described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments may be referred to each other.

For convenience of description, the above system or apparatus is described as being divided into various modules or units by function, respectively. Of course, the functionality of the units may be implemented in one or more software and/or hardware when implementing the present application.

From the above description of the embodiments, it is clear to those skilled in the art that the present application can be implemented by software plus necessary general hardware platform. Based on such understanding, the technical solutions of the present application may be essentially or partially implemented in the form of a software product, which may be stored in a storage medium, such as a ROM/RAM, a magnetic disk, an optical disk, etc., and includes several instructions for enabling a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the method according to the embodiments or some parts of the embodiments of the present application.

Finally, it is further noted that, herein, relational terms such as first, second, third, fourth, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.

The foregoing is only a preferred embodiment of the present application and it should be noted that those skilled in the art can make several improvements and modifications without departing from the principle of the present application, and these improvements and modifications should also be considered as the protection scope of the present application.

Claims

1. A picture quality regulation and control processing method of a camera module comprises the following steps:

acquiring an original image quality debugging file of a camera module;

controlling the camera module according to the stable image quality processing logic code;

wherein the image quality debugging data comprises image quality parameter values, and the stable image quality processing logic code is obtained by processing in the operating system software based on the data file and the image quality debugging file, and comprises:

if not, the image quality testing process of the camera module is ended, and the corresponding image quality processing logic code when the image quality testing process of the camera module is ended is used as the stable image quality processing logic code.

2. The method of claim 1, wherein the stripping the picture quality debugging data from the original picture quality debugging file comprises:

3. The method of claim 2, wherein the controlling the camera module according to the stabilized image quality processing logic comprises:

4. The method of claim 3, wherein controlling the camera module according to the stabilized image quality processing logic further comprises:

5. The method of claim 4, wherein controlling the camera module according to the stabilized image quality processing logic further comprises:

6. A picture quality regulation and control processing method of a camera module comprises the following steps:

controlling the camera module according to the stable image quality processing logic code in the terminal equipment and the upgraded or customized image quality parameter value;

wherein the stable image quality processing logic code is: and the image quality processing logic code can enable the image quality of the camera module to reach a preset standard.

7. The method of claim 6, wherein the downloading, at the terminal device, the upgraded version of the picture quality parameter value from the server, or selecting and downloading a set of customized picture quality parameter values from a plurality of sets of customized picture quality parameter values provided by the server, comprises:

8. A supplier processing apparatus, comprising:

a first memory for storing at least one set of instructions;

acquiring an original image quality debugging file of a camera module;

the first processor, when obtaining a stable image quality processing logic code based on the data file and the image quality debugging file in the operating system software, is specifically configured to:

9. A terminal device, comprising:

a second memory for storing at least one set of instructions;

10. An image quality regulation and control processing system of a camera module comprises:

a supplier processing device, configured to push the generated image quality parameter values of the upgraded version or the image quality parameter values of the plurality of sets of customized versions and/or the customized constraint information to the server by executing the image quality control processing method of the camera module according to any one of claims 1 to 5;

the terminal device, which is used for upgrading or customizing the image quality parameter value of the camera module in the terminal device based on the upgrading service or the customizing service of the image quality parameter value provided by the server, by executing the image quality regulation and control processing method of the camera module according to any one of claims 6 to 7, and controlling the camera module according to the stable image quality processing logic code in the terminal device and the upgraded or customized image quality parameter value.