CN114092383A

CN114092383A - ISP self-adaptive adjustment control method and device based on face image

Info

Publication number: CN114092383A
Application number: CN202010856033.1A
Authority: CN
Inventors: 霍帅; 易甜; 南楠; 王晓明; 汪厚峄; 彭刚
Original assignee: Allwinner Technology Co Ltd
Current assignee: Allwinner Technology Co Ltd
Priority date: 2020-08-24
Filing date: 2020-08-24
Publication date: 2022-02-25

Abstract

The invention discloses an ISP self-adaptive adjustment control method and a device based on a face image, wherein the method comprises the steps of obtaining the face image collected by image collecting equipment, and inputting the face image into a face image quality evaluation model for analysis; obtaining an analysis result of the facial image quality evaluation model as an image analysis parameter of the facial image, and judging whether an ISP (internet service provider) corresponding to the image acquisition equipment needs to be adjusted or not according to the image analysis parameter; if yes, adjusting the ISP according to the image analysis parameters until the parameters of the ISP meet preset conditions, and triggering and executing the operation of acquiring the face image acquired by the image acquisition equipment again. Therefore, the dynamic adjustment of the ISP can be realized, the ISP is always in a state of being in fit with the face application, the real-time and accurate acquisition of the face image is realized, the face application is favorably ensured to acquire relatively stable high-quality face input data, and the effectiveness and the safety of face verification (such as entrance guard face refreshing authentication and the like) are improved.

Description

ISP self-adaptive adjustment control method and device based on face image

Technical Field

The invention relates to the technical field of image processing, in particular to an ISP self-adaptive adjustment control method and device based on a face image.

Background

With the rapid development of scientific technology, the development of face recognition technology is more mature. Based on the advantages of fast response speed and capability of performing identity authentication in a non-contact manner, the application range of the face recognition technology is increasingly wide, for example: face unlocking, enterprise attendance, community access control, mobile payment and the like.

In practical applications, the quality of the acquired Image directly affects the accuracy of face recognition, and the quality of the acquired Image depends on the adjustment of an ISP (Image Signal Processor) of the camera. At present, the ISP is mainly adjusted by the global information acquired by the image sensor to adapt to the change of the environment. However, practice shows that the ISP adjusting method is completely separated from the application purpose of calling the camera, and the application calling the camera can only passively use the original data provided by the camera, and cannot guide the ISP to perform targeted adjustment, that is, the current ISP adjustment cannot be dynamically adjusted according to the actual situation, so that a real-time and accurate image cannot be obtained.

Disclosure of Invention

The technical problem to be solved by the invention is to provide a method and a device for ISP self-adaptive adjustment control based on a face image, which can dynamically adjust the ISP according to the actual situation and realize real-time and accurate acquisition of the face image.

In order to solve the technical problem, a first aspect of the present invention discloses a method for controlling ISP adaptive adjustment based on a face image, the method comprising:

acquiring a face image acquired by image acquisition equipment, and inputting the face image into a predetermined face image quality evaluation model for analysis;

obtaining an analysis result of the facial image quality evaluation model as an image analysis parameter of the facial image, and judging whether an ISP (internet service provider) corresponding to the image acquisition equipment needs to be adjusted or not according to the image analysis parameter;

and when the ISP is judged to be required to be adjusted, adjusting the ISP according to the image analysis parameters until the parameters of the ISP meet preset conditions, and triggering and executing the operation of acquiring the face image acquired by the image acquisition equipment again.

As an optional implementation manner, in the first aspect of the present invention, the image analysis parameter includes at least one of an exposure parameter of the face image, a white balance parameter of the face image, and a focusing parameter of the face image;

wherein, the determining whether the ISP corresponding to the image acquisition device needs to be adjusted according to the image analysis parameters includes:

when the image analysis parameters are exposure parameters of the face image, intercepting the face image based on a calibration result corresponding to the determined face key points to obtain a target face region, wherein the area of the target face region is smaller than that of the face image;

acquiring a first brightness value corresponding to the target face area, judging whether the first brightness value is greater than or equal to a preset brightness value threshold, and determining that an ISP (internet service provider) corresponding to the image acquisition equipment needs to be adjusted when the first brightness value is judged to be greater than or equal to the preset brightness value threshold; alternatively, the first and second electrodes may be,

when the image analysis parameters are white balance parameters of the face image, determining the mean value of each channel in RGB three channels of the target face area, judging whether the proportion distribution of all the channels is matched with the predetermined proportion distribution according to all the mean values, and when the judgment result is negative, determining that an ISP (Internet service provider) corresponding to the image acquisition equipment needs to be adjusted; alternatively, the first and second electrodes may be,

and when the image analysis parameter is the focusing parameter of the face image, acquiring a target position of the target face region appearing in the image acquisition equipment, judging whether the target position is in a predetermined position range, and when the judgment result is negative, determining that an ISP (internet service provider) corresponding to the image acquisition equipment needs to be adjusted.

As an alternative implementation, in the first aspect of the present invention, the method further includes:

when the first brightness value is judged to be not more than the preset brightness value threshold, expanding the effective area of the target face region according to a preset expansion mode to obtain an expanded target face region, wherein the preset expansion mode is a mode set based on the central position of the target face region;

determining a second brightness value of a background area corresponding to the enlarged target face area, and calculating the inverse luminosity of the face image based on the first brightness value and the second brightness value;

and judging whether the inverse luminosity is less than or equal to a preset inverse luminosity threshold value, and determining that the ISP corresponding to the image acquisition equipment needs to be adjusted when the inverse luminosity is less than or equal to the preset inverse luminosity threshold value.

As an optional implementation manner, in the first aspect of the present invention, before the acquiring the face image acquired by the image acquisition device, the method further includes:

judging whether the ISP needs to be adjusted or not according to the current state of the ISP, and triggering and executing the operation of acquiring the face image acquired by the image acquisition equipment when the ISP needs to be adjusted;

wherein the determining whether the ISP needs to be adjusted according to the current state of the ISP includes:

reading a target time currently displayed by the image processing system corresponding to the ISP, and acquiring a finishing time corresponding to the ISP adjustment at the last time;

and calculating the interval duration between the target time and the finishing time, judging whether the interval duration is less than or equal to a predetermined interval duration threshold, and determining that the ISP needs to be adjusted when the interval duration is less than or equal to the interval duration threshold.

As an optional implementation manner, in the first aspect of the present invention, after determining that the interval duration is less than or equal to the interval duration threshold and before determining that the ISP needs to be adjusted, the method further includes:

the method comprises the steps of obtaining the total adjustment times of the ISP within a first preset time length, judging whether the total adjustment times is smaller than a preset adjustment time threshold value, and triggering and executing the operation of determining that the ISP needs to be adjusted when the total adjustment times is judged to be smaller than the preset adjustment time threshold value, wherein the ending moment of the first preset time length is the moment of adjusting the ISP at the last time.

As an optional implementation manner, in the first aspect of the present invention, after the obtaining of the face image collected by the image collection device and before the inputting of the face image into a predetermined face image quality evaluation model for analysis, the method further includes:

determining image parameters corresponding to the face image, wherein the image parameters comprise at least one of the area of the face image, the position of the face image appearing in the image acquisition equipment and the face information of the face image, and the face information of the face image comprises the position of a left virtual pupil, the position of a right virtual pupil, the position of a left mouth corner of a virtual mouth, the position of a right mouth corner of the virtual mouth and the position of a virtual nose tip of the face image;

and judging whether the face image meets the preset adjustment condition of the ISP or not according to the image parameters, and triggering and executing the operation of inputting the face image into a preset face image quality evaluation model for analysis when the face image is judged to meet the preset adjustment condition of the ISP.

As an optional implementation manner, in the first aspect of the present invention, after the adjusting the ISP according to the image analysis parameter until the current parameter of the ISP satisfies a preset condition and before the re-triggering and executing the operation of acquiring the facial image acquired by the image acquisition apparatus, the method further includes:

judging whether the real-time display time of the image processing system corresponding to the ISP reaches the ending time of a second preset time length, and when the real-time display time reaches the ending time of the second preset time length, re-triggering and executing the operation of acquiring the face image acquired by the image acquisition equipment, wherein the starting time of the second preset time length is the time when the ISP needs to be adjusted.

The invention discloses a control device for ISP self-adaptive adjustment based on a face image, which comprises an acquisition module, an analysis module, a first judgment module and an adjustment module, wherein:

the acquisition module is used for acquiring a face image acquired by the image acquisition equipment;

the analysis module is used for inputting the face image into a predetermined face image quality evaluation model for analysis;

the acquisition module is further used for acquiring an analysis result of the facial image quality evaluation model as an image analysis parameter of the facial image;

the first judging module is used for judging whether the ISP corresponding to the image acquisition equipment needs to be adjusted or not according to the image analysis parameters;

the adjusting module is configured to adjust the ISP according to the image analysis parameter when the first determining module determines that the ISP needs to be adjusted, until the parameter of the ISP meets a preset condition, and trigger the obtaining module to re-execute the operation of obtaining the face image collected by the image collecting device.

As an optional implementation manner, in the second aspect of the present invention, the image analysis parameter includes at least one of an exposure parameter of the face image, a white balance parameter of the face image, and a focus parameter of the face image;

the first judgment module comprises a first judgment submodule or a second judgment submodule or a third judgment submodule, wherein the first judgment submodule comprises an intercepting unit, an obtaining unit, a judging unit and a determining unit, and the first judgment submodule comprises:

the intercepting unit is used for intercepting the face image based on a calibration result corresponding to the determined face key point to obtain a target face region when the image analysis parameter is an exposure parameter of the face image, wherein the area of the target face region is smaller than that of the face image;

the acquisition unit is used for acquiring a first brightness value corresponding to the target face area;

the judging unit is used for judging whether the first brightness value is greater than or equal to a preset brightness value threshold value;

the determining unit is configured to determine that an ISP corresponding to the image acquisition device needs to be adjusted when the determining unit determines that the first brightness value is greater than or equal to the preset brightness value threshold; alternatively, the first and second electrodes may be,

the second judgment sub-module is configured to determine, when the image analysis parameter is a white balance parameter of the face image, a mean value of each of the three channels RGB of the target face region, judge, according to all the mean values, whether the proportion distribution of all the channels matches a predetermined proportion distribution, and when the judgment result is negative, determine that an ISP corresponding to the image acquisition device needs to be adjusted; alternatively, the first and second electrodes may be,

and the third judging submodule is used for acquiring the target position of the target face area on the image acquisition equipment when the image analysis parameter is the focusing parameter of the face image, judging whether the target position is in a predetermined position range, and determining that the ISP corresponding to the image acquisition equipment needs to be adjusted when the judgment result is negative.

As an optional implementation manner, in the second aspect of the present invention, the obtaining unit is further configured to, when the determining unit determines that the first luminance value is not greater than or equal to the preset luminance value threshold, expand the effective area of the target face region according to a preset expansion manner, so as to obtain an expanded target face region, where the preset expansion manner is a manner set based on a center position of the target face region;

the determining unit is further configured to determine a second brightness value of the background area corresponding to the enlarged target face area;

the acquisition unit is further used for calculating the inverse luminosity of the face image based on the first brightness value and the second brightness value;

the judging unit is used for judging whether the retroluminosity is smaller than or equal to a preset retroluminosity threshold value or not, and when the retroluminosity is judged to be smaller than or equal to the preset retroluminosity threshold value, the determining unit is triggered to execute the operation of determining that the ISP corresponding to the image acquisition equipment needs to be adjusted.

As an optional implementation manner, in the second aspect of the present invention, the apparatus further includes a second determining module, wherein:

the second judging module is used for judging whether the ISP needs to be adjusted or not according to the current state of the ISP before the acquisition module acquires the face image acquired by the image acquisition equipment; when the ISP is judged to need to be adjusted, triggering the acquisition module to execute the operation of acquiring the face image acquired by the image acquisition equipment;

the second judgment module comprises a reading submodule, an obtaining submodule, a calculating submodule and a fourth judgment submodule, wherein:

the reading submodule is used for reading the currently displayed target time of the image processing system corresponding to the ISP;

the obtaining submodule is used for obtaining the finishing time corresponding to the ISP adjustment at the last time;

the calculation submodule is used for calculating the interval duration between the target time and the completion time;

the fourth judgment submodule is used for judging whether the interval duration is less than or equal to a predetermined interval duration threshold value;

the obtaining submodule is further configured to determine that the ISP needs to be adjusted when the fourth determining submodule determines that the interval duration is less than or equal to the interval duration threshold.

As an optional implementation manner, in the second aspect of the present invention, the obtaining sub-module is further configured to obtain, after the fourth determining sub-module determines that the interval duration is less than or equal to the interval duration threshold and before it is determined that the ISP needs to be adjusted, a total adjustment number of times of the ISP within a first preset duration, where a cutoff time of the first preset duration is a time when the ISP is adjusted last time;

the fourth determining submodule is further configured to determine whether the total adjustment time is smaller than a preset adjustment time threshold, and when it is determined that the total adjustment time is smaller than the preset adjustment time threshold, trigger the obtaining submodule to perform the operation of determining that the ISP needs to be adjusted.

As an optional implementation manner, in the second aspect of the present invention, the apparatus further includes a determining module and a third determining module, wherein:

the determining module is configured to determine, after the obtaining module obtains a face image acquired by an image acquisition device and before the analyzing module inputs the face image into a predetermined face image quality evaluation model for analysis, image parameters corresponding to the face image, where the image parameters include at least one of an area of the face image, a position of the face image appearing in the image acquisition device, and face information of the face image, and the face information of the face image includes a position of a left virtual pupil, a position of a right virtual pupil, a position of a left mouth corner of a virtual mouth, a position of a right mouth corner of the virtual mouth, and a position of a virtual nose tip of the face image;

and the third judging module is used for judging whether the face image meets the predetermined adjustment condition of the ISP according to the image parameters, and when the face image meets the adjustment condition of the ISP, triggering the analysis module to execute the operation of inputting the face image into a predetermined face image quality evaluation model for analysis.

As an optional implementation manner, in the second aspect of the present invention, the apparatus further includes a fourth determining module, wherein:

the fourth judging module is configured to judge whether the real-time display time of the image processing system corresponding to the ISP reaches an end time of a second preset time after the adjusting module adjusts the ISP according to the image analysis parameter until the current parameter of the ISP meets a preset condition and before the acquiring module is triggered to execute the operation of acquiring the face image acquired by the image acquisition device again, and when it is judged that the real-time display time reaches the end time of the second preset time, trigger the acquiring module to execute the operation of acquiring the face image acquired by the image acquisition device again, where an initial time of the second preset time is a time when the ISP needs to be adjusted.

The third aspect of the invention discloses another ISP adaptive adjustment control device based on a face image, which comprises:

a memory storing executable program code;

a processor coupled with the memory;

the processor calls the executable program code stored in the memory to execute the ISP self-adaptive adjustment control method based on the face image disclosed by the first aspect of the invention.

The fourth aspect of the present invention discloses a computer storage medium, wherein the computer storage medium stores computer instructions, and when the computer instructions are called, the computer instructions are used for executing the ISP adaptive adjustment control method based on the face image disclosed in the first aspect of the present invention.

Compared with the prior art, the embodiment of the invention has the following beneficial effects:

the embodiment of the invention discloses an ISP self-adaptive adjustment control method and device based on a face image, wherein the method comprises the steps of obtaining the face image collected by image collection equipment, and inputting the face image into a predetermined face image quality evaluation model for analysis; obtaining an analysis result of the facial image quality evaluation model as an image analysis parameter of the facial image, and judging whether an ISP (internet service provider) corresponding to the image acquisition equipment needs to be adjusted or not according to the image analysis parameter; and when the ISP is judged to be required to be adjusted, adjusting the ISP according to the image analysis parameters until the parameters of the ISP meet the preset conditions, and triggering and executing the operation of acquiring the face image acquired by the image acquisition equipment again. Therefore, the embodiment of the invention combines the ISP of the image acquisition equipment with the face related application bearing the face image quality evaluation model, inputs the acquired face image into the face image quality evaluation model for analysis, can evaluate the parameter setting of the ISP according to the image analysis parameters, namely the imaging quality of the ISP, adjusts the ISP according to the image analysis parameters and obtains the face image again to execute the adjustment operation of the same ISP when the ISP needs to be adjusted, can realize the dynamic adjustment of the ISP, ensures that the ISP is always in the state of being matched with the face application, realizes the real-time and accurate acquisition of the face image, is beneficial to ensuring that the face application acquires relatively stable high-quality face input data, and further improves the validity and safety of face verification (such as entrance guard face brushing authentication and the like); and the ISP is adjusted in a self-adaptive manner according to the face imaging result, on the premise of not increasing the cost, the self-adjusting function of the ISP of the existing image acquisition equipment is fully utilized, and the ISP imaging effect of the existing image equipment is obviously improved.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.

Fig. 1 is a schematic flow chart of an ISP adaptive adjustment control method based on a face image according to an embodiment of the present invention;

fig. 2 is a schematic flow chart of another ISP adaptive adjustment control method based on face images, disclosed in the embodiment of the present invention;

fig. 3 is a schematic structural diagram of an ISP adaptive adjustment control device based on a face image according to an embodiment of the present invention;

fig. 4 is a schematic structural diagram of another ISP adaptive adjustment control device based on a face image according to the embodiment of the present invention;

fig. 5 is a schematic structural diagram of another ISP adaptive adjustment control device based on a face image according to an embodiment of the present invention.

Detailed Description

In order to make the technical solutions of the present invention better understood, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

The terms "first," "second," and the like in the description and claims of the present invention and in the above-described drawings are used for distinguishing between different objects and not for describing a particular order. Furthermore, the terms "include" and "have," as well as any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, apparatus, product, or apparatus that comprises a list of steps or elements is not limited to those listed but may alternatively include other steps or elements not listed or inherent to such process, method, product, or apparatus.

Reference herein to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the invention. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is explicitly and implicitly understood by one skilled in the art that the embodiments described herein can be combined with other embodiments.

The invention discloses a method and a device for ISP self-adaptive adjustment control based on a face image, which can input the collected face image into a face image quality evaluation model for analysis by combining the ISP of image collection equipment and face related application carrying the face image quality evaluation model, can analyze parameters according to the image, i.e., the imaging quality of the ISP, the parameter settings of the ISP are evaluated, and when the ISP needs to be adjusted, the ISP will be adjusted according to the image analysis parameters, the human face image is obtained again to execute the adjustment operation of the same ISP, so that the dynamic adjustment of the ISP can be realized, the ISP is always in a state of being matched with the human face application, the real-time and accurate acquisition of the human face image is realized, the human face application is favorably ensured to acquire relatively stable high-quality human face input data, and the effectiveness and the safety of human face verification (such as entrance guard face brushing authentication and the like) are improved; and the ISP is adjusted in a self-adaptive manner according to the face imaging result, on the premise of not increasing the cost, the self-adjusting function of the ISP of the existing image acquisition equipment is fully utilized, and the ISP imaging effect of the existing image equipment is obviously improved. The following are detailed below.

Example one

Referring to fig. 1, fig. 1 is a schematic flowchart of an ISP adaptive adjustment control method based on a face image according to an embodiment of the present invention. The ISP adaptive adjustment control method based on the face image described in fig. 1 is applicable to an image processing system, where the image processing system may be used to adjust an ISP, and the image processing system is built in a terminal device capable of acquiring a face, where the terminal device includes a user terminal and/or an access control device. As shown in fig. 1, the ISP adaptive adjustment control method based on the face image may include the following operations:

101. and acquiring a human face image acquired by the image acquisition equipment.

In the embodiment of the invention, the image acquisition equipment is provided with the ISP, and the face image can be a real-time image acquired by the image acquisition equipment or an image acquired at intervals of preset time (for example, 30 s).

In the embodiment of the present invention, after the face image is obtained, a preprocessing operation is further performed on the face image, at this time, the face image in step 102 is a preprocessed face image, where the preprocessing operation includes a filtering operation, an image segmentation operation, and the like. Therefore, after the face image is obtained, the preprocessing operation is firstly performed on the face image, and the high-quality face image can be obtained, so that the analysis result of the face image is favorably improved, and the judgment accuracy of the adjustment ISP is favorably improved.

In an optional embodiment, before performing step 101, the method for ISP adaptive adjustment control based on a facial image may further include the following operations:

initializing an image processing system, specifically, initializing an ISP adjustment information structure of the image processing system, wherein the ISP adjustment information structure is used for storing variables of the ISP in an adjustment process, such as: the detected face information of the latest frame (namely the face appears at the specific position of a sensor included in the image acquisition equipment), the specific adjustment time of the last ISP, the adjustment times of the ISP in the current operation of the image processing system and the like;

after the image processing system initialization is complete, execution of step 101 may be triggered.

Therefore, in the optional embodiment, before the face image is acquired, the image processing system is initialized, so that the information processing capability of the image processing system can be improved.

102. And inputting the face image into a predetermined face image quality evaluation model for analysis, and acquiring an analysis result of the face image quality evaluation model as an image analysis parameter of the face image.

In this embodiment of the present invention, the image analysis parameter (i.e., the representation of the imaging quality of the sensor of the image acquisition device) includes at least one of an exposure parameter of the face image, a white balance parameter of the face image, and a focusing parameter of the face image, which is not limited in this embodiment of the present invention. Further, the image analysis parameters may further include, but are not limited to, a color correction matrix, sharpness, curve attributes, and saturation, so that the more contents the image analysis parameters include, the more the accuracy of determining whether the ISP needs to be adjusted is improved.

103. Judging whether the ISP corresponding to the image acquisition equipment needs to be adjusted or not according to the image analysis parameters; when the ISP needs to be adjusted, step 103 is triggered to be executed; when the ISP is determined not to need to be adjusted, the process may be ended.

104. And adjusting the ISP according to the image analysis parameters until the parameters of the ISP meet preset conditions, and re-triggering the step 101.

In the embodiment of the present invention, as an optional implementation manner, determining whether an ISP corresponding to an image capturing device needs to be adjusted according to an image analysis parameter includes:

when the image analysis parameters are exposure parameters of the face image, intercepting the face image based on a calibration result (for example, 106 personal face key points) corresponding to the determined face key points to obtain a target face area, wherein the area of the target face area is smaller than that of the face image;

acquiring a first brightness value corresponding to a target face area, judging whether the first brightness value is greater than or equal to a preset brightness value threshold, and determining that an ISP (internet service provider) corresponding to the image acquisition equipment needs to be adjusted when the first brightness value is greater than or equal to the preset brightness value threshold.

In this optional implementation manner, optionally, the obtaining a first brightness value corresponding to the target face region may include:

and converting the RGB expression form of the target face area into the YcbCr expression form, and calculating the mean value of the Y component of the target face area as a first brightness value corresponding to the target face area.

In this optional embodiment, further, when it is determined that the first brightness value is not greater than the preset brightness value threshold, it is determined that the ISP corresponding to the image capturing device does not need to be adjusted, that is, the image capturing device is normally exposed, and this process is ended.

Therefore, in the optional embodiment, by acquiring the brightness value of the face image and comparing the brightness value with the preset brightness value, the judgment that the ISP needs to be adjusted under the condition that the image acquisition equipment is over-exposed can be realized; and before the brightness of the face image is obtained, the face image is further intercepted through a calibration result corresponding to the face key point, so that the determining efficiency and the accuracy of the brightness value of the face image can be improved, and the accuracy and the reliability of judging whether the ISP needs to be adjusted are improved.

In the embodiment of the present invention, as another optional implementation manner, the determining whether an ISP corresponding to an image capturing device needs to be adjusted according to an image analysis parameter includes:

and when the image analysis parameters are the white balance parameters of the face image, determining the mean value of each channel in the RGB three channels of the target face area, judging whether the proportion distribution of all the channels is matched with the predetermined proportion distribution according to all the mean values, and when the judgment result is negative, determining that the ISP corresponding to the image acquisition equipment needs to be adjusted.

Therefore, the optional implementation method can realize the judgment that the ISP needs to be adjusted by judging whether the distribution of the RGB three channels of the face image is reasonable or not.

In the embodiment of the present invention, as another optional implementation manner, determining whether an ISP corresponding to an image capturing device needs to be adjusted according to an image analysis parameter includes:

and when the image analysis parameter is the focusing parameter of the face image, acquiring a target position of a target face region appearing in the image acquisition equipment, judging whether the target position is in a predetermined position range, and when the judgment result is negative, determining that an ISP (Internet service provider) corresponding to the image acquisition equipment needs to be adjusted.

Therefore, in the optional embodiment, the position of the acquired face image appearing in the image acquisition device is compared with the predetermined position range, so that the ISP can be judged to be adjusted.

In the embodiment of the invention, when the first brightness value is judged to be more than or equal to the preset brightness value threshold and/or when the proportion distribution of all the channels is judged not to be matched with the predetermined proportion distribution and/or when the target position is judged not to be in the predetermined position range, the ISP is determined to be required to be adjusted, so that the accuracy of judgment that the ISP is required to be adjusted can be improved, various judgment modes that the ISP is required to be adjusted can be provided, and the flexibility of judgment that the ISP is required to be adjusted is improved.

In the embodiment of the present invention, adjusting the ISP according to the image analysis parameter until the parameter of the ISP meets the preset condition may include:

when the first brightness value is judged to be larger than or equal to the preset brightness value threshold, acquiring an exposure parameter currently set by an ISP (internet service provider), and adjusting the ISP according to the exposure parameter currently set by the ISP and the exposure parameter of the face image until the exposure parameter of the ISP is smaller than or equal to the preset exposure parameter; alternatively, the first and second electrodes may be,

and when the proportion distribution of all the channels is judged not to be matched with the predetermined proportion distribution, fixing the average value of the G channel of the target face image, and respectively adjusting the gain of the R channel and the gain of the B channel based on the value of R/G, G/B so as to enable the proportion distribution of all the channels to be matched with the predetermined proportion distribution. Alternatively, the first and second electrodes may be,

and when the target position is judged not to be in the predetermined position range, adjusting the ISP according to the target position until the target position is in the predetermined position range.

Therefore, in the optional implementation mode, the ISP is adjusted at different times according to different parameters, so that each parameter of the ISP meets the image acquisition requirement, and the image acquisition accuracy and efficiency are improved.

In an optional embodiment, the ISP adaptive adjustment control method based on the face image may further include the following operations:

when the first brightness value is judged to be not more than the preset brightness value threshold, the effective area of the target face area is enlarged according to a preset enlarging mode to obtain the enlarged target face area, wherein the preset enlarging mode is a mode set based on the central position of the target face area;

determining a second brightness value of the background area corresponding to the expanded target face area, and calculating the backlight degree of the face image based on the first brightness value and the second brightness value;

In this optional embodiment, the preset expansion mode is a mode set based on the center position of the target face region, specifically: the preset expansion mode is that a rectangular image area formed by taking the center position of the target face area as the center, taking the short sides of a first plurality of times (for example, 1 time) of the target face area as the first short sides, and taking the long sides of a second plurality of times (for example, 1 time) of the target face area as the first long sides is taken as the expanded target face area. For example, when the target face area is a rectangular image area formed by using the center point of the target face area as the center point, the short edge of the target face area is 15cm, and the long edge of the target face area is 20cm, the target face area after expansion still has the short edge of 10cm and the long edge of 15 cm.

In this optional embodiment, when an enlarged target face region (foreground image) is obtained, the target face region is removed from the face image by an image separation method to obtain a background region, where the image separation method may include one or a combination of multiple separation methods such as a background difference method, a frame difference method, an optical flow field method, and an RPCA method, where the method for removing the foreground image by the image separation method is an existing method and is not described herein again. The calculation method of the second brightness value of the background area is the same as the calculation method of the target face area, and details are not repeated here.

In this alternative embodiment, the specific calculation formula of the inverse luminosity of the face image is as follows:

wherein R is the backlight of the face image; y is_fA first brightness value corresponding to the target face area; y is_bIs the second luminance value of the background region.

In this optional embodiment, further, when it is determined that the inverse luminosity is not less than or equal to the preset inverse luminosity threshold, it is determined that the ISP corresponding to the image acquisition device does not need to be adjusted, that is, the exposure of the image acquisition device is normal, and the process is ended.

Therefore, in the optional embodiment, when the brightness value of the face area is judged to be smaller, the brightness value of the corresponding background area after the face area is expanded is calculated, the backlight degree of the face image is obtained based on the two brightness values, and when the backlight degree of the face image is determined to be smaller, the ISP is determined to be required to be adjusted, so that the judgment that the ISP is required to be adjusted under the condition of insufficient exposure of the image acquisition equipment is improved, the determination accuracy of the ISP required to be adjusted can be improved, the omnibearing dynamic adjustment of the ISP is facilitated, and the accuracy of the dynamic image acquired subsequently is facilitated.

In yet another optional embodiment, the ISP adaptive adjustment control method based on the facial image may further include the following operations:

when the inverse luminosity is judged to be not less than or equal to a preset inverse luminosity threshold value, judging whether the first brightness value is greater than or equal to a certain preset brightness value threshold value, wherein the certain preset brightness value threshold value is less than the preset brightness value threshold value;

and when the first brightness value is judged to be not more than a certain preset brightness value threshold, determining that the ISP corresponding to the image acquisition equipment needs to be adjusted.

In this optional embodiment, when it is determined that the first brightness value is greater than or equal to a preset brightness value threshold, it is determined that the ISP corresponding to the image capturing device does not need to be adjusted, that is, the exposure of the image capturing device is normal.

Therefore, in the optional embodiment, when the backlight degree of the face image is judged to be larger, whether the brightness value of the face area is larger or not is continuously judged, and when the brightness value is judged to be smaller, the ISP is determined to be required to be adjusted, so that the accuracy of determining that the image acquisition equipment is under-exposed is improved, namely the accuracy of judging that the ISP is required to be adjusted is improved, and the accuracy of omnibearing ISP dynamic adjustment is further improved.

In yet another alternative embodiment, before performing step 101, the method for ISP adaptive adjustment control based on facial images may further include the following operations:

judging whether the ISP needs to be adjusted or not according to the current state of the ISP, and triggering to execute the step 101 when the ISP needs to be adjusted is judged;

in this optional embodiment, optionally, determining whether the ISP needs to be adjusted according to the current state of the ISP includes:

reading a target time currently displayed by an image processing system corresponding to an ISP (internet service provider), and acquiring a finishing time corresponding to the last adjustment of the ISP;

In this optional embodiment, when it is determined that the interval duration is not less than the interval duration threshold, it is determined that the ISP does not need to be adjusted, and the total number of times of adjustment of the ISP until the target time is cut off in the current operation process of the image processing system is set to zero, so that it is convenient to reduce the calculation of invalid adjustment times when it is determined that the ISP needs to be adjusted in the current operation of the system, and further reduce the erroneous determination that the ISP needs to be adjusted.

In this alternative embodiment, the completion time corresponding to the last adjustment of the ISP is obtained from the adjustment information structure of the ISP.

It should be noted that this alternative embodiment may also occur simultaneously with step 101, or after step 101, preferably before step 101.

Therefore, before the face image is obtained, the optional embodiment judges whether the ISP needs to be adjusted according to the current state of the ISP, if the ISP needs to be adjusted, the operation of obtaining the face image can be executed, the situation that the adjustment operation is executed on the ISP under the condition that the ISP does not need to be adjusted, namely, various indexes (such as white balance and the like) of the image acquisition equipment are matched with the current environment can be reduced, the situation that the image acquisition equipment acquires the face image with poor quality due to the fact that the ISP is adjusted incorrectly can be reduced, the power consumption of the system can be reduced, and the service life of the system can be prolonged.

In yet another optional embodiment, after the interval duration is judged to be less than or equal to the interval duration threshold and before the ISP is determined to need to be adjusted, the ISP adaptive adjustment control method based on the facial image may further include the following operations:

the method comprises the steps of obtaining the total adjustment times of an ISP within a first preset time length, judging whether the total adjustment times is smaller than a preset adjustment time threshold value, and triggering and executing the operation for determining that the ISP needs to be adjusted when the total adjustment times is judged to be smaller than the preset adjustment time threshold value, wherein the ending moment of the first preset time length is the moment of last adjustment of the ISP.

In this optional embodiment, when it is determined that the total adjustment number is not less than the preset adjustment number threshold, it is determined that the ISP does not need to be adjusted, and the process is basically performed this time.

Therefore, when the time for adjusting the ISP last time is determined to be short, and the total adjustment times of the ISP in the current operation process of the image processing system is further determined to be small, the ISP needs to be adjusted, so that the accuracy of determination that the ISP needs to be adjusted can be improved; and by limiting the total times of adjustment of the ISP in the current operation process of the system, the performance requirement of the ISP can be met and the system is suitable for complex environments, so that the user experience is improved.

In yet another optional embodiment, after the ISP is adjusted according to the image analysis parameter until the current parameter of the ISP meets the preset condition and before the step 101 is re-triggered, the ISP adaptive adjustment control method based on the facial image may further include the following operations:

and judging whether the real-time display time of the image processing system corresponding to the ISP reaches the ending time of the second preset time length, and when the real-time display time reaches the ending time of the second preset time length, re-triggering and executing the step 101, wherein the starting time of the second preset time length is the time when the ISP needs to be adjusted.

In this optional embodiment, when it is determined that the real-time display time does not reach the end time of the second preset time duration, the operation of determining whether the real-time display time of the image processing system corresponding to the ISP reaches the end time of the second preset time duration is triggered and executed. Therefore, the triggering accuracy of the operation of re-executing the face image acquisition can be improved by monitoring the real-time display time of the image processing system.

Therefore, in the optional embodiment, after the ISP is adjusted, it is first determined whether the current time reaches the preset time, and if the current time reaches the preset time, the operation of obtaining the face image is executed again, so that the requirement that a certain time is required from the time when the parameters of the ISP are written into the register to the time when the parameters take effect can be met, the occurrence of the situation that the subsequent direct image reading may damage the stability of the image processing system is reduced, and the running stability of the image processing system is further ensured.

It can be seen that, by implementing the ISP adaptive adjustment control method based on facial images described in fig. 1, by combining the ISP of the image acquisition device with the face-related application carrying the facial image quality assessment model, and inputting the acquired facial images into the facial image quality assessment model for analysis, according to the image analysis parameters, i.e., the imaging quality of the ISP, the parameter settings of the ISP are evaluated, and when the ISP needs to be adjusted, the ISP will be adjusted according to the image analysis parameters, the human face image is obtained again to execute the adjustment operation of the same ISP, so that the dynamic adjustment of the ISP can be realized, the ISP is always in a state of being matched with the human face application, the real-time and accurate acquisition of the human face image is realized, the human face application is favorably ensured to acquire relatively stable high-quality human face input data, and the effectiveness and the safety of human face verification (such as entrance guard face brushing authentication and the like) are improved; and the ISP is adjusted in a self-adaptive manner according to the face imaging result, on the premise of not increasing the cost, the self-adjusting function of the ISP of the existing image acquisition equipment is fully utilized, and the ISP imaging effect of the existing image equipment is obviously improved.

Example two

Referring to fig. 2, fig. 2 is a schematic flowchart of another ISP adaptive adjustment control method based on a face image according to an embodiment of the present invention. The ISP adaptive adjustment control method based on the face image described in fig. 2 is applicable to an image processing system, where the image processing system may be used to adjust an ISP, and the image processing system is built in a terminal device capable of acquiring a face, where the terminal device includes a user terminal and/or an access control device. As shown in fig. 2, the ISP adaptive adjustment control method based on the face image may include the following operations:

201. and acquiring a human face image acquired by the image acquisition equipment.

202. And determining image parameters corresponding to the face image.

In the embodiment of the present invention, the image parameter includes at least one of an area of the face image, a position where the face image appears in the image acquisition device, and face information of the face image, where the face information of the face image includes a position of a left virtual pupil, a position of a right virtual pupil, a position of a left mouth corner of the virtual mouth, a position of a right mouth corner of the virtual mouth, and a position of a virtual nose tip of the face image.

203. Judging whether the face image meets the predetermined ISP adjusting condition or not according to the image parameters; when the face image is judged to meet the adjustment condition of the ISP, triggering to execute the step 204; when it is determined that the face image does not satisfy the adjustment condition of the ISP, step 201 may be triggered to be executed, or the process may be ended.

Therefore, after the face image is acquired, whether the face image meets the adjustment condition of the ISP is further judged, and when the face image meets the adjustment condition of the ISP is judged, the follow-up operation is executed, so that the situation that the adjustment of the ISP is wrong due to the fact that the face image does not meet the adjustment condition of the ISP but uses the face image to adjust the ISP can be reduced, the accuracy of dynamic adjustment of the ISP is improved, and the power consumption of an image processing system is reduced; when the adjustment condition of the ISP is judged not to be met, the operation of obtaining the face image is triggered again, so that the image meeting the adjustment condition of the ISP can be obtained, and dynamic adjustment of the ISP can be further facilitated.

204. Inputting the face image into a predetermined face image quality evaluation model for analysis, and acquiring an analysis result of the face image quality evaluation model as an image analysis parameter of the face image;

205. judging whether the ISP corresponding to the image acquisition equipment needs to be adjusted or not according to the image analysis parameters; when the ISP needs to be adjusted, step 206 is triggered; when the ISP is determined not to need to be adjusted, the process may be ended.

206. And adjusting the ISP according to the image analysis parameters until the parameters of the ISP meet preset conditions, and re-triggering the step 201.

In the embodiment of the present invention, as an optional implementation manner, judging whether the face image meets a predetermined ISP adjustment condition according to the image parameter includes:

and when the image parameter is the area of the face image, judging whether the area of the face image is larger than or equal to a predetermined area range, and when the judgment result is yes, determining that the face image meets the predetermined adjustment condition of the ISP.

Therefore, in the optional embodiment, the area of the acquired face image is calculated, and the area is compared with the preset area range, so that the face image can meet the adjustment condition of the ISP.

In the embodiment of the present invention, as another optional implementation manner, the determining, according to the image parameter, whether the face image meets a predetermined ISP adjustment condition includes:

and when the image parameter is the first position of the face image, acquiring a second position of the face image acquired last time, calculating the position offset between the first position and the second position, judging whether the position offset is less than or equal to a preset position offset threshold value, and if so, determining that the face image meets the preset ISP adjustment condition.

This optional embodiment, optionally, calculating the position offset of the first position and the second position may include:

and calculating the intersection ratio of the first position and the second position as the position offset of the first position and the second position.

Therefore, in the optional embodiment, by calculating the position offset between the position of the face image acquired this time in the image acquisition device and the position of the face image acquired last time in the image acquisition device, the face image can meet the judgment of the adjustment condition of the ISP; and the calculation accuracy and efficiency of the position offset between the positions of the two face images can be improved by calculating the intersection ratio of the positions of the two face images.

when the image parameter is the face information of the face image, calculating a pupil abscissa mean value between the position of the left virtual pupil and the position of the right virtual pupil, and calculating a mouth angle abscissa mean value between the position of the left mouth angle and the position of the right mouth angle;

calculating a first abscissa difference value between the pupil abscissa mean value and the abscissa of the position of the virtual nose tip, and calculating a second abscissa difference value between the mouth angle abscissa mean value and the abscissa of the position of the virtual nose tip;

and calculating a target horizontal coordinate difference value between the first horizontal coordinate difference value and the second horizontal coordinate difference value, judging whether the target horizontal coordinate difference value is less than or equal to a preset horizontal coordinate difference value range, and determining that the face image meets the preset ISP adjustment condition when the judgment result is yes.

In this optional embodiment, a target calibration result matched with a face image is determined from a calibration result set of predetermined face key points, so as to obtain face information of the face image, where the calibration result set of the face key points includes a plurality of calibration results, for example: calibration results containing 5 keypoints, calibration results containing 68 keypoints, and calibration results containing 106 keypoints. The method selects the calibration results of 5 key points as the target calibration result.

Therefore, in the optional embodiment, the positions of the left pupil, the right pupil, the left mouth corner and the nose tip in the face image are calculated, so that the symmetry of the acquired virtual five sense organs of the face image can be judged, the fact that the face image meets the adjustment condition of the ISP is judged, and the accuracy of judging that the face image meets the adjustment condition of the ISP is improved.

In the embodiment of the present invention, it should be noted that when two or three of the determination manners in which the three face images satisfy the adjustment condition of the ISP are yes, it is determined that the face images satisfy the adjustment condition of the ISP, so that the accuracy of determining that the face images satisfy the adjustment condition of the ISP can be improved, and the accuracy of subsequent adjustment of the ISP can be improved; by providing a plurality of judging modes that the face image meets the adjustment condition of the ISP, the flexibility and the possibility of judging that the face image meets the adjustment condition of the ISP can be improved.

In another optional embodiment, the ISP adaptive adjustment control method based on the facial image may further include the following operations:

and when the face image is judged not to meet the adjustment condition of the ISP, analyzing the factor that the face image does not meet the adjustment condition of the ISP according to the image parameter of the face image, and sending the factor to the image acquisition equipment so as to trigger the image acquisition equipment to acquire the face image again according to the factor. The factors include five incompetence of facial images, dark brightness of the environment, and the like.

Therefore, after the optional embodiment judges that the face image does not meet the adjustment condition of the ISP, an image acquisition prompt is further generated, which is favorable for improving the accuracy of acquiring the face image meeting the adjustment condition of the ISP, so that the accuracy of dynamic adjustment of the ISP is improved.

In the embodiment of the present invention, for the related descriptions of step 201, step 204, and step 206, refer to the detailed descriptions of step 101 to step 104 in the first embodiment, which are not repeated herein.

It can be seen that, by combining the ISP of the image acquisition device with the face-related application carrying the face image quality evaluation model, the implementation of the ISP adaptive adjustment control method based on the face image described in fig. 2 inputs the acquired face image into the face image quality evaluation model for analysis, and can analyze the parameters according to the image analysis, i.e., the imaging quality of the ISP, the parameter settings of the ISP are evaluated, and when the ISP needs to be adjusted, the ISP will be adjusted according to the image analysis parameters, the human face image is obtained again to execute the adjustment operation of the same ISP, so that the dynamic adjustment of the ISP can be realized, the ISP is always in a state of being matched with the human face application, the real-time and accurate acquisition of the human face image is realized, the human face application is favorably ensured to acquire relatively stable high-quality human face input data, and the effectiveness and the safety of human face verification (such as entrance guard face brushing authentication and the like) are improved; and the ISP is adjusted in a self-adaptive manner according to the face imaging result, on the premise of not increasing the cost, the self-adjusting function of the ISP of the existing image acquisition equipment is fully utilized, and the ISP imaging effect of the existing image equipment is obviously improved. In addition, the situation that the ISP adjustment is wrong due to the fact that the face image does not meet the adjustment condition of the ISP but is used for adjusting the ISP can be reduced, the accuracy of dynamic adjustment of the ISP is improved, and the power consumption of an image processing system is reduced; the method is also beneficial to acquiring the image meeting the adjustment condition of the ISP, and further beneficial to dynamic adjustment of the ISP; and various judging modes that the face images meet the adjustment conditions of the ISP can be provided, so that the accuracy and flexibility of judging that the face images meet the adjustment conditions of the ISP are improved, and the accuracy of subsequent adjustment of the ISP is improved.

EXAMPLE III

Referring to fig. 3, fig. 3 is a schematic structural diagram of an ISP adaptive adjustment control apparatus based on a face image according to an embodiment of the present invention. The ISP adaptive adjustment and control apparatus based on the face image described in fig. 3 is suitable for an image processing system, where the image processing system may be used to adjust an ISP, and the image processing system is built in a terminal device capable of acquiring a face, where the terminal device includes a user terminal and/or an access control device. As shown in fig. 3, the ISP adaptive adjustment and control apparatus based on a face image may include an obtaining module 301, an analyzing module 302, a first determining module 303, and an adjusting module 304, wherein:

an obtaining module 301, configured to obtain a face image collected by an image collecting device.

An analysis module 302, configured to input the facial image into a predetermined facial image quality evaluation model for analysis.

The obtaining module 301 is further configured to obtain an analysis result of the facial image quality evaluation model as an image analysis parameter of the facial image;

a first determining module 303, configured to determine whether an ISP corresponding to the image acquisition device needs to be adjusted according to the image analysis parameter.

An adjusting module 304, configured to, when the first determining module 303 determines that the ISP needs to be adjusted, adjust the ISP according to the image analysis parameter until the parameter of the ISP meets a preset condition, and trigger the obtaining module 301 to re-execute the operation of obtaining the face image collected by the image collecting device.

It can be seen that, implementing the ISP adaptive adjustment control apparatus based on facial images described in fig. 3, by combining the ISP of the image acquisition device with the face-related application carrying the facial image quality assessment model, inputting the acquired facial images into the facial image quality assessment model for analysis, can analyze the facial images according to the image analysis parameters, i.e., the imaging quality of the ISP, the parameter settings of the ISP are evaluated, and when the ISP needs to be adjusted, the ISP will be adjusted according to the image analysis parameters, the human face image is obtained again to execute the adjustment operation of the same ISP, so that the dynamic adjustment of the ISP can be realized, the ISP is always in a state of being matched with the human face application, the real-time and accurate acquisition of the human face image is realized, the human face application is favorably ensured to acquire relatively stable high-quality human face input data, and the effectiveness and the safety of human face verification (such as entrance guard face brushing authentication and the like) are improved; and the ISP is adjusted in a self-adaptive manner according to the face imaging result, on the premise of not increasing the cost, the self-adjusting function of the ISP of the existing image acquisition equipment is fully utilized, and the ISP imaging effect of the existing image equipment is obviously improved.

In an optional embodiment, the image analysis parameter includes at least one of an exposure parameter of the face image, a white balance parameter of the face image, and a focusing parameter of the face image;

the first determining module 303 may include a first determining submodule, a second determining submodule, or a third determining submodule, where the first determining submodule includes an intercepting unit, an obtaining unit, a determining unit, and it should be noted that none of the submodules and the units are shown in corresponding drawings, where:

and the intercepting unit is used for intercepting the face image based on the determined calibration result corresponding to the face key point to obtain a target face area when the image analysis parameter is the exposure parameter of the face image, wherein the area of the target face area is smaller than that of the face image.

And the acquisition unit is used for acquiring a first brightness value corresponding to the target face area.

And the judging unit is used for judging whether the first brightness value is greater than or equal to a preset brightness value threshold value or not.

The determining unit is used for determining that the ISP corresponding to the image acquisition equipment needs to be adjusted when the judging unit judges that the first brightness value is greater than or equal to the preset brightness value threshold; alternatively, the first and second electrodes may be,

a second judgment sub-module, configured to determine, when the image analysis parameter is a white balance parameter of the face image, a mean value of each of three channels RGB of the target face region, and judge, according to all the mean values, whether proportion allocation of all the channels matches predetermined proportion allocation, and when a judgment result is negative, determine that an ISP corresponding to the image acquisition device needs to be adjusted; alternatively, the first and second electrodes may be,

and a third judging submodule, configured to, when the image analysis parameter is a focusing parameter of the face image, acquire a target position where the target face region appears in the image acquisition device, and judge whether the target position is within a predetermined position range, and when the judgment result is negative, determine that an ISP corresponding to the image acquisition device needs to be adjusted.

Therefore, the ISP self-adaptive adjustment control device based on the face image can also realize the judgment that the ISP needs to be adjusted under the condition of overexposure of the image acquisition equipment by acquiring the brightness value of the face image and comparing the brightness value with the preset brightness value, and/or judging whether the distribution of the RGB three channels of the face image is reasonable or not, and/or comparing the position of the acquired face image appearing in the image acquisition equipment with the predetermined position range; by providing a plurality of determination modes for the ISP to be adjusted, the accuracy and the flexibility of the judgment of the ISP to be adjusted can be improved; and before the brightness of the face image is obtained, the face image is further intercepted through a calibration result corresponding to the face key point, so that the determining efficiency and the accuracy of the brightness value of the face image can be improved, and the accuracy and the reliability of judging whether the ISP needs to be adjusted are improved.

In another optional embodiment, the obtaining unit is further configured to, when the determining unit determines that the first brightness value is not greater than or equal to a preset brightness value threshold, expand the effective area of the target face region according to a preset expansion manner, so as to obtain an expanded target face region, where the preset expansion manner is a manner set based on a center position of the target face region.

And the determining unit is further used for determining a second brightness value of the background area corresponding to the enlarged target face area.

And the acquisition unit is also used for calculating the backlight degree of the face image based on the first brightness value and the second brightness value.

And the judging unit is used for judging whether the inverse luminosity is less than or equal to a preset inverse luminosity threshold value or not, and triggering the determining unit to execute the operation of determining that the ISP corresponding to the image acquisition equipment needs to be adjusted when the inverse luminosity is less than or equal to the preset inverse luminosity threshold value.

Therefore, the ISP self-adaptive adjustment control device based on the face image can also determine that the ISP needs to be adjusted by calculating the brightness value of the corresponding background area after the face area is expanded when the brightness value of the face area is judged to be smaller, acquiring the backlight degree of the face image based on the two brightness values, and determining that the ISP needs to be adjusted when the backlight degree of the face image is determined to be smaller, so that the judgment that the ISP needs to be adjusted under the condition of insufficient exposure of the image acquisition equipment is improved, the determination accuracy that the ISP needs to be adjusted can be improved, the ISP omnibearing dynamic adjustment is facilitated, and the accuracy of the dynamic image acquired subsequently is facilitated.

In yet another alternative embodiment, the ISP adaptive adjustment and control apparatus based on a facial image may further include a second determining module 305, at this time, the ISP adaptive adjustment and control apparatus based on a facial image may be as shown in fig. 4, and fig. 4 is a schematic structural diagram of another ISP adaptive adjustment and control apparatus based on a facial image, where:

a second determining module 305, configured to determine whether the ISP needs to be adjusted according to the current state of the ISP before the obtaining module 301 obtains the face image collected by the image collecting device; when it is determined that the ISP needs to be adjusted, the acquiring module 301 is triggered to execute the above operation of acquiring the face image acquired by the image acquisition device.

In this optional embodiment, optionally, as shown in fig. 4, the second determining module 305 may include a reading sub-module 3051, an obtaining sub-module 3052, a calculating sub-module 3053, and a fourth determining sub-module 3054, where:

and the reading submodule 3051 is configured to read a target time currently displayed by the image processing system corresponding to the ISP.

The obtaining sub-module 3052 is configured to obtain a time when the adjustment of the ISP is completed last time.

The calculating submodule 3053 is configured to calculate an interval duration between the target time and the completion time.

The fourth determining submodule 3054 is configured to determine whether the interval duration is less than or equal to a predetermined interval duration threshold.

The obtaining sub-module 3052 is further configured to determine that the ISP needs to be adjusted when the fourth determining sub-module 3054 determines that the interval duration is less than or equal to the interval duration threshold.

It can be seen that, by implementing the ISP adaptive adjustment control apparatus based on the face image described in fig. 4, it can also be determined whether the ISP needs to be adjusted according to the current state of the ISP before the face image is acquired, and if the adjustment is needed, the operation of acquiring the face image can be executed, which can reduce the occurrence of the adjustment operation performed on the ISP under the condition that the ISP does not need to be adjusted, that is, each index (for example, white balance and the like) of the image acquisition device is matched with the current environment, and is beneficial to reducing the occurrence of the condition that the image acquisition device acquires the face image with poor quality due to the occurrence of the misadjustment of the ISP, reducing the power consumption of the system, and improving the service life of the system.

In yet another alternative embodiment, as shown in fig. 4, the obtaining sub-module 3052 is further configured to, after the fourth determining sub-module 3054 determines that the interval duration is less than or equal to the interval duration threshold and before it is determined that the ISP needs to be adjusted, obtain the total number of times of adjustment of the ISP within a first preset duration, where an expiration time of the first preset duration is a time when the ISP was adjusted last time.

The fourth determining submodule 3054 is further configured to determine whether the total adjustment time is smaller than a preset adjustment time threshold, and when it is determined that the total adjustment time is smaller than the preset adjustment time threshold, trigger the obtaining submodule 3052 to execute the operation of determining that the ISP needs to be adjusted.

It can be seen that, by implementing the ISP adaptive adjustment control device based on the face image described in fig. 4, when it is determined that the time for adjusting the ISP last time is short, and further when it is determined that the total number of times of adjusting the ISP in the current operation process of the image processing system is small, it is determined that the ISP needs to be adjusted, and the accuracy of determining that the ISP needs to be adjusted can be improved; and by limiting the total times of adjustment of the ISP in the current operation process of the system, the performance requirement of the ISP can be met and the system is suitable for complex environments, so that the user experience is improved.

In yet another alternative embodiment, as shown in fig. 4, the ISP adaptive adjustment control apparatus based on a facial image may further include a determining module 306 and a third determining module 307, where:

a determining module 306, configured to determine, after the obtaining module 301 obtains the face image collected by the image collecting device, and before the analyzing module 302 inputs the face image into a predetermined face image quality evaluation model for analysis, image parameters corresponding to the face image, where the image parameters include at least one of an area of the face image, a position of the face image appearing in the image collecting device, and face information of the face image, and the face information of the face image includes a position of a left virtual pupil, a position of a right virtual pupil, a position of a left mouth corner of the virtual mouth, a position of a right mouth corner of the virtual mouth, and a position of a virtual nose tip of the face image.

A third determining module 307, configured to determine whether the face image meets the predetermined adjustment condition of the ISP according to the image parameters, and when it is determined that the face image meets the adjustment condition of the ISP, trigger the analyzing module 302 to perform an operation of inputting the face image into a predetermined face image quality evaluation model for analysis.

It can be seen that, by implementing the ISP adaptive adjustment control apparatus based on the face image described in fig. 4, it can further determine whether the face image meets the adjustment condition of the ISP after the face image is acquired, and execute the subsequent operation when it is determined that the adjustment condition of the ISP is met, which can reduce the occurrence of an error in ISP adjustment caused by the fact that the face image does not meet the adjustment condition of the ISP but is used to adjust the ISP, and is beneficial to improving the accuracy of dynamic adjustment of the ISP and reducing the power consumption of the image processing system; when the adjustment condition of the ISP is judged not to be met, the operation of obtaining the face image is triggered again, so that the image meeting the adjustment condition of the ISP can be obtained, and dynamic adjustment of the ISP can be further facilitated.

In yet another alternative embodiment, as shown in fig. 4, the ISP adaptive adjustment control apparatus based on a facial image may further include a fourth determining module 308, where:

a fourth determining module 308, configured to determine, after the adjusting module 304 adjusts the ISP according to the image analysis parameter until the current parameter of the ISP meets a preset condition, and before the obtaining module 301 is triggered to execute the operation of obtaining the face image collected by the image collecting device again, whether the real-time display time of the image processing system corresponding to the ISP reaches an end time of a second preset time period, and when it is determined that the real-time display time reaches the end time of the second preset time period, the obtaining module 301 is triggered to execute the operation of obtaining the face image collected by the image collecting device again, where a start time of the second preset time period is a time at which the ISP needs to be adjusted.

It can be seen that, by implementing the ISP adaptive adjustment control device based on the face image described in fig. 4, it can also be determined whether the current time reaches the preset time or not after the ISP adjustment is completed, and if the current time reaches the preset time, the operation of obtaining the face image is executed again, so that the requirement that a certain time is required from the time when the parameters of the ISP are written into the register to the time when the parameters of the ISP take effect can be met, thereby reducing the occurrence of the situation that the subsequent direct reading of the image may damage the stability of the image processing system, and further ensuring the running stability of the image processing system.

Example four

Referring to fig. 5, fig. 5 is a schematic diagram illustrating another ISP adaptive adjustment control apparatus based on a face image according to an embodiment of the present invention. The apparatus described in fig. 5 may be applied to an image processing system, where the image processing system may be used to adjust an ISP, and the image processing system is built in a terminal device capable of acquiring a human face, where the terminal device includes a user terminal and/or an access control device. As shown in fig. 5, the ISP adaptive adjustment control apparatus based on a face image may include:

a memory 501 in which executable program code is stored;

a processor 502 coupled to a memory 501;

further, an input interface 503 and an output interface 504 coupled to the processor 502 may be included;

the processor 502 calls the executable program code stored in the memory 501 for executing the steps of the ISP adaptive adjustment control method based on the face image described in the first embodiment or the second embodiment.

EXAMPLE five

The embodiment of the invention discloses a computer-readable storage medium which stores a computer program for electronic data exchange, wherein the computer program enables a computer to execute the steps of the ISP self-adaptive adjustment control method based on the face image described in the first embodiment or the second embodiment.

EXAMPLE six

The embodiment of the invention discloses a computer program product, which comprises a non-transitory computer readable storage medium storing a computer program, wherein the computer program is operable to make a computer execute the steps of the ISP adaptive adjustment control method based on the face image described in the first embodiment or the second embodiment.

The above-described embodiments of the apparatus are merely illustrative, and the modules described as separate components may or may not be physically separate, and the components shown as modules may or may not be physical modules, may be located in one place, or may be distributed on a plurality of network modules. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.

Through the above detailed description of the embodiments, those skilled in the art will clearly understand that the embodiments may be implemented by software plus a necessary general hardware platform, and may also be implemented by hardware. Based on such understanding, the above technical solutions may be embodied in the form of a software product, which may be stored in a computer-readable storage medium, where the storage medium includes a Read-Only Memory (ROM), a Random Access Memory (RAM), a Programmable Read-Only Memory (PROM), an Erasable Programmable Read-Only Memory (EPROM), a One-time Programmable Read-Only Memory (OTPROM), an Electrically Erasable Programmable Read-Only Memory (EEPROM), a Compact Disc-Read-Only Memory (CD-ROM), or other disk memories, CD-ROMs, or other magnetic disks, A tape memory, or any other medium readable by a computer that can be used to carry or store data.

Finally, it should be noted that: the ISP adaptive adjustment control method and device based on face images disclosed in the embodiments of the present invention are only preferred embodiments of the present invention, and are only used for illustrating the technical solutions of the present invention, not for limiting the same; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those skilled in the art; the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. An ISP self-adaptive adjustment control method based on a face image is characterized by comprising the following steps:

2. The ISP adaptive adjustment control method based on the facial image according to claim 1, wherein the image analysis parameter comprises at least one of an exposure parameter of the facial image, a white balance parameter of the facial image, and a focusing parameter of the facial image;

3. The ISP adaptive adjustment control method based on the facial image as claimed in claim 2, wherein the method further comprises:

4. The ISP adaptive adjustment and control method based on the facial image as claimed in any one of claims 1 to 3, wherein before the facial image acquired by the image acquisition device is acquired, the method further comprises:

5. The ISP adaptive adjustment control method based on the facial image as claimed in claim 4, wherein after determining that the interval duration is less than or equal to the interval duration threshold and before the ISP is determined to need to be adjusted, the method further comprises:

6. The ISP adaptive adjustment and control method based on facial images as claimed in claim 1, 2, 3 or 5, wherein after the facial image acquired by the image acquisition device is acquired and before the facial image is input into a predetermined facial image quality evaluation model for analysis, the method further comprises:

7. The ISP adaptive adjustment and control method according to claim 1, 2, 3 or 5, wherein the ISP is adjusted according to the image analysis parameter until after a current parameter of the ISP satisfies a preset condition and before the operation of acquiring the facial image acquired by the image acquisition device is re-triggered, the method further comprises:

8. The ISP self-adaptive adjustment control device based on the face image is characterized by comprising an acquisition module, an analysis module, a first judgment module and an adjustment module, wherein:

9. An ISP (Internet service provider) self-adaptive adjustment control device based on a face image is characterized by comprising:

a memory storing executable program code;

a processor coupled with the memory;

the processor calls the executable program code stored in the memory to execute the ISP adaptive adjustment control method based on the facial image according to any one of claims 1-7.

10. A computer storage medium, characterized in that the computer storage medium stores computer instructions, which when called, are used for executing the ISP adaptive adjustment control method based on the face image according to any one of claims 1 to 7.