WO2022006739A1

WO2022006739A1 - Control method, control apparatus, and infrared camera

Info

Publication number: WO2022006739A1
Application number: PCT/CN2020/100637
Authority: WO
Inventors: 邓宝华; 袁田
Original assignee: 深圳市锐明技术股份有限公司
Priority date: 2020-07-07
Filing date: 2020-07-07
Publication date: 2022-01-13
Also published as: CN111937497B; CN111937497A

Abstract

The present application is applicable to the technical field of cameras. Provided are a control method, a control apparatus, and an infrared camera. The method comprises: detecting, in a turned-on state of an infrared lamp, whether an image collected by an infrared camera contains a human face to be evaluated; if the image collected by the infrared camera contains said human face, acquiring a human face area to be evaluated, with said human face area being the area of said human face; calculating, according to a preset relational expression, a target evaluation exposure amount corresponding to said human face area, wherein the relational expression is used for indicating the relationship between the area of the human face and the evaluation exposure amount; and determining, according to a first real-time exposure amount and the target evaluation exposure amount, whether to turn off the infrared lamp, wherein the first real-time exposure amount is a real-time exposure amount of a photosensitive element at the current moment. By means of the method, an infrared camera can automatically control an infrared lamp according to changes in an external environment, thereby reducing the power consumption of the infrared camera.

Description

A control method, control device and infrared camera

technical field

The present application belongs to the technical field of cameras, and in particular, relates to a control method, a control device, an infrared camera, and a computer-readable storage medium.

Background technique

With the rapid development of the automotive industry, it has become a trend to install infrared cameras in cars. In fact, many interactive functions in the car are closely related to infrared cameras, such as driver fatigue monitoring and identification. However, the current infrared cameras cannot automatically control the infrared lamps according to changes in the external environment (such as ambient illuminance).

technical problem

The current infrared camera cannot automatically control the infrared lamp according to the change of the external environment (such as the ambient illumination), which leads to an increase in the power consumption of the infrared camera.

technical solutions

In view of this, the present application provides a control method, a control device, an infrared camera and a computer-readable storage medium, which can enable the infrared camera to automatically control the infrared lamp according to changes in the external environment, thereby reducing the power consumption of the infrared camera.

In a first aspect, the present application provides a control method, which is applied to an infrared camera. The infrared camera includes an infrared lamp and a photosensitive element for receiving infrared light. The control method includes:

In the activated state of the above-mentioned infrared light, detecting whether the image collected by the above-mentioned infrared camera contains the face to be evaluated;

If the image collected by the above-mentioned infrared camera includes the face to be evaluated, the area of the face to be evaluated is obtained, and the above-mentioned area of the face to be evaluated is the area of the above-mentioned face to be evaluated;

Calculate the target evaluation exposure amount corresponding to the face area to be evaluated according to a preset relational expression, and the above relational expression is used to indicate the relationship between the face area and the evaluation exposure amount;

Whether to turn off the infrared lamp is determined according to the first real-time exposure amount and the target evaluation exposure amount, wherein the first real-time exposure amount is the real-time exposure amount of the photosensitive element at the current moment.

In a second aspect, the present application provides a control device, which is applied to an infrared camera. The infrared camera includes an infrared lamp and a photosensitive element for receiving infrared light. The control device includes:

a face detection unit, configured to detect whether the image collected by the infrared camera contains a face to be evaluated when the infrared lamp is activated;

a face area obtaining unit, configured to obtain the face area to be evaluated if the image collected by the infrared camera includes the face to be evaluated, and the area of the face to be evaluated is the area of the face to be evaluated;

An evaluation exposure calculation unit, used for calculating the target evaluation exposure amount corresponding to the above-mentioned face area to be evaluated according to a preset relational expression, and the above-mentioned relational expression is used to indicate the relationship between the area of the human face and the evaluation exposure amount;

The infrared lamp control unit is configured to determine whether to turn off the infrared lamp according to the first real-time exposure amount and the target evaluation exposure amount, wherein the first real-time exposure amount is the real-time exposure amount of the photosensitive element at the current moment.

In a third aspect, the present application provides an infrared camera, comprising an infrared lamp, a photosensitive element for receiving infrared light, a memory, a processor, and a computer program stored in the memory and running on the processor. When the computer executes the above computer program, the method provided by the above first aspect is implemented.

In a fourth aspect, the present application provides a computer-readable storage medium, where the computer-readable storage medium stores a computer program, and the computer program implements the method provided in the first aspect when the computer program is executed by a processor.

In a fifth aspect, the present application provides a computer program product that, when the computer program product runs on an infrared camera, enables the infrared camera to execute the method provided in the first aspect.

beneficial effect

As can be seen from the above, in the solution of the present application, when the infrared lamp is activated, it is first detected whether the image collected by the infrared camera contains the face to be evaluated. Face area, the above-mentioned face area to be evaluated is the area of the above-mentioned face to be evaluated, and then according to a preset relational formula, the target evaluation exposure amount corresponding to the above-mentioned face area to be evaluated is calculated, and the above-mentioned relational formula is used to indicate the face. The relationship between the area and the estimated exposure amount, and finally determine whether to turn off the infrared lamp according to the first real-time exposure amount and the target estimated exposure amount, wherein the first real-time exposure amount is the real-time exposure amount of the photosensitive element at the current moment. The solution of the present application establishes a relational expression between the area of the face and the estimated exposure in advance, and then calculates the target estimated exposure corresponding to the face area to be assessed through the relational expression, and compares the first real-time exposure at the current moment with the target estimated exposure. Exposure can evaluate the current environmental illumination, so that the infrared camera can automatically control the infrared lamp according to the changes of the external environment, and reduce the power consumption of the infrared camera on the basis of ensuring the image quality of the infrared camera.

Description of drawings

In order to illustrate the technical solutions in the embodiments of the present application more clearly, the following briefly introduces the accompanying drawings that need to be used in the description of the embodiments or the prior art. Obviously, the drawings in the following description are only for the present application. In some embodiments, for those of ordinary skill in the art, other drawings can also be obtained according to these drawings without any creative effort.

1 is a schematic flowchart of a control method provided by an embodiment of the present application;

2 is a schematic diagram of a rectangular frame provided by an embodiment of the present application;

3 is a schematic diagram of an image area provided by an embodiment of the present application;

4 is a structural block diagram of a control device provided by an embodiment of the present application;

FIG. 5 is a schematic structural diagram of an infrared camera provided by an embodiment of the present application.

Embodiments of the present invention

In the following description, for the purpose of illustration rather than limitation, specific details such as a specific system structure and technology are set forth in order to provide a thorough understanding of the embodiments of the present application. However, it will be apparent to those skilled in the art that the present application may be practiced in other embodiments without these specific details. In other instances, detailed descriptions of well-known systems, devices, circuits, and methods are omitted so as not to obscure the description of the present application with unnecessary detail.

It is to be understood that, when used in this specification and the appended claims, the term "comprising" indicates the presence of the described feature, integer, step, operation, element and/or component, but does not exclude one or more other The presence or addition of features, integers, steps, operations, elements, components and/or sets thereof.

It will also be understood that, as used in this specification and the appended claims, the term "and/or" refers to and including any and all possible combinations of one or more of the associated listed items.

As used in the specification of this application and the appended claims, the term "if" may be contextually interpreted as "when" or "once" or "in response to determining" or "in response to detecting ". Similarly, the phrases "if it is determined" or "if the [described condition or event] is detected" may be interpreted, depending on the context, to mean "once it is determined" or "in response to the determination" or "once the [described condition or event] is detected. ]" or "in response to detection of the [described condition or event]".

In addition, in the description of the specification of the present application and the appended claims, the terms "first", "second", "third", etc. are only used to distinguish the description, and should not be construed as indicating or implying relative importance.

References in this specification to "one embodiment" or "some embodiments" and the like mean that a particular feature, structure or characteristic described in connection with the embodiment is included in one or more embodiments of the present application. Thus, appearances of the phrases "in one embodiment," "in some embodiments," "in other embodiments," "in other embodiments," etc. in various places in this specification are not necessarily All refer to the same embodiment, but mean "one or more but not all embodiments" unless specifically emphasized otherwise. The terms "including", "including", "having" and their variants mean "including but not limited to" unless specifically emphasized otherwise.

Before further describing the present application in detail, a method for establishing the preset relational expression in the embodiment of the present application will be described first.

S1. It is necessary to determine the working current of the infrared lamp in a completely dark environment (no visible light and no infrared light). Specifically, the size of the working current of the infrared lamp needs to meet the following conditions: in a completely dark environment, when the infrared lamp works with the working current, the infrared lamp projects a certain intensity of infrared light. When the infrared camera is located at the farthest design distance for shooting, the certain intensity of infrared light will prevent the exposure of the photosensitive element from exceeding the maximum allowable exposure; when the infrared camera is located at the closest design distance for shooting, the certain intensity The infrared light makes the exposure of the photosensitive element not lower than the minimum allowable exposure. The farthest design distance is the farthest shooting distance for which the infrared camera is designed, and correspondingly, the shortest design distance is the shortest shooting distance for which the infrared camera is designed. The maximum allowable exposure amount is the maximum exposure amount that can guarantee the image quality, and the minimum allowable exposure amount is the minimum exposure amount that can guarantee the image quality. Specifically, the size of the maximum allowable exposure amount and the minimum allowable exposure amount can be obtained by testing with an infrared camera.

S2. Under the condition that the infrared lamp works with the working current in S1, the infrared camera batch collects the experimental data generated in the process of moving the face from the nearest design distance to the farthest design distance in a completely dark environment. The experimental data includes the human face. The facial features of the face and the exposure of the photosensitive element. For example, suppose the closest design distance of the infrared camera is 1 meter, and the farthest design distance is 2 meters, so that the face moves from 1 meter in front of the infrared camera to 2 meters in front of the lens; during this process, the infrared camera captures The facial feature information of the face in the obtained picture changes, and the exposure of the photosensitive element also changes; the experimental data can be obtained by collecting the facial feature information and the exposure of the photosensitive element when the face moves to each position. Optionally, the front face of the human face, the left face of the human face, and the right face of the human face can be moved from the nearest design distance to the farthest design distance, and then the front face is collected and moved from the nearest design distance to the farthest design distance. The experimental data generated in the process of distance, the experimental data generated in the process of moving the left face from the closest design distance to the farthest design distance, and the experimental data generated in the process of moving the right face from the closest design distance to the farthest design distance.

S3. It is necessary to calculate the area of the face according to the collected facial features information, and establish a corresponding relationship between the area of the face and the exposure amount of the photosensitive element. For example, the face is moved to the 1.5 meters in front of the lens of the infrared camera, an infrared camera to capture facial features information screen features for human face information _1.5, the exposure amount at this time is the amount of exposure of the photosensitive element _1.5, _1.5 is calculated according to information features The area of the face is _1.5 , _{and the corresponding relationship between the area 1.5} and the exposure _1.5 is established; when the face moves 1.8 meters in front of the lens of the infrared camera, the facial features of the face captured by the infrared camera are the facial features. Information _1.8 , at this time, the exposure of the photosensitive element is the exposure _1.8 , and the area of the face calculated according to the facial features information _1.8 _{is the area 1.8} , and the corresponding relationship between the _{area 1.8} and the exposure _{1.8 is established.}

S4. For the area of the face and the exposure amount of the photosensitive element obtained in S3, redundant data and invalid data need to be removed. Specifically, if the area of a certain face corresponds to the exposure amount of two or more photosensitive elements, the smallest exposure amount among the exposure amounts of the two or more photosensitive elements is retained, and the exposure amount of the two or more photosensitive elements is divided by the exposure amount. Exposures other than the smallest exposure (ie redundant data) are deleted. If the exposure amount of a certain photosensitive element exceeds the preset normal range, the exposure amount (invalid data) of the photosensitive element will be deleted. After removing redundant data and invalid data, a coordinate system is established with the area of the face as the abscissa and the exposure of the photosensitive element as the ordinate. Next, a coordinate point is determined in the coordinate system according to the area of each pair of corresponding faces and the exposure of the photosensitive element, and then nonlinear fitting is performed on each coordinate point to generate a fitting curve. Since the on and off states of the infrared lamps need to be controlled according to the established relationship in the future, in order to ensure that the infrared lamps will not be turned on and off frequently, it is necessary to shift the fitting curve downward to a certain extent. The curve equation corresponding to the curve is used as the preset relational expression obtained by establishment. It should be noted that if the translated fitting curve intersects the coordinate axis, it is necessary to re-determine the working current of the infrared lamp, that is, reduce the working current of the infrared lamp, and perform S2, S3 and S4 again.

It should be understood that the face mentioned in the establishment method of the above-mentioned preset relational expression is a face that does not wear a mask. The present application can also establish another relational expression through the above-mentioned S1, S2, S3 and S4 for the face wearing a mask, and this other relational expression is here called the relational expression of wearing a mask. The way of establishing the preset relational expression is the same, so the method of establishing the relational expression of wearing a mask will not be repeated.

FIG. 1 shows a flowchart of a control method provided by an embodiment of the present application. The control method is applied to an infrared camera. The infrared camera includes an infrared lamp and a photosensitive element for receiving infrared light. The details are as follows:

Step 101, in the activated state of the infrared lamp, detect whether the image collected by the infrared camera contains the face to be evaluated;

In the embodiment of the present application, the infrared camera may be installed in the vehicle. When the infrared light is activated (ie, the infrared light projects infrared light), the infrared camera will detect whether the currently collected image contains a face to be evaluated. The face to be evaluated can be any face, that is to say, as long as the image currently collected by the infrared camera contains any face, the face is determined as the face to be evaluated, and the image currently collected by the infrared camera is considered to be the face to be evaluated. contains the face to be evaluated. If the image currently collected by the infrared camera does not contain a face, it is considered that the image currently collected by the infrared camera does not contain the face to be evaluated.

Step 102, if the image collected by the infrared camera includes the face to be evaluated, obtain the area of the face to be evaluated;

In the embodiment of the present application, if the image currently collected by the infrared camera contains the face to be evaluated, the area of the face to be evaluated in the image currently collected by the infrared camera is acquired, and the area of the face to be evaluated is recorded as the face to be evaluated Assess face area.

Exemplarily, in order to obtain the area of the face to be evaluated, the facial feature information of the face to be evaluated can be obtained first, and then the area of the face to be evaluated is calculated according to the facial feature information of the face to be evaluated to obtain the area of the face to be evaluated. For example, the eyebrows, eyes, mouth, nose and ears of the face to be evaluated can be identified from the images currently collected by the infrared camera through target detection, and a rectangular frame for selecting the eyebrows, eyes, mouth, nose and ears can be obtained, and then according to The rectangular box calculates the face area to be evaluated.

Optionally, the facial features information includes the coordinates of the facial features. In the embodiment of the present application, it can be determined according to the coordinates of the facial features of the face to be evaluated and the preset facial proportion (that is, the facial proportion of a normal human face, which belongs to prior knowledge). A rectangular box for selecting faces to be evaluated, see Figure 2 for details. Since the rectangular frame is the circumscribing rectangle of the face to be evaluated, the area of the rectangular frame will be larger than the area of the face to be evaluated. In order to obtain the face area to be evaluated, the image in the rectangular frame can be divided into at least two image areas, wherein the area of each image area is equal; then all the highlighted image areas in the at least two image areas are Determined, please refer to Figure 3 for details. Each square in the rectangular frame in Figure 3 represents an image area, and the black square is the highlighted image area; it can be seen that in the highlighted image area It includes a connected domain, which consists of several highlighted image regions. Since the area of each image region is equal, the connected domain can be obtained by multiplying the area of the image region by the number of highlighted image regions in the connected domain. area. Finally, the area of the connected domain can be used as the face area to be evaluated.

For example, the image in the rectangular box in Fig. 3 is divided into 40 image areas. Among the 40 image areas, 13 highlighted image areas (ie 13 black squares) are included. In the area, there are 2 highlighted image areas that do not belong to the connected domain and 11 highlighted image areas that belong to the connected domain. Assuming that the area of each image area is 2cm ² , the area of the connected domain is the area of one image area. The area of 2 cm ² multiplied by the number of highlighted image regions belonging to the connected domain 11 equals ²² cm 2 . It should be understood that FIG. 3 is only an example, and does not limit the present application in any way.

Exemplarily, in order to determine the highlighted image areas in at least two image areas, the average brightness of each image area may be calculated first, for example, for any image area, the average brightness of all pixel points in the image area may be calculated. value to get the average brightness of the image area. At the same time, it is also necessary to use an adaptive threshold algorithm to calculate the corresponding high-brightness threshold for the image in the rectangular frame. Finally, the average brightness of each image area is compared with the high-brightness threshold. For any image area, if the average brightness of the image area is higher than the high-brightness threshold, the image area is determined as a high-brightness image area. .

Step 103, according to the preset relational formula, calculate the target evaluation exposure amount corresponding to the face area to be evaluated;

In the embodiment of the present application, the preset relational expression is established through the above steps S1, S2, S3 and S4, and the preset relational expression is used to indicate the area of the face (face without a mask) and the estimated exposure amount The relationship between. After obtaining the face area to be assessed, the face area to be assessed is substituted into the preset relational expression for calculation, and the obtained calculation result is the estimated exposure amount corresponding to the face area to be assessed. The evaluation exposure corresponding to the face area is recorded as the target evaluation exposure.

Optionally, if a mask wearing relationship is also established through the above steps S1, S2, S3 and S4, before the above step 103, it is also necessary to detect whether the face to be evaluated wears a mask. Based on this, if it is detected that the face to be assessed is wearing a mask, the face area to be assessed will be substituted into the mask wearing relationship for calculation, and the calculation result will be used as the target assessment exposure corresponding to the face area to be assessed. Among them, the mask-wearing relationship is used to indicate the relationship between the area of the face (face with a mask) and the estimated exposure. Correspondingly, if it is detected that the face to be evaluated does not wear a mask, the target evaluation exposure amount corresponding to the area of the face to be evaluated is still calculated according to the preset relational expression.

Step 104: Determine whether to turn off the infrared lamp according to the first real-time exposure amount and the target estimated exposure amount.

In the embodiment of the present application, the first real-time exposure amount is the real-time exposure amount of the photosensitive element at the current moment, wherein the photosensitive element belongs to a monochromatic photosensitive element and only receives infrared light. Specifically, when the infrared lamp is activated, the photosensitive element will receive the infrared light in the natural light and the infrared light projected by the infrared lamp (belonging to narrow-wave infrared light), and the infrared light projected by the infrared lamp is the main component. In the off state of the infrared lamp (that is, the infrared lamp does not project infrared light), the photosensitive element will receive infrared light in natural light (belonging to broadband infrared light), and the infrared light in natural light is the main component. After the target evaluation exposure amount is calculated, whether to turn off the infrared lamp can be determined according to the first real-time exposure amount and the target evaluation exposure amount.

Exemplarily, the first real-time exposure can be compared with the target estimated exposure, and if the first real-time exposure is greater than or equal to the target estimated exposure, the infrared lamp is not turned off, that is, the infrared lamp continues to be on; If the real-time exposure is less than the target evaluation exposure, it means that the proportion of infrared light in the natural light is higher than the infrared light projected by the infrared light in the light received by the photosensitive element. At this time, the infrared light can be turned off.

Optionally, it is also possible to periodically detect whether the first real-time exposure amount is less than the target estimated exposure amount within a predetermined period of time. The infrared light will be turned off only when the first real-time exposure amount is less than the target evaluation exposure amount within the predetermined time period. For example, if at time t1, the first real-time exposure 1 is less than the target estimated exposure 1, and at time t2, the first real-time exposure 2 is less than the target estimated exposure 2, then turn off the infrared light; if at t1, the first The real-time exposure amount 1 is less than the target evaluation exposure amount 1, and at time t2, the first real-time exposure amount 2 is greater than the target evaluation exposure amount 2, and the infrared lamp is not turned off.

Optionally, after the above step 101, it also includes:

If the image collected by the infrared camera does not contain the face to be evaluated, it is determined whether to turn off the infrared lamp according to the first real-time exposure amount and the preset extreme value evaluation exposure amount.

In the embodiment of the present application, if the image currently collected by the infrared camera does not contain the face to be evaluated, the first real-time exposure is compared with the preset extreme value evaluation exposure, where the extreme value evaluation exposure may be The maximum estimated exposure calculated according to the preset relational expression, for example, the extreme estimated exposure is the estimated exposure corresponding to the area of the face in the image collected by the infrared camera when the face is located at the closest design distance of the infrared camera. If the first real-time exposure amount is greater than or equal to the extreme value evaluation exposure amount, the infrared lamp is not turned off; if the first real-time exposure amount is less than the extreme value evaluation exposure amount, the infrared lamp is turned off.

Optionally, after the infrared lamp is turned off, the infrared lamp will be in an off state, and in the off state of the infrared lamp, the infrared camera can obtain the second real-time exposure amount, wherein the second real-time exposure amount is the real-time exposure of the photosensitive element at the current moment. Then, according to the second real-time exposure amount and the preset underexposure threshold, it can be determined whether to activate the infrared lamp. Specifically, the second real-time exposure can be compared with the under-exposure threshold. If the second real-time exposure is less than the under-exposure threshold, it means that the image currently collected by the infrared camera is under-exposed, and at this time, the infrared light will be activated; If the second real-time exposure amount is greater than or equal to the under-exposure threshold, the infrared light will not be activated, that is, the infrared light will continue to be turned off.

Optionally, since the infrared light may be turned on and off frequently, in order to avoid this situation, during the working process of the infrared camera, the number of times the infrared light is turned on and the number of times the infrared light is turned off can be counted within a predetermined period of time. Then, the number of times the infrared lamp is turned on and the number of times of closing the infrared lamp are summed to obtain the total number of switches, wherein the predetermined time period is the time period with the current moment as the cut-off moment and the time span as the preset duration. For example, assuming that the current time is 3 minutes and 16 seconds and the preset duration is 15 seconds, the predetermined time period is 3 minutes and 1 second to 3 minutes and 16 seconds. After the total number of switches is obtained, the total number of switches can be compared with a preset upper limit of the number of times, and if the total number of switches reaches the upper limit of the number of times, the preset relational expression will be corrected. Specifically, the preset relational expression can be corrected according to a preset correction principle, and the correction principle is that the curve corresponding to the corrected relational expression (that is, the curve that can represent the corrected relational expression in the coordinate system) will not form convex hull. It should be understood that the revised relational expression is used for the next calculation of the target evaluation exposure amount corresponding to the face area to be evaluated.

It should be understood that the size of the sequence numbers of the steps in the above embodiments does not mean the sequence of execution, and the execution sequence of each process should be determined by its function and internal logic, and should not constitute any limitation to the implementation process of the embodiments of the present application.

FIG. 4 shows a schematic structural diagram of a control device provided by an embodiment of the present application. The control device is applied to an infrared camera. The infrared camera includes an infrared lamp and a photosensitive element for receiving infrared light. For convenience of description, only the Parts related to the embodiments of the present application are described.

The control device 400 includes:

A face detection unit 401, configured to detect whether the image collected by the infrared camera contains a face to be evaluated under the activation state of the infrared lamp;

A face area obtaining unit 402, configured to obtain the face area to be evaluated if the image collected by the infrared camera includes the face to be evaluated, and the area of the face to be evaluated is the area of the face to be evaluated;

The evaluation exposure calculation unit 403 is used to calculate the target evaluation exposure amount corresponding to the above-mentioned face area to be evaluated according to a preset relational expression, and the above-mentioned relational expression is used to indicate the relationship between the area of the human face and the evaluation exposure amount;

The infrared lamp control unit 404 is configured to determine whether to turn off the infrared lamp according to the first real-time exposure amount and the target evaluation exposure amount, wherein the first real-time exposure amount is the real-time exposure amount of the photosensitive element at the current moment.

Optionally, the above-mentioned face area obtaining unit 402 further includes:

The facial features information acquisition subunit is configured to acquire the facial features information of the above-mentioned face to be evaluated if the image collected by the above-mentioned infrared camera includes the face to be evaluated;

The first face area obtaining subunit is used to obtain the above-mentioned face area to be evaluated according to the above-mentioned facial feature information.

Optionally, the above-mentioned facial features information includes the coordinates of facial features, and the above-mentioned first face area acquisition subunit further includes:

a rectangular frame determination subunit, used for determining a rectangular frame for frame selection of the above-mentioned face to be evaluated according to the coordinates of the above-mentioned facial features and a preset face ratio;

a rectangular frame dividing subunit, used for dividing the image in the above-mentioned rectangular frame into at least two image areas;

a highlight area determination subunit, configured to determine a highlight image area in the at least two image areas;

The second face area acquisition subunit is configured to use the area of the connected domain in the highlighted image area as the face area to be evaluated.

Optionally, the above-mentioned highlight area determination subunit further includes:

a brightness calculation subunit, used to calculate the average brightness of each image area;

a brightness threshold calculation subunit, used for calculating a corresponding high brightness threshold for the image in the above-mentioned rectangular frame with an adaptive threshold algorithm;

The threshold determination highlight subunit is used to determine an image area whose average brightness is higher than the aforementioned high brightness threshold as a highlight image area.

Optionally, the above-mentioned infrared lamp control unit 404 is further configured to determine whether to close the above-mentioned according to the above-mentioned first real-time exposure amount and the preset extreme value evaluation exposure amount if the image collected by the above-mentioned infrared camera does not contain the face to be evaluated. Infrared light.

Optionally, the above-mentioned infrared lamp control unit 404 is further configured to determine whether to activate the above-mentioned infrared lamp according to the second real-time exposure amount and the preset under-exposure threshold when the above-mentioned infrared lamp is turned off, wherein the above-mentioned second real-time exposure The amount is the real-time exposure amount of the above-mentioned photosensitive element at the current moment.

Optionally, the above-mentioned control device 400 further includes:

The number of times counting unit is used to count the sum of the number of times of starting the above-mentioned infrared lamps and the times of turning off the above-mentioned infrared lamps within a predetermined period of time, to obtain the total number of switches, and the above-mentioned predetermined period of time is a preset time period with the current moment as the cut-off time. ;

The relational expression correction unit is configured to correct the above-mentioned relational expression if the total number of times of switching reaches a preset upper limit of the number of times.

FIG. 5 is a schematic structural diagram of an infrared camera provided by an embodiment of the present application. As shown in FIG. 5 , the infrared camera 5 of this embodiment includes: at least one processor 50 (only one is shown in FIG. 5 ), a memory 51 , which is stored in the above-mentioned memory 51 and can run on the above-mentioned at least one processor 50 The computer program 52, the infrared lamp 53 and the photosensitive element 54 for receiving infrared light, the above-mentioned processor 50 implements the following steps when executing the above-mentioned computer program 52:

Assuming that the above is the first possible implementation manner, in the second possible implementation manner provided on the basis of the first possible implementation manner, if the above-mentioned image collected by the infrared camera includes the face to be evaluated, then Obtain the face area to be evaluated, including:

If the image collected by the above-mentioned infrared camera includes the face to be evaluated, obtain the facial feature information of the above-mentioned face to be evaluated;

According to the above-mentioned facial features information, the above-mentioned face area to be evaluated is obtained.

In the third possible implementation manner provided on the basis of the above-mentioned second possible implementation manner, the above-mentioned facial features information includes the coordinates of the facial features, and the above-mentioned obtaining the above-mentioned face area to be evaluated according to the above-mentioned facial feature information includes:

According to the coordinates of the above-mentioned facial features and the preset face ratio, determine a rectangular frame for selecting the above-mentioned face to be evaluated;

dividing the image in the above-mentioned rectangular frame into at least two image areas;

determining a highlighted image area in the at least two image areas;

The area of the connected domain in the above highlighted image area is taken as the above face area to be evaluated.

In the fourth possible implementation manner provided on the basis of the above-mentioned third possible implementation manner, the above-mentioned determination of the highlighted image area in the above-mentioned at least two image areas includes:

Calculate the average brightness of each image area;

Use the adaptive threshold algorithm to calculate the corresponding high-brightness threshold for the image in the above-mentioned rectangular frame;

An image area whose average brightness is higher than the above-mentioned high-brightness threshold is determined as a high-brightness image area.

Based on the above-mentioned first possible implementation manner, or the above-mentioned second possible implementation manner as a basis, or the above-mentioned third possible implementation manner as a basis, or the above-mentioned fourth possible implementation manner In a fifth possible implementation manner, after the above-mentioned detection of whether the image collected by the above-mentioned infrared camera contains a face to be evaluated, the above-mentioned processor 50 implements the following steps when executing the above-mentioned computer program 52:

If the image collected by the infrared camera does not contain the face to be evaluated, then whether to turn off the infrared lamp is determined according to the first real-time exposure amount and the preset extreme value evaluation exposure amount.

Based on the above-mentioned first possible implementation manner, or the above-mentioned second possible implementation manner as a basis, or the above-mentioned third possible implementation manner as a basis, or the above-mentioned fourth possible implementation manner In a sixth possible implementation manner, when the above-mentioned processor 50 executes the above-mentioned computer program 52, the following steps are implemented:

In the off state of the infrared lamp, whether to activate the infrared lamp is determined according to a second real-time exposure amount and a preset underexposure threshold, wherein the second real-time exposure amount is the real-time exposure amount of the photosensitive element at the current moment.

Based on the above-mentioned first possible implementation manner, or the above-mentioned second possible implementation manner as a basis, or the above-mentioned third possible implementation manner as a basis, or the above-mentioned fourth possible implementation manner In a seventh possible implementation manner, the processor 50 implements the following steps when executing the computer program 52:

Counting the sum of the number of times of starting the above-mentioned infrared lamps and the times of turning off the above-mentioned infrared lamps within a predetermined time period to obtain the total number of switches, and the above-mentioned predetermined time period is a time period of a preset duration with the current moment as the cut-off time;

If the above-mentioned total number of times of switching reaches the preset upper limit of the times, the above-mentioned relational expression is corrected.

The above infrared camera may include, but is not limited to, the processor 50 and the memory 51 . Those skilled in the art can understand that FIG. 5 is only an example of the infrared camera 5, and does not constitute a limitation on the infrared camera 5, and may include more or less components than the one shown, or combine some components, or different components , for example, may also include input and output devices, network access devices, and the like.

The so-called processor 50 may be a central processing unit (Central Processing Unit, CPU), and the processor 50 may also be other general-purpose processors, digital signal processors (Digital Signal Processors) Processor, DSP), application-specific integrated circuits (Application Specific Integrated Circuit, ASIC), off-the-shelf Programmable Gate Array (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.

The above-mentioned memory 51 may be an internal storage unit of the above-mentioned infrared camera 5 in some embodiments, such as a hard disk or a memory of the infrared camera 5 . In other embodiments, the above-mentioned memory 51 may also be an external storage device of the above-mentioned infrared camera 5, for example, a plug-in hard disk equipped on the above-mentioned infrared camera 5, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital) , SD) card, flash memory card (Flash Card), etc. Further, the above-mentioned memory 51 may also include both the internal storage unit of the above-mentioned infrared camera 5 and an external storage device. The above-mentioned memory 51 is used to store an operating system, an application program, a boot loader (Boot Loader), data, and other programs, for example, program codes of the above-mentioned computer programs. The above-mentioned memory 51 can also be used to temporarily store data that has been output or is to be output.

It should be noted that the information exchange, execution process and other contents between the above-mentioned devices/units are based on the same concept as the method embodiments of the present application. For specific functions and technical effects, please refer to the method embodiments section. It is not repeated here.

Those skilled in the art can clearly understand that, for the convenience and simplicity of description, only the division of the above-mentioned functional units and modules is used as an example for illustration. In practical applications, the above-mentioned functions can be allocated to different functional units, The module is completed, that is, the internal structure of the above-mentioned apparatus is divided into different functional units or modules, so as to complete all or part of the functions described above. Each functional unit and module in the embodiment may be integrated in one processing unit, or each unit may exist physically alone, or two or more units may be integrated into one unit, and the above-mentioned integrated units may adopt hardware. It can also be realized in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing from each other, and are not used to limit the protection scope of the present application. For the specific working process of the units and modules in the above-mentioned system, reference may be made to the corresponding process in the foregoing method embodiments, which will not be repeated here.

An embodiment of the present application further provides a computer-readable storage medium, where the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, implements the steps in each of the foregoing method embodiments.

The embodiments of the present application provide a computer program product, when the computer program product is run on an infrared camera, the infrared camera is made to perform the steps in the foregoing method embodiments.

If the above-mentioned integrated units are implemented in the form of software functional units and sold or used as independent products, they may be stored in a computer-readable storage medium. Based on this understanding, the present application realizes all or part of the processes in the methods of the above-mentioned embodiments, which can be completed by instructing the relevant hardware through a computer program, and the above-mentioned computer program can be stored in a computer-readable storage medium, and the computer program is in When executed by the processor, the steps of each of the above method embodiments can be implemented. Wherein, the above-mentioned computer program includes computer program code, and the above-mentioned computer program code may be in the form of source code, object code form, executable file or some intermediate form. The above-mentioned computer-readable medium may include at least: any entity or device capable of carrying computer program codes to the infrared camera, recording medium, computer memory, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), electrical carrier signals, telecommunication signals, and software distribution media. For example, U disk, mobile hard disk, disk or CD, etc. In some jurisdictions, under legislation and patent practice, computer readable media may not be electrical carrier signals and telecommunications signals.

In the foregoing embodiments, the description of each embodiment has its own emphasis. For parts that are not described or described in detail in a certain embodiment, reference may be made to the relevant descriptions of other embodiments.

Those of ordinary skill in the art can realize that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Skilled artisans may implement the described functionality using different methods for each particular application, but such implementations should not be considered beyond the scope of this application.

In the embodiments provided in this application, it should be understood that the disclosed apparatus/network device and method may be implemented in other manners. For example, the apparatus/network device embodiments described above are only illustrative. For example, the division of the above modules or units is only a logical function division. In actual implementation, there may be other division methods, such as multiple units or Components may be combined or may be integrated into another system, or some features may be omitted, or not implemented. On the other hand, the shown or discussed mutual coupling or direct coupling or communication connection may be through some interfaces, indirect coupling or communication connection of devices or units, and may be in electrical, mechanical or other forms.

The above-mentioned units described as separate components may or may not be physically separated, and components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution in this embodiment.

The above embodiments are only used to illustrate the technical solutions of the present application, but not to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: The recorded technical solutions are modified, or some technical features thereof are equivalently replaced; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the application, and should be included in the application. within the scope of protection.

Claims

A control method, characterized in that it is applied to an infrared camera, the infrared camera includes an infrared lamp and a photosensitive element for receiving infrared light, and the control method includes:

In the activated state of the infrared light, detecting whether the image collected by the infrared camera contains the face to be evaluated;

If the image collected by the infrared camera includes the face to be evaluated, the area of the face to be evaluated is obtained, and the area of the face to be evaluated is the area of the face to be evaluated;

Calculate the target evaluation exposure amount corresponding to the face area to be evaluated according to a preset relational expression, and the relational expression is used to indicate the relationship between the area of the human face and the evaluation exposure amount;

Whether to turn off the infrared lamp is determined according to the first real-time exposure amount and the target estimated exposure amount, wherein the first real-time exposure amount is the real-time exposure amount of the photosensitive element at the current moment.
The control method according to claim 1, wherein, if the image collected by the infrared camera includes a face to be evaluated, obtaining the area of the face to be evaluated includes:

If the image collected by the infrared camera includes the face to be evaluated, obtain the facial features information of the face to be evaluated;

According to the facial features information, the face area to be evaluated is obtained.
The control method according to claim 2, wherein the facial features information includes coordinates of facial features, and obtaining the face area to be evaluated according to the facial feature information includes:

According to the coordinates of the facial features and a preset face ratio, determine a rectangular frame for frame selection of the face to be evaluated;

dividing the image in the rectangular frame into at least two image areas;

determining a highlighted image area in the at least two image areas;

The area of the connected domain in the highlighted image area is taken as the face area to be evaluated.
The control method according to claim 3, wherein the determining a highlighted image area in the at least two image areas comprises:

Calculate the average brightness of each image area;

Using an adaptive threshold algorithm to calculate a corresponding high-brightness threshold for the image in the rectangular frame;

An image region whose average brightness is higher than the high brightness threshold is determined as a highlight image region.
The control method according to any one of claims 1 to 4, wherein after detecting whether the image collected by the infrared camera contains a face to be evaluated, the control method further comprises:

If the image collected by the infrared camera does not contain the face to be evaluated, it is determined whether to turn off the infrared lamp according to the first real-time exposure amount and the preset extreme value evaluation exposure amount.
The control method according to any one of claims 1 to 4, wherein the control method further comprises:

In the off state of the infrared lamp, whether to activate the infrared lamp is determined according to a second real-time exposure amount and a preset underexposure threshold, wherein the second real-time exposure amount is the real-time exposure of the photosensitive element at the current moment. exposure.
The control method according to any one of claims 1 to 4, wherein the control method further comprises:

Counting the sum of the number of times of starting the infrared light and the number of times of turning off the infrared light within a predetermined time period to obtain the total number of switches, and the predetermined time period is a time period of a preset duration with the current time as the cut-off time;

If the total number of switches reaches a preset upper limit of the number of times, the relational expression is corrected.
A control device, characterized in that it is applied to an infrared camera, the infrared camera includes an infrared lamp and a photosensitive element for receiving infrared light, and the control device includes:

a face detection unit, configured to detect whether the image collected by the infrared camera contains a face to be evaluated when the infrared lamp is activated;

a face area obtaining unit, configured to obtain the face area to be assessed if the image collected by the infrared camera includes the face to be assessed, and the face area to be assessed is the area of the face to be assessed;

An evaluation exposure calculation unit, configured to calculate the target evaluation exposure amount corresponding to the face area to be evaluated according to a preset relational expression, and the relational expression is used to indicate the relationship between the area of the human face and the evaluation exposure amount;

An infrared lamp control unit, configured to determine whether to turn off the infrared lamp according to a first real-time exposure amount and the target evaluation exposure amount, wherein the first real-time exposure amount is the real-time exposure amount of the photosensitive element at the current moment.
An infrared camera, comprising an infrared lamp, a photosensitive element for receiving infrared light, a memory, a processor, and a computer program stored in the memory and running on the processor, characterized in that the processor A method as claimed in any one of claims 1 to 7 is implemented when the computer program is executed.
A computer-readable storage medium storing a computer program, characterized in that, when the computer program is executed by a processor, the method according to any one of claims 1 to 7 is implemented.