WO2022121243A1

WO2022121243A1 - Calibration method and apparatus, and electronic device, storage medium, and program product

Info

Publication number: WO2022121243A1
Application number: PCT/CN2021/096072
Authority: WO
Inventors: 张国庆; 张弼坤; 丁诚诚; 林佩材
Original assignee: 北京市商汤科技开发有限公司
Priority date: 2020-12-07
Filing date: 2021-05-26
Publication date: 2022-06-16
Also published as: TW202223739A; CN112529947B; CN112529947A

Abstract

Disclosed in the present application are a calibration method and apparatus, and an electronic device, a storage medium, and a program product. The method comprises: in response to a received calibration trigger instruction, entering a calibration user interface, the calibration user interface comprising a thermal infrared image and a first face contour box; in response to the fact that an operation instruction of moving the first face contour box is received, moving the first face contour box according to the operation instruction; and when the first face contour box coincides with a first face area in the thermal infrared image, outputting calibration completion information.

Description

Calibration method and device, electronic equipment, storage medium and program product

CROSS-REFERENCE TO RELATED APPLICATIONS

The present disclosure is based on the Chinese patent application with the application number of 202011420092.0, the application date of December 7, 2020, and the application name of "calibration method and device, electronic equipment and storage medium", and claims the priority of the Chinese patent application, the The entire contents of the Chinese patent application are hereby incorporated by reference into the present disclosure.

technical field

The present application relates to the field of computer vision technology, and in particular, to a calibration method and apparatus, electronic equipment, storage medium and program product.

Background technique

Binocular stereo vision is an important form of machine vision, which is based on the principle of parallax and uses an imaging device to obtain two images of the object to be measured (hereinafter referred to as binocular images) from different positions.

In some application scenarios, it is necessary to determine the pixel area corresponding to the same object from the binocular image, and when there is parallax between the binocular images, the accuracy of determining the pixel area corresponding to the same object from the binocular image Low. Therefore, how to calibrate the disparity between binocular images is of great significance.

SUMMARY OF THE INVENTION

The present application provides a calibration method and device, an electronic device, a storage medium and a program product.

The application provides a calibration method, the method includes:

In response to the received calibration trigger instruction, enter a calibration user interface, where the calibration user interface includes a thermal infrared image and a first face contour frame;

In response to receiving an operation instruction for moving the first human face outline frame, move the first human face outline frame according to the operation instruction;

When the first face contour frame coincides with the first face region in the thermal infrared image, the calibration completion information is output.

In conjunction with any embodiment of the present application, the method further includes:

In response to receiving the instruction that the calibration is completed, display the coincidence result of the first face contour frame and the first face region in the calibration user interface, wherein the coincidence result includes but is not limited to the coincidence degree, The forehead area of the human face.

In this way, displaying the face forehead area in the calibration user interface enables the user to know the degree of coincidence between the forehead area in the face frame and the forehead area in the thermal infrared image. In this way, it is more beneficial to improve the accuracy of body temperature obtained based on thermal infrared images and visible light images.

With reference to any embodiment of the present application, before displaying the coincidence result of the first face contour frame and the first face region in the calibration user interface, the method further includes:

Obtain visible light images;

Performing face recognition processing on the visible light image to obtain the position of the reference pixel point area in the visible light image; the reference pixel point area is the area corresponding to the first face area in the visible light image;

According to the reference parallax and the position of the reference pixel area in the visible light image, determine the position of the first face region in the thermal infrared image; the reference parallax is the visible light image and the thermal infrared image. Parallax between infrared images;

According to the position and termination position of the first face region in the thermal infrared image, the overlapping result of the first face contour frame and the first face region is obtained; wherein, the termination position is the the position of the first face contour frame in the calibration user interface.

In this way, the reference parallax is the parallax between the visible light image and the thermal infrared image. The calibration device can determine the position of the first face region in the thermal infrared image according to the reference parallax and the position of the reference pixel point region in the visible light image. The calibration device can determine the area coincidence degree between the first face contour frame and the first face region in the thermal infrared image according to the position and termination position of the first face region in the thermal infrared image, as the coincidence result.

With reference to any embodiment of the present application, in response to receiving an operation instruction for moving the first face contour frame, moving the first face contour frame according to the operation instruction includes:

In the case of detecting the movement instruction of the object sliding on the user interface, the first face contour frame is moved along the sliding direction of the object on the user interface.

In this way, when the calibration device detects the movement instruction, the first face contour frame can be moved along the sliding direction of the object on the user interface.

With reference to any embodiment of the present application, the calibration method is applied to a calibration device;

Before moving the first face contour frame according to the operation instruction in response to receiving the operation instruction for moving the first face contour frame, the method further includes:

Displaying at least one virtual direction button in the calibration user interface; the at least one virtual direction button includes at least one of the following: an up virtual button, a down virtual button, a left virtual button, and a right virtual button;

The moving the first human face outline frame according to the operation instruction in response to receiving the operation instruction for moving the first human face outline frame includes:

When it is detected that an object touches the at least one virtual direction button through the screen of the calibration device, the face frame is moved according to the direction indicated by the touched virtual direction button.

In this way, the user can control the movement of the first face contour frame by touching the virtual direction button, so that the first face contour frame and the first face area in the thermal infrared image are overlapped.

In combination with any of the embodiments of the present application, the first face contour frame is obtained according to at least one reference first face contour frame; the at least one reference first face contour frame is obtained by performing face analysis on at least one face image. The acquisition conditions of the at least one face image are all actual acquisition conditions; and the actual acquisition conditions are image acquisition conditions under the application environment of the calibration device.

In this way, in the case where the acquisition conditions of at least one face image are the same as the actual acquisition conditions, the first face contour frame obtained according to the at least one first face contour frame is compared with the calibration device under the actual acquisition conditions for the human face The first face contour frame obtained by shooting is closer, thereby improving the calibration accuracy between the visible light image and the thermal infrared image.

In the case of receiving an instruction to reset the first human face outline frame, the first human face outline frame is reset to an initial position.

In this way, the user can return the first face contour frame to the initial position by inputting an instruction to reset the first face contour frame to the calibration device.

With reference to any embodiment of the present application, the first face contour frame includes at least one face key point;

The overlapping of the first face contour frame with the first face region in the thermal infrared image includes: the first face contour frame and the boundary of the first face region overlapping and the at least one face The key points coincide with the corresponding face key points in the first face region.

In this way, when judging whether the first face contour frame coincides with the first face area in the thermal infrared image, the user can not only check whether the face contour in the first face contour frame coincides with the boundary of the first face area As a judgment basis, whether at least one face key point in the first face outline frame and a corresponding face key point in the first face area overlap can also be used as a judgment basis.

With reference to any embodiment of the present application, the calibration user interface further includes a second display area different from the first area, and the method further includes:

A preview image of the overlapping effect between the first human face outline frame and the first human face area is displayed in the second display area; the overlapping effect preview image includes the second human face outline frame and the second human face. The overlapping effect diagram of the face area; the temperature measurement area is marked in the second face contour frame; the position of the second face contour frame in the second display area and the first face contour frame are in The positions in the first display area correspond; the second face area corresponds to the first face area.

In this way, the second face area corresponds to the first face area, that is, in the overlap effect preview image, the second face area is the preview image of the first face area, and in the process of moving the first face outline frame, The position of the temperature measurement area is displayed through the overlay effect preview. In this way, the user can know which part of the temperature measurement object is to be measured by the thermal infrared imaging device when collecting the thermal infrared image.

With reference to any of the embodiments of the present application, in the case that the first face contour frame is coincident with the first face region in the thermal infrared image, before outputting the calibration completion information, the method further includes:

in response to receiving an enlargement instruction for the thermal infrared image and the first face frame, enlarging the thermal infrared image and the first face frame according to the enlargement instruction;

In response to receiving a zoom-out instruction for the thermal infrared image and the first face frame, the thermal infrared image and the first face frame are enlarged according to the zoom-out instruction.

In this way, the user can better observe the overlapping effect between the first face frame and the first face region by inputting a zoom-in command or a zoom-out command to the calibration device.

In some embodiments, the present application also provides a calibration device, the calibration device comprising:

a first processing unit, configured to enter a calibration user interface in response to the received calibration trigger instruction, and the calibration user interface includes a thermal infrared image and a first face outline frame;

a second processing unit, configured to, in response to receiving an operation instruction for moving the first face outline frame, move the first face outline frame according to the operation instruction;

The output unit is configured to output calibration completion information when the first face contour frame coincides with the first face region in the thermal infrared image.

In some embodiments, the present application also provides an electronic device, comprising: a processor and a memory, the memory is used to store computer program code, the computer program code includes computer instructions, and the processor executes the In the case of computer instructions, the electronic device performs the method of the first aspect and any one of possible implementations thereof.

In some embodiments, the present application also provides another electronic device, including: a processor, a sending device, an input device, an output device, and a memory, the memory being used to store computer program code, the computer program code comprising a computer Instructions, when the processor executes the computer instructions, the electronic device executes the method according to the first aspect and any one of possible implementations thereof.

In some embodiments, the present application also provides a computer-readable storage medium, where a computer program is stored in the computer-readable storage medium, the computer program includes program instructions, and the program instructions are executed by a processor. In this case, the processor is caused to execute the method according to the first aspect and any one of possible implementations thereof.

In some embodiments, the present application also provides a computer program product, the computer program product includes a computer program or instructions, when the computer program or instructions are run on a computer, the computer is caused to execute the above-mentioned first step. A method of an aspect and any possible manner of implementation thereof.

It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the application.

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application or the background technology, the accompanying drawings required in the embodiments or the background technology of the present application will be described below.

The accompanying drawings, which are incorporated into and constitute a part of the specification, illustrate embodiments consistent with the present application, and together with the description, serve to explain the technical solutions of the present application.

1 is a schematic flowchart of a calibration method provided in an embodiment of the present application;

2 is a schematic diagram of a first face contour frame provided by an embodiment of the present application;

3 is a schematic diagram of a calibration user interface provided by an embodiment of the present application;

4 is a schematic structural diagram of a calibration device provided by an embodiment of the present application;

FIG. 5 is a schematic diagram of a hardware structure of a calibration apparatus provided by an embodiment of the present application.

Implementation

In order to make those skilled in the art better understand the solutions of the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only It is a part of the embodiments of the present application, but not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present application.

The terms "first", "second" and the like in the description and claims of the present application and the above drawings are used to distinguish different objects, rather than to describe a specific order. Furthermore, the terms "comprising" and "having" and any variations thereof are intended to cover non-exclusive inclusion. For example, a process, method, system, product or device comprising a series of steps or units is not limited to the listed steps or units, but optionally also includes unlisted steps or units, or optionally also includes For other steps or units inherent to these processes, methods, products or devices.

It should be understood that in this application, "at least one (item)" refers to one or more, "multiple" refers to two or more, and "at least two (item)" refers to two or three And three or more, "and/or" is used to describe the association relationship of related objects, indicating that three kinds of relationships can exist, for example, "A and/or B" can mean: only A exists, only B exists, and A exists at the same time and B three cases, where A, B can be singular or plural. The character "/" can indicate that the related objects are an "or" relationship, which refers to any combination of these items, including any combination of a single item (a) or a plurality of items (a). For example, at least one (a) of a, b or c, can mean: a, b, c, "a and b", "a and c", "b and c", or "a and b and c" ", where a, b, c can be single or multiple. The character "/" can also represent a division sign in a mathematical operation, eg, a/b=a divided by b; 6/3=2. "At least one (a) of the following" or similar expressions thereof.

Reference herein to an "embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the present application. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor a separate or alternative embodiment that is mutually exclusive of other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.

As we all know, people are prone to abnormal body temperature when they are sick. Therefore, a person's body temperature can be used as a basis for judging whether a person needs to be further determined to be sick. In some special cases, it is necessary to maintain a safe distance between people, which makes it impossible to measure people's body temperature through contact measurement.

For example, respiratory infectious diseases are easily contagious. When people with respiratory infectious diseases appear in public places or crowds, they may cause greater harm to social security (such as the harm to human safety caused by the spread of new coronary pneumonia). In order to reduce the transmission efficiency of respiratory infectious diseases, close contact between people can be reduced. At this time, it is not appropriate to measure people's body temperature by means of contact measurement.

In the case where the body temperature of a person cannot be measured by means of contact measurement, the body temperature of a person can only be measured by means of non-contact measurement. The current method of non-contact measurement is that the temperature measurement terminal uses a Red Green Blue (RGB) camera and a thermal imaging (Infrared Radiation, IR) camera to shoot the face of the object to be measured, and obtain an RGB image. and a temperature heatmap. The temperature measurement terminal determines the first face area from the RGB image by performing face detection processing on the RGB image, and then determines the pixel area corresponding to the first face area from the temperature heat map as the target pixel area. The temperature measurement terminal obtains the body temperature of the object to be measured according to the temperature of the target pixel area.

Since the installation position of the RGB camera is different from that of the thermal imaging camera, the position of the face of the object to be measured in the RGB image is different from the position of the face of the object to be measured in the temperature heat map. In this way, there may be a deviation between the target pixel area determined by the temperature measurement terminal from the temperature heat map and the first face area of the object to be measured, which in turn leads to inaccurate body temperature of the object to be measured.

Based on this, the embodiment of the present application provides a calibration method to determine the displacement difference between the RGB camera and the thermal imaging camera, so as to improve the accuracy of the body temperature of the object to be measured.

The execution body of the embodiment of the present application is a calibration device. In some embodiments of the present application, the calibration device may be one of the following: a mobile phone, a computer, a server, and a tablet computer. The embodiments of the present application will be described below with reference to the accompanying drawings in the embodiments of the present application.

Please refer to FIG. 1. FIG. 1 is a schematic flowchart of a calibration method provided by an embodiment of the present application.

101. In response to the received calibration trigger instruction, enter a calibration user interface.

In the embodiment of the present application, the calibration trigger instruction is used to instruct the calibration device to start the calibration procedure. In some embodiments of the present application, there is a communication connection between the calibration device and the display, and the calibration device displays an information box on the display whether to start the calibration program through the communication connection. The user can input a calibration trigger command to the calibration device through this information box.

For example, the information box includes starting the calibration procedure and not starting the calibration procedure. The user can input a calibration trigger command to the calibration device by clicking to start the calibration procedure.

In some embodiments of the present application, the user inputs a calibration trigger instruction to the calibration device by inputting voice data carrying the information of starting the calibration program to the calibration device.

In some embodiments of the present application, the reception of the calibration trigger instruction by the calibration apparatus may be that the calibration apparatus receives the calibration trigger instruction sent by the terminal. In some embodiments of the present application, the terminal may be any one of the following: a mobile phone, a computer, a tablet computer, a server, and a wearable device.

In response to the received calibration trigger instruction, the calibration device enters the calibration user interface to perform the next calibration process. In some embodiments of the present application, when the calibration device enters the calibration user interface, it may switch to the user interface after receiving the calibration trigger instruction.

102. In response to receiving an operation instruction for moving the first human face outline frame, move the above-mentioned first human face outline frame according to the above-mentioned operation instruction.

In the embodiment of the present application, the calibration user interface includes a first display area, and the first display area includes a thermal infrared image and a first face outline frame. Wherein, the first display area may be a part of the area of the calibration user interface, and the first display area may also be the entire area of the calibration user interface.

In this embodiment of the present application, the first face contour frame may be the face contour shown in FIG. 2 . In some embodiments of the present application, before performing step 102, the calibration apparatus obtains the first face contour frame. In an implementation manner of acquiring the first face contour frame, the calibration device receives the first face contour frame input by the user through the input component. In some embodiments of the present application, the above-mentioned input components include: a keyboard, a mouse, a touch screen, a touch pad, an audio input, and the like.

In another implementation manner of acquiring the first face contour frame, the calibration device receives the first face contour frame sent by the terminal.

In this embodiment of the present application, the initial position of the first face contour frame in the calibration user interface is fixed. That is, the calibration device displays the calibration user interface in response to receiving the calibration trigger instruction, and displays the first face contour frame at the initial position in the calibration user interface.

In the embodiment of the present application, the operation instruction for moving the first face contour frame is used to instruct the calibration device to move the first face contour frame on the calibration user interface.

In some embodiments of the present application, the user inputs an operation instruction for moving the first face contour frame to the calibration apparatus through the input component, so that the calibration apparatus moves the first face contour frame according to the operation instruction. For example, the user inputs an operation instruction to the calibration device through the input component to move the first face outline frame to the left by 10 pixel point units. When the calibration device receives the operation instruction, the first human face will be displayed in the calibration user interface. The outline box is moved to the left by 10 pixel units.

103. In a case where the first face contour frame overlaps with the first face region in the thermal infrared image, output calibration completion information.

In the embodiment of the present application, the thermal infrared image is the face image collected by the above thermal imaging device. In some embodiments of the present application, after the calibration device enters the calibration user interface, the thermal infrared image is also displayed in the calibration user interface.

In the embodiment of the present application, the initial position of the first face contour frame in the calibration user interface is the position of the first face region in the visible light image when the visible light image is displayed in the calibration user interface. For example, the visible light image includes the first face area a. The visible light image is displayed in the calibration user interface, and the position of the first face region a in the visible light image is A.

In the embodiment of the present application, the thermal infrared image and the visible light image are binocular images, that is, the thermal infrared image and the visible light image are two images obtained by photographing the same face by different imaging devices at the same time. The device is a visible light imaging device. In some embodiments of the present application, the visible light imaging device is an RGB imaging device.

For example, the temperature measurement terminal includes an RGB camera and an IR camera. The temperature measurement terminal uses an RGB camera to photograph Zhang San's face to obtain an RGB image, and while using the RGB camera to collect the RGB image, uses an IR camera to photograph Zhang San's face to obtain a thermal infrared image.

Since the installation position of the visible light imaging device is different from that of the thermal infrared imaging device, the position of the face of the object to be measured in the visible light image is different from the position of the face of the object to be measured in the thermal infrared image. Therefore, before determining the body temperature of the object to be measured based on the visible light image and the thermal infrared image, the parallax between the visible light image and the thermal infrared image needs to be obtained by calibrating the visible light image and the thermal infrared image.

Since the initial position of the first face contour frame in the calibration user interface is the position of the first face area in the visible light image in the visible light image, by moving the first face contour frame, the first face contour frame and the When the first face area in the thermal infrared image is coincident, the calibration between the visible light image and the thermal infrared image can be completed.

For example, if the calibration device moves the first face contour frame to the right by 5 pixel point units on the calibration user interface, it is obtained that the first face contour frame coincides with the first face region in the thermal infrared image. Then it can be explained that moving the visible light image to the right side of the calibration user interface by 5 pixel point units can make the visible light image and the thermal infrared image overlap. That is, the parallax between the visible light image and the thermal infrared image is 5 pixel units.

When it is determined that the first face contour frame coincides with the first face region in the thermal infrared image, the calibration device outputs calibration completion information to inform the user that the calibration between the thermal infrared image and the visible light image has been completed.

In some embodiments of the present application, there is a communication connection between the calibration device and the display. The calibration device makes the display output calibration completion information through the communication connection.

For example, the calibration device may display the calibration completion information in the calibration user interface; for another example, the calibration device may switch the calibration user interface to another interface, and display the calibration completion information in the switched interface.

In some embodiments of the present application, the calibration device may output calibration completion information by outputting voice data.

In some embodiments of the present application, the calibration device may output calibration completion information by controlling the prompt light to flash.

In the embodiment of the present application, the calibration device determines to complete the calibration between the visible light image and the thermal infrared image when it is determined that the first face contour frame coincides with the first face region in the thermal infrared image.

Based on the technical solutions provided by the embodiments of the present application, the calibration device can display the calibration user interface, so that the user can move the face frame to determine whether the face frame overlaps with the first face area in the thermal infrared image, and then can The calibration between the visible light image and the thermal infrared image is completed, thereby reducing the operational complexity for the user to obtain the parallax between the visible light image and the thermal infrared image.

In some embodiments of the present application, the calibration device further performs the following steps:

1. In the case that the first face contour frame and the first face region in the thermal infrared image overlap, the position of the first face contour frame in the interface is taken as the termination position.

2. Determine the displacement difference between the initial position of the first face outline frame in the interface and the termination position as the parallax between the thermal infrared image and the visible light image.

In the embodiment of the present application, the disparity between the points with the same name refers to the difference between the positions of two pixels with the same name in the binocular image in the respective images.

In the embodiment of the present application, the disparity between the binocular images is the disparity obtained according to the disparity between all points with the same name in the binocular images. In some embodiments of the present application, the average value of the disparity between all points with the same name in the binocular image is used as the disparity between the binocular images.

In the embodiment of the present application, the calibration device obtains the parallax between the visible light image and the thermal infrared image by determining the displacement difference, thereby reducing the amount of data processing required by the calibration device to obtain the parallax between the visible light image and the thermal infrared image, and reducing the amount of visible light obtained by the user. Operational complexity of parallax between image and thermal infrared image.

3. In response to receiving the calibration completion instruction, display the coincidence result of the first face contour frame and the first face region in the first display area.

In the embodiment of the present application, the coincidence result includes but is not limited to the coincidence degree and the forehead area of the human face. The degree of coincidence may be one of the following: a numerical value, a coincidence effect diagram between the first face contour frame and the first face region in the thermal infrared image.

The face forehead area refers to the face forehead area in the first face outline frame. Since the body temperature of a person is measured based on a visible light image and a thermal infrared image, the body temperature of a person is usually determined by measuring the temperature of a person's forehead. Therefore, displaying the face forehead region in the calibration user interface enables the user to know the degree of coincidence between the forehead region in the face frame and the forehead region in the thermal infrared image. In this way, it is more beneficial to improve the accuracy of the body temperature obtained based on the thermal infrared image and the visible light image.

In some embodiments of the present application, the calibration device further performs the following steps before displaying the coincidence result between the first face contour frame and the first face region in the calibration user interface:

4. Obtain visible light images.

As mentioned above, the visible light image and the thermal infrared image are binocular images. In an implementation manner of acquiring the visible light image, the calibration device receives the visible light image input by the user through the input component.

In another implementation manner of acquiring the visible light image, the calibration device receives the visible light image sent by the terminal.

In yet another implementation manner of acquiring a visible light image, the calibration device is loaded with a visible light imaging device. The calibration device uses visible light imaging equipment to collect visible light images.

5. Perform face recognition processing on the visible light image to obtain the position of the reference pixel area in the visible light image.

In this embodiment of the present application, the reference pixel area is an area corresponding to the first face area in the visible light image. That is, the reference pixel area corresponds to the face of the same person as the first face area in the thermal infrared image.

The calibration device can determine the position of the first face region in the visible light image by performing face recognition processing on the visible light image. When the visible light image includes one first face region, the calibration device uses the first face region in the visible light image as a reference pixel region. When the first face area included in the visible light image exceeds 1, the calibration device uses the first face area with the largest area as the reference pixel area.

6. Determine the position of the first face region in the thermal infrared image according to the reference parallax and the position of the reference pixel area in the visible light image; the reference parallax is the visible light image and the thermal infrared image. parallax between.

In this embodiment of the present application, the reference parallax is the parallax between the visible light image and the thermal infrared image. The calibration device can determine the position of the first face region in the thermal infrared image according to the reference parallax and the position of the reference pixel point region in the visible light image.

7. According to the position of the first face region in the thermal infrared image and the termination position, the overlapping result of the first face contour frame and the first face region is obtained.

In some embodiments of the present application, the calibration device may determine the distance between the first face contour frame and the first face region in the thermal infrared image according to the position and termination position of the first face region in the thermal infrared image. Area coincidence degree, as the coincidence result.

In some embodiments of the present application, the calibration device can obtain the relationship between the first face contour frame and the first face region in the thermal infrared image according to the position and termination position of the first face region in the thermal infrared image. Coincidence effect map, as the coincidence result.

In some embodiments of the present application, the calibration device performs the following steps in the process of performing step 102:

8. Move the first face contour frame along the sliding direction of the object on the user interface in the case of detecting the movement instruction of the object sliding on the user interface.

In this step, there is a communication connection between the calibration device and the touch display. The calibration device detects the movement instruction of the object sliding on the user interface by detecting the sliding operation of the object on the touch display.

The calibration device moves the first face contour frame along the sliding direction of the object on the user interface when the movement instruction is detected. For example, the user slides a finger on the touch display to move the first human face outline frame; for another example, the user uses a stylus to slide and move the first human face outline frame on the touch display.

In some embodiments of the present application, the position where the object contacts the touch display may be located on the first face contour frame, and the position where the object contacts the touch display may not be located on the first face contour frame. For example, in the case where the area of the above-mentioned touch display is so large that it is difficult for the user to operate with one hand, the user's finger-reachable area in the touch display (such as the area in the lower left corner or the lower right corner of the touch display) can be used as the control area, and the user can use objects in the Swipe in the control area to move the first face outline frame.

In some embodiments of the present application, before performing step 102, the calibration apparatus further performs the following steps:

9. Display at least one virtual direction button in the above calibration user interface.

In this embodiment of the present application, the at least one virtual direction button includes at least one of the following: an up virtual button, a down virtual button, a left virtual button, and a right virtual button.

The virtual direction button is used to move the first face outline frame. For example, if the up virtual button is touched by an object, it means that the first face outline frame should move to the upper side of the calibration user interface; if the down virtual button is touched by an object, it means that the first face outline frame should move to the lower side of the calibration user interface; When the left virtual button is touched by an object, it indicates that the first face contour box should move to the left side of the calibration user interface; if the right virtual button is touched by an object, it indicates that the first face contour box should move to the right side of the calibration user interface.

After performing step 9, the calibration device performs a step in the process of performing step 102:

10. When it is detected that an object touches the at least one virtual direction button through the screen of the calibration device, move the face frame according to the direction indicated by the touched virtual direction button.

In some embodiments of the present application, the calibration device moves the first face contour frame to the upper side of the calibration user interface by n pixel units when detecting that the object touches the upward virtual button.

When the at least one virtual direction button includes an up virtual button, and the calibration device detects that the object touches the up virtual button, the first face contour frame moves n pixel units to the upper side of the calibration user interface. The value of n can be set according to actual needs.

For example, if n=1, the object touches the up virtual button once, and the calibration device moves the first face contour frame to the upper side of the calibration user interface by 1 pixel unit; if n=3, the object touches the up virtual button once, and the calibration The device moves the first face contour frame to the upper side of the calibration user interface by 3 pixel units.

In some embodiments of the present application, the calibration device moves the first face contour frame to the lower side of the calibration user interface by m pixel units when detecting that the object touches the downward virtual button.

When the at least one virtual direction button includes a down virtual button, and the calibration device detects that the object touches the down virtual button, the first face contour frame moves m pixel units to the lower side of the calibration user interface. The value of m can be set according to actual needs.

For example, in response to m=1, the object touches the down virtual button once, the calibration device moves the first face contour frame to the lower side of the calibration user interface by 1 pixel unit; in response to m=2, the object touches the down virtual button once , the calibration device moves the first face contour frame to the lower side of the calibration user interface by 2 pixel units.

In some embodiments of the present application, the calibration device moves the first face contour frame to the left side of the calibration user interface by i pixel units when detecting that the object touches the left virtual button.

When the at least one virtual direction button includes a left virtual button, and the calibration device detects that the object touches the left virtual button, the first face contour frame moves i pixel units to the left of the calibration user interface. The value of i can be set according to actual needs.

For example, in response to i=1, the object touches the left virtual button once, the calibration device moves the first face contour frame to the left side of the calibration user interface by 1 pixel unit; in response to i=2, the object touches the left virtual button once , the calibration device moves the first face contour frame to the left side of the calibration user interface by 2 pixel units.

In some embodiments of the present application, the calibration device moves the first face outline frame to the right side of the calibration user interface by j pixel units when detecting that the object touches the right virtual button.

When the at least one virtual direction button includes a right virtual button, and the calibration device detects that the object touches the right virtual button, the first face contour frame moves j pixel units to the right side of the calibration user interface. The value of j can be set according to actual needs.

For example, in response to j=1, the object touches the right virtual button once, the calibration device moves the first face contour frame to the right side of the calibration user interface by 1 pixel unit; in response to j=2, the object touches the right virtual button once , the calibration device moves the first face contour frame to the right side of the calibration user interface by 2 pixel units.

The user can control the movement of the first face contour frame by touching the virtual direction button, so that the first face contour frame and the first face area in the thermal infrared image are overlapped.

In some embodiments of the present application, the first face contour frame is obtained according to at least one reference to the first face contour frame. At least one reference first face contour frame is obtained by performing face detection processing on at least one face image. The acquisition conditions of at least one face image are all actual acquisition conditions, wherein the actual acquisition conditions are image acquisition conditions under the application environment of the calibration device.

In the embodiment of the present application, the face detection processing is used to process the face image to obtain the face contour and the face key points. The electronic device can obtain at least one face contour and at least one face key point by performing face detection processing on a face image. The electronic device can obtain at least one reference first face contour frame by performing face detection processing on at least one face image.

The electronic device can further obtain the first face contour frame according to the at least one reference first face contour frame. For example, the electronic device obtains the first face contour frame by fitting at least one reference first face contour frame. For another example, the electronic device may average at least one reference first face contour frame to obtain the first face contour frame. For another example, the electronic device may use any one of the at least one reference first face contour frame as the first face contour frame.

In this embodiment of the present application, the collection conditions include one of the following factors: brightness and shooting angle. For example, the collection conditions in the waiting hall are different from the collection conditions outdoors; for another example, there are a calibration device 1 and a calibration device 2 in the waiting hall, wherein the shooting angle of the camera of the calibration device 1 is the same as the shooting angle of the camera of the calibration device 2. The angles are different, that is, the acquisition conditions of the calibration device 1 and the acquisition conditions of the calibration device 2 are different.

Obviously, there are differences between the face images obtained by photographing the same person under different acquisition conditions. For example, the face image of Zhang San is collected under the collection condition 1 to obtain the face image 1, and the face image of Zhang San is collected under the collection condition 2 to obtain the face image 2. At this time, the face contour of Zhang San in the face image 1 is different from the face contour of Zhang San in the face image 2 .

In the embodiments of the present application, the image acquisition conditions under the application environment of the calibration device are referred to as actual acquisition conditions. For example, if the calibration device is used in the hall of company A, the actual acquisition conditions are the acquisition conditions when the calibration device collects images in the hall of company A.

In the case where the acquisition conditions of the at least one face image are the same as the actual acquisition conditions, the first face contour frame obtained according to the at least one first face contour frame is used with the calibration device to photograph the human face under the actual acquisition conditions. The obtained first face contour frame is closer, thereby improving the calibration accuracy between the visible light image and the thermal infrared image.

In some embodiments of the present application, the first face contour frame further includes at least one of the following face key points: eye key point, forehead key point, and eye key point. In the case that the first face contour frame includes at least one face key point, when the user determines whether the first face contour frame coincides with the first face region in the thermal infrared image, not only the first face Whether the face contour in the face contour frame overlaps with the boundary of the first face area is used as a judgment basis, and at least one face key point in the first face contour frame can also be used with the corresponding face in the first face area. Whether the key points overlap is the basis for judgment.

For example, assume that at least one face keypoint includes eye keypoints. Then, when judging whether the first face contour frame coincides with the first face area in the thermal infrared image, the user not only checks whether the face contour in the first face contour frame coincides with the boundary of the first face area As the judgment basis, whether the eye key point in the first face contour frame and the eye key point in the first face area overlap can also be used as the judgment basis.

In some embodiments of the present application, the calibration device resets the first human face contour frame to an initial position when receiving an instruction to reset the first human face contour frame. In this embodiment, the user may input an instruction to reset the first face contour frame to the calibration device, so that the first face contour frame can return to the initial position.

In some embodiments of the present application, the calibration user interface further includes a second display area, and the calibration device further performs the following steps:

11. Display a preview image of the overlapping effect between the first face outline frame and the first face area in the second display area.

In this embodiment of the present application, the first display area is different from the second display area. In some embodiments of the present application, there is no intersection between the second display area and the first display area.

In this embodiment of the present application, the overlap effect preview image includes an overlap effect image of the second face contour frame and the second face region. The temperature measurement area is marked in the second face outline frame. In some embodiments of the present application, the temperature measurement area may be a point marked with a special color. For example, suppose the temperature measurement area is a green point. Explain that the green point is the temperature measurement point of the thermal infrared imaging device.

In some embodiments of the present application, the temperature measurement area may be an area marked with a frame, and in this case, the temperature measurement area is a temperature measurement area of a thermal infrared imaging device.

In this embodiment of the present application, the position of the second face contour frame in the second display area corresponds to the position of the first face contour frame in the first display area. That is, if the first face contour frame moves to the left in the first display area, then the second face contour frame moves to the left in the second display area; if the first face contour frame moves upward in the first display area, then The second face outline frame moves upward in the second display area.

For example, the user moves the first face outline frame upward in the first display area by clicking the up virtual button, and at this time, the second face outline frame moves upward in the second display area.

In some embodiments of the present application, the ratio between the moving distance of the first face outline frame in the first display area and the movement distance of the second face outline frame in the second display area is the preview ratio.

For example, suppose the preview scale is 2. If the user clicks the up virtual button to move the first face contour frame upward by 4 pixel units in the first display area, then the second face contour frame moves upward by 2 pixel units in the second display area .

In the embodiment of the present application, the second face area corresponds to the first face area, that is, in the preview image of the overlap effect, the second face area is a preview image of the first face area. In some embodiments of the present application, the ratio between the size of the first face region and the size of the second face region is the preview ratio.

By performing step 11, the calibration device can display the position of the temperature measurement area through the overlapping effect preview image during the process of moving the first face contour frame. In this way, the user can know which part of the temperature measurement object is measured by the thermal infrared imaging device when the thermal infrared image is collected. For example, if the temperature measurement area is in the right forehead area of the second face area, then the body temperature obtained according to the visible light image and the thermal infrared image is the temperature of the right forehead area of the temperature measurement object.

In some embodiments of the present application, before performing step 103, the calibration apparatus further performs the following steps:

12. In response to receiving an enlargement instruction for the thermal infrared image and the face frame, enlarge the thermal infrared image and the face frame according to the enlargement instruction.

In this embodiment of the present application, the enlargement instruction is used to instruct the calibration device to enlarge the thermal infrared image and the face frame. In some embodiments of the present application, the calibration device simultaneously magnifies the thermal infrared image and the first face frame according to the magnification instruction.

13. In response to receiving a zoom-out instruction for the thermal infrared image and the face frame, enlarging the thermal infrared image and the face frame according to the zoom-out instruction.

In this embodiment of the present application, the zoom-out instruction is used to instruct the calibration device to zoom in on the thermal infrared image and the face frame. In some embodiments of the present application, the calibration device simultaneously reduces the thermal infrared image and the first face frame according to the enlargement instruction.

The user can better observe the overlapping effect between the first face frame and the first face region by inputting a zoom-in or zoom-out command to the calibration device.

In some embodiments of the present application, the user inputs a zoom-in instruction to the calibration device, which may be touching the zoom-in button in the first display area; the user inputs a zoom-out instruction to the calibration device, which may be touching the zoom-in button in the first display area.

Based on the technical solutions disclosed in the embodiments of the present application, the embodiments of the present application also provide a possible application scenario.

As described above, in the case of using the temperature measurement terminal for non-contact temperature measurement, the temperature measurement terminal determines the first face area from the RGB image, and then determines the pixel corresponding to the first face area from the thermal infrared image Point area, as the target pixel area. The temperature measurement terminal obtains the body temperature of the object to be measured according to the temperature of the target pixel area. However, if there is a large parallax between the RGB image and the thermal infrared image, the obtained body temperature of the object to be measured has a large error, and even an unreasonable body temperature may be obtained.

For example, using the temperature measuring terminal to measure Zhang San's body temperature, it is obtained that Zhang San's body temperature is 30 degrees; for another example, using the temperature measuring terminal to measure Zhang San's body temperature, it is obtained that Zhang San's body temperature is 43 degrees. Obviously 30 degrees and 40 degrees are unreasonable body temperature.

When the obtained body temperature is obviously unreasonable, the reason may be that the displacement difference between the RGB camera and the thermal imaging camera is large, resulting in a large parallax between the RGB image and the thermal infrared image. At this time, the user can determine the parallax between the RGB image and the thermal infrared image based on the technical solutions provided by the embodiments of the present application, thereby improving the accuracy of the body temperature of the object to be measured.

It should be understood that in the case of collecting the face image of Zhang San, the temperature measurement terminal displays the outline frame of the first face collected on the display, so that Zhang San adjusts the position of the face, so that the face of Zhang San is in the first position of the collection. within the face contour frame. The position of the collected first face contour frame in the calibration user interface of the display is the same as the position of the first face contour frame in the calibration user interface.

In the case that the temperature measurement terminal determines that Zhang San's face is within the frame of the first face outline, the temperature measurement terminal uses an RGB camera to collect an image containing Zhang San's face as an RGB image, and uses a thermal imaging camera to collect Zhang San's face. image of the part as a thermal infrared image.

Based on the technical solutions, visible RGB images and thermal infrared images provided by the embodiments of the present application, the temperature measurement terminal can complete the calibration between the RGB images and the thermal infrared images.

For example, the user can make the first face contour frame overlap with the first face area in the thermal infrared image by moving the first face contour frame, and input the first face contour frame and the thermal infrared image to the temperature measurement terminal. The first face area coincidence command. The temperature measurement terminal can then determine the parallax between the RGB image and the thermal infrared image. In this way, the temperature measurement terminal can determine the target pixel area from the thermal infrared image based on the parallax, thereby improving the accuracy of the body temperature of the object to be measured.

For example, Figure 3 shows a calibration user interface displaying a first face contour box and a thermal infrared image. In this user interface, a first face outline box 301 using a dashed line is included. There are four virtual direction buttons 302 below the user interface, which are respectively used to control the first face contour frame to move to the upper side of the user interface, to the lower side of the user interface, to the left side of the user interface, and to the user interface. The right side of the interface moves. By touching the virtual direction button, the user can move the first face contour frame 301 so that the first face contour frame 301 coincides with the first face area in the thermal infrared image.

Those skilled in the art can understand that in the above method of the specific implementation, the writing order of each step does not mean a strict execution order but constitutes any limitation on the implementation process, and the specific execution order of each step should be based on its function and possible Internal logic is determined.

The methods of the embodiments of the present application are described in detail above, and the apparatuses of the embodiments of the present application are provided below.

Please refer to FIG. 4. FIG. 4 is a schematic structural diagram of a calibration device provided by an embodiment of the present application. The calibration device 1 includes: a first processing unit 11, a second processing unit 12, an output unit 13, a first display unit 14, The acquisition unit 15, the third processing unit 16, the fourth processing unit 17, the fifth processing unit 18, the second display unit 19 and the reset unit 20, wherein:

The first processing unit 11 is configured to enter a calibration user interface in response to the received calibration trigger instruction, and the calibration user interface includes a thermal infrared image and a first face outline frame;

The second processing unit 12 is configured to, in response to receiving an operation instruction for moving the first human face outline frame, move the first human face outline frame according to the operation instruction;

The output unit 13 is configured to output calibration completion information when the first face contour frame coincides with the first face region in the thermal infrared image.

In combination with any embodiment of the present application, the calibration device 1 further includes:

The first display unit 14 is configured to display the coincidence result of the first face outline frame and the first face region in the calibration user interface in response to receiving the calibration completion instruction, wherein the coincidence The results include, but are not limited to, coincidence, face forehead area.

In combination with any embodiment of the present application, the calibration device further includes:

The obtaining unit 15 is configured to obtain a visible light image before displaying the coincidence result of the first face contour frame and the first face region in the calibration user interface;

The third processing unit 16 is configured to perform face recognition processing on the visible light image to obtain the position of the reference pixel point area in the visible light image; the reference pixel point area is the difference between the visible light image and the The area corresponding to the first face area;

The fourth processing unit 17 is configured to determine the position of the first face region in the thermal infrared image according to the reference parallax and the position of the reference pixel area in the visible light image; the reference parallax is Parallax between the visible light image and the thermal infrared image;

The fifth processing unit 18 is configured to obtain the coincidence of the first face contour frame and the first face region according to the position of the first face region in the thermal infrared image and the termination position result.

With reference to any embodiment of the present application, the second processing unit 12 is configured as:

With reference to any embodiment of the present application, the calibration device further includes: a second display unit 19, configured to, in response to receiving an operation instruction for moving the first face contour frame, move according to the operation instruction Before the first face outline frame, at least one virtual direction button is displayed in the calibration user interface; the at least one virtual direction button includes at least one of the following: an up virtual button, a down virtual button, a left virtual button, Right virtual button;

The second processing unit 12 is configured as:

The resetting unit 20 is configured to reset the first human face outline frame to an initial position when receiving an instruction to reset the first human face outline frame.

With reference to any embodiment of the present application, the calibration user interface further includes a second display area different from the first area, and the first processing unit 11 is further configured to display the second display area in the second display area. A preview of the overlapping effect between the first face contour frame and the first face area; the overlapping effect preview includes an overlapping effect diagram of the second face contour frame and the second face area; the second A temperature measurement area is marked in the face contour frame; the position of the second face contour frame in the second display area corresponds to the position of the first face contour frame in the first display area; The second face area corresponds to the first face area.

With reference to any embodiment of the present application, the second processing unit 12 is further configured to output calibration completion information when the first face contour frame overlaps with the first face region in the thermal infrared image before, in response to receiving an enlargement instruction for the thermal infrared image and the first face frame, enlarging the thermal infrared image and the first face frame according to the enlargement instruction;

In some embodiments, the functions or modules included in the apparatus provided in the embodiments of the present application may be configured to execute the methods described in the above method embodiments, and the specific implementation may refer to the descriptions in the above method embodiments. No longer.

FIG. 5 is a schematic diagram of a hardware structure of a calibration apparatus provided by an embodiment of the present application. The calibration device 2 includes a processor 21 , a memory 22 , an input device 23 , and an output device 24 . The processor 21, the memory 22, the input device 23, and the output device 24 are coupled through a connector, and the connector includes various types of interfaces, transmission lines, or buses, etc., which are not limited in this embodiment of the present application. It should be understood that, in various embodiments of the present application, coupling refers to mutual connection in a specific manner, including direct connection or indirect connection through other devices, such as various interfaces, transmission lines, and buses.

The processor 21 may be one or more graphics processing units (graphics processing units, GPUs). In the case where the processor 21 is a GPU, the GPU may be a single-core GPU or a multi-core GPU. In some embodiments of the present application, the processor 21 may be a processor group composed of multiple GPUs, and the multiple processors are coupled to each other through one or more buses. In some embodiments of the present application, the processor may also be other types of processors, etc., which are not limited in the embodiments of the present application.

The memory 22 can be used to store computer program instructions and various types of computer program codes including program codes for executing the solutions of the present application. Optionally, the memory includes, but is not limited to, random access memory (RAM), read-only memory (read-only memory, ROM), erasable programmable read-only memory (erasable programmable read only memory, EPROM) ), or a portable read-only memory (compact disc read-only memory, CD-ROM), which is used for related instructions and data.

The input device 23 is used for inputting data and/or signals, and the output device 24 is used for outputting data and/or signals. The input device 23 and the output device 24 may be independent devices or may be an integral device.

It can be understood that in this embodiment of the present application, the memory 22 can be used not only to store related instructions, but also to store related data. For example, the memory 22 can be used to store the calibration trigger instruction obtained through the input device 23, or the memory 22 can also be used to store The parallax between the visible light image obtained by the processor 21 and the thermal infrared image is stored, and the embodiment of the present application does not limit the specific data stored in the memory.

It will be appreciated that Figure 5 shows a simplified design of a calibration device. In practical applications, the calibration device may also include other necessary components, including but not limited to any number of input/output devices, processors, memories, etc., and all calibration devices that can implement the embodiments of the present application are included in the present application. within the scope of protection.

Those of ordinary skill in the art can realize that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Skilled artisans may implement the described functionality using different methods for each particular application, but such implementations should not be considered beyond the scope of this application.

Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the above-described systems, devices and units may refer to the corresponding processes in the foregoing method embodiments, which will not be repeated here. Those skilled in the art can also clearly understand that the description of each embodiment of the present application has its own emphasis. For the convenience and brevity of the description, the same or similar parts may not be repeated in different embodiments. Therefore, in a certain embodiment For the parts that are not described or not described in detail, reference may be made to the descriptions of other embodiments.

In the several embodiments provided in this application, it should be understood that the disclosed system, apparatus and method may be implemented in other manners. For example, the apparatus embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components may be combined or Can be integrated into another system, or some features can be ignored, or not implemented. On the other hand, the shown or discussed mutual coupling or direct coupling or communication connection may be through some interfaces, indirect coupling or communication connection of devices or units, and may be in electrical, mechanical or other forms.

The units described as separate components may or may not be physically separated, and components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution in this embodiment.

In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically alone, or two or more units may be integrated into one unit.

In the above-mentioned embodiments, it may be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented in software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of the present application are generated. The computer may be a general purpose computer, special purpose computer, computer network, or other programmable device. The computer instructions may be stored in or transmitted over a computer-readable storage medium. The computer instructions can be sent from a website site, computer, server, or data center via wired (eg, coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (eg, infrared, wireless, microwave, etc.) another website site, computer, server or data center for transmission. The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server, a data center, or the like that includes an integration of one or more available media. The available media may be magnetic media (eg, floppy disks, hard disks, magnetic tapes), optical media (eg, digital versatile disc (DVD)), or semiconductor media (eg, solid state disk (SSD)) )Wait.

Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments can be implemented. The process can be completed by instructing the relevant hardware by a computer program, and the program can be stored in a computer-readable storage medium. When the program is executed , which may include the processes of the foregoing method embodiments. The aforementioned storage medium includes: read-only memory (read-only memory, ROM) or random access memory (random access memory, RAM), magnetic disk or optical disk and other media that can store program codes.

Industrial Applicability

The calibration device of the present application can display the calibration user interface, so that the user can move the face frame to determine whether the face frame is coincident with the first face area in the thermal infrared image, and then the visible light image and the thermal infrared image can be completed. Calibration between the two, thereby reducing the operational complexity of the user to obtain the parallax between the visible light image and the thermal infrared image.

Claims

A calibration method, the method being performed by a calibration device, the method comprising:

In response to the received calibration trigger instruction, enter a calibration user interface, where the first display area of the calibration user interface includes a thermal infrared image and a first face outline frame;

In response to receiving an operation instruction for moving the first human face outline frame, move the first human face outline frame according to the operation instruction;

When the first face contour frame coincides with the first face region in the thermal infrared image, the calibration completion information is output.
The method of claim 1, wherein the method further comprises:

In response to receiving the instruction that the calibration is completed, display the coincidence result of the first face contour frame and the first face region in the first display area, wherein the coincidence result includes but is not limited to the coincidence degree , the forehead area of the human face.
The method according to claim 2, wherein, before displaying the coincidence result of the first face contour frame and the first face region in the first display area, the method further comprises:

Obtain visible light images;

Performing face recognition processing on the visible light image to obtain the position of the reference pixel point area in the visible light image; the reference pixel point area is the area corresponding to the first face area in the visible light image;

According to the reference parallax and the position of the reference pixel area in the visible light image, determine the position of the first face region in the thermal infrared image; the reference parallax is the visible light image and the thermal infrared image. Parallax between infrared images;

According to the position and termination position of the first face region in the thermal infrared image, the overlapping result of the first face contour frame and the first face region is obtained; wherein, the termination position is the the position of the first face contour frame in the calibration user interface.
The method according to any one of claims 1 to 3, wherein, in response to receiving an operation instruction for moving the first human face outline frame, the first human face outline frame is moved according to the operation instruction ,include:

In the case of detecting the movement instruction of the object sliding on the user interface, the first face contour frame is moved along the sliding direction of the object on the user interface.
The method according to any one of claims 1 to 3, wherein the calibration method is applied to a calibration device;

Before moving the first face contour frame according to the operation instruction in response to receiving the operation instruction for moving the first face contour frame, the method further includes:

Displaying at least one virtual direction button in the calibration user interface; the at least one virtual direction button includes at least one of the following: an up virtual button, a down virtual button, a left virtual button, and a right virtual button;

The moving the first human face outline frame according to the operation instruction in response to receiving the operation instruction for moving the first human face outline frame includes:

When it is detected that an object touches the at least one virtual direction button through the screen of the calibration device, the face frame is moved according to the direction indicated by the touched virtual direction button.
The method according to claim 4 or 5, wherein the first face contour frame is obtained according to at least one reference first face contour frame; the at least one reference first face contour frame is obtained by comparing at least one The face image is obtained by performing face detection processing; the acquisition conditions of the at least one face image are all actual acquisition conditions; the actual acquisition conditions are image acquisition conditions under the application environment of the calibration device.
The method according to any one of claims 1 to 6, wherein the method further comprises:

In the case of receiving an instruction to reset the first human face outline frame, the first human face outline frame is reset to an initial position.
The method according to any one of claims 1 to 7, wherein the first face contour frame includes at least one face key point;

The overlapping of the first face contour frame with the first face region in the thermal infrared image includes: the first face contour frame and the boundary of the first face region overlapping and the at least one face The key points coincide with the corresponding face key points in the first face region.
The method according to any one of claims 1 to 8, wherein the calibration user interface further comprises a second display area different from the first area, the method further comprising:

A preview image of the overlapping effect between the first human face outline frame and the first human face area is displayed in the second display area; the overlapping effect preview image includes the second human face outline frame and the second human face. The overlapping effect diagram of the face area; the temperature measurement area is marked in the second face contour frame; the position of the second face contour frame in the second display area and the first face contour frame are in The positions in the first display area correspond; the second face area corresponds to the first face area.
The method according to any one of claims 1 to 9, wherein when the first face contour frame is coincident with the first face region in the thermal infrared image, outputting calibration completion information Before, the method further includes:

in response to receiving an enlargement instruction for the thermal infrared image and the first face frame, enlarging the thermal infrared image and the first face frame according to the enlargement instruction;

In response to receiving a zoom-out instruction for the thermal infrared image and the first face frame, the thermal infrared image and the first face frame are enlarged according to the zoom-out instruction.
A calibration device comprising:

a first processing unit, configured to enter a calibration user interface in response to the received calibration trigger instruction, and the first display area of the calibration user interface includes a thermal infrared image and a first face outline frame;

a second processing unit, configured to, in response to receiving an operation instruction for moving the first face contour frame, move the first face contour frame according to the operation instruction;

The output unit is configured to output calibration completion information when the first face contour frame coincides with the first face region in the thermal infrared image.
The calibration device according to claim 11, wherein the calibration device further comprises:

a first display unit, configured to display the coincidence result of the first face contour frame and the first face region in the calibration user interface in response to receiving the calibration completion instruction, wherein the coincidence result Including but not limited to coincidence, face and forehead area.
The calibration device according to claim 12, wherein the calibration device further comprises:

an obtaining unit, configured to obtain a visible light image before displaying the result of the overlap between the first face contour frame and the first face region in the calibration user interface;

The third processing unit is configured to perform face recognition processing on the visible light image to obtain the position of the reference pixel point area in the visible light image; the reference pixel point area is the same as the first person in the visible light image. The area corresponding to the face area;

The fourth processing unit is configured to determine the position of the first face region in the thermal infrared image according to the reference parallax and the position of the reference pixel area in the visible light image; the reference parallax is the disparity between the visible light image and the thermal infrared image;

The fifth processing unit is configured to obtain a coincidence result of the first face contour frame and the first face region according to the position and the termination position of the first face region in the thermal infrared image.
The calibration device according to any one of claims 11 to 13, wherein the second processing unit is configured to: in the case of detecting a movement instruction of an object sliding on the user interface, move along the object Move the first face outline frame in the sliding direction on the user interface.
The calibration device according to any one of claims 11 to 13, wherein the calibration device further comprises: a second display unit configured to, in the response to receiving the movement of the first face contour frame, an operation instruction, before moving the first face outline frame according to the operation instruction, display at least one virtual direction button in the calibration user interface; the at least one virtual direction button includes at least one of the following: an up virtual button, a Down virtual button, left virtual button, right virtual button;

The second processing unit is configured to: in the case of detecting that an object touches the at least one virtual direction button through the screen of the calibration device, move the person according to the direction indicated by the touched virtual direction button face frame.
The calibration device according to claim 14 or 15, wherein the first face contour frame is obtained according to at least one reference first face contour frame; the at least one reference first face contour frame is obtained by comparing at least one The face image is obtained by performing face detection processing; the acquisition conditions of the at least one face image are all actual acquisition conditions; the actual acquisition conditions are image acquisition conditions under the application environment of the calibration device.
The calibration device according to any one of claims 11 to 16, wherein the calibration device further comprises: a reset unit, configured to, when receiving an instruction to reset the first face outline frame, reset the The first face contour frame is reset to the initial position.
The calibration device according to any one of claims 11 to 17, wherein the first face contour frame includes at least one face key point;

The overlapping of the first face contour frame with the first face region in the thermal infrared image includes: the first face contour frame and the boundary of the first face region overlapping and the at least one face The key points coincide with the corresponding face key points in the first face region.
The calibration device according to any one of claims 11 to 18, wherein the calibration user interface further comprises a second display area different from the first area, and the first processing unit is further configured to The second display area displays a preview image of the overlapping effect of the first face outline frame and the first face area; the overlapping effect preview image includes the second face outline frame and the second face area. The overlapping effect diagram; the temperature measurement area is marked in the second face contour frame; the position of the second face contour frame in the second display area and the first face contour frame are in the The positions in the first display area correspond; the second face area corresponds to the first face area.
The calibration device according to any one of claims 11 to 19, wherein the second processing unit is further configured to perform the calibration between the first face contour frame and the thermal infrared image in the first In the case where the face areas overlap, before outputting the calibration completion information, in response to receiving an enlargement instruction for the thermal infrared image and the first face frame, enlarge the thermal infrared image and the first face frame according to the enlargement instruction. a first human face frame; in response to receiving a zoom-out instruction for the thermal infrared image and the first human face frame, enlarging the thermal infrared image and the first human face frame according to the zoom-out instruction.
An electronic device, comprising: a processor and a memory, the memory is used to store computer program code, the computer program code includes computer instructions, and when the processor executes the computer instructions, the electronic device executes A method as claimed in any one of claims 1 to 10.
A computer-readable storage medium storing a computer program in the computer-readable storage medium, the computer program comprising program instructions, which, when the program instructions are executed by a processor, cause the processor to execute the claims The method of any one of 1 to 10.
A computer program product comprising one or more instructions adapted to be loaded by a processor and to perform the method of any one of claims 1 to 10.