CN113269036A - Method, system, device and storage medium for determining face coordinates on thermal imaging - Google Patents
Method, system, device and storage medium for determining face coordinates on thermal imaging Download PDFInfo
- Publication number
- CN113269036A CN113269036A CN202110396783.XA CN202110396783A CN113269036A CN 113269036 A CN113269036 A CN 113269036A CN 202110396783 A CN202110396783 A CN 202110396783A CN 113269036 A CN113269036 A CN 113269036A
- Authority
- CN
- China
- Prior art keywords
- face
- camera
- thermal imaging
- width
- blind zone
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000001931 thermography Methods 0.000 title claims abstract description 75
- 238000000034 method Methods 0.000 title claims abstract description 45
- 238000010586 diagram Methods 0.000 claims abstract description 74
- 238000003384 imaging method Methods 0.000 claims abstract description 42
- 238000004364 calculation method Methods 0.000 claims abstract description 18
- 230000000007 visual effect Effects 0.000 claims description 32
- 238000004590 computer program Methods 0.000 claims description 16
- 230000036760 body temperature Effects 0.000 claims description 9
- 238000001514 detection method Methods 0.000 description 6
- 238000009529 body temperature measurement Methods 0.000 description 5
- 230000008901 benefit Effects 0.000 description 4
- 238000004422 calculation algorithm Methods 0.000 description 4
- 238000004861 thermometry Methods 0.000 description 3
- 238000006243 chemical reaction Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 230000002452 interceptive effect Effects 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 238000013135 deep learning Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000007429 general method Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
-
- G—PHYSICS
- G07—CHECKING-DEVICES
- G07C—TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
- G07C9/00—Individual registration on entry or exit
- G07C9/30—Individual registration on entry or exit not involving the use of a pass
- G07C9/32—Individual registration on entry or exit not involving the use of a pass in combination with an identity check
- G07C9/37—Individual registration on entry or exit not involving the use of a pass in combination with an identity check using biometric data, e.g. fingerprints, iris scans or voice recognition
Abstract
The application relates to a method, a system, equipment and a storage medium for determining face coordinates on thermal imaging, and belongs to the technical field of face recognition. The method comprises the following steps: acquiring an imaging diagram shot by an entrance guard camera and a thermodynamic diagram shot by a thermal imaging camera; acquiring a first face coordinate of a field angle superposition area of a thermal imaging camera and an access control camera, wherein the first face coordinate is obtained by identifying an imaging picture by access control equipment; and substituting the first face coordinate into a preset formula to calculate a second face coordinate on the thermodynamic diagram. In the embodiment of the application, the face coordinates on the thermodynamic diagram can be quickly positioned through small calculation power, the CPU load is small in the calculation process, the identification picture of the access control equipment is smooth, and good experience of a user can be guaranteed.
Description
Technical Field
The present application relates to the field of face recognition technologies, and in particular, to a method, a system, an electronic device, and a storage medium for determining face coordinates in thermal imaging in an access control scene.
Background
The body temperature is measured by using an infrared thermal imaging method, and the method has the advantages of rapidness, convenience, unattended operation and the like. Each pixel point on the thermal imaging picture contains temperature information. The process of temperature measurement is to search out the temperature of the person on the thermodynamic diagram, but since the entire thermodynamic diagram contains the entire environment, there may be interfering factors such as high temperature objects, other people around, etc., the whole thermodynamic diagram, if used for searching, will be affected by these interfering factors. In order to accurately measure the temperature of a person, the position and size of the person in the thermodynamic diagram needs to be identified.
In the related art, a general method for detecting a face is to collect a large number of pictures, calibrate the face in the pictures, train a face detection model by using a deep learning algorithm, and detect the pictures by using the model to determine the position and size of the face. However, the user use environments are different, and it is difficult to collect thermodynamic diagrams of the user in various scenes. In addition, the door access is an embedded device, the calculation is limited, and if a face detection model is adopted to detect the thermodynamic diagram in the existing function, the load of a CPU is too heavy, and the picture is blocked.
Disclosure of Invention
The embodiment of the application provides a method, a system, electronic equipment and a storage medium for determining coordinates of a face on thermal imaging in an entrance guard scene, so as to at least solve the technical problem of how to accurately identify the position and size of the face on a thermodynamic diagram in the related art.
In a first aspect, an embodiment of the present application provides a method for determining coordinates of a face on thermal imaging in an access scene, where the method includes: acquiring an imaging picture shot by an entrance guard camera and a thermodynamic diagram shot by a thermal imaging camera; acquiring a first face coordinate of a field angle coincidence region of the thermal imaging camera and the access control camera, wherein the first face coordinate is obtained by identifying the imaging image by access control equipment; and substituting the first face coordinate into a preset formula to calculate a second face coordinate on the thermodynamic diagram.
In some of these embodiments, the formula is:
x′＝a′+K1*(270-a′-d′)*((x-a)/(720-a-d))
y′＝b′+K2*(360-b′-c′)*((y-b)/(1280-b-c))
wherein x 'is the abscissa of the second face coordinate, and y' is the ordinate of the second face coordinate; x is the abscissa of the first face coordinate, and y is the ordinate of the first face coordinate;
a is the width of a visual angle blind zone at the left side of the thermal imaging camera, b is the width of a visual angle blind zone above the thermal imaging camera,
c is the width of the visual angle blind zone below the thermal imaging camera, d is the width of the right side visual angle blind zone of the thermal imaging camera,
a 'is the width of the blind zone of the visual angle at the left side of the access control camera, b' is the width of the blind zone of the visual angle above the access control camera,
c 'is the width of the blind zone of the visual angle below the access control camera, d' is the width of the blind zone of the visual angle on the right side of the access control camera,
k1, K2 are constants.
In some of these embodiments, each of the widths of the view angle dead zones is measured by Photoshop during movement of the target object.
In some embodiments, after calculating the second face coordinates on the thermodynamic diagram by substituting the first face coordinates into a preset formula, the method includes: retrieving the highest temperature point of the face area on the thermodynamic diagram according to the second face coordinate; the average temperature of the predetermined region is calculated as the human body temperature with the maximum temperature point as the center.
In a second aspect, an embodiment of the present application provides a system for determining coordinates of a face on thermal imaging in an access scene, including: the system comprises an access control camera, a thermal imaging camera and a calculation module, wherein the access control camera is used for shooting an imaging picture; the thermal imaging camera is used for shooting a thermodynamic diagram; the calculation module is used for acquiring the imaging diagram and the thermodynamic diagram; acquiring a first face coordinate of a field angle superposition area of the thermal imaging camera and the access control camera, wherein the first face coordinate is obtained by identifying the imaging graph by access control equipment; and substituting the first face coordinate into a preset formula to calculate a second face coordinate on the thermodynamic diagram.
In some of these embodiments, the formula is:
x′＝a′+K1*(270-a′-d′)*((x-a)/(720-a-d))
y′＝b′+K2*(360-b′-c′)*((y-b)/(1280-b-c))
wherein x 'is the abscissa of the second face coordinate, and y' is the ordinate of the second face coordinate; x is the abscissa of the first face coordinate, and y is the ordinate of the first face coordinate;
a is the width of a visual angle blind zone at the left side of the thermal imaging camera, b is the width of a visual angle blind zone above the thermal imaging camera,
c is the width of the visual angle blind zone below the thermal imaging camera, d is the width of the right side visual angle blind zone of the thermal imaging camera,
a 'is the width of the blind zone of the visual angle at the left side of the access control camera, b' is the width of the blind zone of the visual angle above the access control camera,
c 'is the width of the blind zone of the visual angle below the access control camera, d' is the width of the blind zone of the visual angle on the right side of the access control camera,
k1, K2 are constants.
In some of these embodiments, each of the widths of the view angle dead zones is measured by Photoshop during movement of the target object.
In some embodiments, after the first face coordinate is substituted into a preset formula to calculate a second face coordinate on the thermodynamic diagram, the calculation module is further configured to retrieve a highest temperature point of a face area on the thermodynamic diagram according to the second face coordinate; the average temperature of the predetermined region is calculated as the human body temperature with the maximum temperature point as the center.
In a third aspect, an embodiment of the present application provides an electronic device, including a memory and a processor, where the memory stores a computer program, and the processor is configured to execute the computer program to perform any one of the methods described above.
In a fourth aspect, the present application provides a storage medium having a computer program stored therein, wherein the computer program is configured to execute any one of the above methods when the computer program runs.
Compared with the prior art, the method for determining the face coordinates in the thermal imaging in the entrance guard scene comprises the following steps: acquiring an imaging diagram shot by an entrance guard camera and a thermodynamic diagram shot by a thermal imaging camera; acquiring a first face coordinate of a field angle superposition area of a thermal imaging camera and an access control camera, wherein the first face coordinate is obtained by identifying an imaging picture by access control equipment; and substituting the first face coordinate into a preset formula to calculate a second face coordinate on the thermodynamic diagram. According to the embodiment of the application, the face coordinates on the thermodynamic diagram can be quickly positioned through small calculation force, the CPU load is small in the calculation process, and the identification picture of the access control equipment is smooth.
Drawings
The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the application and together with the description serve to explain the application and not to limit the application. In the drawings:
fig. 1 is a flowchart of a method for determining face coordinates on thermal imaging in an access control scenario according to an embodiment of the present application;
fig. 2 is a schematic representation diagram of a thermal imaging camera and an entrance guard camera overlapping field of view according to an embodiment of the present application;
FIG. 3 is a schematic representation of an imaging graph and a thermodynamic diagram according to an embodiment of the present application;
FIG. 4 is a schematic representation of the face position and size on an image according to an embodiment of the present application;
FIG. 5 is a schematic flow chart including a temperature measurement step according to an embodiment of the present application;
FIG. 6 is a block diagram of a system for determining face coordinates in thermal imaging in an access control scenario according to an embodiment of the present application;
fig. 7 is an internal structural diagram of an electronic device according to an embodiment of the present application.
Detailed Description
In order to make the purpose, technical solution and advantages of the present application more apparent, the present application will be described and illustrated with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments provided in the present application without any inventive step are within the scope of protection of the present application. Moreover, it should be further appreciated that such a development effort might be complex and tedious, but would nevertheless be a routine undertaking of design, fabrication, and manufacture for those of ordinary skill having the benefit of this disclosure, and it should be understood that such a development effort might be complex and tedious.
Reference in the specification to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the specification. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. Those of ordinary skill in the art will explicitly and implicitly appreciate that the embodiments described herein may be combined with other embodiments without conflict.
Unless defined otherwise, technical or scientific terms referred to herein shall have the ordinary meaning as understood by those of ordinary skill in the art to which this application belongs. Reference to "a," "an," "the," and similar words throughout this application are not to be construed as limiting in number, and may refer to the singular or the plural. The present application is directed to the use of the terms "including," "comprising," "having," and any variations thereof, which are intended to cover non-exclusive inclusions; for example, a process, method, system, article, or apparatus that comprises a list of steps or modules (elements) is not limited to the listed steps or elements, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus. Reference throughout this application to "connected," "coupled," and the like are not intended to be limited to physical or mechanical connections, but may include electrical connections, whether direct or indirect. Reference herein to "a plurality" means greater than or equal to two. "and/or" describes the association relationship of the associated objects, meaning that there may be three relationships, for example, "a and/or B" may mean: a exists alone, A and B exist simultaneously, and B exists alone. Reference herein to the terms "first," "second," "third," etc., merely distinguish similar objects and do not represent a particular ordering for the objects.
The embodiment of the application provides a method for determining coordinates of a face on thermal imaging in an access scene, and fig. 1 is a flowchart of the method for determining coordinates of the face on thermal imaging in the access scene according to the embodiment of the application, and as shown in fig. 1, the method includes the following steps:
s101: acquiring an imaging diagram shot by an entrance guard camera and a thermodynamic diagram shot by a thermal imaging camera;
s102: acquiring a first face coordinate of a thermal imaging camera and a field angle coincidence region of an access control camera, wherein the first face coordinate is obtained by identifying an imaging picture by access control equipment;
s103: and substituting the first face coordinate into a preset formula to calculate a second face coordinate on the thermodynamic diagram.
According to the content, the face coordinates on the thermodynamic diagram can be quickly positioned through small calculation force, the CPU load is small in the calculation process, the identification picture of the access control equipment is smooth, and good experience of a user can be guaranteed.
The above steps are described in detail below for the sake of clarity in describing the present application.
Step S101: an imaging diagram taken by the door access camera and a thermodynamic diagram taken by the thermal imaging camera are obtained. For example, the infrared thermometry instrument is fixed above the access control device, when the access control device performs face recognition, the distance between the recognized person and the access control device is relatively fixed, at this time, a camera of the access control device (which may be called "access control camera") shoots an imaging diagram, and a thermal imaging camera of the infrared thermometry instrument shoots a thermal diagram.
Step S102: and acquiring a first face coordinate of the thermal imaging camera and the field angle coincidence region of the access control camera, wherein the first face coordinate is obtained by identifying the imaging graph by the access control camera.
For example, after the infrared thermometry instrument and the face recognition access control device are fixed in a manner of being stacked up and down, the Field of View (FOV) of the thermal imaging camera and the access control camera has a certain overlapping area, and in actual use, the relative positions of the two cameras are not changed.
Fig. 2 is a schematic representation of a thermal imaging camera and an entrance guard camera overlapping area according to an embodiment of the present application, and as shown in fig. 2, a grid area is an overlapping area where the angles of view of the two cameras intersect; the blank area where the angles of view intersect is a non-overlapping area where the angles of view of the two cameras cannot be seen simultaneously because the two cameras are located at different positions and thus have different angles of view.
From the principle of pinhole imaging, the size and position of an object and its size and position for imaging are in equal proportion. In the embodiment of the application, the position and the size of the face on an imaging graph are detected through face recognition access control equipment, and then the position and the size of the face on the thermodynamic graph are converted.
Fig. 3 is a schematic representation diagram of an imaging graph and a thermodynamic diagram according to an embodiment of the present disclosure, where, as shown in fig. 3, RGB is an imaging graph (for example, YUV format) captured by an entrance guard camera, and IR is a thermodynamic diagram captured by a thermal imaging camera. The image may be black and white, but may preferably be colored in order to improve the accuracy of recognition.
Fig. 4 is a schematic representation of the position and size of the face on the imaging graph according to the embodiment of the present application, and as shown in fig. 4, the position and size of the face on the imaging graph are represented as (x, y, w, h), where w is the width of the face on the imaging graph, h is the length of the face on the imaging graph, and (x, y) is the position of the face on the imaging graph (e.g., the coordinates of the upper left corner of the face). Then, the coordinates of the face on the imaging graph are substituted into a preset formula, and the position and the size (x ', y', w ', h') of the face on the thermodynamic diagram can be calculated, wherein w 'is the width of the face on the thermodynamic diagram, h' is the length of the face on the thermodynamic diagram, and (x ', y') is the position of the face on the thermodynamic diagram. It should be noted that, in order to clearly distinguish the face coordinates on the imaging chart from the face coordinates on the thermodynamic chart, the former is referred to as "first face coordinates", and the latter is referred to as "second face coordinates".
Step S103: and substituting the first face coordinate into a preset formula to calculate a second face coordinate on the thermodynamic diagram. Continuing with fig. 3, assume that the size of the imaging graph (i.e., RGB) is 720 x 1280 pixels and the size of the thermal graph (i.e., IR) is 270 x 360 pixels. In the view angle overlapping region, the coordinates (x, y) of an arbitrary point on the imaging map and the coordinates (x ', y') of the corresponding point on the thermodynamic map have the following relationship:
K1*((x-a)/(720-a-d))＝(x'-a')/(270-a'-d')
K2*((y-b)/(1280-b-c))＝(y'-b')/(360-b'-c')
after conversion, the following can be obtained:
x'＝a'+K1*(270-a'-d')*((x-a)/(720-a-d))
y'＝b'+K2*(360-b'-c')*((y-b)/(1280-b-c))
wherein x 'is the abscissa of the second face coordinate, and y' is the ordinate of the second face coordinate; x is the abscissa of the first face coordinate, and y is the ordinate of the first face coordinate;
a is the width of a visual angle blind zone at the left side of the thermal imaging camera, b is the width of a visual angle blind zone above the thermal imaging camera,
c is the width of the visual angle blind zone below the thermal imaging camera, d is the width of the visual angle blind zone at the right side of the thermal imaging camera,
a 'is the width of a viewing angle blind zone on the left side of the access control camera, b' is the width of a viewing angle blind zone above the access control camera,
c 'is the width of the viewing angle blind zone below the entrance guard camera, d' is the width of the viewing angle blind zone at the right side of the entrance guard camera,
k1, K2 are constants.
According to the above contents, for the face in the overlapping area of the field angles, after the face coordinates on the imaging graph are recognized by the access control device, the face coordinates on the thermodynamic diagram can be derived according to the above formula.
The calculation of K1 and K2 is described in detail below.
As an example, specific values of the respective widths a, b, c, d, a ', b', c ', d' of the above view angle dead zones may be measured by Photoshop during the movement of the target object. For example, the target object is moved from left to right, from right to left, from top to bottom, and from bottom to top, respectively, in the above process, several frames of RGB and IR images are collected, and the overlapping area of the RGB and IR images is found by a Photoshop tool, so as to obtain the values of a, b, c, d, a ', b', c ', d'. Then, the target object is simultaneously appeared in the RGB and IR images, and the pixel coordinate values (x, y) of the target object in the imagewise map and the pixel coordinate values (x ', y') in the thermography are checked by Photoshop.
Then, the value of K1 can be calculated by substituting the values of a, d, a ', d ' x, x ' into the following equation:
K1*((x-a)/(720-a-d))＝(x’-a’)/(270-a’-d’)；
the value of K2 can be calculated by substituting the values of b, c, b ', c ', y, y ' into the following equation:
K2*((y-b)/(1280-b-c))＝(y’-b’)/(360-b’-c’)。
as an example, when obtaining the values of a and a ', first, a target point is selected on the target object, the target point is moved from left to right in the field angle, when the target point reaches the start point of the field angle coincidence region, an image (including RGB and IR images) is captured, a brush (e.g., Photoshop) is used to open the image, the brush reports the coordinates of the target point at this time, for example, the pixel coordinates on the RGB image are (335,470), in this sampling, a is 335, and a' is 0;
the same method is adopted:
the target point is moved from right to left in the angle of view, an image is captured when the target point reaches the start point of the angle of view overlapping area, and d is 93 and d' is 0, for example, from the captured image
The target point is moved from top to bottom in the field angle, an image is acquired when the target point reaches the start point of the field angle overlapping region, and based on the acquired image, for example, b is 0, b is 118
The target point is moved from bottom to top in the field angle, and when the target point reaches the start point of the field angle overlapping region, an image is captured, and from the captured image, for example, c is 0 and c' is 32.
As an example, the obtained parameters (including a, b, c, d, a ', b', c ', d', K1, and K2) are stored in a face recognition access control device, the first face coordinates on an imaging map are detected at the moment when temperature measurement is required, the second face coordinates on the corresponding thermodynamic diagram are calculated through the above formula, and since each coordinate (i.e., pixel point) on the thermodynamic diagram contains temperature information, the temperature information on the second face coordinates can be obtained. Therefore, an entrance guard application scene with an infrared temperature measurement function is built in the embodiment of the application, and when entrance guard equipment completes face recognition, the temperature of the face can be rapidly measured.
Further, in order to reduce data errors and improve the accuracy of temperature measurement results, after a first face coordinate is substituted into a preset formula to calculate a second face coordinate on the thermodynamic diagram, the highest temperature point of a face area on the thermodynamic diagram is retrieved according to the second face coordinate, and the face area can be obtained according to the second face coordinate; then, the average temperature of the predetermined region is calculated as the human body temperature with the highest temperature point as the center.
For example, after the first face coordinate is substituted into a preset formula to calculate a second face coordinate on the thermodynamic diagram, the highest temperature point of a face area on the thermodynamic diagram is retrieved according to the second face coordinate; the average temperature of 2 × 2 pixel regions is calculated centering on the highest temperature point to be output as a result of the human body temperature.
A specific example is given below to further illustrate the embodiments of the present application.
FIG. 5 is a schematic diagram of a process including a temperature measuring step according to an embodiment of the present application, and as shown in FIG. 5, the process includes the following steps:
step S501: and simultaneously opening an access control camera and a thermal imaging camera, wherein the access control camera shoots a colorful imaging picture, and the thermal imaging camera is a component of the infrared temperature measuring instrument.
Step S502: and taking a frame of imaging picture from the access control camera, and sending the imaging picture data to a face detection algorithm module for detection.
Step S503: the face detection algorithm module detects whether a face exists.
Step S504: and after the face coordinates are acquired from the face detection algorithm module, the face coordinates of the thermal imaging are obtained through conversion according to a preset formula.
Step S505: and searching the highest temperature point of the face region according to the face coordinates of the thermal imaging, and calculating the average temperature of the 2 x 2 pixel region by taking the highest temperature point as the center to output as the result of the human body temperature.
In summary, the embodiments of the present application have the following advantages: the face coordinates on the thermodynamic diagram can be quickly positioned through small calculation power, the CPU load is small in the calculation process, the identification picture of the access control equipment is smooth, and good experience of a user can be guaranteed.
The embodiment of the application further provides a system for determining coordinates of a face on a thermal imaging in an access scene, and fig. 6 is a structural block diagram of the system for determining coordinates of the face on the thermal imaging in the access scene according to the embodiment of the application, and as shown in fig. 6, the system comprises an access camera 1, a thermal imaging camera 2 and a calculation module 3, wherein the access camera 1 is used for shooting an imaging diagram, the thermal imaging camera 2 is used for shooting a thermodynamic diagram, and the calculation module 3 is used for obtaining the imaging diagram and the thermodynamic diagram; acquiring a first face coordinate of a field angle overlapping region of the thermal imaging camera 2 and the access control camera 1, wherein the first face coordinate is obtained by identifying an imaging picture by access control equipment; and substituting the first face coordinate into a preset formula to calculate a second face coordinate on the thermodynamic diagram.
Preferably, in this embodiment of the present application, the computing module 3 may be disposed in an access control device, so as to improve the usability of the whole system.
As an example, the above formula is:
x′＝a′+K1*(270-a′-d′)*((x-a)/(720-a-d))
y′＝b′+K2*(360-b′-c′)*((y-b)/(1280-b-c))
wherein x 'is the abscissa of the second face coordinate, and y' is the ordinate of the second face coordinate; x is the abscissa of the first face coordinate, and y is the ordinate of the first face coordinate;
a is the width of a blind zone of the visual angle at the left side of the thermal imaging camera 2, b is the width of a blind zone of the visual angle above the thermal imaging camera 2,
c is the width of the blind zone of the visual angle below the thermal imaging camera 2, d is the width of the blind zone of the visual angle at the right side of the thermal imaging camera 2,
a 'is the width of a viewing angle blind zone at the left side of the access control camera 1, b' is the width of a viewing angle blind zone above the access control camera 1,
c 'is the width of the viewing angle blind zone below the access control camera 1, d' is the width of the viewing angle blind zone at the right side of the access control camera 1,
k1, K2 are constants.
As an example, the respective widths of the view angle dead zones are measured by Photoshop during the movement of the target object.
As an example, after the first face coordinate is substituted into the preset formula to calculate the second face coordinate on the thermodynamic diagram, the calculating module 3 is further configured to retrieve the highest temperature point of the face area on the thermodynamic diagram according to the second face coordinate; the average temperature of the predetermined region is calculated as the human body temperature with the highest temperature point as the center.
It should be noted that, in the embodiment of the present application, each module may be a functional module or a program module, and may be implemented by software or hardware. For a module implemented by hardware, the various modules may be located in the same processor; or the modules may be located in different processors in any combination.
In addition, in combination with the method for determining the coordinates of the face on the thermal imaging in the access control scene in the embodiment, the embodiment of the application can be implemented by providing a storage medium. The storage medium having stored thereon a computer program; the computer program, when executed by a processor, implements a method of determining coordinates of a human face on thermal imaging in any one of the embodiments in an access scenario.
In one embodiment, fig. 7 is a schematic diagram of an internal structure of an electronic device according to an embodiment of the present application, and as shown in fig. 7, there is provided an electronic device, which may be a server, and an internal structure diagram of which may be as shown in fig. 7. The electronic device includes a processor, a network interface, an internal memory, and a non-volatile memory, which stores an operating system, a computer program, and a database, connected by an internal bus. The processor is used for providing calculation and control capability, the network interface is used for communicating with an external terminal through network connection, the internal memory is used for providing an environment for an operating system and the running of a computer program, the computer program is executed by the processor to realize a method for determining coordinates of a human face on thermal imaging in an access scene, and the database is used for storing data.
Those skilled in the art will appreciate that the architecture shown in fig. 7 is a block diagram of only a portion of the architecture associated with the subject application, and does not constitute a limitation on the electronic devices to which the subject application may be applied, and that a particular electronic device may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by a computer program, which can be stored in a non-volatile computer-readable storage medium, and can include the processes of the embodiments of the methods described above when the computer program is executed. Any reference to memory, storage, database, or other medium used in the embodiments provided herein may include non-volatile and/or volatile memory, among others. Non-volatile memory can include read-only memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDRSDRAM), Enhanced SDRAM (ESDRAM), Synchronous Link DRAM (SLDRAM), Rambus Direct RAM (RDRAM), direct bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).
It should be understood by those skilled in the art that various features of the above-described embodiments can be combined in any combination, and for the sake of brevity, all possible combinations of features in the above-described embodiments are not described in detail, but rather, all combinations of features which are not inconsistent with each other should be construed as being within the scope of the present disclosure.
The above-mentioned embodiments only express several embodiments of the present application, and the description thereof is more specific and detailed, but not construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present patent application shall be subject to the appended claims.
Claims (10)
1. A method for determining face coordinates on thermal imaging in an entrance guard scene is characterized by comprising the following steps:
acquiring an imaging diagram shot by an entrance guard camera and a thermodynamic diagram shot by a thermal imaging camera;
acquiring a first face coordinate of a field angle superposition area of the thermal imaging camera and the access control camera, wherein the first face coordinate is obtained by identifying the imaging picture by access control equipment;
and substituting the first face coordinate into a preset formula to calculate a second face coordinate on the thermodynamic diagram.
2. The method of claim 1, wherein the formula is:
x′＝a′+K1*(270-a′-d′)*((x-a)/(720-a-d))
y′＝b′+K2*(360-b′-c′)*((y-b)/(1280-b-c))
wherein x 'is the abscissa of the second face coordinate, and y' is the ordinate of the second face coordinate; x is the abscissa of the first face coordinate, and y is the ordinate of the first face coordinate;
a is the width of the visual angle blind zone at the left side of the thermal imaging camera, b is the width of the visual angle blind zone above the thermal imaging camera,
c is the width of the visual angle blind zone below the thermal imaging camera, d is the width of the visual angle blind zone at the right side of the thermal imaging camera,
a 'is the width of the viewing angle blind zone at the left side of the access control camera, b' is the width of the viewing angle blind zone above the access control camera,
c 'is the width of the viewing angle blind zone below the entrance guard camera, d' is the width of the viewing angle blind zone on the right side of the entrance guard camera,
k1, K2 are constants.
3. The method of claim 2, wherein each of said widths of said view blind zones is measured by Photoshop during movement of the target object.
4. The method according to claim 1, wherein after calculating the second face coordinates on the thermodynamic diagram by substituting the first face coordinates into a preset formula, the method comprises:
retrieving the highest temperature point of the face area on the thermodynamic diagram according to the second face coordinate; the average temperature of the predetermined region is calculated as the human body temperature with the maximum temperature point as the center.
5. A system for determining face coordinates on thermal imaging in an access scene, comprising:
the access control camera is used for shooting an imaging picture;
the thermal imaging camera is used for shooting a thermodynamic diagram;
the calculation module is used for acquiring the imaging map and the thermodynamic map; acquiring a first face coordinate of a field angle superposition area of the thermal imaging camera and the access control camera, wherein the first face coordinate is obtained by identifying the imaging picture by access control equipment; and substituting the first face coordinate into a preset formula to calculate a second face coordinate on the thermodynamic diagram.
6. The system of claim 5, wherein the formula is:
x′＝a′+K1*(270-a′-d′)*((x-a)/(720-a-d))
y′＝b′+K2*(360-b′-c′)*((y-b)/(1280-b-c))
wherein x 'is the abscissa of the second face coordinate, and y' is the ordinate of the second face coordinate; x is the abscissa of the first face coordinate, and y is the ordinate of the first face coordinate;
a is the width of the visual angle blind zone at the left side of the thermal imaging camera, b is the width of the visual angle blind zone above the thermal imaging camera,
c is the width of the visual angle blind zone below the thermal imaging camera, d is the width of the visual angle blind zone at the right side of the thermal imaging camera,
a 'is the width of the viewing angle blind zone at the left side of the access control camera, b' is the width of the viewing angle blind zone above the access control camera,
c 'is the width of the viewing angle blind zone below the entrance guard camera, d' is the width of the viewing angle blind zone on the right side of the entrance guard camera,
k1, K2 are constants.
7. The system of claim 6, wherein each of said widths of said view angle dead zones is measured by Photoshop during movement of the target object.
8. The system according to claim 5, wherein after the first face coordinates are substituted into a preset formula to calculate second face coordinates on the thermodynamic diagram, the calculation module is further configured to retrieve a highest temperature point of a face area on the thermodynamic diagram according to the second face coordinates; the average temperature of the predetermined region is calculated as the human body temperature with the maximum temperature point as the center.
9. An electronic device comprising a memory and a processor, wherein the memory has stored therein a computer program, and wherein the processor is arranged to execute the computer program to perform the method of any of claims 1 to 4.
10. A storage medium, in which a computer program is stored, wherein the computer program is arranged to perform the method of any of claims 1 to 4 when executed.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110396783.XA CN113269036A (en) | 2021-04-13 | 2021-04-13 | Method, system, device and storage medium for determining face coordinates on thermal imaging |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110396783.XA CN113269036A (en) | 2021-04-13 | 2021-04-13 | Method, system, device and storage medium for determining face coordinates on thermal imaging |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113269036A true CN113269036A (en) | 2021-08-17 |
Family
ID=77228791
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110396783.XA Pending CN113269036A (en) | 2021-04-13 | 2021-04-13 | Method, system, device and storage medium for determining face coordinates on thermal imaging |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113269036A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114093015A (en) * | 2022-01-21 | 2022-02-25 | 杭州魔点科技有限公司 | Intelligent light supplementing method for face recognition, electronic equipment and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2010281811A (en) * | 2009-05-08 | 2010-12-16 | Univ Of Miyazaki | Device for making temperature image three dimensional |
| CN111426388A (en) * | 2020-03-31 | 2020-07-17 | 高新兴科技集团股份有限公司 | Personnel body temperature measuring method, system, computer storage medium and electronic equipment |
| CN112229524A (en) * | 2020-10-27 | 2021-01-15 | 深圳英飞拓科技股份有限公司 | Body temperature screening method and device, terminal equipment and storage medium |
| CN112414558A (en) * | 2021-01-25 | 2021-02-26 | 深圳市视美泰技术股份有限公司 | Temperature detection method and device based on visible light image and thermal imaging image |
-
2021
- 2021-04-13 CN CN202110396783.XA patent/CN113269036A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2010281811A (en) * | 2009-05-08 | 2010-12-16 | Univ Of Miyazaki | Device for making temperature image three dimensional |
| CN111426388A (en) * | 2020-03-31 | 2020-07-17 | 高新兴科技集团股份有限公司 | Personnel body temperature measuring method, system, computer storage medium and electronic equipment |
| CN112229524A (en) * | 2020-10-27 | 2021-01-15 | 深圳英飞拓科技股份有限公司 | Body temperature screening method and device, terminal equipment and storage medium |
| CN112414558A (en) * | 2021-01-25 | 2021-02-26 | 深圳市视美泰技术股份有限公司 | Temperature detection method and device based on visible light image and thermal imaging image |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114093015A (en) * | 2022-01-21 | 2022-02-25 | 杭州魔点科技有限公司 | Intelligent light supplementing method for face recognition, electronic equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10503966B1 (en) | Binocular pedestrian detection system having dual-stream deep learning neural network and the methods of using the same | |
| US8384783B2 (en) | Infrared camera and method for calculating output power value indicative of an amount of energy dissipated in an image view | |
| JP7293169B2 (en) | Distance measuring device for video camera focus applications | |
| TWI528019B (en) | System and method for estimating three-dimensional packaging size of an object | |
| EP3547259A2 (en) | Image-based position detection method, image-based position detection apparatus, device and storage medium | |
| JP4929828B2 (en) | Three-dimensional authentication method, three-dimensional authentication device, and three-dimensional authentication program | |
| JP5035467B2 (en) | Three-dimensional authentication method, three-dimensional authentication device, and three-dimensional authentication program | |
| WO2021259365A1 (en) | Target temperature measurement method and apparatus, and temperature measurement system | |
| WO2022241964A1 (en) | Temperature measuring method, computer device, and computer-readable storage medium | |
| EP3438875A1 (en) | Image processing apparatus and control method therefor | |
| CN111144398A (en) | Target detection method, target detection device, computer equipment and storage medium | |
| CN110796709A (en) | Method and device for acquiring size of frame number, computer equipment and storage medium | |
| US11037014B2 (en) | Image processing apparatus, image processing method, and non-transitory computer-readable storage medium | |
| US10643338B2 (en) | Object detection device and object detection method | |
| CN113269036A (en) | Method, system, device and storage medium for determining face coordinates on thermal imaging | |
| JP2020123304A (en) | Image processing system, imaging device, image processing device, electronic apparatus, control method thereof, and program | |
| CN111652314A (en) | Temperature detection method and device, computer equipment and storage medium | |
| KR20190136931A (en) | Information processing device, imaging device, information processing method, and storage medium | |
| CN113569594A (en) | Method and device for labeling key points of human face | |
| US9811740B2 (en) | Computer-readable medium storing therein image processing program, image processing device, and image processing method | |
| CN113992904B (en) | Information processing method, device, electronic equipment and readable storage medium | |
| CN110569921A (en) | Vehicle logo identification method, system, device and computer readable medium | |
| CN111611836A (en) | Ship detection model training and ship tracking method based on background elimination method | |
| CN114511556B (en) | Gastric mucosa bleeding risk early warning method and device and medical image processing equipment | |
| US20170069109A1 (en) | Method and apparatus for measuring an object |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210817 |
|
| RJ01 | Rejection of invention patent application after publication |