CN111426388A - Personnel body temperature measuring method, system, computer storage medium and electronic equipment - Google Patents
Personnel body temperature measuring method, system, computer storage medium and electronic equipment Download PDFInfo
- Publication number
- CN111426388A CN111426388A CN202010244864.3A CN202010244864A CN111426388A CN 111426388 A CN111426388 A CN 111426388A CN 202010244864 A CN202010244864 A CN 202010244864A CN 111426388 A CN111426388 A CN 111426388A
- Authority
- CN
- China
- Prior art keywords
- face
- visible light
- image
- face area
- body temperature
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 58
- 230000036760 body temperature Effects 0.000 title claims abstract description 28
- 238000009529 body temperature measurement Methods 0.000 claims abstract description 44
- 238000003331 infrared imaging Methods 0.000 claims abstract description 19
- 230000015654 memory Effects 0.000 claims description 32
- 238000001514 detection method Methods 0.000 claims description 29
- 238000003062 neural network model Methods 0.000 claims description 15
- 238000004364 calculation method Methods 0.000 claims description 7
- 238000005457 optimization Methods 0.000 claims description 4
- 238000005259 measurement Methods 0.000 abstract description 14
- 230000000007 visual effect Effects 0.000 abstract description 6
- 241000700605 Viruses Species 0.000 abstract description 3
- 210000000887 face Anatomy 0.000 description 24
- 238000012545 processing Methods 0.000 description 9
- 230000005855 radiation Effects 0.000 description 5
- 238000004590 computer program Methods 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 238000004891 communication Methods 0.000 description 3
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 2
- 238000007689 inspection Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 241000711573 Coronaviridae Species 0.000 description 1
- 230000003321 amplification Effects 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 238000013528 artificial neural network Methods 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 210000004709 eyebrow Anatomy 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 230000013011 mating Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 238000003199 nucleic acid amplification method Methods 0.000 description 1
- 238000012634 optical imaging Methods 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 210000001747 pupil Anatomy 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
- 230000009385 viral infection Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J5/00—Radiation pyrometry, e.g. infrared or optical thermometry
- G01J5/0022—Radiation pyrometry, e.g. infrared or optical thermometry for sensing the radiation of moving bodies
- G01J5/0025—Living bodies
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01K—MEASURING TEMPERATURE; MEASURING QUANTITY OF HEAT; THERMALLY-SENSITIVE ELEMENTS NOT OTHERWISE PROVIDED FOR
- G01K13/00—Thermometers specially adapted for specific purposes
- G01K13/20—Clinical contact thermometers for use with humans or animals
- G01K13/223—Infrared clinical thermometers, e.g. tympanic
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J5/00—Radiation pyrometry, e.g. infrared or optical thermometry
- G01J2005/0077—Imaging
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Human Computer Interaction (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Spectroscopy & Molecular Physics (AREA)
- Radiation Pyrometers (AREA)
Abstract
The invention provides a method and a system for measuring the body temperature of a person, a computer storage medium and electronic equipment, wherein the method comprises the following steps: s1, acquiring a visible light image in a shooting view field through a shooting device; s2, acquiring the face areas of all people and the position information corresponding to each face area from the visible light image; and S3, converting each face area into a thermal infrared imaging image respectively, and acquiring the temperature of each face area. According to the method for measuring the body temperature of the person, disclosed by the embodiment of the invention, the face region temperature of all the persons in the visual field can be quickly acquired, so that all the persons appearing in the shooting range of the shooting device can finish temperature measurement at one time, the simultaneous temperature measurement of multiple persons in an open scene is supported, the measurement efficiency is higher, the close contact of the persons can be avoided, and the virus propagation under special conditions is reduced.
Description
Technical Field
The present invention relates to the field of body temperature detection, and more particularly, to a method and a system for measuring a body temperature of a person, a computer storage medium, and an electronic device based on image processing.
Background
In the last 20 years, the non-contact thermal infrared human body thermometer is developed rapidly in technology, has improved performance, enhanced functions, increased varieties and expanded application range. Compared with a contact temperature measurement method, the thermal infrared temperature measurement has the advantages of fast response time, non-contact, safe use, long service life and the like. All objects with a temperature above absolute zero continuously emit infrared radiant energy into the surrounding space. The magnitude of the infrared radiation energy of an object and its distribution by wavelength are very closely related to its surface temperature. Therefore, the surface temperature of the object can be accurately measured by measuring the infrared energy radiated by the object, which is the basic principle of infrared radiation temperature measurement. The infrared thermal imager uses an infrared detector, an optical imaging objective lens and an optical scanning system to receive the infrared radiation energy distribution pattern of a detected target and reflect the infrared radiation energy distribution pattern to a photosensitive element of the infrared detector, if the infrared radiation energy distribution pattern can be converted into an electric signal, the thermal infrared image can be displayed through amplification processing, conversion or a standard video signal through a display.
The body temperature monitoring method based on thermal infrared imaging has been popularized and applied in customs, security inspection and other occasions, and is mainly divided into a handheld infrared thermometer and a fixed infrared thermometer.
At present, a method for measuring human face temperature by adopting infrared is already applied to a certain extent, a human face area in visible light is detected, then the human face area in a thermal infrared image is obtained through coordinate transformation, and temperature measurement is carried out on the area. The method utilizes visible light face detection to register the region to be measured, thereby improving the temperature measurement precision. However, the visible light image and the thermal infrared image adopted in the current method can only carry out one-time measurement on the target, and have the defect of low measurement precision.
In addition, the existing handheld infrared temperature measuring device needs the close contact between the measuring personnel and the measured personnel, and in some special periods, such as a novel coronavirus transmission period, the close contact between the measuring personnel and a potential patient directly increases the risk of virus infection; in addition, handheld infrared temperature measuring device single can only measure alone, and is inefficient, is difficult to satisfy the temperature measurement demand when crowd density is great.
And fixed infrared temperature measuring device based on the temperature measurement mode of grabbing the photograph, only under the circumstances of the personnel highly complex of being surveyed, can realize the registration of the visible light image of gathering and thermal infrared image, require single under the circumstances of passing through of single in some security installations such as customs, still can obtain higher measurement accuracy. However, in other open occasions, the fixed temperature measuring device with high matching degree is difficult to popularize and apply.
Disclosure of Invention
In order to solve the technical problems, the invention provides a method for measuring the body temperature of a person, which can avoid the close contact between a measuring person and the person to be measured and has high measuring efficiency.
A person body temperature measurement method according to an embodiment of a first aspect of the invention comprises the following steps: s1, acquiring a visible light image in a shooting view field through a shooting device; s2, acquiring the face areas of all people and the position information corresponding to each face area from the visible light image; and S3, converting each face area into a thermal infrared imaging image respectively, and acquiring the temperature of each face area.
According to the method for measuring the body temperature of the person, disclosed by the embodiment of the invention, the visible light images of all the persons in the shooting visual field are acquired at one time through the shooting device, the face areas and the corresponding related information of all the persons are detected from the visible light images, and then the images based on the full-image face detection are converted into the thermal infrared imaging images, so that the face area temperatures of all the persons in the visual field can be quickly acquired, all the persons appearing in the shooting range of the shooting device can finish temperature measurement at one time, the simultaneous temperature measurement of multiple persons in an open scene is supported, the measurement efficiency is higher, the close contact of the persons can be avoided, and the virus propagation under special conditions is reduced.
The method for measuring the body temperature of the person according to the embodiment of the invention can also have the following additional technical characteristics:
according to some embodiments of the invention, in step S1, the photographing distance of the photographing device is 5m-8m, and the visible light image is a visible light video stream.
According to some embodiments of the invention, step S2 includes: s21, based on the deep neural network model, positioning the position of a human face in each frame of image of the visible light video stream to obtain the human face area with position information; s22, respectively allocating IDs to all human faces in the visible light video stream and tracking; s23, respectively positioning key points of all human faces by using a deep neural network model; and S24, according to the key point positioning of each face, outputting the face area and the corresponding position information of which the key point positioning information meets the requirements of qualified faces.
According to some embodiments of the present invention, in step S24, the qualified face requires that the interpupillary distance of the face area and the turning angle of the face are both within a preset range.
According to some embodiments of the invention, further comprising the steps of: and S4, acquiring continuous multi-frame images for the same face area, measuring the temperature of the thermal infrared imaging image corresponding to each frame image, and acquiring the temperature average value of the multi-frame images.
According to some embodiments of the invention, in step S4, the multi-frame image is a 4-6 frame image.
A body temperature measurement system for a person according to an embodiment of the second aspect of the present invention comprises: the photographing device can acquire visible light images in a photographing field of view; the face detection module is connected with the photographing device and can acquire face areas of all people and position information corresponding to each face area from the visible light image; and the body temperature measuring module is connected with the face detection module, converts each face area into a thermal infrared imaging image respectively and acquires the temperature of each face area.
According to some embodiments of the invention, the photographing device has a photographing distance of 5m-8m, and the visible light image is a visible light video stream.
According to some embodiments of the invention, the face detection module comprises: the full-image detection module is used for positioning the position of a human face in each frame of image of the visible light video stream based on a deep neural network model to obtain the human face area with position information; the face tracking module is used for respectively allocating IDs to all faces in the visible light video stream and tracking the faces; the key point positioning module is used for respectively positioning key points of all the human faces by utilizing a deep neural network model; and the face optimization module is used for outputting the face area and the corresponding position information, the key point positioning information of which meets the requirements of qualified faces, according to the key point positioning of each face.
According to some embodiments of the invention, the body temperature measurement module further comprises: and the body temperature calculation module acquires continuous multi-frame images for the same face region, measures the temperature of the thermal infrared imaging image corresponding to each frame of image and acquires the average temperature value of the multi-frame images.
In a third aspect, an embodiment of the present invention provides a computer storage medium including one or more computer instructions, which when executed implement the method according to the above embodiment.
An electronic device according to a fourth aspect of the present invention comprises a memory for storing one or more computer instructions and a processor; the processor is configured to invoke and execute the one or more computer instructions to implement the method according to any of the embodiments described above.
Drawings
FIG. 1 is a flow chart of a method of measuring a body temperature of a person according to an embodiment of the present invention;
FIG. 2 is a flowchart of step S2 of a body temperature measurement method of a person according to an embodiment of the present invention;
FIG. 3 is a flowchart of step S3 of a body temperature measurement method of a person according to an embodiment of the present invention;
FIG. 4 is a schematic view of a body temperature measurement system according to an embodiment of the present invention;
fig. 5 is a schematic diagram of an electronic device according to an embodiment of the invention.
Reference numerals:
a personal temperature measurement system 100;
a photographing device 10;
a face detection module 20; a full picture detection module 21; a face tracking module 22; a key point positioning module 23; a face preference module 24;
a body temperature measuring module 30; a body temperature calculation module 31;
an electronic device 300;
a memory 310; an operating system 311; an application 312;
a processor 320; a network interface 330; an input device 340; a hard disk 350; a display device 360.
Detailed Description
The following detailed description of embodiments of the present invention will be made with reference to the accompanying drawings and examples. The following examples are intended to illustrate the invention but are not intended to limit the scope of the invention.
First, a method for measuring a body temperature of a person according to an embodiment of the present invention will be described in detail with reference to the accompanying drawings.
The method for measuring the body temperature of the person comprises the following steps:
and S1, acquiring the visible light image in the shooting visual field through the shooting device.
And S2, acquiring the face areas of all the people and the position information corresponding to each face area from the visible light image.
And S3, converting each face area into a thermal infrared imaging image respectively, and acquiring the temperature of each face area. The human face area and the thermal infrared imaging area are partially overlapped, under the condition that the scale is the same, the relative coordinates of four point coordinates of the thermal infrared image in the visible light image are directly used for obtaining a total temperature measurement area, the human face area is obtained in the temperature measurement area again by using the position information of human face detection, and then the human face temperature is obtained.
Therefore, according to the method for measuring the body temperature of the person, disclosed by the embodiment of the invention, the visible light images of all the persons in the shooting visual field are acquired at one time through the shooting device, the face areas and the corresponding related information of all the persons are detected from the visible light images, and then the images based on the full-image face detection are converted into the thermal infrared imaging images, so that the face area temperatures of all the persons in the visual field can be quickly acquired, all the persons appearing in the shooting range of the shooting device can finish temperature measurement at one time, the simultaneous temperature measurement of multiple persons in an open scene is supported, the measurement efficiency is higher, the close contact of the persons can be avoided, and the virus propagation under special conditions is reduced.
According to some embodiments of the invention, in step S1, the photographing distance of the photographing device is 5m-8m, and the visible light image is a visible light video stream.
That is to say, the method for measuring the body temperature of the person according to the embodiment of the invention can be applied to a patrol robot, and the patrol robot can be equipped with a vision device to shoot scenes in a shooting field of view, so that the person appearing in the field of view of the patrol robot can measure the temperature at one time. The method is convenient to use, can avoid close contact with a tested person, and has high detection efficiency.
In some embodiments of the invention, step S2 includes:
s21, based on the deep neural network model, positioning the position of the human face in each frame of image of the visible light video stream, and obtaining the human face area with position information.
And S22, respectively allocating IDs to all human faces in the visible light video stream and tracking.
And S23, respectively positioning key points of all the faces by using the deep neural network model.
And S24, according to the key point positioning of each face, outputting the face area and the corresponding position information of which the key point positioning information meets the requirements of qualified faces. In step S24, the qualified face is required to be the pupil distance of the face area and the turning angle of the face both located in a preset range.
When the size of an output video stream is 1920 × 1080, and the shooting distance is 5m-8m, the occupied area of the face is very small.
As shown in fig. 2, according to the method for measuring the body temperature of the person in the embodiment of the present invention, when the face areas of all the persons and the position information corresponding to each of the face areas are obtained from the visible light image, the following four steps are adopted:
1) face detection based on the whole image: based on the deep neural network model, positioning the position of a human face in each frame of image of the visible light video stream, and outputting a human face area with position information;
2) face tracking: distributing ID to the detected face in the video stream and accurately tracking;
3) positioning key points of the human face: performing key point positioning on the detected face by using a deep neural network model, for example, calibrating the positions of eyes, eyebrows and mouth;
4) the human face is preferably: and through the positioning of the key points of the human face in the last step, filtering the human face with improper interpupillary distance or improper angle, and outputting qualified human face queues comprising information such as detection frames, key points, tracking IDs and the like.
Wherein, the interpupillary distance scope of qualified people's face: assuming that the face width is 96 pixels, the standard interpupillary distance is 35 pixels, the ordinate of the left eye is 30, and the ordinate of the right eye is 65. The interpupillary distances of the human faces with different sizes are converted by the proportion, and the numerical values float up and down by 5 pixels.
The steering angle of the qualified face is as follows: the eyebrow center is taken as a center line, and the left and right steering angles are within 60 degrees.
In the full-face detection module aiming at the full image, information such as undetected faces, face key point positioning errors, unqualified faces and the like can occur, and the information is sent to a subsequent link and a result conforming to logic is output.
Therefore, through the steps, the operations of detecting, identifying, positioning, tracking and the like of a plurality of human faces in one image can be realized. Aiming at a visible light image shot by a patrol robot, a series of deep neural network models are adopted to detect a face region from the image, the face is tracked and key points are positioned, unqualified faces are filtered based on key point information, the optimized face region and related information are output, and the detection accuracy can be improved. In addition, the method adopts semi-fit temperature measurement, temperature measurement can be completed once only when a detected person appears in the shooting range of the patrol robot, simultaneous temperature measurement of multiple persons in an open scene is supported, and the measurement efficiency is higher.
According to some embodiments of the invention, further comprising the steps of: and S4, acquiring continuous multi-frame images for the same face area, measuring the temperature of the thermal infrared imaging image corresponding to each frame image, and acquiring the temperature average value of the multi-frame images. Preferably, in step S4, the multi-frame image is 4-6 frame images.
That is to say, when measuring the temperature of the thermal infrared imaging image, two methods may be adopted, or the two methods may be used in combination, wherein one method is to convert the face position area into the thermal infrared imaging image, so as to obtain the temperature of the face area; in another method, as shown in fig. 3, for the same person, the detection results of multiple continuous frames of qualified faces of the person are obtained, the thermal infrared image corresponding to each frame of visible light image is measured, and the average temperature value of the accumulated multiple frames of faces is obtained, so that misjudgment can be reduced, and the measurement accuracy is improved. The real-time performance requirement can be still achieved even if the average temperature of the human face is taken as 5 frames by video stream calculation of 25 frames per second.
Therefore, according to the method for measuring the body temperature of the person, disclosed by the embodiment of the invention, the face area on the corresponding thermal infrared image is calculated by utilizing the face area output by the visible light image and the related information, so that the temperature value of the face is obtained. If the tested person has multiple frames of qualified faces in the shooting video stream of the patrol robot, the corresponding thermal infrared image is measured, the accumulated average value is calculated, the temperature is output as the final result, the qualified face area and the related information are obtained based on the face detection, tracking and optimization of the visible light video stream, the face area in the thermal infrared image video stream is registered, and the measurement precision is improved in a multi-frame measurement mode.
As shown in FIG. 4, a body temperature measurement system 100 for a person according to an embodiment of the second aspect of the present invention comprises: the device comprises a photographing device 10, a face detection module 20 and a body temperature measurement module 30.
The photographing device 10 can acquire visible light images in a photographing field, the face detection module 20 is connected with the photographing device 10, the face detection module 20 can acquire face regions of all people and position information corresponding to each face region from the visible light images, the body temperature measurement module 30 is connected with the face detection module 20, and the body temperature measurement module 30 converts each face region into a thermal infrared imaging image respectively and acquires the temperature of each face region.
According to some embodiments of the present invention, the photographing apparatus 10 has a photographing distance of 5m-8m, and the visible light image is a visible light video stream.
In some embodiments of the present invention, the face detection module 20 comprises: a full image detection module 21, a face tracking module 22, a key point positioning module 23 and a face preference module 24.
Specifically, the full-image detection module 21 locates the position of a face in each frame image of the visible light video stream based on the deep neural network model to obtain a face region with position information, the face tracking module 22 assigns IDs to all faces in the visible light video stream and tracks them, the key point location module 23 locates key points of all faces by using the deep neural network model, and the face optimization module 24 locates key points according to the key points of each face and outputs the face region whose key point location information meets the requirements of qualified faces and the corresponding position information.
According to some embodiments of the invention, the body temperature measurement module 30 further comprises: the body temperature calculation module 31, the body temperature calculation module 31 obtains continuous multiframe images for the same face region, and measures the temperature of the thermal infrared imaging image corresponding to each frame image to obtain the average temperature value of the multiframe images.
It should be noted that the body temperature measurement system 100 according to the embodiment of the present invention may be used in a vision device of a patrol robot, and the system can realize remote and rapid measurement of a person to be measured. The method for measuring the body temperature of the person to be measured by the system is described in detail in the above embodiments, and therefore, the description is omitted.
In summary, according to the body temperature measurement system 100 of the embodiment of the present invention, based on the deep neural network, the visible light image processing and the infrared thermodynamic diagram are combined, and in an open scene separated by 5 meters, all the face areas of the person in the robot shooting field of view can be quickly and accurately located, and the body temperature measurement can be completed at one time.
This personnel body temperature measurement system 100 has realized the long-range accurate measurement of half mating type, only needs the surveyed personnel openly appear in the shooting field of inspection of patrol robot, obtains multiframe accumulative total average temperature measurement result through the mode of preferred qualified people's face in the video stream, when improving measurement accuracy, avoids surveying personnel and surveyed personnel's closely contact. Meanwhile, the full-image whole-person temperature measurement of an open scene is realized, the qualified faces appearing in a temperature measurement area are tracked and the IDs are distributed, the temperature of the qualified faces is measured when the frame number of the qualified faces of each ID exceeds a set value, the personnel with unqualified body temperature directly give an alarm, a plurality of personnel can be measured at one time, and the measurement efficiency is improved.
In addition, the present invention also provides a computer storage medium, which includes one or more computer instructions, and when executed, the one or more computer instructions implement any one of the above-mentioned human body temperature measurement methods.
That is, the computer storage medium stores a computer program which, when executed by a processor, causes the processor to perform any one of the above-described person body temperature measurement methods.
As shown in fig. 5, an embodiment of the present invention provides an electronic device 300, which includes a memory 310 and a processor 320, where the memory 310 is configured to store one or more computer instructions, and the processor 320 is configured to call and execute the one or more computer instructions, so as to implement any one of the methods described above.
That is, the electronic device 300 includes: a processor 320 and a memory 310, in which memory 310 computer program instructions are stored, wherein the computer program instructions, when executed by the processor, cause the processor 320 to perform any of the methods described above.
Further, as shown in fig. 5, the electronic device 300 further includes a network interface 330, an input device 340, a hard disk 350, and a display device 360.
The various interfaces and devices described above may be interconnected by a bus architecture. A bus architecture may be any architecture that may include any number of interconnected buses and bridges. Various circuits of one or more Central Processing Units (CPUs), represented in particular by processor 320, and one or more memories, represented by memory 310, are coupled together. The bus architecture may also connect various other circuits such as peripherals, voltage regulators, power management circuits, and the like. It will be appreciated that a bus architecture is used to enable communications among the components. The bus architecture includes a power bus, a control bus, and a status signal bus, in addition to a data bus, all of which are well known in the art and therefore will not be described in detail herein.
The network interface 330 may be connected to a network (e.g., the internet, a local area network, etc.), and may obtain relevant data from the network and store the relevant data in the hard disk 350.
The input device 340 may receive various commands input by an operator and send the commands to the processor 320 for execution. The input device 340 may include a keyboard or a pointing device (e.g., a mouse, a trackball, a touch pad, a touch screen, or the like).
The display device 360 may display the result of the instructions executed by the processor 320.
The memory 310 is used for storing programs and data necessary for operating the operating system, and data such as intermediate results in the calculation process of the processor 320.
It will be appreciated that memory 310 in embodiments of the invention may be either volatile memory or nonvolatile memory, or may include both volatile and nonvolatile memory. The nonvolatile memory may be a Read Only Memory (ROM), a Programmable Read Only Memory (PROM), an Erasable Programmable Read Only Memory (EPROM), an Electrically Erasable Programmable Read Only Memory (EEPROM), or a flash memory. Volatile memory can be Random Access Memory (RAM), which acts as external cache memory. The memory 310 of the apparatus and methods described herein is intended to comprise, without being limited to, these and any other suitable types of memory.
In some embodiments, memory 310 stores the following elements, executable modules or data structures, or a subset thereof, or an expanded set thereof: an operating system 311 and application programs 312.
The operating system 311 includes various system programs, such as a framework layer, a core library layer, a driver layer, and the like, and is used for implementing various basic services and processing hardware-based tasks. The application programs 312 include various application programs, such as a Browser (Browser), and are used for implementing various application services. A program implementing methods of embodiments of the present invention may be included in application 312.
The method disclosed by the above embodiment of the present invention can be applied to the processor 320, or implemented by the processor 320. Processor 320 may be an integrated circuit chip having signal processing capabilities. In implementation, the steps of the above method may be performed by integrated logic circuits of hardware or instructions in the form of software in the processor 320. The processor 320 may be a general purpose processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), an off-the-shelf programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination thereof, and may implement or perform the methods, steps, and logic blocks disclosed in the embodiments of the present invention. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of the method disclosed in connection with the embodiments of the present invention may be directly implemented by a hardware decoding processor, or implemented by a combination of hardware and software modules in the decoding processor. The software module may be located in ram, flash memory, rom, prom, or eprom, registers, etc. storage media as is well known in the art. The storage medium is located in the memory 310, and the processor 320 reads the information in the memory 310 and completes the steps of the method in combination with the hardware.
For a hardware implementation, the processing units may be implemented within one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), programmable logic devices (P L D), Field Programmable Gate Arrays (FPGAs), general purpose processors, controllers, microcontrollers, microprocessors, other electronic units designed to perform the functions described herein, or a combination thereof.
For a software implementation, the techniques described herein may be implemented with modules (e.g., procedures, functions, and so on) that perform the functions described herein. The software codes may be stored in a memory and executed by a processor. The memory may be implemented within the processor or external to the processor.
In particular, the processor 320 is also configured to read the computer program and execute any of the methods described above.
In the several embodiments provided in the present application, it should be understood that the disclosed method and apparatus may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the units is only one logical division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may be physically included alone, or two or more units may be integrated into one unit. The integrated unit can be realized in a form of hardware, or in a form of hardware plus a software functional unit.
The integrated unit implemented in the form of a software functional unit may be stored in a computer readable storage medium. The software functional unit is stored in a storage medium and includes several instructions to enable a computer device (which may be a personal computer, a server, or a network device) to execute some steps of the transceiving method according to various embodiments of the present invention. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
While the foregoing is directed to the preferred embodiment of the present invention, it will be understood by those skilled in the art that various changes and modifications may be made without departing from the spirit and scope of the invention as defined in the appended claims.
Claims (12)
1. A method for measuring the body temperature of a person, which is characterized by comprising the following steps:
s1, acquiring a visible light image in a shooting view field through a shooting device;
s2, acquiring the face areas of all people and the position information corresponding to each face area from the visible light image;
and S3, converting each face area into a thermal infrared imaging image respectively, and acquiring the temperature of each face area.
2. The method according to claim 1, wherein in step S1, the visible light image is a visible light video stream.
3. The method according to claim 2, wherein step S2 includes:
s21, based on the deep neural network model, positioning the position of a human face in each frame of image of the visible light video stream to obtain the human face area with position information;
s22, respectively allocating IDs to all human faces in the visible light video stream and tracking;
s23, respectively positioning key points of all human faces by using a deep neural network model;
and S24, according to the key point positioning of each face, outputting the face area and the corresponding position information of which the key point positioning information meets the requirements of qualified faces.
4. The method according to claim 3, wherein in step S24, the qualified face requirement is that the interpupillary distance of the face region and the steering angle of the face are both within a preset range.
5. The method of claim 2, further comprising the steps of:
and S4, acquiring continuous multi-frame images for the same face area, measuring the temperature of the thermal infrared imaging image corresponding to each frame image, and acquiring the temperature average value of the multi-frame images.
6. The method according to claim 5, wherein in step S4, said multiframe image is 4-6 frames.
7. A body temperature measurement system for a person, comprising:
the photographing device can acquire visible light images in a photographing field of view;
the face detection module is connected with the photographing device and can acquire face areas of all people and position information corresponding to each face area from the visible light image;
and the body temperature measuring module is connected with the face detection module, converts each face area into a thermal infrared imaging image respectively and acquires the temperature of each face area.
8. The personal temperature measurement system of claim 7, wherein the photographing device has a photographing distance of 5m-8m, and the visible light image is a visible light video stream.
9. The personal temperature measurement system of claim 8, wherein the face detection module comprises:
the full-image detection module is used for positioning the position of a human face in each frame of image of the visible light video stream based on a deep neural network model to obtain the human face area with position information;
the face tracking module is used for respectively allocating IDs to all faces in the visible light video stream and tracking the faces;
the key point positioning module is used for respectively positioning key points of all the human faces by utilizing a deep neural network model;
and the face optimization module is used for outputting the face area and the corresponding position information, the key point positioning information of which meets the requirements of qualified faces, according to the key point positioning of each face.
10. The personal body temperature measurement system of claim 7, wherein the body temperature measurement module further comprises:
and the body temperature calculation module acquires continuous multi-frame images for the same face region, measures the temperature of the thermal infrared imaging image corresponding to each frame of image and acquires the average temperature value of the multi-frame images.
11. A computer storage medium comprising one or more computer instructions which, when executed, implement the method of any one of claims 1-6.
12. An electronic device comprising a memory and a processor, wherein,
the memory is to store one or more computer instructions;
the processor is configured to invoke and execute the one or more computer instructions to implement the method of any one of claims 1-6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010244864.3A CN111426388A (en) | 2020-03-31 | 2020-03-31 | Personnel body temperature measuring method, system, computer storage medium and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010244864.3A CN111426388A (en) | 2020-03-31 | 2020-03-31 | Personnel body temperature measuring method, system, computer storage medium and electronic equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111426388A true CN111426388A (en) | 2020-07-17 |
Family
ID=71550054
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010244864.3A Pending CN111426388A (en) | 2020-03-31 | 2020-03-31 | Personnel body temperature measuring method, system, computer storage medium and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111426388A (en) |
Cited By (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111855017A (en) * | 2020-07-22 | 2020-10-30 | 深圳市青柠互动科技开发有限公司 | Body temperature detection method, device and equipment based on face recognition and storage medium |
| CN111967428A (en) * | 2020-08-27 | 2020-11-20 | 杭州魔点科技有限公司 | Face temperature measurement method and device and storage medium |
| CN111964790A (en) * | 2020-08-14 | 2020-11-20 | 济南博观智能科技有限公司 | Temperature calibration method and infrared temperature measuring device |
| CN112001953A (en) * | 2020-07-27 | 2020-11-27 | 浙江大华技术股份有限公司 | Temperature detection method, device, equipment and computer equipment |
| CN112070185A (en) * | 2020-08-13 | 2020-12-11 | 五邑大学 | Re-ID-based non-contact fever person tracking system and tracking method thereof |
| CN112057074A (en) * | 2020-07-21 | 2020-12-11 | 北京迈格威科技有限公司 | Respiration rate measuring method, respiration rate measuring device, electronic equipment and computer storage medium |
| CN112287798A (en) * | 2020-10-23 | 2021-01-29 | 深圳市商汤科技有限公司 | Temperature measuring method and device, electronic equipment and storage medium |
| CN112380938A (en) * | 2020-11-04 | 2021-02-19 | 浙江大华技术股份有限公司 | Face recognition and temperature measurement method, device, equipment and medium |
| CN112414552A (en) * | 2020-11-24 | 2021-02-26 | 西南交通大学 | Body temperature detection device for elevator and body temperature calculation method thereof |
| CN112461374A (en) * | 2020-11-13 | 2021-03-09 | 上海优加利健康管理有限公司 | Infrared temperature measuring equipment |
| CN113139413A (en) * | 2020-08-07 | 2021-07-20 | 西安天和防务技术股份有限公司 | Personnel management method and device and electronic equipment |
| CN113158712A (en) * | 2020-08-07 | 2021-07-23 | 西安天和防务技术股份有限公司 | Personnel management system |
| CN113155290A (en) * | 2021-03-09 | 2021-07-23 | 广州大学 | Patrol temperature measurement robot and patrol temperature measurement method |
| CN113269036A (en) * | 2021-04-13 | 2021-08-17 | 杭州魔点科技有限公司 | Method, system, device and storage medium for determining face coordinates on thermal imaging |
| CN114166358A (en) * | 2021-11-19 | 2022-03-11 | 北京图菱视频科技有限公司 | Robot inspection system, method, equipment and storage medium for epidemic prevention inspection |
| CN117146985A (en) * | 2023-11-01 | 2023-12-01 | 本溪钢铁（集团）信息自动化有限责任公司 | Temperature measurement method and system based on multi-person face recognition |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101793562A (en) * | 2010-01-29 | 2010-08-04 | 中山大学 | Face detection and tracking algorithm of infrared thermal image sequence |
| US9607138B1 (en) * | 2013-12-18 | 2017-03-28 | Amazon Technologies, Inc. | User authentication and verification through video analysis |
| CN109846463A (en) * | 2019-03-04 | 2019-06-07 | 武汉迅检科技有限公司 | Infrared face temp measuring method, system, equipment and storage medium |
| CN109919007A (en) * | 2019-01-23 | 2019-06-21 | 绵阳慧视光电技术有限责任公司 | A method of generating infrared image markup information |
-
2020
- 2020-03-31 CN CN202010244864.3A patent/CN111426388A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101793562A (en) * | 2010-01-29 | 2010-08-04 | 中山大学 | Face detection and tracking algorithm of infrared thermal image sequence |
| US9607138B1 (en) * | 2013-12-18 | 2017-03-28 | Amazon Technologies, Inc. | User authentication and verification through video analysis |
| CN109919007A (en) * | 2019-01-23 | 2019-06-21 | 绵阳慧视光电技术有限责任公司 | A method of generating infrared image markup information |
| CN109846463A (en) * | 2019-03-04 | 2019-06-07 | 武汉迅检科技有限公司 | Infrared face temp measuring method, system, equipment and storage medium |
Cited By (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112057074A (en) * | 2020-07-21 | 2020-12-11 | 北京迈格威科技有限公司 | Respiration rate measuring method, respiration rate measuring device, electronic equipment and computer storage medium |
| CN111855017A (en) * | 2020-07-22 | 2020-10-30 | 深圳市青柠互动科技开发有限公司 | Body temperature detection method, device and equipment based on face recognition and storage medium |
| CN112001953A (en) * | 2020-07-27 | 2020-11-27 | 浙江大华技术股份有限公司 | Temperature detection method, device, equipment and computer equipment |
| CN113139413A (en) * | 2020-08-07 | 2021-07-20 | 西安天和防务技术股份有限公司 | Personnel management method and device and electronic equipment |
| CN113158712A (en) * | 2020-08-07 | 2021-07-23 | 西安天和防务技术股份有限公司 | Personnel management system |
| CN112070185A (en) * | 2020-08-13 | 2020-12-11 | 五邑大学 | Re-ID-based non-contact fever person tracking system and tracking method thereof |
| CN111964790A (en) * | 2020-08-14 | 2020-11-20 | 济南博观智能科技有限公司 | Temperature calibration method and infrared temperature measuring device |
| CN111967428A (en) * | 2020-08-27 | 2020-11-20 | 杭州魔点科技有限公司 | Face temperature measurement method and device and storage medium |
| CN111967428B (en) * | 2020-08-27 | 2021-09-14 | 杭州魔点科技有限公司 | Face temperature measurement method and device and storage medium |
| CN112287798A (en) * | 2020-10-23 | 2021-01-29 | 深圳市商汤科技有限公司 | Temperature measuring method and device, electronic equipment and storage medium |
| CN112380938A (en) * | 2020-11-04 | 2021-02-19 | 浙江大华技术股份有限公司 | Face recognition and temperature measurement method, device, equipment and medium |
| CN112380938B (en) * | 2020-11-04 | 2024-05-03 | 浙江大华技术股份有限公司 | Face recognition and temperature measurement method, device, equipment and medium |
| CN112461374A (en) * | 2020-11-13 | 2021-03-09 | 上海优加利健康管理有限公司 | Infrared temperature measuring equipment |
| CN112414552A (en) * | 2020-11-24 | 2021-02-26 | 西南交通大学 | Body temperature detection device for elevator and body temperature calculation method thereof |
| CN113155290A (en) * | 2021-03-09 | 2021-07-23 | 广州大学 | Patrol temperature measurement robot and patrol temperature measurement method |
| CN113269036A (en) * | 2021-04-13 | 2021-08-17 | 杭州魔点科技有限公司 | Method, system, device and storage medium for determining face coordinates on thermal imaging |
| CN114166358A (en) * | 2021-11-19 | 2022-03-11 | 北京图菱视频科技有限公司 | Robot inspection system, method, equipment and storage medium for epidemic prevention inspection |
| CN114166358B (en) * | 2021-11-19 | 2024-04-16 | 苏州超行星创业投资有限公司 | Robot inspection method, system, equipment and storage medium for epidemic prevention inspection |
| CN117146985A (en) * | 2023-11-01 | 2023-12-01 | 本溪钢铁（集团）信息自动化有限责任公司 | Temperature measurement method and system based on multi-person face recognition |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111426388A (en) | Personnel body temperature measuring method, system, computer storage medium and electronic equipment | |
| Dong et al. | Marker-free monitoring of the grandstand structures and modal identification using computer vision methods | |
| CN111626125B (en) | Face temperature detection method, system, device and computer equipment | |
| US6442419B1 (en) | Infrared 3D scanning system | |
| Treible et al. | Cats: A color and thermal stereo benchmark | |
| CN110934572A (en) | Body temperature monitoring method and device and readable storage medium | |
| US20060043296A1 (en) | Non-visible radiation imaging and inspection | |
| CN111358443A (en) | Body temperature monitoring method and device | |
| CN112418251B (en) | Infrared body temperature detection method and system | |
| CN110213491B (en) | Focusing method, device and storage medium | |
| CN113358231B (en) | Infrared temperature measurement method, device and equipment | |
| CN110675448A (en) | Ground light remote sensing monitoring method, system and storage medium based on civil aircraft | |
| Robson et al. | Optimised multi-camera systems for dimensional control in factory environments | |
| CN113701894A (en) | Face temperature measurement method and device, computer equipment and storage medium | |
| CN112200002B (en) | Body temperature measuring method, device, terminal equipment and storage medium | |
| Seewald et al. | Toward analyzing mutual interference on infrared-enabled depth cameras | |
| JP2008236276A (en) | Camera apparatus | |
| JP6166631B2 (en) | 3D shape measurement system | |
| CN117315783A (en) | Personnel detection method, device, equipment and computer storage medium | |
| WO2011047508A1 (en) | Embedded vision tracker and mobile guiding method for tracking sequential double color beacons array with extremely wide-angle lens | |
| Yan et al. | Dynamic group difference coding based on thermal infrared face image for fever screening | |
| Moghadam | 3D medical thermography device | |
| Yaryshev et al. | Development of a digital camera-based method for bridge deformation measurement | |
| Tong et al. | Refraction error analysis in stereo vision for system parameters optimization | |
| Castillo et al. | Assessing Spatiotemporal Behavior of Human Gait: A Comparative Study Between Low-Cost Smartphone-Based Mocap and OptiTrack Systems |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200717 |