WO2019071489A1

WO2019071489A1 - Intelligent terminal-based method and system for measuring temperature by photographing

Info

Publication number: WO2019071489A1
Application number: PCT/CN2017/105761
Authority: WO
Inventors: 阎乾进; 赵柯莹
Original assignee: 深圳传音通讯有限公司
Priority date: 2017-10-11
Filing date: 2017-10-11
Publication date: 2019-04-18
Also published as: CN111212593A

Abstract

Provided in the present invention are an intelligent terminal-based method and system for measuring temperature by photographing, the method for measuring temperature by photographing comprising: receiving a temperature measurement instruction; capturing, according to the temperature measurement instruction, a preview image comprising the face of a current user, and simultaneously acquiring infrared information; detecting the position of the face in the preview image so as to generate a face frame; converting the infrared information into body temperature data according to the infrared information and the face frame; and displaying the body temperature data in the face frame. The system for measuring temperature by photographing comprises: an instruction module, a capturing module, an acquisition module, a detection module, a conversion module and a display module. By employing the technical solution of the present invention, the camera of an intelligent terminal and a built-in infrared temperature sensing device may be used together to measure the body temperature of a photo capture object by means of capturing the preview image; the camera and temperature sensing device may be easily carried around by the user and used by the user to measure body temperature at any time or location.

Description

Photo-sensing method based on intelligent terminal and photographing temperature measuring system

Technical field

The invention relates to the field of intelligent terminals, in particular to a photo temperature measuring method based on an intelligent terminal and a photo temperature measuring system.

Background technique

The thermometer is also called "medical thermometer". The working substance of the thermometer is mercury. Its glass bubble volume is much larger than the volume of the upper tube. Mercury in the bubble, due to the influence of body temperature, produces a slight change, and the expansion of the volume of mercury causes a significant change in the length of the mercury column in the tube. The temperature of the human body is generally between 35 ° C and 42 ° C, so the scale of the thermometer is usually 35 ° C to 42 ° C, and the range of each degree is divided into 10 parts, so the thermometer can be accurate to 1 / 10 degrees. The neck of the thermometer near the bubble is a very narrow curved neck. When the body temperature is measured, the mercury in the bubble expands by the heat volume, and the mercury can rise from the neck portion to a position inside the tube. When the body temperature reaches the thermal equilibrium, the mercury The column is constant. When the thermometer leaves the human body, the outside temperature is low, and the mercury shrinks in the cold volume, and is broken in the narrow curved neck portion, so that part of the mercury that has been lifted into the tube cannot be returned, and the mercury column is kept in contact with the human body. The height reached. However, traditional thermometers often use mercury columns, which are not convenient for users to carry around, but the accuracy of electronic thermometers is often unsatisfactory.

Therefore, it is necessary to provide a thermometer that is convenient to carry and has high measurement accuracy, which is convenient for the user to carry around, and can know his body temperature in the first time when the body is unwell. The invention provides a photographing temperature measuring method based on an intelligent terminal and a photographing temperature measuring system, and combines the camera of the intelligent terminal and the built-in infrared temperature sensing device to measure the body temperature of the photographing object by taking a preview image, which is convenient for the user to carry around, and It is convenient for users to measure body temperature anytime and anywhere.

Summary of the invention

In order to overcome the above technical deficiencies, the object of the present invention is to provide a photo temperature measuring method based on a smart terminal and a photo temperature measuring system, and combine the camera of the smart terminal and the built-in infrared temperature sensing device to measure the temperature of the object by taking a preview image. It is convenient for users to carry around, and it is convenient for users to measure body temperature anytime and anywhere.

The invention provides a photo temperature measuring method based on an intelligent terminal, and the photo temperature measuring method comprises the following steps:

Receiving a temperature measurement instruction;

Obtaining, according to the temperature measurement instruction, a preview image including a face of the current user, and acquiring an infrared information;

Detecting a position of the face in the preview image to generate a face frame;

Converting the infrared information into body temperature data according to the infrared information and the face frame;

The body temperature data is displayed in the face frame.

Preferably, the step of simultaneously acquiring an infrared information further includes:

Obtaining infrared light radiated by the current user;

The infrared light is converted into an electrical signal to generate the infrared information.

Preferably, the step of detecting a position of the face in the preview image to generate a face frame further comprises:

Extracting facial feature information that matches a preset feature information;

Determining an outline of the face according to a skin color of the face and a background color of the preview image;

Positioning the face according to the feature information and the outline;

A face frame containing the outline is displayed.

The brightness, contrast, and smoothness of the preview image are processed.

Preferably, the photographing temperature measuring method further comprises:

The body temperature data displayed in the face frame is closed.

The present invention further provides a camera temperature measurement system based on an intelligent terminal, the camera temperature measurement system includes: an instruction module, an acquisition module, an acquisition module, a detection module, a conversion module, and a display module;

The instruction module is in communication connection with the acquisition module and the acquisition module, and receives a temperature measurement instruction;

According to the temperature measurement instruction, the acquisition module collects a preview image including a face of the current user, and the acquisition module acquires an infrared information;

The detecting module is connected to the collecting module, the converting module, and the display module, and detects a position of the face in the preview image to generate a face frame;

The conversion module is communicably connected to the detection module and the display module, and converts the infrared information into body temperature data according to the infrared information and the face frame;

The display module is in communication with the conversion module, and displays the body temperature data in the face frame.

Preferably, the obtaining module further comprises:

Receiving unit, obtaining infrared light radiated by the current user;

And a conversion unit that converts the infrared light into an electrical signal to generate the infrared information.

Preferably, the detecting module further comprises:

Extracting unit, extracting facial feature information that matches a preset feature information;

a contour unit that determines an outline of the face according to a skin color of the face and a background color of the preview image;

Positioning unit, positioning the face according to the feature information and the contour;

The identification unit displays a face frame containing the outline.

Preferably, the detecting module further comprises:

a processing unit that processes brightness, contrast, and smoothness of the preview image.

Preferably, the photographing temperature measuring system further comprises a closing module, which is in communication connection with the display module;

Used to close the body temperature data displayed in the face frame. After adopting the above technical solution, compared with the prior art, the following beneficial effects are obtained:

The camera can be combined with the smart terminal and the built-in infrared temperature sensing device to measure the temperature of the subject by taking a preview image, which is convenient for the user to carry around, and can facilitate the user to perform body temperature measurement anytime and anywhere.

DRAWINGS

1 is a schematic flow chart of a method for photographing temperature measurement based on an intelligent terminal according to an embodiment of the present invention;

2 is a schematic flow chart of a method for photographing temperature measurement based on an intelligent terminal according to an embodiment of the present invention;

3 is a schematic flow chart of a method for photographing temperature measurement based on an intelligent terminal according to an embodiment of the present invention;

4 is a schematic structural diagram of a camera temperature measurement system based on an intelligent terminal according to an embodiment of the present invention;

FIG. 5 is a schematic structural diagram of a camera temperature measurement system based on an intelligent terminal according to an embodiment of the present invention; FIG.

6 is a schematic structural diagram of a camera-based temperature measurement system based on an intelligent terminal according to an embodiment of the present invention;

FIG. 7 is a schematic structural diagram of a camera temperature measurement system based on an intelligent terminal according to an embodiment of the present invention.

Detailed ways

Advantages of the present invention are further explained below in conjunction with the accompanying drawings and specific embodiments.

Exemplary embodiments will be described in detail herein, examples of which are illustrated in the accompanying drawings. The following description refers to the same or similar elements in the different figures unless otherwise indicated. The following exemplary implementation The embodiments described in the examples do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with aspects of the present disclosure as detailed in the appended claims.

The terms used in the present disclosure are for the purpose of describing particular embodiments only, and are not intended to limit the disclosure. The singular forms "a", "the" and "the" It should also be understood that the term "and/or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items.

In the description of the present invention, unless otherwise specified and limited, it should be noted that the term "connected" should be understood broadly, and may be, for example, a mechanical connection or an electrical connection, or may be internal to the two elements, or may be The direct connection may also be indirectly connected through an intermediate medium. For those skilled in the art, the specific meanings of the above terms may be understood according to specific situations.

In the following description, the use of suffixes such as "module" or "unit" for indicating an element is merely an explanation for facilitating the present invention, and does not have a specific meaning per se. Therefore, "module" and "component" can be used in combination.

The smart terminal can be implemented in various forms. For example, the terminal described in the present invention may include a smart terminal such as a mobile phone, a smart phone, a notebook computer, a PDA (Personal Digital Assistant), a PAD (Tablet), a PMP (Portable Multimedia Player), a navigation device, and the like, and such as Fixed terminal for digital TV, desktop computer, etc. In the following, it is assumed that the terminal is a smart terminal. However, those skilled in the art will appreciate that configurations in accordance with embodiments of the present invention can be applied to fixed type terminals in addition to components that are specifically for mobile purposes.

1 is a schematic flowchart of a method for photographing temperature measurement based on an intelligent terminal according to an embodiment of the present invention. In this embodiment, a photo temperature measurement method based on an intelligent terminal is provided, and the photo temperature measurement method includes the following steps:

Receiving a temperature measurement instruction;

When the user needs to measure the body temperature through the smart terminal, send a temperature measurement command to the smart terminal, including opening the operation interface of the smart terminal, clicking the icon to start the application for measuring the body temperature, and clicking the button for starting the temperature measurement to control the smart terminal to start measuring. body temperature.

The intelligent terminal receives the temperature measurement command sent by the user through the screen, and the temperature measurement instruction immediately starts the camera built in the smart terminal and the infrared temperature sensor. At this time, the built-in camera of the smart terminal includes any one of the front camera and the rear camera to automatically turn on, and starts capturing a preview image including the current user's face. The current user object is the object of the body temperature to be measured.

At the same time, the infrared temperature sensor built into the smart terminal is activated to start collecting the infrared light radiated by the current user. In nature, when the temperature of an object/body is higher than absolute zero, electromagnetic waves are continuously radiated to the surroundings due to internal thermal motion, including infrared rays with a wavelength of 0.75-100 μm. The infrared temperature sensor uses this The principle is made. Therefore, based on the acquisition of infrared light radiated from the user's body, the infrared temperature sensor can acquire the current user's body temperature based on the infrared light.

Detecting a position of the face in the preview image to generate a face frame;

After the smart terminal collects a preview image including the face of the current user through the front camera or the rear camera, the smart terminal further recognizes the face in the preview image through the face detecting device according to the preview image, and distinguishes the preview. The face and the background in the image are used to locate the position of the face. After the positioning is completed, a face frame indicating the position of the face is further generated in the preview image. In a preferred embodiment, the face frame is a red rectangular frame displayed on the outside of the face to display the face recognition in the preview image by the smart terminal.

After the smart terminal acquires the infrared information of the current user and the face recognition result of the current user in the preview image according to the built-in infrared temperature sensor, the smart terminal further collects the result by calling the function. The infrared information composed of the infrared light radiated by the current user is converted into the corresponding body temperature data.

The body temperature data is displayed in the face frame.

After the current user's body temperature data is obtained, the preview image acquired by the front camera or the rear camera in the smart terminal is further combined, and the body temperature data is displayed on the face position in the preview image, that is, in the face frame.

In a preferred embodiment, the smart terminal-based photo temperature measurement method provided by the present invention can be applied to two or more current users. If the preview image includes two or more current users, the smart terminal collects the radiation infrared light of each current user and the preview image including the face, and the specific steps are as described above, and are not described again, and finally for each current user. The corresponding body temperature data is displayed in the face box.

2 is a schematic flowchart of a method for taking a photo temperature measurement based on an intelligent terminal according to an embodiment of the present invention. In this embodiment, the step of acquiring an infrared information at the same time further includes:

Obtaining infrared light radiated by the current user;

Preferably, the step of obtaining, by the infrared temperature detector, the infrared information of the current user further comprises acquiring the infrared light radiated by the current user, and the object based on each physical temperature greater than the absolute zero is continuously due to the internal thermal motion. The electromagnetic wave is radiated to the surroundings, and the infrared light having a wavelength band of 0.75 to 100 μm is included. Therefore, the infrared temperature detector built in the smart terminal can realize the contactless measurement of the object to be tested through the intelligent terminal. After obtaining the infrared light, the smart terminal further converts the infrared light radiated by the current user to the infrared electric signal by calling the function, and generates an infrared information, so as to further further the infrared according to the Planck formula V=RaεσT4=KT4. The information is converted to the corresponding body temperature data.

Referring to FIG. 3, it is a schematic flowchart of a method for photographing temperature measurement based on an intelligent terminal according to an embodiment of the present invention. In this embodiment, the step of detecting a position of the face in the preview image to generate a face frame further includes:

Positioning the face according to the feature information and the outline;

A face frame containing the outline is displayed.

Preferably, the step of detecting and recognizing the face included in the preview image by the smart terminal further includes: extracting a facial feature of the face in the preview image, and specifically determining the matching manner with the preset facial feature information The facial features such as eyes, nose, ears, hair, and mouth are included in the preview image, and the approximate position of the face is determined by extracting the facial features. The preset facial features include feature information stored in a picture library in the smart terminal, or connected to a third-party network platform to update and download the obtained feature information.

Further, the facial skin patches around the facial features are extracted, and the color patches are compared and distinguished from the background patches in the preview image to determine the contours of the faces in the preview image.

Further, the position of the current user's face in the preview image is further positioned on the facial features and the facial contours included in the face in the preview image.

After the positioning is completed, the smart terminal displays a face frame at the location of the face determined by the positioning. Preferably, the face frame is a red rectangular frame, and the face is framed into the face frame to complete the face recognition in the preview image by the smart terminal.

The brightness, contrast, and smoothness of the preview image are processed.

Referring to FIG. 3, in the step of detecting the position of the face in the preview image, in the step of generating a face frame, before the extraction of the facial feature information, the step further includes preprocessing the preview image, including adjusting the brightness of the preview image, Contrast, smoothness, etc., to optimize the quality of the preview image acquired by the smart terminal, so that the smart terminal can locate the location of the face and extract the feature information in the preview image.

In a preferred embodiment, the photo temperature measurement method further includes:

The body temperature data displayed in the face frame is closed.

Preferably, when the user does not need the smart terminal to display the body temperature data in the preview image, the display of the body temperature data in the preview image may be further turned off.

Referring to FIG. 4, it is a schematic structural diagram of a camera-based temperature measurement system based on an intelligent terminal according to the embodiment. In this embodiment, the photographing temperature measurement system includes: an instruction module, an acquisition module, an acquisition module, a detection module, a conversion module, and a display module;

When the user needs to measure the body temperature through the smart terminal, send a temperature measurement command to the smart terminal, including opening the operation interface of the smart terminal, clicking the icon to start the application for measuring the body temperature, and clicking the button for starting the temperature measurement to control the smart terminal to start measuring. body temperature. The instruction module receives the temperature measurement instruction sent by the user through the screen of the intelligent terminal, and sends the temperature measurement instruction to the acquisition module and the acquisition module through a communication connection.

The command module receives a temperature measurement command sent by the user through the screen, and the temperature measurement command immediately starts the camera built in the smart terminal and the infrared temperature sensor. At this time, the camera in the acquisition module includes any of the front camera and the rear camera automatically turned on, and starts capturing a preview image including the current user's face. The current user object is the object of the body temperature to be measured. After the acquisition is completed, the acquisition module further sends the preview image to the detection module.

At the same time, the infrared temperature sensor in the acquisition module is activated to start collecting the infrared light radiated by the current user. In nature, when the temperature of an object/body is higher than absolute zero, electromagnetic waves are continuously radiated to the surroundings due to internal thermal motion, including infrared rays with a wavelength of 0.75-100 μm. The infrared temperature sensor uses this The principle is made. Therefore, based on the acquisition of infrared light radiated from the user's body, the acquisition module can obtain the current user's body temperature according to the infrared light through the infrared temperature sensor. After the acquisition is completed, the acquisition module further sends the infrared information to the conversion module.

After the acquisition module collects a preview image including the face of the current user through the front camera or the rear camera, the detection module further identifies the face in the preview image through the face detection device according to the preview image, and distinguishes the preview. The face and the background in the image are used to locate the position of the face. After the positioning is completed, a face frame indicating the position of the face is further generated in the preview image. In a preferred embodiment, the face frame is a red rectangular frame displayed on the outside of the face to display the face recognition in the preview image by the smart terminal.

After the conversion module receives the infrared temperature sensor in the acquisition module, by acquiring the infrared information of the current user and detecting the face recognition result of the current user in the preview image, the conversion module further collects the current result by calling the function. The infrared information composed of infrared light radiated by the user is converted into corresponding body temperature data.

After obtaining the body temperature data of the current user, the display module further combines the preview image with the face frame after the detection by the detection module, and displays the body temperature data converted by the conversion module in the face position in the preview image, that is, the face frame. .

In a preferred embodiment, the smart terminal-based photo temperature measurement system provided by the present invention is applicable to body temperature measurement of two or more current users. If the preview image includes two or more current users, the acquisition module and the acquisition module acquire and collect the radiation infrared light of each current user and the preview image including the face, as described above, no further description, the final display module The corresponding body temperature data is displayed in the face frame of each current user.

Referring to FIG. 5, it is a schematic structural diagram of a camera-based temperature measurement system based on an intelligent terminal according to an embodiment of the present invention. Figure. In this embodiment, the acquiring module further includes:

Receiving unit, obtaining infrared light radiated by the current user;

Preferably, the step of obtaining, by the infrared temperature detector, the infrared information of the current user further comprises: the receiving unit acquiring the infrared light radiated by the current user, and the object is greater than the absolute zero degree based on each physical temperature, because there is internal thermal motion, The electromagnetic waves are continuously radiated to the surroundings, and the infrared rays having the wavelength band of 0.75 to 100 μm are included. Therefore, the infrared temperature detector built in the acquisition module can realize the contactless measurement of the object to be measured through the intelligent terminal. After acquiring the infrared light, the obtaining unit further converts the infrared light radiated by the current user obtained by the acquisition unit into an infrared electric signal to generate an infrared information, so as to further follow the Planck formula V=RaεσT4=KT4. The infrared information is converted into corresponding body temperature data.

FIG. 6 is a schematic structural diagram of a camera-based temperature measurement system based on an intelligent terminal according to an embodiment of the present invention. In this embodiment, the detecting module further includes:

The identification unit displays a face frame containing the outline.

Preferably, the detecting module further comprises: an extracting unit, a contour unit, a positioning unit and an identifying unit. The extracting unit extracts the facial features of the face in the preview image, and specifically determines the facial features such as the eyes, the nose, the ears, the hair, the mouth, and the like included in the preview image by matching the preset facial feature information. The extraction of features is used to determine the approximate location of the face. The preset facial features include feature information stored in a picture library in the smart terminal, or connected to a third-party network platform to update and download the obtained feature information.

Further, the contour unit compares and distinguishes the color patch from the background color patch in the preview image by extracting the facial skin color patch around the facial feature to determine the contour of the face in the preview image.

Further, the positioning unit further positions the position of the current user's face in the preview image for the facial features and the facial contours included in the face in the preview image.

After the positioning is completed, the recognition unit displays a face frame at the position of the face where the positioning is determined. Preferably, the face frame is a red rectangular frame, and the face is framed into the face frame to complete the face recognition in the preview image by the smart terminal.

Preferably, the detecting module further comprises:

Referring to FIG. 6 , before the extracting unit in the detecting module extracts the facial feature information, the detecting module further includes a processing unit, and preprocessing the preview image, including adjusting brightness, contrast, smoothness, etc. of the preview image to optimize The quality of the preview image obtained by the smart terminal is convenient for the smart terminal to locate the location of the face and extract the feature information in the preview image.

FIG. 7 is a schematic structural diagram of a camera-based temperature measurement system based on an intelligent terminal according to an embodiment of the present invention. The photographing temperature measuring system further includes a closing module, and is in communication connection with the display module;

Used to close the body temperature data displayed in the face frame.

Preferably, when the user does not need the smart terminal to display the body temperature data in the preview image, the display of the body temperature data in the preview image may be further turned off by the closing module.

The invention adopts a smart terminal-based photographing temperature measuring method and a photographing temperature measuring system, and combines a smart terminal camera and a built-in infrared temperature sensing device to measure a body temperature of a photograph by taking a preview image, which is convenient for the user to carry around. It also makes it easy for users to take body temperature measurements anytime, anywhere.

It should be noted that the embodiments of the present invention are preferred embodiments, and are not intended to limit the scope of the present invention. Any one skilled in the art may use the above-disclosed technical contents to change or modify the equivalent embodiments. , without departing from the technical solution of the present invention, according to the technical essence of the present invention Any modifications or equivalent changes and modifications are still within the scope of the technical solutions of the present invention.

Claims

A method for photographing temperature measurement based on a smart terminal, characterized in that

The photo temperature measurement method includes the following steps:

Receiving a temperature measurement instruction;

Obtaining, according to the temperature measurement instruction, a preview image including a face of the current user, and acquiring an infrared information;

Detecting a position of the face in the preview image to generate a face frame;

Converting the infrared information into body temperature data according to the infrared information and the face frame;

The body temperature data is displayed in the face frame.
The photographing temperature measuring method according to claim 1, wherein

In the step of acquiring an infrared information at the same time, the method further includes:

Obtaining infrared light radiated by the current user;

The infrared light is converted into an electrical signal to generate the infrared information.
The photographing temperature measuring method according to claim 1, wherein

The step of detecting a position of the face in the preview image to generate a face frame further includes:

Extracting facial feature information that matches a preset feature information;

Determining an outline of the face according to a skin color of the face and a background color of the preview image;

Positioning the face according to the feature information and the outline;

A face frame containing the outline is displayed.
The photographing temperature measuring method according to claim 3, wherein

The step of detecting a position of the face in the preview image to generate a face frame further includes:

The brightness, contrast, and smoothness of the preview image are processed.
The photographing temperature measuring method according to any one of claims 1 to 4, wherein

The photographing temperature measuring method further includes:

The body temperature data displayed in the face frame is closed.
A camera temperature measurement system based on a smart terminal, characterized in that

The photographing temperature measuring system comprises: an instruction module, an acquisition module, an acquisition module, a detection module, a conversion module and a display module;

The instruction module is in communication connection with the acquisition module and the acquisition module, and receives a temperature measurement instruction;

According to the temperature measurement instruction, the acquisition module collects a preview image including a face of the current user, and the acquisition module acquires an infrared information;

The detecting module is connected to the collecting module, the converting module, and the display module, and detects a position of the face in the preview image to generate a face frame;

The conversion module is communicably connected to the detection module and the display module, and converts the infrared information into body temperature data according to the infrared information and the face frame;

The display module is in communication with the conversion module, and displays the body temperature data in the face frame.
The photographing temperature measuring system according to claim 6, wherein

The obtaining module further includes:

Receiving unit, obtaining infrared light radiated by the current user;

And a conversion unit that converts the infrared light into an electrical signal to generate the infrared information.
The photographing temperature measuring system according to claim 6, wherein

The detecting module further includes:

Extracting unit, extracting facial feature information that matches a preset feature information;

a contour unit that determines an outline of the face according to a skin color of the face and a background color of the preview image;

Positioning unit, positioning the face according to the feature information and the contour;

The identification unit displays a face frame containing the outline.
The photographing temperature measuring system according to claim 8, wherein

The detection module further includes:

a processing unit that processes brightness, contrast, and smoothness of the preview image.
The photographing temperature measuring system according to any one of claims 6-9, wherein

The photographing temperature measuring system further includes a closing module, and is in communication connection with the display module;

Used to close the body temperature data displayed in the face frame.