Disclosure of Invention
In view of this, embodiments of the present invention provide a method, an apparatus, a terminal and a computer-readable storage medium for human body feature capture and recognition by using millimeter waves, so as to implement detection of a living body and recognition of a specific human body target, and can better solve the problem of detection of the living body while face recognition is performed.
One embodiment of the present invention discloses a method for identifying a physical form, which comprises:
acquiring four-dimensional data of a measured object in a preset range of a terminal, wherein the four-dimensional data comprises a three-dimensional space coordinate and a fourth-dimensional parameter based on millimeter wave characteristics;
comparing the four-dimensional data with a pre-stored four-dimensional target image to identify whether the object to be detected is a designated target; and if so, the terminal executes corresponding operation.
Further, in the above body appearance recognition method, the obtaining of the three-dimensional space coordinates of the object to be measured includes:
the terminal transmits millimeter waves and constructs a three-dimensional space coordinate of the object to be measured based on the electromagnetic wave reflection principle of the scanning point; or, the terminal utilizes an optical sensor and an optical image recognition technology to construct the three-dimensional space coordinate of the measured object.
Further, in the above body appearance recognition method, the obtaining of the fourth-dimensional parameter of the object to be measured based on millimeter wave characteristics includes:
the terminal transmits millimeter waves for detection so as to obtain the ratio of the transmitted millimeter wave power corresponding to the scanning point to the received reflected power, or the phase difference between the transmitted millimeter wave signal corresponding to the scanning point and the received reflected signal, or the radiation temperature corresponding to the scanning point.
Further, in the above body appearance recognition method, the obtaining of the fourth-dimensional parameter of the object to be measured based on millimeter wave characteristics includes:
and the terminal receives the millimeter waves radiated by the object to be detected so as to obtain the radiation signal intensity of the corresponding scanning point or the radiation temperature of the corresponding scanning point.
Further, in the above-described physical appearance recognition method, for the four-dimensional target image stored in advance, the method further includes:
carrying out fourth-dimensional parameter test on different parts of the human body in advance to obtain a fourth-dimensional parameter interval value of the corresponding part, and generating a human body part mapping table for judging which part the corresponding scanning point belongs to according to the obtained fourth-dimensional parameter;
or, a fourth-dimensional parameter test is performed on different tissues of the human body in advance to obtain a fourth-dimensional parameter interval value of the corresponding tissue, and a human body tissue mapping table is generated to judge which tissue the corresponding scanning point belongs to according to the obtained fourth-dimensional parameter.
Further, in the above body appearance recognition method, the human body part mapping table includes a part and a corresponding fourth-dimensional parameter interval value, wherein the part includes at least one of an eye, a nose, a cheek, a lip and a forehead;
the human tissue mapping table comprises tissues and corresponding fourth-dimensional parameter interval values, wherein the tissues comprise at least one of skin, teeth, hair and blood vessels.
Another embodiment of the present invention provides a method and an apparatus for identifying a physical form, which are applied to a terminal, and the apparatus includes:
the four-dimensional data acquisition module is used for acquiring four-dimensional data of the measured object in the preset range of the terminal, wherein the four-dimensional data comprises a three-dimensional space coordinate and a fourth-dimensional parameter based on millimeter wave characteristics;
the body appearance recognition module is used for comparing the four-dimensional data with a pre-stored four-dimensional target image so as to recognize whether the detected object is a designated target; and if so, the terminal executes corresponding operation.
Yet another embodiment of the present invention provides a terminal comprising a millimeter wave antenna for receiving and transmitting millimeter waves, a processor, and a memory, the memory storing a computer program, the processor being configured to execute the computer program to implement the above-mentioned physical appearance recognition method.
Further, in the above terminal, the terminal is a mobile terminal.
Still another embodiment of the present invention provides a computer-readable storage medium storing a computer program that, when executed, implements the physical form recognition method according to the above.
According to the technical scheme, the detection of the living body and the identification of the specific human body target are realized by grabbing at least one human body feature by using the millimeter waves, so that the problem of detection of the living body while face identification is carried out can be solved well, the identification safety is improved, and the like.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments.
The components of embodiments of the present invention generally described and illustrated in the figures herein may be arranged and designed in a wide variety of different configurations. Thus, the following detailed description of the embodiments of the present invention, presented in the figures, is not intended to limit the scope of the invention, as claimed, but is merely representative of selected embodiments of the invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments of the present invention without making any creative effort, shall fall within the protection scope of the present invention.
Hereinafter, the terms "including", "having", and their derivatives, which may be used in various embodiments of the present invention, are only intended to indicate specific features, numbers, steps, operations, elements, components, or combinations of the foregoing, and should not be construed as first excluding the existence of, or adding to, one or more other features, numbers, steps, operations, elements, components, or combinations of the foregoing.
Furthermore, the terms "first," "second," "third," and the like are used solely to distinguish one from another and are not to be construed as indicating or implying relative importance.
Unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which various embodiments of the present invention belong. The terms (such as those defined in commonly used dictionaries) should be interpreted as having a meaning that is consistent with their contextual meaning in the relevant art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein in various embodiments of the present invention.
Example 1
Referring to fig. 1, the present embodiment provides a body appearance recognition method, which can be applied to various terminals such as mobile phones and door control devices, and the body appearance recognition method performs body appearance recognition by using millimeter waves, for example, the detection of a living body can be performed while performing face recognition, so that the recognition security and the like can be improved. As shown in fig. 1, the body appearance recognition method will be described in detail below.
And S100, acquiring four-dimensional data of the measured object in a preset range of the terminal, wherein the four-dimensional data comprises three-dimensional space coordinates and a fourth-dimensional parameter based on millimeter wave characteristics.
For the above step S100, human body appearance recognition, such as face recognition, hand recognition, gesture recognition, etc., is performed by acquiring four-dimensional data of the object to be measured. In this embodiment, the four-dimensional data mainly includes three-dimensional space coordinates of the object to be measured and a fourth-dimensional parameter, where the fourth-dimensional parameter is obtained based on the millimeter wave correlation characteristic. It can be understood that, by using the four-dimensional data to identify together, whether a living body exists can be identified, and thus the safety of the identification process is improved.
As shown in fig. 2, in the present embodiment, the four-dimensional data is composed of three-dimensional space coordinates of the object to be measured and a fourth-dimensional parameter based on the millimeter wave characteristics. The three-dimensional space coordinate mainly refers to the space coordinates of each scanning point forming the object to be measured on an X axis, a Y axis and a Z axis respectively; and the fourth dimension parameter is a parameter of the millimeter wave related characteristic.
For the fourth dimension parameter, the fourth dimension parameter can be obtained by utilizing the detection and reflection physical characteristics of millimeter waves. For example, the four-dimensional parameter may be a ratio of the transmitted millimeter wave power to the received reflected power of the corresponding scanning point. If the transmission power is P
tReceived reflected power is P
rThen the fourth dimension parameter
Alternatively, the four-dimensional parameter may be a phase difference between the transmitted millimeter wave signal and the received reflected signal corresponding to the scanning point. If the phase of the transmitted signal is theta
tThe phase of the received signal being theta
rThen, thenThe fourth dimension parameter
In addition, the four-dimensional parameter may be the radiation signal intensity of the scanning point, or the radiation temperature calculated based on the received radiation signal intensity, or the like. It is understood that the above-mentioned cases are merely illustrative examples of the fourth-dimensional parameters, and other characteristic parameters may be used.
Further optionally, for each scanned point, the fourth dimension parameter can be mapped to a color value for representation, wherein the fourth dimension parameters with different sizes correspond to different colors. Therefore, the user can conveniently observe the four-dimensional image when the four-dimensional data of the measured object is presented.
For the acquisition of the four-dimensional data in the step S100, as shown in fig. 3, as an alternative, the following sub-steps may be included:
and a substep S110, transmitting millimeter waves by the terminal and constructing a three-dimensional space coordinate of the measured object based on the electromagnetic wave reflection principle of the scanning point.
For the above sub-step S110, the millimeter wave is used for detection to obtain the three-dimensional space coordinates of the measured object. For example, the terminal scans the object to be measured by emitting a millimeter wave beam and receives electromagnetic waves reflected from each scanning point, and then calculates a relative distance between the terminal and the object to be measured based on a millimeter wave ranging principle according to physical characteristics of the received electromagnetic waves, such as a return time, etc., thereby calculating three-dimensional space coordinates, i.e., an X coordinate, a Y coordinate, and a Z coordinate, of each scanning point constituting the object to be measured.
In the substep S120, the terminal transmits millimeter waves for detection, so as to obtain a ratio between the transmitted millimeter wave power and the received reflected power of the corresponding scanning point, or obtain a phase difference between the transmitted millimeter wave signal and the received reflected signal of the corresponding scanning point, or obtain a radiation temperature of the corresponding scanning point.
For the above substep S120, when the terminal transmits the millimeter wave for detection, the ratio of the transmission power of each scanning point to the reflection power corresponding to the received electromagnetic wave may be obtained and used as the fourth dimension parameter. Alternatively, the phase difference between the emission signal of each scanning point and the received reflection signal, that is, the phase difference between the emission signal and the electromagnetic wave signal reflected by the object to be measured, may also be used. Of course, it is also possible to actively emit a millimeter wave beam to each scanning point, detect the intensity of the radiation signal reflected by the object to be measured or the radiation temperature, and then use this as the fourth-dimensional parameter.
As for the acquisition of the four-dimensional data in the step S100, as shown in fig. 4, as another alternative, the following sub-steps may be further included:
and a substep S130, wherein the terminal constructs the three-dimensional space coordinate of the measured object by using an optical sensor and an optical image recognition technology.
For the sub-step S130, in order to obtain the three-dimensional space coordinates of the measured object, an optical sensor may be used to obtain an optical image of the measured object, and an optical image recognition technology is used to identify the measured object, so as to obtain the three-dimensional space coordinates of the measured object. Exemplarily, a common infrared camera or the like may be used to capture an image of the object to be measured to obtain a captured image, and the three-dimensional space coordinates of the object to be measured may be calculated by using the relationship between the coordinates of the captured image and the three-dimensional space coordinates.
In the substep S140, the terminal receives the millimeter waves radiated by the object to be measured to obtain the radiation signal intensity corresponding to the scanning point or the radiation temperature corresponding to the scanning point.
For the above sub-step S140, in order to further obtain the fourth-dimensional parameter, since any object radiates the millimeter wave, the terminal may be used to passively receive the millimeter wave signal radiated from the object to be measured, so as to obtain the radiated signal intensity as the fourth-dimensional parameter, or the radiation temperature of the corresponding scanning point may be further obtained based on the obtained radiation signal. Wherein, the scanning point can be selected from the measured object by the terminal.
It is understood that the obtaining of the three-dimensional space coordinates in the step S100 can be obtained through the sub-step S110 or the sub-step S130; the fourth dimension parameter can be obtained through the sub-step S120 or the sub-step S140. It should be understood that the combination between the sub-steps described above is not limiting.
In this embodiment, the acquired four-dimensional data of each scanning point may be optionally recorded in a table shown in table 1 below. As shown in table 1, the last four columns respectively represent the X coordinate, the Y coordinate, the Z coordinate, and the fourth-dimensional parameter of each scanning point. It is to be understood that table 1 is merely an example of a four-dimensional data store.
TABLE 1
|
X coordinate
|
Y coordinate
|
Z coordinate
|
Fourth dimension parameter
|
Scanning point 1
|
X1 |
Y1 |
Z1 |
C1 |
Scanning point 2
|
X2 |
Y2 |
Z2 |
C2 |
…
|
…
|
…
|
…
|
…
|
Scanning point n
|
Xn |
Yn |
Zn |
Cn |
Then, after the four-dimensional data of each scanning point is acquired, the four-dimensional data is recognized from a pre-stored four-dimensional target image, so that a specific human target, for example, a face of a user, a gesture of the user, a palm of the user, or the like is recognized.
And step S200, comparing the acquired four-dimensional data with a pre-stored four-dimensional target image.
In this embodiment, four-dimensional image data of a human target to be recognized may be stored in the terminal in advance, where the target may include, but is not limited to, a human face, a palm, a gesture, and the like. For example, for face recognition, the positions of several scan points, such as eyes, nose, forehead and lips, constituting the face can be selected. For palm recognition, the positions of the thumb, middle finger, little finger, palm center and the like can be selected. For gesture recognition, the positions of the finger pulp, the finger back and the like of some designated fingers can be selected as well.
In the comparison process, the relative position between the three-dimensional space coordinates of each scanning point may be used to make a preliminary determination, and the fourth-dimensional parameter may be used to further determine whether the portion or tissue to which each scanning point belongs is correct. Of course, it is also possible to determine what the portion or tissue of each scanning point belongs to first, and further determine whether the measured object formed by each scanning point is consistent with the pre-stored target image by using the three-dimensional space coordinates. It can be understood that the steps are not limited in sequence when the four-dimensional data is used for comparison, so that the accuracy, the safety and the like of the physical appearance recognition can be improved.
In this embodiment, a fourth-dimensional parameter test may be performed on each part of the human body in advance to obtain a fourth-dimensional parameter interval value of the corresponding part, so as to generate a human body part mapping table. The human body part mapping table is used for judging which part the corresponding scanning point belongs to according to the acquired fourth-dimensional parameter.
Exemplarily, as shown in table 2 below, the human body part mapping table includes different parts and corresponding fourth-dimensional parameter interval values. It is understood that these interval values can be obtained by testing or simulating each part of the human body in advance. For example, the site may include, but is not limited to, at least one of eyes, nose, cheeks, lips, forehead, and the like.
TABLE 2
Fourth dimension parameter
|
Parts of human body
|
Interval value A1
|
Eye(s)
|
Interval value A2
|
Nose
|
Interval value A3
|
Cheek
|
Interval value A4
|
Lip (lip)
|
Interval value A5
|
Forehead head
|
…
|
… |
As another implementable scheme, a fourth-dimensional parameter test may be performed on different tissues of the human body in advance to obtain a fourth-dimensional parameter interval value of a corresponding tissue, and a human body tissue mapping table is generated. Wherein, the method is used for judging which tissue the corresponding scanning point belongs to according to the acquired fourth dimension parameter.
Exemplarily, as shown in table 3 below, the human tissue mapping table includes different tissues and corresponding values of the fourth-dimensional parameter interval. It is understood that these interval values can be obtained by testing or simulating each tissue of the human body in advance. For example, the tissue may include, but is not limited to, at least one of skin, teeth, hair, and blood vessels, among others.
TABLE 3
Fourth dimension parameter
|
Human tissue
|
Interval value B1
|
Skin(s)
|
Interval value B2
|
Tooth with tooth-like structure
|
Interval value B3
|
Hair with hair-protecting layer
|
Interval value B4
|
Blood vessel
|
…
|
… |
And step S300, identifying whether the measured object is a specified target.
For the above step S300, the acquired four-dimensional data is compared with the pre-stored four-dimensional target image to identify whether the object under test is consistent with the pre-stored specified target. If the comparison is successful, namely the tested object is judged to be in accordance with the designated target, the step S400 is executed, otherwise, the tested object is judged to be not in accordance with the designated target, namely the tested object is not in accordance with the designated target, the step S500 is executed.
And step S400, if yes, the terminal executes corresponding operation.
And step S500, if not, the terminal does not execute corresponding operation.
For the step S400, for example, the corresponding operation may be unlocking the terminal, or paying by the terminal or controlling the opening of another object, and the like, and may be specifically set according to actual needs. For the step S500, when the identification is unsuccessful, the terminal may not respond, including not performing the corresponding operation set in advance.
It is to be understood that, with the above-described physique recognition method, millimeter waves may be transmitted or received through a millimeter wave antenna in the terminal. The millimeter wave antenna may be implemented by a single antenna or an antenna array. For example, the millimeter wave antenna array may be one-dimensional arranged or two-dimensional arranged, and the antenna elements of the antenna array may be one or a combination of several of patches, dipoles, monopoles, yagi, and the like, and are not limited in particular. As for the setting position of the millimeter wave antenna, the setting position may be set in the direction toward the display screen in the terminal, or the back of the terminal, or both sides of the terminal, and the like, and may be specifically set according to actual requirements. For example, when a human face is recognized, it may be set at a position in a direction toward the display screen; when recognizing a palm or a gesture, it may be disposed on the back of the terminal, etc.
According to the body appearance recognition method provided by the embodiment, at least one body appearance feature is captured by utilizing the millimeter waves, so that the detection of the living body and the recognition of the specific human body target are realized, the problem of the detection of the living body during face recognition can be solved well, the recognition safety is improved, and the user experience degree is further improved. In addition, by generating a human body part mapping table or a human body tissue mapping table in advance, the fact whether the part to which the fourth-dimensional parameter belongs is correct or not can be conveniently and quickly judged, and the contrast efficiency and the like are improved.
Example 2
Referring to fig. 5, based on the physical form recognition method of embodiment 1, in this embodiment, a physical form recognition method apparatus 1 is provided, which is applied to a terminal, and the physical form recognition method apparatus 1 includes:
a four-dimensional data obtaining module 100, configured to obtain four-dimensional data of a measured object within a preset terminal range, where the four-dimensional data includes a three-dimensional space coordinate and a fourth-dimensional parameter based on a millimeter wave characteristic;
a physical form recognition module 200, configured to compare the four-dimensional data with a pre-stored four-dimensional target image to recognize whether the detected object is a designated target; and if so, the terminal executes corresponding operation.
It is to be understood that the above-described body appearance recognition method device 1 corresponds to the body appearance recognition method of embodiment 1. Any of the options in embodiment 1 are also applicable to this embodiment, and will not be described in detail here.
The invention also provides a terminal, such as a computer and the like, which comprises a millimeter wave antenna, a memory and a processor, wherein the millimeter wave antenna can be used for receiving and transmitting millimeter wave signals, the memory stores a computer program, and the processor executes the computer program, so that the terminal executes the functions of each module in the physique recognition method or the physique recognition method device.
Preferably, the terminal is a portable mobile terminal, such as a mobile phone, an Ipad, a notebook, and the like. Taking a mobile terminal, i.e. a mobile phone, as an example, the setting position of the millimeter wave antenna can be set correspondingly according to actual requirements. For example, it may be disposed in a direction toward the display screen for recognizing a human face or a gesture, etc.; and may also be provided on the back or both sides of the mobile terminal for recognizing a palm or a gesture, etc.
The memory may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the terminal, etc. Further, the memory may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.
The present invention also provides a computer-readable storage medium for storing the computer program used in the above-mentioned terminal.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus and method can be implemented in other ways. The apparatus embodiments described above are merely illustrative and, for example, the flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of apparatus, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
In addition, each functional module or unit in each embodiment of the present invention may be integrated together to form an independent part, or each module may exist separately, or two or more modules may be integrated to form an independent part.
The functions, if implemented in the form of software functional modules and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention or a part of the technical solution that contributes to the prior art in essence can be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a smart phone, a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
The above description is only for the specific embodiments of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present invention, and all the changes or substitutions should be covered within the scope of the present invention.