CN107657219B - Face detection method and related product - Google Patents
Face detection method and related product Download PDFInfo
- Publication number
- CN107657219B CN107657219B CN201710819035.1A CN201710819035A CN107657219B CN 107657219 B CN107657219 B CN 107657219B CN 201710819035 A CN201710819035 A CN 201710819035A CN 107657219 B CN107657219 B CN 107657219B
- Authority
- CN
- China
- Prior art keywords
- face image
- target
- target positions
- image
- preview image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/172—Classification, e.g. identification
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/40—Spoof detection, e.g. liveness detection
Abstract
The embodiment of the invention discloses a face detection method and a related product, comprising the following steps: acquiring a preview image of a display screen, wherein the preview image comprises a face image; determining a focusing plane of a plurality of target positions in the preview image, wherein the plurality of target positions comprise a first target position on the face image and a plurality of second target positions in an area except the face image; and when the difference value between the focal length corresponding to the focusing plane of the first target position and the focal length corresponding to the focusing plane of any one of the second target positions is smaller than a preset threshold value, determining the face image as a false face image. The embodiment of the invention is beneficial to improving the safety and convenience of the mobile terminal and reducing the hardware overhead.
Description
Technical Field
The invention relates to the technical field of mobile terminals, in particular to a face detection method and a related product.
Background
With the popularization and application of smart phones in a large number, smart phones can support more and more applications and have more and more powerful functions, and smart phones develop towards diversification and individuation and become indispensable electronic products in user life.
At present, a biological information unlocking scheme is mostly adopted for a smart phone, wherein in face recognition, the situations that face recognition is carried out by using illegal means such as photos and videos and important information is stolen exist, and how to distinguish whether a face image is a face image of a real user or a false face image such as a photo becomes a problem which is urgently needed to be solved in face recognition.
Disclosure of Invention
The embodiment of the invention provides a face detection method and a related product, aiming at improving the safety and convenience of a mobile terminal and reducing the hardware overhead.
In a first aspect, an embodiment of the present invention provides a mobile terminal, including a processor, a front-facing camera connected to the processor, and a camera driving device, where:
the front-facing camera is used for acquiring a preview image of a display screen, wherein the preview image comprises a human face image;
the camera driving device is configured to determine a focal plane of a plurality of target positions in the preview image, where the plurality of target positions include a first target position on the face image and a plurality of second target positions in an area other than the face image;
the processor is configured to determine that the face image is a false face image when it is determined that a difference between a focal length corresponding to the focusing plane at the first target position and a focal length corresponding to the focusing plane at any one of the plurality of second target positions is smaller than a preset threshold.
In a second aspect, an embodiment of the present invention provides a face detection method, including:
acquiring a preview image of a display screen, wherein the preview image comprises a face image;
determining a focusing plane of a plurality of target positions in the preview image, wherein the plurality of target positions comprise a first target position on the face image and a plurality of second target positions in an area except the face image;
and when the difference value between the focal length corresponding to the focusing plane of the first target position and the focal length corresponding to the focusing plane of any one of the second target positions is smaller than a preset threshold value, determining the face image as a false face image.
In a third aspect, an embodiment of the present invention provides a mobile terminal, including a processing unit and a communication unit,
the processing unit is used for acquiring a preview image of a display screen through the communication unit, wherein the preview image comprises a human face image; and a focusing plane for determining a plurality of target positions in the preview image, the plurality of target positions including a first target position on the face image and a plurality of second target positions in an area other than the face image; and determining the face image to be a false face image when the difference value between the focal length corresponding to the focusing plane of the first target position and the focal length corresponding to the focusing plane of any one of the second target positions is smaller than a preset threshold value.
In a fourth aspect, an embodiment of the present invention provides a mobile terminal, including a processor, a memory, a communication interface, and one or more programs, where the one or more programs are stored in the memory and configured to be executed by the processor, and the program includes instructions for executing steps of any of the methods in the second aspect of the present invention.
In a fifth aspect, the present invention provides a computer-readable storage medium, where the computer-readable storage medium stores a computer program for electronic data exchange, where the computer program enables a computer to perform some or all of the steps described in any one of the methods in the second aspect of the present invention, and the computer includes a mobile terminal.
In a sixth aspect, the present invention provides a computer program product, wherein the computer program product includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to cause a computer to perform some or all of the steps described in any one of the methods according to the second aspect of the embodiments of the present invention. The computer program product may be a software installation package, the computer comprising a mobile terminal.
It can be seen that, in the embodiment of the present invention, the mobile terminal first obtains a preview image of the display screen, where the preview image includes a face image; secondly, determining a focusing plane of a plurality of target positions in the preview image, wherein the plurality of target positions comprise a first target position on the face image and a plurality of second target positions in an area except the face image; and finally, when the difference value between the focal length corresponding to the focusing plane of the first target position and the focal length corresponding to the focusing plane of any one of the second target positions is smaller than a preset threshold value, determining the face image as a false face image. Therefore, the mobile terminal judges the face image to be the false face image by acquiring the focal lengths of the focusing planes of the target positions, the safety of the mobile terminal is improved, the preview image of the display screen is detected without acquiring the face image, the detection convenience of the mobile terminal is facilitated, in addition, the hardware of the mobile terminal is utilized for detection, devices such as a camera and the like are not additionally added, and the hardware overhead is facilitated to be reduced.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a schematic structural diagram of a mobile terminal according to an embodiment of the present invention;
fig. 2A is a schematic flow chart of a face detection method disclosed in the embodiment of the present invention;
FIG. 2B is a schematic illustration of a first target location and a second target location as disclosed in an embodiment of the present invention;
FIG. 3 is a schematic flow chart of another face detection method disclosed in the embodiment of the present invention;
FIG. 4 is a schematic flow chart of another face detection method disclosed in the embodiment of the present invention;
fig. 5 is a schematic structural diagram of a mobile terminal according to an embodiment of the present invention;
fig. 6 is a block diagram of functional units of a mobile terminal according to an embodiment of the present invention.
Detailed Description
In order to make the technical solutions of the present invention better understood, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The terms "first," "second," and the like in the description and claims of the present invention and in the above-described drawings are used for distinguishing between different objects and not for describing a particular order. Furthermore, the terms "include" and "have," as well as any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements listed, but may alternatively include other steps or elements not listed, or inherent to such process, method, article, or apparatus.
Reference herein to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the invention. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is explicitly and implicitly understood by one skilled in the art that the embodiments described herein can be combined with other embodiments.
The Mobile terminal according to the embodiment of the present invention may include various handheld devices, vehicle-mounted devices, wearable devices, computing devices or other processing devices connected to a wireless modem, and various forms of User Equipment (UE), Mobile Stations (MS), terminal devices (terminal device), and the like, which have wireless communication functions. For convenience of description, the above-mentioned devices are collectively referred to as a mobile terminal.
The mobile terminal described in the embodiment of the invention is provided with a front camera and a camera driving device. The following describes embodiments of the present invention in detail.
Referring to fig. 1, fig. 1 is a schematic structural diagram of a mobile terminal 100 according to an embodiment of the present invention, where the mobile terminal 100 includes: the device comprises a shell, a touch display screen, a main board, a battery and an auxiliary board, wherein the main board is provided with a processor 110, a memory 120, a front camera 130, a camera driving device 140, a SIM card slot and the like, the auxiliary board is provided with a vibrator, an integrated sound cavity and a VOOC flash charging interface, wherein,
the front camera 130 is configured to obtain a preview image of a display screen, where the preview image includes a face image;
the camera driving device 140 is configured to determine a focal plane of a plurality of target positions in the preview image, where the plurality of target positions include a first target position on the face image and a plurality of second target positions in an area other than the face image;
the camera driving device 140 may be a camera driving motor, such as a stepping motor, for driving the camera to perform focusing.
The processor 110 is configured to determine that the face image is a false face image when it is determined that a difference between a focal length corresponding to the focusing plane at the first target position and a focal length corresponding to the focusing plane at any one of the plurality of second target positions is smaller than a preset threshold.
The processor 110 is a control center of the mobile terminal, connects various parts of the entire mobile terminal by using various interfaces and lines, and performs various functions of the mobile terminal and processes data by operating or executing software programs and/or modules stored in the memory 120 and calling data stored in the memory 120, thereby integrally monitoring the mobile terminal. Alternatively, the processor 110 may integrate an application processor, which mainly handles operating systems, user interfaces, application programs, etc., and a modem processor, which mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 110.
The memory 120 may be used to store software programs and modules, and the processor 110 executes various functional applications and data processing of the mobile terminal by operating the software programs and modules stored in the memory 120. The memory 120 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function, and the like; the storage data area may store data created according to the use of the mobile terminal, and the like. Further, the memory 120 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.
It can be seen that, in the embodiment of the present invention, the mobile terminal first obtains a preview image of the display screen, where the preview image includes a face image; secondly, determining a focusing plane of a plurality of target positions in the preview image, wherein the plurality of target positions comprise a first target position on the face image and a plurality of second target positions in an area except the face image; and finally, when the difference value between the focal length corresponding to the focusing plane of the first target position and the focal length corresponding to the focusing plane of any one of the second target positions is smaller than a preset threshold value, determining the face image as a false face image. Therefore, the mobile terminal judges the face image to be the false face image by acquiring the focal lengths of the focusing planes of the target positions, the safety of the mobile terminal is improved, the preview image of the display screen is detected without acquiring the face image, the detection convenience of the mobile terminal is facilitated, in addition, the hardware of the mobile terminal is utilized for detection, devices such as a camera and the like are not additionally added, and the hardware overhead is facilitated to be reduced.
In a possible example, after the front camera 130 acquires a preview image of a display screen, and before the camera driving device 140 determines a focusing plane of a plurality of target positions in the preview image, the processor 110 is further configured to: detecting the position of the face image in the preview image; and is used for confirming any position on the above-mentioned face picture is the above-mentioned first target position; and the image processing device is used for detecting the position relation between objects except the face image in the preview image and the face image; and the second target positions are determined according to the position relation.
In this possible example, in the determining the plurality of second target positions according to the position relationship, the processor 110 is specifically configured to: acquiring a plurality of target objects with the position relationship with the face image being an overlapping relationship; and determining at least one position on each of the plurality of target objects as the second target position, the at least one position being a position in a non-overlapping area of the target object and the face image.
In a possible example, after the front camera 130 acquires a preview image of a display screen, and before the camera driving device 140 determines a focusing plane of a plurality of target positions in the preview image, the processor 110 is further configured to: determining the position of the face image in the preview image; and is used for confirming any position on the above-mentioned face picture is the above-mentioned first target position; and the second target positions are used for determining the second target positions in the area except the face image according to the position of the face image, and the second target positions comprise positions with the distance from the face image smaller than a preset distance.
In one possible example, in determining the focus plane of the plurality of target positions in the preview image, the processor 110 is specifically configured to: the camera driving device 140 focuses on a plurality of target positions in the preview image, and increases the allocation of system resources to determine the focal planes of the target positions.
Referring to fig. 2A, fig. 2A is a schematic flow chart of a face detection method according to an embodiment of the present invention, which is applied to a mobile terminal, and as shown in the figure, the face detection method includes:
s201, the mobile terminal acquires a preview image of a display screen, wherein the preview image comprises a face image;
before the mobile terminal acquires the preview image of the display screen, the front camera of the mobile terminal is used for acquiring the preview image.
The face image may be a complete face image or a partial face image, which is not limited herein.
The face detection method can be used for detecting a face image before a mobile terminal detects a to-be-unlocked event and performs face identification to determine whether the face image is a real face image, and can also be used for detecting the face image before face identification to determine whether the face image is a real face image and the like when a mobile terminal user performs face identification card-punching and signing through the mobile terminal, and the unique limitation is not made herein.
The event to be unlocked may be, for example, an event to be unlocked on a desktop of the mobile terminal, an event to be unlocked in an application, an event to be unlocked in a file, an event to be unlocked in a payment, and the like, which is not limited herein. The event to be unlocked on the desktop refers to an event to be unlocked for locking the screen desktop, the event to be unlocked for applying refers to an event to be unlocked for a specific operation of applying, such as application starting, application deleting and the like, the event to be unlocked for a file refers to an event to be unlocked for a file, such as an event to be unlocked for a target file, and the event to be unlocked for paying refers to an event to be unlocked for paying a scene, such as an event to be unlocked for paying a scene of applying, such as payment treasure, WeChat and the like.
The event to be unlocked detected by the mobile terminal may be a detected event to be unlocked in a screen-off state, or a detected event to be unlocked in a screen-on state, where the trigger condition for detecting the event to be unlocked may be triggered by a touch operation, a pressing operation, a voice operation, and the like of a user, for example, for a mobile terminal in a screen-off standby state, the trigger condition may be not limited, and the trigger condition may be triggered by long pressing of a touch display screen.
S202, the mobile terminal determines a focusing plane of a plurality of target positions in the preview image, wherein the plurality of target positions comprise a first target position on the face image and a plurality of second target positions in an area except the face image;
the plurality of target positions can be determined by the mobile terminal according to the area of the acquired face image and the position of the face image in the preview image.
The first target position and the plurality of second target positions are positions where the depth of the preview image is not obviously in the same focusing plane.
In one possible example, the determining the focus plane of the plurality of target positions in the preview image includes:
and respectively focusing by taking a plurality of target positions in the preview image as focusing points, and increasing the distribution of system resources to determine focusing planes of the plurality of target positions.
After determining the target positions, the mobile terminal focuses on the target positions by using a camera driving device, such as a stepping motor, to obtain the focusing plane.
When the mobile terminal detects that the mobile terminal executes the operation of determining the focusing plane, system resources are added to a processor executing the operation, wherein the system resources can be CPU resources, bandwidth resources, disk resources and the like, and are not limited uniquely, and the system resources are added so that the processor can reduce the scheduling period of the system resources and increase the operating frequency.
Therefore, in this example, when the mobile terminal determines the focusing planes of the plurality of target positions, the mobile terminal adds system resources to the operation, which is beneficial to increasing the speed of determining the focusing planes by the mobile terminal and increasing the real-time performance of face detection.
And S203, when the mobile terminal judges that the difference value between the focal length corresponding to the focusing plane of the first target position and the focal length corresponding to the focusing plane of any one of the second target positions is smaller than a preset threshold value, determining the face image as a false face image.
And when the difference value between the focal length corresponding to the focusing plane of the first target position and the focal lengths corresponding to the focusing planes of all the second target positions in the plurality of second target positions is judged to be greater than or equal to the preset threshold value, determining that the face image is a real face image.
The first target position is a position on a face image, and the plurality of second target positions are positions in an area except the face image, so that when a difference value between a focal length corresponding to a focusing plane of the first target position and a focal length corresponding to a focusing plane of any one of the plurality of second target positions is smaller than a preset threshold value, it is indicated that the depths of the first target position and the plurality of second target positions are similar, and the face image may be a photo or a video, and the second target position is a position of a background area on the photo or the video.
It can be seen that, in the embodiment of the present invention, the mobile terminal first obtains a preview image of the display screen, where the preview image includes a face image; secondly, determining a focusing plane of a plurality of target positions in the preview image, wherein the plurality of target positions comprise a first target position on the face image and a plurality of second target positions in an area except the face image; and finally, when the difference value between the focal length corresponding to the focusing plane of the first target position and the focal length corresponding to the focusing plane of any one of the second target positions is smaller than a preset threshold value, determining the face image as a false face image. Therefore, the mobile terminal judges the face image to be the false face image by acquiring the focal lengths of the focusing planes of the target positions, the safety of the mobile terminal is improved, the preview image of the display screen is detected without acquiring the face image, the detection convenience of the mobile terminal is facilitated, in addition, the hardware of the mobile terminal is utilized for detection, devices such as a camera and the like are not additionally added, and the hardware overhead is facilitated to be reduced.
In a possible example, after the obtaining of the preview image of the display screen and before the determining of the focus plane of the plurality of target positions in the preview image, the method further includes:
detecting the position of the face image in the preview image;
determining any position on the face image as the first target position;
detecting the position relation between objects except the face image in the preview image and the face image;
and determining the plurality of second target positions according to the position relation.
The human face image can be a partial human face image, so that the first target position is not preset, and the first target position can be at any position on the human face image in the preview image.
The position relation between the objects except the face image and the face image can comprise multiple relations such as overlapping relation, segmentation relation and the like, and the mobile terminal can determine a first target position and a plurality of second target positions which are not in the same focusing plane depth through the position relation, so that whether the face image is a false image or not can be accurately described through the positions.
If the position relationship between the object except the face image and the face image is a segmentation relationship, the plurality of second target positions may be pixel points on the face image, of which the rear proportion of the face image is smaller than that of another one of the face images entering the preview image.
As can be seen, in this example, the mobile terminal determines the first target position according to the position of the face image, and determines the plurality of second target positions according to the position relationship between the object other than the face image and the face image, instead of presetting the target positions, which is beneficial to improving the flexibility and accuracy of determining the position of the mobile terminal.
In this possible example, the determining the plurality of second target positions according to the position relationship includes:
acquiring a plurality of target objects with the position relationship with the face image being an overlapping relationship;
and determining at least one position on each of the plurality of target objects as the second target position, wherein the at least one position is a position in a non-overlapping area of the target object and the face image.
As shown in fig. 2B, when the target object is a vase, the relationship between the vase and the face image is an overlapping relationship, a point on the vase is determined as the second target position, and a point on the face image is determined as the first target position, and if the face image is a real face image, a difference between a focal length corresponding to a focal plane of the first target position and a focal length corresponding to a focal plane of the second target position is large, and if the face image is a face image on a photo or a video, the vase is also an object on a photo or a video, a difference between a focal length corresponding to a focal plane of the first target position and a focal length corresponding to a focal plane of the second target position is very small.
Therefore, in this example, the mobile terminal determines the second target position by using the position on the object having the overlapping relationship with the face image, which is beneficial to improving the accuracy of detecting whether the face image is the face image by the mobile terminal.
In a possible example, after the obtaining of the preview image of the display screen and before the determining of the focus plane of the plurality of target positions in the preview image, the method further includes:
determining the position of the face image in the preview image;
determining any position on the face image as the first target position;
and determining the second target positions in the area except the face image according to the position of the face image, wherein the second target positions comprise positions with a distance to the face image smaller than a preset distance.
The human face image can be a partial human face image, so that the first target position is not preset, and the first target position can be at any position on the human face image in the preview image.
The position where the distance is smaller than the preset distance may be, for example, the position of the area below the ear and at the two sides of the neck, if the face image is a real face image, the position of the area at the two sides of the neck below the ear should be a background area, and the difference between the focal length of the area and the focal length of the position on the face image is large, and when the face image is a picture or a face image on a video, the area at the two sides of the neck below the ear is also a picture or a region on a video, and the difference between the focal length corresponding to the focal plane at the first target position and the focal length corresponding to the focal plane at the second target position is very small.
Therefore, in this example, the mobile terminal determines the first target positions according to the positions of the face images instead of presetting the target positions, which is beneficial to improving the flexibility of determining the positions of the mobile terminal, and determines that the plurality of second target positions are positions with distances smaller than the preset distance from the face images, which is beneficial to improving the accuracy of determining the positions of the mobile terminal.
Referring to fig. 3, fig. 3 is a schematic flow chart of a face detection method according to an embodiment of the present invention, and the face detection method is applied to a mobile terminal. As shown in the figure, the face detection method includes:
s301, the mobile terminal obtains a preview image of the display screen, wherein the preview image comprises a human face image.
And S302, the mobile terminal detects the position of the face image in the preview image.
And S303, the mobile terminal determines any position on the face image as a first target position.
And S304, the mobile terminal detects the position relation between the objects except the face image in the preview image and the face image.
S305, the mobile terminal obtains a plurality of target objects having an overlapping relationship with the face image.
S306, the mobile terminal determines at least one position on each of the plurality of target objects as a second target position, wherein the at least one position is a position in a non-overlapping area of the target object and the face image.
S307, the mobile terminal determines a focusing plane of the first target position and the plurality of second target positions in the preview image.
And S308, when the mobile terminal judges that the difference value between the focal length corresponding to the focusing plane of the first target position and the focal length corresponding to the focusing plane of any one of the second target positions is smaller than a preset threshold value, determining the face image as a false face image.
It can be seen that, in the embodiment of the present invention, the mobile terminal first obtains a preview image of the display screen, where the preview image includes a face image; secondly, determining a focusing plane of a plurality of target positions in the preview image, wherein the plurality of target positions comprise a first target position on the face image and a plurality of second target positions in an area except the face image; and finally, when the difference value between the focal length corresponding to the focusing plane of the first target position and the focal length corresponding to the focusing plane of any one of the second target positions is smaller than a preset threshold value, determining the face image as a false face image. Therefore, the mobile terminal judges the face image to be the false face image by acquiring the focal lengths of the focusing planes of the target positions, the safety of the mobile terminal is improved, the preview image of the display screen is detected without acquiring the face image, the detection convenience of the mobile terminal is facilitated, in addition, the hardware of the mobile terminal is utilized for detection, devices such as a camera and the like are not additionally added, and the hardware overhead is facilitated to be reduced.
In addition, the mobile terminal determines the first target position according to the position of the face image instead of presetting the target positions, so that the flexibility of determining the position of the mobile terminal is improved, and the mobile terminal determines the second target position by using the position on the object which is in an overlapping relation with the face image, so that the accuracy of detecting whether the face image is the face image or not by the mobile terminal is improved.
Referring to fig. 4, fig. 4 is a schematic flow chart of a face detection method according to an embodiment of the present invention, and the face detection method is applied to a mobile terminal. As shown in the figure, the face detection method includes:
s401, the mobile terminal obtains a preview image of the display screen, wherein the preview image comprises a human face image.
S402, the mobile terminal determines the position of the face image in the preview image.
And S403, the mobile terminal determines any position on the face image as a first target position.
S404, the mobile terminal determines a plurality of second target positions in the area except the face image according to the position of the face image, wherein the plurality of second target positions comprise positions with a distance smaller than a preset distance from the face image.
S405, the mobile terminal focuses on the first target position and the second target positions in the preview image respectively, and increases allocation of system resources to determine a focusing plane of the first target position and the second target positions in the preview image.
And S406, when the mobile terminal judges that the difference value between the focal length corresponding to the focusing plane of the first target position and the focal length corresponding to the focusing plane of any one of the second target positions is smaller than a preset threshold value, determining that the face image is a false face image.
It can be seen that, in the embodiment of the present invention, the mobile terminal first obtains a preview image of the display screen, where the preview image includes a face image; secondly, determining a focusing plane of a plurality of target positions in the preview image, wherein the plurality of target positions comprise a first target position on the face image and a plurality of second target positions in an area except the face image; and finally, when the difference value between the focal length corresponding to the focusing plane of the first target position and the focal length corresponding to the focusing plane of any one of the second target positions is smaller than a preset threshold value, determining the face image as a false face image. Therefore, the mobile terminal judges the face image to be the false face image by acquiring the focal lengths of the focusing planes of the target positions, the safety of the mobile terminal is improved, the preview image of the display screen is detected without acquiring the face image, the detection convenience of the mobile terminal is facilitated, in addition, the hardware of the mobile terminal is utilized for detection, devices such as a camera and the like are not additionally added, and the hardware overhead is facilitated to be reduced.
In addition, the mobile terminal determines the first target positions according to the positions of the face images instead of presetting the target positions, so that the flexibility of determining the positions of the mobile terminal is improved, and the accuracy of determining the positions of the mobile terminal is improved by determining the plurality of second target positions to be positions with the distances smaller than the preset distance from the face images.
In addition, when the mobile terminal determines the focusing planes of the target positions, system resources are added to the operation, so that the speed of determining the focusing planes by the mobile terminal is improved, and the real-time performance of face detection is improved.
In accordance with the embodiments shown in fig. 2A, fig. 3, and fig. 4, please refer to fig. 5, and fig. 5 is a schematic structural diagram of a mobile terminal according to an embodiment of the present invention, and as shown in the drawing, the mobile terminal includes a processor, a memory, a communication interface, and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the processor, and the programs include instructions for performing the following steps;
acquiring a preview image of a display screen, wherein the preview image comprises a face image;
determining a focusing plane of a plurality of target positions in the preview image, wherein the plurality of target positions comprise a first target position on the face image and a plurality of second target positions in an area except the face image;
and when the difference value between the focal length corresponding to the focusing plane of the first target position and the focal length corresponding to the focusing plane of any one of the second target positions is smaller than a preset threshold value, determining the face image as a false face image.
It can be seen that, in the embodiment of the present invention, the mobile terminal first obtains a preview image of the display screen, where the preview image includes a face image; secondly, determining a focusing plane of a plurality of target positions in the preview image, wherein the plurality of target positions comprise a first target position on the face image and a plurality of second target positions in an area except the face image; and finally, when the difference value between the focal length corresponding to the focusing plane of the first target position and the focal length corresponding to the focusing plane of any one of the second target positions is smaller than a preset threshold value, determining the face image as a false face image. Therefore, the mobile terminal judges the face image to be the false face image by acquiring the focal lengths of the focusing planes of the target positions, the safety of the mobile terminal is improved, the preview image of the display screen is detected without acquiring the face image, the detection convenience of the mobile terminal is facilitated, in addition, the hardware of the mobile terminal is utilized for detection, devices such as a camera and the like are not additionally added, and the hardware overhead is facilitated to be reduced.
In one possible example, the program includes instructions for performing the following steps: after the preview image of the display screen is obtained and before the focusing planes of a plurality of target positions in the preview image are determined, detecting the position of the face image in the preview image; and is used for confirming any position on the above-mentioned face picture is the above-mentioned first target position; and the image processing device is used for detecting the position relation between objects except the face image in the preview image and the face image; and the second target positions are determined according to the position relation.
In this possible example, in the above-described determining the plurality of second target positions based on the positional relationship, the instructions in the program are specifically configured to perform the steps of: acquiring a plurality of target objects with the position relationship with the face image being an overlapping relationship; and determining at least one position on each of the plurality of target objects as the second target position, the at least one position being a position in a non-overlapping area of the target object and the face image.
In one possible example, the program includes instructions for performing the following steps: after the preview image of the display screen is obtained and before the focusing planes of a plurality of target positions in the preview image are determined, determining the position of the face image in the preview image; and is used for confirming any position on the above-mentioned face picture is the above-mentioned first target position; and the second target positions are used for determining the second target positions in the area except the face image according to the position of the face image, and the second target positions comprise positions with the distance from the face image smaller than a preset distance.
In one possible example, in the aspect of determining the focus plane of the plurality of target positions in the preview image, the instructions in the program are specifically configured to perform the following steps: and respectively focusing by taking a plurality of target positions in the preview image as focusing points, and increasing the distribution of system resources to determine focusing planes of the plurality of target positions.
The above description has introduced the solution of the embodiment of the present invention mainly from the perspective of the method-side implementation process. It is understood that the mobile terminal includes hardware structures and/or software modules for performing the respective functions in order to implement the above-described functions. Those of skill in the art will readily appreciate that the present invention can be implemented in hardware or a combination of hardware and computer software, with the exemplary elements and algorithm steps described in connection with the embodiments disclosed herein. Whether a function is performed as hardware or computer software drives hardware depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
The embodiment of the present invention may perform the division of the functional units for the mobile terminal according to the method example described above, for example, each functional unit may be divided corresponding to each function, or two or more functions may be integrated into one processing unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit. It should be noted that the division of the unit in the embodiment of the present invention is schematic, and is only a logic function division, and there may be another division manner in actual implementation.
In case of an integrated unit, fig. 6 shows a block diagram of one possible functional unit composition of the mobile terminal involved in the above embodiment. The mobile terminal 600 includes: a processing unit 602 and a communication unit 603. Processing unit 602 is configured to control and manage actions of the mobile terminal, e.g., processing unit 602 is configured to support the mobile terminal to perform steps S201-S203 in fig. 2A, steps S301-S308 in fig. 3, steps S401-S406 in fig. 4, and/or other processes for the techniques described herein. The communication unit 603 is used to support communication between the mobile terminal and other devices (such as a display screen, etc.), or between the processing unit 602 and peripheral devices (such as a front camera, etc.) of the mobile terminal. The mobile terminal may further include a storage unit 601 for storing program codes and data of the mobile terminal.
The processing unit 602 is configured to obtain a preview image of a display screen through the communication unit 603, where the preview image includes a human face image; and a focusing plane for determining a plurality of target positions in the preview image, the plurality of target positions including a first target position on the face image and a plurality of second target positions in an area other than the face image; and determining the face image to be a false face image when the difference value between the focal length corresponding to the focusing plane of the first target position and the focal length corresponding to the focusing plane of any one of the second target positions is smaller than a preset threshold value.
In a possible example, after the processing unit 602 acquires a preview image of a display screen through the communication unit 603, before determining a focusing plane of a plurality of target positions in the preview image, the processing unit is further configured to: detecting the position of the face image in the preview image; and is used for confirming any position on the above-mentioned face picture is the above-mentioned first target position; and the image processing device is used for detecting the position relation between objects except the face image in the preview image and the face image; and the second target positions are determined according to the position relation.
In this possible example, in the aspect of determining the plurality of second target positions according to the position relationship, the processing unit 602 is specifically configured to: acquiring a plurality of target objects with the position relationship with the face image being an overlapping relationship; and determining at least one position on each of the plurality of target objects as the second target position, the at least one position being a position in a non-overlapping area of the target object and the face image.
In a possible example, after the processing unit 602 acquires a preview image of a display screen through the communication unit 603, before determining a focusing plane of a plurality of target positions in the preview image, the processing unit is further configured to: determining the position of the face image in the preview image; and is used for confirming any position on the above-mentioned face picture is the above-mentioned first target position; and the second target positions are used for determining the second target positions in the area except the face image according to the position of the face image, and the second target positions comprise positions with the distance from the face image smaller than a preset distance.
In one possible example, in terms of determining the focus planes of the plurality of target positions in the preview image, the processing unit 602 is specifically configured to: and respectively focusing by taking a plurality of target positions in the preview image as focusing points, and increasing the distribution of system resources to determine focusing planes of the plurality of target positions.
Wherein the processing unit 602 may be a processor or a controller, the communication unit 603 may be a communication interface, and the storage unit 601 may be a memory.
An embodiment of the present invention further provides a computer storage medium, where the computer storage medium stores a computer program for electronic data exchange, and the computer program enables a computer to execute part or all of the steps of any one of the methods described in the above method embodiments, and the computer includes a mobile terminal.
Embodiments of the present invention also provide a computer program product comprising a non-transitory computer readable storage medium storing a computer program operable to cause a computer to perform some or all of the steps of any of the methods as described in the above method embodiments. The computer program product may be a software installation package, the computer comprising a mobile terminal.
It should be noted that, for simplicity of description, the above-mentioned method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present invention is not limited by the order of acts, as some steps may occur in other orders or concurrently in accordance with the invention. Further, those skilled in the art should also appreciate that the embodiments described in the specification are preferred embodiments and that the acts and modules referred to are not necessarily required by the invention.
In the foregoing embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus may be implemented in other manners. For example, the above-described embodiments of the apparatus are merely illustrative, and for example, the above-described division of the units is only one type of division of logical functions, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of some interfaces, devices or units, and may be an electric or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated unit may be stored in a computer readable memory if it is implemented in the form of a software functional unit and sold or used as a stand-alone product. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a memory and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the above methods according to the embodiments of the present invention. And the aforementioned memory comprises: a U-disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic or optical disk, and other various media capable of storing program codes.
Those skilled in the art will appreciate that all or part of the steps in the methods of the above embodiments may be implemented by associated hardware instructed by a program, which may be stored in a computer-readable memory, which may include: flash Memory disks, Read-Only memories (ROMs), Random Access Memories (RAMs), magnetic or optical disks, and the like.
The above embodiments of the present invention are described in detail, and the principle and the implementation of the present invention are explained by applying specific embodiments, and the above description of the embodiments is only used to help understanding the method of the present invention and the core idea thereof; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.
Claims (14)
1. A mobile terminal, comprising a processor, a front camera connected to the processor, and a camera driving device, wherein:
the front camera is used for acquiring a preview image of the display screen, and the preview image comprises a face image;
the camera driving device is used for determining a focusing plane of a plurality of target positions in the preview image, wherein the plurality of target positions comprise a first target position on the face image and a plurality of second target positions in an area except the face image;
the processor is configured to determine that the face image is a false face image when it is determined that a difference between a focal length corresponding to the focusing plane of the first target position and a focal length corresponding to the focusing plane of any one of the plurality of second target positions is smaller than a preset threshold;
after the front-facing camera acquires a preview image of a display screen and before the camera driving device determines the focusing planes of a plurality of target positions in the preview image, the processor is further configured to: detecting the position of the face image in the preview image; and is used for confirming any position on the facial image as the first target position; the method comprises the steps of obtaining a preview image, and detecting the position relation between objects except the face image in the preview image and the face image; and the second target positions are determined according to the position relation.
2. The mobile terminal according to claim 1, wherein in said determining the plurality of second target locations according to the location relationship, the processor is specifically configured to: acquiring a plurality of target objects of which the position relations with the face images are overlapped relations; and the second target position is used for determining at least one position on each target object in the plurality of target objects, wherein the at least one position is a position in a non-overlapping area of the target object and the face image.
3. The mobile terminal of claim 1, wherein after the front-facing camera acquires a preview image of the display screen and before the camera driving device determines a focusing plane of a plurality of target positions in the preview image, the processor is further configured to: determining the position of the face image in the preview image; and is used for confirming any position on the facial image as the first target position; and the second target positions are used for determining the second target positions in the area except the face image according to the position of the face image, and the second target positions comprise positions with the distance to the face image smaller than a preset distance.
4. A mobile terminal according to any of claims 1-3, wherein in said determining a focal plane for a plurality of target positions in the preview image, the processor is specifically configured to: and respectively focusing by taking a plurality of target positions in the preview image as focusing points through the camera driving device, and increasing the distribution of system resources to determine focusing planes of the plurality of target positions.
5. A mobile terminal, comprising a processor, a front camera connected to the processor, and a camera driving device, wherein:
the front camera is used for acquiring a preview image of the display screen, and the preview image comprises a face image;
the camera driving device is used for determining a focusing plane of a plurality of target positions in the preview image, wherein the plurality of target positions comprise a first target position on the face image and a plurality of second target positions in an area except the face image;
the processor is configured to determine that the face image is a false face image when it is determined that a difference between a focal length corresponding to the focusing plane of the first target position and a focal length corresponding to the focusing plane of any one of the plurality of second target positions is smaller than a preset threshold;
wherein the content of the first and second substances,
after the front camera acquires a preview image of the display screen and before the camera driving device determines the focusing planes of a plurality of target positions in the preview image, the processor is further configured to: determining the position of the face image in the preview image; and is used for confirming any position on the facial image as the first target position; and the second target positions are used for determining the second target positions in the area except the face image according to the position of the face image, and the second target positions comprise positions with the distance to the face image smaller than a preset distance.
6. A face detection method, comprising:
acquiring a preview image of a display screen, wherein the preview image comprises a face image;
determining a focusing plane of a plurality of target positions in the preview image, wherein the plurality of target positions comprise a first target position on the face image and a plurality of second target positions in an area except the face image;
when the difference value between the focal length corresponding to the focusing plane of the first target position and the focal length corresponding to the focusing plane of any one of the second target positions is smaller than a preset threshold value, determining the face image as a false face image;
after the preview image of the display screen is acquired and before the focusing plane of the plurality of target positions in the preview image is determined, the method further comprises:
detecting the position of the face image in the preview image;
determining any position on the face image as the first target position;
detecting the position relation between objects except the face image in the preview image and the face image;
and determining the plurality of second target positions according to the position relation.
7. The method of claim 6, wherein said determining the plurality of second target locations according to the positional relationship comprises:
acquiring a plurality of target objects of which the position relations with the face images are overlapped relations;
determining at least one position on each of the plurality of target objects as the second target position, the at least one position being a position in a non-overlapping region of the target object and the face image.
8. The method of claim 6, wherein after the obtaining a preview image of a display screen and before the determining a focal plane for a plurality of target locations in the preview image, the method further comprises:
determining the position of the face image in the preview image;
determining any position on the face image as the first target position;
and determining a plurality of second target positions in the area except the face image according to the position of the face image, wherein the plurality of second target positions comprise positions with a distance to the face image smaller than a preset distance.
9. The method of any of claims 6-8, wherein determining the focal plane for the plurality of target locations in the preview image comprises:
and respectively focusing by taking a plurality of target positions in the preview image as focusing points, and increasing the distribution of system resources to determine focusing planes of the plurality of target positions.
10. A face detection method, comprising:
acquiring a preview image of a display screen, wherein the preview image comprises a face image;
determining a focusing plane of a plurality of target positions in the preview image, wherein the plurality of target positions comprise a first target position on the face image and a plurality of second target positions in an area except the face image;
when the difference value between the focal length corresponding to the focusing plane of the first target position and the focal length corresponding to the focusing plane of any one of the second target positions is smaller than a preset threshold value, determining the face image as a false face image;
after the preview image of the display screen is acquired and before the focusing plane of the plurality of target positions in the preview image is determined, the method further comprises:
determining the position of the face image in the preview image;
determining any position on the face image as the first target position;
and determining a plurality of second target positions in the area except the face image according to the position of the face image, wherein the plurality of second target positions comprise positions with a distance to the face image smaller than a preset distance.
11. A mobile terminal, characterized in that it comprises a processing unit and a communication unit,
the processing unit is used for acquiring a preview image of the display screen through the communication unit, wherein the preview image comprises a human face image; and a focusing plane for determining a plurality of target positions in the preview image, the plurality of target positions including a first target position on the face image and a plurality of second target positions in an area other than the face image; and determining the face image as a false face image when the difference value between the focal length corresponding to the focusing plane of the first target position and the focal length corresponding to the focusing plane of any one of the second target positions is smaller than a preset threshold value;
wherein the content of the first and second substances,
the processing unit is further configured to determine the position of the face image in the preview image after acquiring the preview image of the display screen and before determining the focusing planes of the plurality of target positions in the preview image; determining any position on the face image as the first target position; and determining a plurality of second target positions in the area except the face image according to the position of the face image, wherein the plurality of second target positions comprise positions with a distance to the face image smaller than a preset distance.
12. A mobile terminal, characterized in that it comprises a processing unit and a communication unit,
the processing unit is used for acquiring a preview image of the display screen through the communication unit, wherein the preview image comprises a human face image; and a focusing plane for determining a plurality of target positions in the preview image, the plurality of target positions including a first target position on the face image and a plurality of second target positions in an area other than the face image; and determining the face image as a false face image when the difference value between the focal length corresponding to the focusing plane of the first target position and the focal length corresponding to the focusing plane of any one of the second target positions is smaller than a preset threshold value;
the processing unit is further configured to, after a preview image of a display screen is acquired and before a focusing plane of a plurality of target positions in the preview image is determined, detect a position of the face image in the preview image; determining any position on the face image as the first target position; detecting the position relation between objects except the face image in the preview image and the face image; and determining the plurality of second target positions according to the position relation.
13. A mobile terminal comprising a processor, memory, a communications interface, and one or more programs stored in the memory and configured for execution by the processor, the programs including instructions for performing the steps in the method of any of claims 6-10.
14. A computer-readable storage medium, characterized in that a computer program for electronic data exchange is stored, wherein the computer program causes a computer to perform the method according to any of claims 6-10, the computer comprising a mobile terminal.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710819035.1A CN107657219B (en) | 2017-09-12 | 2017-09-12 | Face detection method and related product |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710819035.1A CN107657219B (en) | 2017-09-12 | 2017-09-12 | Face detection method and related product |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107657219A CN107657219A (en) | 2018-02-02 |
| CN107657219B true CN107657219B (en) | 2021-06-15 |
Family
ID=61129502
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710819035.1A Active CN107657219B (en) | 2017-09-12 | 2017-09-12 | Face detection method and related product |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107657219B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108809992B (en) * | 2018-06-15 | 2021-07-13 | 黄玉新 | Face recognition verification system and correlation method of face recognition verification system and target system |
| CN109190539B (en) * | 2018-08-24 | 2020-07-07 | 阿里巴巴集团控股有限公司 | Face recognition method and device |
| CN109409328A (en) * | 2018-11-12 | 2019-03-01 | 华南师范大学 | A kind of method of 3D Face datection |
| CN110418064B (en) * | 2019-09-03 | 2022-03-04 | 北京字节跳动网络技术有限公司 | Focusing method and device, electronic equipment and storage medium |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105512637A (en) * | 2015-12-22 | 2016-04-20 | 联想(北京)有限公司 | Image processing method and electric device |
| CN105975926A (en) * | 2016-04-29 | 2016-09-28 | 中山大学 | Human face living detection method based on light field camera |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP6512810B2 (en) * | 2014-12-11 | 2019-05-15 | キヤノン株式会社 | Image pickup apparatus, control method and program |
| CN105809111B (en) * | 2016-02-25 | 2019-10-01 | 曹宇 | Identity identifying method, device, equipment and system |
| CN106572305A (en) * | 2016-11-03 | 2017-04-19 | 乐视控股（北京）有限公司 | Image shooting method, image processing method, apparatuses and electronic device |
-
2017
- 2017-09-12 CN CN201710819035.1A patent/CN107657219B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105512637A (en) * | 2015-12-22 | 2016-04-20 | 联想(北京)有限公司 | Image processing method and electric device |
| CN105975926A (en) * | 2016-04-29 | 2016-09-28 | 中山大学 | Human face living detection method based on light field camera |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107657219A (en) | 2018-02-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107657219B (en) | Face detection method and related product | |
| CN107480601B (en) | Detection method and related product | |
| CN110995994B (en) | Image shooting method and related device | |
| CN107729836B (en) | Face recognition method and related product | |
| EP3471015A1 (en) | Face recognition method and related product | |
| CN108429879B (en) | Electronic apparatus, camera control method, camera control apparatus, and computer-readable storage medium | |
| CN107491672B (en) | Unlocking processing method and related product | |
| CN107622243B (en) | Unlocking control method and related product | |
| CN107622191B (en) | Unlocking control method and related product | |
| CN107527019B (en) | Unlocking control method and related product | |
| CN107563338B (en) | Face detection method and related product | |
| CN107832598B (en) | Unlocking control method and related product | |
| CN107402787B (en) | Iris recognition mode starting method and related product | |
| US11238563B2 (en) | Noise processing method and apparatus | |
| CN111373728B (en) | Control method and device for camera application | |
| CN107454251B (en) | Unlocking control method and related product | |
| CN107832669B (en) | Face detection method and related product | |
| CN111603772A (en) | Area detection method, device, equipment and storage medium | |
| CN108388781B (en) | Mobile terminal, image data acquisition method and related product | |
| CN112990197A (en) | License plate recognition method and device, electronic equipment and storage medium | |
| CN110781975B (en) | Image processing method and device, electronic device and storage medium | |
| CN110933314A (en) | Focus-following shooting method and related product | |
| CN107493368B (en) | Unlocking method and related product | |
| EP3236377A1 (en) | Method, device and system for preventing account from being broken into | |
| CN114519794A (en) | Feature point matching method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18 Applicant after: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS Corp.,Ltd. Address before: Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18 Applicant before: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS Corp.,Ltd. |
|
| CB02 | Change of applicant information | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |