CN111610921A - Gesture recognition method and device - Google Patents

Gesture recognition method and device Download PDF

Info

Publication number
CN111610921A
CN111610921A CN201910143406.8A CN201910143406A CN111610921A CN 111610921 A CN111610921 A CN 111610921A CN 201910143406 A CN201910143406 A CN 201910143406A CN 111610921 A CN111610921 A CN 111610921A
Authority
CN
China
Prior art keywords
fingerprint detection
determining
sub
screen
detection signal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910143406.8A
Other languages
Chinese (zh)
Inventor
刘楠
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Xiaomi Mobile Software Co Ltd
Original Assignee
Beijing Xiaomi Mobile Software Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Xiaomi Mobile Software Co Ltd filed Critical Beijing Xiaomi Mobile Software Co Ltd
Priority to CN201910143406.8A priority Critical patent/CN111610921A/en
Publication of CN111610921A publication Critical patent/CN111610921A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/12—Fingerprints or palmprints
    • G06V40/13—Sensors therefor
    • G06V40/1318—Sensors therefor using electro-optical elements or layers, e.g. electroluminescent sensing
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/12—Fingerprints or palmprints
    • G06V40/1347—Preprocessing; Feature extraction
    • G06V40/1359—Extracting features related to ridge properties; Determining the fingerprint type, e.g. whorl or loop

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The disclosure relates to a gesture recognition method and device. The method comprises the following steps: controlling a fingerprint detection module under a screen to perform fingerprint detection so as to acquire fingerprint detection signals corresponding to a plurality of sub-areas in a fingerprint detection area of the screen; determining that the detection distance between the detected object and the screen is greater than a first distance threshold and less than or equal to a second distance threshold; and determining the change condition of the fingerprint detection signal, and executing corresponding gesture operation when the change condition of the fingerprint detection signal meets the set condition. According to the technical scheme, the gesture made by the detected object can be acquired when the detected object is not in contact with the screen, namely, the gesture operation of the user can be executed when the user is not convenient to touch the screen, and therefore the user experience is improved.

Description

Gesture recognition method and device
Technical Field
The disclosure relates to the technical field of terminal control, and in particular relates to a gesture recognition method and device.
Background
With the development of electronic device technology, the functions of the touch screen, such as gesture recognition, are increasing. In the related art, when a user uses an electronic device, the user can click or move a finger on a screen to make a corresponding gesture, so that the electronic device recognizes the gesture and performs a corresponding operation.
Disclosure of Invention
To overcome the problems in the related art, embodiments of the present disclosure provide a gesture recognition method and apparatus. The technical scheme is as follows:
according to a first aspect of embodiments of the present disclosure, there is provided a gesture recognition method, including:
controlling a fingerprint detection module under a screen to perform fingerprint detection so as to acquire fingerprint detection signals corresponding to a plurality of sub-areas in a fingerprint detection area of the screen;
determining that the detection distance between the detected object and the screen is greater than a first distance threshold and less than or equal to a second distance threshold; and
and determining the change condition of the fingerprint detection signal, and executing corresponding gesture operation when the change condition of the fingerprint detection signal meets the set condition.
According to the technical scheme, fingerprint detection is carried out through a fingerprint detection module under a control screen, so that fingerprint detection signals corresponding to a plurality of sub-areas in a fingerprint detection area of the screen are obtained, when it is determined that the detection distance between a detected object and the screen is larger than a first distance threshold and smaller than or equal to a second distance threshold (namely, the detected object is not in contact with the screen, but the distance between the detected object and the screen is not too far), the change condition of the fingerprint detection signals is determined, and when the change condition of the fingerprint detection signals meets a set condition, corresponding gesture operation is executed. According to the scheme, the gesture made by the detected object can be acquired when the detected object is not in contact with the screen, namely, the gesture operation of the user can be executed when the user is not convenient to touch the screen, and therefore the user experience is improved.
In one embodiment, determining a change in the fingerprint detection signal comprises:
acquiring signal distribution conditions of fingerprint detection signals corresponding to a plurality of sub-areas at least two time points;
and determining the change condition of the fingerprint detection signal according to the signal distribution conditions of at least two time points.
In one embodiment, acquiring signal distribution conditions of fingerprint detection signals corresponding to a plurality of sub-regions at least two time points includes:
when the intensity value of the fingerprint detection signal corresponding to any sub-region in the plurality of sub-regions meets a signal intensity preset condition, acquiring position information corresponding to the sub-region and acquisition time of the position information, wherein the acquisition time of the acquired position information comprises at least two time points;
determining the change condition of the fingerprint detection signal according to the signal distribution conditions of at least two time points, comprising the following steps:
and determining the change condition of the fingerprint detection signal according to the plurality of pieces of position information and the acquisition time of each piece of position information.
In one embodiment, determining a change in the fingerprint detection signal based on the plurality of location information and the acquisition time of each location information comprises:
and determining the change condition of the fingerprint detection signal according to the plurality of pieces of position information, the acquisition time of each piece of position information and the intensity value of the fingerprint detection signal corresponding to the sub-region corresponding to each piece of position information.
In one embodiment, determining a change in the fingerprint detection signal comprises:
acquiring signal intensity values of fingerprint detection signals corresponding to at least one sub-region at least two time points;
and determining the change condition of the fingerprint detection signal according to the signal intensity values of at least two time points.
In one embodiment, determining that the detected distance between the detected object and the screen is greater than a first distance threshold and less than or equal to a second distance threshold comprises:
and determining that the signal-to-noise ratio of the fingerprint detection signal is within a set interval, wherein the signal-to-noise ratio is inversely related to the detection distance.
In one embodiment, controlling a fingerprint detection module under a screen to perform fingerprint detection to acquire a fingerprint detection signal corresponding to each sub-area in a fingerprint detection area of the screen includes:
determining an operating mode of the electronic equipment;
when the working mode meets the preset gesture obtaining condition, the fingerprint detection module under the screen is controlled to perform fingerprint detection so as to obtain fingerprint detection signals corresponding to each sub-area in the fingerprint detection area of the screen.
In a second aspect of embodiments of the present disclosure, there is provided a gesture recognition apparatus including:
the fingerprint detection module is used for controlling the fingerprint detection module under the screen to perform fingerprint detection so as to acquire fingerprint detection signals corresponding to a plurality of sub-areas in the fingerprint detection area of the screen;
the distance determining module is used for determining that the detection distance between the detected object and the screen is greater than a first distance threshold and smaller than or equal to a second distance threshold; and
and the gesture operation module is used for determining the change condition of the fingerprint detection signal and executing corresponding gesture operation when the change condition of the fingerprint detection signal meets the set condition.
In one embodiment, the gesture operation module includes:
the signal distribution acquisition submodule is used for acquiring the signal distribution conditions of the fingerprint detection signals corresponding to the plurality of sub-areas at least two time points;
and the first change condition determining submodule is used for determining the change condition of the fingerprint detection signal according to the signal distribution conditions of at least two time points.
In one embodiment, the signal distribution acquisition sub-module includes:
the fingerprint detection device comprises a position information acquisition unit, a fingerprint detection unit and a control unit, wherein the position information acquisition unit is used for acquiring position information corresponding to any sub-area in a plurality of sub-areas and acquisition time of the position information when the intensity value of a fingerprint detection signal corresponding to the sub-area meets a signal intensity preset condition, and the acquisition time of the acquired position information comprises at least two time points;
a first variation determination submodule comprising:
and the change situation determining unit is used for determining the change situation of the fingerprint detection signal according to the plurality of pieces of position information and the acquisition time of each piece of position information.
In one embodiment, the change situation determination unit includes:
and the change situation determining subunit is used for determining the change situation of the fingerprint detection signal according to the plurality of pieces of position information, the acquisition time of each piece of position information and the intensity value of the fingerprint detection signal corresponding to the sub-region corresponding to each piece of position information.
In one embodiment, the gesture operation module includes:
the sub-region signal intensity acquisition sub-module is used for acquiring signal intensity values of fingerprint detection signals corresponding to at least one sub-region at least two time points;
and the second change condition determining submodule is used for determining the change condition of the fingerprint detection signal according to the signal intensity values of at least two time points.
In one embodiment, the distance determination module includes:
and the distance determining submodule is used for determining that the signal-to-noise ratio of the fingerprint detection signal is positioned in a set interval, wherein the signal-to-noise ratio is inversely related to the detection distance.
In one embodiment, a fingerprint detection module includes:
the working mode determining submodule is used for determining the working mode of the electronic equipment;
and the fingerprint detection submodule is used for controlling the fingerprint detection module under the screen to perform fingerprint detection when the working mode meets the preset gesture acquisition condition so as to acquire a fingerprint detection signal corresponding to each sub-region in the fingerprint detection region of the screen.
In a third aspect of the embodiments of the present disclosure, there is provided a gesture recognition apparatus including:
a processor;
a memory for storing processor-executable instructions;
wherein the processor is configured to:
controlling a fingerprint detection module under a screen to perform fingerprint detection so as to acquire fingerprint detection signals corresponding to a plurality of sub-areas in a fingerprint detection area of the screen;
determining that the detection distance between the detected object and the screen is greater than a first distance threshold and less than or equal to a second distance threshold; and
and determining the change condition of the fingerprint detection signal, and executing corresponding gesture operation when the change condition of the fingerprint detection signal meets the set condition.
A fourth aspect of the embodiments of the present disclosure provides a computer-readable storage medium having stored thereon computer instructions, characterized in that the instructions, when executed by a processor, implement the steps of the method of any one of the first aspects of the embodiments of the present disclosure.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and together with the description, serve to explain the principles of the disclosure.
FIG. 1a is a schematic flow diagram illustrating a method of gesture recognition according to an example embodiment;
FIG. 1b1 is a schematic flow diagram illustrating a gesture recognition method according to an exemplary embodiment;
FIG. 1b2 is a schematic diagram illustrating fingerprint detection signal strength for a fingerprint detection area in accordance with an exemplary embodiment;
FIG. 1b3 is a schematic diagram illustrating fingerprint detection signal strength for a fingerprint detection area in accordance with an exemplary embodiment;
FIG. 1c is a schematic flow diagram illustrating a method of gesture recognition according to an example embodiment;
FIG. 1d is a schematic flow diagram illustrating a gesture recognition method in accordance with an exemplary embodiment;
FIG. 1e is a schematic flow diagram illustrating a gesture recognition method according to an example embodiment;
FIG. 1f is a schematic flow diagram illustrating a method of gesture recognition according to an example embodiment;
FIG. 2a is a schematic diagram illustrating a structure of a gesture recognition apparatus according to an exemplary embodiment;
FIG. 2b is a schematic diagram illustrating the structure of a gesture recognition apparatus according to an exemplary embodiment;
FIG. 2c is a schematic diagram illustrating the structure of a gesture recognition apparatus according to an example embodiment;
FIG. 2d is a schematic diagram illustrating the structure of a gesture recognition apparatus according to an exemplary embodiment;
FIG. 2e is a schematic diagram illustrating the structure of a gesture recognition apparatus according to an example embodiment;
FIG. 2f is a schematic diagram illustrating the structure of a gesture recognition device according to an exemplary embodiment;
FIG. 2g is a schematic diagram illustrating a structure of a gesture recognition apparatus according to an example embodiment;
FIG. 3 is a block diagram illustrating an apparatus in accordance with an exemplary embodiment;
FIG. 4 is a block diagram illustrating an apparatus in accordance with an example embodiment.
Detailed Description
Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the exemplary embodiments below are not intended to represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.
With the development of electronic device technology, the functions of the touch screen, such as gesture recognition, are increasing. In the related art, when a user uses an electronic device, the user can make a corresponding gesture by touching a screen and clicking or moving a finger, so that the electronic device recognizes the gesture and performs a corresponding operation.
Although the above solution enables the user to operate the electronic device by touching the screen and clicking or moving a finger to make a corresponding gesture, in some application scenarios, for example, when the user cooks in a kitchen or has a meal in a restaurant, the user may not conveniently touch the screen, so that the user cannot make a gesture to operate the electronic device, thereby impairing the user experience.
In recent years, a full screen has become a trend of future development of the intelligent terminal, and in order to make the full screen compatible with the function of fingerprint identification, a fingerprint identification area may be designated on the screen, and a fingerprint detection module may be disposed under the fingerprint identification area. When a fingerprint needs to be identified, the electronic device may prompt the user to place a finger on the screen and into the fingerprint identification area. When the electronic equipment detects that an object in contact with the screen exists in the fingerprint identification area of the screen, the electronic equipment can control the fingerprint detection module to perform fingerprint detection on the grains on the surface of the object, and fingerprint identification is performed on the grains according to the fingerprint detection result.
According to the technical scheme, fingerprint detection is carried out through a fingerprint detection module under a control screen, so that fingerprint detection signals corresponding to a plurality of sub-areas in a fingerprint detection area of the screen are obtained, when it is determined that the detection distance between a detected object and the screen is larger than a first distance threshold and smaller than or equal to a second distance threshold (namely, the detected object is not in contact with the screen, but the distance between the detected object and the screen is not too far), the change condition of the fingerprint detection signals is determined, and when the change condition of the fingerprint detection signals meets a set condition, corresponding gesture operation is executed. According to the scheme, the gesture made by the detected object can be acquired when the detected object is not in contact with the screen, namely the gesture made by the user can be acquired when the user is not convenient to touch the screen, and therefore user experience is improved.
The embodiment of the disclosure provides a gesture recognition method, which is used for controlling an electronic device, wherein the electronic device can be a mobile phone, a tablet computer, a smart watch and other devices with an underscreen fingerprint recognition function, and the embodiment of the disclosure does not limit the electronic device. As shown in fig. 1a, the gesture recognition method includes the following steps 101 to 105:
in step 101, a fingerprint detection module under a screen is controlled to perform fingerprint detection to acquire fingerprint detection signals corresponding to a plurality of sub-areas in a fingerprint detection area of the screen.
For example, the fingerprint detection module may be an optical fingerprint detection module or an ultrasonic fingerprint detection module. Wherein, optics fingerprint detection module can include light source and light sensor, when optics fingerprint detection module carries out the fingerprint detection, the light that the light source launched is beaten on the finger, because the valley (protruding line) of finger fingerprint and ridge (sunken line) are different to the reflection effect of light, consequently there is the difference in the light that corresponds the valley on the light sensor that the finger reflects, fingerprint line information can be restoreed out with the help of ADC conversion again through photoelectric conversion, realize the fingerprint identification function through the template contrast.
In step 102, it is determined that the detected distance between the detected object and the screen is greater than a first distance threshold and less than or equal to a second distance threshold.
For example, the detection distance may be obtained by detecting the detected object by a distance detection sensor.
Meanwhile, when the detected object is suspended above the screen, the signal-to-noise ratio of the acquired fingerprint detection signal is reduced compared with the signal-to-noise ratio of the fingerprint detection signal acquired when the detected object contacts the screen, and the larger the distance is, the smaller the signal-to-noise ratio is. Therefore, the distance can also be detected by acquiring the signal-to-noise ratio of the fingerprint detection signal and acquiring the detection distance according to the signal-to-noise ratio, wherein the signal-to-noise ratio is inversely related to the detection distance. For example, determining that the detection distance between the detected object and the screen is greater than the first distance threshold and less than or equal to the second distance threshold may be performed by determining that the signal-to-noise ratio of the fingerprint detection signal is within a set interval.
It should be noted that, the signal-to-noise ratio of the fingerprint detection signal may be obtained according to the fingerprint detection signal corresponding to any sub-region in the fingerprint detection region, or may be obtained according to the fingerprint detection signals corresponding to a plurality of sub-regions in the fingerprint detection region, and an average value or a minimum value of the signal-to-noise ratios is taken to perform further processing to obtain the detection distance.
When the detection distance is greater than the first distance threshold and less than or equal to the second distance threshold, it can be understood that the distance between the detected object and the screen is an appropriate distance (e.g., 3-5cm), and the fingerprint detection module can still clearly acquire the fingerprint detection signal.
In step 103, the change condition of the fingerprint detection signal is determined, and when the change condition of the fingerprint detection signal satisfies the setting condition, the corresponding gesture operation is executed.
For example, the variation of the fingerprint detection signal may be a variation of the fingerprint detection signal in any one of the acquisition time, the acquisition position, and the signal strength. The change condition of the fingerprint detection signal can be used for indicating the motion trend or motion trail of the detected object suspended above the screen.
The electronic device may pre-store a corresponding relationship between a change condition of the fingerprint detection signal and a gesture operation, where the corresponding relationship describes a plurality of different gesture operations corresponding to different change conditions, and the different gesture operations corresponding to different change conditions are different. By inquiring the corresponding relation, when the change condition identical to that of the fingerprint detection signal is found in the corresponding relation, the change condition of the fingerprint detection signal can be considered to meet the set condition, and the gesture operation corresponding to the corresponding relation is executed.
For example, in a scene of playing audio, the corresponding relationship between the gesture and the operation instruction pre-stored in the electronic device describes that the operation instruction corresponding to leftward sliding is playing the next music audio; sliding the corresponding operation instruction to the right to play the previous music audio; the corresponding operation instruction of upward sliding is volume increase; and the operation instruction corresponding to the downward sliding is that the volume is reduced. When the electronic equipment determines that the gesture corresponding to the moving track slides upwards, the corresponding relation is inquired, the operation instruction corresponding to the gesture is determined to be playing of the next music, and at the moment, the electronic equipment can execute the operation instruction, namely playing of the next music in the current list.
For another example, in a scene of browsing photos, the correspondence between the gesture and the operation instruction stored in advance in the electronic device describes that the operation instruction corresponding to leftward sliding is to display the next photo; sliding the corresponding operation instruction to the right to display the previous picture; sliding the corresponding operation instruction upwards to display other photos related to the current photo; and sliding the corresponding operation instruction downwards to return to the album main interface. When the electronic equipment determines that the gesture corresponding to the moving track slides upwards, the corresponding relation is inquired, and the operation instruction corresponding to the gesture is determined to be displaying the next photo, and at the moment, the electronic equipment can execute the operation instruction, namely displaying the next photo of the current photo album.
According to the technical scheme, fingerprint detection is carried out through a fingerprint detection module under a control screen, so that fingerprint detection signals corresponding to a plurality of sub-areas in a fingerprint detection area of the screen are obtained, when it is determined that the detection distance between a detected object and the screen is larger than a first distance threshold and smaller than or equal to a second distance threshold (namely, the detected object is not in contact with the screen, but the distance between the detected object and the screen is not too far), the change condition of the fingerprint detection signals is determined, and when the change condition of the fingerprint detection signals meets a set condition, corresponding gesture operation is executed. According to the scheme, the gesture made by the detected object can be acquired when the detected object is not in contact with the screen, namely the gesture made by the user can be acquired when the user is not convenient to touch the screen, and therefore user experience is improved.
In one embodiment, as shown in fig. 1b1, in step 103, determining a variation of the fingerprint detection signal, and when the variation of the fingerprint detection signal satisfies a set condition, performing a corresponding gesture operation, which can be implemented by steps 1031 to 1033:
in step 1031, signal distributions of fingerprint detection signals corresponding to the plurality of sub-regions at least two time points are obtained.
In step 1032, the variation of the fingerprint detection signal is determined according to the signal distribution at least two time points.
In step 1033, when the variation of the fingerprint detection signal satisfies a set condition, a corresponding gesture operation is performed.
For example, the plurality of sub-regions may be arranged in a matrix in the fingerprint detection region, and by acquiring an intensity difference of fingerprint detection signals of the plurality of sub-regions in the matrix at two time points, a movement trend of a detected object, such as a finger, between the two time points may be determined according to the intensity difference, so as to acquire a corresponding gesture operation according to the intensity difference, and perform the gesture operation. For example, the fingerprint detection area includes M × N sub-areas arranged in a matrix, and the signal distribution of the fingerprint detection signals corresponding to the sub-areas at least two time points may be obtained by obtaining a first fingerprint detection signal intensity matrix corresponding to a first time point and a first fingerprint detection signal intensity matrix corresponding to a second time point, where the first fingerprint detection signal intensity matrix and the second fingerprint detection signal intensity matrix are both M × N matrices, and a parameter in the matrices is used to indicate the fingerprint detection signal intensity corresponding to the sub-area at a corresponding position in the fingerprint detection area, and a third fingerprint detection signal intensity matrix is obtained by comparing the first fingerprint detection signal intensity matrix with the second fingerprint detection signal intensity matrix (for example, subtracting the second fingerprint detection signal intensity matrix from the first fingerprint detection signal intensity matrix), and the third fingerprint detection signal intensity matrix is used to indicate the fingerprint detection signal intensity in the fingerprint detection area from the first time point to the second time point The fingerprint of the sub-area of (a) detects a signal variation.
For another example, fig. 1b2 and fig. 1b3 are schematic diagrams of fingerprint detection signal intensity of a fingerprint detection area, which are signal distribution conditions of fingerprint detection signals corresponding to all sub-areas in the fingerprint detection area at a first time point as shown in fig. 1a2, and signal distribution conditions of fingerprint detection signals corresponding to all sub-areas in the fingerprint detection area at a second time point as shown in fig. 1a3, wherein the surface of the screen 10 is a fingerprint detection area, the fingerprint detection area is divided into a plurality of rectangular sub-areas, and the number in each rectangular sub-area is the signal intensity of the fingerprint detection signal corresponding to the sub-area. The sub-region with a signal strength of 0 can be understood as having no detected object above the sub-region, the sub-region with a signal strength of 1 can be understood as having a possible detected object above the sub-region, and the sub-regions with a signal strength of 2 and a signal strength of 5 can be understood as having a detected object above the sub-region. That is, as shown in fig. 1b2, at a first time point, the detected object is located above the first position area 11, at a second time point, the detected object is located above the second position area 12, and by comparing the signal intensity of all sub-areas in the fingerprint detection area at the first time point and the second time point, it can be confirmed that the movement trend of the detected object is moving from above the first position area 11 to above the second position area 12, and the gesture operation corresponding to the movement trend is performed.
The change conditions of the fingerprint detection signals are determined by acquiring the signal distribution conditions of the fingerprint detection signals corresponding to the plurality of sub-areas at least two time points and according to the signal distribution conditions of the at least two time points, and the change conditions of the fingerprint detection signals are determined by acquiring the fingerprint detection signals at fewer time points, so that the speed of determining the change conditions of the fingerprint detection signals is increased, and the consumption of processing resources is reduced.
In one embodiment, as shown in fig. 1c, in step 1031, signal distributions of fingerprint detection signals corresponding to a plurality of sub-regions at least two time points are obtained. This can be achieved by step 1131:
in step 1131, when the intensity value of the fingerprint detection signal corresponding to any one of the sub-regions satisfies the preset signal intensity condition, the location information corresponding to the sub-region and the time for acquiring the location information are acquired.
Wherein the acquisition time of the acquired position information includes at least two time points
In step 1032, the change condition of the fingerprint detection signal is determined according to the signal distribution conditions of at least two time points, which may be implemented by step 1132:
in step 1132, the variation of the fingerprint detection signal is determined according to the plurality of pieces of position information and the acquisition time of each piece of position information.
For example, the intensity value of the fingerprint detection signal corresponding to any one of the multiple sub-regions satisfies the signal intensity preset condition, and may be that the intensity value of the fingerprint detection signal corresponding to any one of the multiple sub-regions is greater than or equal to a preset intensity threshold, or may be that the intensity value of the fingerprint detection signal corresponding to any one of the multiple sub-regions belongs to a preset intensity interval. The intensity value of the fingerprint detection signal corresponding to any one of the plurality of sub-regions is greater than or equal to the preset intensity value of the fingerprint detection signal, or the intensity value of the fingerprint detection signal corresponding to any one of the plurality of sub-regions belongs to the preset intensity interval, and it can be understood that the detected object is located right above the sub-region. When the detected object is located right above the sub-region, the acquired position information corresponding to the sub-region and the acquisition time of the position information may be used to indicate the position of the detected object at that moment.
Further, when the change condition of the fingerprint detection signal satisfies the setting condition, a corresponding gesture operation is performed, which may be to determine a target motion trajectory of the detected object according to the plurality of pieces of position information and the acquisition time of each piece of position information, and perform a gesture operation corresponding to the target motion trajectory of the detected object. The target motion trajectory of the detected object may be determined by determining, according to the acquisition time, positions where the detected object passes in sequence when moving, so as to acquire the target motion trajectory of the detected object. Multiple gestures may be stored in the electronic device, with different gestures being used to implement different operations. Determining an operation gesture corresponding to a target moving track of the detected object, determining a target preset moving track with the highest similarity to the target moving track by acquiring the similarity between the target moving track and each preset moving track in a plurality of preset moving tracks, determining a gesture corresponding to the target preset moving track as an operation gesture corresponding to the target moving track, and executing the operation gesture.
It should be noted that the matching probability may be an overlapping rate of the movement trajectory and the gesture, where the higher the overlapping rate is, the higher the matching probability is, and the lower the overlapping rate is, the lower the matching probability is; or the matching probability can also be an angle difference between the movement track and the gesture, the larger the angle difference is, the lower the matching probability is, and the smaller the angle difference is, the higher the matching probability is.
For example, taking the matching probability as the angle difference as an example, the electronic device may store four gestures, namely, a downward slide, an upward slide, a leftward slide, and a rightward slide. When the terminal acquires the movement track, the angle difference between the movement track and the gesture sliding upwards is determined to be 30 degrees, the angle difference between the movement track and the gesture sliding downwards is determined to be 150 degrees, the angle difference between the movement track and the gesture sliding leftwards is determined to be 110 degrees, and the angle difference between the movement track and the gesture sliding rightwards is determined to be 60 degrees. It can be considered that the probability of matching the movement trajectory with the gesture of sliding upward is the highest, and the probability of matching the movement trajectory with the gesture of sliding downward is the lowest, so that the terminal can regard the upward sliding as the gesture corresponding to the movement trajectory.
When the strength value of the fingerprint detection signal corresponding to any one of the sub-regions meets the signal strength preset condition, the position information corresponding to the sub-region and the acquisition time of the position information are acquired, the change condition of the fingerprint detection signal is determined according to the plurality of position information and the acquisition time of each position information, and the change condition of the fingerprint detection signal can be acquired clearly, so that more accurate gesture operation is further acquired and executed, the accuracy of executing the gesture operation is improved, and the user experience is improved.
In one embodiment, as shown in fig. 1d, in step 1132, determining the variation of the fingerprint detection signal according to the plurality of position information and the acquisition time of each position information may be implemented by step 1232:
in step 1232, a change condition of the fingerprint detection signal is determined according to the plurality of location information, the obtaining time of each location information, and the intensity value of the fingerprint detection signal corresponding to the sub-area corresponding to each location information.
For example, since the intensity value of the fingerprint detection signal corresponding to the sub-region corresponding to each piece of location information may indicate the distance between the detected object directly above the sub-region and the screen, the variation of the fingerprint detection signal determined according to the plurality of pieces of location information, the acquisition time of each piece of location information, and the intensity value of the fingerprint detection signal corresponding to the sub-region corresponding to each piece of location information may be used to indicate the three-dimensional movement trend of the detected object hovering above the screen.
By determining the change condition of the fingerprint detection signal according to the plurality of pieces of position information, the acquisition time of each piece of position information and the strength value of the fingerprint detection signal corresponding to the sub-region corresponding to each piece of position information, the determined change condition of the fingerprint detection signal can be used for indicating the three-dimensional motion trend of the detected object suspended above the screen, so that the type or the number of gesture operations which can be executed is increased, and the user experience is improved.
In one embodiment, as shown in fig. 1e, in step 103, determining a variation of the fingerprint detection signal, and when the variation of the fingerprint detection signal satisfies a set condition, performing a corresponding gesture operation, which may be implemented by steps 1034 to 1036:
in step 1034, signal strength values of the fingerprint detection signal corresponding to at least one sub-region at least two time points are obtained.
In step 1035, a change in the fingerprint detection signal is determined based on the signal strength values of the at least two time points.
In step 1036, when the variation of the fingerprint detection signal satisfies a set condition, a corresponding gesture operation is performed.
The signal intensity values of the fingerprint detection signals corresponding to at least one sub-area at least two time points are obtained, the change condition of the fingerprint detection signals is determined according to the signal intensity values of the at least two time points, and the change condition of the fingerprint detection signals can be used for indicating the motion trend of a detected object suspended above a screen to approach or leave the screen, so that the types or the number of executed gesture operations is increased, and the user experience is improved.
In one embodiment, as shown in fig. 1f, in step 101, controlling a fingerprint detection module under a screen to perform fingerprint detection to acquire fingerprint detection signals corresponding to a plurality of sub-areas in a fingerprint detection area of the screen, which may be implemented in steps 1011 to 1012;
in step 1011, the operating mode of the electronic device is determined.
In step 1012, when the working mode satisfies the preset gesture obtaining condition, the fingerprint detection module under the screen is controlled to perform fingerprint detection to obtain a fingerprint detection signal corresponding to each sub-region in the fingerprint detection region of the screen.
For example, the working mode satisfies the preset gesture obtaining condition, which may be that when the electronic device is in a standby state and receives an incoming call or a message, the working mode of the electronic device is considered to satisfy the preset gesture obtaining condition; the operation mode of the electronic device may also be considered to satisfy a preset gesture obtaining condition when the electronic device is in an image (e.g., photo) browsing mode or a photographing mode.
Through confirming the operating mode of electronic equipment to when operating mode satisfies predetermined gesture and acquires the condition, the fingerprint detection module under the control screen carries out fingerprint detection, with the fingerprint detection signal that every subregion corresponds in the fingerprint detection area of acquireing and screen, can control fingerprint detection module and carry out fingerprint detection when only needing discernment gesture, reduced the unnecessary consumption, improved user experience.
The following are embodiments of the disclosed apparatus that may be used to perform embodiments of the disclosed methods.
Fig. 2a is a block diagram illustrating a gesture recognition apparatus 20 according to an exemplary embodiment, where the gesture recognition apparatus 20 may be a terminal or a part of the terminal, and the gesture recognition apparatus 20 may be implemented as part or all of an electronic device through software, hardware or a combination of both. As shown in fig. 2a, the gesture recognition apparatus 20 includes:
the fingerprint detection module 201 is configured to control the fingerprint detection module under the screen to perform fingerprint detection, so as to obtain fingerprint detection signals corresponding to a plurality of sub-areas in the fingerprint detection area of the screen.
And the distance determining module 202 is configured to determine that the detected distance between the detected object and the screen is greater than a first distance threshold and less than or equal to a second distance threshold. And
the gesture operation module 203 is configured to determine a change condition of the fingerprint detection signal, and execute a corresponding gesture operation when the change condition of the fingerprint detection signal meets a set condition.
In one embodiment, as shown in fig. 2b, the gesture operation module 203 includes:
the signal distribution obtaining sub-module 2031 is configured to obtain signal distribution conditions of the fingerprint detection signals corresponding to the multiple sub-regions at least two time points.
The first variation determining sub-module 2032 is configured to determine a variation of the fingerprint detection signal according to signal distributions of at least two time points.
In one embodiment, as shown in fig. 2c, the signal distribution obtaining sub-module 2031 comprises:
a location information acquiring unit 2131, configured to, when an intensity value of a fingerprint detection signal corresponding to any one of the multiple sub-regions meets a signal intensity preset condition, acquire location information corresponding to the sub-region and an acquisition time of the location information, where the acquisition time of the acquired location information includes at least two time points.
The first variation determining sub-module 2032 includes:
a variation determining unit 2132, configured to determine a variation of the fingerprint detection signal according to the plurality of pieces of location information and the acquisition time of each piece of location information.
In one embodiment, as shown in fig. 2d, the change situation determining unit 2132 includes:
the change situation determining subunit 2232 is configured to determine a change situation of the fingerprint detection signal according to the plurality of location information, the obtaining time of each location information, and the intensity value of the fingerprint detection signal corresponding to the sub-region corresponding to each location information.
In one embodiment, as shown in fig. 2e, the gesture operation module 203 includes:
the sub-region signal strength obtaining sub-module 2033 is configured to obtain signal strength values of the fingerprint detection signal corresponding to at least one sub-region at least two time points.
The second variation determining sub-module 2034 is configured to determine a variation of the fingerprint detection signal according to the signal strength values at least two time points.
In one embodiment, as shown in fig. 2f, the distance determination module 202 includes:
the distance determining sub-module 2021 is configured to determine that a signal-to-noise ratio of the fingerprint detection signal is within a set interval, where the signal-to-noise ratio is inversely related to the detection distance.
In one embodiment, as shown in fig. 2g, the fingerprint detection module 201 includes:
the operating mode determining sub-module 2011 is configured to determine an operating mode of the electronic device.
The fingerprint detection sub-module 2012 is configured to control the fingerprint detection module under the screen to perform fingerprint detection when the working mode satisfies the preset gesture obtaining condition, so as to obtain a fingerprint detection signal corresponding to each sub-region in the fingerprint detection region of the screen.
The embodiment of the disclosure provides a gesture recognition device, which can perform fingerprint detection by controlling a fingerprint detection module under a screen to acquire fingerprint detection signals corresponding to a plurality of sub-areas in a fingerprint detection area of the screen, and when it is determined that a detection distance between a detected object and the screen is greater than a first distance threshold and less than or equal to a second distance threshold (i.e., the detected object does not contact the screen, but the distance between the detected object and the screen is not too far), determine a change condition of the fingerprint detection signals, and when the change condition of the fingerprint detection signals meets a set condition, execute corresponding gesture operations. According to the scheme, the gesture made by the detected object can be acquired when the detected object is not in contact with the screen, namely the gesture made by the user can be acquired when the user is not convenient to touch the screen, and therefore user experience is improved.
Fig. 3 is a block diagram illustrating a gesture recognition apparatus 30 according to an exemplary embodiment, where the gesture recognition apparatus 30 may be a terminal or a part of the terminal, and the gesture recognition apparatus 30 includes:
a processor 301;
a memory 302 for storing instructions executable by the processor 301;
wherein the processor 301 is configured to:
controlling a fingerprint detection module under a screen to perform fingerprint detection so as to acquire fingerprint detection signals corresponding to a plurality of sub-areas in a fingerprint detection area of the screen;
determining that the detection distance between the detected object and the screen is greater than a first distance threshold and less than or equal to a second distance threshold; and
and determining the change condition of the fingerprint detection signal, and executing corresponding gesture operation when the change condition of the fingerprint detection signal meets the set condition.
In one embodiment, the processor 301 may be further configured to:
determining a change in the fingerprint detection signal, comprising:
acquiring signal distribution conditions of fingerprint detection signals corresponding to a plurality of sub-areas at least two time points;
and determining the change condition of the fingerprint detection signal according to the signal distribution conditions of at least two time points.
In one embodiment, the processor 301 may be further configured to:
acquiring signal distribution conditions of fingerprint detection signals corresponding to a plurality of sub-areas at least two time points, wherein the signal distribution conditions comprise:
when the intensity value of the fingerprint detection signal corresponding to any sub-region in the plurality of sub-regions meets a signal intensity preset condition, acquiring position information corresponding to the sub-region and acquisition time of the position information, wherein the acquisition time of the acquired position information comprises at least two time points;
determining the change condition of the fingerprint detection signal according to the signal distribution conditions of at least two time points, comprising the following steps:
and determining the change condition of the fingerprint detection signal according to the plurality of pieces of position information and the acquisition time of each piece of position information.
In one embodiment, the processor 301 may be further configured to:
determining the change condition of the fingerprint detection signal according to the plurality of pieces of position information and the acquisition time of each piece of position information, comprising the following steps:
and determining the change condition of the fingerprint detection signal according to the plurality of pieces of position information, the acquisition time of each piece of position information and the intensity value of the fingerprint detection signal corresponding to the sub-region corresponding to each piece of position information.
In one embodiment, the processor 301 may be further configured to:
determining a change in the fingerprint detection signal, comprising:
acquiring signal intensity values of fingerprint detection signals corresponding to at least one sub-region at least two time points;
and determining the change condition of the fingerprint detection signal according to the signal intensity values of at least two time points.
In one embodiment, the processor 301 may be further configured to:
determining that the detection distance between the detected object and the screen is greater than a first distance threshold and less than or equal to a second distance threshold, including:
and determining that the signal-to-noise ratio of the fingerprint detection signal is within a set interval, wherein the signal-to-noise ratio is inversely related to the detection distance.
In one embodiment, the processor 301 may be further configured to:
fingerprint detection module under the control screen carries out fingerprint detection to acquire the fingerprint detection signal that corresponds with every subregion in the fingerprint detection area of screen, include:
determining an operating mode of the electronic equipment;
when the working mode meets the preset gesture obtaining condition, the fingerprint detection module under the screen is controlled to perform fingerprint detection so as to obtain fingerprint detection signals corresponding to each sub-area in the fingerprint detection area of the screen.
The embodiment of the disclosure provides a gesture recognition device, which can perform fingerprint detection by controlling a fingerprint detection module under a screen to acquire fingerprint detection signals corresponding to a plurality of sub-areas in a fingerprint detection area of the screen, and when it is determined that a detection distance between a detected object and the screen is greater than a first distance threshold and less than or equal to a second distance threshold (i.e., the detected object does not contact the screen, but the distance between the detected object and the screen is not too far), determine a change condition of the fingerprint detection signals, and when the change condition of the fingerprint detection signals meets a set condition, execute corresponding gesture operations. According to the scheme, the gesture made by the detected object can be acquired when the detected object is not in contact with the screen, namely the gesture made by the user can be acquired when the user is not convenient to touch the screen, and therefore user experience is improved.
Fig. 4 is a block diagram illustrating an apparatus 400 for recognizing gestures according to an exemplary embodiment, where the apparatus 400 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, an exercise device, a personal digital assistant, or the like.
The apparatus 400 may include one or more of the following components: processing components 402, memory 404, power components 406, multimedia components 408, audio components 410, input/output (I/O) interfaces 412, sensor components 414, and communication components 416.
The processing component 402 generally controls overall operation of the apparatus 400, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing element 402 may include one or more processors 420 to execute instructions to perform all or part of the steps of the methods described above. Further, the processing component 402 can include one or more modules that facilitate interaction between the processing component 402 and other components. For example, the processing component 402 can include a multimedia module to facilitate interaction between the multimedia component 408 and the processing component 402.
The memory 404 is configured to store no various types of data to support operations at the apparatus 400. Examples of such data include instructions for any application or method operating on the device 400, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 404 may be implemented by any type or combination of volatile or non-volatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.
Power supply components 406 provide power to the various components of device 400. The power components 406 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the apparatus 400.
The multimedia component 408 includes a screen that provides an output interface between the device 400 and the user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 408 includes a front facing camera and/or a rear facing camera. The front camera and/or the rear camera may receive external multimedia data when the apparatus 400 is in an operation mode, such as a photographing mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.
The audio component 410 is configured to output and/or input audio signals. For example, audio component 410 includes a Microphone (MIC) configured to receive external audio signals when apparatus 400 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may further be stored in the memory 404 or transmitted via the communication component 416. In some embodiments, audio component 410 also includes a speaker for outputting audio signals.
The I/O interface 412 provides an interface between the processing component 402 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.
The sensor component 414 includes one or more sensors for providing various aspects of status assessment for the apparatus 400. For example, the sensor assembly 414 may detect an open/closed state of the apparatus 400, the relative positioning of the components, such as a display and keypad of the apparatus 400, the sensor assembly 414 may also detect a change in the position of the apparatus 400 or a component of the apparatus 400, the presence or absence of user contact with the apparatus 400, orientation or acceleration/deceleration of the apparatus 400, and a change in the temperature of the apparatus 400. The sensor assembly 414 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 414 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 414 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
The communication component 416 is configured to facilitate wired or wireless communication between the apparatus 400 and other devices. The apparatus 400 may access a wireless network based on a communication standard, such as a walkie-talkie private network, WiFi, 2G, 3G, 4G, or 5G, or a combination thereof. In an exemplary embodiment, the communication component 416 receives broadcast signals or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 416 further includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.
In an exemplary embodiment, the apparatus 400 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components for performing the above-described methods.
In an exemplary embodiment, a non-transitory computer-readable storage medium comprising instructions, such as the memory 404 comprising instructions, executable by the processor 420 of the apparatus 400 to perform the above-described method is also provided. For example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.
A non-transitory computer readable storage medium, wherein instructions, when executed by a processor of an apparatus 400, enable the apparatus 400 to perform the hand speed identification method described above, the method comprising:
controlling a fingerprint detection module under a screen to perform fingerprint detection so as to acquire fingerprint detection signals corresponding to a plurality of sub-areas in a fingerprint detection area of the screen;
determining that the detection distance between the detected object and the screen is greater than a first distance threshold and less than or equal to a second distance threshold; and
and determining the change condition of the fingerprint detection signal, and executing corresponding gesture operation when the change condition of the fingerprint detection signal meets the set condition.
In one embodiment, determining a change in the fingerprint detection signal comprises:
acquiring signal distribution conditions of fingerprint detection signals corresponding to a plurality of sub-areas at least two time points;
and determining the change condition of the fingerprint detection signal according to the signal distribution conditions of at least two time points.
In one embodiment, acquiring signal distribution conditions of fingerprint detection signals corresponding to a plurality of sub-regions at least two time points includes:
when the intensity value of the fingerprint detection signal corresponding to any sub-region in the plurality of sub-regions meets a signal intensity preset condition, acquiring position information corresponding to the sub-region and acquisition time of the position information, wherein the acquisition time of the acquired position information comprises at least two time points;
determining the change condition of the fingerprint detection signal according to the signal distribution conditions of at least two time points, comprising the following steps:
and determining the change condition of the fingerprint detection signal according to the plurality of pieces of position information and the acquisition time of each piece of position information.
In one embodiment, determining a change in the fingerprint detection signal based on the plurality of location information and the acquisition time of each location information comprises:
and determining the change condition of the fingerprint detection signal according to the plurality of pieces of position information, the acquisition time of each piece of position information and the intensity value of the fingerprint detection signal corresponding to the sub-region corresponding to each piece of position information.
In one embodiment, determining a change in the fingerprint detection signal comprises:
acquiring signal intensity values of fingerprint detection signals corresponding to at least one sub-region at least two time points;
and determining the change condition of the fingerprint detection signal according to the signal intensity values of at least two time points.
In one embodiment, determining that the detected distance between the detected object and the screen is greater than a first distance threshold and less than or equal to a second distance threshold comprises:
and determining that the signal-to-noise ratio of the fingerprint detection signal is within a set interval, wherein the signal-to-noise ratio is inversely related to the detection distance.
In one embodiment, controlling a fingerprint detection module under a screen to perform fingerprint detection to acquire a fingerprint detection signal corresponding to each sub-area in a fingerprint detection area of the screen includes:
determining an operating mode of the electronic equipment;
when the working mode meets the preset gesture obtaining condition, the fingerprint detection module under the screen is controlled to perform fingerprint detection so as to obtain fingerprint detection signals corresponding to each sub-area in the fingerprint detection area of the screen.
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This application is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims (16)

1. A gesture recognition method, comprising:
controlling a fingerprint detection module under a screen to perform fingerprint detection so as to acquire fingerprint detection signals corresponding to a plurality of sub-areas in a fingerprint detection area of the screen;
determining that the detection distance between the detected object and the screen is greater than a first distance threshold and less than or equal to a second distance threshold; and
and determining the change condition of the fingerprint detection signal, and executing corresponding gesture operation when the change condition of the fingerprint detection signal meets a set condition.
2. The gesture recognition method according to claim 1, wherein the determining the change condition of the fingerprint detection signal comprises:
acquiring signal distribution conditions of fingerprint detection signals corresponding to a plurality of sub-areas at least two time points;
and determining the change condition of the fingerprint detection signal according to the signal distribution conditions of the at least two time points.
3. The gesture recognition method according to claim 2, wherein the obtaining of signal distribution conditions of fingerprint detection signals corresponding to a plurality of sub-regions at least two time points comprises:
when the intensity value of the fingerprint detection signal corresponding to any sub-region in the plurality of sub-regions meets a signal intensity preset condition, acquiring position information corresponding to the sub-region and acquisition time of the position information, wherein the acquisition time of the acquired position information comprises at least two time points;
the determining the change condition of the fingerprint detection signal according to the signal distribution conditions of the at least two time points includes:
and determining the change condition of the fingerprint detection signal according to the plurality of pieces of position information and the acquisition time of each piece of position information.
4. The gesture recognition method according to claim 3, wherein the determining the change condition of the fingerprint detection signal according to the plurality of position information and the acquisition time of each position information comprises:
and determining the change condition of the fingerprint detection signal according to the plurality of pieces of position information, the acquisition time of each piece of position information and the intensity value of the fingerprint detection signal corresponding to the sub-region corresponding to each piece of position information.
5. The gesture recognition method according to claim 1, wherein determining the change in the fingerprint detection signal comprises:
acquiring signal intensity values of fingerprint detection signals corresponding to at least one sub-region at least two time points;
and determining the change condition of the fingerprint detection signal according to the signal intensity values of the at least two time points.
6. The gesture recognition method according to claim 1, wherein the determining that the detected distance between the detected object and the screen is greater than a first distance threshold and less than or equal to a second distance threshold comprises:
and determining that the signal-to-noise ratio of the fingerprint detection signal is within a set interval, wherein the signal-to-noise ratio is inversely related to the detection distance.
7. The gesture recognition method according to claim 1, wherein the controlling a fingerprint detection module under the screen to perform fingerprint detection to obtain a fingerprint detection signal corresponding to each sub-area in the fingerprint detection area of the screen comprises:
determining an operating mode of the electronic equipment;
and when the working mode meets a preset gesture acquisition condition, controlling a fingerprint detection module under the screen to perform fingerprint detection so as to acquire a fingerprint detection signal corresponding to each sub-region in the fingerprint detection region of the screen.
8. A gesture recognition apparatus, comprising:
the fingerprint detection module is used for controlling the fingerprint detection module under the screen to perform fingerprint detection so as to acquire fingerprint detection signals corresponding to a plurality of sub-areas in the fingerprint detection area of the screen;
the distance determining module is used for determining that the detection distance between the detected object and the screen is greater than a first distance threshold and smaller than or equal to a second distance threshold; and
and the gesture operation module is used for determining the change condition of the fingerprint detection signal and executing corresponding gesture operation when the change condition of the fingerprint detection signal meets a set condition.
9. The gesture recognition device according to claim 8, wherein the gesture operation module comprises:
the signal distribution acquisition submodule is used for acquiring the signal distribution conditions of the fingerprint detection signals corresponding to the plurality of sub-areas at least two time points;
and the first change condition determining submodule is used for determining the change condition of the fingerprint detection signal according to the signal distribution conditions of the at least two time points.
10. The gesture recognition device of claim 9, wherein the signal distribution acquisition submodule comprises:
the position information acquiring unit is used for acquiring position information corresponding to any sub-region in the plurality of sub-regions and acquiring time of the position information when the strength value of the fingerprint detection signal corresponding to the sub-region meets a signal strength preset condition, wherein the acquiring time of the acquired position information comprises at least two time points;
the first variation determination sub-module includes:
and the change situation determining unit is used for determining the change situation of the fingerprint detection signal according to the plurality of pieces of position information and the acquisition time of each piece of position information.
11. The gesture recognition apparatus according to claim 10, wherein the change situation determination unit includes:
and the change situation determining subunit is used for determining the change situation of the fingerprint detection signal according to the plurality of pieces of position information, the acquisition time of each piece of position information and the intensity value of the fingerprint detection signal corresponding to the sub-region corresponding to each piece of position information.
12. The gesture recognition device according to claim 8, wherein the gesture operation module comprises:
the sub-region signal intensity acquisition sub-module is used for acquiring signal intensity values of fingerprint detection signals corresponding to at least one sub-region at least two time points;
and the second change condition determining submodule is used for determining the change condition of the fingerprint detection signal according to the signal intensity values of the at least two time points.
13. The gesture recognition device of claim 8, wherein the distance determination module comprises:
and the distance determining submodule is used for determining that the signal-to-noise ratio of the fingerprint detection signal is within a set interval, wherein the signal-to-noise ratio is inversely related to the detection distance.
14. The gesture recognition device of claim 8, wherein the fingerprint detection module comprises:
the working mode determining submodule is used for determining the working mode of the electronic equipment;
and the fingerprint detection submodule is used for controlling the fingerprint detection module under the screen to perform fingerprint detection when the working mode meets the preset gesture acquisition condition so as to acquire a fingerprint detection signal corresponding to each sub-region in the fingerprint detection region of the screen.
15. A gesture recognition apparatus, comprising:
a processor;
a memory for storing processor-executable instructions;
wherein the processor is configured to:
controlling a fingerprint detection module under a screen to perform fingerprint detection so as to acquire fingerprint detection signals corresponding to a plurality of sub-areas in a fingerprint detection area of the screen;
determining that the detection distance between the detected object and the screen is greater than a first distance threshold and less than or equal to a second distance threshold; and
and determining the change condition of the fingerprint detection signal, and executing corresponding gesture operation when the change condition of the fingerprint detection signal meets a set condition.
16. A computer-readable storage medium having stored thereon computer instructions, which when executed by a processor, perform the steps of the method of any one of claims 1 to 7.
CN201910143406.8A 2019-02-26 2019-02-26 Gesture recognition method and device Pending CN111610921A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910143406.8A CN111610921A (en) 2019-02-26 2019-02-26 Gesture recognition method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910143406.8A CN111610921A (en) 2019-02-26 2019-02-26 Gesture recognition method and device

Publications (1)

Publication Number Publication Date
CN111610921A true CN111610921A (en) 2020-09-01

Family

ID=72199403

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910143406.8A Pending CN111610921A (en) 2019-02-26 2019-02-26 Gesture recognition method and device

Country Status (1)

Country Link
CN (1) CN111610921A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115856912A (en) * 2023-02-06 2023-03-28 宜科(天津)电子有限公司 Data processing system for detecting motion direction of object

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105324736A (en) * 2013-07-23 2016-02-10 英特尔公司 Techniques for touch and non-touch user interaction input
CN106066764A (en) * 2016-05-27 2016-11-02 广东欧珀移动通信有限公司 A kind of unlocked by fingerprint method and terminal
CN106170754A (en) * 2014-05-13 2016-11-30 三星电子株式会社 Fingerprint recognition is used to control the method for mobile terminal and use the mobile terminal of the method
CN108920079A (en) * 2018-06-27 2018-11-30 北京小米移动软件有限公司 Gesture identification method and device
CN109154959A (en) * 2017-05-17 2019-01-04 深圳市汇顶科技股份有限公司 Optical fingerprint sensor with non-contact imaging capability

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105324736A (en) * 2013-07-23 2016-02-10 英特尔公司 Techniques for touch and non-touch user interaction input
CN106170754A (en) * 2014-05-13 2016-11-30 三星电子株式会社 Fingerprint recognition is used to control the method for mobile terminal and use the mobile terminal of the method
CN106066764A (en) * 2016-05-27 2016-11-02 广东欧珀移动通信有限公司 A kind of unlocked by fingerprint method and terminal
CN109154959A (en) * 2017-05-17 2019-01-04 深圳市汇顶科技股份有限公司 Optical fingerprint sensor with non-contact imaging capability
CN108920079A (en) * 2018-06-27 2018-11-30 北京小米移动软件有限公司 Gesture identification method and device

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115856912A (en) * 2023-02-06 2023-03-28 宜科(天津)电子有限公司 Data processing system for detecting motion direction of object
CN115856912B (en) * 2023-02-06 2023-05-30 宜科(天津)电子有限公司 Data processing system for detecting movement direction of object

Similar Documents

Publication Publication Date Title
CN106572299B (en) Camera opening method and device
RU2661289C1 (en) Method and device for preventing random taping of terminal with touch screen
EP3163411A1 (en) Method, device and apparatus for application switching
EP3575862B1 (en) Method and device for adjusting lens position
EP3196736A1 (en) Method and apparatus for recognizing gesture
EP3125531A1 (en) Control method and device for adjusting shooting function
US20170060320A1 (en) Method for controlling a mobile terminal using a side touch panel
CN107102772B (en) Touch control method and device
CN105912258B (en) Operation processing method and device
CN107992257B (en) Screen splitting method and device
EP3109741B1 (en) Method and device for determining character
CN107562349B (en) Method and device for executing processing
EP3232301B1 (en) Mobile terminal and virtual key processing method
CN105511777B (en) Session display method and device on touch display screen
CN104216525B (en) Method and device for mode control of camera application
CN106775377B (en) Gesture recognition device, equipment and control method of gesture recognition device
CN110636383A (en) Video playing method and device, electronic equipment and storage medium
CN109862169B (en) Electronic equipment control method, device and storage medium
CN112905136A (en) Screen projection control method and device and storage medium
CN107566615B (en) Message treatment method, device and computer readable storage medium
CN106940653B (en) Method, apparatus and computer-readable storage medium for controlling application program
CN112346571A (en) Equipment control method and device and storage medium
CN108845852B (en) Control method and device of intelligent equipment and computer readable storage medium
CN111610921A (en) Gesture recognition method and device
CN110290272A (en) A kind of method, apparatus and medium of display function card

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination