CN109358755B - Gesture detection method and device for mobile terminal and mobile terminal - Google Patents
Gesture detection method and device for mobile terminal and mobile terminal Download PDFInfo
- Publication number
- CN109358755B CN109358755B CN201811337135.1A CN201811337135A CN109358755B CN 109358755 B CN109358755 B CN 109358755B CN 201811337135 A CN201811337135 A CN 201811337135A CN 109358755 B CN109358755 B CN 109358755B
- Authority
- CN
- China
- Prior art keywords
- mobile terminal
- detection device
- proximity sensor
- ultrasonic transmitting
- target detection
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Telephone Function (AREA)
Abstract
The application discloses a gesture detection method and device for a mobile terminal, the mobile terminal and a storage medium. The mobile terminal comprises a proximity sensor and a plurality of groups of ultrasonic transmitting and receiving devices, wherein each group of ultrasonic transmitting and receiving devices comprises an ultrasonic transmitting component and an ultrasonic receiving component, and the method comprises the following steps: receiving a distance between a user's hand and the mobile terminal detected by the proximity sensor; selecting a target detection device from the proximity sensor and the multiple groups of ultrasonic transmitting and receiving devices according to the distance; and controlling the target detection device to perform gesture detection according to a detection strategy corresponding to the target detection device. The method can solve the technical problem that in the prior art, the gesture of the user is detected only through a single detection mode, and the detection result is possibly inaccurate, so that the use experience of the user is influenced.
Description
Technical Field
The present application relates to the field of mobile terminal control, and in particular, to a gesture detection method and apparatus for a mobile terminal, and a computer-readable storage medium.
Background
With the gradual popularization of mobile terminals, a new passive control mode is increasingly required, and the existing control mode is expanded. At present, a mobile terminal is similar to a smart phone and a tablet computer, due to the limitation of a screen, although the existing man-machine interaction modes such as a button touch screen can basically meet daily requirements, the experience is poor. The user has limited control modes on the devices, so that the user experience is better enhanced by using the wireless sensing control mode outside the screen of the devices, and developers can utilize more-dimensional man-machine interaction options.
At present, a wireless sensing control mode is generally to realize wireless sensing control of a mobile terminal by detecting gestures. However, regardless of the distance between the hand of the user and the mobile terminal, the gesture detection of the mobile terminal usually detects the gesture of the user only through a single detection method, which may cause inaccurate detection results and affect the user experience.
Disclosure of Invention
The gesture detection method and device for the mobile terminal, the mobile terminal and the storage medium can solve the technical problem that in the prior art, the gesture of the user is detected only through one detection mode, the detection mode is single, the detection result is possibly inaccurate, and therefore the use experience of the user is influenced.
The gesture detection method for the mobile terminal provided by the embodiment of the first aspect of the application includes a proximity sensor and a plurality of sets of ultrasonic transmitting and receiving devices, each set of ultrasonic transmitting and receiving device includes an ultrasonic transmitting component and an ultrasonic receiving component, and the method includes:
receiving a distance between the user's hand and the mobile terminal detected by the proximity sensor;
selecting a target detection device from the proximity sensor and the multiple groups of ultrasonic transmitting and receiving devices according to the distance;
and controlling the target detection device to perform gesture detection according to a detection strategy corresponding to the target detection device.
The embodiment of the second aspect of the present application provides a gesture detection apparatus for a mobile terminal, where the mobile terminal includes a proximity sensor and a plurality of sets of ultrasonic transmitting and receiving apparatuses, each set of the ultrasonic transmitting and receiving apparatuses includes an ultrasonic transmitting component and an ultrasonic receiving component, the apparatus includes:
the distance receiving module is used for receiving the distance between the user hand and the mobile terminal, which is detected by the proximity sensor;
the selection module is used for selecting a target detection device from the proximity sensor and the multiple groups of ultrasonic transmitting and receiving devices according to the distance;
and the gesture detection module is used for controlling the target detection device to perform gesture detection according to the detection strategy corresponding to the target detection device.
An embodiment of a third aspect of the present application provides a mobile terminal, including: the gesture detection method for the mobile terminal comprises a memory, a processor and a computer program which is stored on the memory and can run on the processor, wherein when the processor executes the computer program, the gesture detection method for the mobile terminal is realized.
A non-transitory computer-readable storage medium is provided in an embodiment of a fourth aspect of the present application, and has a computer program stored thereon, where the computer program is executed by a processor to implement the gesture detection method for a mobile terminal according to the embodiment of the first aspect of the present application.
According to the gesture detection method and device for the mobile terminal, the mobile terminal and the storage medium, the distance between the hand of the user and the mobile terminal, which is detected by the proximity sensor, can be received, the target detection device is selected from the proximity sensor and the multiple groups of ultrasonic transmitting and receiving devices according to the distance, and then the target detection device is controlled to perform gesture detection according to the detection strategy corresponding to the target detection device. The embodiment of the application provides a plurality of devices capable of being used for detecting gestures, one of the plurality of devices capable of being used for detecting gestures is selected as a target detection device by detecting the distance between the hand of a user and a mobile terminal, and then the target detection device is controlled to perform gesture detection according to the detection strategy of the target detection device, so that the types of gesture detection modes of the mobile terminal are enriched, the detection device matched with the distance is determined to perform gesture detection through the distance, the detection device is ensured to be detected in the detection range of the detection device, the gesture detection range of the mobile terminal is enlarged on the whole, the detection result is improved, and the use experience of the user is improved.
Additional aspects and advantages of the present application will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the present application.
Drawings
The foregoing and/or additional aspects and advantages of the present application will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:
FIG. 1 is a flow diagram of a gesture detection method for a mobile terminal according to one embodiment of the present application;
FIG. 2 is a schematic diagram of a position structure of an ultrasonic transmitting and receiving device according to an embodiment of the present application;
FIG. 3 is a flow chart of a gesture detection method for a mobile terminal according to a specific embodiment of the present application;
FIG. 4 is a flow diagram of a gesture detection method for a mobile terminal according to another embodiment of the present application;
FIG. 5 is a schematic structural diagram of a gesture detection apparatus for a mobile terminal according to an embodiment of the present application;
FIG. 6 is a schematic structural diagram of a gesture detection apparatus for a mobile terminal according to another embodiment of the present application;
fig. 7 is a schematic structural diagram of a mobile terminal according to an embodiment of the present application.
Detailed Description
Reference will now be made in detail to embodiments of the present application, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the drawings are exemplary and intended to be used for explaining the present application and should not be construed as limiting the present application.
The present application provides a gesture detection method and apparatus for a mobile terminal, and a computer-readable storage medium, which are described below with reference to the accompanying drawings.
Fig. 1 is a flowchart of a gesture detection method for a mobile terminal according to one embodiment of the present application. It should be noted that the gesture detection method for a mobile terminal according to the embodiment of the present application may be applied to the gesture detection device for a mobile terminal according to the embodiment of the present application, and the gesture detection device may be configured on a mobile terminal.
In the embodiment of the present application, the mobile terminal may include a proximity sensor and a plurality of sets of ultrasonic transmitting and receiving devices, and each set of ultrasonic transmitting and receiving devices may include one ultrasonic transmitting component and one ultrasonic receiving component. As an example, the ultrasonic wave emitting part may be an earpiece or a speaker; the ultrasonic receiving component may be a microphone or a microphone.
As shown in fig. 1, the gesture detection method for a mobile terminal may include:
and S110, receiving the distance between the user' S hand and the mobile terminal, which is detected by the proximity sensor.
For example, the proximity sensor may emit infrared light outwards, when a hand of a user is present in the range of the mobile terminal, the infrared light may be reflected when hitting the hand of the user, the proximity sensor may receive the reflected infrared light signal, and process the received signal to detect the distance between the hand of the user and the mobile terminal, so that the distance between the hand of the user and the mobile terminal detected by the proximity sensor may be obtained.
And S120, selecting a target detection device from the proximity sensor and the multiple groups of ultrasonic transmitting and receiving devices according to the distance.
Alternatively, after obtaining the distance between the hand of the user and the mobile terminal, one of the proximity sensor and the plurality of sets of ultrasonic wave transmitting and receiving devices may be selected as the target detection device according to the size of the distance, that is, the target detection device will be used for gesture detection of the hand of the user.
As an example of one possible implementation, it may be determined whether the distance is greater than or equal to a preset threshold, and if the distance is greater than or equal to the preset threshold, the multiple sets of ultrasonic transmitting and receiving devices are selected as the target detection device from the proximity sensor and the multiple sets of ultrasonic transmitting and receiving devices; and if the distance is smaller than the preset threshold value, selecting the proximity sensor as the target detection device from the proximity sensor and a plurality of groups of ultrasonic transmitting and receiving devices.
That is to say, it may be determined whether a distance between a hand of a user and the mobile terminal is greater than or equal to a preset threshold, if so, it is considered that the hand is located at a position where the gesture is detected by the proximity sensor, which may cause a problem of inaccurate detection.
In this example, if it is determined that the distance between the hand of the user and the mobile terminal is smaller than the preset threshold, it may be considered that the gesture of the user may be detected by a proximity sensor, and at this time, the proximity sensor may be used as the target detection device for performing gesture detection on the hand of the user.
It should be noted that the mobile terminal of the embodiment of the present application may have multiple sets of ultrasonic transmitting and receiving devices, and each set of ultrasonic transmitting and receiving device may include one ultrasonic transmitting component and one ultrasonic receiving component. As an example, the ultrasonic wave emitting part may be an earpiece; the ultrasonic receiving member may be a microphone. For example, assuming that the mobile terminal has 2 sets of ultrasonic wave transmitting and receiving devices, each set of ultrasonic wave transmitting and receiving device may include an earpiece and a microphone, as shown in fig. 2, which is a schematic structural diagram of the positions of the 2 sets of ultrasonic wave transmitting and receiving devices, wherein the earpiece 11 and the microphone 12 form a set of ultrasonic wave transmitting and receiving devices, and the earpiece 21 and the microphone 22 form a set of ultrasonic wave transmitting and receiving devices. Therefore, the gesture detection is realized through the multiple groups of ultrasonic transmitting and receiving devices, and the detection result can be improved.
And S130, controlling the target detection device to perform gesture detection according to the detection strategy corresponding to the target detection device.
Optionally, after the target detection device is selected from the proximity sensor and the plurality of sets of ultrasonic transmitting and receiving devices, a detection strategy adopted by the target detection device may be determined, and the target detection device may be controlled to perform gesture detection on the hand of the user according to the detection strategy.
As an example, when the target detection device is the multiple groups of ultrasonic transmitting and receiving devices, the specific implementation process of controlling the target detection device to perform gesture detection according to the detection policy corresponding to the target detection device may include: controlling the multiple groups of ultrasonic transmitting and receiving devices to perform gesture detection on the hand of the user according to an ultrasonic detection strategy; when the target detection device is the proximity sensor, the specific implementation process of controlling the target detection device to perform gesture detection according to the gesture detection strategy corresponding to the target detection device may include: and controlling the proximity sensor to perform gesture detection on the hand of the user according to an infrared detection strategy.
That is, when the target detection device is the multiple sets of ultrasonic transmitting and receiving devices, the multiple sets of ultrasonic transmitting and receiving devices may be controlled according to an ultrasonic detection strategy to perform gesture detection, for example, an ultrasonic transmitting component in the ultrasonic transmitting and receiving device transmits an ultrasonic signal, an ultrasonic receiving component in the ultrasonic transmitting and receiving device receives an ultrasonic signal reflected by a hand action, and then, the collected ultrasonic signal may be processed to obtain a relative position when the gesture moves, and a complete gesture action model may be established according to the positions where different gestures are obtained, and the established gesture action model may be matched with a gesture template in a database to perform gesture recognition.
When the target detection device is the proximity sensor, the proximity sensor may be controlled to perform gesture detection according to an infrared detection strategy, for example, the proximity sensor sends out an infrared light signal, and receives an infrared light signal reflected back by a hand motion, and then, the collected infrared light signal may be processed to obtain a relative position when the gesture moves, and a complete gesture motion model may be established according to the positions where different gestures are obtained, and the established gesture motion model may be matched with a gesture template in a database to perform gesture recognition.
Therefore, according to the gesture detection method for the mobile terminal in the embodiment of the application, when the hand of the user is close to the mobile terminal or the behavior of the user is mainly focused in the sensing range of the proximity sensor, the detection can be performed by the proximity sensor first, and if the hand of the user is out of the sensing range of the proximity sensor, the detection is performed by ultrasonic waves.
According to the gesture detection method for the mobile terminal, the distance between the hand of the user and the mobile terminal, which is detected by the proximity sensor, can be received, the target detection device is selected from the proximity sensor and the multiple groups of ultrasonic transmitting and receiving devices according to the distance, and then the target detection device is controlled to perform gesture detection according to the detection strategy corresponding to the target detection device. The embodiment of the application provides a plurality of devices capable of being used for detecting gestures, one of the plurality of devices capable of being used for detecting gestures is selected as a target detection device by detecting the distance between the hand of a user and a mobile terminal, and then the target detection device is controlled to perform gesture detection according to the detection strategy of the target detection device, so that the types of gesture detection modes of the mobile terminal are enriched, the detection device matched with the distance is determined to perform gesture detection through the distance, the detection device is ensured to be detected in the detection range of the detection device, the gesture detection range of the mobile terminal is enlarged on the whole, the detection result is improved, and the use experience of the user is improved.
Fig. 3 is a flowchart of a gesture detection method for a mobile terminal according to a specific embodiment of the present application. As shown in fig. 3, the gesture detection method for a mobile terminal may include:
and S310, receiving the distance between the user' S hand and the mobile terminal, which is detected by the proximity sensor.
And S320, judging whether the distance is greater than or equal to a preset threshold value.
S330, if the distance is larger than or equal to the preset threshold value, selecting the multiple groups of ultrasonic transmitting and receiving devices from the proximity sensor and the multiple groups of ultrasonic transmitting and receiving devices.
S340, controlling the multiple groups of ultrasonic transmitting and receiving devices to perform gesture detection on the hand of the user according to an ultrasonic detection strategy.
And S350, if the distance is smaller than the preset threshold value, selecting the proximity sensor from the proximity sensor and multiple groups of ultrasonic transmitting and receiving devices.
And S360, controlling the proximity sensor to perform gesture detection on the hand of the user according to an infrared detection strategy.
That is to say, according to the gesture detection method for the mobile terminal in the embodiment of the application, when the hand of the user is close to the mobile terminal or the behavior of the user is mainly focused on the sensing range of the proximity sensor, the detection may be performed by the proximity sensor first, and if the hand of the user is out of the sensing range of the proximity sensor, the detection is performed by using ultrasonic waves.
According to the gesture detection method for the mobile terminal, one of the multiple devices capable of detecting the gesture is selected as the target detection device by detecting the distance between the hand of the user and the mobile terminal, and then the target detection device is controlled to perform gesture detection according to the detection strategy of the target detection device, so that the types of gesture detection modes of the mobile terminal are enriched, the detection device matched with the distance is determined to perform gesture detection according to the distance, detection in the detection range of the detection device is guaranteed, the gesture detection range of the mobile terminal is enlarged on the whole, the detection result is improved, and the use experience of the user is improved.
Fig. 4 is a flowchart of a gesture detection method for a mobile terminal according to another embodiment of the present application. As shown in fig. 4, the gesture detection method for a mobile terminal further includes:
s410, receiving the coverage range of the hand relative to the mobile terminal, which is detected by the proximity sensor;
it can be understood that when the hand of the user is detected by the proximity sensor, since the palm has a certain width, when the palm is located above the proximity sensor, the range width of the hand, which is the coverage of the hand with respect to the mobile terminal, can be detected by the proximity sensor.
And S420, determining the ultrasonic transmitting and receiving device corresponding to the coverage range from the plurality of groups of ultrasonic transmitting and receiving devices, and taking the ultrasonic transmitting and receiving device corresponding to the coverage range as the target detection device.
And S430, controlling the target detection device to perform gesture detection according to the detection strategy corresponding to the target detection device.
That is, when the coverage of the hand with respect to the mobile terminal is obtained, the ultrasonic transceiver corresponding to the coverage may be determined from the plurality of sets of ultrasonic transceivers, and the ultrasonic transceiver corresponding to the coverage may be used as the target detection device for performing gesture detection.
It should be noted that, in an embodiment of the present application, before receiving the coverage area of the hand detected by the proximity sensor with respect to the mobile terminal, the multiple sets of ultrasonic transmitting and receiving devices may be controlled to be in the off state, and when the ultrasonic transmitting and receiving device corresponding to the coverage area is determined, the ultrasonic transmitting and receiving device corresponding to the coverage area is turned on to perform gesture detection through the ultrasonic transmitting and receiving device corresponding to the coverage area. That is to say, before the coverage of the hand relative to the mobile terminal detected by the proximity sensor is not received, the multiple groups of ultrasonic transmitting and receiving devices can be controlled to be in the closed state, and only when the corresponding ultrasonic transmitting and receiving device for gesture detection is determined according to the coverage, the ultrasonic transmitting and receiving device can be started, so that the purpose of saving power consumption can be achieved.
According to the gesture detection method for the mobile terminal, the coverage range of the hand, relative to the mobile terminal, detected by the proximity sensor can be received, the ultrasonic transmitting and receiving device corresponding to the coverage range is determined from the multiple groups of ultrasonic transmitting and receiving devices, the ultrasonic transmitting and receiving device corresponding to the coverage range is used as the target detection device, then the target detection device is started, and the target detection device is controlled to perform gesture detection according to the corresponding detection strategy. That is, before the coverage of the hand relative to the mobile terminal detected by the proximity sensor is not received, the multiple groups of ultrasonic transmitting and receiving devices can be controlled to be in a closed state, and only when the corresponding ultrasonic transmitting and receiving device for gesture detection is determined according to the coverage, the ultrasonic transmitting and receiving device can be started, so that the purpose of saving power consumption can be achieved.
Corresponding to the gesture detection methods for the mobile terminal provided in the foregoing several embodiments, an embodiment of the present application further provides a gesture detection apparatus for the mobile terminal, and since the gesture detection apparatus for the mobile terminal provided in the embodiment of the present application corresponds to the gesture detection methods for the mobile terminal provided in the foregoing several embodiments, the implementation of the gesture detection method for the mobile terminal is also applicable to the gesture detection apparatus for the mobile terminal provided in the embodiment, and is not described in detail in the embodiment. Fig. 5 is a schematic structural diagram of a gesture detection apparatus for a mobile terminal according to an embodiment of the present application. It should be noted that, the gesture detection apparatus for a mobile terminal according to the embodiment of the present application may be configured on the mobile terminal. In the embodiment of the present application, the mobile terminal may include a proximity sensor and a plurality of sets of ultrasonic transmitting and receiving devices, and each set of ultrasonic transmitting and receiving devices may include one ultrasonic transmitting component and one ultrasonic receiving component. As an example, the ultrasonic wave emitting part may be an earpiece or a speaker; the ultrasonic receiving component may be a microphone or a microphone.
As shown in fig. 5, the gesture detecting apparatus 500 for a mobile terminal may include: a distance receiving module 510, a selection module 520, and a gesture detection module 530.
Specifically, the distance receiving module 510 is configured to receive a distance between a hand of the user and the mobile terminal detected by the proximity sensor.
The selection module 520 is used for selecting the target detection device from the proximity sensor and the sets of ultrasonic transmitting and receiving devices according to the distance. As an example, the selection module 520 is specifically configured to: judging whether the distance is greater than or equal to a preset threshold value; if the distance is greater than or equal to the preset threshold value, selecting multiple groups of ultrasonic transmitting and receiving devices from the proximity sensor and multiple groups of ultrasonic transmitting and receiving devices as the target detection device; and if the distance is smaller than the preset threshold value, selecting the proximity sensor as the target detection device from the proximity sensor and a plurality of groups of ultrasonic transmitting and receiving devices.
The gesture detection module 530 is configured to control the target detection device to perform gesture detection according to a detection policy corresponding to the target detection device. As an example, when the target detection device is the multiple sets of ultrasonic transmitting and receiving devices, the gesture detection module 530 may control the multiple sets of ultrasonic transmitting and receiving devices to perform gesture detection on the hand of the user according to an ultrasonic detection strategy; when the target detection device is the proximity sensor, the gesture detection module 530 may control the proximity sensor to perform gesture detection on the hand of the user according to an infrared detection policy.
In order to achieve the purpose of saving power consumption, optionally, in an embodiment of the present application, as shown in fig. 6, the gesture detection apparatus 500 for a mobile terminal may further include a coverage receiving module 540. Wherein the coverage receiving module 540 is operable to receive the coverage of the hand relative to the mobile terminal detected by the proximity sensor. In this embodiment of the present application, the selecting module 520 is further configured to determine, from the multiple sets of ultrasound transmitting and receiving devices, an ultrasound transmitting and receiving device corresponding to the coverage area, and use the ultrasound transmitting and receiving device corresponding to the coverage area as the target detecting device.
According to the gesture detection device for the mobile terminal, the embodiment of the application provides various devices capable of being used for detecting gestures, one of the various devices capable of being used for detecting the gestures is selected as a target detection device through detecting the distance between the hand of a user and the mobile terminal, and then the target detection device is controlled to perform gesture detection according to the detection strategy of the target detection device.
In order to implement the above embodiments, the present application further provides a mobile terminal.
Fig. 7 is a schematic structural diagram of a mobile terminal according to an embodiment of the present application.
As shown in fig. 7, the mobile terminal 700 may include:
a memory 710 and a processor 720, a bus 730 connecting different components (including the memory 710 and the processor 720), wherein the memory 710 stores computer programs, and when the processor 720 executes the programs, the gesture detection method for the mobile terminal according to the embodiment of the present application is implemented.
The mobile terminal 700 typically includes a variety of mobile terminal readable media. Such media may be any available media that is accessible by mobile terminal 700 and includes both volatile and nonvolatile media, removable and non-removable media.
A program/utility 780 having a set (at least one) of program modules 770 may be stored, for example, in memory 710, such program modules 770 including, but not limited to, an operating system, one or more application programs, other program modules, and program data, each of which examples or some combination thereof may comprise an implementation of a network environment. Program modules 770 typically perform the functions and/or methods described in the embodiments herein.
The processor 720 executes various functional applications and data processing by executing programs stored in the memory 710.
It should be noted that, for the implementation process and the technical principle of the mobile terminal of this embodiment, reference is made to the foregoing explanation of the gesture detection method for a mobile terminal in the embodiment of the present application, and details are not repeated here.
The mobile terminal provided by the embodiment of the application can execute the gesture detection method for the mobile terminal as described above, and the gesture detection method for the mobile terminal includes receiving the distance between the hand of the user and the mobile terminal detected by the proximity sensor, selecting the target detection device from the proximity sensor and the multiple sets of ultrasonic transmitting and receiving devices according to the distance, and then controlling the target detection device to perform gesture detection according to a detection strategy corresponding to the target detection device. The embodiment of the application provides a plurality of devices capable of being used for detecting gestures, one of the plurality of devices capable of being used for detecting gestures is selected as a target detection device by detecting the distance between the hand of a user and a mobile terminal, and then the target detection device is controlled to perform gesture detection according to the detection strategy of the target detection device, so that the types of gesture detection modes of the mobile terminal are enriched, the detection device matched with the distance is determined to perform gesture detection through the distance, the detection device is ensured to be detected in the detection range of the detection device, the gesture detection range of the mobile terminal is enlarged on the whole, the detection result is improved, and the use experience of the user is improved.
To implement the above embodiments, the present application also proposes a non-transitory computer-readable storage medium.
The computer readable storage medium stores thereon a computer program, and the computer program is executed by a processor to implement the gesture detection method for a mobile terminal according to the embodiment of the present application.
In order to implement the foregoing embodiments, a further embodiment of the present application provides a computer program, which when executed by a processor, implements the gesture detection method for a mobile terminal according to the embodiments of the present application.
In an alternative implementation, the embodiments may be implemented in any combination of one or more computer-readable media. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
A computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Computer program code for carrying out operations for aspects of the present application may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C + +, and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's mobile terminal, partly on the user's mobile terminal, as a stand-alone software package, partly on the user's mobile terminal and partly on a remote mobile terminal, or entirely on the remote mobile terminal or server. In the case of a remote mobile terminal, the remote mobile terminal may be connected to the user mobile terminal through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external mobile terminal (e.g., through the internet using an internet service provider).
Other embodiments of the present application will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the invention following, in general, the principles of the application and including such departures from the present disclosure as come within known or customary practice within the art to which the invention pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the application being indicated by the following claims.
It will be understood that the present application is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the application is limited only by the appended claims.
Claims (8)
1. A gesture detection method for a mobile terminal, wherein the mobile terminal comprises a proximity sensor and a plurality of sets of ultrasonic transmitting and receiving devices, each set of ultrasonic transmitting and receiving device comprises an ultrasonic transmitting component and an ultrasonic receiving component, the method comprising:
receiving a distance between the user's hand and the mobile terminal detected by the proximity sensor;
selecting a target detection device from the proximity sensor and the multiple groups of ultrasonic transmitting and receiving devices according to the distance;
controlling the target detection device to acquire the relative position of the gesture when moving according to a detection strategy corresponding to the target detection device to perform gesture detection;
wherein, when the target detection device is the multiple sets of ultrasonic wave transmitting and receiving devices, the method further comprises:
receiving the coverage of the hand relative to the mobile terminal, which is detected by the proximity sensor;
and determining a group of ultrasonic transmitting and receiving devices corresponding to the coverage range from the plurality of groups of ultrasonic transmitting and receiving devices, and taking the group of ultrasonic transmitting and receiving devices corresponding to the coverage range as the target detection device.
2. The method of claim 1, wherein selecting a target detection device from the proximity sensor and the plurality of sets of ultrasound transmitting and receiving devices based on the distance comprises:
judging whether the distance is greater than or equal to a preset threshold value;
if the distance is greater than or equal to the preset threshold value, selecting multiple groups of ultrasonic transmitting and receiving devices from the proximity sensor and multiple groups of ultrasonic transmitting and receiving devices as the target detection device;
and if the distance is smaller than the preset threshold value, selecting the proximity sensor as the target detection device from the proximity sensor and a plurality of groups of ultrasonic transmitting and receiving devices.
3. The method of claim 2,
when the target detection device is the multiple groups of ultrasonic transmitting and receiving devices, controlling the target detection device to perform gesture detection according to a detection strategy corresponding to the target detection device, including:
controlling the multiple groups of ultrasonic transmitting and receiving devices to perform gesture detection on the hand of the user according to an ultrasonic detection strategy;
when the target detection device is the proximity sensor, controlling the target detection device to perform gesture detection according to a gesture detection strategy corresponding to the target detection device, including:
and controlling the proximity sensor to perform gesture detection on the hand of the user according to an infrared detection strategy.
4. A method according to any one of claims 1 to 3, wherein the ultrasound emitting component is an earpiece; the ultrasonic receiving component is a microphone.
5. A gesture detection apparatus for a mobile terminal, wherein the mobile terminal comprises a proximity sensor and a plurality of sets of ultrasonic transmitting and receiving devices, each set of the ultrasonic transmitting and receiving devices comprises an ultrasonic transmitting part and an ultrasonic receiving part, the apparatus comprising:
the distance receiving module is used for receiving the distance between the user hand and the mobile terminal, which is detected by the proximity sensor;
the selection module is used for selecting a target detection device from the proximity sensor and the multiple groups of ultrasonic transmitting and receiving devices according to the distance;
the gesture detection module is used for controlling the target detection device to acquire the relative position of the gesture when the gesture moves according to the detection strategy corresponding to the target detection device so as to perform gesture detection;
a coverage receiving module, configured to receive a coverage of the hand detected by the proximity sensor with respect to the mobile terminal;
the selection module is further configured to determine an ultrasonic transmitting and receiving device corresponding to the coverage area from the multiple groups of ultrasonic transmitting and receiving devices, and use the ultrasonic transmitting and receiving device corresponding to the coverage area as the target detection device.
6. The apparatus of claim 5, wherein the selection module is specifically configured to:
judging whether the distance is greater than or equal to a preset threshold value;
if the distance is greater than or equal to the preset threshold value, selecting multiple groups of ultrasonic transmitting and receiving devices from the proximity sensor and multiple groups of ultrasonic transmitting and receiving devices as the target detection device;
and if the distance is smaller than the preset threshold value, selecting the proximity sensor as the target detection device from the proximity sensor and a plurality of groups of ultrasonic transmitting and receiving devices.
7. A mobile terminal, comprising: memory, processor and computer program stored on the memory and executable on the processor, the processor implementing a gesture detection method for a mobile terminal according to any of claims 1 to 4 when executing the computer program.
8. A non-transitory computer-readable storage medium having stored thereon a computer program, wherein the computer program, when executed by a processor, implements the gesture detection method for a mobile terminal according to any one of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811337135.1A CN109358755B (en) | 2018-11-12 | 2018-11-12 | Gesture detection method and device for mobile terminal and mobile terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811337135.1A CN109358755B (en) | 2018-11-12 | 2018-11-12 | Gesture detection method and device for mobile terminal and mobile terminal |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109358755A CN109358755A (en) | 2019-02-19 |
| CN109358755B true CN109358755B (en) | 2022-03-22 |
Family
ID=65344790
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811337135.1A Active CN109358755B (en) | 2018-11-12 | 2018-11-12 | Gesture detection method and device for mobile terminal and mobile terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109358755B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110830644B (en) * | 2019-09-16 | 2021-04-20 | 深圳市万普拉斯科技有限公司 | Display screen control method and device, electronic equipment and storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9354709B1 (en) * | 2014-06-17 | 2016-05-31 | Amazon Technologies, Inc. | Tilt gesture detection |
| CN105824406A (en) * | 2015-11-30 | 2016-08-03 | 维沃移动通信有限公司 | Photographing method and terminal |
| CN208061136U (en) * | 2018-05-07 | 2018-11-06 | 深圳辉烨通讯技术有限公司 | A kind of gesture identification terminal |
-
2018
- 2018-11-12 CN CN201811337135.1A patent/CN109358755B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9354709B1 (en) * | 2014-06-17 | 2016-05-31 | Amazon Technologies, Inc. | Tilt gesture detection |
| CN105824406A (en) * | 2015-11-30 | 2016-08-03 | 维沃移动通信有限公司 | Photographing method and terminal |
| CN208061136U (en) * | 2018-05-07 | 2018-11-06 | 深圳辉烨通讯技术有限公司 | A kind of gesture identification terminal |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109358755A (en) | 2019-02-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10783364B2 (en) | Method, apparatus and device for waking up voice interaction function based on gesture, and computer readable medium | |
| CN109240576B (en) | Image processing method and device in game, electronic device and storage medium | |
| CN106778585B (en) | A kind of face key point-tracking method and device | |
| US10810413B2 (en) | Wakeup method, apparatus and device based on lip reading, and computer readable medium | |
| EP3358455A1 (en) | Apparatus and method for controlling fingerprint sensor | |
| US9261995B2 (en) | Apparatus, method, and computer readable recording medium for selecting object by using multi-touch with related reference point | |
| KR102208477B1 (en) | Operating Method For Microphones and Electronic Device supporting the same | |
| US9201521B2 (en) | Storing trace information | |
| WO2019024642A1 (en) | Process control method and apparatus, storage medium, and electronic device | |
| CN108470571B (en) | Audio detection method and device and storage medium | |
| US20160026272A1 (en) | Method for displaying screen in electronic device, and electronic device thereof | |
| US20210256077A1 (en) | Methods, devices and computer-readable storage media for processing a hosted application | |
| EP2958006A1 (en) | Electronic device and method for controlling display | |
| US10452199B2 (en) | Denoising touch gesture input | |
| WO2019105376A1 (en) | Gesture recognition method, terminal and storage medium | |
| CN107390923B (en) | Screen false touch prevention method and device, storage medium and terminal | |
| CN104281394A (en) | Method and device for intelligently selecting words | |
| CN108615158B (en) | Risk detection method and device, mobile terminal and storage medium | |
| US20210326151A1 (en) | Methods, devices and computer-readable storage media for processing a hosted application | |
| US11537329B1 (en) | Emulation test system for flash translation layer and method thereof | |
| CN103631502B (en) | Show content adjustment method, apparatus and electronic equipment | |
| KR102096070B1 (en) | Method for improving touch recognition and an electronic device thereof | |
| US20150049035A1 (en) | Method and apparatus for processing input of electronic device | |
| CN110850982A (en) | AR-based human-computer interaction learning method, system, device and storage medium | |
| CN109358755B (en) | Gesture detection method and device for mobile terminal and mobile terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |