CN106897018B - Gesture operation method and device and mobile terminal - Google Patents
Gesture operation method and device and mobile terminal Download PDFInfo
- Publication number
- CN106897018B CN106897018B CN201710107560.0A CN201710107560A CN106897018B CN 106897018 B CN106897018 B CN 106897018B CN 201710107560 A CN201710107560 A CN 201710107560A CN 106897018 B CN106897018 B CN 106897018B
- Authority
- CN
- China
- Prior art keywords
- ultrasonic
- finger
- mobile terminal
- frequency
- gesture
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
Abstract
The invention discloses a gesture operation method and device and a mobile terminal. The gesture operation method comprises the following steps: controlling the ultrasonic speaker to emit ultrasonic waves, and controlling the ultrasonic receiver to receive reflected waves after the ultrasonic waves collide with fingers; obtaining the time difference between the emission of each frequency ultrasonic wave and the reception of the corresponding reflected wave, and determining the spatial position of the finger according to the time difference; and after the motion track of the finger in the space is determined by continuously recording the position relation of the finger in the space, executing an operation instruction corresponding to the motion track. The invention has the effect of providing a new gesture control method.
Description
Technical Field
The invention relates to the technical field of interactive input, in particular to a gesture operation method, a gesture operation device and a mobile terminal.
Background
The existing gesture operation is based on gesture control realized by a touch screen, but the use scene of the mobile terminal is more and more complicated along with the increasing unavailability of the mobile terminal, and the screen cannot be stably and effectively controlled by screen touch when the mobile terminal is worn with gloves or wet hands.
Disclosure of Invention
The invention mainly aims to provide a gesture operation method, a gesture operation device and a mobile terminal, and aims to provide a new gesture control method.
In order to achieve the above object, the present invention provides a gesture operation method for a mobile terminal, wherein the mobile terminal is provided with at least three ultrasonic speakers arranged around the center of a display surface and having different frequencies, and three ultrasonic receivers corresponding to the ultrasonic speakers; the steps of the gesture operation method include:
controlling the ultrasonic speaker to emit ultrasonic waves, and controlling the ultrasonic receiver to receive reflected waves after the ultrasonic waves collide with fingers;
obtaining the time difference between the emission of each frequency ultrasonic wave and the reception of the corresponding reflected wave, and determining the spatial position of the finger according to the time difference;
and after the motion track of the finger in the space is determined by continuously recording the position relation of the finger in the space, executing an operation instruction corresponding to the motion track.
Preferably, the step of obtaining a time difference between the emission of each frequency of the ultrasonic wave and the reception of the corresponding reflected wave, and determining the spatial position of the finger according to the time difference comprises:
obtaining a plurality of time differences between the emission of each frequency ultrasonic wave and the reception of the corresponding reflected wave;
obtaining a plurality of distances between the finger and the ultrasonic receiver of each frequency according to a plurality of the time differences;
obtaining a series of spatial points of each frequency according to the plurality of distances and the sequence from near to far, and connecting the obtained series of spatial points of each frequency to obtain a line segment corresponding to each frequency respectively;
and determining the space position of the finger according to the obtained line segments and preset finger parameters.
Preferably, the distance between the series of spatial points is set equidistantly;
the step of determining the spatial position of the finger according to the obtained line segments and preset finger parameters comprises the following steps:
calculating the first space point of each line segment through the compensation finger diameter to obtain a first space point until the Nth space point of each line segment is calculated through the compensation finger diameter to obtain an Nth space point;
and connecting the first to the Nth spatial points to form a central line segment, and determining the central line segment as the spatial position of the finger.
Preferably, the motion trajectory includes a plane gesture trajectory moving in parallel with respect to the display surface of the mobile terminal, a 3D gesture trajectory in which a plurality of fingers are closed and opened, and a combination of the plane gesture trajectory and the 3D gesture.
The invention also provides a gesture operation device which is used for a mobile terminal, wherein the mobile terminal is provided with at least three ultrasonic speakers which are arranged around the center of a display surface and have different frequencies, and three ultrasonic receivers which are arranged corresponding to the ultrasonic speakers; the gesture operation device comprises:
the control module is used for controlling the ultrasonic speaker to emit ultrasonic waves and controlling the ultrasonic receiver to receive reflected waves after the ultrasonic waves touch fingers;
the position calculation module is used for obtaining the time difference between the emission of each frequency ultrasonic wave and the reception of the corresponding reflected wave and determining the spatial position of the finger according to the time difference;
and the track recording module is used for determining the motion track of the finger in the space and then executing an operation instruction corresponding to the motion track by continuously recording the position relation of the finger in the space.
Preferably, the position calculation module includes:
a time difference calculation unit for obtaining a plurality of time differences between transmission of each frequency ultrasonic wave and reception of a corresponding reflected wave;
a distance calculation unit for obtaining a plurality of distances between the finger and the ultrasonic receiver of each frequency according to a plurality of the time differences;
the space calculation unit is used for obtaining a series of space points of each frequency according to the plurality of distances and the sequence from near to far, and connecting the obtained series of space points of each frequency to obtain a line segment corresponding to each frequency respectively;
and the position calculation unit is used for determining the spatial position of the finger according to the obtained line segments and preset finger parameters.
Preferably, the distance between the series of spatial points is set equidistantly;
the position calculation unit is specifically configured to:
calculating the first space point of each line segment through the compensation finger diameter to obtain a first space point until the Nth space point of each line segment is calculated through the compensation finger diameter to obtain an Nth space point;
and connecting the first to the Nth spatial points to form a central line segment, and determining the central line segment as the spatial position of the finger.
Preferably, the motion trajectory includes a plane gesture trajectory moving in parallel with respect to the display surface of the mobile terminal, a 3D gesture trajectory in which a plurality of fingers are closed and opened, and a combination of the plane gesture trajectory and the 3D gesture.
The invention also provides a mobile terminal which is provided with at least three ultrasonic loudspeakers which are arranged around the center of the display surface and have different frequencies, and an ultrasonic receiver which is arranged corresponding to the ultrasonic loudspeakers; the mobile terminal further comprises the gesture operation device.
Preferably, the mobile terminal comprises a first ultrasonic speaker, a second ultrasonic speaker and a third ultrasonic speaker, and a first ultrasonic receiver, a second ultrasonic receiver and a third ultrasonic receiver which are correspondingly arranged;
the first ultrasonic speaker and the first ultrasonic receiver are arranged close to the top end of the mobile terminal, and the first ultrasonic receiver is arranged on the top side of the first ultrasonic speaker;
the second ultrasonic speaker and the second ultrasonic receiver are arranged close to the bottom end of the mobile terminal, and the second ultrasonic receiver is arranged at the bottom side of the second ultrasonic speaker;
the third ultrasonic speaker and the third ultrasonic receiver are arranged close to the bottom end of the mobile terminal, and the third ultrasonic receiver is arranged at the bottom side of the third ultrasonic speaker;
and the connecting line of the first ultrasonic loudspeaker, the second ultrasonic loudspeaker and the third ultrasonic loudspeaker is triangular.
According to the gesture operation method provided by the invention, the ultrasonic waves and the reflected waves are adopted to position the finger, so that the touch control and non-touch suspended control screens can be performed on the screen of the mobile terminal when the finger is in water or oil or wears gloves.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the structures shown in the drawings without creative efforts.
Fig. 1 is a schematic diagram of an alternative hardware architecture of a mobile terminal implementing various embodiments of the present invention;
FIG. 2 is a diagram of a wireless communication system for the mobile terminal shown in FIG. 1;
FIG. 3 is a flowchart of a first embodiment of a gesture operation method according to the present invention;
FIG. 4 is a flowchart illustrating a gesture operation method according to a second embodiment of the present invention;
FIG. 5 is a flowchart illustrating a gesture operation method according to a third embodiment of the present invention;
FIG. 6 is a flowchart of an embodiment of a mobile terminal of the present invention;
FIG. 7 is a block diagram of the gesture operation apparatus shown in FIG. 6;
FIG. 8 is a block diagram of a position calculation module of FIG. 7;
FIG. 9 is a schematic diagram illustrating a gesture operation of the mobile terminal shown in FIG. 6;
fig. 10 is a schematic structural diagram of the mobile terminal shown in fig. 6.
The implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
A mobile terminal implementing various embodiments of the present invention will now be described with reference to the accompanying drawings. In the following description, suffixes such as "module", "component", or "unit" used to denote elements are used only for facilitating the explanation of the present invention, and have no specific meaning in themselves. Thus, "module" and "component" may be used in a mixture.
The mobile terminal may be implemented in various forms. For example, the terminal described in the present invention may include a mobile terminal such as a mobile phone, a smart phone, a notebook computer, a digital broadcast receiver, a PDA (personal digital assistant), a PAD (tablet computer), a PMP (portable multimedia player), a navigation device, and the like, and a stationary terminal such as a digital TV, a desktop computer, and the like. In the following, it is assumed that the terminal is a mobile terminal. However, it will be understood by those skilled in the art that the configuration according to the embodiment of the present invention can be applied to a fixed type terminal in addition to elements particularly used for moving purposes.
Fig. 1 is a schematic diagram of a hardware structure of an optional mobile terminal for implementing various embodiments of the present invention.
The mobile terminal 100 may include a wireless communication unit 110, an a/V (audio/video) input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, an interface unit 170, a controller 180, and a power supply unit 190, etc. Fig. 1 illustrates a mobile terminal having various components, but it is to be understood that not all illustrated components are required to be implemented. More or fewer components may alternatively be implemented. Elements of the mobile terminal will be described in detail below.
The wireless communication unit 110 typically includes one or more components that allow radio communication between the mobile terminal 100 and a wireless communication system or network. For example, the wireless communication unit 110 may include at least one of a broadcast receiving module 111, a mobile communication module 112, a wireless internet module 113, a short-range communication module 114, and a location information module 115.
The broadcast receiving module 111 receives a broadcast signal and/or broadcast related information from an external broadcast management server via a broadcast channel, the broadcast channel may include a satellite channel and/or a terrestrial channel, the broadcast management server may be a server that generates and transmits a broadcast signal and/or broadcast related information or a server that receives a previously generated broadcast signal and/or broadcast related information and transmits it to a terminal, the broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, etc. also, the broadcast signal may further include a broadcast signal combined with the TV or radio broadcast signal, the broadcast related information may also be provided via a mobile communication network, and in this case, the broadcast related information may be received by the mobile communication module 112, the broadcast signal may exist in various forms, for example, it may exist in the form of an Electronic Program Guide (EPG) for Digital Multimedia Broadcasting (DMB), an Electronic Service Guide (ESG) for digital video broadcasting handheld (DVB-H), etc., the broadcast receiving module 111 may receive a signal broadcast using various types of broadcast systems, in particular, the broadcast receiving module 111 may receive a broadcast signal using various types such as a digital broadcast-terrestrial broadcast-media-broadcast-receiving system (DVB-H), a media-DVB-H), and the above-DVB-H, and the like.
The mobile communication module 112 transmits and/or receives radio signals to and/or from at least one of a base station (e.g., access point, node B, etc.), an external terminal, and a server. Such radio signals may include voice call signals, video call signals, or various types of data transmitted and/or received according to text and/or multimedia messages.
The wireless internet access technology to which the module refers may include W L AN (wireless L AN) (Wi-Fi), Wibro (wireless broadband), Wimax (worldwide interoperability for microwave Access), HSDPA (high speed Downlink packet Access), and the like.
The short-range communication module 114 is a module for supporting short-range communication. Some examples of short-range communication technologies include bluetooth (TM), Radio Frequency Identification (RFID), infrared data association (IrDA), Ultra Wideband (UWB), zigbee (TM), and the like.
The location information module 115 is a module for checking or acquiring location information of the mobile terminal. A typical example of the location information module is a GPS (global positioning system). According to the current technology, the GPS module 115 calculates distance information and accurate time information from three or more satellites and applies triangulation to the calculated information, thereby accurately calculating three-dimensional current location information according to longitude, latitude, and altitude. Currently, a method for calculating position and time information uses three satellites and corrects an error of the calculated position and time information by using another satellite. In addition, the GPS module 115 can calculate speed information by continuously calculating current position information in real time.
The a/V input unit 120 is used to receive an audio or video signal. The a/V input unit 120 may include a camera 121 and a microphone 122, and the camera 121 processes image data of still pictures or video obtained by an image capturing apparatus in a video capturing mode or an image capturing mode. The processed image frames may be displayed on the display unit 151. The image frames processed by the cameras 121 may be stored in the memory 160 (or other storage medium) or transmitted via the wireless communication unit 110, and two or more cameras 121 may be provided according to the construction of the mobile terminal. The microphone 122 may receive sounds (audio data) via the microphone in a phone call mode, a recording mode, a voice recognition mode, or the like, and can process such sounds into audio data. The processed audio (voice) data may be converted into a format output transmittable to a mobile communication base station via the mobile communication module 112 in case of a phone call mode. The microphone 122 may implement various types of noise cancellation (or suppression) algorithms to cancel (or suppress) noise or interference generated in the course of receiving and transmitting audio signals.
The user input unit 130 may generate key input data according to a command input by a user to control various operations of the mobile terminal. The user input unit 130 allows a user to input various types of information, and may include a keyboard, dome sheet, touch pad (e.g., a touch-sensitive member that detects changes in resistance, pressure, capacitance, and the like due to being touched), scroll wheel, joystick, and the like. In particular, when the touch pad is superimposed on the display unit 151 in the form of a layer, a touch screen may be formed.
The sensing unit 140 detects a current state of the mobile terminal 100 (e.g., an open or closed state of the mobile terminal 100), a position of the mobile terminal 100, presence or absence of contact (i.e., touch input) by a user with the mobile terminal 100, an orientation of the mobile terminal 100, acceleration or deceleration movement and direction of the mobile terminal 100, and the like, and generates a command or signal for controlling an operation of the mobile terminal 100. For example, when the mobile terminal 100 is implemented as a slide-type mobile phone, the sensing unit 140 may sense whether the slide-type phone is opened or closed. In addition, the sensing unit 140 can detect whether the power supply unit 190 supplies power or whether the interface unit 170 is coupled with an external device. The sensing unit 140 may include a proximity sensor 141 as will be described below in connection with a touch screen.
The interface unit 170 serves as an interface through which at least one external device is connected to the mobile terminal 100. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The identification module may store various information for authenticating a user using the mobile terminal 100 and may include a User Identity Module (UIM), a Subscriber Identity Module (SIM), a Universal Subscriber Identity Module (USIM), and the like. In addition, a device having an identification module (hereinafter, referred to as an "identification device") may take the form of a smart card, and thus, the identification device may be connected with the mobile terminal 100 via a port or other connection means. The interface unit 170 may be used to receive input (e.g., data information, power, etc.) from an external device and transmit the received input to one or more elements within the mobile terminal 100 or may be used to transmit data between the mobile terminal and the external device.
In addition, when the mobile terminal 100 is connected with an external cradle, the interface unit 170 may serve as a path through which power is supplied from the cradle to the mobile terminal 100 or may serve as a path through which various command signals input from the cradle are transmitted to the mobile terminal. Various command signals or power input from the cradle may be used as signals for recognizing whether the mobile terminal is accurately mounted on the cradle. The output unit 150 is configured to provide output signals (e.g., audio signals, video signals, alarm signals, vibration signals, etc.) in a visual, audio, and/or tactile manner. The output unit 150 may include a display unit 151, an audio output module 152, an alarm unit 153, and the like.
The display unit 151 may display information processed in the mobile terminal 100. For example, when the mobile terminal 100 is in a phone call mode, the display unit 151 may display a User Interface (UI) or a Graphical User Interface (GUI) related to a call or other communication (e.g., text messaging, multimedia file downloading, etc.). When the mobile terminal 100 is in a video call mode or an image capturing mode, the display unit 151 may display a captured image and/or a received image, a UI or GUI showing a video or an image and related functions, and the like.
Meanwhile, when the display unit 151 and the touch pad are stacked on each other in the form of a layer TO form a touch screen, the display unit 151 may be used as an input device and an output device, the display unit 151 may include at least one of a liquid crystal display (L CD), a thin film transistor L CD (TFT-L CD), an organic light emitting diode (O L ED) display, a flexible display, a three-dimensional (3D) display, and the like, some of these displays may be configured TO be transparent TO allow a user TO view from the outside, which may be referred TO as a transparent display, a typical transparent display may be, for example, a TO L ED (transparent organic light emitting diode) display, and the like, the mobile terminal 100 may include two or more display units (or other display devices) according TO a specific intended embodiment, for example, the mobile terminal may include an external display unit (not shown) and an internal display unit (not shown), and the touch screen may be used TO detect a touch input pressure and a touch input position and a touch input area.
The audio output module 152 may convert audio data received by the wireless communication unit 110 or stored in the memory 160 into an audio signal and output as sound when the mobile terminal is in a call signal reception mode, a call mode, a recording mode, a voice recognition mode, a broadcast reception mode, or the like. Also, the audio output module 152 may provide audio output related to a specific function performed by the mobile terminal 100 (e.g., a call signal reception sound, a message reception sound, etc.). The audio output module 152 may include a speaker, a buzzer, and the like.
The alarm unit 153 may provide an output to notify the mobile terminal 100 of the occurrence of an event. Typical events may include call reception, message reception, key signal input, touch input, and the like. In addition to audio or video output, the alarm unit 153 may provide output in different ways to notify the occurrence of an event. For example, the alarm unit 153 may provide an output in the form of vibration, and when a call, a message, or some other incoming communication (incomingmunication) is received, the alarm unit 153 may provide a tactile output (i.e., vibration) to inform the user thereof. By providing such a tactile output, the user can recognize the occurrence of various events even when the user's mobile phone is in the user's pocket. The alarm unit 153 may also provide an output notifying the occurrence of an event via the display unit 151 or the audio output module 152.
The memory 160 may store software programs or the like for processing and controlling operations performed by the controller 180, or may temporarily store data (e.g., a phonebook, messages, still images, videos, etc.) that has been output or is to be output. Also, the memory 160 may store data regarding various ways of vibration and audio signals output when a touch is applied to the touch screen.
The memory 160 may include at least one type of storage medium including a flash memory, a hard disk, a multimedia card, a card-type memory (e.g., SD or DX memory, etc.), a Random Access Memory (RAM), a Static Random Access Memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read-only memory (PROM), a magnetic memory, a magnetic disk, an optical disk, and the like. Also, the mobile terminal 100 may cooperate with a network storage device that performs a storage function of the memory 160 through a network connection.
The controller 180 generally controls the overall operation of the mobile terminal. For example, the controller 180 performs control and processing related to voice calls, data communications, video calls, and the like. In addition, the controller 180 may include a multimedia module 181 for reproducing (or playing back) multimedia data, and the multimedia module 181 may be constructed within the controller 180 or may be constructed separately from the controller 180. The controller 180 may perform a pattern recognition process to recognize a handwriting input or a picture drawing input performed on the touch screen as a character or an image.
The power supply unit 190 receives external power or internal power and provides appropriate power required to operate various elements and components under the control of the controller 180.
For a hardware implementation, the embodiments described herein may be implemented using at least one of an Application Specific Integrated Circuit (ASIC), a Digital Signal Processor (DSP), a Digital Signal Processing Device (DSPD), a programmable logic device (P L D), a Field Programmable Gate Array (FPGA), a processor, a controller, a microcontroller, a microprocessor, an electronic unit designed to perform the functions described herein, such an implementation may be implemented in the controller 180 in some cases.
Up to now, the mobile terminal has been described in terms of its functions. Hereinafter, a slide-type mobile terminal among various types of mobile terminals, such as a folder-type, bar-type, swing-type, slide-type mobile terminal, and the like, will be described as an example for the sake of brevity. Accordingly, the present invention can be applied to any type of mobile terminal, and is not limited to a slide type mobile terminal.
The mobile terminal 100 as shown in fig. 1 may be configured to operate with communication systems such as wired and wireless communication systems and satellite-based communication systems that transmit data via frames or packets.
A communication system in which a mobile terminal according to the present invention is operable will now be described with reference to fig. 2.
For example, the air interfaces used by communication systems include, for example, Frequency Division Multiple Access (FDMA), Time Division Multiple Access (TDMA), Code Division Multiple Access (CDMA), and Universal Mobile Telecommunications System (UMTS) (particularly Long term evolution (L TE)), Global System for Mobile communications (GSM), and so forth.
Referring to fig. 2, a CDMA wireless communication system may include a plurality of mobile terminals 100, a plurality of Base Stations (BSs) 270, Base Station Controllers (BSCs) 275, and Mobile Switching Centers (MSCs) 280, the MSCs 280 are structured to interface with Public Switched Telephone Networks (PSTNs) 290, the MSCs 280 are also structured to interface with the BSCs 275, which may be coupled to the base stations 270 via backhaul lines, which may be structured according to any of several known interfaces including, for example, E1/T1, ATM, IP, PPP, frame relay, HDS L, ADS L, or xDS L, it will be appreciated that a system as shown in fig. 2 may include a plurality of BSCs 275.
Each BS270 may serve one or more sectors (or regions), each sector covered by a multi-directional antenna or an antenna pointing in a particular direction being radially distant from the BS 270. Alternatively, each partition may be covered by two or more antennas for diversity reception. Each BS270 may be configured to support multiple frequency allocations, with each frequency allocation having a particular frequency spectrum (e.g., 1.25MHz,5MHz, etc.).
The intersection of partitions with frequency allocations may be referred to as a CDMA channel. The BS270 may also be referred to as a Base Transceiver Subsystem (BTS) or other equivalent terminology. In such a case, the term "base station" may be used to generically refer to a single BSC275 and at least one BS 270. The base stations may also be referred to as "cells". Alternatively, each sector of a particular BS270 may be referred to as a plurality of cell sites.
As shown in fig. 2, a Broadcast Transmitter (BT)295 transmits a broadcast signal to the mobile terminal 100 operating within the system. A broadcast receiving module 111 as shown in fig. 1 is provided at the mobile terminal 100 to receive a broadcast signal transmitted by the BT 295. In fig. 2, several Global Positioning System (GPS) satellites 300 are shown. The satellite 300 assists in locating at least one of the plurality of mobile terminals 100.
In fig. 2, a plurality of satellites 300 are depicted, but it is understood that useful positioning information may be obtained with any number of satellites. The GPS module 115 as shown in fig. 1 is generally configured to cooperate with satellites 300 to obtain desired positioning information. Other techniques that can track the location of the mobile terminal may be used instead of or in addition to GPS tracking techniques. In addition, at least one GPS satellite 300 may selectively or additionally process satellite DMB transmission.
As a typical operation of the wireless communication system, the BS270 receives reverse link signals from various mobile terminals 100. The mobile terminal 100 is generally engaged in conversations, messaging, and other types of communications. Each reverse link signal received by a particular base station 270 is processed within the particular BS 270. The obtained data is forwarded to the associated BSC 275. The BSC provides call resource allocation and mobility management functions including coordination of soft handoff procedures between BSs 270. The BSCs 275 also route the received data to the MSC280, which provides additional routing services for interfacing with the PSTN 290. Similarly, the PSTN290 interfaces with the MSC280, the MSC interfaces with the BSCs 275, and the BSCs 275 accordingly control the BS270 to transmit forward link signals to the mobile terminal 100.
Based on the above mobile terminal hardware structure and communication system, the present invention provides various embodiments of the method.
Referring to fig. 3, a first embodiment of the gesture operation method of the present invention is applied to a mobile terminal, where the mobile terminal is provided with at least three ultrasonic speakers arranged around the center of a display surface and having different frequencies, and three ultrasonic receivers corresponding to the ultrasonic speakers; the steps of the gesture operation method include:
step S100, controlling the ultrasonic speaker to emit ultrasonic waves, and controlling the ultrasonic receiver to receive reflected waves after the ultrasonic waves collide with fingers; the frequencies of the ultrasonic speakers are different, for example, 40 to 60 Khz.
Step S101, obtaining the time difference between the emission of each frequency ultrasonic wave and the reception of the corresponding reflected wave, and determining the space position of the finger according to the time difference; by means of at least three ultrasonic waves and reflected waves thereof, the spatial position of the finger relative to the ultrasonic receiver, namely the spatial position of the finger and the mobile terminal, can be obtained through an algorithm.
And S102, continuously recording the position relation of the finger in the space, determining the motion track of the finger in the space, and then executing an operation instruction corresponding to the motion track. The operation instruction corresponding to the motion track comprises a game manipulation instruction, a playing instruction of a multimedia player, an interface operation instruction of a web browser, browsing interface switching and other program instructions.
In the embodiment, by using ultrasonic waves and reflected waves to perform finger positioning, touch control can be performed on a screen of the mobile terminal when a finger is in water, in oil and is wearing gloves, and a non-touch suspended control screen can be performed.
Referring to fig. 4, a gesture operation method according to a second embodiment of the present invention is based on the first embodiment, and step S101 is described in detail in this embodiment. The method comprises the following specific steps:
step S200 is the same as step S100 in the first embodiment, and is not described herein again.
In step S201, a plurality of time differences between the transmission of each frequency of ultrasonic waves and the reception of the corresponding reflected waves are obtained.
Step S202, obtaining a plurality of distances between the finger and the ultrasonic receiver of each frequency according to a plurality of the time differences.
Step S203, obtaining a series of spatial points of each frequency according to the plurality of distances and the sequence from near to far, and connecting the obtained series of spatial points of each frequency to obtain a line segment corresponding to each frequency. For example:
as shown in fig. 9, the ultrasonic waves of 40Khz emitted from the first ultrasonic speaker 1100 are reflected by the uneven skin surface of the finger 400 to generate reflected waves, and the reflected waves are received by the first ultrasonic receiver 1400. The distance between the reflection point of the finger 400 and the first ultrasonic receiver 1400 is calculated by the time difference between the emission and the reception of the sound wave, and by this scheme, a series of points a1 (not shown), B1 (not shown), C1 (not shown) from near to far are calculated and drawn as a line segment, and the separation distance between each point a1, B1, C1 can be set to a fixed value, for example, the separation distance is 10mm
The ultrasonic wave of 50Khz emitted from the second ultrasonic speaker 1200 is reflected by the uneven skin surface of the finger 400 to generate a reflected wave, and the reflected wave is received by the second ultrasonic receiver 1500. The distance between the reflection point of the finger 400 and the second ultrasonic receiver 1500 is calculated by the time difference between the emission and the reception of the sound waves, and by this scheme, a series of points a2 (not shown in the figure), B2 (not shown in the figure), C2 (not shown in the figure) from near to far are calculated and drawn as a line segment, and the spacing distance between each point of a2, B2, and C2 can be set to be a fixed value, for example, the spacing is 10 mm.
The third ultrasonic speaker (shielded, not labeled) emits 60Khz ultrasonic waves which are reflected by the uneven skin surface of the finger 400 to generate reflected waves, which are received by the third ultrasonic receiver. The distance between the reflection point of the finger 400 and the third ultrasonic receiver is calculated by the time difference between the emission and the reception of the sound waves, and by the scheme, a series of points A3 (not shown in the figure), B3 (not shown in the figure), C3 (not shown in the figure) from near to far are calculated and drawn as a line segment, and the distances of each point A3, B3 and C3 can be set to be fixed values, for example, the intervals are 10 mm.
And step S204, determining the space position of the finger according to the obtained line segments and preset finger parameters. The finger parameters may include shape parameters of a single finger, shape parameters of two fingers being closed, shape parameters of five fingers being closed or opened, and the like. For example, when the obtained multiple line segments match with a single finger, the positional relationship of the single hand is obtained, and when the obtained multiple line segments match with five fingers, the positional relationship of the five fingers is obtained.
Step S205 is the same as step S102 in the first embodiment, and is not described herein again.
In this embodiment, by drawing a line segment of each frequency ultrasonic wave, the state and the motion trajectory of the finger can be described more accurately, so that a more accurate gesture can be obtained.
Referring to fig. 5, a gesture operation method according to a third embodiment of the present invention is based on the second embodiment, and step S204 is described in detail in this embodiment. The method comprises the following specific steps:
step S300 is the same as step S200 in the second embodiment, and is not described herein again.
Step S301 is the same as step S201 in the second embodiment, and is not described herein again.
Step S302 is the same as step S202 in the second embodiment, and is not described herein again.
Step S303 is the same as step S203 in the second embodiment, and is not described herein again.
Step S304, calculating the first space point of each line segment through the compensation finger diameter to obtain a first space point, until the Nth space point of each line segment is calculated through the compensation finger diameter to obtain an Nth space point. The diameter of the finger may be a range or typical value, including the size of an ordinary person in most situations, such as bare hands and wearing gloves.
Step S305, connecting the first to the Nth spatial points to form a central line segment, and determining the central line segment as the spatial position of the finger.
Step S306 is the same as step S205 in the second embodiment, and is not described herein again.
Referring to fig. 9, continuing with the example in the previous embodiment, a series of points a1, B1, C1, a2, B2, C2, A3, B3, and C3 from near to far have been calculated; wherein the distances from A1 to B1 and from B1 to C1 are equal and are 10 mm; wherein the distances from A2 to B2 and from B2 to C2 are equal and are 10 mm; wherein the distances from A3 to B3 and from B3 to C3 are equal and are 10 mm.
The finger diameter is compensated through a software algorithm, so that the points A1, A2 and A3 are the same points A, B1, B2 and B3 are the same points B, C1, C2 and C3 are the same point C, and a central line segment 410 formed by a plurality of points A, B and C is obtained.
In the embodiment, a central line segment is used as the position of the finger, that is, the finger with the outline is represented by a line, so that the machine can describe the position information of the finger more conveniently, and the moving track of the finger can be confirmed.
Preferably, the motion tracks comprise a plane gesture track moving in parallel relative to a display surface of the mobile terminal, a 3D gesture track formed by folding and unfolding a plurality of fingers, and a combination of the plane gesture track and the 3D gesture, wherein the plane track can move along an L type above a screen, an M type movement and the like, the 3D gesture track can move by folding five fingers and unfolding five fingers and the like, and the combination track can move by folding two fingers together, moving the two fingers together separately, moving the two fingers together and folding the two fingers together, or moving the two fingers together and unfolding the like.
In order to describe the gesture operation device more clearly, the detailed description of the embodiment describes the mobile terminal using the gesture operation device in detail.
Referring to fig. 6 and 10, an embodiment of a mobile terminal according to the present invention is shown. The mobile terminal is provided with three ultrasonic speakers arranged around the center of the display surface and different in frequency, and three ultrasonic receivers provided corresponding to the ultrasonic speakers. Specifically, the mobile terminal includes a first ultrasonic speaker 1100, a second ultrasonic speaker 1200, a third ultrasonic speaker 1300, and a first ultrasonic receiver 1400, a second ultrasonic receiver 1500, and a third ultrasonic receiver 1600 that are correspondingly disposed. The present embodiment is described in detail by taking three ultrasonic speakers as an example, but the present embodiment is not limited to three ultrasonic speakers, and in other embodiments, a greater number of ultrasonic speakers may be used, so as to obtain an effect of more precise spatial positioning. In this embodiment, the gesture operation apparatus 1700 is built in the mobile terminal and is integrated with the mobile terminal, in other embodiments, the gesture operation apparatus 1700 may also be separately used as a component, and is combined with the mobile terminal when needed, and may obtain a corresponding control authority in the mobile terminal system.
The mobile terminal further includes a gesture operation means 1700.
Referring to fig. 7, the gesture operation apparatus 1700 includes:
a control module 1710, configured to control the ultrasonic speaker to emit ultrasonic waves, and control the ultrasonic receiver to receive reflected waves of the ultrasonic waves after hitting a finger; the frequencies of the ultrasonic speakers are different, for example, 40 to 60 Khz.
A position calculating module 1720, configured to obtain a time difference between transmission of each frequency ultrasonic wave and reception of a corresponding reflected wave, and determine a spatial position of the finger according to the time difference; by means of at least three ultrasonic waves and reflected waves thereof, the spatial position of the finger relative to the ultrasonic receiver, namely the spatial position of the finger and the mobile terminal, can be obtained through an algorithm.
The track recording module 1730 is configured to determine a motion track of the finger in the space by continuously recording the position relationship of the finger in the space, and then execute an operation instruction corresponding to the motion track. The operation instruction corresponding to the motion track comprises a game manipulation instruction, a playing instruction of a multimedia player, an interface operation instruction of a web browser, browsing interface switching and other program instructions.
In the embodiment, by using ultrasonic waves and reflected waves to perform finger positioning, touch control can be performed on a screen of the mobile terminal when a finger is in water, in oil and is wearing gloves, and a non-touch suspended control screen can be performed.
Referring to fig. 8, preferably, the position calculation module 1720 includes:
a time difference calculation unit 1721 for obtaining a plurality of time differences between the transmission of each frequency ultrasonic wave and the reception of the corresponding reflected wave.
A distance calculating unit 1722, configured to obtain a plurality of distances between the finger and the ultrasonic receiver at each frequency according to the plurality of time differences.
The space calculating unit 1723 is configured to obtain a series of spatial points of each frequency according to the distances and the sequence from near to far, and connect the obtained series of spatial points of each frequency to obtain a line segment corresponding to each frequency. For example:
as shown in fig. 9, the ultrasonic waves of 40Khz emitted from the first ultrasonic speaker 1100 are reflected by the uneven skin surface of the finger 400 to generate reflected waves, and the reflected waves are received by the first ultrasonic receiver 1400. The distance between the reflection point of the finger 400 and the first ultrasonic receiver 1400 is calculated by the time difference between the emission and the reception of the sound wave, and by this scheme, a series of points a1 (not shown in the figure), B1 (not shown in the figure), C1 (not shown in the figure) from near to far are calculated and drawn as a line segment, and the spacing distance between each point of a1, B1, and C1 can be set to a fixed value, for example, the spacing is 10 mm.
The ultrasonic wave of 50Khz emitted from the second ultrasonic speaker 1200 is reflected by the uneven skin surface of the finger 400 to generate a reflected wave, and the reflected wave is received by the second ultrasonic receiver 1500. The distance between the reflection point of the finger 400 and the second ultrasonic receiver 1500 is calculated by the time difference between the emission and the reception of the sound waves, and by this scheme, a series of points a2 (not shown in the figure), B2 (not shown in the figure), C2 (not shown in the figure) from near to far are calculated and drawn as a line segment, and the spacing distance between each point of a2, B2, and C2 can be set to be a fixed value, for example, the spacing is 10 mm.
The third ultrasonic speaker (shielded, not labeled) emits 60Khz ultrasonic waves which are reflected by the uneven skin surface of the finger 400 to generate reflected waves, which are received by the third ultrasonic receiver. The distance between the reflection point of the finger 400 and the third ultrasonic receiver is calculated by the time difference between the emission and the reception of the sound waves, and by the scheme, a series of points A3 (not shown in the figure), B3 (not shown in the figure), C3 (not shown in the figure) from near to far are calculated and drawn as a line segment, and the distances of each point A3, B3 and C3 can be set to be fixed values, for example, the intervals are 10 mm.
The position calculating unit 1724 is configured to determine a spatial position of the finger according to the obtained plurality of line segments and a preset finger parameter. The finger parameters may include shape parameters of a single finger, shape parameters of two fingers being closed, shape parameters of five fingers being closed or opened, and the like. For example, when the obtained multiple line segments match with a single finger, the positional relationship of the single hand is obtained, and when the obtained multiple line segments match with five fingers, the positional relationship of the five fingers is obtained.
In this embodiment, by drawing a line segment of each frequency ultrasonic wave, the state and the motion trajectory of the finger can be described more accurately, so that a more accurate gesture can be obtained.
Preferably, the distance between the series of spatial points is set equidistantly;
the position calculating unit 1724 is specifically configured to:
and calculating the first space point of each line segment through the compensation finger diameter to obtain a first space point until the Nth space point of each line segment is calculated through the compensation finger diameter to obtain an Nth space point. The diameter of the finger may be a range or typical value, including the size of an ordinary person in most situations, such as bare hands and wearing gloves.
And connecting the first to the Nth spatial points to form a central line segment, and determining the central line segment as the spatial position of the finger.
Referring to FIG. 9, continuing with the previous example, a series of near-to-far points A1, B1, C1, A2, B2, C2, A3, B3, and C3 have been calculated; wherein the distances from A1 to B1 and from B1 to C1 are equal and are 10 mm; wherein the distances from A2 to B2 and from B2 to C2 are equal and are 10 mm; wherein the distances from A3 to B3 and from B3 to C3 are equal and are 10 mm.
The finger diameter is compensated through a software algorithm, so that the points A1, A2 and A3 are the same points A, B1, B2 and B3 are the same points B, C1, C2 and C3 are the same point C, and a central line segment 410 formed by a plurality of points A, B and C is obtained.
In the embodiment, a central line segment is used as the position of the finger, that is, the finger with the outline is represented by a line, so that the machine can describe the position information of the finger more conveniently, and the moving track of the finger can be confirmed.
Preferably, the motion tracks comprise a plane gesture track moving in parallel relative to a display surface of the mobile terminal, a 3D gesture track formed by folding and unfolding a plurality of fingers, and a combination of the plane gesture track and the 3D gesture, wherein the plane track can move along an L type above a screen, an M type movement and the like, the 3D gesture track can move by folding five fingers and unfolding five fingers and the like, and the combination track can move by folding two fingers together, moving the two fingers together separately, moving the two fingers together and folding the two fingers together, or moving the two fingers together and unfolding the like.
Referring to fig. 10, in this embodiment, the first ultrasonic speaker 1100 and the first ultrasonic receiver 1400 are disposed near the top of the mobile terminal, and the first ultrasonic receiver 1400 is mounted on the top side of the first ultrasonic speaker 1100.
The second ultrasonic speaker 1200 and the second ultrasonic receiver 1500 are disposed near the bottom end of the mobile terminal, and the second ultrasonic receiver 1500 is mounted at the bottom side of the second ultrasonic speaker 1200.
The third ultrasonic speaker 1300 and the third ultrasonic receiver 1600 are disposed near the bottom end of the mobile terminal, and the third ultrasonic receiver 1600 is mounted on the bottom side of the third ultrasonic speaker 1300.
The connecting line of the first ultrasonic speaker 1100, the second ultrasonic speaker 1200 and the third ultrasonic speaker 1300 is triangular.
In the embodiment, the three ultrasonic speakers are arranged in a triangular shape and correspond to the three ultrasonic speakers respectively, and the three ultrasonic receivers arranged on the periphery of the triangular shape are also arranged in a triangular shape, so that a better sound wave positioning effect can be obtained, and the effect of fully utilizing the three ultrasonic speakers is achieved.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal device (which may be a mobile terminal, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.
The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.
Claims (8)
1. A gesture operation method is used for a mobile terminal, and is characterized in that the mobile terminal is provided with at least three ultrasonic speakers which are arranged around the center of a display surface and have different frequencies, and three ultrasonic receivers which are arranged corresponding to the ultrasonic speakers; the steps of the gesture operation method include:
controlling the ultrasonic speaker to emit ultrasonic waves, and controlling the ultrasonic receiver to receive reflected waves after the ultrasonic waves collide with fingers;
obtaining the time difference between the emission of each frequency ultrasonic wave and the reception of the corresponding reflected wave, and determining the spatial position of the finger according to the time difference;
after the motion track of the finger in the space is determined by continuously recording the position relation of the finger in the space, executing an operation instruction corresponding to the motion track;
the step of obtaining the time difference between the emission of each frequency ultrasonic wave and the reception of the corresponding reflected wave and determining the spatial position of the finger according to the time difference comprises the following steps:
obtaining a plurality of time differences between the emission of each frequency ultrasonic wave and the reception of the corresponding reflected wave;
obtaining a plurality of distances between the finger and the ultrasonic receiver of each frequency according to a plurality of the time differences;
obtaining a series of spatial points of each frequency according to the plurality of distances and the sequence from near to far, and connecting the obtained series of spatial points of each frequency to obtain a line segment corresponding to each frequency respectively;
and determining the space position of the finger according to the obtained line segments and preset finger parameters.
2. The gestural operation method of claim 1, wherein the series of spatial points are spaced equidistantly;
the step of determining the spatial position of the finger according to the obtained line segments and preset finger parameters comprises the following steps:
calculating the first space point of each line segment through the compensation finger diameter to obtain a first space point until the Nth space point of each line segment is calculated through the compensation finger diameter to obtain an Nth space point;
and connecting the first to the Nth spatial points to form a central line segment, and determining the central line segment as the spatial position of the finger.
3. The gesture operation method according to claim 1, wherein the motion trajectory includes a planar gesture trajectory moving in parallel with respect to a display surface of the mobile terminal, a 3D gesture trajectory in which a plurality of fingers are closed and opened, and a combination of the planar gesture trajectory and the 3D gesture.
4. A gesture operation device is used for a mobile terminal and is characterized in that the mobile terminal is provided with at least three ultrasonic speakers which are arranged around the center of a display surface and have different frequencies and three ultrasonic receivers which are arranged corresponding to the ultrasonic speakers; the gesture operation device comprises:
the control module is used for controlling the ultrasonic speaker to emit ultrasonic waves and controlling the ultrasonic receiver to receive reflected waves after the ultrasonic waves touch fingers;
the position calculation module is used for obtaining the time difference between the emission of each frequency ultrasonic wave and the reception of the corresponding reflected wave and determining the spatial position of the finger according to the time difference;
a track recording module, configured to determine a motion track of the finger in space by continuously recording a position relationship of the finger in space, and then execute an operation instruction corresponding to the motion track
The position calculation module includes:
a time difference calculation unit for obtaining a plurality of time differences between transmission of each frequency ultrasonic wave and reception of a corresponding reflected wave;
a distance calculation unit for obtaining a plurality of distances between the finger and the ultrasonic receiver of each frequency according to a plurality of the time differences;
the space calculation unit is used for obtaining a series of space points of each frequency according to the plurality of distances and the sequence from near to far, and connecting the obtained series of space points of each frequency to obtain a line segment corresponding to each frequency respectively;
and the position calculation unit is used for determining the spatial position of the finger according to the obtained line segments and preset finger parameters.
5. The gesturing apparatus of claim 4, wherein the series of spatial points are spaced equidistantly;
the position calculation unit is specifically configured to:
calculating the first space point of each line segment through the compensation finger diameter to obtain a first space point until the Nth space point of each line segment is calculated through the compensation finger diameter to obtain an Nth space point;
and connecting the first to the Nth spatial points to form a central line segment, and determining the central line segment as the spatial position of the finger.
6. The gesture operation device according to claim 4, wherein the motion trace comprises a planar gesture trace moving in parallel with respect to a display surface of the mobile terminal, a 3D gesture trace in which a plurality of fingers are closed and opened, and a combination of the planar gesture trace and the 3D gesture.
7. A mobile terminal is characterized in that the mobile terminal is provided with at least three ultrasonic speakers which are arranged around the center of a display surface and have different frequencies, and an ultrasonic receiver which is arranged corresponding to the ultrasonic speakers; the mobile terminal further comprises a gesture operation device according to any one of claims 4 to 6.
8. The mobile terminal of claim 7, wherein the mobile terminal comprises a first ultrasonic speaker, a second ultrasonic speaker, and a third ultrasonic speaker, and a first ultrasonic receiver, a second ultrasonic receiver, and a third ultrasonic receiver disposed correspondingly;
the first ultrasonic speaker and the first ultrasonic receiver are arranged close to the top end of the mobile terminal, and the first ultrasonic receiver is arranged on the top side of the first ultrasonic speaker;
the second ultrasonic speaker and the second ultrasonic receiver are arranged close to the bottom end of the mobile terminal, and the second ultrasonic receiver is arranged at the bottom side of the second ultrasonic speaker;
the third ultrasonic speaker and the third ultrasonic receiver are arranged close to the bottom end of the mobile terminal, and the third ultrasonic receiver is arranged at the bottom side of the third ultrasonic speaker;
and the connecting line of the first ultrasonic loudspeaker, the second ultrasonic loudspeaker and the third ultrasonic loudspeaker is triangular.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710107560.0A CN106897018B (en) | 2017-02-27 | 2017-02-27 | Gesture operation method and device and mobile terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710107560.0A CN106897018B (en) | 2017-02-27 | 2017-02-27 | Gesture operation method and device and mobile terminal |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106897018A CN106897018A (en) | 2017-06-27 |
| CN106897018B true CN106897018B (en) | 2020-07-28 |
Family
ID=59184765
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710107560.0A Active CN106897018B (en) | 2017-02-27 | 2017-02-27 | Gesture operation method and device and mobile terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106897018B (en) |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109725704B (en) * | 2017-10-30 | 2023-05-12 | 腾讯科技（武汉）有限公司 | Method and device for controlling application running |
| CN109597312B (en) * | 2018-11-26 | 2022-03-01 | 北京小米移动软件有限公司 | Sound box control method and device |
| CN110032276A (en) * | 2019-03-07 | 2019-07-19 | 永德利硅橡胶科技(深圳)有限公司 | Quick start voice translation method and Related product |
| CN110221720A (en) * | 2019-04-29 | 2019-09-10 | 华为技术有限公司 | A kind of touch method and electronic equipment |
| CN110297542B (en) * | 2019-06-28 | 2022-10-18 | Oppo广东移动通信有限公司 | Parameter adjusting method and related equipment |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN201886412U (en) * | 2010-11-11 | 2011-06-29 | 郑贤豪 | Input device applied in 3D image interaction system |
| CN103226386A (en) * | 2013-03-13 | 2013-07-31 | 广东欧珀移动通信有限公司 | Gesture identification method and system based on mobile terminal |
| CN105045385A (en) * | 2015-06-29 | 2015-11-11 | 山东超越数控电子有限公司 | Terminal gesture recognition method based on dual microphones |
| CN105260024A (en) * | 2015-10-15 | 2016-01-20 | 广东欧珀移动通信有限公司 | Method and apparatus for stimulating gesture motion trajectory on screen |
-
2017
- 2017-02-27 CN CN201710107560.0A patent/CN106897018B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN201886412U (en) * | 2010-11-11 | 2011-06-29 | 郑贤豪 | Input device applied in 3D image interaction system |
| CN103226386A (en) * | 2013-03-13 | 2013-07-31 | 广东欧珀移动通信有限公司 | Gesture identification method and system based on mobile terminal |
| CN105045385A (en) * | 2015-06-29 | 2015-11-11 | 山东超越数控电子有限公司 | Terminal gesture recognition method based on dual microphones |
| CN105260024A (en) * | 2015-10-15 | 2016-01-20 | 广东欧珀移动通信有限公司 | Method and apparatus for stimulating gesture motion trajectory on screen |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106897018A (en) | 2017-06-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR101760422B1 (en) | Mobile terminal and control method therof | |
| CN106897018B (en) | Gesture operation method and device and mobile terminal | |
| CN106527933B (en) | Control method and device for edge gesture of mobile terminal | |
| CN104750420A (en) | Screen capturing method and device | |
| CN106157970B (en) | Audio identification method and terminal | |
| CN110928708B (en) | Icon display method and device, electronic equipment and computer readable storage medium | |
| CN105551479B (en) | Mobile terminal noise reduction method and device | |
| CN106873887B (en) | System and method for controlling application function based on gesture | |
| CN106372264B (en) | Map data migration device and method | |
| CN106598538B (en) | Instruction set updating method and system | |
| CN109240579B (en) | Touch operation method, equipment and computer storage medium | |
| CN106648324B (en) | Hidden icon control method and device and terminal | |
| CN106851114B (en) | Photo display device, photo generation device, photo display method, photo generation method and terminal | |
| CN106371704B (en) | Application shortcut layout method of screen locking interface and terminal | |
| CN109542317B (en) | Display control method, device and storage medium of double-sided screen mobile terminal | |
| CN107197084B (en) | Method for projection between mobile terminals and first mobile terminal | |
| CN106873981B (en) | Icon processing method and device and terminal | |
| CN107071275B (en) | Image synthesis method and terminal | |
| CN107025158B (en) | Sliding operation testing method and device and terminal | |
| CN106876980B (en) | Terminal antenna system and setting method of terminal antenna | |
| CN106569670B (en) | Device and method for processing application | |
| CN106550116B (en) | Interface display device and method and mobile terminal | |
| CN105573563B (en) | Mobile terminal and method for realizing touch operation on mobile terminal | |
| CN105094733B (en) | Split screen display method and device | |
| CN106658116B (en) | Play control method, device and terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |