CN110096213A - Terminal operation method, mobile terminal and readable storage medium storing program for executing based on gesture - Google Patents
Terminal operation method, mobile terminal and readable storage medium storing program for executing based on gesture Download PDFInfo
- Publication number
- CN110096213A CN110096213A CN201910366850.6A CN201910366850A CN110096213A CN 110096213 A CN110096213 A CN 110096213A CN 201910366850 A CN201910366850 A CN 201910366850A CN 110096213 A CN110096213 A CN 110096213A
- Authority
- CN
- China
- Prior art keywords
- gesture
- touch event
- gesture motion
- mobile terminal
- terminal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 46
- 238000003860 storage Methods 0.000 title claims abstract description 19
- 230000033001 locomotion Effects 0.000 claims abstract description 94
- 238000013507 mapping Methods 0.000 claims abstract description 36
- 238000012544 monitoring process Methods 0.000 claims abstract description 14
- 230000006870 function Effects 0.000 claims description 21
- 230000006854 communication Effects 0.000 description 12
- 238000004891 communication Methods 0.000 description 11
- 238000001514 detection method Methods 0.000 description 9
- 238000010586 diagram Methods 0.000 description 8
- 238000012545 processing Methods 0.000 description 8
- 239000000725 suspension Substances 0.000 description 4
- 230000006399 behavior Effects 0.000 description 3
- 230000006698 induction Effects 0.000 description 3
- 238000010295 mobile communication Methods 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 230000005611 electricity Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000005764 inhibitory process Effects 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 230000007774 longterm Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 230000001960 triggered effect Effects 0.000 description 2
- 230000001133 acceleration Effects 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000005314 correlation function Methods 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000008030 elimination Effects 0.000 description 1
- 238000003379 elimination reaction Methods 0.000 description 1
- 230000005484 gravity Effects 0.000 description 1
- 230000014759 maintenance of location Effects 0.000 description 1
- 230000001404 mediated effect Effects 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 230000000149 penetrating effect Effects 0.000 description 1
- 238000009527 percussion Methods 0.000 description 1
- 238000011897 real-time detection Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000011664 signaling Effects 0.000 description 1
- 230000005236 sound signal Effects 0.000 description 1
- 238000010897 surface acoustic wave method Methods 0.000 description 1
- 230000002194 synthesizing effect Effects 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M2250/00—Details of telephonic subscriber devices
- H04M2250/22—Details of telephonic subscriber devices including a touch pad, a touch sensor or a touch detector
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D30/00—Reducing energy consumption in communication networks
- Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Telephone Function (AREA)
Abstract
The invention discloses a kind of terminal operation methods based on gesture, method includes the following steps: when detecting using starting, determine whether the application opens secondary operating mode, when determining that secondary operating mode is opened in the application, gesture motion is monitored based on the infrared sensor, when monitoring gesture motion based on the infrared sensor, corresponding first touch event of the gesture motion is determined based on default mapping relations, third touch event is determined based on the second touch event and first touch event of the screen triggering of the mobile terminal, pass through the corresponding operation of third touch event described in the application execution.The invention also discloses a kind of mobile terminal and readable storage medium storing program for executing.The present invention is applied to the mobile terminal equipped with infrared sensor, obtains gesture by infrared sensor and executes corresponding operation, provides more operative combinations, achievable more complex operations realize the concurrency of the terminal operation based on gesture.
Description
Technical field
The present invention relates to intelligent terminal technical field more particularly to a kind of terminal operation method based on gesture, movements eventually
End and readable storage medium storing program for executing.
Background technique
With the development of smart phone, mobile phone operation is more and more stronger, mobile phone usually only one piece of positive touch screen, leads to
The touch control operation at common family is carried out on front panel, and user can be used mobile phone and execute a variety of operations.
With the prevailing of trip is set about, many manufacturer terminals are all proposed game terminal now, since mobile terminal itself does not have
The physical button of standby game, when user plays game using equipment such as mobile terminals, such as smart phone, tablet computer, one
As be all to be realized by virtual key on interface up and down and the operation of other function.But in complicated hand
Machine game or other operate in more complicated application, generally require complicated operation, that is, user needed to click on screen
Multiple touch-control virtual keys, could complete corresponding application operating, and due to there was only one piece of touch screen of mobile phone, and user is on the screen
Operating space it is limited, achievable complex operations are limited, cause operate concurrency it is low.
Summary of the invention
The main purpose of the present invention is to provide a kind of terminal operation method based on gesture, mobile terminal and readable storages
Medium, it is intended to solve that terminal operation space of the existing movement based on gesture is small, and achievable complex operations are limited, cause to operate
The low technical problem of concurrency.
To achieve the above object, described based on gesture the present invention provides a kind of terminal operation method based on gesture
Terminal operation method includes:
When detecting using starting, determine whether the application opens secondary operating mode；
When determining that secondary operating mode is opened in the application, gesture motion is monitored based on the infrared sensor；
When monitoring gesture motion based on the infrared sensor, the gesture motion is determined based on default mapping relations
Corresponding first touch event；
Third is determined based on the second touch event and first touch event of the screen triggering of the mobile terminal
Touch event；
Pass through the corresponding operation of third touch event described in the application execution.
Optionally, described when monitoring gesture motion based on the infrared sensor, it is determined based on default mapping relations
The step of gesture motion corresponding first touch event includes:
When monitoring gesture motion based on the infrared sensor, the gesture is determined based on the default mapping relations
Whether movement meets preset condition；
When the gesture motion meets preset condition, determine that the gesture motion is corresponding based on the default mapping relations
The first touch event.
Optionally, described that the step of whether gesture motion meets preset condition determined based on the default mapping relations
Include:
It determines in the default mapping relations with the presence or absence of the gesture motion, wherein when in the default mapping relations
There are when the gesture motion, the gesture motion meets preset condition.
Optionally, the second touch event of the screen triggering based on the mobile terminal and the first touch thing
Part determines that the step of third touch event includes:
Determine corresponding first operational order of first touch event and second touch event corresponding second
Whether operational order is consistent；
In first operational order and consistent second operational order, using second touch event as institute
Third touch event is stated, using first touch event as invalid touch event.
Optionally, corresponding first operational order of the determination first touch event and second touch event
After the whether consistent step of corresponding second operational order, further includes:
In first operational order and inconsistent second operational order, by first touch event and institute
It states the second touch event and synthesizes the third touch event.
Optionally, described when detecting using starting, the step of whether application opens secondary operating mode determined
Before, further includes:
When receiving setting instruction, application to be placed is determined, and set secondary operating mode for application to be placed；
Gesture motion is acquired based on the infrared sensor, and generates gesture based on preset rules and the gesture motion
The default mapping relations of movement and touch event.
Optionally, described when detecting using starting, the step of whether application opens secondary operating mode determined
Later, further includes:
If receiving switching command, secondary operating mode is switched into single screen operation mode；
Close the monitoring function of the infrared sensor.
Optionally, the step of operation corresponding by third touch event described in the application execution includes:
The table of comparisons based on touch event and operational order determines the corresponding operational order of the third touch event, and
Execute the corresponding operation of the operational order.
In addition, to achieve the above object, the present invention also provides a kind of mobile terminal, the mobile terminal include memory,
Processor and the terminal operation program based on gesture that is stored on the memory and can run on the processor, it is described
The operation side terminal based on gesture as described above is realized when terminal operation program based on gesture is executed by the processor
The step of method.
In addition, to achieve the above object, the present invention also provides a kind of readable storage medium storing program for executing, being deposited on the readable storage medium storing program for executing
The terminal operation program based on gesture is contained, is realized when the terminal operation program based on gesture is executed by processor as above
The step of described terminal operation method based on gesture.
The present invention is by determining whether the application opens secondary operating mode when detecting using starting, in determination
When secondary operating mode is opened in the application, gesture motion is monitored based on the infrared sensor, then based on described infrared
When sensor monitors gesture motion, corresponding first touch event of the gesture motion is determined based on default mapping relations, is connect
Get off and determines that third touches based on the second touch event of the screen triggering of the mobile terminal and first touch event
Event passes through the corresponding operation of third touch event described in the application execution.The present invention is applied to equipped with infrared sensor
Mobile terminal can carry out different operations simultaneously on mobile terminals, provide more operative combinations, achievable more multiple
Miscellaneous operation realizes the concurrency of the terminal operation based on gesture.
Detailed description of the invention
A kind of Fig. 1 hardware structural diagram of terminal of each embodiment to realize the present invention；
Fig. 2 is a kind of communications network system architecture diagram provided in an embodiment of the present invention；
Fig. 3 is that the present invention is based on the flow diagrams of the terminal operation method first embodiment of gesture；
Fig. 4 is that the present invention is based on the flow diagrams of the terminal operation method second embodiment of gesture.
The realization, the function and the advantages of the object of the present invention will be explained referring to attached drawing in conjunction with the embodiments.
Specific embodiment
It should be appreciated that the specific embodiments described herein are merely illustrative of the present invention, it is not intended to limit the present invention.
In subsequent description, it is only using the suffix for indicating such as " module ", " component " or " unit " of element
Be conducive to explanation of the invention, itself there is no a specific meaning.Therefore, " module ", " component " or " unit " can mix
Ground uses.
Terminal can be implemented in a variety of manners.For example, terminal described in the present invention may include such as mobile phone, plate
Computer, laptop, palm PC, personal digital assistant (Personal Digital Assistant, PDA), portable
Media player (Portable Media Player, PMP), navigation device, wearable device, Intelligent bracelet, pedometer etc. move
The fixed terminals such as dynamic terminal, and number TV, desktop computer.
It will be illustrated by taking mobile terminal as an example in subsequent descriptions, it will be appreciated by those skilled in the art that in addition to special
Except element for moving purpose, the construction of embodiment according to the present invention can also apply to the terminal of fixed type.
Referring to Fig. 1, a kind of hardware structural diagram of its mobile terminal of each embodiment to realize the present invention, the shifting
Dynamic terminal 100 may include: RF (Radio Frequency, radio frequency) unit 101, WiFi module 102, audio output unit
103, A/V (audio/video) input unit 104, sensor 105, display unit 106, user input unit 107, interface unit
108, the components such as memory 109, processor 110 and power supply 111.It will be understood by those skilled in the art that shown in Fig. 1
Mobile terminal structure does not constitute the restriction to mobile terminal, and mobile terminal may include components more more or fewer than diagram,
Perhaps certain components or different component layouts are combined.
It is specifically introduced below with reference to all parts of the Fig. 1 to mobile terminal:
Radio frequency unit 101 can be used for receiving and sending messages or communication process in, signal sends and receivees, specifically, by base station
Downlink information receive after, to processor 110 handle；In addition, the data of uplink are sent to base station.In general, radio frequency unit 101
Including but not limited to antenna, at least one amplifier, transceiver, coupler, low-noise amplifier, duplexer etc..In addition, penetrating
Frequency unit 101 can also be communicated with network and other equipment by wireless communication.Any communication can be used in above-mentioned wireless communication
Standard or agreement, including but not limited to GSM (Global System of Mobile communication, global system for mobile telecommunications
System), GPRS (General Packet Radio Service, general packet radio service), CDMA2000 (Code
Division Multiple Access 2000, CDMA 2000), WCDMA (Wideband Code Division
Multiple Access, wideband code division multiple access), TD-SCDMA (Time Division-Synchronous Code
Division Multiple Access, TD SDMA), FDD-LTE (Frequency Division
Duplexing-Long Term Evolution, frequency division duplex long term evolution) and TDD-LTE (Time Division
Duplexing-Long Term Evolution, time division duplex long term evolution) etc..
WiFi belongs to short range wireless transmission technology, and mobile terminal can help user to receive and dispatch electricity by WiFi module 102
Sub- mail, browsing webpage and access streaming video etc., it provides wireless broadband internet access for user.Although Fig. 1 shows
Go out WiFi module 102, but it is understood that, and it is not belonging to must be configured into for mobile terminal, it completely can be according to need
It to omit within the scope of not changing the essence of the invention.
Audio output unit 103 can be in call signal reception pattern, call mode, record mould in mobile terminal 100
When under the isotypes such as formula, speech recognition mode, broadcast reception mode, by radio frequency unit 101 or WiFi module 102 it is received or
The voice data stored in memory 109 is converted into audio signal and exports to be sound.Moreover, audio output unit 103
Audio output relevant to the specific function that mobile terminal 100 executes can also be provided (for example, call signal receives sound, disappears
Breath receives sound etc.).Audio output unit 103 may include loudspeaker, buzzer etc..
A/V input unit 104 is for receiving audio or video signal.A/V input unit 104 may include graphics processor
(Graphics Processing Unit, GPU) 1041 and microphone 1042, graphics processor 1041 is in video acquisition mode
Or the image data of the static images or video obtained in image capture mode by image capture apparatus (such as camera) carries out
Reason.Treated, and picture frame may be displayed on display unit 106.Through graphics processor 1041, treated that picture frame can be deposited
Storage is sent in memory 109 (or other storage mediums) or via radio frequency unit 101 or WiFi module 102.Mike
Wind 1042 can connect in telephone calling model, logging mode, speech recognition mode etc. operational mode via microphone 1042
Quiet down sound (voice data), and can be voice data by such acoustic processing.Audio that treated (voice) data can
To be converted to the format output that can be sent to mobile communication base station via radio frequency unit 101 in the case where telephone calling model.
Microphone 1042 can be implemented various types of noises elimination (or inhibition) algorithms and send and receive sound to eliminate (or inhibition)
The noise generated during frequency signal or interference.
Mobile terminal 100 further includes at least one sensor 105, such as optical sensor, motion sensor and other biographies
Sensor.Specifically, optical sensor includes ambient light sensor and proximity sensor, wherein ambient light sensor can be according to environment
The light and shade of light adjusts the brightness of display panel 1061, and proximity sensor can close when mobile terminal 100 is moved in one's ear
Display panel 1061 and/or backlight.As a kind of motion sensor, accelerometer sensor can detect in all directions (general
For three axis) size of acceleration, it can detect that size and the direction of gravity when static, can be used to identify the application of mobile phone posture
(such as horizontal/vertical screen switching, dependent game, magnetometer pose calibrating), Vibration identification correlation function (such as pedometer, percussion) etc.；
The fingerprint sensor that can also configure as mobile phone, pressure sensor, iris sensor, molecule sensor, gyroscope, barometer,
The other sensors such as hygrometer, thermometer, infrared sensor, details are not described herein.
Display unit 106 is for showing information input by user or being supplied to the information of user.Display unit 106 can wrap
Display panel 1061 is included, liquid crystal display (Liquid Crystal Display, LCD), Organic Light Emitting Diode can be used
Forms such as (Organic Light-Emitting Diode, OLED) configure display panel 1061.
User input unit 107 can be used for receiving the number or character information of input, and generate the use with mobile terminal
Family setting and the related key signals input of function control.Specifically, user input unit 107 may include touch panel 1071 with
And other input equipments 1072.Touch panel 1071, also referred to as touch screen collect the touch control operation of user on it or nearby
(for example user uses any suitable objects or attachment such as finger, stylus on touch panel 1071 or in touch panel 1071
Neighbouring operation), and corresponding attachment device is driven according to preset formula.Touch panel 1071 may include touch control detection
Two parts of device and touch control controller.Wherein, the touch-control orientation of touch control detection device detection user, and detect touch control operation band
The signal come, transmits a signal to touch control controller；Touch control controller receives touch information from touch control detection device, and by it
It is converted into contact coordinate, then gives processor 110, and order that processor 110 is sent can be received and executed.In addition, can
To realize touch panel 1071 using multiple types such as resistance-type, condenser type, infrared ray and surface acoustic waves.In addition to touch panel
1071, user input unit 107 can also include other input equipments 1072.Specifically, other input equipments 1072 can wrap
It includes but is not limited in physical keyboard, function key (such as volume control button, switch key etc.), trace ball, mouse, operating stick etc.
It is one or more, specifically herein without limitation.
Further, touch panel 1071 can cover display panel 1061, when touch panel 1071 detect on it or
After neighbouring touch control operation, processor 110 is sent to determine the type of touch event, is followed by subsequent processing device 110 according to touch-control thing
The type of part provides corresponding visual output on display panel 1061.Although in Fig. 1, touch panel 1071 and display panel
1061 be the function that outputs and inputs of realizing mobile terminal as two independent components, but in certain embodiments, it can
The function that outputs and inputs of mobile terminal is realized so that touch panel 1071 and display panel 1061 is integrated, is not done herein specifically
It limits.
Interface unit 108 be used as at least one external device (ED) connect with mobile terminal 100 can by interface.For example,
External device (ED) may include wired or wireless headphone port, external power supply (or battery charger) port, wired or nothing
Line data port, memory card port, the port for connecting the device with identification module, audio input/output (I/O) end
Mouth, video i/o port, ear port etc..Interface unit 108 can be used for receiving the input from external device (ED) (for example, number
It is believed that breath, electric power etc.) and the input received is transferred to one or more elements in mobile terminal 100 or can be with
For transmitting data between mobile terminal 100 and external device (ED).
Memory 109 can be used for storing software program and various data.Memory 109 can mainly include storing program area
The storage data area and, wherein storing program area can (such as the sound of application program needed for storage program area, at least one function
Sound playing function, image player function etc.) etc.；Storage data area can store according to mobile phone use created data (such as
Voice data, phone directory etc.) etc..In addition, memory 109 may include high-speed random access memory, it can also include non-easy
The property lost memory, a for example, at least disk memory, flush memory device or other volatile solid-state parts.
Processor 110 is the control centre of mobile terminal, utilizes each of various interfaces and the entire mobile terminal of connection
A part by running or execute the software program and/or module that are stored in memory 109, and calls and is stored in storage
Data in device 109 execute the various functions and processing data of mobile terminal, to carry out integral monitoring to mobile terminal.Place
Managing device 110 may include one or more processing units；Preferably, processor 110 can integrate application processor and modulatedemodulate is mediated
Manage device, wherein the main processing operation system of application processor, user interface and application program etc., modem processor is main
Processing wireless communication.It is understood that above-mentioned modem processor can not also be integrated into processor 110.
In addition, in mobile terminal 100 shown in Fig. 1, processor 110 be used to calling stored in memory 109 based on
The step of terminal operation program of gesture, the terminal operation method based on gesture that each embodiment of execution the application provides.
Mobile terminal 100 can also include the power supply 111 (such as battery) powered to all parts, it is preferred that power supply 111
Can be logically contiguous by power-supply management system and processor 110, to realize management charging by power-supply management system, put
The functions such as electricity and power managed.
Although Fig. 1 is not shown, mobile terminal 100 can also be including bluetooth module etc., and details are not described herein.
Embodiment to facilitate the understanding of the present invention, the communications network system that mobile terminal of the invention is based below into
Row description.
Referring to Fig. 2, Fig. 2 is a kind of communications network system architecture diagram provided in an embodiment of the present invention, the communication network system
System is the LTE system of universal mobile communications technology, which includes UE (User Equipment, the use of successively communication connection
Family equipment) (the land Evolved UMTS Terrestrial Radio Access Network, evolved UMTS 201, E-UTRAN
Ground wireless access network) 202, EPC (Evolved Packet Core, evolved packet-based core networks) 203 and operator IP operation
204。
Specifically, UE201 can be above-mentioned mobile terminal 100, and details are not described herein again.
E-UTRAN202 includes eNodeB2021 and other eNodeB2022 etc..Wherein, eNodeB2021 can be by returning
Journey (backhaul) (such as X2 interface) is connect with other eNodeB2022, and eNodeB2021 is connected to EPC203,
ENodeB2021 can provide the access of UE201 to EPC203.
EPC203 may include MME (Mobility Management Entity, mobility management entity) 2031, HSS
(Home Subscriber Server, home subscriber server) 2032, other MME2033, SGW (Serving Gate Way,
Gateway) 2034, PGW (PDN Gate Way, grouped data network gateway) 2035 and PCRF (Policy and
Charging Rules Function, policy and rate functional entity) 2036 etc..Wherein, MME2031 be processing UE201 and
The control node of signaling, provides carrying and connection management between EPC203.HSS2032 is all to manage for providing some registers
Such as the function of home location register (not shown) etc, and preserves some related service features, data rates etc. and use
The dedicated information in family.All customer data can be sent by SGW2034, and PGW2035 can provide the IP of UE 201
Address distribution and other functions, PCRF2036 are strategy and the charging control strategic decision-making of business data flow and IP bearing resource
Point, it selects and provides available strategy and charging control decision with charge execution function unit (not shown) for strategy.
IP operation 204 may include internet, Intranet, IMS (IP Multimedia Subsystem, IP multimedia
System) or other IP operations etc..
Although above-mentioned be described by taking LTE system as an example, those skilled in the art should know the present invention is not only
Suitable for LTE system, be readily applicable to other wireless communication systems, such as GSM, CDMA2000, WCDMA, TD-SCDMA with
And the following new network system etc., herein without limitation.
Based on above-mentioned terminal hardware structure and communications network system, propose that the present invention is based on the terminal operation methods of gesture
Each embodiment.
The present invention provides a kind of terminal operation method based on gesture.
It is that the present invention is based on the flow diagrams of the terminal operation method first embodiment of gesture referring to Fig. 3, Fig. 3.
In the present embodiment, the embodiment of the terminal operation method based on gesture is provided, it should be noted that although
Logical order is shown in flow chart, but in some cases, it can be to be different from shown by sequence execution herein or retouch
The step of stating.
In the present embodiment, the terminal operation method based on gesture is applied in the mobile terminal equipped with infrared sensor,
Terminal operation method based on gesture includes:
Step S10 determines whether the application opens secondary operating mode when detecting using starting；
In the present embodiment, the present invention is applied to the mobile terminal equipped with infrared sensor, and the quantity of infrared sensor is extremely
It is less 2, it is preferable that infrared sensor is arranged in the center of mobile terminal.The application of mobile terminal real-time detection is opened
Emotionally condition starts corresponding application when receiving the enabled instruction of application, shows application interface, wherein enabled instruction can
To be that mobile terminal detects touch control operation, the enabled instruction triggered according to touch control operation is also possible to receive comprising opening
The phonetic order of application to be launched is moved, herein with no restrictions.When mobile terminal is detected using starting, whether the application is judged
Secondary operating mode is had been switched on, only under secondary operating mode, the infrared sensor of mobile terminal just will start detection
Function, wherein the specific method for judging whether the application opens secondary operating mode is in advance to grasp the starting of application and auxiliary
Operation mode is associated, and when being associated with the application starting of secondary operating mode, can correspond to the auxiliary behaviour that starting is pre-set
Operation mode.
It should be noted that determine that secondary operating mode is not opened in the application after mobile terminal is detected using starting,
So mobile terminal will carry out display operation with normal single screen operation mode.
Step S20, it is dynamic based on infrared sensor monitoring gesture when determining that secondary operating mode is opened in the application
Make；
In the present embodiment, after mobile terminal is detected using starting, if mobile terminal determines that auxiliary is opened in the application
Operation mode, mobile terminal are acted by infrared sensor detection gesture, wherein gesture motion is the induction in infrared sensor
It is obtained in area, for example, brandishing finger in inductor, it is determined that the gesture motion is sliding, can also be specifically subdivided into the left
Sliding, is slided to the right, upward sliding, slide downward etc..
Step S30, when monitoring gesture motion based on the infrared sensor, based on described in the determination of default mapping relations
Corresponding first touch event of gesture motion；
In the present embodiment, when mobile terminal monitors gesture motion by infrared sensor, based on gesture motion with
The mapping relations of touch event further determine that corresponding first touch event of gesture motion.Wherein, touch event specially can
It is identified by mobile terminal, is equivalent to user and in the operation of screen is formed by track or to the operation of virtual key, for example,
The gesture brandished to the right in the induction zone of infrared sensor determines that the gesture motion is the gesture slided to the right, is then mapped as certain
The corresponding relationship of the touch event of virtual key, gesture motion and touch event is preset by user and is stored in mapping relations
In.
Specifically, step S30 includes:
Step S31 is determined when monitoring gesture motion based on the infrared sensor based on the default mapping relations
Whether the gesture motion meets preset condition；
In the present embodiment, after mobile terminal is detected using starting, and determine that secondary operating mode is opened in the application
When, mobile terminal is acted by infrared sensor detection gesture, after detecting gesture motion, it is also necessary to further determine that gesture
Whether movement meets preset condition, that is to say, that determine whether the gesture is for effective gesture and then trigger action instruction
Execute relevant operation.
Specifically, step S31 is comprised determining that in the default mapping relations with the presence or absence of the gesture motion, wherein when
There are when the gesture motion in the default mapping relations, the gesture motion meets preset condition.
In the present embodiment, the corresponding relationship for saving gesture motion and touch event in mapping relations is preset, movement is worked as
When terminal is acted by infrared sensor detection gesture, check whether in default mapping relations there are the gesture motion,
If in default mapping relations, there are the gesture motions, it is determined that the gesture motion meets preset condition, it can by default
Mapping relations get the corresponding touch event of the gesture motion.
Step S32 determines the gesture based on the default mapping relations when the gesture motion meets preset condition
Act corresponding first touch event.
In the present embodiment, when there are the gesture motions in default mapping relations, it is determined that the gesture motion meets default
Condition.Gesture motion and touch event correspond in default mapping relations, therefore when detecting a gesture motion, then
Uniquely determine a touch event.For example, the hand of user leans on the gesture motion of near infrared sensor, it can determine that the gesture is dynamic
As the gesture motion of click, it is mapped as opening the touch event of camera；It is brandished to the right in the induction zone of infrared sensor
Gesture motion can determine that the gesture is the gesture motion slided to the right, then be mapped as the corresponding touch thing of jump virtual key
Part, to sum up, the corresponding relationship saved in default mapping relations are as follows: the corresponding touch event for opening camera of the gesture motion of click,
The corresponding jump touch event of the gesture motion brandished to the right.
Step S40, the second touch event and first touch event of the screen triggering based on the mobile terminal
Determine third touch event；
In the present embodiment, after starting secondary operating mode, if mobile terminal, which is detected simultaneously by, passes through infrared sensor
Second touch event of the gesture motion that detects and the first touch event of determination and the screen triggering based on mobile terminal, then
The first touch event that will test synthesizes third touch event with the second touch event detected.For mobile terminal,
The same time has received two group informations, and therefore, the first touch event can be synthesized third with the second touch event by mobile terminal
Touch event, wherein third touch event refers exclusively to the new touch event after the first touch event is synthesized with the second touch event,
It should be understood that third touch event includes all features of the first touch event and the second touch event.
It should be understood that screen and infrared sensor all have the ability for detecting touch event under secondary operating mode,
If contemporaneity, when screen and infrared sensor have all determined touch event, then screen is acquired simultaneously and infrared sensor determines
Touch event；If contemporaneity, only screen or infrared sensor detect touch event, then acquire screen or infrared sensing
The touch event of device.
Step S50 passes through the corresponding operation of third touch event described in the application execution.
In the present embodiment, mobile terminal obtains the behaviour that third touch event is triggered after synthesizing third touch event
It instructs, according to the operational order of triggering, executes corresponding operation in the application.
Specifically, step S50 includes:
Step S51, the table of comparisons based on touch event and operational order determine the corresponding operation of the third touch event
Instruction, and execute the corresponding operation of the operational order.
In the present embodiment, the operational order of third touch event and mobile terminal is established mapping relations by mobile terminal,
The table of comparisons of touch control operation and operational order based on mobile terminal storage, determines the corresponding operational order of touch control operation, and hold
The corresponding operation of row operational order.For example, the corresponding jump touch event of the gesture motion brandished to the right, is brandished to the right when detecting
Gesture motion when, execute skip operation；The corresponding touch event for opening camera of the gesture motion of click, when detecting a hitter
When gesture, the operation for opening camera is executed.
Further, in one embodiment, before step S10 further include:
Step S60 determines application to be placed, and set auxiliary behaviour for application to be placed when receiving setting instruction
Operation mode；
In the present embodiment, it when mobile terminal receives setting instruction, is instructed according to setting, into Setting pattern,
Under Setting pattern, set interface, application to be placed for selection by the user, specifically, acquisition for mobile terminal mobile terminal are shown
In all application, by application icon list display in set interface, corresponding icon for selection by the user.Receiving user
After the application to be placed of selection, secondary operating mode is set by the application, the method that secondary operating mode is arranged is optional are as follows: will
The starting of application is associated with secondary operating mode, corresponding to open secondary operating mode when application starting.
Step S70 acquires gesture motion based on the infrared sensor, and is based on preset rules and the gesture motion
Generate the default mapping relations of gesture motion and touch event.
In the present embodiment, it under secondary operating mode, firstly, acquiring gesture motion based on infrared sensor, such as adopts
Collect the gesture motion clicked, then, on the screen by one small suspension icon of dragging, this small suspension icon drag
Onto the game virtual key to be manipulated, such as the virtual push button is the key for opening knapsack, then according to the position of suspension icon
It sets, gets the coordinate of suspension icon central point, the start position or click location manipulated using this coordinate as this, this
When, the setting of the gesture motion clicked with the touch event for opening knapsack is completed, repeated acquisition gesture motion and dragging, which suspend, to be schemed
Target step completes the mapping of various gestures movement and touch event, it should be noted that gesture motion and touch event are one
One corresponding relationship.
Further, in one embodiment, after step S10 further include:
Secondary operating mode is switched to single screen operation mode if receiving switching command by step S80；
Step S90 closes the monitoring function of the infrared sensor.
In the present embodiment, after determining that secondary operating mode is opened in application, if mobile terminal receives switch mode
Instruction, then secondary operating mode is switched into normal single screen operation mode.
Specifically, mobile terminal one transparent virtual of display on the application display interface for open secondary operating mode is cut
Key is changed, such as upper left position can be located at, facilitates switching.When user open secondary operating mode application in, not
When needing auxiliary operation, and intending to switch to single screen operation mode, user can click directly on switch key, and mobile terminal is receiving
After the instruction of switch mode, by application switching at single screen operation mode, under single screen mode, the detection function of infrared sensor is closed
Energy.
The terminal operation method based on gesture that the present embodiment proposes determines the application when detecting using starting
Whether secondary operating mode is opened, when determining that secondary operating mode is opened in the application, is monitored based on the infrared sensor
Gesture motion determines the hand based on default mapping relations then when monitoring gesture motion based on the infrared sensor
Gesture acts corresponding first touch event, next the second touch event of the screen triggering based on the mobile terminal and institute
It states the first touch event and determines third touch event, pass through the corresponding operation of third touch event described in the application execution.It answers
For being equipped with the mobile terminal of infrared sensor, gesture is obtained by infrared sensor and executes corresponding operation, is provided more
More operative combination, achievable more complex operations, realizes the concurrency of the terminal operation based on gesture.
Based on first embodiment, propose the present invention is based on the second embodiment of the terminal operation method of gesture, reference Fig. 4,
In the present embodiment, step S40 includes:
Step S41 determines corresponding first operational order of first touch event and second touch event pair
Whether the second operational order answered is consistent；
In the present embodiment, after starting secondary operating mode, examined if mobile terminal is detected simultaneously by by infrared sensor
Second touch event of the gesture motion that measures and the first touch event of determination and the screen triggering based on mobile terminal, default
There can only be a touch event on the same area or same virtual push button, when touch event, in order to keep away
Exempt from the operation corresponding with the second touch event of the first touch event to repeat and lead to system disorders, needs first to confirm the first touching
It touches corresponding first operational order of event and whether corresponding second operational order of the second touch event is consistent.
Step S42 touches thing for described second in first operational order and consistent second operational order
Part is as the third touch event, using first touch event as invalid touch event.
It, can to avoid collecting two kinds of repetition touch events on the same area or same virtual key in the present embodiment
Principle is executed according to preferential, in the first operational order and consistent the second operational order, using the second touch event as third
Touch event, that is, the touch operation based on screen is only carried out, using the first touch event as invalid touch event, that is, move
Terminal does not give gesture motion response.
Step S43 is touched in first operational order and inconsistent second operational order by described first
Event synthesizes the third touch event with second touch event.
In the present embodiment, in the first operational order and inconsistent the second operational order, illustrates mobile terminal while examining
Measure the first touch event of the gesture motion determination detected by infrared sensor and the screen touching based on mobile terminal
Second touch event of hair acts on different regions or different virtual keys, then touches the first touch event and second
Event synthesizes third touch event, and then executes the operation of third touch event.
The terminal operation method based on gesture that the present embodiment proposes, mobile terminal, which is detected simultaneously by, passes through infrared sensor
Second touch event of the gesture motion that detects and the first touch event of determination and the screen triggering based on mobile terminal is write from memory
A touch event can only be had by recognizing on the same area or same virtual push button, when touch event and be phase
When with touch event, only retains the second touch event, touch event is avoided to repeat.
In addition, the embodiment of the present invention also proposes a kind of readable storage medium storing program for executing.
The terminal operation program based on gesture, the terminal operation based on gesture are stored on the readable storage medium storing program for executing
The step of terminal operation method based on gesture in such as any of the above-described embodiment is realized when program is executed by processor.
Readable storage medium storing program for executing specific embodiment of the present invention and each embodiment base of the above-mentioned terminal operation method based on gesture
This is identical, and details are not described herein.
It should be noted that, in this document, the terms "include", "comprise" or its any other variant are intended to non-row
His property includes, so that the process, method, article or the system that include a series of elements not only include those elements, and
And further include the other elements being not explicitly listed, or further include for this process, method, article or system institute it is intrinsic
Element.In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that including being somebody's turn to do
There is also other identical elements in the process, method of element, article or system.
The serial number of the above embodiments of the invention is only for description, does not represent the advantages or disadvantages of the embodiments.
Through the above description of the embodiments, those skilled in the art can be understood that above-described embodiment side
Method can be realized by means of software and necessary general hardware platform, naturally it is also possible to by hardware, but in many cases
The former is more preferably embodiment.Based on this understanding, technical solution of the present invention substantially in other words does the prior art
The part contributed out can be embodied in the form of software products, which is stored in a storage medium
In (such as ROM/RAM, magnetic disk, CD), including some instructions are used so that a terminal device (can be mobile phone, computer, clothes
Business device, air conditioner or the network equipment etc.) execute method described in each embodiment of the present invention.
The above is only a preferred embodiment of the present invention, is not intended to limit the scope of the invention, all to utilize this hair
Equivalent structure or equivalent flow shift made by bright specification and accompanying drawing content is applied directly or indirectly in other relevant skills
Art field, is included within the scope of the present invention.
Claims (10)
1. a kind of terminal operation method based on gesture, which is characterized in that applied to the mobile terminal for being equipped with infrared sensor, institute
Stating the terminal operation method based on gesture includes:
When detecting using starting, determine whether the application opens secondary operating mode；
When determining that secondary operating mode is opened in the application, gesture motion is monitored based on the infrared sensor；
When monitoring gesture motion based on the infrared sensor, determine that the gesture motion is corresponding based on default mapping relations
The first touch event；
Determine that third touches based on the second touch event and first touch event of the screen triggering of the mobile terminal
Event；
Pass through the corresponding operation of third touch event described in the application execution.
2. as described in claim 1 based on the terminal operation method of gesture, which is characterized in that described to be based on the infrared biography
When sensor monitors gesture motion, the step of determining the gesture motion corresponding first touch event based on default mapping relations
Include:
When monitoring gesture motion based on the infrared sensor, the gesture motion is determined based on the default mapping relations
Whether preset condition is met；
When the gesture motion meets preset condition, the gesture motion corresponding is determined based on the default mapping relations
One touch event.
3. as described in claim 1 based on the terminal operation method of gesture, which is characterized in that described to be based on the default mapping
Relationship determines that the step of whether gesture motion meets preset condition includes:
It determines in the default mapping relations with the presence or absence of the gesture motion, wherein exist when in the default mapping relations
When the gesture motion, the gesture motion meets preset condition.
4. as described in claim 1 based on the terminal operation method of gesture, which is characterized in that described to be based on the mobile terminal
Screen triggering the second touch event and first touch event the step of determining third touch event include:
Determine corresponding first operational order of first touch event and corresponding second operation of second touch event
It whether consistent instructs；
In first operational order and consistent second operational order, using second touch event as described
Three touch events, using first touch event as invalid touch event.
5. as claimed in claim 4 based on the terminal operation method of gesture, which is characterized in that the determination described first touches
Corresponding first operational order of event and the whether consistent step of corresponding second operational order of second touch event it
Afterwards, further includes:
In first operational order and inconsistent second operational order, by first touch event and described the
Two touch events synthesize the third touch event.
6. as described in claim 1 based on the terminal operation method of gesture, which is characterized in that described to detect using starting
When, before determining described application the step of whether opening secondary operating mode, further includes:
When receiving setting instruction, application to be placed is determined, and set secondary operating mode for application to be placed；
Gesture motion is acquired based on the infrared sensor, and generates gesture motion based on preset rules and the gesture motion
With the default mapping relations of touch event.
7. as described in claim 1 based on the terminal operation method of gesture, which is characterized in that described to detect using starting
When, after determining described application the step of whether opening secondary operating mode, further includes:
If receiving switching command, secondary operating mode is switched into single screen operation mode；
Close the monitoring function of the infrared sensor.
8. such as the described in any item terminal operation methods based on gesture of claim 1-7, which is characterized in that described by described
The step of corresponding operation of third touch event described in application execution includes:
The table of comparisons based on touch event and operational order determines the corresponding operational order of the third touch event, and executes
The corresponding operation of the operational order.
9. a kind of mobile terminal, which is characterized in that the mobile terminal includes memory, processor and is stored in the memory
The terminal operation program based on gesture that is upper and can running on the processor, the terminal operation program quilt based on gesture
It realizes when the processor executes such as the step of the terminal operation method described in any item of the claim 1 to 8 based on gesture.
10. a kind of readable storage medium storing program for executing, which is characterized in that be stored with the terminal operation based on gesture on the readable storage medium storing program for executing
Program is realized when the terminal operation program based on gesture is executed by processor as described in any item of the claim 1 to 8
The step of terminal operation method based on gesture.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910366850.6A CN110096213B (en) | 2019-04-30 | 2019-04-30 | Terminal operation method based on gestures, mobile terminal and readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910366850.6A CN110096213B (en) | 2019-04-30 | 2019-04-30 | Terminal operation method based on gestures, mobile terminal and readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110096213A true CN110096213A (en) | 2019-08-06 |
| CN110096213B CN110096213B (en) | 2023-12-08 |
Family
ID=67446757
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910366850.6A Active CN110096213B (en) | 2019-04-30 | 2019-04-30 | Terminal operation method based on gestures, mobile terminal and readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110096213B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111831138A (en) * | 2020-06-22 | 2020-10-27 | 歌尔科技有限公司 | Wireless earphone signal identification method and device and wireless earphone |
| CN113315871A (en) * | 2021-05-25 | 2021-08-27 | 广州三星通信技术研究有限公司 | Mobile terminal and operating method thereof |
| CN116755565A (en) * | 2023-08-21 | 2023-09-15 | 南京维赛客网络科技有限公司 | Method, system and storage medium for realizing virtual interaction by transmitting signal by finger |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130265257A1 (en) * | 2012-04-08 | 2013-10-10 | Samsung Electronics Co., Ltd. | Flexible display apparatus and operating method thereof |
| US20140309871A1 (en) * | 2013-04-15 | 2014-10-16 | Flextronics Ap, Llc | User gesture control of vehicle features |
| CN107422853A (en) * | 2017-06-29 | 2017-12-01 | 努比亚技术有限公司 | A kind of gesture identification method, mobile terminal and computer-readable recording medium |
| WO2018076523A1 (en) * | 2016-10-25 | 2018-05-03 | 科世达（上海）管理有限公司 | Gesture recognition method and apparatus, and in-vehicle system |
| CN108897478A (en) * | 2018-06-28 | 2018-11-27 | 努比亚技术有限公司 | Terminal operation method, mobile terminal and computer readable storage medium |
-
2019
- 2019-04-30 CN CN201910366850.6A patent/CN110096213B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130265257A1 (en) * | 2012-04-08 | 2013-10-10 | Samsung Electronics Co., Ltd. | Flexible display apparatus and operating method thereof |
| US20140309871A1 (en) * | 2013-04-15 | 2014-10-16 | Flextronics Ap, Llc | User gesture control of vehicle features |
| WO2018076523A1 (en) * | 2016-10-25 | 2018-05-03 | 科世达（上海）管理有限公司 | Gesture recognition method and apparatus, and in-vehicle system |
| CN107422853A (en) * | 2017-06-29 | 2017-12-01 | 努比亚技术有限公司 | A kind of gesture identification method, mobile terminal and computer-readable recording medium |
| CN108897478A (en) * | 2018-06-28 | 2018-11-27 | 努比亚技术有限公司 | Terminal operation method, mobile terminal and computer readable storage medium |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111831138A (en) * | 2020-06-22 | 2020-10-27 | 歌尔科技有限公司 | Wireless earphone signal identification method and device and wireless earphone |
| CN111831138B (en) * | 2020-06-22 | 2024-03-15 | 歌尔科技有限公司 | Signal identification method and device of wireless earphone and wireless earphone |
| CN113315871A (en) * | 2021-05-25 | 2021-08-27 | 广州三星通信技术研究有限公司 | Mobile terminal and operating method thereof |
| CN113315871B (en) * | 2021-05-25 | 2022-11-22 | 广州三星通信技术研究有限公司 | Mobile terminal and operating method thereof |
| CN116755565A (en) * | 2023-08-21 | 2023-09-15 | 南京维赛客网络科技有限公司 | Method, system and storage medium for realizing virtual interaction by transmitting signal by finger |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110096213B (en) | 2023-12-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108897478A (en) | Terminal operation method, mobile terminal and computer readable storage medium | |
| CN109213401A (en) | Double-sided screen application icon method for sorting, mobile terminal and readable storage medium storing program for executing | |
| CN109407957A (en) | Screen touch control method, terminal and computer readable storage medium | |
| CN108108081A (en) | Method for information display, mobile terminal and readable storage medium storing program for executing based on double-sided screen | |
| CN108345426A (en) | A kind of terminal control method, terminal and computer readable storage medium | |
| CN108182028A (en) | A kind of control method, terminal and computer readable storage medium | |
| CN109376669A (en) | Control method, mobile terminal and the computer readable storage medium of intelligent assistant | |
| CN108040168A (en) | Mobile terminal operating method, mobile terminal and computer-readable recording medium | |
| CN108172161A (en) | Display methods, mobile terminal and computer readable storage medium based on flexible screen | |
| CN108958936A (en) | Application programe switch-over method, mobile terminal and computer readable storage medium | |
| CN109889651A (en) | A kind of notification message processing method, terminal and computer readable storage medium | |
| CN110096213A (en) | Terminal operation method, mobile terminal and readable storage medium storing program for executing based on gesture | |
| CN109739346A (en) | A kind of key simulating method, double screen terminal and computer readable storage medium | |
| CN109542325A (en) | Double-sided screen touch control method, double-sided screen terminal, readable storage medium storing program for executing | |
| CN109389394A (en) | A kind of multi-screen payment control method, equipment and computer readable storage medium | |
| CN109522276A (en) | Application icon management method, terminal and computer readable storage medium | |
| CN110096173A (en) | Method for controlling mobile terminal, mobile terminal and computer readable storage medium | |
| CN109683796A (en) | A kind of interaction control method, equipment and computer readable storage medium | |
| CN110007817A (en) | A kind of message treatment method and mobile terminal, computer readable storage medium | |
| CN109947330A (en) | Prompt operation processing method, mobile terminal and computer readable storage medium | |
| CN109710149A (en) | A kind of interactive display method, equipment and computer readable storage medium | |
| CN109151163A (en) | A kind of method for controlling mobile terminal, mobile terminal and computer readable storage medium | |
| CN108897451A (en) | The recognition methods of major-minor display screen, mobile terminal and computer readable storage medium | |
| CN109062964A (en) | A kind of data-erasure method, terminal and computer readable storage medium | |
| CN110069291A (en) | A kind of display control method, mobile terminal and computer readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |