CN107463326A - A kind of recognition methods of mobile terminal touch control gesture, mobile terminal and storage medium - Google Patents

A kind of recognition methods of mobile terminal touch control gesture, mobile terminal and storage medium Download PDF

Info

Publication number
CN107463326A
CN107463326A CN201710580450.6A CN201710580450A CN107463326A CN 107463326 A CN107463326 A CN 107463326A CN 201710580450 A CN201710580450 A CN 201710580450A CN 107463326 A CN107463326 A CN 107463326A
Authority
CN
China
Prior art keywords
touch control
control gesture
mobile terminal
image
touch
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201710580450.6A
Other languages
Chinese (zh)
Inventor
王秀琳
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nubia Technology Co Ltd
Original Assignee
Nubia Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nubia Technology Co Ltd filed Critical Nubia Technology Co Ltd
Priority to CN201710580450.6A priority Critical patent/CN107463326A/en
Publication of CN107463326A publication Critical patent/CN107463326A/en
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text

Abstract

The present invention discloses a kind of mobile terminal touch control gesture recognition methods, mobile terminal and computer-readable recording medium, the present invention is by gathering first touch control gesture information of the mobile terminal on the first touch-screen, all first touch control gesture information of collection are handled, obtain the characteristics of image of the touch control gesture of operating personnel first, by the characteristics of image of first touch control gesture accurately to identify first touch control gesture, the method of the present invention is simple, and it can accurately obtain the touch control gesture of mobile terminal, consequently facilitating operating personnel or user carry out more preferable management and control according to touch control gesture to mobile terminal, and then greatly improve Consumer's Experience.

Description

A kind of recognition methods of mobile terminal touch control gesture, mobile terminal and storage medium
Technical field
The present invention relates to electronic information technical field, more particularly to a kind of mobile terminal touch control gesture recognition methods, movement Terminal and computer-readable recording medium.
Background technology
As various mobile terminals are increasingly popularized, requirement of the user to the various functions of mobile terminal also more and more higher. However, traditional mobile terminal is substantially according to gravity sensing come control operation system, and gravity sensing control operation system, Often when user carelessly rocks, there is situation about being converted back and forth between transverse screen and portrait layout, although Ye You operators propose By the touch control gesture of user more accurately to control the operating system of mobile terminal, but existing method can not accurately Obtain the touch control gesture of user, from so that reduce Consumer's Experience.
The content of the invention
It is a primary object of the present invention to propose a kind of recognition methods of mobile terminal touch control gesture, mobile terminal and computer Readable storage medium storing program for executing, it is intended to solve the problems, such as the touch control gesture of the prior art that can not accurately obtain on mobile terminal.
To achieve the above object, a kind of mobile terminal touch control gesture recognition methods provided by the invention, this method include：Extremely It is few once to gather first touch control gesture information of the mobile terminal on the first touch-screen；All first touch control gestures of collection are believed Breath is handled, and obtains the characteristics of image of the touch control gesture of operating personnel first, the characteristics of image of first touch control gesture is used for Identify first touch control gesture.
Further, before the first touch control gesture information of the collection mobile terminal on the first touch-screen, in addition to： The display reminding information on the second touch-screen of the mobile terminal, the prompt message is guiding operating personnel in the shifting The touch control gesture of corresponding operator scheme is carried out in dynamic terminal.
Further, first touch control gesture information of the collection mobile terminal on the first touch-screen, is specifically included：It is logical The sensor crossed on first touch-screen gathers the first touch control gesture information.
Further, all first touch control gesture information of described pair of collection are handled, and are obtained operating personnel first and are touched After the characteristics of image for controlling gesture, in addition to：Judge whether the characteristics of image of first touch control gesture is effective, if it is, The operator scheme of the operating personnel on the mobile terminal is determined according to the characteristics of image of first touch control gesture.
Further, it is described judge first touch control gesture characteristics of image it is whether effective, specifically include：Described in judgement The similar probability of the characteristics of image of the characteristics of image of first touch control gesture typical touch control gesture corresponding with each operator scheme, when When the probability is respectively less than default probability threshold value, it is determined that the characteristics of image of first touch control gesture is invalid, otherwise, it determines institute The characteristics of image for stating the first touch control gesture is effective.
Further, after the characteristics of image of determination first touch control gesture is effective, in addition to：To described first The image of touch control gesture is preserved, and obtains touch control gesture image set, by learning to the touch control gesture image set, is built Corresponding relation between the characteristics of image and operator scheme of vertical touch control gesture.
Further, the characteristics of image according to first touch control gesture determines the operating personnel in the movement After operator scheme in terminal, in addition to：The operating system of the mobile terminal is adjusted according to the operator scheme, so that institute The layout for stating each function that operating system is shown is suitable to the current operation of operating personnel operator.
Further, the operator scheme includes following at least one：The right hand is clicked under portrait layout, portrait layout bottom right rubber sleeve is dynamic, Left hand is clicked under right hand input, portrait layout under portrait layout, portrait layout bottom left rubber sleeve is dynamic, both hands are clicked on, be perpendicular under left hand input, portrait layout under portrait layout The lower both hands of screen are slided, the right hand is clicked under both hands input, transverse screen under portrait layout, transverse screen bottom right rubber sleeve is dynamic, right hand input, transverse screen under transverse screen Lower left hand is clicked on, transverse screen bottom left rubber sleeve is dynamic, both hands are clicked under left hand input, transverse screen under transverse screen, both hands slide and transverse screen under transverse screen Lower both hands input.
On the other hand, the present invention also provides a kind of mobile terminal, and the mobile terminal includes processor, memory and communication Bus；The communication bus is used to realize the connection communication between processor and memory；The processor is used to perform storage The computer instruction stored in device, to realize a kind of mobile terminal touch control gesture recognition methods described in any of the above-described kind.
On the other hand, the present invention also provides a kind of computer-readable medium, and the computer-readable recording medium storage has One or more program, one or more of programs can be by one or more computing devices, to realize the present invention Any mobile terminal touch control gesture recognition methods provided.
A kind of mobile terminal touch control gesture recognition methods, mobile terminal and the computer storage that embodiments of the invention provide Medium, by gathering first touch control gesture information of the mobile terminal on the first touch-screen, to all first touch-control hands of collection Gesture information is handled, and obtains the characteristics of image of the touch control gesture of operating personnel first, passes through the image of first touch control gesture For feature accurately to identify first touch control gesture, method of the invention is simple, and can accurately obtain touching for mobile terminal Gesture is controlled, consequently facilitating operating personnel or user carry out more preferable management and control according to touch control gesture to mobile terminal, and then significantly Improve Consumer's Experience.
Scheme explanation
Fig. 1 is the hardware architecture diagram for realizing each optional mobile terminal of embodiment of the present invention；
Fig. 2 is the wireless communication system schematic diagram of mobile terminal as shown in Figure 1；
Fig. 3 is a kind of a kind of flow chart of mobile terminal touch control gesture recognition methods provided in an embodiment of the present invention；
Fig. 4 is mobile terminal holding operation schematic diagram of a scenario provided in an embodiment of the present invention；
Fig. 5 is images of gestures schematic diagram provided in an embodiment of the present invention；
Fig. 6 is a kind of another flow chart of mobile terminal touch control gesture recognition methods provided in an embodiment of the present invention；
Fig. 7 is backside touch screen acquisition interface schematic diagram provided in an embodiment of the present invention；
Fig. 8 is the interface schematic diagram that guide provided in an embodiment of the present invention prompts operating personnel to complete operator scheme；
Fig. 9 is a kind of structural representation of mobile terminal provided in an embodiment of the present invention.
The realization, functional characteristics and advantage of the object of the invention will in conjunction with the embodiments, and reference picture is described further.
Embodiment
It should be appreciated that the specific embodiments described herein are merely illustrative of the present invention, it is not intended to limit the present invention.
In follow-up description, the suffix using such as " module ", " part " or " unit " for representing element is only Be advantageous to the explanation of the present invention, itself there is no a specific meaning.Therefore, " module ", " part " or " unit " can mix Ground uses.
Mobile terminal can be implemented in a variety of manners.For example, the mobile terminal described in the present invention can be included such as Mobile phone, tablet personal computer, notebook computer, palm PC, personal digital assistant (Personal Digital Assistant, PDA), portable media player (Portable Media Player, PMP), guider, wearable device, intelligent hand The mobile terminals such as ring, pedometer, and the fixed cellular terminal such as digital TV, desktop computer.
It will be illustrated in subsequent descriptions by taking mobile terminal as an example, it will be appreciated by those skilled in the art that except special Outside element for moving purpose, construction according to the embodiment of the present invention can also apply to the mobile end of fixed type End.
Referring to Fig. 1, its hardware architecture diagram for a kind of mobile terminal of each embodiment of the realization present invention, the shifting Dynamic terminal 100 can include：RF (Radio Frequency, radio frequency) unit 101, WiFi module 102, audio output unit 103rd, A/V (audio/video) input block 104, sensor 105, display unit 106, user input unit 107, interface unit 108th, the part such as memory 109, processor 110 and power supply 111.It will be understood by those skilled in the art that shown in Fig. 1 Mobile terminal structure does not form the restriction to mobile terminal, and mobile terminal can be included than illustrating more or less parts, Either combine some parts or different parts arrangement.
The all parts of mobile terminal are specifically introduced with reference to Fig. 1：
Radio frequency unit 101 can be used for receiving and sending messages or communication process in, the reception and transmission of signal, specifically, by base station Downlink information receive after, handled to processor 110；In addition, up data are sent to base station.Generally, radio frequency unit 101 Including but not limited to antenna, at least one amplifier, transceiver, coupler, low-noise amplifier, duplexer etc..In addition, penetrate Frequency unit 101 can also be communicated by radio communication with network and other equipment.Above-mentioned radio communication can use any communication Standard or agreement, including but not limited to GSM (Global System of Mobile communication, global system for mobile telecommunications System), GPRS (General Packet Radio Service, general packet radio service), CDMA2000 (Code Division Multiple Access 2000, CDMA 2000), WCDMA (Wideband Code Division Multiple Access, WCDMA), TD-SCDMA (Time Division-Synchronous Code Division Multiple Access, TD SDMA), FDD-LTE (Frequency Division Duplexing-Long Term Evolution, FDD Long Term Evolution) and TDD-LTE (Time Division Duplexing-Long Term Evolution, time division duplex Long Term Evolution) etc..
WiFi belongs to short range wireless transmission technology, and mobile terminal can help user to receive and dispatch electricity by WiFi module 102 Sub- mail, browse webpage and access streaming video etc., it has provided the user wireless broadband internet and accessed.Although Fig. 1 shows Go out WiFi module 102, but it is understood that, it is simultaneously not belonging to must be configured into for mobile terminal, completely can be according to need To be omitted in the essential scope for do not change invention.
Audio output unit 103 can be in call signal reception pattern, call mode, record mould in mobile terminal 100 When under the isotypes such as formula, speech recognition mode, broadcast reception mode, by radio frequency unit 101 or WiFi module 102 it is receiving or It is sound that the voice data stored in memory 109, which is converted into audio signal and exported,.Moreover, audio output unit 103 The audio output related to the specific function that mobile terminal 100 performs can also be provided (for example, call signal receives sound, disappeared Breath receives sound etc.).Audio output unit 103 can include loudspeaker, buzzer etc..
A/V input blocks 104 are used to receive audio or video signal.A/V input blocks 104 can include graphics processor (Graphics Processing Unit, GPU) 1041 and microphone 1042, graphics processor 1041 is in video acquisition mode Or the static images or the view data of video obtained in image capture mode by image capture apparatus (such as camera) are carried out Reason.Picture frame after processing may be displayed on display unit 106.Picture frame after the processing of graphics processor 1041 can be deposited Storage is transmitted in memory 109 (or other storage mediums) or via radio frequency unit 101 or WiFi module 102.Mike Wind 1042 can connect in telephone calling model, logging mode, speech recognition mode etc. operational mode via microphone 1042 Quiet down sound (voice data), and can be voice data by such acoustic processing.Audio (voice) data after processing can To be converted to the form output that mobile communication base station can be sent to via radio frequency unit 101 in the case of telephone calling model. Microphone 1042 can implement various types of noises and eliminate (or suppression) algorithm to eliminate (or suppression) in reception and send sound Caused noise or interference during frequency signal.
Mobile terminal 100 also includes at least one sensor 105, such as optical sensor, motion sensor and other biographies Sensor.Specifically, optical sensor includes ambient light sensor and proximity transducer, wherein, ambient light sensor can be according to environment The light and shade of light adjusts the brightness of display panel 1061, and proximity transducer can close when mobile terminal 100 is moved in one's ear Display panel 1061 and/or backlight.As one kind of motion sensor, accelerometer sensor can detect in all directions (general For three axles) size of acceleration, size and the direction of gravity are can detect that when static, the application available for identification mobile phone posture (such as horizontal/vertical screen switching, dependent game, magnetometer pose calibrating), Vibration identification correlation function (such as pedometer, percussion) etc.； The fingerprint sensor that can also configure as mobile phone, pressure sensor, iris sensor, molecule sensor, gyroscope, barometer, The other sensors such as hygrometer, thermometer, infrared ray sensor, will not be repeated here.
Display unit 106 is used for the information for showing the information inputted by user or being supplied to user.Display unit 106 can wrap Display panel 1061 is included, liquid crystal display (Liquid Crystal Display, LCD), Organic Light Emitting Diode can be used Forms such as (Organic Light-Emitting Diode, OLED) configures display panel 1061, and display unit 106 includes position In the positive color/graphics of mobile terminal, and the black and white electronic ink screen positioned at the mobile terminal back side.
User input unit 107 can be used for the numeral or character information for receiving input, and produce the use with mobile terminal The key signals input that family is set and function control is relevant.Specifically, user input unit 107 may include contact panel 1071 with And other input equipments 1072.User input unit 107 includes two contact panels, i.e. double-sided screen, may be configured as being located at respectively The front and back of mobile terminal.Contact panel 1071, also referred to as touch-screen, collect touch behaviour of the user on or near it Make (for example user uses any suitable objects or annex such as finger, stylus on contact panel 1071 or in contact panel Operation near 1071), and corresponding attachment means are driven according to formula set in advance.Contact panel 1071 may include to touch Two parts of detection means and touch controller.Wherein, the touch orientation of touch detecting apparatus detection user, and detect touch behaviour Make the signal brought, transmit a signal to touch controller；Touch controller receives touch information from touch detecting apparatus, and Contact coordinate is converted into, then gives processor 110, and the order sent of reception processing device 110 and can be performed.This Outside, the polytypes such as resistance-type, condenser type, infrared ray and surface acoustic wave can be used to realize contact panel 1071.Except touching Panel 1071 is controlled, user input unit 107 can also include other input equipments 1072.Specifically, other input equipments 1072 Physical keyboard, function key (such as volume control button, switch key etc.), trace ball, mouse, operation can be included but is not limited to One or more in bar etc., are not limited specifically herein.
Further, contact panel 1071 can cover display panel 1061, detect thereon when contact panel 1071 or After neighbouring touch operation, processor 110 is sent to determine the type of touch event, is followed by subsequent processing device 110 according to touch thing The type of part provides corresponding visual output on display panel 1061.Although in Fig. 1, contact panel 1071 and display panel 1061 be the part independent as two to realize the input of mobile terminal and output function, but in certain embodiments, can Input and the output function of mobile terminal are realized so that contact panel 1071 and display panel 1061 is integrated, is not done herein specifically Limit.
Interface unit 108 is connected the interface that can pass through as at least one external device (ED) with mobile terminal 100.For example, External device (ED) can include wired or wireless head-band earphone port, external power source (or battery charger) port, wired or nothing Line FPDP, memory card port, the port for connecting the device with identification module, audio input/output (I/O) end Mouth, video i/o port, ear port etc..Interface unit 108 can be used for receiving the input from external device (ED) (for example, number It is believed that breath, electric power etc.) and the input received is transferred to one or more elements in mobile terminal 100 or can be with For transmitting data between mobile terminal 100 and external device (ED).
Memory 109 can be used for storage software program and various data.Memory 109 can mainly include storing program area And storage data field, wherein, storing program area can storage program area, application program (such as the sound needed at least one function Sound playing function, image player function etc.) etc.；Storage data field can store according to mobile phone use created data (such as Voice data, phone directory etc.) etc..In addition, memory 109 can include high-speed random access memory, can also include non-easy The property lost memory, a for example, at least disk memory, flush memory device or other volatile solid-state parts.
Processor 110 is the control centre of mobile terminal, utilizes each of various interfaces and the whole mobile terminal of connection Individual part, by running or performing the software program and/or module that are stored in memory 109, and call and be stored in storage Data in device 109, the various functions and processing data of mobile terminal are performed, so as to carry out integral monitoring to mobile terminal.Place Reason device 110 may include one or more processing units；Preferably, processor 110 can integrate application processor and modulatedemodulate is mediated Device is managed, wherein, application processor mainly handles operating system, user interface and application program etc., and modem processor is main Handle radio communication.It is understood that above-mentioned modem processor can not also be integrated into processor 110.
Mobile terminal 100 can also include the power supply 111 (such as battery) to all parts power supply, it is preferred that power supply 111 Can be logically contiguous by power-supply management system and processor 110, so as to realize management charging by power-supply management system, put The function such as electricity and power managed.
Although Fig. 1 is not shown, mobile terminal 100 can also will not be repeated here including bluetooth module etc..
For the ease of understanding the embodiment of the present invention, the communications network system being based on below to the mobile terminal of the present invention enters Row description.
Referring to Fig. 2, Fig. 2 is a kind of communications network system Organization Chart provided in an embodiment of the present invention, the communication network system Unite as the LTE system of universal mobile communications technology, the UE that the LTE system includes communicating connection successively (User Equipment, is used Family equipment) 201, E-UTRAN (Evolved UMTS Terrestrial Radio Access Network, evolved UMTS lands Ground wireless access network) 202, EPC (Evolved Packet Core, evolved packet-based core networks) 203 and operator IP operation 204。
Specifically, UE201 can be above-mentioned mobile terminal 100, and here is omitted.
E-UTRAN202 includes eNodeB2021 and other eNodeB2022 etc..Wherein, eNodeB2021 can be by returning Journey (backhaul) (such as X2 interface) is connected with other eNodeB2022, and eNodeB2021 is connected to EPC203, ENodeB2021 can provide UE201 to EPC203 access.
EPC203 can include MME (Mobility Management Entity, mobility management entity) 2031, HSS (Home Subscriber Server, home subscriber server) 2032, other MME2033, SGW (Serving Gate Way, Gateway) 2034, PGW (PDN Gate Way, grouped data network gateway) 2035 and PCRF (Policy and Charging Rules Function, policy and rate functional entity) 2036 etc..Wherein, MME2031 be processing UE201 and The control node of signaling between EPC203, there is provided carrying and connection management.HSS2032 is all to manage for providing some registers Such as the function of attaching position register (not shown) etc, and preserve some and used about service features, data rate etc. The special information in family.All customer data can be transmitted by SGW2034, and PGW2035 can provide UE 201 IP Address is distributed and other functions, and PCRF2036 is strategy and the charging control strategic decision-making of business data flow and IP bearing resources Point, it selects and provided available strategy and charging control decision-making with charge execution function unit (not shown) for strategy.
IP operation 204 can include internet, Intranet, IMS (IP Multimedia Subsystem, IP multimedia System) or other IP operations etc..
Although above-mentioned be described by taking LTE system as an example, those skilled in the art it is to be understood that the present invention not only Suitable for LTE system, be readily applicable to other wireless communication systems, such as GSM, CDMA2000, WCDMA, TD-SCDMA with And following new network system etc., do not limit herein.
Based on above-mentioned mobile terminal hardware configuration and communications network system, each embodiment of the inventive method is proposed.
As shown in figure 3, the embodiment provides a kind of mobile terminal touch control gesture recognition methods, including：
S31, first touch control gesture information of the mobile terminal on the first touch-screen is gathered at least once；
S32, all first touch control gesture information of collection are handled, obtain the figure of the touch control gesture of operating personnel first As feature, the characteristics of image of first touch control gesture is used to identify first touch control gesture.
Wherein, all first touch control gesture information of collection are handled, be specifically as follows：Mobile terminal multi collect Same touch control gesture, the touch control gesture gathered each time is formed into picture, to obtain the pictures that a large amount of pictures form, the picture Collect the features training that the touch control gesture is identified for (but being not limited only to), ultimately form the characteristics of image of the touch control gesture, the figure As feature can be stored in mobile terminal.When mobile terminal is by storing the characteristics of image of each different touch control gestures with upper type Afterwards, the touch control gesture different available for match cognization user, i.e. operator scheme.That is, it is provided in an embodiment of the present invention a kind of mobile Terminal touch control gesture recognition methods, by gathering first touch control gesture information of the mobile terminal on the first touch-screen, to collection All first touch control gesture information handled, obtain the characteristics of image of the touch control gesture of operating personnel first, pass through described For the characteristics of image of one touch control gesture accurately to identify first touch control gesture, method of the invention is simple, and can be accurate The touch control gesture of mobile terminal is obtained, consequently facilitating operating personnel or user are carried out more preferably according to touch control gesture to mobile terminal Management and control, and then greatly improve Consumer's Experience.
On the whole, it is of the invention by synthesizing images of gestures according to the touch control gesture information gathered on the first touch-screen, and The current operator scheme of mobile terminal is accurately determined according to the characteristics of image of touch control gesture, in order to operating personnel or user More preferable management and control is carried out to mobile terminal, for example, in the case of it is determined that user gesture does not become, makes mobile terminal without transverse screen Switching between portrait layout, influence Consumer's Experience to avoid converting back and forth between unnecessary transverse screen and portrait layout.
It should be noted that the embodiment of the present invention is to be directed to dual-screen mobile terminal, first touch-screen is mobile terminal Backside touch screen, i.e. the mobile terminal back side black and white electronic ink water bottle, second touch-screen be mobile terminal front touch Screen, the i.e. positive colorful display screen of mobile terminal.
The present invention is according under different operator schemes, touch-control that the touch area of user's palm and backside touch screen is formed Images of gestures takes on a different character, by the related algorithm of image recognition to the touch control gesture figure that is formed under different operation modes As the extraction of the characteristics of image that carries out touch control gesture, effectively to distinguish the presently used operator scheme of user, and according to working as Preceding operator scheme is optimized accordingly to the operating system of mobile terminal, and Consumer's Experience is improved so as to further realize.
Stated differently, since the embodiment of the present invention is believed by the touch control gesture of acquisition operations personnel on mobile terminals Breath, the touch control gesture is synthesized into touch control gesture figure, the characteristics of image in touch control gesture image determines that operating personnel are current Operator scheme, can be according to the operator scheme that the inventive method obtains to moving so the operator scheme that obtains of the present invention is more accurate The operating system of dynamic terminal carries out management and control.
It should be noted that the embodiment of the present invention is mainly for technical staff, e.g., application developer, procedure operation people Member etc., by setting prompt message, to guide operating personnel to carry out the operation of corresponding operator scheme on mobile terminals.And adopt The touch control gesture information that the touch area of collection user's palm and backside touch screen is formed, synthesis touch control gesture image pass through image The related algorithm of identification preserves to the touch control gesture image formed under different operation modes, and carries out neural metwork training, The presently used operator scheme of user can effectively be distinguished according to training result, and then the operating system of mobile terminal is entered The corresponding optimization of row, it is final to realize lifting Consumer's Experience.
In addition, method of the present invention can also be used in general user, according to collection user's palm and backside touch screen The touch control gesture image that is formed of touch area there is different characteristics of image, the operating system of mobile terminal is entered with realizing Row is optimized and revised, final to realize lifting Consumer's Experience.
When it is implemented, the embodiment of the present invention is by establishing the characteristics of image of various operator schemes and touch control gesture, and The two corresponding relation between touch information, so that current operator scheme to be identified.
For example, the characteristics of image that the right hand under portrait layout in operator scheme is clicked on is arranged to the image of the first touch control gesture Feature, corresponding touch control gesture information is arranged to the first touch control gesture information, in concrete operations, to the first of acquisition Touch control gesture information is handled to obtain the characteristics of image of the first touch control gesture, true according to the characteristics of image of first touch control gesture Determine the current operator scheme of operating personnel.The determination mode of other operator schemes is similar therewith, is not described in detail herein.
When it is implemented, operator scheme described in the embodiment of the present invention includes following at least one：The right hand is clicked on, is perpendicular under portrait layout Shield that bottom right rubber sleeve is dynamic, left hand is clicked on, portrait layout bottom left rubber sleeve is dynamic, left hand input, portrait layout under portrait layout under right hand input, portrait layout under portrait layout Lower both hands are clicked on, both hands are slided under portrait layout, the right hand is clicked under both hands input, transverse screen under portrait layout, transverse screen bottom right rubber sleeve is dynamic, under transverse screen Right hand input, left hand is clicked under transverse screen, transverse screen bottom left rubber sleeve is dynamic, under transverse screen under left hand input, transverse screen both hands click on, lower pair of transverse screen Rubber sleeve is dynamic to be inputted with both hands under transverse screen.Certainly, those skilled in the art can also set other operations according to being actually needed Pattern, to meet various different demands.
It is specifically, of the invention mainly by gathering the touch control gesture information on the mobile terminal backside touch screen, And touch control gesture characteristics of image is synthesized according to the touch control gesture information, the shifting is then determined according to touch control gesture characteristics of image Operator scheme in dynamic terminal, and optimizing and revising to the operating system of the mobile terminal is completed according to the operator scheme Work.
It should be noted that the first touch control gesture information described in the embodiment of the present invention is the inductor collection on mobile terminal The operating personnel arrived contact information with mobile terminal, and the characteristics of image of the first touch control gesture image is according to above-mentioned touch-control hand The characteristics of image of the touch control gesture image of the operating personnel of gesture information synthesis, the present invention are special according to the image of the touch control gesture image Sign determines the operator scheme of operating personnel on mobile terminals, and the operating system of mobile terminal is carried out according to the operator scheme Adjustment, so that each function of being shown in operating system is more suitable for the current operation of operating personnel, so as to greatly promote Consumer's Experience.
As shown in figure 4, it is operation scenario schematic diagram under right hand grip state.Now, palm large area and backside touch screen Contact, the now touch control gesture information of palm and backside touch screen can be obtained by capturing backside touch screen sensor information.It is left Under hand gripping and hands grasping state similarly.Its difference is, under different operation modes, the Touch Zone of palm and backside touch screen Domain takes on a different character.
As shown in figure 5, to handle images of gestures schematic diagram corresponding to obtained Fig. 4, when gripping mobile terminal due to user, The habitual bending of finger, so finger fault-layer-phenomenon occurs in image.
A kind of mobile terminal touch control gesture recognition methods provided by the invention is carried out below by specific embodiment detailed Explanation.As shown in fig. 6, a kind of mobile terminal touch control gesture recognition methods in the present embodiment may include following steps：
S61, first touch control gesture information of the mobile terminal on the first touch-screen is gathered at least once；
S62, all first touch control gesture information of collection are handled, obtain the figure of the touch control gesture of operating personnel first As feature, the characteristics of image of first touch control gesture is used to identify first touch control gesture
That is, the present invention is by gathering first touch control gesture information of the mobile terminal on the first touch-screen, to the institute of collection There is the first touch control gesture information to be handled, obtain the characteristics of image of the touch control gesture of operating personnel first, touched by described first The characteristics of image of gesture is controlled accurately to identify first touch control gesture, method of the invention is simple, and can accurately obtain The touch control gesture of mobile terminal, consequently facilitating operating personnel or user are preferably managed according to touch control gesture to mobile terminal Control, and then greatly improve Consumer's Experience.
On the whole, the present invention according to the touch control gesture information gathered on the first touch-screen by synthesizing touch control gesture figure Picture, and the current operator scheme of mobile terminal is accurately determined according to the characteristics of image of touch control gesture, in order to operating personnel or Person user carries out more preferable management and control to mobile terminal, for example, in the case of it is determined that user gesture does not become, mobile terminal is not entered Switching between row transverse screen and portrait layout, influence Consumer's Experience to avoid converting back and forth between unnecessary transverse screen and portrait layout.
It should be noted that the embodiment of the present invention is to be directed to dual-screen mobile terminal, first touch-screen is mobile terminal Backside touch screen, i.e. the mobile terminal back side black and white electronic ink water bottle, second touch-screen be mobile terminal front touch Screen, the i.e. positive colorful display screen of mobile terminal.
The present invention is according under different operator schemes, touch-control that the touch area of user's palm and backside touch screen is formed Images of gestures has different characteristics of image, by the related algorithm of image recognition to the touch-control hand that is formed under different operation modes Gesture image carries out touch control gesture information extraction, effectively to distinguish the presently used operator scheme of user, and according to current Operator scheme is optimized accordingly to the operating system of mobile terminal, and Consumer's Experience is improved so as to further realize.
When it is implemented, before step S61, the method described in the embodiment of the present invention also includes：
S60, the display reminding information on the second touch-screen of the mobile terminal, the prompt message operate to guide Personnel carry out the touch control gesture of corresponding operator scheme on the mobile terminal.
The second touch-screen described in the embodiment of the present invention is the front touch-screen of mobile terminal, or alternatively referred to as mobile whole The positive colorful display screen at end.
That is, the embodiment of the present invention is by the display reminding information on positive display screen, to guide operator Member carries out the operation of corresponding operator scheme on mobile terminals.
The embodiment of the present invention e.g., application developer, procedure operation personnel etc., passes through setting mainly for technical staff Prompt message, to guide operating personnel to carry out the operation of corresponding operator scheme on mobile terminals.And gather user's palm with The touch control gesture information that the touch area of backside touch screen is formed, synthesis touch control gesture image pass through the related calculation of image recognition Method preserves to the touch control gesture image formed under different operation modes, and carries out neural metwork training, according to training result The presently used operator scheme of user can be effectively distinguished, and then the operating system progress to mobile terminal is corresponding excellent Change, it is final to realize lifting Consumer's Experience.
Certainly, for the user using mobile terminal, it may be selected to skip display reminding information Step, be directly acquired hand Gesture image.
Fig. 7 is backside touch screen acquisition interface schematic diagram provided in an embodiment of the present invention, as shown in fig. 7, the interface not with It is a blank interface when interaction occurs for IMAQ personnel, only prompts whether Bluetooth communication establishes connection, when receiving touch-control hand During gesture information, touch control gesture information is gathered by backside touch screen sensor.
Fig. 8 is that guide provided in an embodiment of the present invention prompts operating personnel's interface schematic diagram of completion operator scheme, such as Fig. 8 It is shown, under each operator scheme, prompt the set operating area for the operation and operation that need to currently perform.Click on and grasp such as the right hand Make, user need to be prompted to grip mobile terminal with the right hand, perform clicking operation, and prompt the user position clicked on, other operation moulds It is similar under formula.After user touches interface, prompting frame disappears, and user can be gently sliding etc. in the set operation of interface execution, or left and right Switch the touch control gesture information gathering under interface progress different operation modes.
When it is implemented, all first touch control gesture information of described pair of collection are handled, operating personnel first are obtained After the characteristics of image of touch control gesture, in addition to：
Judge whether the characteristics of image of first touch control gesture is effective, if it is, according to first touch control gesture Characteristics of image determine the operator scheme of the operating personnel on the mobile terminal.
That is, it is of the invention by judging whether touch control gesture image is effective, to avoid invalid images of gestures to behaviour Make the influence of system.
Judge whether the images of gestures effectively specifically includes when it is implemented, of the present invention：Judge that described first touches The similar probability of the characteristics of image of the characteristics of image typical touch control gesture corresponding with each operator scheme of gesture is controlled, when the probability Respectively less than default probability threshold value when, it is determined that the characteristics of image of first touch control gesture is invalid, otherwise, it determines described first The characteristics of image of touch control gesture is effective.
That is, the embodiment of the present invention passes through the characteristics of image of current touch control gesture is corresponding with each operator scheme typical The characteristics of image of touch control gesture carries out the rate of exchange, probability similar therebetween is judged, when the probability is respectively less than default probability threshold During value, it is determined that gesture effective image before deserving, otherwise, then the images of gestures is effective.
Specifically, the present invention can be directed to the image spy that each operator scheme sets a corresponding typical touch control gesture Sign, naturally it is also possible to the characteristics of image of multiple typical touch control gestures is set as desired for some or all operator schemes, The characteristics of image of the typical touch control gesture includes typical hand-type feature of corresponding operator scheme etc., according to the image of touch control gesture Feature is compared with the characteristics of image of default typical touch control gesture, it is determined that the two similar probability, for example, specifically comparing When, the touch control gesture picture that will be obtained according to touch control gesture information processing, by the touch control gesture picture and typical touch control gesture figure Typical touch control gesture feature as in is compared one by one, when not detecting typical touch control gesture image in touch control gesture picture In touch-control hand-type feature, then judge that the touch control gesture picture probability similar with the typical touch control gesture image by compared with is small, Conversely, then judge that the two similar probability is higher.
When it is implemented, methods described of the embodiment of the present invention may also include：The image of first touch control gesture is carried out Preserve, obtain touch control gesture image set, by learning to the touch control gesture image set, the image for establishing touch control gesture is special Corresponding relation between sign and operator scheme.
That is, the embodiment of the present invention is directed under different operator schemes, the touch-control of user's palm and backside touch screen The different characteristic for the image that region is formed, the touch control gesture image is preserved, touch control gesture image set is obtained, passes through Image recognition related algorithm is identified and classified to the different gesture features in touch control gesture image set, establishes touch control gesture figure The corresponding relation between gesture feature and operator scheme as in so that subsequently can accurately be obtained according to images of gestures current Operator scheme.
Detailed explanation and illustration will be carried out to method of the present invention by a specific example below：
The embodiment of the present invention guides operating personnel to carry out the behaviour under each operator scheme by IMAQ APP form Make, i.e., the present invention is carried out on the mobile terminal accordingly by IMAQ APP display reminding information, guiding operating personnel Operator scheme operation.During operating personnel perform associative operation under each pattern, the hand of grasping manipulation personnel The touch control gesture image of the palm and backside touch screen, and according to current operator scheme and operating time, to the touch-control hand grabbed Gesture image is named and preserved.
The IMAQ APP of the embodiment of the present invention mainly realizes two functions, including prompting and guiding function and touch control gesture Information collection function.
The prompting and guiding function of the embodiment of the present invention is to prompt operating personnel in each mode of operation by display screen Make, such as prompt the currently used left and right/right hand of operating personnel/hands grasping mobile terminal device, and prompt operating personnel current The operator scheme to be carried out, such as left hand click, right hand slip etc.；And for clicking operation, it can be carried in the display screen Show the number of the position clicked on needed for operating personnel and click；For slide, operating personnel can be prompted in the display screen The region of required slip and the length of slip, time etc.；For continuous word input operation, can prompt to grasp in the display screen Make word for continuously being inputted needed for personnel etc..
The touch control gesture information collection function of the embodiment of the present invention includes：When mobile terminal detects the operation of operating personnel Afterwards, then the touch control gesture information of acquisition operations personnel palm and backside touch screen, due to deploying big quantity sensor in touch-screen Operating personnel capture operating personnel's touch control gesture information, can be based on sensor information and (include but is not limited to palm and touch-screen The sensor of binding face carries out the collection of touch control gesture information), the touch control gesture of acquisition operating personnel's palm and backside touch screen Information；
Mobile terminal calls OpenGL correlation API according to the sensing data collected, draws touch control gesture image, After drawing successfully, Effective judgement is carried out to the touch control gesture image, or the touch control gesture image drawn can also be supplied Operating personnel's preview, to judge the validity of the primary images of gestures；
If effectively, the image of capture is named and preserved according to current mode and time, such as right_ click_2017_01_23_11_30_25_023；
Operating personnel are guided to re-start collection under current mode if invalid.
User can under same operator scheme multiple touch control gesture pictures of continuous acquisition；
The pictures that the present invention can form a large amount of touch-control pictures of acquisition, the touch-control picture can be used for (but being not limited only to) Features training of operating personnel's operator scheme etc. is identified, and for identifying the operator scheme of true operation personnel, and then optimize system System, lift Consumer's Experience.
The operator scheme includes but are not limited to：
Under vertical screen mode：
1) right hand is clicked on：I.e. IMAQ personnel only grip mobile terminal device with the right hand, and click is performed on screen Operation；
2) right hand slides：I.e. IMAQ personnel only grip mobile terminal device with the right hand, and slip is performed on screen Operation；
3) right hand inputs：I.e. IMAQ personnel only grip mobile terminal device with the right hand, and are performed continuously on screen Word input operation；
4) left hand is clicked on：I.e. IMAQ personnel only use left-handed mobile terminal device, and click is performed on screen Operation；
5) left hand slides：I.e. IMAQ personnel only use left-handed mobile terminal device, and slip is performed on screen Operation；
6) left hand inputs：I.e. IMAQ personnel only use left-handed mobile terminal device, and are performed continuously on screen Word input operation；
7) both hands are clicked on：I.e. IMAQ personnel with the hands grip mobile terminal device, and are performed on screen and click on behaviour Make；
8) both hands slide：I.e. IMAQ personnel with the hands grip mobile terminal device, and are performed on screen and slide behaviour Make；
9) both hands input：I.e. IMAQ personnel with the hands grip mobile terminal device, and are performed continuously on screen Word input operation；
Under transverse screen mode：
1) right hand is clicked on：I.e. IMAQ personnel only grip mobile terminal device with the right hand, and click is performed on screen Operation；
2) right hand slides：I.e. IMAQ personnel only grip mobile terminal device with the right hand, and slip is performed on screen Operation；
3) right hand inputs：I.e. IMAQ personnel only grip mobile terminal device with the right hand, and are performed continuously on screen Word input operation；
4) left hand is clicked on：I.e. IMAQ personnel only use left-handed mobile terminal device, and click is performed on screen Operation；
5) left hand slides：I.e. IMAQ personnel only use left-handed mobile terminal device, and slip is performed on screen Operation；
6) left hand inputs：I.e. IMAQ personnel only use left-handed mobile terminal device, and are performed continuously on screen Word input operation；
7) both hands are clicked on：I.e. IMAQ personnel with the hands grip mobile terminal device, and are performed on screen and click on behaviour Make；
8) both hands slide：I.e. IMAQ personnel with the hands grip mobile terminal device, and are performed on screen and slide behaviour Make；
9) both hands input：I.e. IMAQ personnel with the hands grip mobile terminal device, and are performed continuously on screen Word input operation.
Accordingly, as shown in figure 9, embodiments of the invention also provide a kind of mobile terminal, including：Processor 91, storage Device 92 and communication bus；
Communication bus is used to realize the connection communication between processor 91 and memory 92；
Memory 92 is used to store computer instruction, and the computer that processor 91 is used to run the memory storage refers to Order, to realize following steps：First touch control gesture information of the mobile terminal on the first touch-screen is gathered at least once；To collection All first touch control gesture information handled, obtain the characteristics of image of the touch control gesture of operating personnel first, described first touches The characteristics of image of control gesture is used to identify first touch control gesture.
That is, mobile terminal provided in an embodiment of the present invention, by gather mobile terminal on the first touch-screen first touch Gesture information is controlled, all first touch control gesture information of collection are handled, obtain the figure of the touch control gesture of operating personnel first As feature, by the characteristics of image of first touch control gesture accurately to identify first touch control gesture, side of the invention Method is simple, and can accurately obtain the touch control gesture of mobile terminal, consequently facilitating operating personnel or user are according to touch control gesture More preferable management and control is carried out to mobile terminal, and then greatly improves Consumer's Experience.
On the whole, it is of the invention by synthesizing images of gestures according to the touch control gesture information gathered on the first touch-screen, and The current operator scheme of mobile terminal is accurately determined according to the characteristics of image of touch control gesture, in order to operating personnel or user More preferable management and control is carried out to mobile terminal, for example, in the case of it is determined that user gesture does not become, makes mobile terminal without transverse screen Switching between portrait layout, influence Consumer's Experience to avoid converting back and forth between unnecessary transverse screen and portrait layout.
It should be noted that the embodiment of the present invention is to be directed to dual-screen mobile terminal, first touch-screen is mobile terminal Backside touch screen, i.e. the mobile terminal back side black and white electronic ink water bottle, second touch-screen be mobile terminal front touch Screen, the i.e. positive colorful display screen of mobile terminal.
The present invention is according under different operator schemes, touch-control that the touch area of user's palm and backside touch screen is formed Images of gestures takes on a different character, by the related algorithm of image recognition to the touch control gesture figure that is formed under different operation modes As the extraction of the characteristics of image that carries out touch control gesture, effectively to distinguish the presently used operator scheme of user, and according to working as Preceding operator scheme is optimized accordingly to the operating system of mobile terminal, and Consumer's Experience is improved so as to further realize.
Stated differently, since the embodiment of the present invention is believed by the touch control gesture of acquisition operations personnel on mobile terminals Breath, the touch control gesture is synthesized into touch control gesture figure, the characteristics of image in touch control gesture image determines that operating personnel are current Operator scheme, can be according to the operator scheme that the inventive method obtains to moving so the operator scheme that obtains of the present invention is more accurate The operating system of dynamic terminal carries out management and control.
It should be noted that the embodiment of the present invention is mainly for technical staff, e.g., application developer, procedure operation people Member etc., by setting prompt message, to guide operating personnel to carry out the operation of corresponding operator scheme on mobile terminals.And adopt The touch control gesture information that the touch area of collection user's palm and backside touch screen is formed, synthesis touch control gesture image pass through image The related algorithm of identification preserves to the touch control gesture image formed under different operation modes, and carries out neural metwork training, The presently used operator scheme of user can effectively be distinguished according to training result, and then the operating system of mobile terminal is entered The corresponding optimization of row, it is final to realize lifting Consumer's Experience.
In addition, method of the present invention can also be used in general user, according to collection user's palm and backside touch screen The touch control gesture image that is formed of touch area there is different characteristics of image, the operating system of mobile terminal is entered with realizing Row is optimized and revised, final to realize lifting Consumer's Experience.
When it is implemented, the embodiment of the present invention is by establishing the characteristics of image of various operator schemes and touch control gesture, and The two corresponding relation between touch information, so that current operator scheme to be identified.
For example, the characteristics of image that the right hand under portrait layout in operator scheme is clicked on is arranged to the image of the first touch control gesture Feature, corresponding touch control gesture information is arranged to the first touch control gesture information, in concrete operations, to the first of acquisition Touch control gesture information is handled to obtain the characteristics of image of the first touch control gesture, true according to the characteristics of image of first touch control gesture Determine the current operator scheme of operating personnel.The determination mode of other operator schemes is similar therewith, is not described in detail herein.
When it is implemented, operator scheme described in the embodiment of the present invention includes following at least one：The right hand is clicked on, is perpendicular under portrait layout Shield that bottom right rubber sleeve is dynamic, left hand is clicked on, portrait layout bottom left rubber sleeve is dynamic, left hand input, portrait layout under portrait layout under right hand input, portrait layout under portrait layout Lower both hands are clicked on, both hands are slided under portrait layout, the right hand is clicked under both hands input, transverse screen under portrait layout, transverse screen bottom right rubber sleeve is dynamic, under transverse screen Right hand input, left hand is clicked under transverse screen, transverse screen bottom left rubber sleeve is dynamic, under transverse screen under left hand input, transverse screen both hands click on, lower pair of transverse screen Rubber sleeve is dynamic to be inputted with both hands under transverse screen.Certainly, those skilled in the art can also set other operations according to being actually needed Pattern, to meet various different demands.
It is specifically, of the invention mainly by gathering the touch control gesture information on the mobile terminal backside touch screen, And touch control gesture characteristics of image is synthesized according to the touch control gesture information, the shifting is then determined according to touch control gesture characteristics of image Operator scheme in dynamic terminal, and optimizing and revising to the operating system of the mobile terminal is completed according to the operator scheme Work.
It should be noted that the first touch control gesture information described in the embodiment of the present invention is the inductor collection on mobile terminal The operating personnel arrived contact information with mobile terminal, and the characteristics of image of the first touch control gesture image is according to above-mentioned touch-control hand The characteristics of image of the touch control gesture image of the operating personnel of gesture information synthesis, the present invention are special according to the image of the touch control gesture image Sign determines the operator scheme of operating personnel on mobile terminals, and the operating system of mobile terminal is carried out according to the operator scheme Adjustment, so that each function of being shown in operating system is more suitable for the current operation of operating personnel, so as to greatly promote Consumer's Experience.
Mobile terminal provided by the invention is described in detail below by specific embodiment.Processor 91 is used to run The computer instruction of the memory storage, to realize following steps：
The display reminding information on the second touch-screen of the mobile terminal, the prompt message is guiding operating personnel The touch control gesture of corresponding operator scheme is carried out on the mobile terminal.
That is, the mobile terminal of the embodiment of the present invention is by the display reminding information on positive display screen, with Guiding operating personnel carry out the operation of corresponding operator scheme on mobile terminals.
When it is implemented, processor 91 is used for the computer instruction for running the memory storage, it is also following to realize Step：Judge whether the characteristics of image of first touch control gesture is effective, if it is, the figure according to first touch control gesture As feature determines the operator scheme of the operating personnel on the mobile terminal.
Judge whether the images of gestures effectively specifically includes when it is implemented, of the present invention：Judge that described first touches The similar probability of the characteristics of image of the characteristics of image typical touch control gesture corresponding with each operator scheme of gesture is controlled, when the probability Respectively less than default probability threshold value when, it is determined that the characteristics of image of first touch control gesture is invalid, otherwise, it determines described first The characteristics of image of touch control gesture is effective.
That is, the embodiment of the present invention passes through the characteristics of image of current touch control gesture is corresponding with each operator scheme typical The characteristics of image of touch control gesture carries out the rate of exchange, probability similar therebetween is judged, when the probability is respectively less than default probability threshold During value, it is determined that gesture effective image before deserving, otherwise, then the images of gestures is effective.
Specifically, the present invention can be directed to the image spy that each operator scheme sets a corresponding typical touch control gesture Sign, naturally it is also possible to the characteristics of image of multiple typical touch control gestures is set as desired for some or all operator schemes, The characteristics of image of the typical touch control gesture includes typical hand-type feature of corresponding operator scheme etc., according to the image of touch control gesture Feature is compared with the characteristics of image of default typical touch control gesture, it is determined that the two similar probability, for example, specifically comparing When, the touch control gesture picture that will be obtained according to touch control gesture information processing, by the touch control gesture picture and typical touch control gesture figure Typical touch control gesture feature as in is compared one by one, when not detecting typical touch control gesture image in touch control gesture picture In touch-control hand-type feature, then judge that the touch control gesture picture probability similar with the typical touch control gesture image by compared with is small, Conversely, then judge that the two similar probability is higher.
When it is implemented, methods described of the embodiment of the present invention may also include：The image of first touch control gesture is carried out Preserve, obtain touch control gesture image set, by learning to the touch control gesture image set, the image for establishing touch control gesture is special Corresponding relation between sign and operator scheme.
That is, the embodiment of the present invention is directed under different operator schemes, the touch-control of user's palm and backside touch screen The different characteristic for the image that region is formed, the touch control gesture image is preserved, touch control gesture image set is obtained, passes through Image recognition related algorithm is identified and classified to the different gesture features in touch control gesture image set, establishes touch control gesture figure The corresponding relation between gesture feature and operator scheme as in so that subsequently can accurately be obtained according to images of gestures current Operator scheme.
Accordingly, embodiments of the invention also provide a kind of computer-readable recording medium, the computer-readable storage Media storage has one or more program, one or more of programs can by one or more computing device, with Any mobile terminal touch control gesture recognition methods that previous embodiment provides is realized, therefore can also realize corresponding technology effect Fruit, have been carried out being described in detail above, here is omitted.
Optionally, in one embodiment of the invention, the program stored in computer-readable recording medium can be used for real Existing following steps：
First touch control gesture information of the mobile terminal on the first touch-screen is gathered at least once；
All first touch control gesture information of collection are handled, the image for obtaining the touch control gesture of operating personnel first is special Sign, the characteristics of image of first touch control gesture are used to identify first touch control gesture.
The computer-readable recording medium that embodiments of the invention provide, by gathering mobile terminal on the first touch-screen The first touch control gesture information, all first touch control gesture information of collection are handled, obtain the touch-control of operating personnel first The characteristics of image of gesture, by the characteristics of image of first touch control gesture accurately to identify first touch control gesture, this The method of invention is simple, and can accurately obtain the touch control gesture of mobile terminal, consequently facilitating operating personnel or user according to Touch control gesture carries out more preferable management and control to mobile terminal, and then greatly improves Consumer's Experience.
Specifically, the embodiment of the present invention is to be directed to computer-readable recording medium, according under different operator schemes, is used The touch control gesture image that the touch area of family palm and backside touch screen is formed takes on a different character, and passes through image recognition phase The algorithm of pass carries out touch control gesture information extraction to the touch control gesture image formed under different operation modes, is used with effective difference The presently used operator scheme in family, and then the operating system of mobile terminal is optimized accordingly, it is final to realize that lifting is used Experience at family.
It should be noted that method of the present invention can be used for technical staff, e.g., application developer, procedure operation Personnel etc., there are different spies by the touch control gesture image for gathering user's palm from the touch area of backside touch screen is formed Sign, the touch control gesture image formed under different operation modes is preserved by image recognition related algorithm, and carry out god Through network training, the presently used operator scheme of user can effectively be distinguished according to training result, and then to mobile terminal Operating system optimized accordingly, it is final to realize lifting Consumer's Experience.
In addition, method of the present invention can also be used in general user, according to collection user's palm and backside touch screen The touch control gesture image that is formed of touch area take on a different character, carried out with the operating system for realizing to mobile terminal excellent Change adjustment, it is final to realize lifting Consumer's Experience.
When it is implemented, operator scheme described in the embodiment of the present invention includes following at least one：The right hand is clicked on, is perpendicular under portrait layout Shield that bottom right rubber sleeve is dynamic, left hand is clicked on, portrait layout bottom left rubber sleeve is dynamic, left hand input, portrait layout under portrait layout under right hand input, portrait layout under portrait layout Lower both hands are clicked on, both hands are slided under portrait layout, the right hand is clicked under both hands input, transverse screen under portrait layout, transverse screen bottom right rubber sleeve is dynamic, under transverse screen Right hand input, left hand is clicked under transverse screen, transverse screen bottom left rubber sleeve is dynamic, under transverse screen under left hand input, transverse screen both hands click on, lower pair of transverse screen Rubber sleeve is dynamic to be inputted with both hands under transverse screen.Certainly, those skilled in the art can also set other operations according to being actually needed Pattern, to meet various different demands.
It should be noted that herein, term " comprising ", "comprising" or its any other variant are intended to non-row His property includes, so that process, method, article or device including a series of elements not only include those key elements, and And also include the other element being not expressly set out, or also include for this process, method, article or device institute inherently Key element.In the absence of more restrictions, the key element limited by sentence "including a ...", it is not excluded that including this Other identical element also be present in the process of key element, method, article or device.
The embodiments of the present invention are for illustration only, do not represent the quality of embodiment.
Through the above description of the embodiments, those skilled in the art can be understood that above-described embodiment side Method can add the mode of required general hardware platform to realize by software, naturally it is also possible to by hardware, but in many cases The former is more preferably embodiment.Based on such understanding, technical scheme is substantially done to prior art in other words Going out the part of contribution can be embodied in the form of software product, and the computer software product is stored in a storage medium In (such as ROM/RAM, magnetic disc, CD), including some instructions to cause a mobile terminal (can be mobile phone, computer, clothes Be engaged in device, air conditioner, or network equipment etc.) perform method described in each embodiment of the present invention.
Embodiments of the invention are described above in conjunction with figure, but the invention is not limited in above-mentioned specific reality Mode is applied, above-mentioned embodiment is only schematical, rather than restricted, and one of ordinary skill in the art exists Under the enlightenment of the present invention, in the case of present inventive concept and scope of the claimed protection is not departed from, many shapes can be also made Formula, these are belonged within the protection of the present invention.

Claims (10)

  1. A kind of 1. mobile terminal touch control gesture recognition methods, it is characterised in that including：
    First touch control gesture information of the mobile terminal on the first touch-screen is gathered at least once；
    All first touch control gesture information of collection are handled, obtain the characteristics of image of the touch control gesture of operating personnel first, The characteristics of image of first touch control gesture is used to identify first touch control gesture.
  2. 2. according to the method for claim 1, it is characterised in that it is described collection mobile terminal on the first touch-screen first Before touch control gesture information, in addition to：
    The display reminding information on the second touch-screen of the mobile terminal, the prompt message is guiding operating personnel in institute State the touch control gesture that corresponding operator scheme is carried out on mobile terminal.
  3. 3. according to the method for claim 1, it is characterised in that it is described collection mobile terminal on the first touch-screen first Touch control gesture information, is specifically included：
    The first touch control gesture information is gathered by the sensor on first touch-screen.
  4. 4. according to the method described in any one in claim 1-3, it is characterised in that all first touch-controls of described pair of collection Gesture information is handled, after obtaining the characteristics of image of the touch control gesture of operating personnel first, in addition to：
    Judge whether the characteristics of image of first touch control gesture is effective, if it is, the figure according to first touch control gesture As feature determines the operator scheme of the operating personnel on the mobile terminal.
  5. 5. according to the method for claim 4, it is characterised in that it is described judge first touch control gesture characteristics of image be It is no effective, specifically include：
    Judge the characteristics of image of the characteristics of image typical touch control gesture corresponding with each operator scheme of first touch control gesture Similar probability, when the probability is respectively less than default probability threshold value, it is determined that the characteristics of image of first touch control gesture without Effect, otherwise, it determines the characteristics of image of first touch control gesture is effective.
  6. 6. according to the method for claim 5, it is characterised in that the characteristics of image for determining first touch control gesture has After effect, in addition to：
    The image of first touch control gesture is preserved, obtains touch control gesture image set, by the touch control gesture figure Image set is learnt, the corresponding relation established between the characteristics of image of touch control gesture and operator scheme.
  7. 7. according to the method for claim 4, it is characterised in that the characteristics of image according to first touch control gesture is true After the fixed operator scheme of the operating personnel on the mobile terminal, in addition to：
    The operating system of the mobile terminal is adjusted according to the operator scheme, so that each function that the operating system is shown Layout is suitable to the current operation of operating personnel operator.
  8. 8. according to the method for claim 2, it is characterised in that
    The operator scheme includes following at least one：The right hand is clicked under portrait layout, portrait layout bottom right rubber sleeve is dynamic, the right hand is defeated under portrait layout Enter, left hand is clicked under portrait layout, portrait layout bottom left rubber sleeve is dynamic, both hands are clicked under left hand input, portrait layout under portrait layout, both hands are slided under portrait layout The right hand is clicked under both hands input, transverse screen under dynamic, portrait layout, transverse screen bottom right rubber sleeve is dynamic, left hand point under right hand input, transverse screen under transverse screen Hit, transverse screen bottom left rubber sleeve is dynamic, under transverse screen under left hand input, transverse screen both hands click on, under transverse screen both hands slide and transverse screen under both hands it is defeated Enter.
  9. 9. a kind of mobile terminal, it is characterised in that the mobile terminal includes processor, memory and communication bus；
    The communication bus is used to realize the connection communication between processor and memory；
    The processor is used to perform the computer instruction stored in memory, to realize any one of claim 1 to 8 A kind of mobile terminal touch control gesture recognition methods.
  10. A kind of 10. computer-readable recording medium, it is characterised in that the computer-readable recording medium storage have one or Multiple programs, one or more of programs can be by one or more computing devices, to realize in claim 1 to 8 A kind of mobile terminal touch control gesture recognition methods described in any one.
CN201710580450.6A 2017-07-17 2017-07-17 A kind of recognition methods of mobile terminal touch control gesture, mobile terminal and storage medium Pending CN107463326A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710580450.6A CN107463326A (en) 2017-07-17 2017-07-17 A kind of recognition methods of mobile terminal touch control gesture, mobile terminal and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710580450.6A CN107463326A (en) 2017-07-17 2017-07-17 A kind of recognition methods of mobile terminal touch control gesture, mobile terminal and storage medium

Publications (1)

Publication Number Publication Date
CN107463326A true CN107463326A (en) 2017-12-12

Family

ID=60546780

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710580450.6A Pending CN107463326A (en) 2017-07-17 2017-07-17 A kind of recognition methods of mobile terminal touch control gesture, mobile terminal and storage medium

Country Status (1)

Country Link
CN (1) CN107463326A (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108043020A (en) * 2017-12-29 2018-05-18 努比亚技术有限公司 Game gestural control method, dual-screen mobile terminal and computer readable storage medium
CN109561210A (en) * 2018-11-26 2019-04-02 努比亚技术有限公司 A kind of interaction regulation method, equipment and computer readable storage medium
CN109858524A (en) * 2019-01-04 2019-06-07 北京达佳互联信息技术有限公司 Gesture identification method, device, electronic equipment and storage medium
CN111090372A (en) * 2019-04-22 2020-05-01 广东小天才科技有限公司 Man-machine interaction method and electronic equipment
CN111580660A (en) * 2020-05-09 2020-08-25 清华大学 Operation triggering method, device, equipment and readable storage medium
CN114020192A (en) * 2021-09-18 2022-02-08 特斯联科技集团有限公司 Interaction method and system for realizing non-metal plane based on curved surface capacitor

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104182191A (en) * 2014-08-06 2014-12-03 深圳市同洲电子股份有限公司 Control method and control terminal for screen content
CN104898957A (en) * 2014-03-07 2015-09-09 中国移动通信集团公司 Method and device for controlling screen rotation, and user terminal
CN105786345A (en) * 2016-02-25 2016-07-20 周奇 Control method and device of screen display direction
CN106648419A (en) * 2016-11-16 2017-05-10 努比亚技术有限公司 Display processing method and device and terminal
CN106648427A (en) * 2016-11-29 2017-05-10 努比亚技术有限公司 Setting device and method for single hand mode of terminal

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104898957A (en) * 2014-03-07 2015-09-09 中国移动通信集团公司 Method and device for controlling screen rotation, and user terminal
CN104182191A (en) * 2014-08-06 2014-12-03 深圳市同洲电子股份有限公司 Control method and control terminal for screen content
CN105786345A (en) * 2016-02-25 2016-07-20 周奇 Control method and device of screen display direction
CN106648419A (en) * 2016-11-16 2017-05-10 努比亚技术有限公司 Display processing method and device and terminal
CN106648427A (en) * 2016-11-29 2017-05-10 努比亚技术有限公司 Setting device and method for single hand mode of terminal

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108043020A (en) * 2017-12-29 2018-05-18 努比亚技术有限公司 Game gestural control method, dual-screen mobile terminal and computer readable storage medium
CN109561210A (en) * 2018-11-26 2019-04-02 努比亚技术有限公司 A kind of interaction regulation method, equipment and computer readable storage medium
CN109858524A (en) * 2019-01-04 2019-06-07 北京达佳互联信息技术有限公司 Gesture identification method, device, electronic equipment and storage medium
CN109858524B (en) * 2019-01-04 2020-10-16 北京达佳互联信息技术有限公司 Gesture recognition method and device, electronic equipment and storage medium
US11163373B2 (en) 2019-01-04 2021-11-02 Beijing Dajia Internet Information Technology Co., Ltd. Method and electronic device of gesture recognition
CN111090372A (en) * 2019-04-22 2020-05-01 广东小天才科技有限公司 Man-machine interaction method and electronic equipment
CN111090372B (en) * 2019-04-22 2021-11-05 广东小天才科技有限公司 Man-machine interaction method and electronic equipment
CN111580660A (en) * 2020-05-09 2020-08-25 清华大学 Operation triggering method, device, equipment and readable storage medium
CN114020192A (en) * 2021-09-18 2022-02-08 特斯联科技集团有限公司 Interaction method and system for realizing non-metal plane based on curved surface capacitor
CN114020192B (en) * 2021-09-18 2024-04-02 特斯联科技集团有限公司 Interaction method and system for realizing nonmetal plane based on curved surface capacitor

Similar Documents

Publication Publication Date Title
CN107145293A (en) A kind of screenshot method, mobile terminal and storage medium
CN107562336A (en) A kind of method, equipment and computer-readable recording medium for controlling suspension ball
CN107357497A (en) A kind of multi-screen display method and mobile terminal
CN107613110A (en) Method, terminal and the computer-readable recording medium that adjustment terminal interface is shown
CN108037893A (en) A kind of display control method of flexible screen, device and computer-readable recording medium
CN107463326A (en) A kind of recognition methods of mobile terminal touch control gesture, mobile terminal and storage medium
CN107566721A (en) A kind of method for information display, terminal and computer-readable recording medium
CN107562353A (en) A kind of display interface control method, terminal and computer-readable recording medium
CN109213401A (en) Double-sided screen application icon method for sorting, mobile terminal and readable storage medium storing program for executing
CN107729298A (en) Screen occlusion area processing method, mobile terminal and computer-readable recording medium
CN107203305A (en) It is switched fast method, mobile terminal and the computer-readable recording medium of application
CN107844231A (en) A kind of interface display method, mobile terminal and computer-readable recording medium
CN107832397A (en) A kind of image processing method, device and computer-readable recording medium
CN107181700A (en) Control method, mobile terminal and the storage medium of application program for mobile terminal
CN107613100A (en) Application control method, terminal and computer-readable recording medium
CN107463324A (en) A kind of image display method, mobile terminal and computer-readable recording medium
CN107728921A (en) Interface content intelligent display method, mobile terminal and computer-readable recording medium
CN107272906A (en) Using many account display control methods and mobile terminal
CN107844232A (en) A kind of screen operator control method and mobile terminal, computer-readable recording medium
CN107688429A (en) Management method, mobile terminal and the computer-readable recording medium of application controls
CN107506039A (en) Mobile terminal, data transmission method and computer-readable storage medium
CN107168626A (en) A kind of information processing method, equipment and computer-readable recording medium
CN107229410A (en) Interactive operation method, mobile terminal and computer-readable recording medium
CN107809534A (en) A kind of control method, terminal and computer-readable storage medium
CN107526493A (en) A kind of small tool display methods, equipment and computer-readable recording medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20171212