CN106843669A - Application interface operating method and device - Google Patents
Application interface operating method and device Download PDFInfo
- Publication number
- CN106843669A CN106843669A CN201611109113.0A CN201611109113A CN106843669A CN 106843669 A CN106843669 A CN 106843669A CN 201611109113 A CN201611109113 A CN 201611109113A CN 106843669 A CN106843669 A CN 106843669A
- Authority
- CN
- China
- Prior art keywords
- application interface
- hanging type
- operating gesture
- gesture information
- control
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/04847—Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The embodiment of the present invention provides a kind of application interface operating method and device, and the method includes：Obtain the hanging type operating gesture information at current application interface；Generation control instruction corresponding with hanging type operating gesture information；Control current application interface performs control instruction.In this programme, existing application interface mode of operation is extended, corresponding hanging type operation logic is set for each application interface, be that the operation of user is provided convenience under some scenes to realize that the hanging type for application interface is operated.
Description
Technical field
The present invention relates to Internet technical field, more particularly to a kind of application interface operating method and device.
Background technology
For ease of the routine work of user, life, various demands of user are met, at present, user is in its such as intelligent hand
Various applications (APP) are often installed in the subscriber terminal equipments such as machine, panel computer.
It is various that current most subscriber terminal equipments all support that touch operation, i.e. user can be carried out on the touchscreen
Touch operation, various operations are carried out with to the control in the application interface, the application interface that are shown on screen.
The content of the invention
The mode of operation to application interface is realized by the touch operation to touch-screen at present.But, actually should
In, user probably due to speckle with the reasons such as spot on hand and inconvenient directly Touch screen is operated to application interface,
Accordingly, it would be desirable to extend current application interface mode of operation, correspondence can not be completed to solve the touching type operation under some scenes
With the problem of the operation at interface.
In view of this, the embodiment of the present invention provides a kind of application interface operating method and device, the behaviour at expanded application interface
Make mode so that user can operate the operation completed to application interface by hanging type.
The embodiment of the present invention provides a kind of application interface operating method, including：
Obtain the hanging type operating gesture information at current application interface；
Generation control instruction corresponding with the hanging type operating gesture information；
The current application interface is controlled to perform the control instruction.
Alternatively, generation control instruction corresponding with the hanging type operating gesture information, including：
In the current application interface, it is determined that control to be operated corresponding with the hanging type operating gesture information；
Generation control instruction corresponding with the control to be operated；
The control current application interface performs the control instruction, including：
The control to be operated is controlled to perform the control instruction.
Alternatively, determination control to be operated corresponding with the hanging type operating gesture information, including：
According to the corresponding gesture pattern of the hanging type operating gesture information, it is determined that with the hanging type operating gesture information
Corresponding control to be operated；
And/or, the hanging type operating gesture information includes operating position, the determination and the hanging type manipulator
The corresponding control to be operated of gesture information, including：
Control to be operated corresponding with the hanging type operating gesture information is determined according to the operating position.
Alternatively, it is described that control to be operated corresponding with the hanging type operating gesture information is determined according to the operating position
Part, including：
Obtain the positional information of each operational controls in the current application interface；
The identification mapping position of each operational controls on screen；
Determine that the operational controls that mapping position is matched with the operating position are the control to be operated.
Alternatively, methods described also includes：
Obtain the corresponding at least one effectively operating gesture information in the current application interface；
After the hanging type operating gesture information obtained for current application interface, also include：
Determine that the hanging type operating gesture information for getting is according at least one effective operating gesture information
It is no effective.
Alternatively, the corresponding at least one effectively operating gesture information in the acquisition current application interface, including：
Receive described at least one effectively operating gesture information that current application sends, at least one effectively manipulator
Gesture information is that the current application is obtained according to the mark at the current application interface.Alternatively, in response to current application circle
The displaying operation in face, triggers the current application and obtains at least one effectively operating gesture information.
The embodiment of the present invention provides a kind of application interface operation device, including：
First acquisition module, the hanging type operating gesture information for obtaining current application interface；
Generation module, for generating control instruction corresponding with the hanging type operating gesture information；
Control module, for controlling the current application interface to perform the control instruction.
Application interface operating method provided in an embodiment of the present invention and device, for certain application, when the application is opened
When opening and be shown to certain application interface, by gathering and hanging type operating gesture information for current application interface is recognized,
Generation control instruction corresponding with the hanging type operating gesture information, to control current application circle by way of being operated hanging type
Face performs the control instruction, completes corresponding function treatment logic.In this programme, existing application interface mode of operation is expanded
Exhibition, corresponding hanging type operation logic is set for each application interface, to realize that the hanging type for application interface is operated,
It is that the operation of user is provided convenience under some scenes.
Brief description of the drawings
In order to illustrate more clearly about the embodiment of the present invention or technical scheme of the prior art, below will be to embodiment or existing
The accompanying drawing to be used needed for having technology description is briefly described, it should be apparent that, drawings in the following description are this hairs
Some bright embodiments, for those of ordinary skill in the art, on the premise of not paying creative work, can be with root
Other accompanying drawings are obtained according to these accompanying drawings.
Fig. 1 is the flow chart of application interface operating method embodiment one provided in an embodiment of the present invention；
Fig. 2 is the flow chart of application interface operating method embodiment two provided in an embodiment of the present invention；
Fig. 3 is the structural representation of application interface operation device embodiment one provided in an embodiment of the present invention；
Fig. 4 is the structural representation of application interface operation device embodiment two provided in an embodiment of the present invention.
Specific embodiment
To make the purpose, technical scheme and advantage of the embodiment of the present invention clearer, below in conjunction with the embodiment of the present invention
In accompanying drawing, the technical scheme in the embodiment of the present invention is clearly and completely described, it is clear that described embodiment is
A part of embodiment of the present invention, rather than whole embodiments.Based on the embodiment in the present invention, those of ordinary skill in the art
The every other embodiment obtained under the premise of creative work is not made, belongs to the scope of protection of the invention.
The term for using in embodiments of the present invention is the purpose only merely for description specific embodiment, and is not intended to be limiting
The present invention." one kind ", " described " and " being somebody's turn to do " of singulative used in the embodiment of the present invention and appended claims
It is also intended to include most forms, unless context clearly shows that other implications, " various " generally comprise at least two, but not
Exclude and include at least one situation.
It should be appreciated that term "and/or" used herein is only a kind of incidence relation for describing affiliated partner, represent
There may be three kinds of relations, for example, A and/or B, can represent：Individualism A, while there is A and B, individualism B these three
Situation.In addition, character "/" herein, typicallys represent forward-backward correlation pair as if a kind of relation of "or".
It will be appreciated that though XXX may be described using term first, second, third, etc. in embodiments of the present invention, but
These XXX should not necessarily be limited by these terms.These terms are only used for being distinguished from each other open XXX.For example, not departing from implementation of the present invention
In the case of example scope, an XXX can also be referred to as the 2nd XXX, and similarly, the 2nd XXX can also be referred to as an XXX.
Depending on linguistic context, word as used in this " if ", " if " can be construed to " ... when " or
" when ... " or " in response to determining " or " in response to detection ".Similarly, depending on linguistic context, phrase " if it is determined that " or " such as
Fruit detection (condition or event of statement) " can be construed to " when it is determined that when " or " in response to determine " or " when detection (statement
Condition or event) when " or " in response to detection (condition or event of statement) ".
Also, it should be noted that term " including ", "comprising" or its any other variant be intended to nonexcludability
Comprising, so that commodity or system including a series of key elements not only include those key elements, but also including without clear and definite
Other key elements listed, or it is this commodity or the intrinsic key element of system also to include.In the feelings without more limitations
Under condition, the key element limited by sentence "including a ...", it is not excluded that in the commodity or system including the key element also
There is other identical element.
Fig. 1 is the flow chart of application interface operating method embodiment one provided in an embodiment of the present invention, and the present embodiment is provided
The application interface operating method can be performed by an application interface operation device, the application interface operation device can be realized
It is software, or is embodied as the combination of software and hardware, the application interface operation device can be integrally disposed in the terminal of user
In equipment, such as smart mobile phone, panel computer etc..As shown in figure 1, the method comprises the following steps：
Step 101, the hanging type operating gesture information for obtaining current application interface.
Step 102, generation control instruction corresponding with hanging type operating gesture information.
Step 103, control current application interface perform control instruction.
What deserves to be explained is, in the present embodiment, above-mentioned current application interface is currently to be opened certain for using by user to answer
Certain interface, the application is a kind of title method of broad sense, including the various APP installed in terminal device, also including such as table
The system-level application such as face.
With desktop application for this special application, when user starts shooting or triggers display desktop application by certain button
When, the interface comprising various application icons can be considered as the one kind at current application interface in the present embodiment.
For certain APP, when the icon that user clicks on the APP enters the homepage of the APP, the home interface is this implementation
The one kind at current application interface in example.
In practical application, one or more user's control operation logic is usually contained in different application interfaces and (or is claimed
It is control operation type), such as browse, select, switch.In the present embodiment, user can according to practical operation demand and
Control operation logic available to execute in currently displaying application interface, carries out certain operation by the way of hanging type.Such as,
User wishes to carry out the operation of interface switching --- and the interface of display is shown as second by the switching of the first application interface and applies boundary
Face, now, user can be by performing in the range of relative termination equipment certain distance certain angle such as from right to left
Action wave to carry out changing interface control operation.
The operating gesture with hanging type referred in the present embodiment to the executive control operation of current application interface, be relative to
Refer to not contact terminal, gesture control mode to current application for directly touch current application interface is controlled
Interface is controlled.
It is understood that the limitation of above-mentioned certain distance certain angle is in order at following two reasons：On the one hand, user
Trigger control operation gesture premise be that user sees current application interface so that the use demand based on itself and make and being directed to
The operating gesture at current application interface, now current application interface is in the visual range of user；Another aspect reason, due to
The control operation of family triggering is the operating gesture of hanging type, and the detection of the operating gesture triggered for user is often based on end
What camera integrally disposed in end equipment was realized.The shooting angle for preventing position and camera of terminal device is limited to,
User needs just be taken in a certain distance and range of operation angle to collect.
In addition what deserves to be explained is, it is provided in an embodiment of the present invention based on hanging type operate and realize application interface operation
Method, is directed to for application, and in order to support the hanging type to operate, needs to increase extra treatment logic in, than
As generation can in the corresponding application interface of above-mentioned application interface operation device to inform for the Action Events of each application interface
So which type of operating gesture etc. supported.But, in practice, all applications for being installed in the terminal device of user simultaneously differ
Establish a capital support hanging type operation, therefore, alternatively, for support hanging type operate application, when activated, can actively to
Application interface operation device sends an announcement information, is used with triggering application interface operation device triggering control camera collection
The hanging type operating gesture image at family, and then gesture identification is carried out by the image, to identify that corresponding hanging type is operated
Gesture information.
Alternatively, with reference to the facilities of camera in the terminal device of user, an at least width operating gesture can be gathered
Image, and then application interface operation device can carry out gesture recognition process by an at least width operating gesture image, obtain
Take corresponding hanging type operating gesture information.In practical application, in order to ensure the accuracy of recognition result, one can be continuously shot
The video image fixed time, it is outstanding to obtain by video image carrying out the image processing meanses such as picture frame cutting, image recognition
Empty formula operating gesture information.
Wherein, when such as two cameras are provided with terminal device, the shooting angle of different cameras is often different,
The recognition result of the image now clapped by comprehensive multiple camera, is obtained in that more careful, accurate hanging type operation
Gesture information.
In the present embodiment, hanging type operating gesture information can be including gesture pattern, movement locus, relative to terminal screen
One or more information content such as operating position.Wherein, gesture pattern is such as kneading operation gesture, horizontally slip manipulator
Gesture, slide up and down operating gesture, single indication and hit operating gesture, etc..
In order that the application for obtaining currently can respond the hanging type operational control of user, application interface operation device needs to exist
After obtaining hanging type operating gesture information, control instruction corresponding with the hanging type operating gesture information is generated, and then control to work as
Preceding application interface performs the control instruction, if the such as current corresponding control instruction of hanging type operating gesture information is interface
Switching command, then perform changing interface instruction, next application interface at switching display current application interface.
In practical application, can be set up for each application interface in advance and control store instruction and hanging type operating gesture
Corresponding relation between information, the determination and generation of control instruction are realized based on the corresponding relation.Specifically, in current application circle
When face is shown, current application can send the mark at current application interface to application interface operation device, so that, application interface
Control instruction and hanging type operating gesture information of the operation device according to corresponding to mark inquiry obtains the current application interface
Between corresponding relation, and then, obtain for current application interface hanging type operating gesture information after, based on this correspondence close
System, generates corresponding control instruction.
In the present embodiment, illustrated only by taking a kind of simple situation as an example, the explanation of other more detailed situations will be follow-up real
Apply explanation in example.Assuming that for for the current application interface of current application, only supporting a kind of control operation logic, such as interface
Handover operation, at this point it is possible to only identification images of gestures obtains the hanging type operating gesture information comprising gesture pattern, if the hand
Gesture pattern matches with gesture style characteristics corresponding with handover operation set in advance, then generate switching command, and control is current
Using the instruction is performed, the handover operation of respective interface is carried out.
In the present embodiment, for certain application, when the application is unlocked and is shown to certain application interface, by adopting
Collect and recognize the hanging type operating gesture information for current application interface, generate corresponding with the hanging type operating gesture information
Control instruction, to control current application interface to perform the control instruction by way of being operated hanging type, completes corresponding function
Treatment logic.In this programme, existing application interface mode of operation is extended, sets corresponding outstanding for each application interface
Empty formula operation logic, to realize that the hanging type for application interface is operated, under some scenes, for the operation of user is provided just
Profit.
Only only supporting a kind of control operation logic, and current application interface in current application interface in previous embodiment
The middle unique situation of control for performing a kind of control operation logic has been carried out for example, still in fact, much applying boundary
Various control operation logic has been usually contained in face, and possible many controls can carry out same control operation logic.
And what deserves to be explained is, in the present embodiment, hanging type operating gesture information be it is corresponding with current application interface, i.e.,
The hanging type operating gesture for being directed to current application interface and triggering, and, control instruction is and hanging type operating gesture information
It is corresponding, therefore, current application interface, hanging type operating gesture information and control instruction have correspondence, and this correspondence was both
It is required that the hanging type operating gesture of user's triggering is current application interface supporting, also require that the hanging type operating gesture corresponds to
It is unique it is a kind of this currently should the control operation logic that is able to carry out of interface.
Based on this, the different application interfaces of correspondence, the specific letter included needed for the hanging type operating gesture information of acquisition
Breath content can be with difference.Such as, if a kind of control operation logic is only supported at current application interface, and in current application interface
Only one control performs the control operation logic, then only need to identifying user whether trigger it is corresponding with the control operation logic
Hanging type operating gesture pattern；If several different control operation logics are only supported at current application interface, and are being worked as
Only one control is distinguished in preceding application interface and performs a kind of corresponding control operation logic, then only need to recognize the hand for collecting
Which kind of gesture pattern what is included in gesture image is；And if current application interface supports that one or more different controls are grasped
Make logic, and same control operation logic corresponding control in current application interface is not unique, then not only need identification
Which kind of gesture pattern what is included in the images of gestures for collecting is, in addition it is also necessary to which other are believed to recognize operating position of the operating gesture etc.
Breath content.
With reference to embodiment illustrated in fig. 2 to including multiple controls in current application interface, various control operation logic
Situation is illustrated.
Fig. 2 is the flow chart of application interface operating method embodiment two provided in an embodiment of the present invention, as shown in Fig. 2 should
Method comprises the following steps：
Step 201, the corresponding at least one effectively operating gesture information in acquisition current application interface.
Step 202, the hanging type operating gesture information for obtaining current application interface.
If step 203, the hanging type operating gesture information for determining to get according at least one effective operating gesture information
Effectively, then in current application interface, it is determined that control to be operated corresponding with hanging type operating gesture information.
Step 204, generation control instruction corresponding with control to be operated, control control to be operated to perform control instruction.
In the present embodiment, in order to avoid the control instruction of application interface operation device generation is not due to current application interface
Match and can not be effectively executed, when current application interface is demonstrated, application interface operation device can be deserved by obtaining
The corresponding effective operating gesture information of preceding application interface, current application interface is directed to as to the user that collection, identification are obtained
And the whether effective judgment basis of hanging type operating gesture information for triggering, when the hanging type operating gesture letter for judging user's triggering
Breath is not belonging to the corresponding effective operating gesture information in current application interface for the moment, without generating control instruction.
Alternatively, application interface operation device can in the following way obtain the corresponding at least one in current application interface
Effective operating gesture information：
Current application is operated in response to the displaying at current application interface, is obtained according to current application interface identification and corresponded to therewith
At least one effectively operating gesture information, and at least one that will be obtained effectively operating gesture information sent to application interface behaviour
Make device.
That is, the corresponding pass being associated with advance between each application interface and effective operating gesture information
System, when certain application interface is demonstrated, using the corresponding effective operating gesture information of active obtaining, and actively informs to application
Interface operating device.
Wherein, the corresponding relation between operational controls and gesture pattern can be included in every kind of effective operating gesture information,
All gesture patterns that current application interface is supported can simply be included.
Therefore, whether effectively judge for the hanging type operating gesture information that user triggers, can be triggered according to user
The corresponding gesture pattern of hanging type operating gesture information whether belong to one of effective operating gesture pattern and determine, gesture pattern
Whether same or analogous identification carries out to images of gestures aspect ratio to realizing, based on conventional images treatment technology
Realize, do not repeated in the present embodiment.
Optionally it is determined that control to be operated corresponding with hanging type operating gesture information, it is possible to achieve be：
According to the corresponding gesture pattern of hanging type operating gesture information, it is determined that corresponding with hanging type operating gesture information treat
Operational controls, and/or, when hanging type operating gesture information includes operating position, can also according to the operating position determine with
The corresponding control to be operated of hanging type operating gesture information.
Under a kind of scene, it is assumed that show every kind of operation in effective operating gesture information that application interface operation device is obtained
Gesture pattern only to that should have an operational controls, now, it is only necessary to identifying user triggering hanging type operating gesture information in
Whether operating gesture pattern operates effectively gesture pattern matching with one kind, so that, the effective operating gesture sample for matching
The corresponding operational controls of formula are control to be operated.
But, under another scene, if comprising the multiple corresponding to same operational control logic in current application interface
Operational controls, such as multiple select buttons, when this multiple select button can be clicked selection, that is, have multiple select buttons pair
Should in click on gesture pattern when, active user triggering click gesture operation be directed to actually which select button, it is necessary to enter
Row determines.
Now, certain operating gesture pattern is shown in effective operating gesture information that even application interface operation device is obtained
To that there should be multiple operational controls, then the operation relative to terminal device screen during with reference to user's triggering hanging type operating gesture is needed
Position carries out the determination of control to be operated.Therefore, it is right not only to be included in the hanging type operating gesture information of now user's triggering
The gesture pattern answered, in addition it is also necessary to including corresponding operating position.
Specifically, determined according to operating position in hanging type operating gesture information corresponding with the hanging type operating gesture information
Control to be operated, it is possible to achieve be：
Obtain the positional information of each operational controls in current application interface；
Recognize mapping position of each operational controls on screen；
Determine that the operational controls that mapping position is matched with operating position in hanging type operating gesture information are control to be operated.
Alternatively, at least one effectively operation for current application interface is reported to application interface operation device in application
During gesture information, the corresponding relation of gesture pattern and operational controls can be included in every kind of effective operating gesture information, the correspondence
Description in relation to operational controls can realize that the position is believed by the description to the corresponding positional information of the operational controls
Breath can be the corresponding pixel point coordinates of the operational controls.So as to application interface operation device is based at least one and effectively grasps
The positional information of each operational controls of information acquisition of making a sign with the hand.
It is understood that the operating position included in the hanging type operating gesture information of user's triggering can be considered as user
To the mapping on terminal device screen, what the operating position was characterized is relative to the position of terminal device screen to finger during operation.
The corresponding operating position of hanging type operating gesture for the ease of determining user's triggering is corresponding with which operational controls, a kind of mode
In, can be mapped on screen according to the pixel point coordinates of each operational controls in current application interface, obtain each operation control
Mapping position of the part on screen, such as certain operational controls are mapped in certain band of position.In another way, it is also possible to
The corresponding operating position of user is mapped as the pixel point coordinates relative to screen, and then according to pixel matching degree, it is determined that
Corresponding operational controls.
After the corresponding control to be operated of user's operation is defined, generate control corresponding with control to be operated and refer to
Order, controls control to be operated to perform control instruction, such as the control to be operated can be the control for being clicked selection, user's triggering
Hanging type operating gesture information in corresponding gesture pattern for click on gesture pattern, then generate selection instruction, perform the instruction,
Control to be operated is placed in selected state, and performs the control logic after being selected, such as into another application interface.
In the present embodiment, application interface operation device is corresponding with current application interface based on what is obtained from current application
Whether effective operating gesture information, the hanging type operating gesture information of the user's triggering that can be obtained to collection, identification is effectively entered
Row judges, it is to avoid the follow-up redundancy treatment to invalid operation；Operating position based on the hanging type operating gesture triggered to user
Identification, can accurately determine the targeted operational controls in current application interface of current operation, realized to behaviour with accurate
Make the hanging type operation of control so that hanging type operation can be more applicable for various application control operations.
The application interface operation device of one or more embodiments of the invention described in detail below.These application interfaces
Operation device can be implemented in the architecture of terminal device.It will be understood by those skilled in the art that these application interfaces
The step of operation device can be used commercially available nextport hardware component NextPort to be instructed by this programme is configured to constitute.
Fig. 3 is the structural representation of application interface operation device embodiment one provided in an embodiment of the present invention, such as Fig. 3 institutes
Show, the application interface operation device includes：First acquisition module 11, generation module 12, control module 13.
First acquisition module 11, the hanging type operating gesture information for obtaining current application interface.
Generation module 12, for generating control instruction corresponding with the hanging type operating gesture information.
Control module 13, for controlling the current application interface to perform the control instruction.
Wherein, first acquisition module 11 specifically for：
Acquisition operations images of gestures；
By carrying out gesture recognition process to the operating gesture image, the hanging type operating gesture information is obtained.
The method that Fig. 3 shown devices can perform embodiment illustrated in fig. 1, the part that the present embodiment is not described in detail can join
Examine the related description to embodiment illustrated in fig. 1.In implementation procedure and the technique effect embodiment shown in Figure 1 of the technical scheme
Description, will not be repeated here.
Fig. 4 is the structural representation of application interface operation device embodiment two provided in an embodiment of the present invention, such as Fig. 4 institutes
Show, on the basis of embodiment illustrated in fig. 3, application interface operation device also includes：Second acquisition module 21, determining module 22.
Second acquisition module 21, for obtaining the corresponding at least one effectively operating gesture letter in the current application interface
Breath.
Determining module 22, for the hanging type for determining to get according at least one effective operating gesture information
Whether operating gesture information is effective.
Wherein, second acquisition module 21 specifically for：
Receive described at least one effectively operating gesture information that current application sends, at least one effectively manipulator
Gesture information is that the current application is obtained according to the mark at the current application interface.
Specifically, the generation module 12 includes：Determining unit 121, generation unit 122.
Determining unit 121, in the current application interface, it is determined that corresponding with the hanging type operating gesture information
Control to be operated
Generation unit 122, for generating control instruction corresponding with the control to be operated.
The control module 13 specifically for：The control to be operated is controlled to perform the control instruction.
Alternatively, the determining unit 121 is used for：
According to the corresponding gesture pattern of the hanging type operating gesture information, it is determined that with the hanging type operating gesture information
Corresponding control to be operated；
And/or, control to be operated corresponding with the hanging type operating gesture information is determined according to operating position, it is described outstanding
Empty formula operating gesture information includes the operating position.
Specifically, the determining unit 121 specifically for：
Obtain the positional information of each operational controls in the current application interface；
The identification mapping position of each operational controls on screen；
Determine that the operational controls that mapping position is matched with the operating position are the control to be operated.
The method that Fig. 4 shown devices can perform embodiment illustrated in fig. 2, the part that the present embodiment is not described in detail can join
Examine the related description to embodiment illustrated in fig. 2.In implementation procedure and the technique effect embodiment shown in Figure 2 of the technical scheme
Description, will not be repeated here.
The built-in function and structure of application interface operation device are the foregoing described, in practice, the application interface operation device
It is terminal device to be capable of achieving, including：Camera, display screen, processor；
The display screen, for showing current application interface；
The camera, the hanging type operating gesture image for gathering current application interface；
The processor, is coupled to the camera, for recognizing described image, obtains for the outstanding of current application interface
Empty formula operating gesture information, generates control instruction corresponding with the hanging type operating gesture information, controls the current application
Interface performs the control instruction.
The display screen, is coupled to the processor, is additionally operable in the case where the processor is controlled, and display performs the control
Application interface after instruction.
Alternatively, the processor is additionally operable to perform all or part of step in method and step shown in above-mentioned Fig. 1, Fig. 2.
Device embodiment described above is only schematical, wherein the unit illustrated as separating component can
To be or may not be physically separate, the part shown as unit can be or may not be physics list
Unit, you can with positioned at a place, or can also be distributed on multiple NEs.It can according to the actual needs be selected
In some or all of module realize the purpose of this embodiment scheme.Those of ordinary skill in the art are not paying creativeness
Work in the case of, you can to understand and implement.
Through the above description of the embodiments, those skilled in the art can be understood that each implementation method can
Realized by the mode of general hardware platform necessary to add, naturally it is also possible to by hardware.Based on such understanding, above-mentioned skill
The part that art scheme substantially contributes to prior art in other words can be embodied in the form of product, and the computer is produced
Product can be stored in a computer-readable storage medium, and such as ROM/RAM, magnetic disc, CD, including some instructions are used to so that one
Platform computer installation (can be personal computer, server, or network equipment etc.) performs each embodiment or embodiment
Some parts described in method.
Finally it should be noted that：The above embodiments are merely illustrative of the technical solutions of the present invention, rather than its limitations；Although
The present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those within the art that：It still may be used
Modified with to the technical scheme described in foregoing embodiments, or equivalent is carried out to which part technical characteristic；
And these modification or replace, do not make appropriate technical solution essence depart from various embodiments of the present invention technical scheme spirit and
Scope.
Claims (14)
1. a kind of application interface operating method, it is characterised in that including：
Obtain the hanging type operating gesture information at current application interface；
Generation control instruction corresponding with the hanging type operating gesture information；
The current application interface is controlled to perform the control instruction.
2. method according to claim 1, it is characterised in that the generation is corresponding with the hanging type operating gesture information
Control instruction, including：
In the current application interface, it is determined that control to be operated corresponding with the hanging type operating gesture information；
Generation control instruction corresponding with the control to be operated；
The control current application interface performs the control instruction, including：
The control to be operated is controlled to perform the control instruction.
3. method according to claim 2, it is characterised in that the determination is corresponding with the hanging type operating gesture information
Control to be operated, including：
According to the corresponding gesture pattern of the hanging type operating gesture information, it is determined that corresponding with the hanging type operating gesture information
Control to be operated；
And/or, the hanging type operating gesture information includes operating position, and the determination is believed with the hanging type operating gesture
Corresponding control to be operated is ceased, including：
Control to be operated corresponding with the hanging type operating gesture information is determined according to the operating position.
4. method according to claim 3, it is characterised in that described to be determined according to the operating position and the hanging type
The corresponding control to be operated of operating gesture information, including：
Obtain the positional information of each operational controls in the current application interface；
The identification mapping position of each operational controls on screen；
Determine that the operational controls that mapping position is matched with the operating position are the control to be operated.
5. method according to any one of claim 1 to 4, it is characterised in that methods described also includes：
Obtain the corresponding at least one effectively operating gesture information in the current application interface；
After the hanging type operating gesture information for obtaining current application interface, also include：
Determine whether the hanging type operating gesture information for getting has according at least one effective operating gesture information
Effect.
6. method according to claim 5, it is characterised in that the acquisition current application interface corresponding at least
Effective operating gesture information is planted, including：
Receive described at least one effectively operating gesture information that current application sends, at least one effectively operating gesture letter
Breath is that the current application is obtained according to the mark at the current application interface.
7. method according to any one of claim 1 to 4, it is characterised in that the acquisition is directed to current application interface
Hanging type operating gesture information, including：
Acquisition operations images of gestures；
By carrying out gesture recognition process to the operating gesture image, the hanging type operating gesture information is obtained.
8. a kind of application interface operation device, it is characterised in that including：
First acquisition module, the hanging type operating gesture information for obtaining current application interface；
Generation module, for generating control instruction corresponding with the hanging type operating gesture information；
Control module, for controlling the current application interface to perform the control instruction.
9. device according to claim 8, it is characterised in that the generation module includes：
Determining unit, in the current application interface, it is determined that corresponding with the hanging type operating gesture information wait to grasp
Make control；
Generation unit, for generating control instruction corresponding with the control to be operated；
The control module specifically for：The control to be operated is controlled to perform the control instruction.
10. device according to claim 9, it is characterised in that the determining unit is used for：
According to the corresponding gesture pattern of the hanging type operating gesture information, it is determined that corresponding with the hanging type operating gesture information
Control to be operated；
And/or, control to be operated corresponding with the hanging type operating gesture information, the hanging type are determined according to operating position
Operating gesture information includes the operating position.
11. devices according to claim 10, it is characterised in that the determining unit specifically for：
Obtain the positional information of each operational controls in the current application interface；
The identification mapping position of each operational controls on screen；
Determine that the operational controls that mapping position is matched with the operating position are the control to be operated.
12. device according to any one of claim 8 to 11, it is characterised in that also include：
Second acquisition module, for obtaining the corresponding at least one effectively operating gesture information in the current application interface；
Determining module, for the hanging type manipulator for determining to get according at least one effective operating gesture information
Whether gesture information is effective.
13. devices according to claim 12, it is characterised in that second acquisition module specifically for：
Receive described at least one effectively operating gesture information that current application sends, at least one effectively operating gesture letter
Breath is that the current application is obtained according to the mark at the current application interface.
14. device according to any one of claim 8 to 11, it is characterised in that first acquisition module is specifically used
In：
Acquisition operations images of gestures；
By carrying out gesture recognition process to the operating gesture image, the hanging type operating gesture information is obtained.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611109113.0A CN106843669A (en) | 2016-12-06 | 2016-12-06 | Application interface operating method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611109113.0A CN106843669A (en) | 2016-12-06 | 2016-12-06 | Application interface operating method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106843669A true CN106843669A (en) | 2017-06-13 |
Family
ID=59146235
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611109113.0A Pending CN106843669A (en) | 2016-12-06 | 2016-12-06 | Application interface operating method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106843669A (en) |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107678613A (en) * | 2017-09-01 | 2018-02-09 | 珠海市魅族科技有限公司 | A kind of display control method and device, terminal and readable storage medium storing program for executing |
| CN107870722A (en) * | 2017-09-27 | 2018-04-03 | 努比亚技术有限公司 | Document transmission method, mobile terminal and the computer-readable recording medium of terminal room |
| CN108932090A (en) * | 2018-05-29 | 2018-12-04 | 北京小米移动软件有限公司 | terminal control method, device and storage medium |
| CN108958844A (en) * | 2018-07-13 | 2018-12-07 | 京东方科技集团股份有限公司 | A kind of control method and terminal of application program |
| CN109358909A (en) * | 2018-08-28 | 2019-02-19 | 努比亚技术有限公司 | Show page control method, terminal and computer readable storage medium |
| CN110045819A (en) * | 2019-03-01 | 2019-07-23 | 华为技术有限公司 | A kind of gesture processing method and equipment |
| CN110557346A (en) * | 2018-06-01 | 2019-12-10 | 弘真科技股份有限公司 | Wireless audio-video transmission system and method |
| CN111506245A (en) * | 2020-04-27 | 2020-08-07 | 北京小米松果电子有限公司 | Terminal control method and device |
| CN112154402A (en) * | 2019-08-29 | 2020-12-29 | 深圳市大疆创新科技有限公司 | Wearable device, control method thereof, gesture recognition method and control system |
| CN112825013A (en) * | 2019-11-20 | 2021-05-21 | 百度在线网络技术（北京）有限公司 | Control method and device of terminal equipment |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120256831A1 (en) * | 2011-04-07 | 2012-10-11 | Seiko Epson Corporation | Cursor display device and cursor display method |
| CN103838486A (en) * | 2014-03-21 | 2014-06-04 | 深圳市金立通信设备有限公司 | Operation method and terminal for terminal display page |
| CN104216642A (en) * | 2014-08-21 | 2014-12-17 | 深圳市金立通信设备有限公司 | Terminal control method |
| CN104656903A (en) * | 2015-03-04 | 2015-05-27 | 联想(北京)有限公司 | Processing method for display image and electronic equipment |
| CN105630364A (en) * | 2014-10-29 | 2016-06-01 | 联想(北京)有限公司 | Information processing method and electronic device |
| CN106126064A (en) * | 2016-06-24 | 2016-11-16 | 乐视控股（北京）有限公司 | A kind of information processing method and equipment |
-
2016
- 2016-12-06 CN CN201611109113.0A patent/CN106843669A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120256831A1 (en) * | 2011-04-07 | 2012-10-11 | Seiko Epson Corporation | Cursor display device and cursor display method |
| CN103838486A (en) * | 2014-03-21 | 2014-06-04 | 深圳市金立通信设备有限公司 | Operation method and terminal for terminal display page |
| CN104216642A (en) * | 2014-08-21 | 2014-12-17 | 深圳市金立通信设备有限公司 | Terminal control method |
| CN105630364A (en) * | 2014-10-29 | 2016-06-01 | 联想(北京)有限公司 | Information processing method and electronic device |
| CN104656903A (en) * | 2015-03-04 | 2015-05-27 | 联想(北京)有限公司 | Processing method for display image and electronic equipment |
| CN106126064A (en) * | 2016-06-24 | 2016-11-16 | 乐视控股（北京）有限公司 | A kind of information processing method and equipment |
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107678613A (en) * | 2017-09-01 | 2018-02-09 | 珠海市魅族科技有限公司 | A kind of display control method and device, terminal and readable storage medium storing program for executing |
| CN107870722A (en) * | 2017-09-27 | 2018-04-03 | 努比亚技术有限公司 | Document transmission method, mobile terminal and the computer-readable recording medium of terminal room |
| CN108932090A (en) * | 2018-05-29 | 2018-12-04 | 北京小米移动软件有限公司 | terminal control method, device and storage medium |
| CN110557346A (en) * | 2018-06-01 | 2019-12-10 | 弘真科技股份有限公司 | Wireless audio-video transmission system and method |
| CN108958844A (en) * | 2018-07-13 | 2018-12-07 | 京东方科技集团股份有限公司 | A kind of control method and terminal of application program |
| CN108958844B (en) * | 2018-07-13 | 2021-09-03 | 京东方科技集团股份有限公司 | Application program control method and terminal |
| CN109358909A (en) * | 2018-08-28 | 2019-02-19 | 努比亚技术有限公司 | Show page control method, terminal and computer readable storage medium |
| CN110045819A (en) * | 2019-03-01 | 2019-07-23 | 华为技术有限公司 | A kind of gesture processing method and equipment |
| CN110045819B (en) * | 2019-03-01 | 2021-07-09 | 华为技术有限公司 | Gesture processing method and device |
| CN112154402A (en) * | 2019-08-29 | 2020-12-29 | 深圳市大疆创新科技有限公司 | Wearable device, control method thereof, gesture recognition method and control system |
| WO2021035646A1 (en) * | 2019-08-29 | 2021-03-04 | 深圳市大疆创新科技有限公司 | Wearable device and control method therefor, gesture recognition method, and control system |
| US11782514B2 (en) | 2019-08-29 | 2023-10-10 | SZ DJI Technology Co., Ltd. | Wearable device and control method thereof, gesture recognition method, and control system |
| CN112825013A (en) * | 2019-11-20 | 2021-05-21 | 百度在线网络技术（北京）有限公司 | Control method and device of terminal equipment |
| CN111506245A (en) * | 2020-04-27 | 2020-08-07 | 北京小米松果电子有限公司 | Terminal control method and device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106843669A (en) | Application interface operating method and device | |
| KR101292467B1 (en) | Virtual controller for visual displays | |
| CN105940365B (en) | A kind of notification information processing method, device and terminal | |
| CN1126021C (en) | Apparatus and method for moving objects on touchscreen display | |
| CN103197885B (en) | The control method and its mobile terminal of mobile terminal | |
| US20060209021A1 (en) | Virtual mouse driving apparatus and method using two-handed gestures | |
| CN108616712B (en) | Camera-based interface operation method, device, equipment and storage medium | |
| US20140132515A1 (en) | System and method for inputting user commands to a processor | |
| CN106415472A (en) | Gesture control method, device, terminal apparatus and storage medium | |
| CN112099707A (en) | Display method and device and electronic equipment | |
| US20210081029A1 (en) | Gesture control systems | |
| CN107797722A (en) | Touch screen icon selection method and device | |
| CN105786245A (en) | Operating control method and device for touch screen | |
| CN112433693B (en) | Split screen display method and device and electronic equipment | |
| WO2020220154A1 (en) | Screen display switching method, display device, and movable platform | |
| CN111857136A (en) | Target map processing method and device | |
| CN107870705A (en) | A kind of change method and device of the picture mark position of application menu | |
| CN105824401A (en) | Mobile terminal control method and mobile terminal thereof | |
| CN105786321B (en) | A kind of function switching method and device | |
| EP4155891A1 (en) | Device control method and apparatus, and storage medium and electronic device | |
| CN109885232A (en) | The control method of data input device, apparatus and system | |
| CN113721808A (en) | Control method and device | |
| WO2023169499A1 (en) | Single-hand control method and control apparatus for touch screen, electronic device, and storage medium | |
| CN109739422B (en) | Window control method, device and equipment | |
| CN105912158A (en) | Touch-screen photographing method, device for mobile terminal and mobile terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: 100085 Beijing, Haidian District on the road to the information on the ground floor of the 1 to the 3 floor of the 2 floor, room 11, 202 Applicant after: Beijing Xingxuan Technology Co.,Ltd. Address before: 100085 Beijing, Haidian District on the road to the information on the ground floor of the 1 to the 3 floor of the 2 floor, room 11, 202 Applicant before: Beijing Xiaodu Information Technology Co.,Ltd. |
|
| CB02 | Change of applicant information | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170613 |
|
| RJ01 | Rejection of invention patent application after publication |