WO2015176358A1

WO2015176358A1 - Method for operating application program based on gesture, terminal and storage medium

Info

Publication number: WO2015176358A1
Application number: PCT/CN2014/081140
Authority: WO
Inventors: 陈斌
Original assignee: 深圳市中兴微电子技术有限公司
Priority date: 2014-05-19
Filing date: 2014-06-30
Publication date: 2015-11-26
Also published as: CN105094659A

Abstract

A method for operating an application program based on a gesture. The method comprises: setting at least one preset gesture, wherein the setting manner is: setting a corresponding preset gesture for one operation of one application program in a preset scenario; when running in the preset scenario, monitoring and recognizing gesture information about a user; and when the gesture information matches a preset gesture in the preset scenario, executing a corresponding operation on a corresponding application program. Also disclosed at the same time is a terminal.

Description

Method, terminal and storage medium for operating an application based on gestures

The present invention relates to the field of communications, and in particular, to a method, a terminal, and a computer storage medium for operating an application based on gestures. Background technique

With the popularity of smart terminals, people are increasingly demanding smart terminals. For the problem of operating an application in a smart terminal, a mobile terminal with a touch screen will be described as an example. Currently, in the case that the mobile terminal is black (also can be said to be dormant), if you need to open the application in the mobile terminal, you need to light up the display, then unlock, find the corresponding application, and then open. This method is very cumbersome and reduces the user experience. In order to enable the user to quickly open an application, the invention proposes to open the corresponding application by shaking the mobile phone, but this method also requires the user to light the display first. In this way, only one application can be opened. If the user wants to open other applications, it is also necessary to light up the display first, then unlock it, and then find the application that needs to be opened. As you can see, the way you open an application is very cumbersome. Similarly, if the user needs to close an application, the operation is cumbersome. The user needs to click the function key on the interface where the application is running, and then select to close; or close the application on the interface of the running program. It can be seen that the existing method of closing the application is also very cumbersome. Because of the cumbersome operation, after opening the application, the user generally does not close the application, but lets it run in the background, which increases the load on the terminal. Invisibly, the terminal speed is reduced. In summary, the existing operations on the applications in the terminal are cumbersome. Summary of the invention

In order to solve the existing technical problems, an embodiment of the present invention provides a method, a terminal, and a computer storage medium for operating an application based on a gesture, which can be solved in a terminal. The operation of the application is rather cumbersome.

The technical solution of the embodiment of the present invention is implemented as follows:

An embodiment of the present invention provides a method for operating an application based on a gesture, where the method includes:

Setting at least one preset gesture, the preset gesture is used to trigger a corresponding operation on the application; the setting manner is: setting a corresponding preset gesture for an operation of an application in a preset scene;

Monitor and recognize the user's gesture information when running in a preset scene;

When it is recognized that the gesture information matches a preset gesture in the executed preset scene, a corresponding operation is performed on the corresponding application.

In the above scheme,

Setting a different preset gesture for the same operation of different applications in a preset scenario; identifying that the gesture information matches a preset gesture in the executed preset scenario, including: identifying the gesture information Matching one of the at least one preset gesture set for the preset scene being run;

The performing the corresponding operations on the corresponding application includes:

A corresponding operation is performed on a corresponding application of the preset gesture matching the gesture information. In the above scheme,

Setting a different preset gesture for opening operations of different applications in a black screen scenario; monitoring and recognizing gesture information of the user to the terminal when running in the black screen scenario; identifying the gesture information as a black screen scenario When one of the preset preset gestures matches,

Trigger the display to brighten, unlock, and open the application that corresponds to the matching preset gesture.

In the above scheme, Setting the same preset gesture for the same operation of different applications in the same preset scenario; when running in the preset scenario, monitoring and identifying the gesture information of the user to the terminal; identifying the gesture information and running After a preset gesture in the preset scene is matched, the method further includes:

Identify the applications that need to be operated;

Perform the corresponding operations on the application that needs to operate.

In the above scheme,

In the scenario where the application is running, set the same preset gesture for the closing operation of the running application;

When running in the preset scenario, monitoring and identifying the gesture information of the user to the terminal; identifying that the gesture information matches a preset gesture in the running preset scenario, determining that the current operation is in the foreground application;

Using the identified application as an application that needs to be operated;

Close the identified application.

In the above solution, the gesture information includes at least one of the following: a touch operation of the user in the touch recognition area of the terminal, and a gesture operation of the user in the image recognition area of the terminal.

The embodiment of the present invention further provides a terminal, where the terminal includes: a setting module, a monitoring identification module, and an execution module;

The setting module is configured to set at least one preset gesture, where the preset gesture is used to trigger a corresponding operation on the application; wherein, in a preset scenario, a preset is set corresponding to an operation of an application. Gesture

The monitoring and identifying module, when configured to be in a preset scenario, monitors and recognizes the gesture information of the user; and when the gesture information is matched with a preset gesture in the preset scenario, the execution is triggered. Module The execution module is configured to perform a corresponding operation on the corresponding application. In the above solution, the setting module includes a first setting submodule, and the executing module includes a first executing submodule;

The first setting sub-module is configured to set different preset gestures corresponding to the same operation of different applications in a preset scenario;

Correspondingly, the monitoring and identifying module is configured to monitor and identify the gesture information of the user in the preset scenario; and identify the gesture information and one of the at least one preset gesture set for the preset scene. When the gestures match, the first execution sub-module is triggered;

The first execution submodule is configured to perform a corresponding operation on a corresponding application of the preset gesture that matches the gesture information.

In the above scheme,

The first setting sub-module is configured to set different preset gestures corresponding to opening operations of different applications in a scenario with a black screen;

Correspondingly, the monitoring and identifying module is configured to monitor and recognize the gesture information of the user in the black screen scenario; and identify that the gesture information matches one of the preset gestures of the at least one preset gesture set for the black screen scene , triggering the first execution submodule;

The first execution sub-module is configured to trigger the display to brighten, unlock, and open an application corresponding to the matched preset gesture.

In the above scheme,

The setting module includes a second setting submodule, where the executing module includes a second executing submodule;

The second setting sub-module is configured to set the same preset gesture for the same operation of different applications in the same preset scenario;

Correspondingly, the monitoring and identifying module is configured to monitor and identify the gesture information of the user when the preset scene is configured; and the gesture information is matched with a preset gesture in the preset scene. When the timing is matched, the second execution submodule is triggered;

The second execution submodule is configured to determine an application that needs to be operated; and perform an operation on the application that needs to operate.

In the above scheme,

a second setting sub-module configured to set the same preset gesture for the closing operation of the running application in a scenario in which the application is running;

The monitoring and identifying module is configured to monitor and identify the gesture information of the user in the scenario; and when the gesture information is matched with a preset gesture in the at least one preset gesture set for the scene, triggering Second execution submodule;

The second execution submodule is configured to determine an application currently running in the foreground, and close the determined application.

The embodiment of the invention further provides a computer storage medium, wherein the computer storage medium stores computer executable instructions, and the computer executable instructions are used to execute the foregoing method for operating an application based on a gesture.

A method, a terminal, and a computer storage medium for operating an application based on a gesture according to an embodiment of the present invention, the method includes: setting at least one preset gesture, the setting manner is: one for an application in a preset scenario The trigger of the operation sets a corresponding preset gesture; when running in a preset scene, monitors and recognizes the gesture information of the user; when it is recognized that the gesture information is related to a preset gesture in the preset scene that is running When matching, perform the corresponding action on the corresponding application. The technical solution provided by the embodiment of the present invention combines the gesture performed by the user on the terminal with the operation of the application, so that the user can perform the operation on the application only by performing gestures on the terminal, which can be solved in the prior art. The cumbersome operation of the application in the terminal eliminates the need for other cumbersome steps and simplifies the user's operation on the application. DRAWINGS

1 is a schematic flowchart of a method for operating an application based on a gesture according to a first embodiment of the present invention;

2 is a schematic flowchart of a method for operating an application based on a gesture according to Embodiment 2 of the present invention;

FIG. 3 is a schematic structural diagram of a terminal according to Embodiment 3 of the present invention. detailed description

The present invention will be further described in detail below with reference to the accompanying drawings.

Embodiment 1:

FIG. 1 is a schematic flowchart of a method for operating an application based on a gesture according to a first embodiment of the present invention; as shown in FIG. 1, the method includes the following steps:

Step S101: Set at least one preset gesture, where the preset gesture is used to trigger a corresponding operation on the application; the setting manner is: setting a corresponding preset gesture for an operation of an application in a preset scenario. ;

In this embodiment, the preset gesture is used to trigger an operation on an application in the terminal; for example, in a preset gesture, the user may select a preset gesture as a certain opening in a black screen scene of the terminal. For the operation of the application, other preset gestures can also be selected as the operation to close the application.

Step S102: When running in a preset scenario, monitoring and identifying gesture information of the user; the gesture information includes at least one of the following: a touch operation of the user in the touch recognition area of the terminal, and a gesture of the user in the image recognition area of the terminal operating. The touch recognition area of the terminal includes a touch screen of a smartphone and a tablet that are now commonly seen, and a touch area provided on the terminal for touch only without a display screen. The image recognition area of the terminal includes an area that the camera of the terminal can recognize, and the terminal can recognize a simple gesture operation performed by the user in the image recognition area.

Step S103: When the gesture information matches a preset gesture in the running preset scene When it is timed, the corresponding operation is performed on the corresponding application.

In this embodiment, the setting manner includes at least two types: setting different preset gestures for the same operation of different applications in one preset scenario; setting the same operation for the same operation of different applications in the same preset scenario Preset gestures.

When a preset gesture is set for the same operation of different applications in a preset scenario, since a plurality of preset gestures are set in the preset scenario, after the gesture information is recognized, the gesture information is determined. Whether it matches the preset gesture in the current scene, it should be judged which gesture is matched with the preset gesture in the current scene; when matching, the application corresponding to the preset gesture matching the gesture information should be determined, and then Triggers the appropriate action on the application. This method can be used in a scenario where the terminal is in a black screen, because when the terminal is in a black screen scenario, only the operations that may be performed on the application are turned on, so the operations performed on different applications are the same. Preferably, different preset gestures are set for opening operations of different applications in a scenario where the terminal is in a black screen. Because the terminal is in the black screen, after the terminal determines that the recognized gesture matches the preset gesture, it also needs to illuminate and unlock the terminal, so that the terminal is in the unlocked state. Therefore, the triggering terminal performs corresponding operations on the corresponding application, including: triggering the terminal to light up, unlocking, and opening the corresponding application. Because you want to open different applications, when you set a preset gesture, a variety of gestures are set, and these gestures correspond to each application. Taking the preset gesture as the example of the gesture drawn by the user on the display screen of the terminal, the corresponding preset gesture can be set corresponding to different applications, and the preset gesture can be best drawn with one stroke, which is convenient for the terminal to recognize the gesture. For example, set the gesture to turn on the camera to draw a tick on the display, the gesture to open the phone interface is to draw a circle on the display, and the gesture to open the short message interface is to draw an m on the display.

When the same preset gesture is set for the same operation of different applications in the same preset scenario, because the preset gestures corresponding to different applications are the same, when the terminal recognizes the gesture made by the user to the terminal, Also need to determine which application to operate on, also That is, identify the application that needs to be operated. This step needs to be performed before the triggering terminal performs a corresponding operation on the corresponding application after determining that the gesture information matches the preset gesture in the current scene. This method can be used in the scenario where the foreground of the terminal is running an application, because the application is already running in the foreground of the terminal, so the user most likely to perform an operation on the application is to close the application. Preferably, in the application scenario where the terminal is running, the same preset gesture is set for the closing operation of the running application; because the terminal is performing a shutdown operation on the application currently running in the foreground, the application that needs to be operated is required. It is the application that is running in the foreground. The terminal determines that the application that needs to be operated includes: the terminal determines an application that is running in the foreground as an application that needs to be operated; and triggers the terminal to perform corresponding operations on the corresponding application, including: closing the application running in the foreground . Since the performed operation is off, the preset gesture can be set to be simpler, for example, drawing a flat shape on the touch screen of the terminal. Preferably, the one-line shape can be set from the lower left corner of the terminal to the upper right corner. The shape of "/". Embodiment 2:

In order to explain in more detail the method for operating the application based on the gesture provided by the present invention, the method is described in a more detailed embodiment. The terminal in the embodiment takes a touch screen mobile phone as an example, see FIG. 2 , including the following steps:

Step 201: The user enters a setting interface.

Step 202: The user sets a preset gesture corresponding to different applications in a black screen of the terminal; lists a list of applications of the mobile phone in the setting interface: a camera, a short message, and a call, and provides a list of preset gestures for opening the application. There are: "Λ", "m" and "0", the default gesture for the user to open the call is "Λ", the default gesture for opening the SMS is "m", and the preset gesture for turning on the camera is "0";

Step 203: The user sets a corresponding gesture for closing an application running in the foreground of the mobile phone; There are several preset gestures available in the interface that can be used to close a running application, including: "one", "/", and the user selects "/" as the gesture to close the running application;

Step 204: The setting interface provides a switch button for turning on the function of operating the application based on the gesture, and the user turns the switch on;

Step 205: When the switch of the setting function in the setting interface is "on", the mobile phone starts monitoring whether the preset scene is entered;

Step 206: When the user has no operation, the mobile phone is turned off according to the conventional mobile phone, and the mobile phone enters a black screen state; Step 207: After the mobile phone monitors that the mobile device has entered the black screen state, it starts monitoring whether the user receives the gesture made by the user;

Step 208: It is detected that the user draws a gesture on the mobile phone display screen, and recognizes that the gesture is “0”; Step 209: the mobile phone determines that the recognized gesture matches the preset gesture of the set terminal to open the camera in a black screen condition;

Step 210: The phone lights up the display and unlocks, then turns on the camera;

Step 211: The user uses the camera function;

Step 212: The user wants to turn off the camera, draw a "/" on the running interface of the camera, and when the mobile phone detects the gesture, confirm that the currently running application is a camera application, and the gesture is a close gesture applied to the camera, triggering The camera is turned off. Embodiment 3:

The present embodiment provides a terminal. As shown in FIG. 3, the terminal includes: a first setting module 301, a monitoring and identifying module 302, and an executing module 303;

The setting module 301 is configured to set at least one preset gesture, where the preset gesture is used to trigger a corresponding operation on the application;

Here, the setting module 301 sets a corresponding preset gesture for an operation of an application in a preset scenario; The monitoring and identifying module 302 is configured to monitor and identify the gesture information of the user when the preset scene is configured, and trigger the execution module when the gesture information is matched with a preset gesture in the preset scene. 303 ;

The execution module 303 is configured to perform corresponding operations on the corresponding application.

Preferably, the setting module 301 includes: a first setting sub-module and a second setting sub-module; the execution module includes: a first execution sub-module and a second execution sub-module;

In this embodiment, the setting module 301, specifically the first setting sub-module, is configured to set different preset gestures corresponding to the same operation of different applications in a preset scenario; The monitoring and identifying module 302 monitors and recognizes the gesture information of the user. When the gesture information is matched with one of the at least one preset gesture set for the preset scene, the triggering execution module 303 is specifically a first execution sub-module; correspondingly, the first execution sub-module is configured to perform a corresponding operation on a corresponding application of the preset gesture that matches the gesture information.

In this embodiment, the blackout scenario is taken as an example, and the setting module 301, specifically the first setting sub-module, sets different preset gestures corresponding to opening operations of different applications in a black screen scenario; In the black screen scenario, the monitoring and identifying module 302 monitors and recognizes the gesture information of the user; and when the gesture information is matched with one of the at least one preset gesture set for the black screen scene, the triggering execution module 303 is specifically The first execution sub-module; the first execution sub-module configured to trigger the display to brighten, unlock, and open an application corresponding to the matched preset gesture.

In this embodiment, the setting module 301, specifically the second setting sub-module, is configured to set the same preset gesture for the same operation of different applications in the same preset scenario; The monitoring and identifying module 302 monitors and recognizes the gesture information of the user; and when the gesture information is matched with one of the at least one preset gesture set for the preset scene, the triggering execution module 303 is specifically a second execution submodule; the second execution submodule, Used to determine the application that needs to be operated; and perform the corresponding operations on the application that needs to operate.

In this embodiment, taking the scenario in which the application is running as an example, the setting module, specifically the second setting sub-module, sets the same preset for the closing operation of the running application in the scenario in which the application is running. In the scenario, the monitoring and identifying module 302 monitors and recognizes the gesture information of the user; and when the gesture information is matched with one of the at least one preset gesture set for the scene, the execution module is triggered. 303. Specifically, the second execution submodule. The second execution submodule determines an application currently running in the foreground, and closes the application.

In an actual application, the setting module 301, the monitoring and identifying module 302, and the executing module 303 may each be a central processing unit (CPU), or a digital signal processor (DSP), or a processor (MPU, The Micro Processor Unit or the Field Programmable Gate Array (FPGA) is implemented; the CPU, the DSP, the MPU, and the FPGA may be built in the terminal.

Those skilled in the art will appreciate that the implementation functions of the various processing modules in the terminal shown in Figure 3 can be understood with reference to the aforementioned description of the method of operating an application based on gestures. It should be understood by those skilled in the art that the functions of the processing units in the terminal shown in FIG. 3 can be implemented by a program running on a processor, or can be implemented by a specific logic circuit.

Those skilled in the art will appreciate that embodiments of the present invention can be provided as a method, system, or computer program product. Accordingly, the present invention can take the form of a hardware embodiment, a software embodiment, or a combination of software and hardware aspects. Moreover, the present invention may employ computer usable storage media (including but not limited to disk) in one or more of the computer usable program code embodied therein. A form of computer program product embodied on a memory and optical storage, etc.).

The present invention has been described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (system), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowchart and/or block diagrams, and combinations of flow and / or blocks in the flowcharts and / or block diagrams can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing device to produce a machine for the execution of instructions for execution by a processor of a computer or other programmable data processing device. Means for implementing the functions specified in one or more of the flow or in a block or blocks of the flow chart.

The computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device. The apparatus implements the functions specified in one or more blocks of a flow or a flow and/or block diagram of the flowchart.

These computer program instructions can also be loaded onto a computer or other programmable data processing device such that a series of operational steps are performed on a computer or other programmable device to produce computer-implemented processing for execution on a computer or other programmable device. The instructions provide steps for implementing the functions specified in one or more of the flow or in a block or blocks of a flow diagram.

The above is only the preferred embodiment of the present invention and is not intended to limit the scope of the present invention. Industrial applicability

The method for operating an application based on a gesture, the terminal, and the computer storage medium provided by the embodiment of the present invention, and setting at least one preset gesture, the setting manner is: setting a trigger for an operation of an application in a preset scenario. Corresponding preset gesture; when running in a preset scene, monitoring and recognizing the gesture information of the user; when identifying the gesture information and the location When a preset gesture in the running preset scene matches, the corresponding operation is performed on the corresponding application. By combining the gestures made by the user with the terminal and the operation of the application, the user can operate the application only by gesturing the terminal, and solves the comparison of the operations of the application in the terminal in the prior art. The cumbersome problem simplifies the user's operation of the application.

Claims

Claim

A method for operating an application based on a gesture, the method comprising: setting at least one preset gesture, wherein the preset gesture is used to trigger a corresponding operation on an application; the setting manner is: in a preset Setting a corresponding preset gesture for an operation of an application in the scenario;

2. The method of operating an application based on a gesture according to claim 1, wherein the method further comprises:

Setting a different preset gesture for the same operation of different applications in a preset scenario; identifying that the gesture information matches a preset gesture in the executed preset scenario, the method includes: identifying the gesture information and Matching one of the at least one preset gesture set for the running preset scene;

A corresponding operation is performed on a corresponding application of the preset gesture that matches the gesture information.

The method for operating an application based on a gesture according to claim 2, wherein the method further comprises:

The method for operating an application based on a gesture according to claim 1, wherein the method further comprises:

Setting the same preset gesture for the same operation of different applications in the same preset scenario; when running in the preset scenario, monitoring and identifying the gesture information of the user to the terminal; identifying the gesture information and running After a preset gesture in the preset scene is matched, the method further includes:

Identify the applications that need to be operated;

Perform the corresponding operations on the application that needs to operate.

The method for operating an application based on a gesture according to claim 4, wherein the method further comprises:

Using the identified application as an application that needs to be operated;

Close the identified application.

6. The method of operating an application based on a gesture according to any one of claims 1 to 5, wherein

The gesture information includes at least one of the following: a touch operation in a touch recognition area of the terminal, and a gesture operation in an image recognition area of the terminal.

A terminal, the terminal comprising: a setting module, a monitoring and identifying module, and an executing module; wherein

The setting module is configured to set at least one preset gesture, and the preset gesture is set Triggering a corresponding operation on the application; wherein, in a preset scenario, setting a preset gesture corresponding to an operation of an application;

The monitoring and identifying module, when configured to be in a preset scenario, monitors and recognizes the gesture information of the user; and when the gesture information is matched with a preset gesture in the preset scenario, the execution is triggered. Module

The execution module is configured to perform a corresponding operation on the corresponding application.

The terminal according to claim 7, wherein the setting module includes a first setting sub-module, and the executing module includes a first executing sub-module;

9. The terminal according to claim 8, wherein

The terminal according to claim 7, wherein the setting module includes a second setting sub-module, and the executing module includes a second executing sub-module; The second setting sub-module is configured to set the same preset gesture for the same operation of different applications in the same preset scenario;

Correspondingly, the monitoring and identifying module is configured to monitor and identify the gesture information of the user when the preset scene is configured; and when the gesture information is matched with a preset gesture in the preset scene, the triggering Said second execution sub-module;

11. The terminal according to claim 10, wherein

12. A computer storage medium, wherein the computer storage medium stores computer executable instructions for performing the method of any one of claims 1 to 6.