CN107870674A - A kind of program starts method and mobile terminal - Google Patents

Abstract

The invention discloses a program starting method and a mobile terminal. The method includes: collecting gesture information and sound signals of gesture operations performed in the image collection area of the terminal; according to the gesture information and the sound signals, searching for a program matching the gesture operations from a gesture operation library; The relationship between gesture operations and programs is stored in the gesture operation library, and the programs are used to realize specific functions; and the programs are started. The embodiment of the present invention starts the program from two dimensions of the gesture information and the sound signal of the gesture operation. Compared with the scheme of simply using the gesture start in the prior art, it can effectively avoid the wrong operation of the start and improve the usable gesture operation. types; moreover, gesture operations do not need to touch the terminal screen, which can effectively improve the user's convenience.

Description

A method for starting a program and a mobile terminal

technical field

The invention relates to the field of terminals, in particular to a method for starting a program and a mobile terminal.

Background technique

Gesture operation is a unique and technologically futuristic function of smartphones, that is, it supports screen sliding operations. Users can directly wake up a certain program of the mobile phone through gestures set inside the mobile phone.

For example, if the user performs a two-finger sliding operation on the touch screen, the terminal will match the monitored two-finger sliding gesture with the gesture corresponding to each preset function, and determine whether to enable the corresponding function according to the matching result.

However, according to this solution, it is easy for the user to activate the corresponding function after taking an action unintentionally, resulting in misoperation.

Contents of the invention

Embodiments of the present invention provide a method for starting a program and a mobile terminal, which are used to solve the problems that the existing program starting scheme is prone to misoperation, has fewer types of operations, and has narrower application scenarios.

In a first aspect, an embodiment of the present invention provides a method for starting a program, including:

collecting gesture information and sound signals of gesture operations performed by the gesture operation user through the camera of the mobile terminal;

Searching for a program associated with the gesture operation from a gesture operation library according to the gesture information and the sound signal; the gesture operation library stores an association between the gesture operation and the program;

Start the program.

In the second aspect, the embodiment of the present invention also provides a mobile terminal, including:

A collection unit, configured to collect gesture information and sound signals of gesture operations performed by the gesture operation user through the camera of the mobile terminal;

A matching unit, configured to search a gesture operation library for a program that matches the gesture operation according to the gesture information and the sound signal; the gesture operation library stores the association between the gesture operation and the program relationship, the program is used to achieve a specific function;

The starting unit is used to start the program.

In the third aspect, the embodiment of the present invention also provides a mobile terminal, including: a memory, a processor, and a program startup program stored in the memory and operable on the processor, and the program startup program is controlled by the The processor implements the steps of the above-mentioned program starting method when executing.

In the embodiment of the present invention, by starting the program from the two dimensions of gesture information and sound signals of gesture operation, compared with the solution in the prior art that only uses gestures to start, it can effectively avoid misoperation when starting the program and improve the performance of the program. Types of available gesture operations; moreover, gesture operations do not need to touch the terminal screen, which can effectively improve the user experience.

Description of drawings

The accompanying drawings described here are used to provide a further understanding of the present invention, and constitute a part of the present invention. The schematic embodiments of the present invention and their descriptions are used to explain the present invention, and do not constitute improper limitations to the present invention. In the attached picture:

FIG. 1 is a schematic flow chart of a method for starting a program provided by Embodiment 1 of the present invention;

FIG. 2 is a schematic flowchart of a method for starting a program provided by Embodiment 2 of the present invention;

FIG. 3 is a schematic structural diagram of a mobile terminal provided by Embodiment 3 of the present invention;

FIG. 4 is a schematic structural diagram of a mobile terminal provided by Embodiment 4 of the present invention.

Detailed ways

In order to make the purpose, technical solution and advantages of the present invention clearer, the technical solution of the present invention will be clearly and completely described below in conjunction with specific embodiments of the present invention and corresponding drawings. Apparently, the described embodiments are only some of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

It should be noted that the present invention can be applied to mobile terminals, where a mobile terminal refers to computer equipment that can be used on the move, broadly speaking, it includes mobile phones, notebooks, tablet computers, POS machines and even vehicle-mounted computers. But in most cases, it refers to mobile phones or smart phones and tablet computers with various application functions.

The technical solutions provided by various embodiments of the present invention will be described in detail below in conjunction with the accompanying drawings.

Example 1

Fig. 1 is a schematic flow chart of the program starting method provided by Embodiment 1 of the present invention. Referring to Fig. 1, the method can be executed by the processor of the terminal, and may specifically include the following steps:

Step 12, collect gesture information and sound signals of the gesture operation performed by the gesture operation user through the camera of the mobile terminal;

It should be noted that one implementation of step 12 may be as follows:

When the terminal is in the locked screen/bright screen state, the gesture operation user (hereinafter referred to as the user) performs gesture operations in the collection area of the terminal's camera and other image collection devices, such as: clapping hands, snapping fingers, etc., and the camera collects the gestures of the gesture operation At the same time, the recording device of the terminal collects the sound signal of the gesture operation. Among them, the gesture and the sound are simultaneous events.

If most of the user's gestures are not within the image acquisition area, a prompt of acquisition failure can be selectively issued.

Step 14, according to the gesture information and the sound signal, search for a program associated with the gesture operation from the gesture operation library; the gesture operation library stores the relationship between the gesture operation and the program;

It should be noted that one implementation of step 14 may be as follows:

First, the terminal recognizes the content of the gesture operation collected in step 12 based on the gesture recognition technology, for example: gesture information, which is used as a language for interacting with the terminal, so that the terminal can understand the meaning of the gesture operation, for example: gesture information shape, trajectory, etc. Then, based on the gesture information and the sound signal corresponding to the gesture operation, the gesture operation matching the gesture operation and the program associated with the gesture operation found are found from the gesture operation library. Wherein, the program here can be an application program, for example: a certain app; it can also be a function program, for example: application program-a function program in the player-play pause/continue.

Specifically include the following sub-steps:

Constructing sub-steps: determining the gesture operation to be entered; identifying the gesture information and the sound signal of the gesture operation to be entered, and establishing an association between the gesture operation to be entered and a designated program; The gesture information and sound signal, and the association relationship with the specified program are entered into the gesture operation library of the terminal.

In the construction sub-step, the establishment of the association between the gesture operation and the specified program can be for example: the user enters the quick start setting interface, selects the program, and then, based on the terminal instruction, makes a wake-up call in the image acquisition area of the terminal. For the gesture operation of the selected program, the terminal creates the association between the gesture information and the sound signal of the gesture operation and the selected program, and stores it in the gesture operation library, and then selectively sends out the prompt message of the completion of the setting .

In addition, in the sub-step of building, in order to avoid overlapping gesture operations to be recorded, after identifying the content (gesture information) of the gesture operation to be recorded, it is also possible to determine whether the gesture operation to be recorded is a gesture that has already been recorded operate. Specifically, it may be: judging whether the similarity between the content and/or sound signal corresponding to the gesture operation to be recorded and the content and/or sound signal corresponding to the recorded gesture operation stored in the gesture operation library is less than a predetermined If not, then prompt that the gesture operation to be entered is a gesture operation that has already been entered, and refuse to enter the gesture operation to be entered; if so, enter it into the gesture operation library.

Matching sub-step: matching the collected gesture information and sound signals of gesture operations with the gesture information and sound signals corresponding to the entered gesture operations stored in the gesture operation library; determining the program of the terminal according to the matching result A program in which the gesture information corresponding to the collected gesture operation and the sound signal have an associated relationship.

In the matching sub-step, an implementation manner of matching may be: comparing and determining the first similarity between the collected gesture information of the gesture operation and the gesture information of the gesture operation already entered in the gesture operation library; The attribute information of the signal determines the second similarity between the sound signal corresponding to the collected gesture operation and the sound signal corresponding to the recorded gesture operation. Wherein, the attribute information of the sound signal includes: at least one of loudness, timbre, and pitch. For example: if the gestures of the gesture operation are the same, but the loudness of the sound is different, different functions may be awakened.

In the matching sub-step, an implementation manner of determining the program may be as follows: firstly, according to the first similarity and the second similarity, it is determined that each gesture operation entered in the gesture operation library is related to the collected The matching degree of the gesture operation; then, determine the gesture operation whose matching degree satisfies the predetermined condition, and the predetermined condition may be a gesture operation with the highest matching degree; then, select and determine the gesture operation from the application program of the terminal The gesture operation has an associated program as the program corresponding to the collected gesture operation.

In the matching sub-step, if it is determined that there are at least two gesture operations that have been entered and the degree of matching of the gesture operation collected is very close, for example: at least two gesture operations that have been entered are matched with the gesture operations collected by the hand If the difference in degrees is less than a predetermined threshold, it is determined that the at least two gesture operations that have been entered are all gesture operations whose matching degree with the collected gesture operations meets a predetermined condition, and the at least two gesture operations are associated with the gesture operations For example, display its icon or operation interface on the screen, and let the user choose the program he wants to operate.

Step 16, start the program.

It should be noted that one implementation of step 16 may be as follows:

If a program associated with the collected gesture operation is found based on step 12 and step 14, the program is executed.

Another implementation of step 16 may be:

If at least two programs associated with the collected gesture operations are matched based on step 12 and step 14, after the user makes a selection, the corresponding program selected by the user is executed.

Another implementation of step 16 can be:

After matching the programs associated with the collected gesture operations based on step 12 and step 14, continue to determine the programs associated with the matched programs and the running status of the associated programs; according to the The running state of the associated program determines whether the current running environment of the terminal satisfies the predetermined condition for starting the matched program. If yes, start the matching program; if not, then do not respond, or issue a prompt that the command is wrong. For example: the matched program is a functional program - video playback pause/play, but if the associated application - video player is not in the state, or in other words, the function program that realizes the startup service is not in the state, then determine The current operating environment of the terminal does not meet the predetermined condition, and thus the mobile terminal does not start the function program-video playback pause/play.

It can be seen that this embodiment starts the program from the two dimensions of the gesture information and the sound signal of the gesture operation. Compared with the solution of simply using the gesture start in the prior art, it can effectively avoid the wrong operation of the start and improve the usable gesture operation. Moreover, the gesture operation does not need to touch the terminal screen, which can effectively improve the user's convenience.

Example 2

Fig. 2 is a schematic flow chart of the program starting method provided by Embodiment 2 of the present invention. Referring to Fig. 2, the present invention will be described in detail below in the form of an example, which may specifically include the following steps:

Step 202: Enter the setting function interface

It is not difficult to understand that the user operates the terminal to enter an interface for setting gesture information and sound signals corresponding to gesture operations for the program. This process is similar to recording fingerprints, so it will not be repeated here.

Step 204: Record gestures and sounds

The user enters the gesture and sound in the setting function, and the mobile terminal recognizes and records it through the camera and recording device. The gesture and sound need to be simultaneous events

For example: after the user selects the program to be set (for example: video pause), he snaps his fingers in front of the camera, the mobile terminal records the snapping action through the camera, and records the loudness, pitch, timbre and other sound attributes of the sound through recording .

Step 206: Whether the gesture and sound are similar to the existing gesture and sound

Wherein, the method for distinguishing the sound may be: by acquiring the acoustic features of the sound (Mel-Frequency Cepstral Coefficients, MFCC), it is judged whether there is a clear distinction between the main attributes of the snapping sound and the recorded gesture sound.

The gesture distinguishing method can be, for example, distinguishing based on the movement track corresponding to the snapping finger gesture and the movement rule of the recorded gesture.

In addition, for other actions, such as recording clapping, clapping with five fingers together and clapping with five fingers apart, there is no obvious difference. Light clapping and heavy clapping, fast clapping and slow clapping, left hand clapping and right hand clapping, clapping once and clapping twice can be regarded as obvious distinctions

Step 208: Prompt the user to distinguish the input gesture from the existing gesture

If the gesture and sound of snapping fingers are not significantly different from the existing gestures and sounds, it will prompt that the entered gesture needs to be distinguished from the existing gesture.

Step 210: After the input is completed, the user sets the gesture and sound-activated program

If the finger snapping gesture and finger snapping sound are clearly different from the existing gestures and sounds, guide the user to set a program that needs to be woken up. The program here can be a functional program or an application program. The wake-up function is not unique, but it must be mutually exclusive, that is, functions that cannot occur at the same time. For example: the wake-up function can be set to start or pause video, take pictures or record videos. It cannot be set to wake up both WeChat and the camera.

Step 212: Setup complete

Step 214: The user makes a response gesture in front of the screen accompanied by sound

The user can make corresponding gestures accompanied by sound through the image acquisition area above the screen.

Step 216: Identify whether the gesture and sound have been recorded through the camera and recording microphone

The mobile terminal performs gesture recognition matching and voice recognition matching; if the recognition is unsuccessful, it does not respond.

Wherein, gesture recognition matching can be performed based on characteristic image recognition matching.

Voice recognition matching is based on the loudness, timbre, pitch and other attributes of the voice to match the voice corresponding to the recorded gesture.

If not, then do not respond; if so, then execute step 218.

Step 218: Determine whether the current environment allows to wake up the corresponding program

If the recognition is successful but not in the video playback interface, you cannot wake up clap to pause and play the video.

If the identification is successful and the current environment allows the corresponding function to be awakened, step 220 is executed to wake up the corresponding function.

It can be seen that in this embodiment, the start operation of the program is carried out from the two dimensions of gesture information and sound signals of gesture operation. Compared with the scheme of simply using gesture start in the prior art, it can effectively avoid start-up misoperations and improve available gestures. The type of operation; moreover, the gesture operation does not need to touch the terminal screen, which can effectively improve the user's convenience.

It should be noted that the subject of execution of each step of the method provided in Embodiment 1 or 2 may be the same device, or the method may also be executed by different devices. For example, the execution subject of step 12 and step 14 can be device 1, and the execution subject of step 16 can be device 2; for another example, the execution subject of step 12 can be device 1, and the execution subject of step 14 and step 16 can be device 2 ;and many more.

In addition, for the above-mentioned method implementation, for the sake of simple description, it is expressed as a series of action combinations, but those skilled in the art should know that the implementation of the present invention is not limited by the described action sequence, because according to this In the embodiment of the invention, some steps may be performed in other order or simultaneously. Secondly, those skilled in the art should also know that the implementations described in the specification belong to preferred implementations, and the actions involved are not necessarily required by the implementations of the present invention.

Example 3

FIG. 3 is a schematic structural diagram of a mobile terminal provided in Embodiment 3 of the present invention, which may specifically include: a collection unit 31, a matching unit 32, and a starting unit 33, wherein:

The collection unit 31 is configured to collect gesture information and sound signals of gesture operations performed by the gesture operation user through the camera of the mobile terminal;

The matching unit 32 is configured to search for a program matching the gesture operation from the gesture operation library according to the gesture information and the sound signal; the gesture operation library stores the relationship between the gesture operation and the program Association relationship, the program is used to realize a specific function;

The starting unit 33 is configured to start the program.

Wherein, the matching unit 32 may specifically include:

A matching subunit, configured to match the collected gesture information and sound signals of gesture operations with the gesture information and sound signals of gesture operations already entered in the gesture operation library;

A first determining subunit, configured to determine, according to a matching result, a gesture operation whose matching degree with the collected gesture operation satisfies a predetermined condition in the gesture operation library;

The selection subunit is used to select a program associated with the determined gesture operation.

The matching unit 32 may also include:

The presenting subunit is configured to display programs associated with the determined at least two gesture operations if at least two gesture operations whose matching degrees with the collected gesture operations satisfy a predetermined condition are determined.

Startup unit 33, comprising:

A second determining subunit, configured to determine a program associated with the matched program and an operating state of the associated program;

The third determining subunit is configured to determine whether the current operating environment of the terminal satisfies a predetermined condition for starting the matched program according to the operating state of the associated program.

In another feasible implementation, it also includes:

a determining unit, configured to determine a gesture operation to be entered;

An identification unit, configured to identify the gesture information and the sound signal of the gesture operation to be recorded, and establish an association between the gesture operation to be recorded and a designated program;

The input unit is configured to input the gesture information and sound signal of the gesture operation to be input, and the association relationship with the specified program into the gesture operation library of the terminal.

In yet another feasible implementation, it also includes:

A judging unit, configured to judge whether the similarity between the gesture information and/or sound signal of the gesture operation to be recorded and the gesture information and/or sound signal of the gesture operation stored in the gesture operation library is less than a predetermined similarity threshold;

The prompting unit is configured to, if not, prompt that the gesture operation to be recorded is a recorded gesture operation.

It can be seen that in this embodiment, the start operation of the program is carried out from the two dimensions of gesture information and sound signals of gesture operation. Compared with the scheme of simply using gesture start in the prior art, it can effectively avoid start-up misoperations and improve available gestures. The type of operation; moreover, the gesture operation does not need to touch the terminal screen, which can effectively improve the user's convenience.

For the implementation of the virtual device of the mobile terminal above, since it is basically similar to the implementation of the method, the description is relatively simple, and for relevant parts, please refer to the part of the description of the implementation of the method.

It should be noted that among the various components of the device of the present invention, the components are logically divided according to the functions to be realized, but the present invention is not limited thereto, and each component can be re-divided as required or a combination.

Example 4

Figure 4 is a schematic structural diagram of a mobile terminal provided in Embodiment 4 of the present invention, referring to Figure 4, the mobile terminal 400 includes but not limited to: a radio frequency unit 401, a network module 402, an audio output unit 403, an input unit 404, a sensor 405, a display Unit 406, user input unit 407, interface unit 408, memory 409, processor 310, power supply 411 and other components. Those skilled in the art can understand that the structure of the mobile terminal shown in Figure 4 does not constitute a limitation on the mobile terminal, and the mobile terminal may include more or less components than shown in the figure, or combine some components, or different components layout. In the embodiment of the present invention, the mobile terminal includes, but is not limited to, a mobile phone, a tablet computer, a notebook computer, a palmtop computer, a vehicle terminal, a wearable device, and a pedometer.

Wherein, the radio frequency unit 401 is configured to collect gesture information and sound signals of gesture operations performed by the gesture operation user through the camera of the mobile terminal;

The processor 410 is configured to search for a program associated with the gesture operation from a gesture operation library according to the gesture information and the sound signal; the gesture operation library stores information between the gesture operation and the program. relationship between; start the program.

It can be seen that in this embodiment, the start operation of the program is performed from the two dimensions of the gesture information and the sound signal of the gesture operation. Compared with the scheme of simply using gesture start or voice start in the prior art, it can effectively avoid start misoperation and improve the performance of the program. The types of available gesture operations; moreover, the gesture operation does not need to touch the terminal screen, which can effectively improve the user's convenience.

It should be understood that, in the embodiment of the present invention, the radio frequency unit 401 can be used for receiving and sending signals during sending and receiving information or during a call. Specifically, the downlink data from the base station is received and processed by the processor 410; Uplink data is sent to the base station. Generally, the radio frequency unit 401 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio frequency unit 401 can also communicate with the network and other devices through a wireless communication system.

The mobile terminal provides users with wireless broadband Internet access through the network module 402, such as helping users send and receive emails, browse web pages, and access streaming media.

The audio output unit 403 may convert audio data received by the radio frequency unit 401 or the network module 402 or stored in the memory 409 into an audio signal and output as sound. Also, the audio output unit 403 can also provide audio output related to a specific function performed by the mobile terminal 400 (eg, call signal reception sound, message reception sound, etc.). The audio output unit 403 includes a speaker, a buzzer, a receiver, and the like.

The input unit 404 is used for receiving audio or video signals. The input unit 404 can include a graphics processing unit (Graphics Processing Unit, GPU) 4041 and a microphone 4042, and the graphics processing unit 4041 is used for still pictures or video images obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The data is processed. The processed image frames may be displayed on the display unit 406 . The image frames processed by the graphics processor 4041 may be stored in the memory 409 (or other storage media) or sent via the radio frequency unit 401 or the network module 402 . The microphone 4042 can receive sound, and can process such sound into audio data. The processed audio data can be converted into a format that can be sent to a mobile communication base station via the radio frequency unit 401 for output in the case of a phone call mode.

The mobile terminal 400 also includes at least one sensor 405, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor and a proximity sensor, wherein the ambient light sensor can adjust the brightness of the display panel 4061 according to the brightness of the ambient light, and the proximity sensor can turn off the display panel 4061 and the display panel 4061 when the mobile terminal 400 moves to the ear / or backlighting. As a kind of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in various directions (generally three axes), and can detect the magnitude and direction of gravity when it is still, and can be used to identify the posture of mobile terminals (such as horizontal and vertical screen switching, related games, etc.) , magnetometer posture calibration), vibration recognition-related functions (such as pedometer, knocking), etc.; the sensor 405 can also include fingerprint sensors, pressure sensors, iris sensors, molecular sensors, gyroscopes, barometers, hygrometers, thermometers, Infrared sensors, etc., will not be repeated here.

The display unit 406 is used to display information input by the user or information provided to the user. The display unit 406 may include a display panel 4061, and the display panel 4061 may be configured in the form of a liquid crystal display (Liquid Crystal Display, LCD), an organic light-emitting diode (Organic Light-Emitting Diode, OLED), or the like.

The user input unit 407 can be used to receive input numbers or character information, and generate key signal input related to user settings and function control of the mobile terminal. Specifically, the user input unit 407 includes a touch panel 4071 and other input devices 4072 . The touch panel 4071, also referred to as a touch screen, can collect touch operations of the user on or near it (for example, the user uses any suitable object or accessory such as a finger or a stylus on the touch panel 4071 or near the touch panel 4071). operate). The touch panel 4071 may include two parts, a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into contact coordinates, and sends it to For the processor 410, receive the command sent by the processor 410 and execute it. In addition, the touch panel 4071 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch panel 4071 , the user input unit 407 may also include other input devices 4072 . Specifically, other input devices 4072 may include, but are not limited to, physical keyboards, function keys (such as volume control keys, switch keys, etc.), trackballs, mice, and joysticks, which will not be repeated here.

Furthermore, the touch panel 4071 can be covered on the display panel 4061, and when the touch panel 4071 detects a touch operation on or near it, it will be sent to the processor 410 to determine the type of the touch event, and then the processor 410 will The type of event provides a corresponding visual output on the display panel 4061 . Although in FIG. 4, the touch panel 4071 and the display panel 4061 are used as two independent components to realize the input and output functions of the mobile terminal, in some embodiments, the touch panel 4071 and the display panel 4061 can be integrated. The implementation of the input and output functions of the mobile terminal is not specifically limited here.

The interface unit 408 is an interface for connecting an external device to the mobile terminal 400 . For example, an external device may include a wired or wireless headset port, an external power (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device with an identification module, audio input/output (I/O) ports, video I/O ports, headphone ports, and more. The interface unit 408 can be used to receive input from an external device (for example, data information, power, etc.) transfer data between devices.

The memory 409 can be used to store software programs as well as various data. The memory 409 can mainly include a program storage area and a data storage area, wherein the program storage area can store an operating system, at least one application program required by a function (such as a sound playback function, an image playback function, etc.); Data created by the use of mobile phones (such as audio data, phonebook, etc.), etc. In addition, the memory 409 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage devices.

The processor 410 is the control center of the mobile terminal, which uses various interfaces and lines to connect various parts of the entire mobile terminal, by running or executing software programs and/or modules stored in the memory 409, and calling data stored in the memory 409 , execute various functions of the mobile terminal and process data, so as to monitor the mobile terminal as a whole. The processor 410 may include one or more processing units; preferably, the processor 410 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface and application programs, etc., and the modem The processor mainly handles wireless communication. It can be understood that the foregoing modem processor may not be integrated into the processor 410 .

The mobile terminal 400 can also include a power supply 411 (such as a battery) for supplying power to various components. Preferably, the power supply 411 can be logically connected to the processor 410 through a power management system, so as to manage charging, discharging, and power consumption through the power management system. and other functions.

In addition, the mobile terminal 400 includes some functional modules not shown, which will not be repeated here.

Preferably, the embodiment of the present invention also provides a mobile terminal, including a processor 110, a memory 109, a computer program stored in the memory 109 and operable on the processor 110, when the computer program is executed by the processor 110 The various processes of Embodiment 1 or 2 of the above-mentioned method can be realized and the same technical effect can be achieved. In order to avoid repetition, details are not repeated here.

The embodiment of the present invention also provides a computer-readable storage medium. A computer program is stored on the computer-readable storage medium. When the computer program is executed by a processor, each process of the above-mentioned method embodiment 1 or 2 is realized, and the same Technical effects, in order to avoid repetition, will not be repeated here. Wherein, the computer-readable storage medium is, for example, a read-only memory (Read-Only Memory, ROM for short), a random access memory (Random Access Memory, RAM for short), a magnetic disk or an optical disk, and the like.

It should be noted that, in this document, the term "comprising", "comprising" or any other variation thereof is intended to cover a non-exclusive inclusion such that a process, method, article or apparatus comprising a set of elements includes not only those elements, It also includes other elements not expressly listed, or elements inherent in the process, method, article, or device. Without further limitations, an element defined by the phrase "comprising a ..." does not preclude the presence of additional identical elements in the process, method, article, or apparatus comprising that element.

Through the description of the above embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus a necessary general-purpose hardware platform, and of course also by hardware, but in many cases the former is better implementation. Based on such an understanding, the essence of the technical solution of the present invention or the part that contributes to the prior art can be embodied in the form of software products, and the computer software products are stored in a storage medium (such as ROM/RAM, disk, CD) contains several instructions to make a terminal (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) execute the methods described in various embodiments of the present invention.

Embodiments of the present invention have been described above in conjunction with the accompanying drawings, but the present invention is not limited to the above-mentioned specific implementations, and the above-mentioned specific implementations are only illustrative, rather than restrictive, and those of ordinary skill in the art will Under the enlightenment of the present invention, without departing from the gist of the present invention and the protection scope of the claims, many forms can also be made, all of which belong to the protection of the present invention.

Claims (13)

1. A method for starting a program, applied to a mobile terminal, comprising: collecting gesture information and sound signals of gesture operations performed by the gesture operation user through the camera of the mobile terminal; Searching for a program associated with the gesture operation from a gesture operation library according to the gesture information and the sound signal; the gesture operation library stores an association between the gesture operation and the program; Start the program. 2. The method according to claim 1, further comprising: Determine the gesture operation to be recorded; Recognizing the gesture information and the sound signal of the gesture operation to be recorded, and establishing an association between the gesture operation to be recorded and a designated program; The gesture information and the sound signal of the gesture operation to be recorded, and the association relationship with the specified program are recorded into the gesture operation library of the terminal. 3. The method according to claim 2, further comprising: before establishing the association between the gesture operation to be entered and the specified program: Judging whether the similarity between the gesture information and/or sound signal of the gesture operation to be recorded and the gesture information and/or sound signal of the gesture operation stored in the gesture operation library is less than a predetermined similarity threshold ; If not, prompting that the gesture operation to be entered is a gesture operation already entered. 4. The method according to claim 1, wherein matching the program matching the gesture operation from the gesture operation library comprises: Matching the collected gesture information and sound signal of the gesture operation with the gesture information and sound signal of the gesture operation already entered in the gesture operation library; determining, according to the matching result, the gesture operations in the gesture operation library whose matching degree with the collected gesture operations satisfies a predetermined condition; A program associated with the determined gesture operation is selected. 5. The method according to claim 4, wherein if at least two gesture operations whose matching degrees with the collected gesture operations meet a predetermined condition are determined, then the at least two determined gesture operations will be The program of the association relationship is displayed. 6. The method according to any one of claims 1-5, characterized in that, before starting the program, further comprising: determining a program associated with the matched program and an operating state of the associated program; It is determined whether the current operating environment of the terminal satisfies a predetermined condition for starting the matched program according to the operating state of the associated program. 7. A mobile terminal, characterized in that, comprising: A collection unit, configured to collect gesture information and sound signals of gesture operations performed by the gesture operation user through the camera of the mobile terminal; A matching unit, configured to search a gesture operation library for a program that matches the gesture operation according to the gesture information and the sound signal; the gesture operation library stores the association between the gesture operation and the program relationship, the program is used to achieve a specific function; The starting unit is used to start the program. 8. The mobile terminal according to claim 7, further comprising: a determining unit, configured to determine a gesture operation to be entered; An identification unit, configured to identify the gesture information and the sound signal of the gesture operation to be recorded, and establish an association between the gesture operation to be recorded and a specified program; The input unit is configured to input the gesture information and sound signal of the gesture operation to be input, and the association relationship with the specified program into the gesture operation library of the terminal. 9. The mobile terminal according to claim 8, further comprising: A judging unit, configured to judge whether the similarity between the gesture information and/or sound signal of the gesture operation to be recorded and the gesture information and/or sound signal of the gesture operation stored in the gesture operation library is less than a predetermined similarity threshold; The prompting unit is configured to, if not, prompt that the gesture operation to be recorded is a recorded gesture operation. 10. The mobile terminal according to claim 7, wherein the matching unit comprises: A matching subunit, configured to match the collected gesture information and sound signals of gesture operations with the gesture information and sound signals of gesture operations already entered in the gesture operation library; A first determining subunit, configured to determine, according to a matching result, a gesture operation whose matching degree with the collected gesture operation satisfies a predetermined condition in the gesture operation library; The selection subunit is used to select a program associated with the determined gesture operation. 11. The mobile terminal according to claim 10, wherein the matching unit further comprises: The presenting subunit is configured to display programs associated with the determined at least two gesture operations if at least two gesture operations whose matching degrees with the collected gesture operations satisfy a predetermined condition are determined. 12. The mobile terminal according to any one of claims 7-11, wherein the starting unit comprises: A second determining subunit, configured to determine a program associated with the matched program and an operating state of the associated program; The third determining subunit is configured to determine whether the current operating environment of the terminal satisfies a predetermined condition for starting the matched program according to the operating state of the associated program. 13. A mobile terminal, characterized in that it comprises: a memory, a processor, and a program startup program stored on the memory and operable on the processor, when the program startup program is executed by the processor The steps for implementing the program starting method according to any one of claims 1 to 6.