CN107704137A - The method and its equipment of multi-point touch - Google Patents

Abstract

A touch control method is proposed, comprising the following steps: a terminal detects a fixed-point single-touch signal and other touch signals, wherein the fixed-point single-touch signal corresponds to a first control instruction; when receiving the fixed-point When the single touch signal and the departure signal of the other touch signals, the terminal determines the second control instruction according to the combination of the first control instruction and the other touch signals; the terminal in the application program Execute the second control instruction. The embodiment of the present invention also provides a touch device. According to the technical solution proposed by the present invention, the user can easily perform touch operations on a large-size screen or a small-size screen, and through the combination of single-point touch and multi-touch, the user's control purpose can be quickly and conveniently realized, saving The time for touch control is shortened, the efficiency of touch control is improved, the types of touch operations are enriched, the interaction between the user and the terminal device is strengthened, and the user experience is enhanced.

Description

Multi-touch method and device thereof

The application of the present invention is a divisional application with the filing date of February 07, 2013, the title of the invention is "Multi-touch method and device thereof", and the application number is 201310049867.1.

technical field

The present invention relates to the technical field of terminal equipment, in particular, the present invention relates to a multi-touch method and a device thereof.

Background technique

In recent years, with the rapid development of the electronic industry and communication technology, new services based on data, voice, and video have developed rapidly. The rapid development of microelectronics technology and computer software and hardware technology has laid the foundation for terminal equipment to handle more and more complex tasks, and provided the possibility for the realization of terminal equipment personalization, so that the terminal can get rid of the constraints of the network to some extent, and can With more and more powerful functions. In addition, users themselves have urgent needs for terminals, hoping that terminals will be more powerful, more flexible, and simpler. The development of information technology has made terminal technology more intelligent, mobile and multi-functional.

Specifically, the touch screen has become a standard configuration of terminal electronic products, especially in portable handheld devices such as mobile phones and tablet computers. Multi-touch (multi-touch) is an interactive method based on image processing methods and hardware devices. It does not use traditional keyboards, mice and other input devices, but uses various gestures or other touch objects to realize human-computer interaction. In recent years, with the appearance of products such as iPhone and Microsoft surface, multi-touch methods have gradually entered the public's field of vision. For example, on the screen of the iPhone, the effect of shrinking the interface is achieved by shrinking the relative distance of two fingers.

However, the existing touch operation has disadvantages such as time-consuming and inconvenient operation. For example, to switch between uppercase and lowercase English letters, first press the cheat button and then press the corresponding letter button, requiring the thumb to perform two operations, and for a terminal device with a small screen, due to the small screen and relatively thick thumb, it is easy to cause misoperation ; For a terminal device with a large screen, due to the large screen, the finger needs to move a relatively long distance during two touch operations.

Therefore, it is necessary to propose a corresponding technical solution to solve the above-mentioned problems existing in the prior art.

Contents of the invention

The purpose of the present invention is to at least solve one of the above-mentioned technical defects, especially through the combination of single-touch and multi-touch, enrich the types of touch operations, and improve the time-consuming and difficult-to-operate problems of existing touch operations .

In order to achieve the above purpose, an embodiment of the present invention proposes a touch method on the one hand, including the following steps:

The terminal detects a fixed-point single-touch signal and other touch signals, wherein the fixed-point single-touch signal corresponds to the first control instruction;

When receiving the fixed-point single-touch signal and the departure signal of the other touch signals, the terminal determines a second control instruction according to a combination of the first control instruction and the other touch signals;

The terminal executes the second control instruction in the application program.

On the other hand, the embodiment of the present invention also proposes a terminal device, which is characterized in that it includes: a detection module, an identification module and an execution module,

The detection module is used to detect fixed-point single-touch signals and other touch signals, wherein the fixed-point single-touch signals correspond to the first control instruction;

The identification module is used to identify the second control instruction, and when receiving the fixed-point single-touch signal and the departure signal of the other touch signals, the identification module according to the first control instruction and the Combining other touch signals to determine the second control command;

The execution module is configured to execute the second control instruction in the application program.

The above-mentioned touch control method or terminal device disclosed in the present invention does not need to add additional hardware to the terminal. The user can execute corresponding operation instructions through single-touch, multi-touch or a combination thereof, which can be fast and convenient. The user's control purpose is realized, the interaction between the user and the terminal device is improved, and the user's sense of experience is enhanced.

Additional aspects and advantages of the invention will be set forth in part in the description which follows, and will become apparent from the description, or may be learned by practice of the invention.

Description of drawings

The above and/or additional aspects and advantages of the present invention will become apparent and easy to understand from the following description of the embodiments in conjunction with the accompanying drawings, wherein:

FIG. 1 is a flowchart of a touch control method according to an embodiment of the present invention;

Fig. 2 is a schematic flow chart of applying the present invention;

Fig. 3 is several examples of single-point and multi-touch gesture interaction;

FIG. 4 is a schematic structural diagram of a terminal device according to an embodiment of the present invention.

detailed description

Embodiments of the present invention are described in detail below, examples of which are shown in the drawings, wherein the same or similar reference numerals designate the same or similar elements or elements having the same or similar functions throughout. The embodiments described below by referring to the figures are exemplary only for explaining the present invention and should not be construed as limiting the present invention.

Those skilled in the art will understand that unless otherwise stated, the singular forms "a", "an", "said" and "the" used herein may also include plural forms. It should be further understood that the word "comprising" used in the description of the present invention refers to the presence of said features, integers, steps, operations, elements and/or components, but does not exclude the presence or addition of one or more other features, Integers, steps, operations, elements, components, and/or groups thereof. It will be understood that when an element is referred to as being "connected" or "coupled" to another element, it can be directly connected or coupled to the other element or intervening elements may also be present. Additionally, "connected" or "coupled" as used herein may include wirelessly connected or coupled. As used herein, the term "and/or" includes any and all combinations of one or more of the associated listed items.

Those skilled in the art can understand that, unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. It should also be understood that terms such as those defined in commonly used dictionaries should be understood to have a meaning consistent with the meaning in the context of the prior art, and will not be interpreted in an idealized or overly formal sense unless defined as herein Explanation.

Those skilled in the art can understand that the "terminal device" and "terminal" used here include not only a device with a wireless signal receiver without transmission capability, but also a device capable of receiving and communicating on a two-way communication link. A device that emits hardware. Such equipment may include: cellular or other communication equipment with or without a multi-line display; personal communication systems (PCS) that may combine voice and data processing, facsimile and/or data communication capabilities; may include radio frequency receivers and pagers, Internet / Personal Digital Assistant (PDA) with intranet access, web browser, notepad, calendar, and/or Global Positioning System (GPS) receiver; and/or conventional laptop and/or palmtop computer including radio frequency receiver or other devices. A "terminal device" as used herein may be portable, transportable, mounted in a vehicle (air, sea, and/or land), or adapted and/or configured to operate locally and/or in a distributed Forms operate at any other location on Earth and/or in space. The "terminal device" and "terminal" used here may also be a communication terminal, an Internet terminal, and a music/video playback terminal. The "terminal device" and "terminal" used here may also be PDA, MID and/or mobile phone with music/video playing function, etc.

In order to achieve the purpose of the present invention, as shown in FIG. 1 , it is a flowchart of a touch control method according to an embodiment of the present invention, including steps S110 to S130:

Step S110: The terminal detects the fixed-point single-touch signal and other touch signals, wherein the fixed-point single-touch signal corresponds to the first control command;

Step S120: When receiving the fixed-point single-touch signal and the departure signal of other touch signals, the terminal determines the second control command according to the combination of the first control command and other touch signals;

Step S130: the terminal executes the second control instruction in the application program.

The specific implementation details of each step in the above process will be described in detail below.

S110: The terminal detects a fixed-point single-touch signal and other touch signals, wherein the fixed-point single-touch signal corresponds to the first control command.

Wherein, other touch signals include: another single-touch signal; or a multi-touch signal. For example, the user first taps a point on the screen with one finger and holds it down, which is a fixed-point single-touch signal, and then the user taps another point on the screen with another finger; Hold it down, and then the user taps another 3 points on the screen with the other 3 fingers.

In addition, the fixed-point touch signal and other touch signals may not be sequenced. For example, the user can first tap a point on the screen with one finger and hold it down, and then tap another three points on the screen with another three fingers; the user can also tap three points on the screen with three fingers first, and then use another Click another point with your finger to form a fixed-point single-touch.

Among them, the first control instruction includes but is not limited to:

Select or input a character selected by fixed-point single-touch, confirm a command selected by fixed-point single-touch, and so on.

Apparently, in step S110 it is only required that the fixed-point single-touch signal corresponds to the first control instruction, but it is not required to execute the first control instruction. For example, because the fixed-point single-point touch has not ended (for example, the finger does not leave the screen after the single-point touch), so the first control instruction is not executed.

In addition, the touch signal includes: a click touch signal and/or a slide touch signal. For example, the user may input a touch signal by clicking or sliding.

S120: When receiving the fixed-point single-touch signal and the leaving signal of other touch signals, the terminal determines a second control instruction according to a combination of the first control instruction and other touch signals.

The receiving of the fixed-point single-touch signal and the departure signal of other touch signals includes: the detection of the signal that the fixed-point single-touch signal and other touch signals leave at the same time or successively within a set time threshold. That is, if the fixed-point single-touch signal and other touch signals disappear or disappear simultaneously within the set time, it is considered that step S110 has been executed.

Specifically, the terminal finds the combination of the first control instruction and other touch signals by searching the local terminal or the network, and determines the second control instruction.

Specifically, the terminal determines the second control instruction according to the combination of the first control instruction and other touch signals, including any of the following methods:

The terminal determines the second control instruction according to the first control instruction and the number of touch points of other touch signals; the terminal determines the second control instruction according to the trajectory of the first control instruction and other touch signals; or the terminal determines the second control instruction according to the first control instruction and other touch signals. The position of the touch signal determines the second control command.

Specifically, the terminal determines the second control instruction according to the first control instruction and the number of touch points of other touch signals, including: the terminal determines the second control instruction according to the first control instruction and the number of touch points of other touch signals, Wherein, the second control instruction is that the terminal switches the input mode in the application program.

Specifically, the terminal determines the second control instruction according to the trajectory of the first control instruction and other touch signals, including: the terminal determines the second control instruction according to the trajectory of the first control instruction and other touch signals, wherein the second control instruction Switches the input mode in the application for the terminal.

Specifically, the terminal determining the second control instruction according to the position of the first control instruction and other touch signals includes: the terminal determining the second control instruction according to the position of the first control instruction and other touch signals, wherein the second control instruction Switches the input mode in the application for the terminal.

Specifically, converting the input mode in the application program by the terminal includes: executing an input mode opposite or different from the first control instruction.

Specifically, the terminal converts the input mode in the application to perform any of the following conversions:

Convert the entered letters to upper and lower case;

Simplified-to-traditional conversion of input Chinese characters;

Translate and convert the input language text;

Convert the input single characters and overlapping characters;

Convert the input Chinese characters and Pinyin; or,

Convert a single input character to multiple characters.

In addition, step S120 also includes: the user can pre-set the second control command corresponding to the combination of the first control command and other touch signals in the local machine or the network.

S130: The terminal executes the second control instruction in the application program.

In order to further illustrate the present invention, the following will be described in conjunction with specific applications. As shown in Figure 2, it is a schematic flow chart of applying the present invention, including:

101: The user clicks a point on the screen, and presses a fixed point on the touch part 1 to touch; 102: Executes operations such as clicking or sliding on one or more places except the touch part 1; Any point or multi-point touch, the touch method can be click or slide, after the signal of any touch point stops inputting or after a certain period of time, the terminal determines that the user has completed the process of inputting the touch signal, for example, the user touches the When all fingers are lifted on the screen, the terminal determines that the user has completed the input of the touch signal; 103: Operation recognition based on multi-touch; 104: The response of the system to perform the corresponding operation, that is, the terminal recognizes the operation corresponding to the touch signal after performing this operation.

For example, as shown in Figure 3, there are several examples of single-point and multi-touch gesture interactions:

Single touch outside the fixed point, press the fixed point, and any second point in sequence, and touch the screen at the same time, when the number of points is 2, the operation is completed, that is, the operation of the second control command is completed;

Multi-touch outside the fixed point, press the fixed point and any multi-point in sequence, and the operation is completed when the corresponding value is touched on the screen at the same time, that is, the operation of the second control command is completed;

Slide a single point outside the fixed point, press the fixed point and any second point in sequence, and complete the specified operation according to the distance trend between the fixed point and the second point, that is, complete the operation of the second control command;

Slide multiple points other than the fixed point relative to each other, press the fixed point and any number of points in sequence, and complete the specified operation according to the distance trend of each point except the fixed point, that is, complete the operation of the second control command.

Invention application scenario 1: switch between upper and lower case of English letters.

The user handwrites or clicks a lowercase English letter with one finger. The finger does not move away. The user slides the other finger in the direction where the distance from the lowercase English letter becomes larger. After any finger moves away, the terminal outputs the uppercase English letter corresponding to the lowercase English letter. ;

The user handwrites or clicks a capital English letter with one finger. The finger does not move away. The user slides the other finger in the direction where the distance from the capital English letter becomes smaller. After any finger leaves, the terminal outputs the lowercase English letter corresponding to the capital English letter. .

Invention Application Scenario 2: Conversion of Simplified and Traditional Chinese characters.

The user handwrites or clicks a simplified Chinese character with one finger, and the finger does not leave. The user touches any point on the screen with the other finger except the touched point. After any finger leaves, the terminal outputs the traditional Chinese character corresponding to the simplified Chinese character.

The user writes or clicks a traditional Chinese character with one finger, and the finger does not leave. The user uses another finger to touch any point on the screen except the touched point. After any finger is released, the terminal outputs the simplified Chinese character corresponding to the traditional Chinese character.

Invention Application Scenario 3: Conversion of single and overlapping characters.

For example, if the user handwrites or clicks the Chinese character "木" with one finger, the finger does not leave, and the user touches any point outside the screen with the other finger. After any finger leaves the screen, the terminal outputs the Chinese character "林";

The user handwrites or clicks the Chinese character "木" with one finger, and the finger does not leave. The user uses the other two fingers to touch any two points on the screen except the touch point. After any finger leaves the screen, the terminal outputs the Chinese character "森";

Invention Application Scenario 4: Translate words input by users.

The user writes or clicks to input a Chinese word with one finger. The finger does not leave. The user touches any point on the screen with the other finger except the touched point. After any finger leaves, the terminal outputs the English translation corresponding to the Chinese word; or,

The user uses one finger to handwrite or click to input a French word, and the finger does not leave. The user uses another finger to touch any point on the screen except the touched point. After any finger leaves, the terminal outputs the Chinese translation corresponding to the French word.

Obviously, the target language that can be translated can be set to other languages through the user's settings.

Invention Application Scenario 5: Convert a single character to multiple characters.

The user handwrites or clicks a character with one finger, the first clicking finger does not leave, the user clicks the screen with one or more fingers other than the first clicking finger, and the terminal detects that the fingers other than the first clicking finger click the screen at the same time number, after any finger leaves, the terminal outputs the multi-character corresponding to the character. For example, if the user taps the number "9" with one finger, the first tap finger does not leave, and the user taps the screen at the same time with four fingers other than the first tap finger, and after any finger leaves, the terminal outputs "99999".

Invention Application Scenario 6: Interchange between Chinese characters and Pinyin.

The user writes or clicks a Chinese character with one finger, and the finger does not leave. The user uses another finger to touch any point on the screen except the touched point. After any finger leaves, the terminal outputs the pinyin corresponding to the Chinese character.

Invention Application Scenario 7: Game Control.

Common game consoles such as gamepads of XBOX and PlayStation have a large number of physical buttons, and the control of the game needs to be completed through a combination of multiple physical buttons. However, on most of the current smart terminal devices equipped with touch screens, in order to realize complex control functions, if too many buttons are placed on the touch screen, the user's vision will be disturbed, which becomes very inapplicable, and the fixed combination of buttons It needs to be clicked correctly by the user to take effect. Single-point fixed touch plus multi-point arbitrary touch or sliding, such as the example of single-point and multi-touch gesture interaction shown in Figure 3, can overcome these shortcomings and quickly and conveniently complete some game control functions.

In addition, the above-mentioned multi-point operation method proposed by the present invention can be extended to various application fields such as switching and copying of pictures, switching and copying of files, and the like. For example, without leaving one finger, tap the screen with the other finger to switch from picture 1 to picture 2, tap the screen with the other two fingers simultaneously to switch from picture 1 to picture 3, and so on.

Through the method disclosed above, the user can easily perform touch operations on a large-size screen or a small-size screen, which saves touch time and improves touch efficiency, and the user can also customize the operation instructions corresponding to the touch signals , enhancing the user experience.

Corresponding to the above method, as shown in FIG. 4 , another aspect of the embodiment of the present invention provides a terminal device 100 , including a detection module 110 , an identification module 120 and an execution module 130 .

A detection module 110, configured to detect a fixed-point single-touch signal and other touch signals, wherein the fixed-point single-touch signal corresponds to the first control instruction;

The identification module 120 is used to identify the second control instruction. When receiving the fixed-point single-point touch signal and the departure signal of other touch signals, the identification module 120 determines the second control instruction according to the combination of the first control instruction and other touch signals. Control instruction;

The execution module 130 is configured to execute the second control instruction in the application program.

Specifically, other touch signals used by the detection module 110 for detection include: another single-point touch signal or a multi-point touch signal.

Specifically, the touch signal used by the detection module 110 for detection includes: a click touch signal and/or a slide touch signal

Specifically, the recognition module 120 is further configured to determine the second control instruction when the fixed-point single-touch signal and the departure signal of other touch signals are received simultaneously or successively within a set time threshold.

Specifically, the recognition module 120 is further used to determine the second control instruction according to the first control instruction and the number of touch points of other touch signals; the recognition module 120 is further used to determine The second control instruction; or the recognition module 120 is further configured to determine the second control instruction according to the position of the first control instruction and other touch signals.

Specifically, the recognition module 120 is further configured to convert the input mode into a second control command determined according to the first control command and the number of touch points of other touch signals.

Specifically, the identification module 120 is further configured to convert the input mode into a second control instruction determined according to the first control instruction and the trajectory of other touch signals.

Specifically, the identification module 120 is further configured to convert the input mode into the second control instruction determined according to the first control instruction and the positions of other touch signals.

Specifically, the execution module 130 is further configured to execute an opposite or different input mode from the first control instruction in the application program.

Specifically, the execution module 130 is further configured to convert the input mode in the application program to perform conversion in any of the following ways:

Convert the entered letters to upper and lower case;

Simplified-to-traditional conversion of input Chinese characters;

Translate and convert the input language text;

Convert the input single characters and overlapping characters;

Convert the input Chinese characters and Pinyin; or,

Convert a single input character to multiple characters. In addition, the terminal device 100 further includes a setting module 140 (not shown in the figure), configured to set a fixed-point single-touch, a second control command corresponding to a combination of the first control command and other touch signals according to user input.

The above example of the terminal device 100 is only to illustrate a typical solution of the method disclosed in the present invention. Obviously, the other methods disclosed above are similarly applicable to be implemented by the terminal device 100, and the corresponding content will not be repeated here.

Through the device disclosed above, users can easily perform touch operations on a large-size screen or a small-size screen, which saves touch time and improves touch efficiency. Users can also customize the operation instructions corresponding to touch signals. , enhancing the user experience.

Those skilled in the art will appreciate that the present invention may relate to an apparatus for performing one or more of the operations described in this application. Said apparatus may be specially designed and fabricated for the required purposes, or it may comprise known apparatus in a general purpose computer selectively activated or reconfigured by a program stored in it. Such a computer program can be stored in a device (e.g., computer) readable medium, including but not limited to any type of medium suitable for storing electronic instructions and respectively coupled to a bus. Types of disks (including floppy disks, hard disks, compact disks, CD-ROMs, and magneto-optical disks), random access memory (RAM), read-only memory (ROM), electrically programmable ROM, electrically erasable ROM (EPROM), electrically erasable Programmable ROM (EEPROM), flash memory, magnetic card or optical card. Readable media include any mechanism for storing or transmitting information in a form readable by a device (eg, a computer). Readable media include, for example, random access memory (RAM), read only memory (ROM), magnetic disk storage media, optical storage media, flash memory devices, signals propagated in electrical, optical, acoustic, or other forms (such as carrier waves, Infrared signal, digital signal), etc.

Those skilled in the art will understand that computer program instructions can be used to implement each block in these structural diagrams and/or block diagrams and/or flow diagrams and combinations of blocks in these structural diagrams and/or block diagrams and/or flow diagrams . These computer program instructions may be provided to a general-purpose computer, specialized computer, or other programmable data-processing processor to create a machine, whereby the instructions executed by the computer or other programmable data-processing processor create a structure for implementing A method specified in a box or boxes of a diagram and/or a block diagram and/or a flow diagram.

Those skilled in the art can understand that the various operations, methods, and steps, measures, and solutions in the processes discussed in the present invention can be replaced, changed, combined, or deleted. Further, other steps, measures, and schemes in the various operations, methods, and processes that have been discussed in the present invention may also be replaced, changed, rearranged, decomposed, combined, or deleted. Further, steps, measures, and schemes in the prior art that have operations, methods, and processes disclosed in the present invention can also be alternated, changed, rearranged, decomposed, combined, or deleted.

The above descriptions are only part of the embodiments of the present invention. It should be pointed out that those skilled in the art can make some improvements and modifications without departing from the principles of the present invention. It should be regarded as the protection scope of the present invention.

Claims (18)

1. A touch method, characterized in that, comprising the following steps: The terminal detects a fixed-point single-touch signal and other touch signals, wherein the fixed-point single-touch signal corresponds to the first control instruction; When receiving the fixed-point single-touch signal and the departure signal of the other touch signals, the terminal determines a second control instruction according to a combination of the first control instruction and the other touch signals; The terminal executes the second control instruction. 2. The touch method according to claim 1, wherein the other touch signals include any of the following signals: Another single-touch signal; or a multi-touch signal. 3. The touch method according to claim 2, wherein the touch signal comprises: a click touch signal and/or a slide touch signal. 4. The touch method according to claim 1, wherein the receiving the fixed-point single-point touch signal and the departure signal of the other touch signals comprises: the terminal simultaneously or successively receives the A departure signal between the fixed-point single-touch signal and the other touch signals. 5. The touch control method according to claim 1, wherein the terminal determines a second control command according to a combination of the first control command and the other touch signals, further comprising any of the following methods : The terminal determines a second control instruction according to the trajectory of the first control instruction and the other touch signals; or The terminal determines a second control instruction according to the first control instruction and the number of touch points of the other touch signals; or The terminal determines a second control instruction according to the first control instruction and the positions of the other touch signals. 6 . The touch control method according to claim 1 , wherein the second control instruction comprises: switching an input mode. 7. The touch control method according to claim 6, wherein the switching of the input mode by the terminal in the application program comprises: executing an input mode opposite or different from the first control instruction. 8. The touch control method according to any one of claims 6 to 7, wherein the terminal switches the input mode in the application program to any of the following ways: Convert the entered letters to upper and lower case; Simplified-to-traditional conversion of input Chinese characters; Translate and convert the input language text; Convert the input single characters and overlapping characters; Convert the input Chinese characters and Pinyin; or, Convert a single input character to multiple characters. 9 . The touch control method according to claim 1 , wherein the terminal executing the second control instruction is specifically: the terminal executing the second control instruction in an application program. 10. A terminal device, characterized in that it includes: a detection module, an identification module and an execution module, The detection module is used to detect fixed-point single-touch signals and other touch signals, wherein the fixed-point single-touch signals correspond to the first control instruction; The identification module is used to identify the second control instruction, and when receiving the fixed-point single-touch signal and the departure signal of the other touch signals, the identification module according to the first control instruction and the Combining other touch signals to determine the second control command; The execution module is configured to execute the second control instruction. 11. The terminal device according to claim 10, wherein the other touch signals detected by the detection module include: another single-point touch signal or a multi-point touch signal. 12 . The terminal device according to claim 11 , wherein the touch signal detected by the detection module comprises: a click touch signal and/or a slide touch signal. 13 . 13. The terminal device according to claim 10, characterized in that, the identification module is further configured to determine when the fixed-point single-touch signal and the departure signals of the other touch signals are received simultaneously or successively. 2. Control instructions. 14. The terminal device according to claim 10, characterized in that, The identification module is further configured to determine a second control instruction according to the trajectory of the first control instruction and the other touch signals; or The identification module is further configured to determine a second control instruction according to the first control instruction and the number of touch points of the other touch signals; or The identification module is further configured to determine a second control instruction according to the positions of the first control instruction and the other touch signals. 15. The terminal device according to claim 10, wherein the identification module is further configured to determine that the second control instruction is to switch an input mode. 16. The terminal device according to claim 15, wherein the execution module is further configured to execute an input mode opposite or different from the first control instruction in the application program. 17. The terminal device according to any one of claims 15 to 16, wherein the execution module is further configured to convert the input mode in the application program to perform any of the following conversions: Convert the entered letters to upper and lower case; Simplified-to-traditional conversion of input Chinese characters; Translate and convert the input language text; Convert the input single characters and overlapping characters; Convert the input Chinese characters and Pinyin; or, Convert a single input character to multiple characters. 18. The terminal device according to claim 10, wherein the executing module is further configured to execute the second control instruction in an application program.