CN111913590A

CN111913590A - Input method, device and equipment

Info

Publication number: CN111913590A
Application number: CN201910376899.XA
Authority: CN
Inventors: 黄海兵; 庞帅; 张扬
Original assignee: Beijing Sogou Technology Development Co Ltd
Current assignee: Beijing Sogou Technology Development Co Ltd
Priority date: 2019-05-07
Filing date: 2019-05-07
Publication date: 2020-11-10

Abstract

The embodiment of the invention discloses an input method, a device and equipment.A terminal selects an input method awakening condition corresponding to first information according to a first input type of the first information after receiving the first information input by a user, and starts to receive the input information if the first information meets the input method awakening condition; and when second information input by a user is received, selecting an input ending condition corresponding to the second information according to a second input type of the second information, if the second information meets the input ending condition, ending the reception of the input information, and obtaining an input result according to the received input information. Therefore, by providing various input method awakening systems and input ending modes, a user can input first information and second information by adopting input types convenient to the user according to different requirements, the problem that the user cannot conveniently complete input under the requirement of a single input type is solved, input convenience is provided for the user, and input experience of the user is improved.

Description

Input method, device and equipment

Technical Field

The invention relates to the technical field of input methods, in particular to an input method, an input device and input equipment.

Background

When a user uses various applications, the user basically needs to input information by calling an input method system, for example: after the instant messaging client is opened, the user needs to call the input method system out first, and input information through an input interface of the input method system, so that instant messaging between the user and other users is realized.

Currently, when a user calls an input method system to perform input, some operations need to be performed in a fixed manner (for example, clicking a specific position on the terminal or controlling by voice), for example: input method system wake-up operations, end input operations, etc., such that, in some cases, for example: suppose that a user can input by clicking the terminal of the user, and under the condition that both hands of the user are occupied or fingers of the user are injured, the user is inconvenient to click a specific position on the terminal, so that the user cannot complete input; in other cases, for example: suppose that the user can input the information in a voice control mode, and the user is inconvenient to input the voice information, so that the user cannot complete the input, and the input experience of the user is reduced.

Disclosure of Invention

In order to solve the above technical problem, embodiments of the present invention provide an input method, apparatus and device, so that even when a user is inconvenient to use a certain mode for input, the user can select a more convenient mode (such as voice input or image input) from other multiple optional modes to complete input on an application installed in a terminal, thereby improving the input experience of the user.

In a first aspect, an embodiment of the present invention provides an input method, which may specifically include:

receiving first information, wherein the first information is at least one of a plurality of input types;

selecting an input method awakening condition corresponding to a first input type according to the first input type of the first information;

if the first information meets the input method awakening condition, starting to receive input information;

receiving second information, wherein the second information is at least one of a plurality of input types;

selecting an input ending condition corresponding to a second input type according to the second input type of the second information;

and if the second information meets the input ending condition, ending the reception of the input information and obtaining an input result according to the received input information.

Optionally, the first input type comprises at least one of the following input types:

a touch screen key input type, a voice input type and an image input type;

the second input type includes at least one of the following input types:

a touch screen key input type, a voice input type, and an image input type.

Optionally, if the first information is first voice information, selecting an input method wakeup condition corresponding to the first input type according to the first input type of the first information includes:

recognizing the input type of the first voice information as a voice input type;

selecting a preset awakening semantic corresponding to the voice input type as the input method awakening condition;

if the first information meets the input method awakening condition, specifically: a first semantic corresponding to the first voice message is matched with the preset awakening semantic;

if the second information is second voice information, selecting an input end condition corresponding to a second input type according to the second input type of the second information, including:

recognizing the input type of the second voice information as a voice input type;

selecting a preset ending semantic corresponding to the voice input type as the input ending condition;

if the second information meets the input end condition, specifically: and matching a second semantic corresponding to the second voice message with the preset ending semantic.

Optionally, if the first information is first image information, the selecting, according to a first input type of the first information, an input method wake-up condition corresponding to the first input type includes:

collecting the first image information;

recognizing the input type of the first image information as an image input type;

selecting a preset awakening image corresponding to the image input type as the input method awakening condition;

if the first information meets the input method awakening condition, specifically: the first image information is matched with the preset awakening image;

if the second information is second image information, selecting an input end condition corresponding to a second input type according to the second input type of the second information, including:

collecting the second image information;

recognizing the input type of the second image information as an image input type;

selecting a preset ending image corresponding to the image input type as the input ending condition;

if the second information meets the input end condition, specifically: the second image information is matched with the preset ending image.

Optionally, if the first information satisfies an input method wakeup condition, the starting to receive input information includes:

and if the first information meets the input method awakening condition corresponding to the target input mode, starting to receive the input information in the target input mode.

Optionally, the target input mode comprises: a voice input mode, a lip language input mode or an empty handwriting input mode;

wherein, in the voice input mode, the input information is voice information;

in the lip language input mode, the input information is a lip language image;

in the space handwriting input mode, the input information is a handwritten image.

Optionally, the method further comprises:

receiving third information and fourth information, wherein the third information meets the input method awakening condition corresponding to a third input type, and the fourth information meets the input method awakening condition corresponding to a fourth input type;

and if the priority of the third input type is higher than that of the fourth input type, determining that the third input type is the target input mode, and triggering execution of the start to receive the input information in the target input mode.

Optionally, the method further comprises:

receiving fifth information and sixth information, wherein the fifth information meets the input method system awakening condition, and the sixth information meets the input ending condition;

and if the priority of the input type corresponding to the fifth information is higher than that of the input type corresponding to the sixth information, triggering to execute the start of receiving the input information.

Optionally, after the obtaining the input result, the method further comprises:

and sending the input result.

In a second aspect, an embodiment of the present invention further provides an input device, which may specifically include:

the first receiving unit is used for receiving first information, and the first information is at least one of a plurality of input types;

the first selection unit is used for selecting an input method awakening condition corresponding to a first input type according to the first input type of the first information;

a second receiving unit, configured to start receiving input information if the first information meets the input method wake-up condition;

the third receiving unit is used for receiving second information, and the second information is at least one of multiple input types;

a second selection unit, configured to select an input end condition corresponding to a second input type of the second information according to the second input type;

and the acquisition unit is used for finishing receiving the input information and acquiring an input result according to the received input information if the second information meets the input finishing condition.

a touch screen key input type, a voice input type and an image input type;

the second input type includes at least one of the following input types:

a touch screen key input type, a voice input type, and an image input type.

Optionally, if the first information is first voice information, the first selecting unit includes:

the first recognition subunit is used for recognizing that the input type of the first voice information is a voice input type;

the second selection subunit is used for selecting a preset awakening semantic corresponding to the voice input type as the awakening condition of the input method;

if the second information is second voice information, the second selecting unit includes:

the second recognition subunit is used for recognizing that the input type of the second voice information is a voice input type;

the second selection subunit is used for selecting a preset ending semantic corresponding to the voice input type as the input ending condition;

Optionally, if the first information is first image information, the first selecting unit includes:

the first acquisition subunit is used for acquiring the first image information;

a third identifying subunit, configured to identify an input type of the first image information as an image input type;

the third selection subunit is used for selecting a preset awakening image corresponding to the image input type as the awakening condition of the input method;

if the second information is second image information, the second selecting unit includes:

the second acquisition subunit is used for acquiring the second image information;

a fourth identifying subunit, configured to identify an input type of the second image information as an image input type;

a fourth selection subunit, configured to select a preset end image corresponding to the image input type as the input end condition;

Optionally, the second receiving unit is specifically configured to:

wherein, in the voice input mode, the input information is voice information;

in the lip language input mode, the input information is a lip language image;

Optionally, the apparatus further comprises:

a fourth receiving unit, configured to receive third information and fourth information, where the third information meets the input method wake-up condition corresponding to a third input type, and the fourth information meets the input method wake-up condition corresponding to a fourth input type;

a determining unit, configured to determine that the third input type is the target input mode and trigger execution of the start to receive the input information in the target input mode if the priority of the third input type is higher than the priority of the fourth input type.

Optionally, the apparatus further comprises:

a fifth receiving unit, configured to receive fifth information and sixth information, where the fifth information meets the system wake-up condition of the input method, and the sixth information meets the input end condition;

and the triggering unit is used for triggering and executing the receiving starting input information if the priority of the input type corresponding to the fifth information is higher than that of the input type corresponding to the sixth information.

Optionally, the apparatus further comprises:

a sending unit, configured to send the input result after the obtaining of the input result.

In a third aspect, embodiments of the present invention also provide an input device, including a memory, and one or more programs, where the one or more programs are stored in the memory, and configured to be executed by the one or more processors includes a processor configured to perform the method as provided in the foregoing first aspect.

In a fourth aspect, embodiments of the present invention also provide a non-transitory computer-readable storage medium, wherein instructions of the storage medium, when executed by a processor of an input device, enable the input device to perform the method as provided in the first aspect.

In the embodiment of the invention, if a user needs to call an input method system on a terminal for inputting, the user can input first information to the terminal by at least one of multiple input types, after the terminal receives the first information, firstly, an input method awakening condition corresponding to the first input type is selected according to the first input type of the first information, then, whether the first information meets the input method awakening condition is judged, if so, the input method system is awakened, and the input information is started to be received; then, when the user inputs the second information to the terminal by at least one of the multiple input types, the input method system receives the second information, can select an input ending condition corresponding to the second input type according to the second input type of the second information, finally, judges whether the second information meets the input ending condition, if so, ends the receiving of the input information, and obtains an input result according to the received input information. Therefore, the embodiment of the invention provides various ways for waking up the input method system and ending the input operation, a user can input the first information and the second information by adopting at least one of various input types according to different requirements of the user, the problem that the input of the user is inconvenient because the input requirement of the user cannot be met under a single input type is solved, the diversification of the waking up and ending operations of the input method system is realized, convenience is provided for the user, and the input experience of the user is improved.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments described in the present invention, and it is obvious for those skilled in the art to obtain other drawings according to these drawings.

FIG. 1 is a schematic flow chart of an input method according to an embodiment of the present invention;

FIG. 2 is a flow chart illustrating an example of an input method according to an embodiment of the present invention;

FIG. 3 is a flow chart illustrating another example of an input method according to an embodiment of the present invention;

FIG. 4 is a schematic structural diagram of an input device according to an embodiment of the present invention;

FIG. 5 is a schematic structural diagram of an input device according to an embodiment of the present invention;

fig. 6 is a schematic structural diagram of a server in an embodiment of the present invention.

Detailed Description

In order to make the technical solutions of the present invention better understood, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

With the development of science and technology, various applications appear on the terminal, and convenient services are provided for various aspects of clothes, food, live, rows and the like of people. The input method system is used as an essential tool for information interaction between the user and various applications, and the user can express own requirements in various applications.

Currently, when an input operation is performed in an application, in some cases, a user is often required to click a specific position on a terminal, for example: when the user A needs to chat with the friend B through WeChat, firstly, an input box on the terminal needs to be clicked, the input method system is awakened, then, on an input interface, the content is input by clicking a corresponding key, and finally, the input operation is finished by clicking a return function key. However, for example: in the case where the user's hands are occupied, another example is: under the condition that the fingers of the user are injured, the user cannot accurately click the terminal, so that the user cannot complete input by clicking a specific position on a terminal interface, and input experience of the user is reduced. In other cases, the user can wake up the input method system by inputting voice control, then continue to input specific contents by voice, and finally end the voice input operation by inputting voice control. However, for example: the user can not input the voice information to the terminal in public places or other places needing silence, so that the user can not complete input through voice control, and input experience of the user is reduced.

Based on this, in the embodiment of the present invention, a more convenient input method is provided, and if a user needs to call the input method system on a terminal for input, a specific implementation manner includes: a user can input first information to a terminal by at least one of multiple input types, after the terminal receives the first information, firstly, an input method awakening condition corresponding to the first input type is selected according to the first input type of the first information, then, whether the first information meets the input method awakening condition is judged, if so, an input method system is awakened, and input information begins to be received; then, when the user inputs the second information to the terminal by at least one of the multiple input types, the input method system receives the second information, can select an input ending condition corresponding to the second input type according to the second input type of the second information, finally, judges whether the second information meets the input ending condition, if so, ends the receiving of the input information, and obtains an input result according to the received input information.

Therefore, the embodiment of the invention provides various ways for waking up the input method system and ending the input operation, a user can input the first information and the second information by adopting at least one of various input types according to different requirements of the user, the problem that the input of the user is inconvenient because the input requirement of the user cannot be met under a single input type is solved, the diversification of the waking up and ending operations of the input method system is realized, convenience is provided for the user, and the input experience of the user is improved.

Various non-limiting embodiments of the present invention are described in detail below with reference to the accompanying drawings.

Exemplary method

Fig. 1 is a schematic flow chart of an input method according to an embodiment of the present invention. Referring to fig. 1, in this embodiment, the method may specifically include the following steps 101 to 106:

step 101, receiving first information, wherein the first information is at least one of a plurality of input types.

In specific implementation, when a user uses an application and wants to perform operations such as content search and chat interaction, the user needs to call the input method system first, and input the user's requirements in the current application through the input method system, so that the user needs to request to wake up the input method system first. To provide more ways of waking up, the user may employ at least one of a variety of input types; for example: in order to liberate the two hands of the user, the user can input first information without contacting the two hands with the terminal, and an input method system awakening request is initiated, so that the input type of the first information can be a voice input type or an image input type; another example is: the user may also input the first information by touching, and initiate an input method system wakeup request, and then, the input type of the first information may also be a touch screen key input type.

It is to be understood that the first information, which may refer to an intention for communicating to the input method system that the user wants to use the input method system, may be regarded as a request message for waking up the input method system. The first information may be information that can be collected without touching the terminal, and the input types thereof may include: a voice input type and an image input type; the first information may also be information that is collected only after the terminal is contacted, and the input type may further include: touch screen key input type.

As an example, if the input type of the first information is a voice input type, the first information may be first voice information, and then step 101 may specifically be: when a user wants to call the input method system to perform input operation, the input method system needs to be awakened first, at this time, the user can speak a section of voice towards the terminal, and the voice acquisition module of the terminal can acquire the section of voice and serve as first voice information (namely first information) to serve as a request message for subsequently awakening the input method system. For example: the received first voice message may be a voice message collected by a microphone of the terminal after a voice segment such as "start input", "start input" or "start reply" spoken by the user to the terminal.

As another example, if the input type of the first information is an image input type, the first information may be first image information, and specifically may be a gesture image, a lip language image, or the like. Then, step 101 may specifically be: when a user wants to call the input method system to perform input operation, the input method system needs to be awakened first, at this time, the user can put a specific model towards the terminal under the condition that the image acquisition module is started, and the image acquisition module of the terminal can acquire an image corresponding to the specific model and serve as first image information (namely first information) to serve as a request message for subsequently awakening the input method system. For example: the received first image information may be image information collected by a camera after a user puts a gesture representing "OK", "ye" or "six" against the camera of the terminal.

As another example, if the input type of the first message is a touch screen key input type, the first information may be first input information, and then step 101 may specifically be: when a user wants to call the input method system to perform input operation, the input method system needs to be awakened first, at this time, the user can click an input box in an application on an interface of the terminal, and the terminal can receive first input information (namely first information) corresponding to the click operation as a request message for subsequently awakening the input method system.

And 102, selecting an input method awakening condition corresponding to a first input type according to the first input type of the first information.

Step 103, if the first information meets the input method awakening condition, beginning to receive the input information.

It can be understood that each input type is provided with a corresponding input method wake-up condition, and the corresponding input method wake-up condition is used for identifying whether the first information can wake up the input method system according to the input method wake-up condition corresponding to the input type after the first information of the input type is received.

As an example, if the first information is first voice information, step 102 may specifically be: s11, recognizing the input type of the first voice information as a voice input type (i.e. a first input type); and S12, selecting a preset awakening semantic corresponding to the voice input type as an input method awakening condition.

As another example, if the first information is first image information, step 102 may specifically be: s21, acquiring first image information; s22, recognizing the input type of the first image information as an image input type (i.e., a first input type); and S23, selecting a preset awakening image corresponding to the image input type as an input method awakening condition.

As another example, if the first information is the first type information, step 102 may specifically be: s31, collecting first keying information; s32, identifying the input type of the first input information as the input type of the touch screen key (namely, the first input type); and S33, selecting a preset awakening position corresponding to the touch screen key input type as an input method awakening condition.

It is understood that the input method wake-up condition may include at least one of a preset wake-up semantic, a preset wake-up image, and a preset wake-up position, which are preset and stored for waking up the input method system. The first information meeting the input method awakening condition means that the first information is matched with a preset awakening semantic included in the input method awakening condition, or the first information is matched with a preset awakening image included in the input method awakening condition, or the first information is matched with a preset awakening position included in the input method awakening condition; the first information does not satisfy the input method awakening condition, and means that the first information is not matched with a preset awakening semantic, a preset awakening image and a preset awakening position included in the input method awakening condition.

In a specific implementation, in one case, if the received first information satisfies the input method wake-up condition, it indicates that the input method system is allowed to be woken up by the currently received first information, and then the input method system is woken up, at this time, the woken-up input method system may start to receive the input information, that is, the user may start to input the content to be input, and the content to be input may be received by the input method system as the input information.

In another case, if the received first information does not satisfy the input method wake-up condition, it indicates that the input method system is not allowed to be woken up by the currently received first information, and the input method system is not woken up by ignoring the first information. In this case, in order to improve the input experience of the user, the user may also be informed that the first information input by the user does not conform to the input method wake-up condition, and be prompted to input the first information again. Therefore, the wrong awakening of the input method system caused by misoperation can be avoided, and the accuracy of the input method is improved.

As an example, when the first information is the first voice information, then, analyzing whether the first information satisfies the input method wake-up condition in step 103 may specifically include the following S41 to S42:

s41, recognizing the first voice information to obtain a first semantic corresponding to the first voice information.

In specific implementation, when the first voice information is acquired through the voice acquisition module (for example, a microphone), semantic recognition can be performed on the first voice information to obtain a first semantic corresponding to the first voice information. In one case, the received first voice information may be converted into corresponding first text information, then the semantics corresponding to the first text information is identified, and the semantics corresponding to the first text information is used as the first semantics corresponding to the first voice information; in another case, the semantic meaning corresponding to the first voice information may also be directly recognized as the first semantic meaning.

As an example, assuming that "the message to start replying now" input by the user through voice is taken as the first voice information, by recognizing the first voice information, the first semantic corresponding to the "the message to start replying now" can be obtained as: a reply is started.

S42, matching the first semantic with a preset awakening semantic; and the first semantic meaning is matched with the preset awakening semantic meaning to indicate that the first voice information meets the awakening condition of the input method.

In specific implementation, after receiving first voice information and recognizing a first semantic corresponding to the first voice information, in order to determine whether the first voice information meets an input method awakening condition, the first semantic may be matched with a preset awakening semantic included in the preset input method awakening condition, and if the first semantic is matched with the preset awakening semantic, it indicates that the input method system is allowed to be awakened by using the first voice information, that is, the first voice information meets the input method awakening condition. Otherwise, if the preset awakening semantic matched with the first semantic is not found, it indicates that the input method system awakened by the first voice information is not set, that is, the first voice information does not meet the input method awakening condition.

For example: the input method awakening condition is assumed to include two preset awakening semantics which are respectively as follows: presetting awakening semantics A-starting input, and presetting awakening semantics B-starting reply. If the first voice message is "reply to message is to begin now", the corresponding first semantics are: and beginning to reply, and then, matching the first semantic with a preset awakening semantic B, so as to determine that the first voice message meets the awakening condition of the input method. If the first voice message is 'eating now', the corresponding first semantics are: and starting to eat, and determining that the first voice information does not meet the input method awakening condition no matter the first semantic is not matched with the preset awakening semantic A or the preset awakening semantic B.

It should be noted that, in the process of matching the first semantic meaning and the preset wakeup semantic meaning, since the preset wakeup semantic meaning may not include all expressions meeting the wakeup condition of the input method, when it is found that the first semantic meaning and the preset wakeup semantic meaning are not completely the same, it may be further analyzed whether the first semantic meaning and the preset wakeup semantic meaning express the same semantic meaning, such as: and the first semantic meaning is matched with the preset awakening semantic meaning if the first semantic meaning comprises the synonym.

As another example, when the first information is first image information, then, analyzing whether the first information satisfies an input method wake-up condition in step 103 may specifically include: matching the first image information with a preset awakening image; and the first image information is matched with the preset awakening image to indicate that the first image information meets the awakening condition of the input method.

In specific implementation, after receiving the first image information, in order to determine whether the first image information satisfies the input method wake-up condition, the first image information may be matched with a preset wake-up image included in the preset input method wake-up condition, and if the first image information is matched with the preset wake-up image, it indicates that the first image information is allowed to wake up the input method system, that is, the first image information satisfies the input method wake-up condition. Otherwise, if the preset awakening image matched with the first image information cannot be found, it indicates that the input method system awakened by the first image information is not set, that is, the first image information does not meet the input method awakening condition.

For example: assume that the input method wake-up condition includes three preset wake-up images, which are respectively: the preset wake-up image C-represents the scissor hand gesture image of "je", the preset wake-up image D-represents the gesture image of "OK", and the preset wake-up image E-represents the gesture image of "six". If the first image information is a gesture image in which the index finger and the middle finger are straight and the other fingers are bent, that is, the first image information is a scissor-hand gesture image representing "je", then the first image information is matched with the preset wake-up image C, and it may be determined that the first image information satisfies the input method wake-up condition. If the first image information is a gesture image in which five fingers are completely straightened, the first image information is not matched with the preset awakening image C, the preset awakening image D and the preset awakening image E, and the first image information can be determined not to meet the awakening condition of the input method.

It can be understood that the preset wake-up image can be flexibly set, and the matching condition that the first image information and each preset wake-up image need to satisfy can also be flexibly set. The matching between the first image information and the preset wake-up image may refer to that the similarity between the first image information and the preset wake-up image is greater than a preset similarity threshold, that the form represented by the first image information is consistent with the form represented by the preset wake-up image, that the first image information and the preset wake-up image information are symmetrical, and the like.

It should be noted that, in order to improve the input experience and liberate the two hands of the user, the implementation manner in which the user inputs the first information to wake up the input method system without contacting the terminal in the embodiment of the present invention is described above, but the implementation manner in which the input method system is woken up by clicking a specific position of the terminal (for example, clicking an input box on a touch screen of the terminal) is also included in the embodiment of the present invention.

In some implementations, when it is analyzed that the first information satisfies the input method wake-up condition, the input method system can be woken up and start to receive the input information. Among them, the input method system generally has a plurality of input modes, for example: the method comprises a contact input mode, a voice input mode, a lip language input mode and an empty handwriting input mode, wherein the contact input mode is a conventional input mode by clicking an input interface presented on a terminal, such as: inputting by clicking a key in an input interface or inputting by handwriting on the input interface; in the voice input mode, the user inputs voice information in a voice mode; in a lip language input mode, a user inputs a lip language image through an image acquisition module of a terminal; in the space handwriting input mode, a user inputs a handwriting image through an image acquisition module of the terminal.

In general, for the convenience of input by the user, the first information may include a part requesting an input mode of inputting information in addition to a part requesting to wake up the input method system. Then, if the first information satisfies the input method wakeup condition in step 103, the method starts to receive input information, including: and if the first information meets the input method awakening condition corresponding to the target input mode, starting to receive the input information in the target input mode.

It can be understood that each preset wake-up semantic in the input method wake-up condition corresponds to one input mode, and similarly, each preset wake-up image in the input method wake-up condition also corresponds to one input mode. However, one input pattern may correspond to at least one preset wake-up semantic and/or at least one preset wake-up image.

In one case, if the first information is the first voice information and it is determined that the first semantic meaning corresponding to the first voice information matches the preset awakening semantic meaning, the input mode corresponding to the preset awakening semantic meaning matching the first semantic meaning may be further determined and recorded as the target input mode, and after the input method system is awakened, the user starts inputting information in the target input mode, and the input method system also receives the input information of the user in the target input mode. For example: assuming that the preset awakening semantics a, the start voice reply and the start voice input correspond to the voice input modes, the preset awakening semantics b, the start lip language reply and the start lip language input correspond to the lip language input modes, and the preset awakening semantics c, the start space handwriting reply and the start space handwriting input correspond to the space handwriting input modes. When the first semantic is matched with the preset awakening semantic a, the input information can be received in a voice input mode; when the first semantic and the preset awakening semantic b are matched, the input information can be received in a lip language input mode; when the first semantic and the preset awakening semantic c are matched, the input information can be received in the space handwriting input mode.

In another case, if the first information is the first image information and it is determined that the first image information matches the preset wakeup image, the input mode corresponding to the preset wakeup image matching the first image information may be further determined and recorded as the target input mode, and after waking up the input method system, the user starts inputting information in the target input mode, and the input method system also receives the input information of the user in the target input mode. For example: assume that the preset wake-up image d "represents a scissor hand gesture image of 'je' corresponding to a voice input mode, the preset wake-up image e" represents a gesture image of 'OK' corresponding to a lip language input mode, and the preset wake-up image f "represents a gesture image of 'six' corresponding to an alternate space handwriting input mode. When the first image information is matched with the preset awakening image d, the input information can be received in a voice input mode; when the first image information is matched with the preset awakening image e, the input information can be received in a lip language input mode; when the first image information and the preset wake-up image f match, then the input information may be received starting in the space handwriting input mode.

It should be noted that, in some examples, the part of the input mode requesting for inputting information may not be included in the first information, but information indicating the input mode is separately received after determining that the first information requesting for waking up the input method system satisfies the input method wake-up condition. In the implementation manner, after the first information is determined to satisfy the input method wake-up condition and wake up the input method system, the user may be prompted to "select the target input mode", and after the user enters the instruction information for instructing the input mode according to the prompt, the user may obtain the target input mode by analyzing the instruction information and start to receive the input information in the target input mode.

It should be noted that, in order to improve the input experience of the user and enable the user to input the content to be input in the correct input mode as soon as possible after waking up the input method system, the user may be prompted to input in the target input mode after waking up the input method system and determining the target input mode, for example: after the target input mode is determined to be the voice input mode, the terminal can prompt 'please start inputting in a voice form' in a text form, and can also prompt 'please start inputting in a voice form' in a voice form.

It should be noted that, in order to liberate both hands, the user may enter the content to be input as the input content through the voice input mode, the lip language input mode, or the space handwriting input mode without touching the terminal. However, in order to be suitable for more application scenarios, the embodiment of the present invention also includes an implementation manner in which the user enters the content to be input through a contact input mode (e.g., clicking a key in the input interface). Moreover, after the target input mode is determined, in the input process, the user can flexibly switch to other input modes for input according to actual requirements.

In some specific scenarios, it is considered that two pieces of first information may be received almost simultaneously and both conform to the input method wake-up condition, however, input types corresponding to the two pieces of first information are different, and in order that the input method may be effectively and conveniently used by a user, the embodiment of the present invention may further set different priorities for a plurality of pieces of first information of different input types. For example: the different first information types may be, in order from high to low according to a preset priority: contact, voice, gesture images, lip language images.

In a specific implementation, as shown in fig. 2, the embodiment of the present invention may further include:

step 201, receiving third information and fourth information, where the third information meets the input method wake-up condition corresponding to a third input type, and the fourth information meets the input method wake-up condition corresponding to a fourth input type.

It can be understood that, in order to distinguish between different received first information, two pieces of first information received almost simultaneously are respectively referred to as third information and fourth information, and the third information and the fourth information are analyzed through the above steps 102 to 103, respectively, to determine that the third information satisfies the input method wake-up condition corresponding to the third input type, and the fourth information satisfies the input method wake-up condition corresponding to the fourth input mode. The input type corresponding to the third information may be a touch screen key input type, a voice input type, a gesture image input type or a lip language image input type; the input type corresponding to the fourth information may also be a touch screen key input type, a voice input type, a gesture image input type, or a lip language image input type.

Step 202, if the priority of the third input type is higher than the priority of the fourth input type, determining that the first input type is the target input mode, and triggering execution of the start to receive the input information in the target input mode.

In a specific implementation, priorities of the third input type corresponding to the third information and the fourth input type corresponding to the fourth information may be respectively determined, and whether the priority of the third input type is higher than that of the fourth input type may be compared. In one case, if the priority of the third input type is higher than that of the fourth input type, it indicates that the third input type corresponding to the input method wakeup condition satisfied by the third information needs to be used as the target input mode, and the step 103 of "starting to receive input information" may specifically be "ignoring the fourth information and starting to receive input information in the first input type (i.e., the target input mode)". In another case, if the priority of the third input type is lower than that of the fourth input type, it indicates that the fourth input type corresponding to the input method wakeup condition satisfied by the fourth information needs to be the target input mode, and the "start receiving input information" in step 103 may specifically be "ignore the third information and start receiving input information with the fourth input type (i.e., the target input mode)".

It should be noted that, if the third input type and the fourth input type are the same or their corresponding priorities are the same, the information received later may be ignored, and on the basis of the information received earlier, if the information received earlier in the third information and the fourth information satisfies the input method wake-up condition, the input type corresponding to the information received earlier in the third information and the fourth information is taken as the target input mode, and the input information continues to be received in the determined target input mode.

For example: the first information types are assumed to be sequentially as follows according to the preset priority from high to low: the method comprises the steps that the input type of a touch screen key is a voice input type, the input type of a gesture image or the input type of a lip language image, received third information corresponds to the third input type and is the voice input type, received fourth information corresponds to the input type and is the input type of the gesture image, and the third information meets the preset awakening semantic a 'start voice reply' in the awakening condition of an input method; the fourth information satisfies a preset wake-up image e ' representing a gesture image of ' OK ' in the input method wake-up condition. Since the priority of the third information corresponding to the input type "voice input type" is higher than that of the fourth information corresponding to the input type "gesture image input type", the reception of the voice input information is started with the third input type (i.e., voice input type) as the target input mode.

Therefore, the problem of input confusion caused by receiving a plurality of pieces of first information almost at the same time can be effectively solved, the user can conveniently and effectively complete input by setting different priorities for corresponding types of each piece of first information, and the input experience of the user is improved.

It can be understood that, from the moment of beginning to receive the input information, the user can continuously input the desired input content through the target input mode, that is, the input information is continuously increased along with the increase of the input content and the time of the user.

And 104, receiving second information, wherein the second information is at least one of a plurality of input types.

It is understood that the second information, which may be intended to convey the intention of the user of the input method system to end the input operation, may be regarded as a request message for ending the input operation. The second information may be information that can be collected without touching the terminal, and the input types thereof may include: a voice input type and an image input type.

As an example, if the input type of the second information is a voice input type, the second information may be second voice information, and then step 104 may specifically be: when the user wants to end the input operation, the user can speak a section of voice to the terminal, and the voice acquisition module of the terminal can acquire the section of voice and use the section of voice as second voice information (namely second information) as a request message for subsequently ending the input operation. For example: the received second voice message may be a voice message collected by a microphone of the terminal after a voice segment such as "end input" or "complete input" is spoken by the user to the terminal.

As another example, if the input type of the second information is an image input type, the second information may be second image information, and specifically may be a gesture image, a lip language image, or the like. Then, step 104 may specifically be: when the user wants to end the input operation, the user can put a specific model towards the terminal under the condition that the image acquisition module is started, and the image acquisition module of the terminal can acquire an image corresponding to the specific model and serve as second image information (namely second information) serving as a request message for subsequently ending the input operation. For example: the received second image information may be image information acquired by the camera after the user has swung out a gesture representing "five" or "eight" or the like to the camera of the terminal.

As another example, if the input type of the second message is a touch screen key input type, the second information may be second entered information, and then step 104 may specifically be: when the user wants to end the input operation, the user can click a sending key in the application on an interface of the terminal, and the terminal can receive second keying-in information (namely second information) corresponding to the click operation as a subsequent request message for ending the input operation.

And 105, selecting an input ending condition corresponding to the second input type according to the second input type of the second information.

And 106, if the second information meets the input ending condition, ending the reception of the input information, and obtaining an input result according to the received input information.

It can be understood that each input type is provided with a corresponding input ending condition, and the corresponding input ending condition is used for judging whether the second information can end the input according to the input ending condition corresponding to the input type after the second information of the input type is received.

As an example, if the second information is the second voice information, step 105 may specifically be: s51, recognizing the input type of the second voice information as a voice input type (i.e. a second input type); and S52, selecting a preset ending semantic corresponding to the voice input type as an input ending condition.

As another example, if the second information is second image information, step 105 may specifically be: s61, acquiring second image information; s62, recognizing the input type of the second image information as an image input type (i.e., a second input type); s63, a preset end image corresponding to the image input type is selected as an input end condition.

As another example, if the second information is the second type information, step 105 may specifically be: s71, collecting second keying information; s72, recognizing the input type of the second input information as the touch screen key input type (namely, the second input type); and S73, selecting a preset ending position corresponding to the touch screen key input type as an input ending condition.

It is understood that the input end condition may include at least one of a preset end semantic, a preset end image and a preset end position, which are preset and stored for ending the input operation this time. The second information meeting the input end condition means that the second information is matched with a preset end semantic included in the input end condition, or the second information is matched with a preset end image included in the input end condition, or the second information is matched with a preset end position included in the input end condition; the second information does not satisfy the input end condition, which means that the second information and the preset end semantic, the preset end image and the preset end position included in the input end condition are not matched.

In a specific implementation, in one case, if the received second information satisfies the input end condition, it indicates that the current input operation is allowed to be ended by the currently received second information, and then the reception of the input information is ended, at this time, the input result may be obtained according to the received input information, that is, all the input information input by the user is taken as the input result from "start receiving the input information" in step 103 to "end receiving the input information" in step 106.

In another case, if the received second information does not satisfy the input end condition, it indicates that the currently received second information is not allowed to end the current input operation, and the second information is ignored and the reception of the input information is not ended. In this case, in order to improve the input experience of the user, the user may be further informed that the second information input by the user does not meet the input end condition, and the user is prompted to: if the input is to be ended, the second information can be input again. Therefore, the input operation error can be prevented from being ended due to misoperation, and the accuracy of the input method is improved.

As an example, when the second information is the second voice information, then, whether the second information satisfies the input end condition is analyzed in step 106, which may specifically include the following S81 to S82:

and S81, recognizing the second voice information to obtain a second semantic corresponding to the second voice information.

In specific implementation, when the second voice information is acquired through the voice acquisition module (for example, a microphone), semantic recognition can be performed on the second voice information to obtain a second semantic corresponding to the second voice information. In one case, the received second voice information can be converted into corresponding second text information, and then the semantics corresponding to the second text information is recognized and recorded as the second semantics corresponding to the second voice information; in another case, the semantic meaning corresponding to the second speech information may also be directly recognized as the second semantic meaning.

As an example, assuming that "the input is completed" of the user through the voice input is taken as the second voice information, by recognizing the second voice information, the second semantic meaning corresponding to "the input is completed" can be obtained as follows: the input is completed.

S82, matching the second semantic with a preset ending semantic; and matching the second semantic meaning with the preset ending semantic meaning to show that the second voice information meets the input ending condition.

In specific implementation, after receiving the second voice message and recognizing a second semantic corresponding to the second voice message, in order to determine whether the second voice message satisfies the input end condition, the second semantic may be matched with a preset end semantic included in the preset input end condition, and if the second semantic matches the preset end semantic, the input operation is performed after the second voice message is allowed to be used, that is, the second voice message satisfies the input end condition. Otherwise, if the preset ending semantic meaning matched with the second semantic meaning cannot be found, the fact that the second voice information is not used for ending the input operation is not set, namely the second voice information does not meet the input ending condition.

For example: assume that the input end condition includes two preset end semantics, which are: and presetting an ending semantic I-finishing input and presetting an ending semantic J-ending reply. If the second voice message is 'input is finished now', the corresponding second semantics are: and completing the input, wherein the second semantic is matched with the preset awakening semantic I, and the second voice information can be determined to meet the input end condition. If the second voice message is 'I eat up', the corresponding second semantics are as follows: and ending the meal, wherein the second semantic is not matched with the preset ending semantic I or the preset ending semantic J, and the second voice information can be determined not to meet the input ending awakening condition.

It should be noted that, in the process of matching the second semantic meaning and the preset end semantic meaning, because the preset end semantic meaning may not include all expressions meeting the input end condition, when it is found that the second semantic meaning and the preset end semantic meaning are not completely the same, it may also be analyzed whether the second semantic meaning and the preset end semantic meaning express the same semantic meaning, such as: synonyms are included, and if so, the second semantic is also considered to match the pre-established end semantic.

As another example, when the second information is second image information, then, analyzing whether the second information satisfies the input end condition in step 106 may specifically include: matching the second image information with a preset ending image; and the second image information is matched with the preset ending image and represents that the second image information meets the input ending condition.

In a specific implementation, after receiving the second image information, in order to determine whether the second image information satisfies the input end condition, the second image information may be matched with a preset end image included in the preset input end condition, and if the second image information matches the preset end image, it indicates that the second image information is allowed to end the input operation, that is, the second image information satisfies the input end condition. Otherwise, if the preset end image matching the second image information is not found, it indicates that the end of the input operation with the second image information has not been set, i.e., the second image information does not satisfy the input end condition.

For example: assume that the input end condition includes three preset end images, which are: the preset end image L-represents a gesture image of "eight", the preset end image M-represents a gesture image of "five", and the preset end image N-represents a gesture image of "very bar". If the second image information is a gesture image in which the thumb is extended and the other fingers are bent, that is, the second image information is a gesture image representing a "very bar", then the second image information is matched with the preset end image N, and it may be determined that the second image information satisfies the input end condition. If the second image information is a gesture image in which all five fingers are bent, the second image information is not matched with the preset end image L, the preset end image M, and the preset end image N, and it can be determined that the second image information does not satisfy the input end condition.

It is understood that the preset end image can be flexibly set, and the matching condition that the second image information and each preset end image need to satisfy can also be flexibly set. The matching between the second image information and the preset end image may refer to that the similarity between the second image information and the preset end image is greater than a preset similarity threshold, that the form represented by the second image information is consistent with the form represented by the preset end image, that the second image information and the preset end image information are symmetrical, and the like.

It should be noted that, in order to improve the input experience and liberate both hands of the user, the implementation manner in which the user inputs the second information to end the input operation is described in the embodiment of the present invention without contacting the terminal, but the embodiment of the present invention also includes an implementation manner in which the input operation is ended by clicking a specific position of the terminal (for example, clicking a return key on a touch screen of the terminal).

In some specific scenarios, considering that the fifth information and the sixth information may be received almost simultaneously, where the fifth information conforms to the input method wake-up condition and the sixth information conforms to the input end condition, then, in order that the input method may be effectively and conveniently used by the user, the embodiment of the present invention may further set different priorities for different types of information. For example: the different information types may be, in order from high to low according to a preset priority: a touch screen key input type, a voice input type, a gesture image input type, or a lip language image input type.

In a specific implementation, as shown in fig. 3, the embodiment of the present invention may further include:

step 301, receiving fifth information and sixth information, where the fifth information meets the system wake-up condition of the input method, and the first stream information meets the input end condition.

It is understood that, in order to distinguish the first information and the second information in the embodiment shown in fig. 1 and the third information and the fourth information in the corresponding embodiment of fig. 2, two pieces of information received almost simultaneously are respectively referred to as fifth information and sixth information, and the fifth information and the sixth information are analyzed in the above-mentioned step 103 and step 106, respectively, to determine that the fifth information satisfies the input method wakeup condition and the sixth information satisfies the input end condition. The input type corresponding to the fifth information may be a touch screen key input type, a voice input type, a gesture image input type or a lip language image input type; the input type corresponding to the sixth information may also be a touch screen key input type, a voice input type, a gesture image input type, or a lip language image input type.

Step 302, if the priority of the input type corresponding to the fifth information is higher than the priority of the input type corresponding to the sixth information, triggering to execute the start of receiving the input information.

In a specific implementation, priorities of the input type corresponding to the fifth information and the input type corresponding to the sixth information may be respectively determined, and whether the priority of the input type corresponding to the fifth information is higher than the priority of the input type corresponding to the sixth information may be compared. In one case, if the priority of the input type corresponding to the fifth information is higher than that of the input type corresponding to the sixth information, it indicates that the input method wakeup condition satisfied by the fifth information needs to be met, that is, "start receiving input information" in step 103 that should be performed after the input method wakeup condition is satisfied is performed. In another case, if the priority of the input type corresponding to the fifth information is lower than the priority of the input type corresponding to the sixth information, it indicates that the input end condition satisfied by the sixth information is required, that is, "end of receiving the input information and obtain the input result according to the received input information" in step 106 that should be executed after the input end condition is satisfied is executed.

It should be noted that, if the input type corresponding to the fifth information is the same as the input type corresponding to the sixth information or the corresponding priority of the fifth information is the same as the input type corresponding to the sixth information, the information received later may be ignored, and it is determined whether to perform "start receiving the input information" in step 103 or "end receiving the input information" in step 106, based on the condition that the information received earlier in the fifth information and the sixth information satisfies, and the input result is obtained according to the received input information.

For example: the input types corresponding to the information are supposed to be sequentially as follows according to the preset priority from high to low: the method comprises the steps that a touch screen key input type, a voice input type, a gesture image input type or a lip language image input type is adopted, received fifth information corresponds to the voice input type, received sixth information corresponds to the gesture image input type, and the fifth information meets a preset awakening semantic a 'start voice reply' in an input method awakening condition; the sixth information satisfies a preset end image M-a gesture image representing "five" in the input end condition. Since the priority of the input type "voice input type" corresponding to the fifth information is higher than the priority of the input type "gesture image input type" corresponding to the sixth information, the input information starts to be received on the basis of the input method wake-up condition satisfied by the fifth information.

Therefore, the problem of input confusion caused by almost simultaneously receiving the information for awakening the input method system and finishing the input operation can be effectively solved, the user can conveniently and effectively complete input by setting different priorities for different types corresponding to the information, and the input experience of the user is improved.

It should be noted that, after receiving a plurality of second information for ending the input operation, which have different corresponding types, almost at the same time, the receiving of the input information may be ended with reference to any one of the received second information.

It should be noted that, after obtaining the received input result, the input result may be subjected to different operations according to different settings, for example: after the input result is obtained, storing the input result in a space corresponding to a target address according to user setting, and sending the input result after receiving a preset sending instruction (such as a voice sending instruction, a gesture image corresponding sending instruction, or a sending instruction corresponding to a specific action of an operation terminal) of a user; another example is: after the input result is obtained, the input result is directly sent according to the setting of the user; for another example: and after the input result is obtained, prompting the user to set according to the user setting, converting the input result into a text result, prompting the user to confirm or modify, and sending the input result after the user confirms without errors, or sending a text result corresponding to the input result, or sending a text result without errors after modification.

It can be seen that, in the embodiment of the present invention, when a user needs to invoke an input method system on a terminal for input, the user may input first information to the terminal in at least one of multiple input types, after the terminal receives the first information, first, an input method wake-up condition corresponding to the first input type is selected according to the first input type of the first information, then, whether the first information meets the input method wake-up condition is determined, if so, the input method system is woken up, and input information starts to be received; then, when the user inputs the second information to the terminal by at least one of the multiple input types, the input method system receives the second information, can select an input ending condition corresponding to the second input type according to the second input type of the second information, finally, judges whether the second information meets the input ending condition, if so, ends the receiving of the input information, and obtains an input result according to the received input information. Therefore, the embodiment provides various ways for waking up the input method system and ending the input operation, the user can input the first information and the second information by adopting at least one of various input types according to different requirements of the user, the problem that the input of the user is inconvenient due to the fact that the input requirements of the user cannot be met under a single input type is solved, diversification of the waking up and ending operations of the input method system is achieved, convenience is provided for the user, and the input experience of the user is improved.

Exemplary device

Fig. 4 is a schematic structural diagram of an input device according to an embodiment of the present invention. Referring to fig. 4, in this embodiment, the apparatus may specifically include:

a first receiving unit 401, configured to receive first information, where the first information is at least one of multiple input types;

a first selecting unit 402, configured to select an input method wake-up condition corresponding to a first input type of the first information according to the first input type;

a second receiving unit 403, configured to start receiving input information if the first information meets the input method wake-up condition;

a third receiving unit 404, configured to receive second information, where the second information is at least one of multiple input types;

a second selecting unit 405, configured to select an input end condition corresponding to a second input type of the second information according to the second input type;

an obtaining unit 406, configured to end receiving the input information and obtain an input result according to the received input information if the second information satisfies the input end condition.

a touch screen key input type, a voice input type and an image input type;

the second input type includes at least one of the following input types:

a touch screen key input type, a voice input type, and an image input type.

Optionally, if the first information is first voice information, the first selecting unit 402 includes:

if the second information is second voice information, the second selecting unit 405 includes:

Optionally, if the first information is first image information, the first selecting unit 402 includes:

if the second information is second image information, the second selecting unit 405 includes:

Optionally, the second receiving unit 403 is specifically configured to:

wherein, in the voice input mode, the input information is voice information;

in the lip language input mode, the input information is a lip language image;

Optionally, the apparatus further comprises:

The apparatus shown in fig. 4 is an apparatus corresponding to the method shown in fig. 1, and the specific implementation manner and the achieved effect are similar to the method shown in fig. 1, and refer to the description in the method shown in fig. 1, which is not described again here.

Referring to fig. 5, input device 500 may include one or more of the following components: processing component 502, memory 504, power component 506, multimedia component 506, audio component 510, input/output (I/O) interface 512, sensor component 514, and communication component 516.

The processing component 502 generally controls overall operation of the device 500, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing components 502 may include one or more processors 520 to execute instructions to perform all or a portion of the steps of the methods described above. Further, the processing component 502 can include one or more modules that facilitate interaction between the processing component 502 and other components. For example, the processing component 502 can include a multimedia module to facilitate interaction between the multimedia component 506 and the processing component 502.

The memory 504 is configured to store various types of data to support operation at the input device 500. Examples of such data include instructions for any application or method operating on input device 500, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 504 may be implemented by any type or combination of volatile or non-volatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.

A power supply component 506 provides power to the various components of the input device 500. Power components 506 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for input device 500.

The multimedia component 506 includes a screen that provides an output interface between the input device 500 and the user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 506 includes a front facing camera and/or a rear facing camera. The front camera and/or the rear camera may receive external multimedia data when the input device 500 is in an operation mode, such as a photographing mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

The audio component 510 is configured to output and/or input audio signals. For example, the audio component 510 includes a Microphone (MIC) configured to receive external audio signals when the input device 500 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may further be stored in the memory 504 or transmitted via the communication component 516. In some embodiments, audio component 510 further includes a speaker for outputting audio signals.

The I/O interface 512 provides an interface between the processing component 502 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.

The sensor assembly 514 includes one or more sensors for providing various aspects of state assessment for the input device 500. For example, the sensor assembly 514 may detect the open/closed state of the input device 500, the relative positioning of the components, such as the display and keypad of the device 500, the sensor assembly 514 may also detect a change in the position of the input device 500 or a component of the input device 500, the presence or absence of user contact with the input device 500, the orientation or acceleration/deceleration of the input device 500, and a change in the temperature of the input device 500. The sensor assembly 514 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 514 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 514 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

The communication component 516 is configured to facilitate wired or wireless communication between the input device 500 and other devices. The input device 500 may access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 516 receives a broadcast signal or broadcast associated information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communications component 516 further includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

In an exemplary embodiment, the input device 500 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components for performing the above-described methods.

Specifically, an input device 500 is provided, which may be embodied as an input device, comprising a memory 504, and one or more programs, wherein the one or more programs are stored in the memory 504 and configured to be executed by the one or more processors 520, the one or more programs including instructions for:

a touch screen key input type, a voice input type and an image input type;

the second input type includes at least one of the following input types:

a touch screen key input type, a voice input type, and an image input type.

collecting the first image information;

collecting the second image information;

wherein, in the voice input mode, the input information is voice information;

in the lip language input mode, the input information is a lip language image;

Optionally, the processor 520 is further configured to execute the one or more programs including instructions for:

Optionally, after the obtaining the input result, the processor 520 is further configured to execute the one or more programs including instructions for:

and sending the input result.

Furthermore, embodiments of the present invention also provide a non-transitory computer-readable storage medium, such as the memory 504, comprising instructions executable by the processor 520 of the input device 500 to perform the above-described method. For example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.

A non-transitory computer readable storage medium in which instructions, when executed by a processor of an input device, enable the input device to perform an input method, the method comprising:

a touch screen key input type, a voice input type and an image input type;

the second input type includes at least one of the following input types:

a touch screen key input type, a voice input type, and an image input type.

collecting the first image information;

collecting the second image information;

wherein, in the voice input mode, the input information is voice information;

in the lip language input mode, the input information is a lip language image;

Optionally, the method further comprises:

Optionally, after the obtaining the input result, the method further comprises:

and sending the input result.

Fig. 6 is a schematic structural diagram of a server in an embodiment of the present invention. The server 600 may vary significantly due to configuration or performance, and may include one or more Central Processing Units (CPUs) 622 (e.g., one or more processors) and memory 632, one or more storage media 630 (e.g., one or more mass storage devices) storing applications 642 or data 644. Memory 632 and storage medium 630 may be, among other things, transient or persistent storage. The program stored in the storage medium 630 may include one or more modules (not shown), each of which may include a series of instruction operations for the server. Still further, the central processor 622 may be configured to communicate with the storage medium 630 and execute a series of instruction operations in the storage medium 630 on the server 600.

The server 600 may also include one or more power supplies 626, one or more wired or wireless network interfaces 650, one or more input-output interfaces 658, one or more keyboards 656, and/or one or more operating systems 641, such as Windows Server, Mac OS XTM, UnixTM, LinuxTM, FreeBSDTM, etc.

Other embodiments of the invention will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. This invention is intended to cover any variations, uses, or adaptations of the invention following, in general, the principles of the invention and including such departures from the present disclosure as come within known or customary practice within the art to which the invention pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the invention being indicated by the following claims.

It will be understood that the invention is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the invention is only limited by the appended claims

The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents, improvements and the like that fall within the spirit and principle of the present invention are intended to be included therein.

Claims

1. An input method, comprising:

2. The method of claim 1, wherein the first input type comprises at least one of the following input types:

a touch screen key input type, a voice input type and an image input type;

the second input type includes at least one of the following input types:

a touch screen key input type, a voice input type, and an image input type.

3. The method according to claim 1, wherein if the first message is a first voice message, the selecting an input method wake-up condition corresponding to the first input type according to the first input type of the first message comprises:

4. The method according to claim 1, wherein if the first information is first image information, the selecting an input method wakeup condition corresponding to the first input type according to the first input type of the first information comprises:

collecting the first image information;

collecting the second image information;

5. The method of claim 1, wherein if the first message satisfies an input method wakeup condition, the starting to receive the input message comprises:

6. The method of claim 5, wherein the target input mode comprises: a voice input mode, a lip language input mode or an empty handwriting input mode;

wherein, in the voice input mode, the input information is voice information;

in the lip language input mode, the input information is a lip language image;

7. The method of claim 5, further comprising:

8. An input device, comprising:

9. An input device comprising a memory, and one or more programs, wherein the one or more programs are stored in the memory, and wherein the one or more programs being configured to be executed by the one or more processors comprises instructions for performing the method of any of claims 1-7.

10. A non-transitory computer readable storage medium having instructions therein which, when executed by a processor of an input device, enable the input device to perform the method of any of the preceding claims 1 to 7.