CN113407099A

CN113407099A - Input method, device and machine readable medium

Info

Publication number: CN113407099A
Application number: CN202010188267.3A
Authority: CN
Inventors: 刘楚勇; 辜海玻; 刘祥; 刘晓龙
Original assignee: Beijing Sogou Technology Development Co Ltd
Current assignee: Beijing Sogou Technology Development Co Ltd
Priority date: 2020-03-17
Filing date: 2020-03-17
Publication date: 2021-09-17

Abstract

The embodiment of the invention provides an input method, an input device and a machine readable medium, wherein the input method specifically comprises the following steps: identifying an operation track of a user on a virtual keyboard; if the operation track is a handwriting track, determining character candidates corresponding to the handwriting track; and displaying the character candidates. The embodiment of the invention can improve the input efficiency.

Description

Input method, device and machine readable medium

Technical Field

The present invention relates to the field of input methods, and in particular, to an input method, an input device, a device for input, and a machine-readable medium.

Background

With the rapid development of the information age, users often need to input information in various situations. For example, a keyword is input into a search engine to search for a web page, a text is input into an instant messenger to communicate with other users, and the like. In a conventional input method, a user generally enters an input string in a keyboard input state, and then the input string is converted into a candidate item of a corresponding language and displayed by an input method program according to a preset standard mapping rule, so that the user browses the candidate item and displays the candidate item required by the selection target on a screen.

Taking japanese input as an example, the preset standard mapping rule may be a pronunciation rule. For example, if the input string is "ta", a candidate such as "た" may be provided, or if the input string is "sakaki", a candidate such as "Sakaki" may be provided.

In practical applications, there may be a need for a user to input text without knowing the pronunciation. For example, the user wants to enter the word "" but does not know the pronunciation of the word. In this case, the user usually queries the pronunciation of the word in a search engine, or the user switches the state of the input method to a handwriting input state, inputs the trajectory data of the word in the handwriting input state, selects the word among candidates given by the input method program, and then switches the state of the input method to a keyboard input state.

The inventor finds that skipping between different interfaces is needed no matter the pronunciation of the character is inquired in a search engine or the character is input in a handwriting input state, so that more skipping cost is needed, and the input efficiency is affected.

Disclosure of Invention

The embodiment of the invention provides an input method, an input device and a machine readable medium, which can improve the input efficiency.

In order to solve the above problem, an embodiment of the present invention discloses an input method, including:

identifying an operation track of a user on a virtual keyboard;

if the operation track is a handwriting track, determining character candidates corresponding to the handwriting track;

and displaying the character candidates.

In another aspect, an embodiment of the present invention discloses an input device, including:

the track recognition module is used for recognizing the operation track of the user on the virtual keyboard;

the character candidate determining module is used for determining a character candidate corresponding to the handwriting track if the operation track is the handwriting track;

and the character candidate display module is used for displaying the character candidates.

In yet another aspect, an embodiment of the present invention discloses an apparatus for input, comprising a memory, and one or more programs, wherein the one or more programs are stored in the memory, and configured to be executed by the one or more processors comprises instructions for:

identifying an operation track of a user on a virtual keyboard;

and displaying the character candidates.

In yet another aspect, embodiments of the invention disclose one or more machine-readable media having instructions stored thereon, which when executed by one or more processors, cause an apparatus to perform one or more of the methods described above.

The embodiment of the invention has the following advantages:

the embodiment of the invention improves the processing logic of the operation track on the virtual keyboard, and adds the identification logic of the operation track and the processing logic of the handwriting track in the processing logic of the operation track. The handwriting input can be realized on the virtual keyboard under the condition of not switching the input state and skipping the interface, so the input efficiency can be improved.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the description of the embodiments of the present invention will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to these drawings without inventive labor.

FIG. 1 is a schematic illustration of an environment in which an input method of an embodiment of the invention may be used;

FIG. 2 is a flow chart of the steps of a first embodiment of an input method of the present invention;

FIG. 3 is a flowchart illustrating steps of a second embodiment of an input method;

FIG. 4 is a block diagram of an input device according to an embodiment of the present invention;

FIG. 5 is a block diagram of an apparatus 1000 for input of the present invention as a terminal; and

fig. 6 is a schematic diagram of a server in some embodiments of the invention.

Detailed Description

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

The embodiment of the invention provides an input scheme which can identify the operation track of a user on a virtual keyboard; if the operation track is a handwriting track, determining character candidates corresponding to the handwriting track; and displaying the character candidates.

In the embodiment of the invention, the virtual keyboard can represent a virtual software disk which can pop up on a screen of the terminal and is used for inputting. The virtual keyboard may include: a 9-key keyboard, a 26-key keyboard, etc.

The virtual keyboard may include a plurality of keys for user activation. The virtual keyboard may include: and the letter keys are used for the user to input the input string. For example, in the case of using a 26-key keyboard, the user presses the keys "t" and "a", respectively, to obtain the input string "ta".

The virtual keyboard may further include: the present invention relates to a keyboard, and more particularly to a keyboard, a.

The operation track for the virtual keyboard response of the embodiment of the invention can comprise: a key trace or a handwriting trace. The key trajectory may be an operation trajectory for a key in response to a function corresponding to the key. The handwritten trace may be used to trigger a recognition function of the handwritten trace.

In the conventional art, it is common to respond to a handwriting trajectory in a handwriting input state. In a handwriting input state, a special handwriting input area, which is usually a blank area, is usually provided, and a handwriting track of the user on the handwriting input area is recognized to provide corresponding character candidates.

In the field of input methods, a keyboard input state and a handwriting input state are different input states of an input method program, and a user needs to switch between the two input states to input characters in the two input states. For example, a user uses a keyboard in most cases to input a character without knowing the pronunciation, switches the input state to a handwriting input state, inputs the character without knowing the pronunciation in the handwriting input state, switches the input state to a keyboard input state, and continues inputting the character in the keyboard input state. However, the switching between the keyboard input state and the handwriting input state consumes more operation cost, which affects the input efficiency.

For example, the virtual keyboard is a japanese keyboard, and the user wants to input "" which is a japanese kanji character during the process of inputting japanese using the japanese keyboard, but the user cannot input the phonetic string of the japanese kanji character by the keyboard input state because the user does not know the phonetic string of the japanese kanji character. Through the embodiment of the invention, the handwriting track of the Japanese Chinese character can be input on the Japanese keyboard by a user, and the embodiment of the invention carries out handwriting recognition on the handwriting track to obtain Japanese character candidates such as corresponding to the handwriting track for the user to check and screen.

The embodiment of the invention can be applied to the Application environment of an input method APP (Application program), and can improve the input efficiency. In addition, the embodiment of the present invention may be applied to any input scenarios such as text editing, instant messaging, and web search, and it can be understood that the embodiment of the present invention does not limit the specific input scenarios.

The input method provided by the embodiment of the present invention can be applied to the application environment shown in fig. 1, as shown in fig. 1, the client 100 and the server 200 are located in a wired or wireless network, and the client 100 and the server 200 perform data interaction through the wired or wireless network.

The input process of the embodiment of the present invention may be executed by any one of the client 100 and the server 200:

for example, the client 100 may run on a terminal with a touch screen, and the terminal specifically includes but is not limited to: smart phones, tablet computers, electronic book readers, MP3 (Moving Picture Experts Group Audio Layer III) players, MP4 (Moving Picture Experts Group Audio Layer IV) players, laptop portable computers, car-mounted computers, desktop computers, set-top boxes, smart televisions, wearable devices, and the like.

The embodiment of the invention can be applied to input method programs of input states such as keyboards, handwriting and the like. Taking the keyboard input state as an example, the user may perform text input through the code character string, and the input string may refer to the code character string input by the user. In the field of input methods, for input method programs in languages such as japanese, input strings input by a user can be converted into candidates in the corresponding language.

According to some embodiments, the input string may include, but is not limited to: a key symbol or a combination of a plurality of key symbols input by a user through a key. The key symbol may specifically include: kana or pinyin strings corresponding to the Chinese characters, and the like.

In an embodiment of the invention, the candidates may be used to represent one or more characters provided by the input method program to be selected by the user. The candidates may be japanese characters, or the candidates may also be symbol combinations in the form of characters, pictures, or the like. The above-mentioned characters include but are not limited to drawings composed of lines, symbols, and words, for example, examples of the above-mentioned characters may include: ": p ",": o ",": etc.

In the embodiment of the invention, the function of realizing handwriting input on the Japanese keyboard can be called a keyboard handwriting function. The state of the keyboard handwriting function may include: an on state, or an off state. In a default state, the state of the handwriting function of the keyboard can be a closed state, and the state of the handwriting function of the keyboard can be switched to an open state in response to a trigger operation of a user.

In an optional embodiment of the present invention, the trigger operation may be a trigger operation for a keyboard handwriting option in a setting interface of the input method program. Of course, the triggering operation may also be an operation such as a voice instruction or a preset shortcut key, and the specific triggering operation is not limited in the embodiment of the present invention.

Method embodiment one

Referring to fig. 2, a flowchart illustrating steps of a first embodiment of an input method according to the present invention is shown, which may specifically include the following steps:

step 201, identifying an operation track of a user on a virtual keyboard;

step 202, if the operation track is a handwriting track, determining character candidates corresponding to the handwriting track;

step 203, displaying the character candidates.

The embodiment of the invention can be applied to the terminal with the touch screen. In practical application, an operation track input on the touch screen by a user can be acquired through the touch screen. Alternatively, the operation track may be generated by a finger or a stylus pen, and in particular, the path of the finger or the stylus pen moving on the touch screen may form the operation track. In practical applications, a track generated by a finger or a stylus pen may be sensed by a sensing device built in or external to the terminal, and optionally, the operation track may include: the position coordinates of the track points, the operation parameters of the sliding operation corresponding to the track points and the like.

In an optional embodiment of the present invention, the sensing device may sense a displacement and a lifting motion of the finger or the stylus, and when the displacement of the finger or the stylus is detected, record an operation trajectory of the finger or the stylus during the displacement until the lifting motion of the finger or the stylus is detected, where one lifting motion may correspond to one operation trajectory. Of course, the detection manner of the operation trajectory is only an example, and actually, the embodiment of the present invention does not limit the specific detection manner of the trajectory.

In step 201, the operation trajectory of the user on the virtual keyboard is identified, which can be used to determine whether the operation trajectory belongs to a handwriting trajectory or a key trajectory.

In the embodiment of the invention, the operation track of the user on the virtual keyboard can be identified according to the handwriting track and the track characteristics corresponding to the key track. The trajectory features may include: the distance of the operation trajectory, the shape of the operation trajectory, and the like. Wherein, the distance of the operation track can be determined according to the position coordinates of the track points.

In practical applications, a key trajectory is generally used to click a key, and the key trajectory is generally located in a key area corresponding to the key. While a handwriting trace is typically used to enter strokes of a character, the handwriting trace typically spans multiple key regions.

In an optional embodiment of the present invention, the identifying an operation track of a user on a virtual keyboard specifically includes: and judging whether the operation track is a handwriting track or not according to the distance of the operation track.

The above determining whether the operation trajectory is a handwriting trajectory specifically includes:

if the distance of the operation track exceeds a distance threshold, the operation track is a handwriting track; or

And if the distance of the operation track does not exceed the distance threshold, the operation track is a key track.

The distance threshold may be determined by those skilled in the art according to the actual application requirements, for example, the distance of the key track may be recorded, and the distance threshold may be determined according to the maximum value of the distance of the key track.

In another optional embodiment of the present invention, whether the operation track is a handwriting track may be determined according to a shape of the operation track. The handwriting tracks are typically in the shape of long bars, while the key tracks are typically in the shape of short bars.

For example, if the operation trajectory is approximated to a quadrangle, it may be determined whether the operation trajectory is a handwriting trajectory or not based on a length ratio of a long side to a short side adjacent to the quadrangle. For example, if the length ratio exceeds the distance threshold, the operation trajectory is a handwriting trajectory, and otherwise, the operation trajectory is a key trajectory.

In step 202, if the operation trajectory is a handwriting trajectory, handwriting recognition may be performed on the handwriting trajectory to obtain a character candidate corresponding to the handwriting trajectory.

It will be appreciated that a handwritten trajectory may correspond to one or more character candidates. Taking the character candidate as the japanese character candidate as an example, the plurality of japanese character candidates may include: multiple Japanese characters with similar characters. Alternatively, the plurality of japanese character candidates may include: japanese characters and kana with similar shapes. Alternatively, the plurality of japanese character candidates may include: japanese characters and symbols with similar shapes.

Handwriting recognition refers to a process of converting a handwriting track into an internal code of a character, and is actually a mapping process from a coordinate sequence of the handwriting track to the internal code of the character.

The handwriting recognition method may include: a sequence recognition method based on LSTM (Long Short-Term Memory network) + ctc (connectionist Temporal classification), or a rule-based HMM (hidden markov Model).

In an optional embodiment of the present invention, the determining the character candidate corresponding to the handwriting trajectory specifically includes: determining character candidates corresponding to the handwriting tracks by using a handwriting model; the training data corresponding to the handwriting model specifically includes: handwriting tracks corresponding to Japanese characters.

Because characters of different languages generally have different writing characteristics, the embodiment of the invention can collect handwriting tracks corresponding to Japanese characters (such as Sakaki, and the like), and add the handwriting tracks corresponding to the Japanese characters into training data, thereby improving the recognition accuracy of a handwriting model.

The japanese characters corresponding to the handwritten characters may include: japanese Chinese characters, kana information, Japanese symbols and other information.

It is understood that the training data corresponding to the handwriting model may also include: handwriting tracks corresponding to characters of other languages, such as handwriting tracks corresponding to Chinese kanji characters.

The embodiment of the invention can train the mathematical model based on the training data to obtain the handwriting model, and the handwriting model can represent the mapping relation between input data (handwriting track) and output data (Japanese characters).

The mathematical model is a scientific or engineering model constructed by using a mathematical logic method and a mathematical language, and is a mathematical structure which is generally or approximately expressed by adopting the mathematical language aiming at the characteristic or quantity dependency relationship of a certain object system, and the mathematical structure is a relational structure which is described by means of mathematical symbols. The mathematical model may be one or a set of algebraic, differential, integral or statistical equations, and combinations thereof, by which the interrelationships or causal relationships between the variables of the system are described quantitatively or qualitatively. In addition to mathematical models described by equations, there are also models described by other mathematical tools, such as algebra, geometry, topology, mathematical logic, etc. Where the mathematical model describes the behavior and characteristics of the system rather than the actual structure of the system. The method can adopt methods such as machine learning and deep learning methods to train the mathematical model, and the machine learning method can comprise the following steps: linear regression, decision trees, random forests, etc., and the deep learning method may include: convolutional Neural Networks (CNNs), long short term memory Networks, Gated cyclic units (GRUs), and so on.

In step 203, the character candidates may be displayed in a candidate area of the input method program for the user to select.

In an optional embodiment of the present invention, the displaying the character candidates specifically includes: displaying the character candidates in a candidate area, and displaying candidates to be displayed on a screen in an input box; the candidate to be displayed on the screen may be a character candidate corresponding to the input focus.

The focus in the field of computers may characterize the area of interest, or the location where the current cursor is activated, or the object selected. The selected object may be manipulated. Specifically, in the embodiment of the present invention, the character candidate corresponding to the input focus is selected and can be operated. The embodiment of the invention displays the candidate to be displayed on the screen in the input box, can prompt the selected character candidate, and further can improve the screen display accuracy of the user aiming at the character candidate.

In the embodiment of the present invention, optionally, the input focus may be updated according to a user operation, so that the candidate to be displayed may be updated. For example, the user operation may be a space operation or the like, and the input focus may be cyclically switched between different character candidates within the candidate page in response to the space operation. Alternatively, the user operation may be a long-press operation or a sliding operation for a certain character candidate, so that the character candidate obtains an input focus, that is, the character candidate becomes a candidate to be displayed on the screen.

In the embodiment of the present invention, optionally, the candidate to be displayed on the screen, which is displayed in the input box, may be updated with the update of the input focus.

In this embodiment of the present invention, optionally, the method may further include: and responding to the preset operation of the user, and selecting the characters corresponding to the preset operation on a screen. The upper screen refers to an operation of displaying the content output in the preview window to the application window. Specifically to the input method program, the screen-up may refer to an operation of displaying a candidate output in the candidate window to the application window.

The preset operation may include: for the clicking operation of any character candidate, the clicked character candidate can be selected on the screen in the case.

Alternatively, the preset operation may include: and a carriage return operation, in which case the character corresponding to the input focus may be selected on the screen.

Alternatively, the preset keys may include: for shift key, 123 key! Is there a And (3) triggering operation of a first preset key such as a # key and a language switching key, and in this case, selecting the character corresponding to the input focus on a screen as a candidate.

Alternatively, the preset keys may include: and aiming at the triggering operation of a second preset key such as an alphabetic key, a symbol key or a punctuation mark key, in this case, the character corresponding to the input focus can be selected on the screen. In this case, the character corresponding to the second preset key may also be input.

One difference between the first preset key and the second preset key is as follows: the first preset key is a function key, and the second preset key is a character key.

The first preset key can trigger corresponding functions, such as the shift key corresponding to the full angle and half angle switching function, the 123 key corresponding to the digital key calling function! Is there a The # key corresponds to the calling function of the symbol key, and the language switching key corresponds to the switching function of different languages.

The second preset key corresponds to a character and can be used for inputting the corresponding character. Such as letter keys for entering corresponding letters, symbol keys for entering corresponding symbols, etc.

In the embodiment of the invention, after the triggering operation of the second preset key, the characters corresponding to the preset operation can be selected on the screen, and the input state is switched from the handwriting input state to the keyboard input state.

In other embodiments of the present invention, after the character candidate corresponding to the preset operation is displayed on the screen, the input state may be maintained as a handwriting input state. Alternatively, the step 201 may be returned to and executed, and the input state may be determined using the recognition result of the step 201. For example, if the recognition result of step 201 is a handwriting trace, the handwriting input state is maintained, and if the recognition result of step 201 is a key trace, the input state is switched from the handwriting input state to the keyboard input state.

To sum up, the input method of the embodiment of the present invention improves the processing logic of the operation trajectory on the virtual keyboard, and adds the recognition logic of the operation trajectory and the processing logic of the handwriting trajectory to the processing logic of the operation trajectory. The handwriting input can be realized on the virtual keyboard under the condition of not switching the input state and skipping the interface, so the input efficiency can be improved.

Method embodiment two

Referring to fig. 3, a flowchart illustrating steps of a second embodiment of the input method of the present invention is shown, which may specifically include the following steps:

step 301, identifying an operation track of a user on a virtual keyboard;

step 302, if the operation track is a handwriting track, determining character candidates corresponding to the handwriting track;

step 303, displaying the character candidates;

with respect to the first embodiment of the method shown in fig. 2, the method of this embodiment may further include:

step 304, determining kana information corresponding to the character candidates according to the mapping relationship between the characters and the kana information;

and 305, displaying kana information corresponding to the character candidates.

Kana is an important part of japanese as phonograms of japanese, and thus the memory and learning of kana is important. In practical applications, there may be a need for learning a pseudonym of a word by a user, and even a need for inputting a pseudonym of a word by the user. To meet the above-mentioned kana requirement, it is common practice for a user to look up the kana of this word in a search engine or dictionary.

The inventor finds that searching the kana of the word in a search engine or a dictionary usually requires a large operation cost in the process of implementing the embodiment of the invention, and therefore, the efficiency of obtaining the kana is affected.

The embodiment of the invention can establish the mapping relation between the stored characters and the kana information. Optionally, the mapping relationship may be japanese kanji or a mapping relationship between chinese kanji and kana information, and the kana information may include: hiragana or katakana, etc. For example, the kana letter corresponding to japanese kanji "Sakaki" is "さかき", and the kana information corresponding to japanese kanji "" is "はたらく".

The embodiment of the invention can collect corresponding kana information aiming at Japanese Chinese characters so as to establish the mapping relation. It is understood that a japanese kanji may correspond to one or kana information. Therefore, the embodiment of the invention can display at least one corresponding kana information for one Japanese Chinese character.

The embodiment of the invention can also collect corresponding kana information aiming at the combination of Japanese Chinese characters (namely Japanese words) to establish the mapping relation. Therefore, the embodiment of the invention can display the corresponding at least one kind of kana information aiming at the Japanese words.

In the embodiment of the present invention, the number of character candidates may be one or more. The embodiment of the invention can determine and display the corresponding kana information aiming at part or all of a plurality of character candidates. For example, the plurality of character candidates may be sorted, and the corresponding kana information may be determined and presented for the top N-ranked character candidates. N may be equal to 1, or N may be greater than 1.

In summary, the input method of the embodiment of the present invention displays the kana information corresponding to the character candidate corresponding to the handwriting trajectory, and can conveniently provide the kana information in the input process, thereby improving the efficiency of obtaining the kana information and helping the user to learn the kana information in the input process.

It can be understood that the embodiment of the invention can support the screen-up of the kana information, so that the user can conveniently screen up the required kana information, thereby improving the input efficiency of the kana information.

It should be noted that, for simplicity of description, the method embodiments are described as a series of motion combinations, but those skilled in the art should understand that the present invention is not limited by the described motion sequences, because some steps may be performed in other sequences or simultaneously according to the present invention. Further, those skilled in the art will appreciate that the embodiments described in the specification are presently preferred and that no moving act is required as an embodiment of the invention.

Device embodiment

Referring to fig. 4, a block diagram of an embodiment of an input device according to the present invention is shown, which may specifically include:

a track recognition module 401, configured to recognize an operation track of a user on a virtual keyboard;

a character candidate determining module 402, configured to determine a character candidate corresponding to the handwriting trajectory if the operation trajectory is the handwriting trajectory;

a character candidate display module 403, configured to display the character candidates.

Optionally, the track recognition module 401 may include:

and the track judging module is used for judging whether the operation track is a handwriting track according to the distance of the operation track.

Optionally, the trajectory determination module may include:

a first track judging module, configured to determine that the operation track is a handwriting track if a distance between the operation tracks exceeds a distance threshold; or

And the second track judgment module is used for judging the operation track to be a key track if the distance of the operation track does not exceed the distance threshold.

Alternatively, the character candidate determination module 402 may include:

a candidate determining module based on model, for determining the character candidate corresponding to the handwriting track by using the handwriting model; the training data corresponding to the handwriting model may include: and track data corresponding to Japanese characters.

Optionally, the character candidate presenting module 403 may include:

the candidate area input box display module is used for displaying the character candidates in the candidate area and displaying the candidate to be displayed on the screen in the input box; and the candidate to be displayed on the screen is a character candidate corresponding to the input focus.

Optionally, the apparatus may further include:

and the screen-loading module is used for responding to the preset operation of the user and loading the characters corresponding to the preset operation on the screen.

Optionally, the apparatus may further include:

a kana determining module, configured to determine kana information corresponding to the character candidate according to a mapping relationship between the character and the kana information;

and the kana display module is used for displaying the kana information corresponding to the character candidates.

For the device embodiment, since it is basically similar to the method embodiment, the description is simple, and for the relevant points, refer to the partial description of the method embodiment.

The embodiments in the present specification are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other.

With regard to the apparatus in the above-described embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated here.

The present invention provides a device for input, comprising a memory, and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by one or more processors, the one or more programs including instructions for: identifying an operation track of a user on a virtual keyboard; if the operation track is a handwriting track, determining character candidates corresponding to the handwriting track; and displaying the character candidates.

Fig. 5 is a block diagram illustrating a structure of an apparatus 1000 for input as a terminal according to an exemplary embodiment. For example, the apparatus 1000 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, an exercise device, a personal digital assistant, and the like.

Referring to fig. 5, the apparatus 1000 may include one or more of the following components: processing component 1002, memory 1004, power component 1006, multimedia component 1008, audio component 1010, input/output (I/O) interface 1012, sensor component 1014, and communications component 1016.

The processing component 1002 generally controls the overall operation of the device 1000, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing elements 1002 may include one or more processors 1020 to execute instructions to perform all or a portion of the steps of the methods described above. Further, processing component 1002 may include one or more modules that facilitate interaction between processing component 1002 and other components. For example, the processing component 1002 may include a multimedia module to facilitate interaction between the multimedia component 1008 and the processing component 1002.

The memory 1004 is configured to store various types of data to support operation at the device 1000. Examples of such data include instructions for any application or method operating on device 1000, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 1004 may be implemented by any type or combination of volatile or non-volatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.

The power supply component 1006 provides power to the various components of the device 1000. The power components 1006 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the device 1000.

The multimedia component 1008 includes a screen that provides an output interface between the device 1000 and a user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 1008 includes a front facing camera and/or a rear facing camera. The front camera and/or the rear camera may receive external multimedia data when the device 1000 is in an operating mode, such as a shooting mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

The audio component 1010 is configured to output and/or input audio signals. For example, audio component 1010 includes a Microphone (MIC) configured to receive external audio signals when apparatus 1000 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signal may further be stored in the memory 1004 or transmitted via the communication component 1016. In some embodiments, audio component 1010 also includes a speaker for outputting audio signals.

I/O interface 1012 provides an interface between processing component 1002 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.

The sensor assembly 1014 includes one or more sensors for providing various aspects of status assessment for the device 1000. For example, sensor assembly 1014 may detect an open/closed state of device 1000, the relative positioning of components, such as a display and keypad of apparatus 1000, sensor assembly 1014 may also detect a change in position of apparatus 1000 or a component of apparatus 1000, the presence or absence of user contact with apparatus 1000, orientation or acceleration/deceleration of apparatus 1000, and a change in temperature of apparatus 1000. The sensor assembly 1014 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 1014 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 1014 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

The communication component 1016 is configured to facilitate communications between the apparatus 1000 and other devices in a wired or wireless manner. The device 1000 may access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 1016 receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communications component 1016 further includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

In an exemplary embodiment, the apparatus 1000 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components for performing the above-described methods.

In an exemplary embodiment, a non-transitory computer readable storage medium comprising instructions, such as the memory 1004 comprising instructions, executable by the processor 1020 of the device 1000 to perform the above-described method is also provided. For example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.

Fig. 6 is a schematic diagram of a server in some embodiments of the invention. The server 1900 may vary widely by configuration or performance and may include one or more Central Processing Units (CPUs) 1922 (e.g., one or more processors) and memory 1932, one or more storage media 1930 (e.g., one or more mass storage devices) storing applications 1942 or data 1944. Memory 1932 and storage medium 1930 can be, among other things, transient or persistent storage. The program stored in the storage medium 1930 may include one or more modules (not shown), each of which may include a series of instructions operating on a server. Still further, a central processor 1922 may be provided in communication with the storage medium 1930 to execute a series of instruction operations in the storage medium 1930 on the server 1900.

The server 1900 may also include one or more power supplies 1926, one or more wired or wireless network interfaces 1950, one or more input-output interfaces 1958, one or more keyboards 1956, and/or one or more operating systems 1941, such as Windows Server, Mac OS XTM, UnixTM, LinuxTM, FreeBSDTM, etc.

A non-transitory computer readable storage medium in which instructions, when executed by a processor of an apparatus (terminal or server), enable the apparatus to perform the input method described in any one of fig. 2 to 3. A method of inputting, the method comprising: identifying an operation track of a user on a virtual keyboard; if the operation track is a handwriting track, determining character candidates corresponding to the handwriting track; and displaying the character candidates.

A1, an input method, the method comprising:

identifying an operation track of a user on a virtual keyboard;

and displaying the character candidates.

A2, according to the method in A1, the recognizing the operation track of the user on the virtual keyboard includes:

and judging whether the operation track is a handwriting track or not according to the distance of the operation track.

A3, the method according to A2, wherein the judging whether the operation track is a handwriting track includes:

A4, according to the method of A1, the determining character candidates corresponding to the handwriting track includes:

determining character candidates corresponding to the handwriting track by using a handwriting model; the training data corresponding to the handwriting model comprises: and track data corresponding to Japanese characters.

A5, the method of A1, the showing the Japanese characters, comprising:

displaying the character candidates in a candidate area, and displaying candidates to be displayed on a screen in an input box; and the candidate to be displayed on the screen is a character candidate corresponding to the input focus.

A6, the method of A1, the method further comprising:

responding to the preset operation of a user, and selecting characters corresponding to the preset operation on a screen.

A7, the method of any one of A1 to A6, the method further comprising:

determining kana information corresponding to the character candidates according to a mapping relation between the characters and the kana information;

and displaying the kana information corresponding to the character candidates.

The embodiment of the invention discloses B8 and an input device, wherein the input device comprises:

B9, the apparatus of B8, the trajectory recognition module comprising:

B10, the device according to B9, the track judging module includes:

the first track judging module is used for judging that the operation track is a handwriting track if the distance of the operation track exceeds a distance threshold; or

And the second track judgment module is used for judging the operation track to be a key track if the distance of the operation track does not exceed a distance threshold.

B11, the character candidate determination module according to the apparatus of B8, comprising:

the model-based candidate determining module is used for determining character candidates corresponding to the handwriting track by utilizing the handwriting model; the training data corresponding to the handwriting model comprises: and track data corresponding to Japanese characters.

B12, the character candidate presentation module of the device of B8, comprising:

B13, the apparatus of B8, the apparatus further comprising:

and the screen-loading module is used for responding to the preset operation of the user and selecting the characters corresponding to the preset operation to be on the screen.

B14, the apparatus according to any one of B8 to B13, further comprising:

the kana determining module is used for determining kana information corresponding to the character candidates according to the mapping relation between the characters and the kana information;

The embodiment of the invention discloses C15, a device for input, comprising a memory, and one or more programs, wherein the one or more programs are stored in the memory, and the one or more programs are configured to be executed by the one or more processors and comprise instructions for:

identifying an operation track of a user on a virtual keyboard;

and displaying the character candidates.

C16, the method for recognizing the operation track of the user on the virtual keyboard according to the device of C15 includes:

C17, the judging whether the operation track is a handwriting track according to the device of C16, comprising:

C18, the determining the character candidates corresponding to the handwriting track according to the apparatus of C15, comprising:

C19, the device of C15, the showing the Japanese characters, comprising:

C20, the device of C15, the device also configured to execute the one or more programs by one or more processors including instructions for:

C21, the device of any of C15-C10, the device also configured to execute the one or more programs by one or more processors including instructions for:

and displaying the kana information corresponding to the character candidates.

Embodiments of the invention disclose D22, one or more machine readable media having instructions stored thereon that, when executed by one or more processors, cause an apparatus to perform a method as described in one or more of a 1-a 7.

Other embodiments of the invention will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. This invention is intended to cover any variations, uses, or adaptations of the invention following, in general, the principles of the invention and including such departures from the present disclosure as come within known or customary practice within the art to which the invention pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the invention being indicated by the following claims.

It will be understood that the invention is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the invention is limited only by the appended claims.

The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents, improvements and the like that fall within the spirit and principle of the present invention are intended to be included therein.

The present invention provides an input method, an input device, and a machine-readable medium, which are described in detail above, and the principles and embodiments of the present invention are explained herein by using specific examples, and the descriptions of the above examples are only used to help understand the method and the core ideas of the present invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.

Claims

1. An input method, characterized in that the method comprises:

identifying an operation track of a user on a virtual keyboard;

and displaying the character candidates.

2. The method of claim 1, wherein the identifying the operation track of the user on the virtual keyboard comprises:

3. The method according to claim 2, wherein the determining whether the operation track is a handwriting track comprises:

4. The method of claim 1, wherein the determining the character candidate corresponding to the handwriting track comprises:

5. The method of claim 1, wherein said presenting said japanese character comprises:

6. The method of claim 1, further comprising:

7. The method according to any one of claims 1 to 6, further comprising:

and displaying the kana information corresponding to the character candidates.

8. An input device, the device comprising:

9. An apparatus for input, comprising a memory, and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs comprising instructions for:

identifying an operation track of a user on a virtual keyboard;

and displaying the character candidates.

10. One or more machine-readable media having instructions stored thereon, which when executed by one or more processors, cause an apparatus to perform the method of one or more of claims 1-7.