CN103324425A - Command execution method and device based on gestures - Google Patents

Command execution method and device based on gestures Download PDF

Info

Publication number
CN103324425A
CN103324425A CN2012105357618A CN201210535761A CN103324425A CN 103324425 A CN103324425 A CN 103324425A CN 2012105357618 A CN2012105357618 A CN 2012105357618A CN 201210535761 A CN201210535761 A CN 201210535761A CN 103324425 A CN103324425 A CN 103324425A
Authority
CN
China
Prior art keywords
gesture
user
instruction icon
gesture instruction
retrieval
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN2012105357618A
Other languages
Chinese (zh)
Other versions
CN103324425B (en
Inventor
刘炳林
王玲
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
CHONGQING HYTAK TECHNOLOGY DEVELOPMENT Co.,Ltd.
Original Assignee
CHONGQING YOUTENG INFORMATION TECHNOLOGY Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by CHONGQING YOUTENG INFORMATION TECHNOLOGY Co Ltd filed Critical CHONGQING YOUTENG INFORMATION TECHNOLOGY Co Ltd
Priority to CN201210535761.8A priority Critical patent/CN103324425B/en
Publication of CN103324425A publication Critical patent/CN103324425A/en
Application granted granted Critical
Publication of CN103324425B publication Critical patent/CN103324425B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Abstract

The invention discloses a command execution method and device based on gestures. The method comprises the following steps: setting a gesture command icon on a screen and setting up the incidence relation between the gesture command icon and a target database; if a receiving user does a touching motion on the gesture command icon, displaying a virtual keyboard; continuously receiving the gesture trajectory data inputted by a user via the virtual keyboard, matching the received gesture trajectory data and command codes stored in the target database, and acquiring a retrieved result; executing an command according to the retrieved result. The command execution device based on gestures comprises a gesture command icon setting module, an interactive interface, an input gesture detection module, a matching detection module and a command execution module. By utilizing the command execution method and device based on gestures, the number of man-machine interaction of executing commands through gestures is reduced, the user operation is facilitated, and the user experience is improved.

Description

A kind of method and apparatus of the command execution based on gesture
Technical field
The application relates to human-computer interaction technique field, particularly a kind of method and apparatus of the command execution based on gesture.
Background technology
Present human-computer interaction device is of a great variety, and wherein great majority are to receive go forward side by side style of writing shelves editor's a electronic equipment of manual command.Especially, the kind of electronic equipment that has touch-screen at present is more and more, for example has computing machine, touch-screen mobile phone, touch-screen palm PC, touch screen flat panel computer of touch-screen etc.Have in the electronic equipment of touch-screen at these, it is mutual normally to utilize touch-screen and electronic equipment to carry out man-machine command, and especially operating personnel will utilize touch-screen instruction or information such as input character in the electronic equipment.
Along with popularizing of touch-screen, execute instruction and obtained using widely by receiving the input gesture, for example the gesture that can import at dummy keyboard according to the user who receives of electronic equipment is carried out corresponding order of this input gesture etc.Particularly, in this application, the user need click corresponding button or menu at first activates dummy keyboard, and electronic equipment shows dummy keyboard at screen; Then, the user draws gesture in dummy keyboard; Afterwards, the gesture imported at dummy keyboard according to the user of electronic equipment is carried out the corresponding order of this input gesture; At last, the user operates hiding dummy keyboard.This shows, the too much man-machine interaction of above-mentioned exectorial process need, inconvenient operation influences the user and experiences.
Summary of the invention
In order to address the above problem, the present invention proposes a kind of method and apparatus of the command execution based on gesture, the user need not to interrupt and the contacting of screen after activating keyboard layout, can finish keyboard by once single continuous touch operation activates, the instruction input, the instruction execution waits operation, has reduced by the exectorial man-machine interaction number of times of gesture, user-friendly, significantly improved user's experience.
Technical scheme of the present invention is achieved in that
A kind of command executing method based on gesture is characterized in that, comprising:
At screen the gesture instruction icon is set, sets up the incidence relation between described gesture instruction icon and the target database;
If receive the user in the touch action that described gesture instruction icon sends, then show dummy keyboard;
Continue to receive the user and draw gesture track data through the dummy keyboard input, the acquisition result for retrieval is mated in the command code of storing in the described gesture track data that receives and the described target database; And
According to described result for retrieval fill order.
In a kind of optimal way, described gesture track data is the data from the track of the initial continuous gesture that continues to streak the target character on the keyboard layout of described gesture instruction icon.
In a kind of optimal way, described touch action comprises: click and click the mobile default at least distance in back.
In a kind of optimal way, further comprise:
If receiving the user clicks the gesture instruction icon, and finger frames out immediately after clicking, and shows the default response interface corresponding with this gesture instruction icon, or shows default desktop state; Perhaps
If receiving the user clicks the gesture instruction icon, and finger does not frame out after clicking, and shows the dummy keyboard of the corresponding keyboard layout of the associated target database of described gesture instruction icon; And, if after receiving described click, do not receive the movement of user on described dummy keyboard, be that the user points and mobilely after clicking the gesture instruction icon just frames out, perhaps receive mobile distance less than default distance, hide dummy keyboard, return to default desktop state, perhaps, show the default response interface corresponding with this gesture instruction icon.
In a kind of optimal way, described target data library storage with described gesture instruction icon the relevant data message of corresponding command type.
In a kind of optimal way, the keyboard layout of described dummy keyboard is corresponding with described target database or gesture instruction icon.
In a kind of optimal way, the described incidence relation of setting up between described gesture instruction icon and the target database comprises: set up the incidence relation between described gesture instruction icon and the one or more target database.
In a kind of optimal way, described screen comprises lock-screen, and/or idle screen, and/or Application Program Interface, for lock-screen, further comprises:
The described screen of release.
In a kind of optimal way, described demonstration comprises with the dummy keyboard of the corresponding keyboard layout of described target database:
As if described gesture instruction icons association to a target database, show the dummy keyboard of the keyboard layout of this target database correspondence;
If described gesture instruction icons association to a plurality of target databases, also comprised before the dummy keyboard that shows described keyboard layout: the complete order type that shows described gesture instruction icon correspondence is selected for the user; Receive the command type that the user selects, shows a dummy keyboard, the target database that the keyboard layout of wherein said dummy keyboard and the command type of described user's selection are corresponding is corresponding.
In a kind of optimal way, described described result for retrieval fill order is comprised:
If obtaining the matching degree of a result for retrieval and this result for retrieval, coupling surpasses preset threshold, then to described result for retrieval fill order;
If only coupling obtains a result for retrieval, but the matching degree of the result for retrieval of described acquisition does not surpass preset threshold, then before fill order, also comprise: at the result for retrieval of the described acquisition of screen demonstration, whether selected to described result for retrieval fill order by the user;
If coupling obtains a plurality of result for retrieval, then before fill order, also comprise: eject the menu of the result for retrieval that comprises whole described acquisitions at screen, selected by the user.
In a kind of optimal way, comprising: to the result for retrieval fill order of described user's selection.
In a kind of optimal way, can also comprise: hide described dummy keyboard.
A kind of command execution device based on gesture is characterized in that, comprising:
The gesture instruction icon arranges module, is used at screen the gesture instruction icon being set, and sets up the incidence relation between described gesture instruction icon and the target database;
Interactive interface is used for receiving the touch action that the user sends at described gesture instruction icon, shows and the associated target database corresponding virtual of described gesture instruction icon keyboard;
Input gestures detection module is used for continuing to receive the user and draws the gesture track of importing through dummy keyboard;
The matching detection module is used for the gesture track corresponding characters sequence that will obtain and the character string that target database is stored and mates, the acquisition result for retrieval;
Command execution module is used for carrying out corresponding order according to described result for retrieval.
In a kind of optimal way, the gesture track that described interactive interface receives is initial from described gesture instruction icon.
In a kind of optimal way, described interactive interface receives the user and clicks the gesture instruction icon, and finger frames out immediately after clicking, and shows the default response interface corresponding with this gesture instruction icon, or shows default desktop state; Perhaps
Described interactive interface receives the user and clicks the gesture instruction icon, and finger does not frame out after clicking, and shows the dummy keyboard of the corresponding keyboard layout of the associated target database of described gesture instruction icon; And, after receiving described click, do not receive the movement of user on described dummy keyboard, be that the user points and mobilely after clicking the gesture instruction icon just frames out, perhaps receive mobile distance less than default distance, hide dummy keyboard, return to default desktop state, perhaps, show the default response interface corresponding with this gesture instruction icon.
In a kind of optimal way, described command execution module also is used for hiding the dummy keyboard of described keyboard layout.
Description of drawings
Fig. 1 is a kind of process flow diagram of the command executing method based on gesture of the present invention;
Fig. 2 is a kind of demonstration synoptic diagram of typical cell phone standby screen;
Fig. 3 is a kind of demonstration synoptic diagram of mobile phone lock-screen;
Fig. 4 is a kind of composition structural representation of the command execution device based on gesture of the present invention;
Fig. 5 be one embodiment of the invention described with the shortcut icon phone input of the touch during as gesture instruction icon synoptic diagram;
Fig. 6 one embodiment of the invention described on lock-screen with the shortcut icon phone input of the touch during as gesture instruction icon synoptic diagram;
Fig. 7 be another embodiment of the present invention described with the shortcut icon network input of the touch during as gesture instruction icon synoptic diagram;
Touch input synoptic diagram when Fig. 8 uses shortcut icon as the gesture instruction icon for another embodiment of the present invention is described;
Fig. 9 for another embodiment of the present invention described with the shortcut icon mail input of the touch during as gesture instruction icon synoptic diagram;
Touch input synoptic diagram when Figure 10 searches for shortcut icon as the gesture instruction icon for another embodiment of the present invention is described;
Embodiment
The present invention is further described in more detail below in conjunction with drawings and the specific embodiments
Fig. 1 is the process flow diagram of the command executing method based on gesture of the present invention.Referring to Fig. 1, method of the present invention mainly comprises:
101, at screen the gesture instruction icon is set, sets up the incidence relation between described gesture instruction icon and the target database;
Particularly, at least one described gesture instruction icon can be set on the screen of electronic equipment.Described gesture instruction icon can be specific region, literal, button, picture, control parts (Widget) on shortcut icon, the screen etc. usually.Described gesture instruction icon is the starting point that the user touches input, is used for the user and selects to indicate electronic equipment to the performed command type of this touch input, and described command type can be dialing, online etc.Described gesture icon is except the starting point as the touch input, can also arrange and click the function interface that described gesture instruction icon starts, this is namely as the default response interface of gesture instruction icon correspondence, start the dialing interface as clicking " phone " icon at the standby desktop, click " network " icon and start browser, click " application " icon and enter the application list, etc.
Described screen comprises: lock-screen, and/or idle screen, and/or Application Program Interface.Fig. 2 has shown a kind of desktop of typical cell phone standby screen.As shown in Figure 2, the shortcut icon commonly used on the typical mobile phone desktop mainly comprises: phone, network, application, mail, search etc.Fig. 3 has shown a kind of mobile phone lock-screen.As shown in Figure 3, this screen below has shown above-mentioned shortcut icon commonly used.
A gesture instruction icon is related with one or more command types.Described command type comprises: dial phone number and/or jump to the website and/or start application program and/or start that mail sends software and result for retrieval is set to the mail recipient address, and/or be enabled in line retrieval flow process etc.A command type is related with target database again, is used for obtaining the result for retrieval of pending order to retrieve from the initial gesture input of gesture instruction icon.Described target data library storage with described gesture instruction icon the relevant data message of corresponding command type.Target database comprises: contact database and/or network address storehouse and/or application database and/or addresses of items of mail storehouse and/or input method dictionary etc.For example, the contact data library storage that is associated with dialing order contact person's name, telephone number information, email address, instant messaging number etc.; The application database related with starting application command stored the local application information of having installed etc.The different target database of different command type correspondence also can corresponding identical target database, as because required visit information source all is associated person information usually, commands for mail, note order etc. also can equally with the dialing order be associated with contact database.Existing Data Source in the directly employing system of described target database, record such as system communication, file set in the system, the pool of applications of having installed, the instruction set of application-specific etc., also can be to set up new target database according to these Data Sources, set up and to comprise in the process searched targets is encoded to improve retrieval rate according to ad hoc rules, such as can be according to specific input method coding index order to name of contact person or application program, the information to be retrieved of target database can be encoded according to multiple coding rule, to support different retrieval matched rules, can support the retrieval of contact person's spelling sound coding as the contact person, the retrieval of simplicity initial, telephone number retrieval etc., the retrieval of network address English alphabet can be supported in the network address storehouse, Pinyin coding retrieval of Chinese network name of station etc., and each target database can be supported multiple retrieval matching way.Described gesture instruction icon need be associated with one or more target databases.The described incidence relation of setting up between described gesture instruction icon and the target database comprises: set up the incidence relation between described gesture instruction icon and the one or more target database.
In order to improve user's input efficiency, can design the keyboard layout of dummy keyboard according to the characteristics of storage information in the database, make things convenient for the user to import this database information.The keyboard layout of described dummy keyboard is corresponding with described target database or gesture instruction icon.Such as, canned data comprises name of contact person and telephone number in the contact database, corresponding with this database so keyboard layout need be taken into account the input of letter and numeral.The English alphabet that canned data comprises in the application database is more, for example, " SinaNews ", " SinaWeibo ", corresponding with this database so keyboard layout need be placed on alphabet key the position of easy operating in the keyboard.Thereby, the keyboard layout of a corresponding a kind of dummy keyboard of target database.That is, a kind of fill order type is associated with a kind of keyboard layout of dummy keyboard.The multiple dummy keyboard of above-mentioned a plurality of target database correspondences can have identical keyboard layout also can have different keyboard layouts.Same target database also can adopt different virtual keyboard layout according to different command types to be retrieved.
In this step, on that described gesture instruction icon can be arranged on lock-screen and/or idle screen and/or the Application Program Interface.As shown in Figure 2, below the screen of standby, described gesture instruction icon is set.Shown in Figure 3, described gesture instruction icon is set below lock-screen.
Among Fig. 2 and Fig. 3, will use shortcut icon always, phone, note, network, mail, application, search are as the gesture instruction icon.
102, if receive the user in the touch action that described gesture instruction icon sends, then show dummy keyboard;
The keyboard layout of described dummy keyboard can be corresponding with described target database or gesture instruction icon.Described touch action comprises clicks and clicks the mobile default at least distance in back.If receiving the user clicks the gesture instruction icon, and finger frames out immediately after clicking, and shows the default response interface corresponding with this gesture instruction icon, or shows default desktop state; Perhaps, if receiving the user clicks the gesture instruction icon, and finger does not frame out after clicking, and shows the dummy keyboard of the corresponding keyboard layout of the associated target database of described gesture instruction icon; And, if after receiving described click, do not receive the movement of user on described dummy keyboard, be that the user points and mobilely after clicking the gesture instruction icon just frames out, or receive mobile distance less than default distance, and hide dummy keyboard, return to default desktop state, perhaps, show the default response interface corresponding with this gesture instruction icon.
If described gesture instruction icons association to a target database receives the touch action that the user sends at described gesture instruction icon, then show the dummy keyboard of the keyboard layout corresponding with the associated target database of this gesture instruction icon.If described gesture instruction icons association to a plurality of target databases, then also comprised before showing described dummy keyboard: show with the associated complete order type of described gesture instruction icon and select for the user; After receiving the command type that the user selects, show dummy keyboard, the target database that the keyboard layout of wherein said dummy keyboard and the command type of described user's selection are corresponding is corresponding.
103, continue to receive the user and draw the gesture track data of importing through dummy keyboard;
After step 102 shows dummy keyboard, continue to receive the user and draw the gesture track data of importing through dummy keyboard.Described lasting reception refers to that beginning continuous reception user from the touch action that receives the user draws the gesture track data of importing through dummy keyboard.
In this step, described gesture track is initial from described gesture instruction icon.User's finger or felt pen are after touching described gesture instruction icon, and contacting of maintenance and described icon as starting point, continuously successively streaked the button at target character place according to keyboard layout with described gesture instruction icon, frames out then.Described target character is expected the character imported for the user.For example, as shown in Figure 6, the user expects to import sina, and then described target character is s, i, n, a.After electronic equipment detects user finger and frames out, judge this end of input, obtain the user and draw gesture track data through the dummy keyboard input.And the position of command code corresponding characters on keyboard layout of storing in the position of described gesture track on keyboard layout and the described target database is relevant.Described gesture track data is the data from the track of the initial continuous gesture that continues to streak the target character on the keyboard layout of described gesture instruction icon.
The command code of storing in the described gesture track data that 104, will receive and the target database is mated, and obtains result for retrieval;
Described gesture track data receives by the dummy keyboard that step 102 shows.The position of command code corresponding characters on keyboard layout of storing in the position of described gesture track on keyboard layout and the described target database is relevant, and the user normally streaks coded character key bits corresponding on keyboard successively in the order of keyboard layout input gesture track.Retrieval is mated in the command code of storing in one or more gesture track datas of obtaining and the target database, obtain one or more result for retrieval.Different matched rules may obtain different result for retrieval.Matching process can be drawn the command code of storing in the character string of warp and the target database at keyboard layout according to gesture and mate, also can described track data and target database in the position data of character string in keyboard layout of the command code of storing mate, the process of coupling namely can be carried out after the gesture input is finished, and also can dynamically mate in input process.May draw through some irrelevant letters owing to drawing from the gesture instruction icon to the keyboard layout process, can cause more matching result to occur, can be by matching degree ordering acquisition best matching result.Need to prove that the method for above-mentioned coupling can be finished according to prior art, do not do at this and launch to describe.
105, carry out corresponding order according to described result for retrieval;
Described result for retrieval is that acquisition is mated in the command code of storing in the gesture track data of result on the dummy keyboard of step 102 demonstration and the target database.If described gesture instruction icons association to a target database, the command type of execution is the command type of this gesture instruction icon correspondence.If described gesture instruction icons association is to a plurality of target databases, then shows that at screen the menu that comprises whole result for retrieval selected which result for retrieval fill order wherein by the user, and carry out the command type that the user has selected.
Particularly, in this step, if only coupling obtains a result for retrieval, and the matching degree of this result for retrieval surpasses preset threshold, then to this result for retrieval fill order.If only coupling obtains a result for retrieval, but the matching degree of this result for retrieval surpasses preset threshold, then shows the result for retrieval that obtains at screen, whether confirms the result for retrieval fill order to showing by the user.Select in the process of result for retrieval described user, keep showing the dummy keyboard of described keyboard layout on the screen, re-enter for the user.If the user confirms to carry out, then to user-selected result for retrieval fill order.Otherwise the user namely forwards step 203 to keeping touching input on the keyboard layout that shows again, abandons this result for retrieval.Which if coupling obtains a plurality of result for retrieval, then before fill order, also comprise: eject the menu that comprises whole result for retrieval at screen and selected to result for retrieval fill order wherein, to user-selected result for retrieval fill order by the user.Select in the process of result for retrieval described user, keep showing the dummy keyboard of described keyboard layout on the screen, re-enter for the user.The user can also touch input again on this keyboard layout, namely forward step 203 to, abandons this result for retrieval.
Select in the process of result for retrieval described user, keep showing the dummy keyboard of described keyboard layout on the screen, re-enter for the user.
106, if described screen is lock-screen, the described screen of release;
The described screen of the described release of this step can be to draw after the gesture track data of dummy keyboard input the lasting user of reception, also can be after obtaining result for retrieval.
107, optional, the dummy keyboard of hiding described keyboard layout.
Described dummy keyboard is the dummy keyboard that step 102 shows.The described hiding described dummy keyboard of this step can be before execution command, also can be after fill order.
Corresponding with above-mentioned command executing method based on gesture, the invention also discloses a kind of command execution device based on gesture, be used for carrying out method of the present invention.Fig. 4 is a kind of composition structural representation of the command execution device based on gesture of the present invention.Referring to Fig. 4, this device comprises:
The gesture instruction icon arranges module 211, is used at screen the gesture instruction icon being set, and sets up the incidence relation between described gesture instruction icon and the target database;
Interactive interface 212 is used for receiving the touch action that the user sends at described gesture instruction icon, shows and the associated target database corresponding virtual of described gesture instruction icon keyboard;
Input gestures detection module 213 is used for continuing to receive the user and draws the gesture track of importing through dummy keyboard;
Matching detection module 214 is used for the gesture track corresponding characters sequence that will obtain and the character string that target database is stored and mates, the acquisition result for retrieval;
Command execution module 215 is used for carrying out corresponding order according to described result for retrieval, and is optional, hides the dummy keyboard of described keyboard layout.Optionally, if described screen is lock-screen, the described screen of release.
Wherein, the gesture track of interactive interface 212 receptions is initial from described gesture instruction icon.Interactive interface 212 receives the user and clicks the gesture instruction icon, and finger frames out immediately after clicking, and shows the default response interface corresponding with this gesture instruction icon, or shows default desktop state; Perhaps described interactive interface receives the user and clicks the gesture instruction icon, and finger does not frame out after clicking, and shows the dummy keyboard of the corresponding keyboard layout of the associated target database of described gesture instruction icon; And, after receiving described click, do not receive the movement of user on described dummy keyboard, be that the user points and mobilely after clicking the gesture instruction icon just frames out, perhaps receive mobile distance less than default distance, hide dummy keyboard, return to default desktop state, perhaps, show the default response interface corresponding with this gesture instruction icon.
The present invention proposes integrated click and the quick exectorial method of touch operation activation dummy keyboard input gesture on the gesture instruction icon.The present invention's gesture instruction icon that setting is associated with execution command, target database, dummy keyboard on screen.When the user only needs once to touch input from this gesture instruction icon is initial at touch-screen, electronic equipment namely can be finished following sequence of operations: show the dummy keyboard with described gesture icon related keyboard layout; Receive, coupling retrieval and to the result for retrieval fill order; Hide dummy keyboard.The present invention will reduce to once from three times by the exectorial man-machine interaction number of times of gesture, make things convenient for user's operation, improve user's experience.Simultaneously, if described screen is lock-screen, the present invention also realized in the exectorial while, the function of release keyboard.
Below be example with above-mentioned shortcut icon commonly used as the gesture instruction icon respectively just, above-mentioned command executing method based on gesture and device are elaborated.
Embodiment 1
In this specific embodiment, as described gesture instruction icon, as target database, the order of execution is for dialing phone number with contact database with the shortcut icon phone.This enforcement comprises concrete steps in the following example:
301, the shortcut icon phone that arranges on module 211 screens of gesture instruction icon is set to the gesture instruction icon, sets up the incidence relation between shortcut icon TEL and the contact database;
302, if interactive interface 212 receives the touch action that the user sends at the phone shortcut icon, then show dummy keyboard;
Such as, the keyboard layout of the dummy keyboard of described demonstration can be corresponding with the dial data storehouse, and is perhaps corresponding with dial feature.
303, the input gestures detection module 213 lasting users of reception draw the gesture track data of importing through dummy keyboard;
For example, give an example as shown in Figure 5, the user streaks alphabetical s, i, n, a corresponding key on the keyboard successively from the shortcut icon phone.Giving an example as shown in Figure 6, the user from the shortcut icon phone, streaks alphabetical s, i, n, a corresponding key on the keyboard successively on the dummy keyboard of lock-screen.The gesture track data streaks the data of the continuous path of s on the keyboard, i, n, a successively for from the shortcut icon phone.
304, matching detection module 214 will be imported the contact person coding of storing in gesture track data and the contact database and mate, and obtain result for retrieval;
As shown in Figure 5, the layout on dialing keyboard according to English or phonetic, gesture is drawn the continuous path through s, i, n, a, streaks following character s, r, q, i, j, n, e, c, a on the keyboard layout of dummy keyboard continuously; According to the layout of numeral on dialing keyboard, gesture is drawn the continuous path through s, i, n, a, streaks following character 7,4,5,6,3,2 on the keyboard layout of dummy keyboard continuously.
As shown in Figure 5 for example, if with English and Pinyin coding as matched rule, the contact person who retrieves from contact database comprises " sina of Sina ", " Si Na ".If telephone number is encoded as matched rule, 7,4,6,2 center, the key position order line track and 7,4,5,6,3 that comprises in " Zhang Bing " telephone number, 2 key position line of centres matching degree are higher, according to corresponding matching process, this contact person is retrieved out.Except mating with the character string of drawing warp and the coded character sequence in the database, can also be with position sequence and the coupling of the hand gesture location data result for retrieval of retrieving coupling of the coded character sequence in the database in keyboard layout. also can also adopt other matching process certainly.Matching process is easy to finish according to disclosed correlation technique data, also non-emphasis of the present invention, and therefore the search method of other embodiment is not similarly yet done and is launched to describe among the present invention.
305,215 pairs of described result for retrieval of command execution module are carried out the dialing order;
Give an example as shown in Figure 5, before carrying out the dialing order, eject at screen and to comprise that the menu of whole result for retrieval " sina of Sina ", " Si Na ", " Zhang Bing " selected by the user, to the result for retrieval fill order of user's selection.And, keep showing on the dialing keyboard layout at screen.The user can also abandon this result for retrieval, re-enters in the dialing keyboard layout, namely is back to step 303.
306, optional, command execution module 215 is hidden described dialing dummy keyboard.
In this step, can before the dialing order, also can after the dialing order, hide described dialing dummy keyboard.
Embodiment 2
In this specific embodiment, as described gesture instruction icon, as target database, the order of execution is for jumping to corresponding website with the network address storehouse with the shortcut icon network.This enforcement comprises concrete steps in the following example:
401, module 211 is set is the gesture instruction icon with the shortcut icon network settings on the screen to the gesture instruction icon, sets up the incidence relation between shortcut icon network and the network address storehouse;
Wherein, the network address storehouse can be stored in local, also can be stored in server, comprises the network address storehouse of default network address storehouse, immediate updating, the network address of user's collection and the network address of visit recently etc.
402, if interactive interface 212 receives the touch action that the user sends at the shortcut icon network, then show dummy keyboard;
403, the input gestures detection module 213 lasting users of reception draw the gesture track data of importing through dummy keyboard;
For example, give an example as shown in Figure 7, the users from networks shortcut icon begins, and streaks alphabetical s, i, n, a corresponding key on the dummy keyboard successively.The gesture track data streaks the data of the continuous path of s on the keyboard, i, n, a successively for from the shortcut icon network.
404, matching detection module 214 will be imported the network address coding of storing in gesture track data and the network address storehouse and mate, and obtain result for retrieval;
Give an example as shown in Figure 7, gesture is drawn through s, i, n, a, and gesture is also streaked on the dummy keyboard from shortcut icon network other letters to initial alphabetical process therebetween, and other letters of process between per two letters.Gesture is drawn the continuous path through s, i, n, a, streaks following character: z, s, d, y, u, i, n, b, v, c, s, a on the keyboard layout of dummy keyboard continuously.
For another example, if gesture is drawn through b, a, i, d, u, gesture is also streaked on the dummy keyboard from shortcut icon network other letters to initial alphabetical process therebetween, and other letters of process between per two letters.Adopt character string sequence as the coded system of gesture track, gesture is drawn the continuous path through b, a, i, d, u, streaks following character: b, a, i, d, u on the keyboard layout of dummy keyboard continuously.
For another example, if gesture is drawn through being x, i, n, l, a, n, g, gesture is also streaked on the dummy keyboard from shortcut icon network other letters to initial alphabetical process therebetween, and other letters of process between per two letters.Adopt character string sequence as the coded system of gesture track, gesture is drawn the continuous path through x, i, n, l, a, n, g, streaks following character: x, i, n, l, a, n, g on the keyboard layout of dummy keyboard continuously.
Give an example as shown in Figure 7, with the English spelling principle as matched rule, " s, i, n, a " position on keyboard and the matching degree of gesture of network address " www.sina.com.cn " are higher, retrieve the network address of mating with the gesture track according to local matching principle and are " www.sina.com.cn ".
For another example, if gesture is drawn through b, a, i, d, u, gesture is also streaked on the dummy keyboard from shortcut icon network other letters to initial alphabetical process therebetween, and other letters of process between per two letters.With the English spelling principle as the retrieval matched rule, " b, a, i, d, the u " position on keyboard and the matching degree of gesture of network address " www.baidu.com " are higher, retrieve the network address of mating with the gesture track according to local matching principle and are " www.baidu.com ".
For another example, if gesture is drawn through being x, i, n, l, a, n, g, gesture is also streaked on the dummy keyboard from shortcut icon network other letters to initial alphabetical process therebetween, and other letters of process between per two letters.With the phonetic spelling rules as the retrieval matched rule, phonetic alphabet " x, i, n, l, a, n, the g " position on keyboard and the matching degree of gesture of the Chinese name " Sina " of network address " www.sina.com.cn " are higher, retrieve the network address of mating with the gesture track according to local matching principle and are " www.sina.com.cn ".
Wherein, retrieving both can be local, also corresponding gesture parameter can be carried out pre-service and send to that server end carries out, and perhaps local retrieved simultaneously with server end, then Dui Ying network address storehouse can be positioned at this locality, and/or is stored on the server.For network search, the pretreated degree of depth before the retrieval depends on the ins and outs when implementing, as whether needing to determine the character string that finger streaks, the employed keyboard layout data of user etc.
405, command execution module 215 jumps to the network address of result for retrieval correspondence;
For example, give an example as shown in Figure 7, jump to the homepage www.sina.com.cn of Sina.
406, optional, command execution module 215 is hidden the dummy keyboard of described keyboard layout.
In this step, can before jumping to network address, also can after jumping to network address, hide dummy keyboard.
Embodiment 3
In this specific embodiment, use as described gesture instruction icon with shortcut icon, as target database, the order of execution is for starting application program with application database.This enforcement comprises concrete steps in the following example:
501, the gesture instruction icon arranges shortcut icon on module 211 screens and uses and to be set to the gesture instruction icon, sets up the incidence relation between shortcut icon APPS and the application database;
Wherein, application database comprises local application program of having installed.
502, use the touch action of sending if interactive interface 212 receives the user at shortcut icon, then show dummy keyboard;
503, the input gestures detection module 213 lasting users of reception draw the gesture track data of importing through dummy keyboard;
For example, give an example as shown in Figure 8, the user streaks alphabetical s, i, n, a on the keyboard successively from using shortcut icon.The gesture track data is to use the data of streaking the continuous path of s on the keyboard, i, n, a successively from shortcut icon.
504, matching detection module 214 will be imported the application code of storing in the data of gesture track and the application database and mate, and obtain result for retrieval;
Give an example as shown in Figure 8, according to the layout of English on dummy keyboard, gesture is drawn the continuous path through s, i, n, a, streaks following character: c, x, s, d, y, u, i, j, n, b, v, c, x, a on the keyboard layout of dummy keyboard continuously.
Give an example as shown in Figure 8, the English spelling principle as the retrieval matched rule, is retrieved local mounted application program " SinaWeiBo " in application database.The phonetic spelling rules as the retrieval matched rule, is retrieved local mounted application program " star despot air battle " in application database.
505, command execution module 215 starts the result for retrieval corresponding application program;
Give an example as shown in Figure 8, owing to match a plurality of result for retrieval, before starting application program, eject at screen and to comprise that the menu of whole result for retrieval " SinaNews ", " star despot air battle " selected by the user.Start user-selected result for retrieval corresponding application program.And, keep showing on the dialing keyboard layout at screen.The user can also abandon this result for retrieval, re-enters in the dialing keyboard layout, namely forwards step 503 to.
Application program started both can be application program independently, it also can be the build-in function that is integrated in the command process, it can also be the online application on the server, for example, when the corresponding simplicity coding " j, s, q " of user input " counter " or spelling coding " j, i, s, u, a, n, q, i " or English are write a Chinese character in simplified form " c, a, l " etc., after matching detection module 214 is mated, obtain matching result " counter ", just can directly start the counter program, namely eject the counter interface.Similarly, when the user imports " air ticket " corresponding order simplicity coding " j, p " or spelling coding " j, i, p, i, a, o ", after matching detection module 214 is mated, obtain matching result " air ticket ", just can directly start the ticket booking program, namely ejection further requires the user to import " starting point " " destination " information such as " sailing dates " earlier, and then carries out the air ticket search.
506, optional, command execution module 215 is hidden the dummy keyboard of described keyboard layout.
In this step, can before starting application program, also can be after starting application program, to hide dummy keyboard.
Embodiment 4
If the shortcut icon mail is as described gesture instruction icon, with the addresses of items of mail storehouse as target database.The order of carrying out sends software for starting mail, and result for retrieval is set to the mail recipient address.This enforcement comprises concrete steps in the following example:
601, the shortcut icon mail that arranges on module 211 screens of gesture instruction icon is set to the gesture instruction icon, sets up the incidence relation between shortcut icon mail and the addresses of items of mail storehouse;
Usually the contact database of system contact's database or other specific programs is set to, and the addresses of items of mail storehouse arranges when specifically implementing as required.
602, if interactive interface 212 receives the touch action that the user sends at the shortcut icon mail, then show dummy keyboard;
603, the input gestures detection module 213 lasting users of reception draw the gesture track data of importing through dummy keyboard;
For example, give an example as shown in Figure 9, the user streaks alphabetical s, i, n, a on the keyboard successively from the shortcut icon mail.The gesture track data streaks the data of the continuous path of s on the keyboard, i, n, a successively for from the shortcut icon mail.
604, matching detection module 214 will be imported the command code of storing in gesture track data and the addresses of items of mail storehouse and mate, and obtain result for retrieval;
Give an example as shown in Figure 9, according to the layout on the keyboard, gesture is drawn the continuous path through z, s, i, n, a, streaks following character: z, s, i, n, a on the keyboard layout of dummy keyboard continuously.
Give an example as shown in Figure 9, according to matched rule, in the addresses of items of mail storehouse, match following result for retrieval " Liu Bing liubing@sina.com ", " Li Yue liyue@sina.com ", " purple Na zina@163.com ".Described matched rule is identical with step 404, does not repeat them here.
605, command execution module 215 starts mail transmission software, and result for retrieval is set to the mail recipient address;
Give an example as shown in Figure 9, owing to match a plurality of result for retrieval, carrying out startup mail transmission software, and result for retrieval is set to before the order of mail recipient address, ejects at screen to comprise that the menu of whole result for retrieval " Liu Bing liubing@sina.com ", " Li Yue liyue@sina.com ", " purple Na zina@163.com " selected by the user.And, keep showing on the dialing keyboard layout at screen.The user can also abandon this result for retrieval, re-enters in the dialing keyboard layout, namely forwards step 503 to.After receiving user's selection result, start mail and send software, and the result for retrieval that the user selects is set to the mail recipient address.
606, optional, command execution module 215 is hidden the dummy keyboard of described keyboard layout.
In this step, can before starting mail transmission software, also can be after mail sends successfully, to hide dummy keyboard.
Embodiment 5
If shortcut icon search is as described gesture instruction icon, with the input method dictionary as target database.The order of carrying out is for being enabled in the line retrieval flow process.This enforcement comprises concrete steps in the following example:
701, the shortcut icon search that arranges on module 211 screens of gesture instruction icon is set to the gesture instruction icon, sets up the incidence relation between shortcut icon search and the input method dictionary;
Give an example as shown in figure 10, this target database is the spelling input method dictionary.
702, if interactive interface 212 receives the touch action that the user sends in the shortcut icon search, then show dummy keyboard;
703, the matching detection module 214 lasting users of reception draw the gesture track data of importing through dummy keyboard;
For example, give an example as shown in figure 10, the user streaks alphabetical l, k, i, e, w, u on the keyboard successively from the shortcut icon search.The gesture track data is from shortcut icon search, the data of streaking the continuous path of l on the keyboard, k, i, e, w, u successively.
Give an example as shown in figure 10, according to the layout on the keyboard, the gesture track is drawn the continuous path through l, k, i, e, w, u, streaks following character: l, k, i, e, w, u on the keyboard layout of dummy keyboard continuously.
704, matching detection module 214 will be imported the coding of storing in gesture track data and the input method dictionary and mate, and obtain result for retrieval;
Give an example as shown in figure 10, according to the layout on the keyboard, the gesture track is drawn through l, k, i, e, w, u.According to matched rule, the character string of gesture track and spelling input method dictionary match following result for retrieval " present ", " Lee five ", " Li Wu ".Described matched rule is identical with step 404, does not repeat them here.
705, command execution module 215 startups are to the on-line search of result for retrieval;
Give an example as shown in figure 10, owing to match a plurality of result for retrieval, before the on-line search that starts result for retrieval, also be included in to eject on the screen and comprise that the menu of whole result for retrieval " present ", " Lee five ", " Li Wu " selected by the user.And, keep showing on the dialing keyboard layout at screen.The user can also abandon this result for retrieval, re-enters in the dialing keyboard layout, namely forwards step 803 to.After receiving user's selection result, start the on-line search of the result for retrieval that the user is selected.
706, optional, command execution module 215 is hidden the dummy keyboard of described keyboard layout.
In this step, can before being enabled in line retrieval, also can be the virtual layout of after withdrawing from online retrieving, hiding described keyboard layout.
The above only is preferred embodiment of the present invention, and is in order to limit the present invention, within the spirit and principles in the present invention not all, any modification of making, is equal to replacement, improvement etc., all should be included within the scope of protection of the invention.

Claims (16)

1. the command executing method based on gesture is characterized in that, comprising:
At screen the gesture instruction icon is set, sets up the incidence relation between described gesture instruction icon and the target database;
If receive the user in the touch action that described gesture instruction icon sends, then show dummy keyboard;
Continue to receive the user and draw gesture track data through the dummy keyboard input, the acquisition result for retrieval is mated in the command code of storing in the described gesture track data that receives and the described target database; And
According to described result for retrieval fill order.
2. according to the described method of claim 1, it is characterized in that described gesture track data is the data from the track of the initial continuous gesture that continues to streak the target character on the keyboard layout of described gesture instruction icon.
3. method according to claim 1 is characterized in that, described touch action comprises: click and click the mobile default at least distance in back.
4. method according to claim 1 is characterized in that, further comprises:
If receiving the user clicks the gesture instruction icon, and finger frames out immediately after clicking, and shows the default response interface corresponding with this gesture instruction icon, or shows default desktop state; Perhaps
If receiving the user clicks the gesture instruction icon, and finger does not frame out after clicking, and shows the dummy keyboard of the corresponding keyboard layout of the associated target database of described gesture instruction icon; And, if after receiving described click, do not receive the movement of user on described dummy keyboard, be that the user points and mobilely after clicking the gesture instruction icon just frames out, perhaps receive mobile distance less than default distance, hide dummy keyboard, return to default desktop state, perhaps, show the default response interface corresponding with this gesture instruction icon.
5. method according to claim 1 is characterized in that, described target data library storage with described gesture instruction icon the relevant data message of corresponding command type.
6. method according to claim 1 is characterized in that, the keyboard layout of described dummy keyboard is corresponding with described target database or gesture instruction icon.
7. method according to claim 1 or 5 is characterized in that the described incidence relation of setting up between described gesture instruction icon and the target database comprises: set up the incidence relation between described gesture instruction icon and the one or more target database.
8. method according to claim 1 is characterized in that, described screen comprises lock-screen, and/or idle screen, and/or Application Program Interface, for lock-screen, further comprises:
The described screen of release.
9. method according to claim 7 is characterized in that, described demonstration comprises with the dummy keyboard of the corresponding keyboard layout of described target database:
As if described gesture instruction icons association to a target database, show the dummy keyboard of the keyboard layout of this target database correspondence;
If described gesture instruction icons association to a plurality of target databases, also comprised before the dummy keyboard that shows described keyboard layout: the complete order type that shows described gesture instruction icon correspondence is selected for the user; Receive the command type that the user selects, shows a dummy keyboard, the target database that the keyboard layout of wherein said dummy keyboard and the command type of described user's selection are corresponding is corresponding.
10. method according to claim 1 is characterized in that, described described result for retrieval fill order is comprised:
If obtaining the matching degree of a result for retrieval and this result for retrieval, coupling surpasses preset threshold, then to described result for retrieval fill order;
If only coupling obtains a result for retrieval, but the matching degree of the result for retrieval of described acquisition does not surpass preset threshold, then before fill order, also comprise: at the result for retrieval of the described acquisition of screen demonstration, whether selected to described result for retrieval fill order by the user;
If coupling obtains a plurality of result for retrieval, then before fill order, also comprise: eject the menu of the result for retrieval that comprises whole described acquisitions at screen, selected by the user.
11. method according to claim 10 is characterized in that, comprising:
Result for retrieval fill order to described user's selection.
12. according to the described method of claim 1, it is characterized in that, can also comprise:
Hide described dummy keyboard.
13. the command execution device based on gesture is characterized in that, comprising:
The gesture instruction icon arranges module, is used at screen the gesture instruction icon being set, and sets up the incidence relation between described gesture instruction icon and the target database;
Interactive interface is used for receiving the touch action that the user sends at described gesture instruction icon, shows and the associated target database corresponding virtual of described gesture instruction icon keyboard;
Input gesture track data detection module is used for continuing to receive the user and draws the gesture track data of importing through dummy keyboard;
The matching detection module is used for the command code that the described gesture track data that will receive and target database stores and mates the acquisition result for retrieval;
Command execution module is used for carrying out corresponding order according to described result for retrieval.
14. the command execution device based on gesture according to claim 13 is characterized in that, the gesture track that described interactive interface receives is initial from described gesture instruction icon.
15. the command execution device based on gesture according to claim 13, it is characterized in that, described interactive interface, receive the user and click the gesture instruction icon, and clicking the back finger frames out immediately, show the default response interface corresponding with this gesture instruction icon, or show default desktop state; Perhaps
Described interactive interface receives the user and clicks the gesture instruction icon, and finger does not frame out after clicking, and shows the dummy keyboard of the corresponding keyboard layout of the associated target database of described gesture instruction icon; And, after receiving described click, do not receive the movement of user on described dummy keyboard, be that the user points and mobilely after clicking the gesture instruction icon just frames out, perhaps receive mobile distance less than default distance, hide dummy keyboard, return to default desktop state, perhaps, show the default response interface corresponding with this gesture instruction icon.
16. method according to claim 13 is characterized in that, described command execution module can also be used for hiding the dummy keyboard of described keyboard layout.
CN201210535761.8A 2012-12-13 2012-12-13 The method and apparatus that a kind of order based on gesture performs Active CN103324425B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201210535761.8A CN103324425B (en) 2012-12-13 2012-12-13 The method and apparatus that a kind of order based on gesture performs

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201210535761.8A CN103324425B (en) 2012-12-13 2012-12-13 The method and apparatus that a kind of order based on gesture performs

Publications (2)

Publication Number Publication Date
CN103324425A true CN103324425A (en) 2013-09-25
CN103324425B CN103324425B (en) 2016-08-03

Family

ID=49193205

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201210535761.8A Active CN103324425B (en) 2012-12-13 2012-12-13 The method and apparatus that a kind of order based on gesture performs

Country Status (1)

Country Link
CN (1) CN103324425B (en)

Cited By (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103677633A (en) * 2013-11-22 2014-03-26 小米科技有限责任公司 Screen unlocking method and device and terminal
CN103905871A (en) * 2014-03-24 2014-07-02 小米科技有限责任公司 Intelligent household appliance control method, device and terminal
CN104023107A (en) * 2014-06-10 2014-09-03 爱维特信息技术有限公司 Gesture dial method implemented on numeric keyboard
CN104657042A (en) * 2015-03-10 2015-05-27 苏州天鸣信息科技有限公司 Trigger realizing method for application program icon and mobile terminal for trigger realizing method
CN105094601A (en) * 2015-06-29 2015-11-25 联想(北京)有限公司 Control method and electronic device
CN105302452A (en) * 2014-07-22 2016-02-03 腾讯科技(深圳)有限公司 Gesture interaction-based operation method and device
CN105468270A (en) * 2014-08-18 2016-04-06 腾讯科技(深圳)有限公司 Terminal application control method and device
CN105653084A (en) * 2014-11-27 2016-06-08 三星电子株式会社 Screen configuration method, electronic device, and storage medium
CN106796673A (en) * 2014-06-30 2017-05-31 A·F·沙班 For the improved system and method for charging
CN106940653A (en) * 2017-04-14 2017-07-11 北京小米移动软件有限公司 Control method, device and the computer-readable recording medium of application program
CN107219933A (en) * 2017-05-10 2017-09-29 北京百度网讯科技有限公司 The operation processing method and device of input method, computer equipment and computer-readable recording medium
CN107517318A (en) * 2017-08-28 2017-12-26 上海传英信息技术有限公司 The method, apparatus and its terminal of a kind of speed dialling
CN107608587A (en) * 2017-10-11 2018-01-19 广州品唯软件有限公司 Display methods, device and the storage medium of customizing keyboard
CN107852566A (en) * 2014-12-30 2018-03-27 泰科消防及安全有限公司 Gesture identification and control based on background
CN110709809A (en) * 2017-09-12 2020-01-17 华为技术有限公司 Touch operation response method and terminal
CN111258412A (en) * 2018-11-30 2020-06-09 宁波方太厨具有限公司 Gesture operation recognition method and gesture control device applying same
CN113989611A (en) * 2021-12-20 2022-01-28 北京优幕科技有限责任公司 Task switching method and device
US11475411B2 (en) 2014-06-30 2022-10-18 Fulcrum Global Technologies Inc. System and method for billing and professional companies and firms relating to budgets and monthly bills
CN115309320A (en) * 2022-08-04 2022-11-08 吉林大学 Man-machine interaction system of automobile driving simulator

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040140956A1 (en) * 2003-01-16 2004-07-22 Kushler Clifford A. System and method for continuous stroke word-based text input
CN101315592A (en) * 2008-07-18 2008-12-03 华硕电脑股份有限公司 Touch control type mobile operation device and display method used on the same
CN102819567A (en) * 2012-07-17 2012-12-12 重庆优腾信息技术有限公司 Method and system for searching contact information in electronic equipment

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040140956A1 (en) * 2003-01-16 2004-07-22 Kushler Clifford A. System and method for continuous stroke word-based text input
CN101315592A (en) * 2008-07-18 2008-12-03 华硕电脑股份有限公司 Touch control type mobile operation device and display method used on the same
CN102819567A (en) * 2012-07-17 2012-12-12 重庆优腾信息技术有限公司 Method and system for searching contact information in electronic equipment

Cited By (29)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103677633B (en) * 2013-11-22 2016-07-06 小米科技有限责任公司 Unlocking screen method, device and terminal
CN103677633A (en) * 2013-11-22 2014-03-26 小米科技有限责任公司 Screen unlocking method and device and terminal
CN103905871A (en) * 2014-03-24 2014-07-02 小米科技有限责任公司 Intelligent household appliance control method, device and terminal
CN104023107A (en) * 2014-06-10 2014-09-03 爱维特信息技术有限公司 Gesture dial method implemented on numeric keyboard
CN104023107B (en) * 2014-06-10 2016-10-05 无锡爱维特信息技术有限公司 A kind of gesture Dialing Method realizing on numeric keypad
US11475411B2 (en) 2014-06-30 2022-10-18 Fulcrum Global Technologies Inc. System and method for billing and professional companies and firms relating to budgets and monthly bills
CN106796673A (en) * 2014-06-30 2017-05-31 A·F·沙班 For the improved system and method for charging
CN106796673B (en) * 2014-06-30 2022-01-04 A·F·沙班 Improved system and method for charging
CN105302452A (en) * 2014-07-22 2016-02-03 腾讯科技(深圳)有限公司 Gesture interaction-based operation method and device
CN105302452B (en) * 2014-07-22 2020-10-30 腾讯科技(深圳)有限公司 Operation method and device based on gesture interaction
CN105468270A (en) * 2014-08-18 2016-04-06 腾讯科技(深圳)有限公司 Terminal application control method and device
CN105653084A (en) * 2014-11-27 2016-06-08 三星电子株式会社 Screen configuration method, electronic device, and storage medium
US11442580B2 (en) 2014-11-27 2022-09-13 Samsung Electronics Co., Ltd. Screen configuration method, electronic device, and storage medium
CN107852566B (en) * 2014-12-30 2020-12-18 泰科消防及安全有限公司 Context-based gesture recognition and control
CN107852566A (en) * 2014-12-30 2018-03-27 泰科消防及安全有限公司 Gesture identification and control based on background
CN104657042B (en) * 2015-03-10 2018-04-03 洛阳理工学院 A kind of application program image target triggering implementation method and its mobile terminal
CN104657042A (en) * 2015-03-10 2015-05-27 苏州天鸣信息科技有限公司 Trigger realizing method for application program icon and mobile terminal for trigger realizing method
CN105094601A (en) * 2015-06-29 2015-11-25 联想(北京)有限公司 Control method and electronic device
CN105094601B (en) * 2015-06-29 2019-03-08 联想(北京)有限公司 A kind of control method and electronic equipment
CN106940653A (en) * 2017-04-14 2017-07-11 北京小米移动软件有限公司 Control method, device and the computer-readable recording medium of application program
CN107219933A (en) * 2017-05-10 2017-09-29 北京百度网讯科技有限公司 The operation processing method and device of input method, computer equipment and computer-readable recording medium
CN107517318A (en) * 2017-08-28 2017-12-26 上海传英信息技术有限公司 The method, apparatus and its terminal of a kind of speed dialling
CN110709809A (en) * 2017-09-12 2020-01-17 华为技术有限公司 Touch operation response method and terminal
CN107608587A (en) * 2017-10-11 2018-01-19 广州品唯软件有限公司 Display methods, device and the storage medium of customizing keyboard
CN111258412B (en) * 2018-11-30 2021-10-22 宁波方太厨具有限公司 Gesture operation recognition method and gesture control device applying same
CN111258412A (en) * 2018-11-30 2020-06-09 宁波方太厨具有限公司 Gesture operation recognition method and gesture control device applying same
CN113989611A (en) * 2021-12-20 2022-01-28 北京优幕科技有限责任公司 Task switching method and device
CN115309320A (en) * 2022-08-04 2022-11-08 吉林大学 Man-machine interaction system of automobile driving simulator
CN115309320B (en) * 2022-08-04 2023-10-03 吉林大学 Man-machine interaction system of automobile driving simulator

Also Published As

Publication number Publication date
CN103324425B (en) 2016-08-03

Similar Documents

Publication Publication Date Title
CN103324425B (en) The method and apparatus that a kind of order based on gesture performs
US10698604B2 (en) Typing assistance for editing
CN103649876B (en) Performing actions on a computing device using a contextual keyboard
US8463731B2 (en) Translating user interaction with a touch screen into text
CN103038728B (en) Such as use the multi-mode text input system of touch-screen on a cellular telephone
CN101526879B (en) Speech input interface on a device
CN102460362B (en) Glyph entry on computing device
CN105630327B (en) The method of the display of portable electronic device and control optional element
US20130007606A1 (en) Text deletion
JP6426417B2 (en) Electronic device, method and program
CN104156161A (en) System and method for carrying out clicking, word capturing and searching on information equipment screen
KR20160011230A (en) Input processing method and apparatus
JP6153919B2 (en) Method and apparatus for processing input information
CN101287026A (en) System and method for executing quick dialing by hand-write recognition function
CN104133815A (en) Input and search method and system
CN102566934A (en) Sliding autofilter input method for touch screen
CN104239550A (en) System and method for performing double-click work-capturing search on screen of information equipment
EP3298761B1 (en) Multi-switch option scanning
CN102662479A (en) Parallel-stoking input method supporting multi-touch, and apparatus thereof
WO2012159245A1 (en) Displaying key pinyins
KR20150093045A (en) Sketch Retrieval system, user equipment, service equipment and service method based on meteorological phenomena information and computer readable medium having computer program recorded therefor
JP6102241B2 (en) Character input program, character input device, and character input method

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
TR01 Transfer of patent right
TR01 Transfer of patent right

Effective date of registration: 20210420

Address after: 401121 d1-5-1, No.82 Xingguang Avenue, gaoxinyuan, northern New District, Yubei District, Chongqing

Patentee after: CHONGQING HYTAK TECHNOLOGY DEVELOPMENT Co.,Ltd.

Address before: 401121, 3 floor, B4 building, mercury science building, 5 middle road, Mount Huangshan Avenue, North New District, Chongqing

Patentee before: CHONGQING YEAHTO INFORMATION TECHNOLOGY Co.,Ltd.