CN103180815A - Automated adjustment of input configuration - Google Patents
Automated adjustment of input configuration Download PDFInfo
- Publication number
- CN103180815A CN103180815A CN2011800521910A CN201180052191A CN103180815A CN 103180815 A CN103180815 A CN 103180815A CN 2011800521910 A CN2011800521910 A CN 2011800521910A CN 201180052191 A CN201180052191 A CN 201180052191A CN 103180815 A CN103180815 A CN 103180815A
- Authority
- CN
- China
- Prior art keywords
- input
- field
- input configuration
- user
- configuration state
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0489—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using dedicated keyboard keys or combinations thereof
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/02—Input arrangements using manually operated switches, e.g. using keyboards or dials
- G06F3/023—Arrangements for converting discrete items of information into a coded form, e.g. arrangements for interpreting keyboard generated codes as alphanumeric codes, operand codes or instruction codes
- G06F3/0233—Character input methods
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
- Input From Keyboards Or The Like (AREA)
Abstract
A method and system for automatically adjusting input configuration are disclosed. The method may include monitoring information input by a user into a graphical user interface (GUI). The method may further include determining an input configuration state of the computing system set by the user for the information input into at least one field of the GUI at an initial input instance. The method may also include, at one or more subsequent input instances, automatically adjusting the input configuration state for the field to the determined input configuration of the initial input instance. A computer program product is also disclosed.
Description
Background technology
The present invention relates to the self-adjusting method and system of input configuration.
When utilizing department of computer science to unify application work, sometimes, can need the operator to change keyboard state.This occurs in following situation, for example, when input needs except when during the data field of front extralinguistic keyboard language (for example when current user with English mode wants with Hebrew (Hebrew) input data), when changing the state of caps lock (Caps Lock) or number lock (Num Lock), and when changing keyboard layout.
In each situation, such change is made in a similar fashion, and sometimes even repeats.For example, say that Hebraic user changes into Hebrew with the keyboard language setting when input text in the e-mail text field, then when input e-mail address in the e-mail address field, English is changed in the keyboard language setting.Change although it is so is relatively easy infers and prediction, but they are not made automatically most of the time.
A known exception is to process password field.Have the recognition code field, storage is used for the following password that uses, and even advises inputting browser and the plug-in unit of password to the user.Yet this scheme is specific to using, and only take password as target.
Summary of the invention
According to embodiments of the invention, provide a kind of method of input configuration of automatic adjustment computing system.The method can comprise: monitor the information to the middle input of graphical user interface (GUI) by the user.The method also can comprise: determine at initial input example place to be the input configuration state of the computing system that arranges of the information inputted at least one field of GUI by the user.The method also can comprise: at one or more example places of inputting subsequently, will automatically be adjusted into for the input configuration state of described at least one field the input configuration of determined initial input example.
In addition, according to embodiments of the invention, provide a kind of computer program of storing on non-provisional tangible computer-readable recording medium.This computer program can comprise for monitoring the code to the information of graphical user interface (GUI) input by the user.This computer program can comprise for determining at initial input example place by the user to be the code of the input configuration state of the computing system that arranges to the information that at least one field of GUI is inputted.This computer program also can comprise at one or more example places of inputting subsequently, will automatically be adjusted into for the input configuration state of described at least one field the code of the input configuration of determined initial input example.
In addition, according to embodiments of the invention, provide a kind of system of automatic adjustment input configuration.This system can comprise: processor is configured to: monitor the information to the middle input of graphical user interface (GUI) by the user.This processor also can be configured to: determine at initial input example place to be the input configuration state of the computing system that arranges of the information inputted at least one field of GUI by the user.This processor also can be configured to: at one or more example places of inputting subsequently, will automatically be adjusted into for the input configuration state of described at least one field the input configuration of determined initial input example.
In addition, according to embodiments of the invention, provide a kind of method of input configuration of automatic adjustment computing system.The method can comprise: by carrying out screen scraping, monitor the information to the middle input of graphical user interface (GUI) by the user.The method also can comprise: indicate the Operational System Control of input configuration state by tracking, determine at initial input example place to be the input configuration state of the computing system that arranges of the information inputted by the user at least one field of GUI.The method also can comprise: at one or more example places of inputting subsequently, will automatically be adjusted into for the input configuration state of described at least one field the input configuration of determined initial input example.
Description of drawings
Now, only by example, with reference to accompanying drawing, the preferred embodiments of the present invention are described, wherein:
Fig. 1 illustrates the graphical user interface (GUI) 12 of e-mail applications (prior art).
Fig. 2 illustrates the method for automatically adjusting according to an embodiment of the invention the input configuration of computing system.
Fig. 3 illustrates the processing of automatically adjusting according to an embodiment of the invention the input configuration of computing system.
Fig. 4 illustrates the system that automatically adjusts according to an embodiment of the invention the input configuration of computing system.
Embodiment
The person of ordinary skill in the field knows, the present invention can be implemented as system, method or computer program.Therefore, the disclosure can specific implementation be following form, that is: can be completely hardware, also can be software (comprising firmware, resident software, microcode etc.) completely, can also be the form of hardware and software combination, this paper is commonly referred to as " circuit ", " module " or " system ".In addition, in certain embodiments, the present invention can also be embodied as the form of the computer program in one or more computer-readable mediums, comprises computer-readable program code in this computer-readable medium.
Can adopt the combination in any of one or more computer-readable media.Computer-readable medium can be computer-readable signal media or computer-readable recording medium.Computer-readable recording medium can be for example---but being not limited to---electricity, magnetic, light, electromagnetism, infrared ray or semi-conductive system, device or device, perhaps any above combination.The example more specifically of computer-readable recording medium (non exhaustive list) comprising: have the electrical connection, portable computer diskette, hard disk, random-access memory (ram), ROM (read-only memory) (ROM), erasable type programmable read only memory (EPROM or flash memory), optical fiber, Portable, compact disk ROM (read-only memory) (CD-ROM), light storage device, magnetic memory device of one or more wires or the combination of above-mentioned any appropriate.In presents, computer-readable recording medium can be any comprising or stored program tangible medium, and this program can be used or be combined with it by instruction execution system, device or device.
Computer-readable signal media can be included in base band or as the data-signal that a carrier wave part is propagated, wherein carry computer-readable program code.The combination of electromagnetic signal that the data-signal of this propagation can adopt various ways, comprises---but being not limited to---, light signal or above-mentioned any appropriate.Computer-readable signal media can also be any computer-readable medium beyond computer-readable recording medium, and this computer-readable medium can send, propagates or transmit the program of using or being combined with it for by instruction execution system, device or device.
The program code that comprises on computer-readable medium can be with any suitable medium transmission, comprises that---but being not limited to---is wireless, electric wire, optical cable, RF etc., the perhaps combination of above-mentioned any appropriate.
Can make up to write the computer program code that operates for carrying out the present invention with one or more programming languages or its, described programming language comprises object oriented program language-such as Java, Smalltalk, C++, also comprise conventional process type programming language-such as " C " language or similar programming language.Program code can fully carried out on subscriber computer, partly carry out on subscriber computer, carrying out on remote computer or carrying out on remote computer or server fully in part on subscriber computer as an independently software package execution, part.In relating to the situation of remote computer, remote computer can be by the network of any kind---comprise LAN (Local Area Network) (LAN) or wide area network (WAN)-be connected to subscriber computer, perhaps, can be connected to outer computer (for example utilizing the ISP to pass through Internet connection).
The below describes the present invention with reference to process flow diagram and/or the block diagram of method, device (system) and the computer program of the embodiment of the present invention.Should be appreciated that the combination of each square frame in each square frame of process flow diagram and/or block diagram and process flow diagram and/or block diagram, can be realized by computer program instructions.These computer program instructions can offer the processor of multi-purpose computer, special purpose computer or other programmable data treating apparatus, thereby produce a kind of machine, these computer program instructions are carried out by computing machine or other programmable data treating apparatus, have produced the device of setting function/operation in the square frame in realization flow figure and/or block diagram.
Also can be stored in these computer program instructions and can make in computing machine or the computer-readable medium of other programmable data treating apparatus with ad hoc fashion work, like this, the instruction that is stored in computer-readable medium just produces a manufacture (manufacture) that comprises the command device (instruction means) of setting function/operation in the square frame in realization flow figure and/or block diagram.
Also can be loaded into computer program instructions on computing machine, other programmable data treating apparatus or miscellaneous equipment, make and carry out the sequence of operations step on computing machine, other programmable data treating apparatus or miscellaneous equipment, producing computer implemented process, thereby make the process of setting function/operation in the square frame of the instruction of carrying out during realization flow figure and/or block diagram can be provided on computing machine or other programmable device.
Process flow diagram in accompanying drawing (a plurality of) and block diagram (a plurality of) illustrate the framework, function of system according to each embodiment of the present invention, method and computer program product and operation that may scheme.Thus, each square frame in process flow diagram or block diagram can represent module, section or code section, comprises be used to the one or more executable instructions that realize specified logic function.It shall yet further be noted that in some alternativess, the function of square frame indicating can occurring in sequence not according to accompanying drawing.For example, two square frames shown in continuously can be carried out in fact substantially simultaneously, or described square frame can sometimes carry out in reverse order, and this depends on related functional.The combination that it shall yet further be noted that the square frame of each square frame of block diagram and/or flowchart illustrations and block diagram and/or flowchart illustrations can realize by the combination based on dedicated hardware systems or specialized hardware and computer instruction of carrying out specific function or behavior.
According to embodiments of the invention, disclosed herein is a kind of self-adjusting method and system that carries out the input configuration of computing system for each the particular data field in the graphical user interface that is monitored in computer utility.
In the context of the present invention, term " input interface " (for example is understood to cover all types of input interfaces, keyboard, pointing device, touch-screen), in the time of can being used for Application Hints on running on computing equipment by the user as required or the expectation input message, and at the upper tablet pattern user interface that shows of display (for example monitor screen).
According to embodiments of the invention, the self-adjusting method and system of input interface configuration can provide automatic adjustment for the input interface configuration of the input behavior that adapts to the user based on study user's input behavior and to this user.
According to embodiments of the invention, the method and system of Lookup protocol keyboard input configuration can be designed to learn each user's of groups of users input behavior, and the automatic keyboard input configuration that the input behavior that adapts to the user is provided to each user.
According to embodiments of the invention, the method and system of Lookup protocol keyboard input configuration can shorten the typing time of data layout and can reduce mistake.
There are the various types of input fields that need different input configurations.For example, e-mail address field (typically, needing the Latin keyboard configuration), name field (typically, native language configuration), numeric field (numeral configuration).
According to embodiments of the invention, can use the screen scraping technology, relate to when computing machine is moving and adopt the OCR(optical character identification need to be from the application of user's input the time on screen picture) screen content that shows to the user with identification.The screen scraping technology also can comprise the parsing of the structural data that operation that GUI belongs to is used, this or (via API) directly extract or extract via operating system (OS) from using itself.
Method can comprise the following steps according to an embodiment of the invention:
A) monitor application screen when the user works, the content by screen scraping (OCR) recognition screen also detects input interface (for example keyboard, mouse) event or other operations of being carried out by operating system.
B) user is current edits the field of (based on the data from (a)) in identification.
C) screen edited of User and field study user behavior and system configuration, and
D) after enough understandings of assembling about specific user's behavior, generate at least one rule for the input field of each supervision.
E) as user next time in the field of the graphical user interface that shows on screen that monitors during input message, if before generated rule, the method for recommending is used the input interface configuration automatically according to the rule that generates.
When the clue that exists the user just to key in, maybe will key in, can use the input interface configuration change in specific fields.
In alternative of the present invention, can use the input interface configuration change in the post-processed process automatically.In the post-processed routine, can automatically adjust according to the input mode (rather than in data typing automatic system configuration simultaneously) of study the field (or a plurality of field) of window.Automatically the post-processed process can be during the user carries out the input of information or just completes (for example the pressing button or the chart of appointment by the user) that is started by the user after the input of information the user or operate in this field.
For example, consider above-mentioned Email example.According to embodiments of the invention, the application monitors screen picture of appointment (by carrying out screen scraping) is also related with its input behavior with the user.(" be sent to: (To :) " by theme in most of e-mail applications and characterize when the user points to the e-mail address field, this can find in the left side of field in many cases and so identify in the screen scraping stage) time, only have in input interface-this situation for keyboard-language mode be English (or using alphabetic(al) other language arbitrarily that are suitable for the typing e-mail address), he or she just inputs e-mail address, and if language mode is not English, the user is English with the language configuration change.These behaviors are by the record that should be used for of appointment, thereby after the enough information of assembling about this field, user's activation email is used and when beginning to write email message next time, when arriving the e-mail address field, the language mode of the application verification keyboard of appointment is English, and if be not English-language mode is switched to English by system.The application examples of appointment changes corresponding KeyEvent as passing through to generate with language mode, or changes by using application programming interface (API) to carry out keyboard language.
The self-adjusting method of input interface configuration can be based on the visual analysis of screen according to an embodiment of the invention, therefore it can be applicable to showing input interface on screen for the user being used for the random procedure of the field input message on the input interface, and its independence and not needing is accessed the source code of application of supervision and/or the platform that it is performed in the above.
Fig. 1 illustrates the graphical user interface (GUI) 12 of e-mail applications (prior art), comprise that some menu key of menu key 16(are texts, and some menu key is graphic icons).GUI12 also comprises e-mail address field 18(" To:(is sent to) " and " CC:(makes a copy for) "), it is designed to typing addressee's e-mail address; With two the text fields-" Subject(theme) " field 20 and message body field 14, it is designed to the typing text.
When the user wanted to use language (maybe can use its alphabet with other language of appropriate format typing e-mail address) except English to send email message, he or she carried out following behavior:
A) for example by being positioned over, cursor selects the e-mail address field in the e-mail address field, and typing addressee's e-mail address.If the configuration of the current language of keyboard is English, the user will key in e-mail address.Yet, if the configuration of the current language of keyboard is not English, for example be not suitable for Hebrew, Arabic, Chinese, Russian of e-mail address or be not suitable for other language of e-mail address, at first the user switches to English with the current language configuration of keyboard.May at first do the key entry that makes mistake with the language setting of mistake, and occur when wrong, the user will delete the text keyed in and before again keying in, the language of keyboard be configured and switch to English.
B) for example select the text field by cursor is positioned over the text field, and key in message with the language of expectation.If the language of expectation is to use the alphabetic(al) language different from Set For Current, the user switches to this language with the language configuration of keyboard.
The order of information registration (for example at first the typing e-mail address is also keyed in Message-text subsequently, or vice versa) can be arbitrarily.
According to embodiments of the invention, can monitor the screen picture of the GUI of application.Can detect visual text and figure project or the symbol (for example icon) that occurs on screen with the screen scraping instrument.Content of text or graphic assembly and position thereof that record detects.Can use input interface (for example keyboard and/or mouse) monitoring instrument and the concurrent working of screen scraping instrument, to be used for recording order and the mouse click event of keyboard typing.
Can identify the action field of current entry information.Existence is for detection of the known method of the position of editor's mark (for example cursor).For example, the sign that seek can be flicker mark or the highlighted field on screen, and the two can detect by known change detection technique.After each keyboard knocks, can analyze screen, and the appearance of the new symbol on screen can be indicated the position when the field of pre-editing.
If there is mouse click event, but the environment that can analyze the coordinate of this event and this event perhaps can be compared it to be used for determining existing of edit field with the analysis of before having completed around the zone of mouse event.
User behavior when edit field on screen and the configuration of current input interface can be associated with the screen that monitors.
Can record and be stored in the history of the input interface configuration of each field in the first input example or several the first example (hereinafter referred to as " initial input example ").
Therefore, input example and input subsequently example for next, when the user selects one of field, input interface can be set be configured to mate the configuration that the user uses in the first input example.
According to embodiments of the invention, the initial input example of specific fields (or the some or all of fields on screen) can comprise a plurality of input examples, thereby can only carry out the automatic adjustment of input interface configuration after having recorded a plurality of initial input examples, and can allow the input interface configuration of the user preference of definite this field for the statistics that this data field is collected.In some embodiments of the present invention, a plurality of input examples can be user customizables.
In user's not indication before logging data in the field, and only in the situation that the user begin to determine the input interface configuration after logging data, can carry out post-processed, the text that has wherein write according to the user behavior reformatting of learning.For example, if the direction of certain data field is always from left to right, can automatically proofread and correct it after data recording, as the situation of typing telephone number etc.
By adopting according to an embodiment of the invention method or using system according to an embodiment of the invention, can provide correct keyboard setting to the user before the typing text.According to other embodiments of the invention, can adopt post-processed with checking, data to be inputed in correct input interface configuration, if really not so, can proofread and correct it.Therefore, the demand by can be by eliminating the manual configuration input interface and avoid being saved time by the key error that incorrect keyboard configuration causes.
Fig. 2 illustrates the method for automatically adjusting according to an embodiment of the invention the input interface configuration.
The method can comprise 210 information of inputting in the GUI that monitor.The method also can comprise determines that 220 is the input configuration state that the information inputted arranges by the user at initial input example place at least one field of GUI.The method also can be included in one or more example places of inputting subsequently, and will automatically adjust 230 for the input configuration state of described at least one field be the input configuration of determined initial input example.
Fig. 3 illustrates the processing 300 of automatically adjusting according to an embodiment of the invention the input interface configuration.
This processing (for example algorithm) can comprise the information 310 of inputting in the GUI that monitors.When in the field of user at GUI during input message, can determine that whether 320 make this operation for the first input example initial example place of above definition (or).
If the user is in input message in this field at the initial input example, determines 330 and record the configuration status of 340 input interfaces, and can monitor GUI310.
If it is not just first of input message the input example (as above definition) in this field of user, the 345(of indication in advance that determined whether to exist the current input field of being selected to be used for input message by the user before the user begins input message for example user presses TAB and cursor is advanced to field, or clicks pointing device on this field).If such indication in advance detected, the configuration status of input interface can be adjusted 350 is for the determined configuration of this field.Then, can determine whether 360 complete input GUI.If really complete, this processing can stop 370.If input GUI does not complete, can further monitor 310.
If there is no the indication in advance of selected field, begin before its input message the user, reformatting 355 input messages are to meet for the determined input interface configuration of this field automatically.
Fig. 4 illustrates the system 400 that automatically adjusts according to an embodiment of the invention the input interface configuration.Such system can comprise storage medium 420, for example hard disk drive.This system also can comprise processor 410, input interface 440(for example keyboard or touch-screen) and display device 430(monitor for example).
Claims (25)
1. method of automatically adjusting the input configuration of computing system, the method comprises:
Supervision is by the information of user to the middle input of graphical user interface (GUI);
Determine at initial input example place to be the input configuration state of the computing system that arranges of the information inputted by the user at least one field of GUI; With
At one or more example places of inputting subsequently, will automatically be adjusted into for the input configuration state of described at least one field the input configuration of determined initial input example.
2. the method for claim 1, determine that wherein the step of the input configuration state of computing system comprises: the Operational System Control of following the tracks of indication input configuration state.
3. the method for claim 1, wherein the supervision of GUI is included in that GUI is upper carries out screen scraping.
4. the method for claim 1, the input configuration that wherein will automatically be adjusted into for the input configuration state of described at least one field determined initial input example comprises: carry out the action of selecting from the action group that comprises following action: the generated keyboard event; With the use application programming interface.
5. the method for claim 1, the input configuration that wherein will automatically be adjusted into for the input configuration state of described at least one field determined initial input example comprises:
Reception is the indication in advance of the field of described at least one field of selecting of input information by the user; With
Begin in this field automatically to adjust before the input message of input configuration state to(for) this field the user.
6. the method for claim 1, the input configuration that wherein will automatically be adjusted into for the input configuration state of described at least one field determined initial input example comprises:
The input information that detection is carried out in the field of described at least one field; With
The information reformatting that to be inputted in this field by the user is to meet the input configuration of determined initial input example.
7. method as claimed in claim 6, the step of wherein automatically adjusting for the input configuration state of this field is started by the user.
8. computer program of storing on non-provisional tangible computer-readable recording medium, this computer program comprises the code for following operation:
Supervision is by the information of user to the middle input of graphical user interface (GUI);
Determine at initial input example place to be the input configuration state of the computing system that arranges of the information inputted by the user at least one field of GUI; With
At one or more example places of inputting subsequently, will automatically be adjusted into for the input configuration state of described at least one field the input configuration of determined initial input example.
9. computer program as claimed in claim 8 is used for wherein determining that the code of the input configuration state of computing system comprises: the code that is used for following the tracks of the Operational System Control of indication input configuration state.
10. computer program as claimed in claim 8, the code that wherein is used for the supervision of GUI is included in the upper code of carrying out screen scraping of GUI.
11. computer program as claimed in claim 8, the code that wherein is used for automatically being adjusted into for the input configuration state of described at least one field the input configuration of determined initial input example comprises: the code of carrying out the action of selecting from the action group that comprises following action: generated keyboard event; With the use application programming interface.
12. computer program as claimed in claim 8, the code that wherein is used for automatically being adjusted into for the input configuration state of described at least one field the input configuration of determined initial input example comprises the code for following operation:
Reception is the indication in advance of the field of described at least one field of selecting of input information by the user; With
Begin in this field automatically to adjust before the input message of input configuration state to(for) this field the user.
13. computer program as claimed in claim 8, the code that wherein is used for automatically being adjusted into for the input configuration state of described at least one field the input configuration of determined initial input example comprises the code for following operation:
The input information that detection is carried out in the field of described at least one field; With
The information reformatting that to be inputted in this field by the user is to meet the input configuration of determined initial input example.
14. computer program as claimed in claim 13 wherein is used for automatically adjusting the code that code for the input configuration state of this field comprises that the self-adjusting user for the input configuration state starts.
15. a system that automatically adjusts input configuration, this system comprises: processor is configured to:
Supervision is by the information of user to the middle input of graphical user interface (GUI);
Determine at initial input example place to be the input configuration state of the computing system that arranges of the information inputted by the user at least one field of GUI; With
At one or more example places of inputting subsequently, will automatically be adjusted into for the input configuration state of described at least one field the input configuration of determined initial input example.
16. system as claimed in claim 15, wherein this processor is configured to, and when monitor message is inputted, follows the tracks of the Operational System Control of the information of indicating user input.
17. system as claimed in claim 15, wherein this processor is configured to, and when carrying out the supervision of GUI, carries out screen scraping on GUI.
18. system as claimed in claim 15, wherein this processor is configured to, in the time will automatically being adjusted into the input configuration of determined initial input example for the input configuration state of described at least one field, the action that execution is selected from the action group that comprises following operation, described operation comprises: the generated keyboard event; With the use application programming interface.
19. system as claimed in claim 15, wherein this processor is configured to, and in the time will automatically being adjusted into the input configuration of determined initial input example for the input configuration state of described at least one field, carries out following operation:
Reception is the indication in advance of the field of described at least one field of selecting of input information by the user; With
Begin in this field automatically to adjust before the input message of input configuration state to(for) this field the user.
20. system as claimed in claim 15, wherein this processor is configured to, and in the time will automatically being adjusted into the input configuration of determined initial input example for the input configuration state of described at least one field, carries out following operation:
The input information that detection is carried out in the field of described at least one field; With
The information reformatting that to be inputted in this field by the user is to meet the input configuration of determined initial input example.
21. system as claimed in claim 20, wherein this processor is configured to start in response to the user by the input configuration state of automatic adjustment for this field.
22. a method of automatically adjusting the input configuration of computing system, the method comprises:
By carrying out screen scraping, monitor the information to the middle input of graphical user interface (GUI) by the user;
Indicate the Operational System Control of input configuration state by tracking, determine at initial input example place to be the input configuration state of the computing system that arranges of the information inputted by the user at least one field of GUI; With
At one or more example places of inputting subsequently, will automatically be adjusted into for the input configuration state of described at least one field the input configuration of determined initial input example.
23. method as claimed in claim 22, the step that wherein will automatically be adjusted into for the input configuration state of described at least one field the input configuration of determined initial input example comprises:
Reception is the indication in advance of the field of described at least one field of selecting of input information by the user; With
Begin in this field automatically to adjust before the input message of input configuration state to(for) this field the user.
24. method as claimed in claim 22, the step that wherein will automatically be adjusted into for the input configuration state of described at least one field the input configuration of determined initial input example comprises:
The input information that detection is carried out in the field of described at least one field; With
The information reformatting that to be inputted in this field by the user is to meet the input configuration of determined initial input example.
25. method as claimed in claim 24, wherein automatic adjustment is started by the user for the step of the input configuration state of this field.
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US12/916,544 US9058105B2 (en) | 2010-10-31 | 2010-10-31 | Automated adjustment of input configuration |
| US12/916,544 | 2010-10-31 | ||
| PCT/EP2011/068034 WO2012055714A1 (en) | 2010-10-31 | 2011-10-14 | Automated adjustment of input configuration |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103180815A true CN103180815A (en) | 2013-06-26 |
| CN103180815B CN103180815B (en) | 2016-08-17 |
Family
ID=45217486
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201180052191.0A Active CN103180815B (en) | 2010-10-31 | 2011-10-14 | Automatically the method and system of the input configuration of Adjustable calculation system |
Country Status (5)
| Country | Link |
|---|---|
| US (1) | US9058105B2 (en) |
| JP (1) | JP2013545380A (en) |
| CN (1) | CN103180815B (en) |
| DE (1) | DE112011102891T5 (en) |
| WO (1) | WO2012055714A1 (en) |
Families Citing this family (57)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9318108B2 (en) | 2010-01-18 | 2016-04-19 | Apple Inc. | Intelligent automated assistant |
| US8977255B2 (en) | 2007-04-03 | 2015-03-10 | Apple Inc. | Method and system for operating a multi-function portable electronic device using voice-activation |
| US8676904B2 (en) | 2008-10-02 | 2014-03-18 | Apple Inc. | Electronic devices with voice command and contextual data processing capabilities |
| US20120311585A1 (en) | 2011-06-03 | 2012-12-06 | Apple Inc. | Organizing task items that represent tasks to perform |
| US10417037B2 (en) | 2012-05-15 | 2019-09-17 | Apple Inc. | Systems and methods for integrating third party services with a digital assistant |
| DE212014000045U1 (en) | 2013-02-07 | 2015-09-24 | Apple Inc. | Voice trigger for a digital assistant |
| US10652394B2 (en) | 2013-03-14 | 2020-05-12 | Apple Inc. | System and method for processing voicemail |
| US10748529B1 (en) | 2013-03-15 | 2020-08-18 | Apple Inc. | Voice activated device for use with a voice-based digital assistant |
| KR20140132183A (en) * | 2013-05-07 | 2014-11-17 | 삼성전자주식회사 | Method and apparatus for displaying an input interface in user device |
| US10176167B2 (en) | 2013-06-09 | 2019-01-08 | Apple Inc. | System and method for inferring user intent from speech inputs |
| US9715875B2 (en) | 2014-05-30 | 2017-07-25 | Apple Inc. | Reducing the need for manual start/end-pointing and trigger phrases |
| EP3149728B1 (en) | 2014-05-30 | 2019-01-16 | Apple Inc. | Multi-command single utterance input method |
| US10170123B2 (en) | 2014-05-30 | 2019-01-01 | Apple Inc. | Intelligent assistant for home automation |
| US9338493B2 (en) | 2014-06-30 | 2016-05-10 | Apple Inc. | Intelligent automated assistant for TV user interactions |
| US9886953B2 (en) | 2015-03-08 | 2018-02-06 | Apple Inc. | Virtual assistant activation |
| US10200824B2 (en) | 2015-05-27 | 2019-02-05 | Apple Inc. | Systems and methods for proactively identifying and surfacing relevant content on a touch-sensitive device |
| US20160378747A1 (en) | 2015-06-29 | 2016-12-29 | Apple Inc. | Virtual assistant for media playback |
| US10740384B2 (en) | 2015-09-08 | 2020-08-11 | Apple Inc. | Intelligent automated assistant for media search and playback |
| US10671428B2 (en) | 2015-09-08 | 2020-06-02 | Apple Inc. | Distributed personal assistant |
| US10747498B2 (en) | 2015-09-08 | 2020-08-18 | Apple Inc. | Zero latency digital assistant |
| US10331312B2 (en) | 2015-09-08 | 2019-06-25 | Apple Inc. | Intelligent automated assistant in a media environment |
| US10691473B2 (en) | 2015-11-06 | 2020-06-23 | Apple Inc. | Intelligent automated assistant in a messaging environment |
| US10956666B2 (en) | 2015-11-09 | 2021-03-23 | Apple Inc. | Unconventional virtual assistant interactions |
| US10528328B2 (en) | 2015-12-08 | 2020-01-07 | Microsoft Technology Licensing, Llc | Learning from input patterns in Programing-By-Example |
| US10223066B2 (en) | 2015-12-23 | 2019-03-05 | Apple Inc. | Proactive assistance based on dialog communication between devices |
| US10586535B2 (en) | 2016-06-10 | 2020-03-10 | Apple Inc. | Intelligent digital assistant in a multi-tasking environment |
| DK179415B1 (en) | 2016-06-11 | 2018-06-14 | Apple Inc | Intelligent device arbitration and control |
| DK201670540A1 (en) | 2016-06-11 | 2018-01-08 | Apple Inc | Application integration with a digital assistant |
| US10175770B2 (en) | 2016-10-13 | 2019-01-08 | International Business Machines Corporation | Proactive input method editor switching |
| EP3619629A4 (en) | 2017-05-10 | 2020-12-09 | Embee Mobile, Inc. | System and method for the capture of mobile behavior, usage, or content exposure |
| US10726832B2 (en) | 2017-05-11 | 2020-07-28 | Apple Inc. | Maintaining privacy of personal information |
| DK180048B1 (en) | 2017-05-11 | 2020-02-04 | Apple Inc. | MAINTAINING THE DATA PROTECTION OF PERSONAL INFORMATION |
| DK201770427A1 (en) | 2017-05-12 | 2018-12-20 | Apple Inc. | Low-latency intelligent automated assistant |
| DK179745B1 (en) | 2017-05-12 | 2019-05-01 | Apple Inc. | SYNCHRONIZATION AND TASK DELEGATION OF A DIGITAL ASSISTANT |
| DK179496B1 (en) | 2017-05-12 | 2019-01-15 | Apple Inc. | USER-SPECIFIC Acoustic Models |
| US10303715B2 (en) | 2017-05-16 | 2019-05-28 | Apple Inc. | Intelligent automated assistant for media exploration |
| US20180336892A1 (en) | 2017-05-16 | 2018-11-22 | Apple Inc. | Detecting a trigger of a digital assistant |
| US10818288B2 (en) | 2018-03-26 | 2020-10-27 | Apple Inc. | Natural assistant interaction |
| US10928918B2 (en) | 2018-05-07 | 2021-02-23 | Apple Inc. | Raise to speak |
| US11145294B2 (en) | 2018-05-07 | 2021-10-12 | Apple Inc. | Intelligent automated assistant for delivering content from user experiences |
| DK179822B1 (en) | 2018-06-01 | 2019-07-12 | Apple Inc. | Voice interaction at a primary device to access call functionality of a companion device |
| US10892996B2 (en) | 2018-06-01 | 2021-01-12 | Apple Inc. | Variable latency device coordination |
| DK180639B1 (en) | 2018-06-01 | 2021-11-04 | Apple Inc | DISABILITY OF ATTENTION-ATTENTIVE VIRTUAL ASSISTANT |
| US11462215B2 (en) | 2018-09-28 | 2022-10-04 | Apple Inc. | Multi-modal inputs for voice commands |
| US11348573B2 (en) | 2019-03-18 | 2022-05-31 | Apple Inc. | Multimodality in digital assistant systems |
| CN113711577A (en) | 2019-04-30 | 2021-11-26 | 爱克发有限公司 | Raster image processor |
| DK201970509A1 (en) | 2019-05-06 | 2021-01-15 | Apple Inc | Spoken notifications |
| US11307752B2 (en) | 2019-05-06 | 2022-04-19 | Apple Inc. | User configurable task triggers |
| US11140099B2 (en) | 2019-05-21 | 2021-10-05 | Apple Inc. | Providing message response suggestions |
| DK180129B1 (en) | 2019-05-31 | 2020-06-02 | Apple Inc. | User activity shortcut suggestions |
| DK201970510A1 (en) | 2019-05-31 | 2021-02-11 | Apple Inc | Voice identification in digital assistant systems |
| US11468890B2 (en) | 2019-06-01 | 2022-10-11 | Apple Inc. | Methods and user interfaces for voice-based control of electronic devices |
| US11061543B1 (en) | 2020-05-11 | 2021-07-13 | Apple Inc. | Providing relevant data items based on context |
| US11038934B1 (en) | 2020-05-11 | 2021-06-15 | Apple Inc. | Digital assistant hardware abstraction |
| US11755276B2 (en) | 2020-05-12 | 2023-09-12 | Apple Inc. | Reducing description length based on confidence |
| US11490204B2 (en) | 2020-07-20 | 2022-11-01 | Apple Inc. | Multi-device audio adjustment coordination |
| US11438683B2 (en) | 2020-07-21 | 2022-09-06 | Apple Inc. | User identification using headphones |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH07168829A (en) * | 1994-09-30 | 1995-07-04 | Hitachi Ltd | Document preparing method |
| JPH10187325A (en) * | 1996-12-25 | 1998-07-14 | Casio Comput Co Ltd | Data inputting device |
| US5912669A (en) * | 1996-04-29 | 1999-06-15 | Netmanage, Inc. | Screen navigation method |
| US20020167545A1 (en) * | 2001-04-26 | 2002-11-14 | Lg Electronics Inc. | Method and apparatus for assisting data input to a portable information terminal |
| CN1578299A (en) * | 2003-06-30 | 2005-02-09 | 国际商业机器公司 | Method and system for input and output of data with web applications |
| JP2010502109A (en) * | 2006-08-22 | 2010-01-21 | インターデイジタル テクノロジー コーポレーション | Method and apparatus for providing trusted single sign-on access to applications and Internet-based services |
| CN101639760A (en) * | 2009-08-27 | 2010-02-03 | 上海合合信息科技发展有限公司 | Input method and input system of contact information |
| CN101842243A (en) * | 2007-09-06 | 2010-09-22 | 谷歌公司 | Dynamic virtual input device configuration |
Family Cites Families (21)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5523754A (en) | 1993-09-20 | 1996-06-04 | International Business Machines Corporation | Method and apparatus for automatic keyboard configuration by layout |
| US6848080B1 (en) * | 1999-11-05 | 2005-01-25 | Microsoft Corporation | Language input architecture for converting one text form to another text form with tolerance to spelling, typographical, and conversion errors |
| US7403888B1 (en) * | 1999-11-05 | 2008-07-22 | Microsoft Corporation | Language input user interface |
| US7392326B2 (en) * | 2001-02-16 | 2008-06-24 | Microsoft Corporation | Method for text entry in an electronic device |
| US20030125927A1 (en) * | 2001-12-28 | 2003-07-03 | Microsoft Corporation | Method and system for translating instant messages |
| KR100634496B1 (en) * | 2003-06-16 | 2006-10-13 | 삼성전자주식회사 | Input language recognition method and apparatus and method and apparatus for automatically interchanging input language modes employing the same |
| EP1683043A1 (en) * | 2003-10-30 | 2006-07-26 | Koninklijke Philips Electronics N.V. | Method of predicting input |
| US7607086B2 (en) | 2003-11-18 | 2009-10-20 | Microsoft Corporation | System and method for pre-processing input events |
| EP1727024A1 (en) * | 2005-05-27 | 2006-11-29 | Sony Ericsson Mobile Communications AB | Automatic language selection for text input in messaging context |
| US8732570B2 (en) * | 2005-09-08 | 2014-05-20 | Ricoh Co. Ltd. | Non-symbolic data system for the automated completion of forms |
| US20070061718A1 (en) * | 2005-09-13 | 2007-03-15 | Nokia Corporation | Method for selecting character interpretation mode |
| US7962857B2 (en) * | 2005-10-14 | 2011-06-14 | Research In Motion Limited | Automatic language selection for improving text accuracy |
| US7849144B2 (en) * | 2006-01-13 | 2010-12-07 | Cisco Technology, Inc. | Server-initiated language translation of an instant message based on identifying language attributes of sending and receiving users |
| US20080001959A1 (en) | 2006-06-28 | 2008-01-03 | Amir Geva | System, Method and Computer Program Product for Performing Information Transfer Using a Virtual Operator |
| EP1901534B1 (en) * | 2006-09-18 | 2010-09-01 | LG Electronics Inc. | Method of managing a language information for a text input and method of inputting a text and a mobile terminal |
| GB0714394D0 (en) * | 2007-07-24 | 2007-09-05 | Keycorp Ltd | Graphic user interface parsing |
| US20090241027A1 (en) * | 2008-03-18 | 2009-09-24 | Dapeng Gao | Handheld electronic device and associated method for improving typing efficiency on the device |
| US8323503B2 (en) | 2008-06-11 | 2012-12-04 | Fresenius Medical Care Holdings, Inc. | User interface processing device |
| US20120226490A1 (en) * | 2009-07-09 | 2012-09-06 | Eliyahu Mashiah | Content sensitive system and method for automatic input language selection |
| US8326333B2 (en) * | 2009-11-11 | 2012-12-04 | Sony Ericsson Mobile Communications Ab | Electronic device and method of controlling the electronic device |
| US8463592B2 (en) * | 2010-07-27 | 2013-06-11 | International Business Machines Corporation | Mode supporting multiple language input for entering text |
-
2010
- 2010-10-31 US US12/916,544 patent/US9058105B2/en active Active
-
2011
- 2011-10-14 JP JP2013535354A patent/JP2013545380A/en active Pending
- 2011-10-14 WO PCT/EP2011/068034 patent/WO2012055714A1/en active Application Filing
- 2011-10-14 DE DE112011102891T patent/DE112011102891T5/en active Pending
- 2011-10-14 CN CN201180052191.0A patent/CN103180815B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH07168829A (en) * | 1994-09-30 | 1995-07-04 | Hitachi Ltd | Document preparing method |
| US5912669A (en) * | 1996-04-29 | 1999-06-15 | Netmanage, Inc. | Screen navigation method |
| JPH10187325A (en) * | 1996-12-25 | 1998-07-14 | Casio Comput Co Ltd | Data inputting device |
| US20020167545A1 (en) * | 2001-04-26 | 2002-11-14 | Lg Electronics Inc. | Method and apparatus for assisting data input to a portable information terminal |
| CN1578299A (en) * | 2003-06-30 | 2005-02-09 | 国际商业机器公司 | Method and system for input and output of data with web applications |
| JP2010502109A (en) * | 2006-08-22 | 2010-01-21 | インターデイジタル テクノロジー コーポレーション | Method and apparatus for providing trusted single sign-on access to applications and Internet-based services |
| CN101842243A (en) * | 2007-09-06 | 2010-09-22 | 谷歌公司 | Dynamic virtual input device configuration |
| CN101639760A (en) * | 2009-08-27 | 2010-02-03 | 上海合合信息科技发展有限公司 | Input method and input system of contact information |
Also Published As
| Publication number | Publication date |
|---|---|
| US20120110459A1 (en) | 2012-05-03 |
| WO2012055714A1 (en) | 2012-05-03 |
| JP2013545380A (en) | 2013-12-19 |
| US9058105B2 (en) | 2015-06-16 |
| CN103180815B (en) | 2016-08-17 |
| DE112011102891T5 (en) | 2013-06-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103180815A (en) | Automated adjustment of input configuration | |
| CN112968991B (en) | Input method, electronic equipment and screen projection system | |
| US9891818B2 (en) | Adaptive touch-sensitive displays and methods | |
| US20130151962A1 (en) | Help Functionality And Graphical User Interface Applications | |
| US8997134B2 (en) | Controlling presentation flow based on content element feedback | |
| CN106201177B (en) | A kind of operation execution method and mobile terminal | |
| CN104412212A (en) | Input method editor | |
| CN104050219A (en) | Method and apparatus for managing conversation messages | |
| CN104520843A (en) | Providing note based annotation of content in e-reader | |
| KR20150095664A (en) | Appending content with annotation | |
| US20160316020A1 (en) | Web page information presentation method and system | |
| CN102663055A (en) | Method, device and browser for realizing browser navigation | |
| KR102298395B1 (en) | System and Method for User Behavior Analysis and Agent for Collection of Event | |
| JP2016531352A (en) | Method, device, program and device for updating input system | |
| CN104346035A (en) | Indicating automatically corrected words | |
| US20130111327A1 (en) | Electronic apparatus and display control method | |
| CN111651228A (en) | Method and device for optimizing user interface layout and related equipment | |
| CN104718512B (en) | Automatic separation specific to context is accorded with | |
| JP2015518993A (en) | Method and apparatus for inputting symbols from a touch sensitive screen | |
| US20190179508A1 (en) | Touchscreen device | |
| CN104636320A (en) | Data processing method and device | |
| JP5057177B2 (en) | Equipment operation support system | |
| CN102314223B (en) | A kind of method and apparatus carrying out adaptive input in non-input scene for user | |
| CN105159874A (en) | Method and apparatus for modifying character | |
| US20180217970A1 (en) | Methods and systems for processing intuitive interactive inputs across a note-taking interface |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |