CN102609086B - Chinese character input method applicable to gaze input - Google Patents
Chinese character input method applicable to gaze input Download PDFInfo
- Publication number
- CN102609086B CN102609086B CN201110455791.3A CN201110455791A CN102609086B CN 102609086 B CN102609086 B CN 102609086B CN 201110455791 A CN201110455791 A CN 201110455791A CN 102609086 B CN102609086 B CN 102609086B
- Authority
- CN
- China
- Prior art keywords
- input
- character
- user
- word
- character code
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Landscapes
- Input From Keyboards Or The Like (AREA)
Abstract
The invention discloses a Chinese character input method applicable to gaze input, which includes the steps: generating a candidate character area and a to-be-inputted next character code area according to currently gazed character codes of a user by utilizing stroke input as an input mode; if one character expected to be inputted by the user appears in the candidate character area, leading the user to gaze the character, and inputting the character after a setting time so that the input is completed; otherwise, leading the user to gaze a next character code needing to be inputted, and taking the character code which is currently gazed by the user as a center, wherein the next possibly inputted character code and the next possibly inputted candidate character are popped out from the left side and the right side; and completing user input. Usability and input efficiency of the gaze-based character input mode are improved.
Description
Technical field
The invention belongs to eye tracking application and word input field, relate to line-of-sight applications analysis, and the solution of word input.
Background technology
Man-machine interaction based on vision is the hot issue of present image process field, its ultimate principle is the direction that decides user to watch attentively according to the feature of eyes and position and some other face clue, using it as a kind of optional or complementary computer input passage, for man-machine interaction provides a kind of new mode.Along with Eye Tracking Technique is ripe day by day, the time and space precision that eye-movement measurement reaches is at present to replace traditional pointing apparatus with Eye Tracking Technique, and becoming a kind of brand-new input channel provides possibility.
The input of the existing word based on eye tracking is similar to the dummy keyboard using on computer screen and inputs, and its interface is substantially identical, and the action of different is instruction and triggering selection is by people's eye fixation information, instead of mouse or other input equipment are carried out.
Although Visual Trace Technology is relatively ripe, and reach quite high precision (about 0.5-1 °), but be limited to the characteristic of sight line input mode, the input speed of existing sight line input method is extremely slow, this has hindered the practical application of sight line input to a great extent.
Utilize sight line to input three problems of main existence: the one, there is unconscious twitching of the eyelid in people's sight line, when user watches certain when some attentively, its blinkpunkt non-stable this place that drops on, but one centered by changing the time among a small circle in random beating.This is to be determined by the physiological mechanism of human eye.The 2nd, input discrete character by continuous process.Sight line input mode is a continuous process, knocks keyboard unlike traditional with hand, and obtaining is the input of series of discrete, and the input of sight line is a track, and we are difficult to judge from this track which character user's actual being intended that will input.As: adopt spelling input method input Chinese character " I ", traditional keyboard entry method requires user's key tap " w " successively, " o " can complete input, but in the time adopting sight line input mode, user watches " w " and " o " character of the dummy keyboard on computer screen successively attentively, its blinkpunkt will inevitably, through the character in the middle of " w " and " o ", cause the ambiguity of input message.The 3rd problem is the start-stop problem of input, and same, the input of sight line is a continuous process, how to judge when user starts input, when finishes input, and whether is insignificant input, if user is stupefied etc. facing to screen.
For first problem, can adopt and use the character zone of large-size to solve.For Second Problem, the Shumin Zhai of IBM Almaden Research Center and Per Ola Kristensson have proposed a kind of input mode---ShapeWriter of slip.ShapeWriter is by having solved the problem with continuous process input discrete character with the continuous character that will input that slips over, but ShapeWriter is only applicable to English input, and it does not still solve the start-stop decision problem of input.
Summary of the invention
In order to overcome the deficiencies in the prior art, the invention provides a kind of Chinese character input method that is applicable to sight line input, can solve the start-stop problem of input, carry out quickly and accurately word input.
The technical solution adopted for the present invention to solve the technical problems comprises the following steps:
(1) adopt stroke to input as basic input mode.Because total character code that stroke input method comprises only has five, be respectively horizontal (one), perpendicular (Shu), skims (Pie), point (Dian), folding (Ya).Relatively other conventional input modes (phonetic, five), character code sum is few, and what therefore each character zone can arrange is relatively large.These character codes are vertically in one line on screen, as the initial layout of this input method.
(2) in the time that user watches any character code of this input method initial layout attentively, start input process.Now, according to the current character code of watching attentively of user, generate a candidate block and next character code district to be entered, be vertically arranged in respectively the both sides of current input word.
(3) appeared at candidate word region if user expects the character of input, user watches this word attentively, after setting-up time, thinks that this character is user and expects the character of inputting, so input this character, this end of input.Otherwise, proceed to next step.Judge that whether character that user is current watched attentively is that the time period length of the actual character of expecting input of user is adjustable, use the skill level of this input method according to user, can between 0.5～3 second, adjust.
(4) if expecting the character of input, user not yet appears at candidate word region, user's sight line moves to opposite side, watch the next character code that needs input attentively, continue the next stroke of input, and centered by the current character code of being watched attentively of user, possible next input word and candidate word are ejected respectively in the left and right sides.
(5) repeating step (3)～step (4), until user completes input.
In described step (4), when user's sight line moves to opposite side, while watching the next character code that needs input attentively, the character code blanking of initial position, to avoid interference the input of current character code.
The invention has the beneficial effects as follows:
By adopting dynamic virtual keyboard, candidate word and next input word are positioned over respectively keyboard layout's mode of current input word both sides, the present invention has well solved the input ambiguity that the continuous input path that exists in the character input modes based on sight line causes, and in each word input process, start and the problem of judgement on end opportunity, ease for use and the input efficiency of the character input modes based on sight line are improved, carry a kind of brand-new character input modes to computer user, without with hand, only need stare at screen with eyes and see that can complete word inputs.This makes inconvenience also can successfully carry out the input of word with the user of manual manipulation computer.
Below in conjunction with drawings and Examples, the present invention is further described.
Brief description of the drawings
Fig. 1, techniqueflow of the present invention.
Fig. 2, the virtual keyboard layout mode that the present invention is initial.
Fig. 3, in the time that user watches a character code attentively, the layout type of dummy keyboard.Wherein, 1 is candidate block, and 2 is current character code input field, and 3 is next character code input field, and 4 is the current position of watching attentively of user.
Fig. 4, in the time that user watches second character code attentively, the layout type of dummy keyboard.5 is the character code in a upper character code input field, for avoiding interference the input of current character code, should reduce the visual attraction of this region to user, by thin out its color or it is vanished from sight.
Fig. 5, for select user expect input word time dummy keyboard outward appearance.
Fig. 6, in actual input application, the demonstration of the original state of dummy keyboard on computer screen.6 is computer screen.7 is word input area, can be general word processor.
Fig. 7, in actual input application, the content of first character code " slash (Pie) " computer-chronograph screen display of input Chinese character " I ".
Fig. 8, in actual input application, selects the content of candidate word " I " computer-chronograph screen display.
Fig. 9, in actual input application, completes after the input of Chinese character " I " content that computer screen shows.
Figure 10, in actual input application, input Chinese character " " the content of first character code " horizontal () " computer-chronograph screen display.
Figure 11, in actual input application, input Chinese character " " the content of second character code computer-chronograph screen display of " skimming (Pie) ".
Figure 12, in actual input application, select candidate word " " content of computer-chronograph screen display.
Figure 13, in actual input application, complete Chinese character " " input after, the content that computer screen shows.
Figure 14, in actual input application, the content of first character code " horizontal () " computer-chronograph screen display of input Chinese character " defeated ".
Figure 15, in actual input application, the content of second character code of input Chinese character " defeated " " folding (Ya) " computer-chronograph screen display.
Figure 16, in actual input application, the content of the 3rd character code " perpendicular (Shu) " the computer-chronograph screen display of input Chinese character " defeated ".
Figure 17, in actual input application, selects the content of candidate word " defeated " computer-chronograph screen display.
Figure 18, in actual input application, completes after the input of Chinese character " defeated " content that computer screen shows.
Figure 19, in the process of input Chinese character " defeated ", the position of blinkpunkt and motion track thereof.Wherein, circle represents the input word of once watching attentively, the order that the numeral on its side is watched attentively.
Embodiment
For ease of adopting sight line to input, improve word input efficiency, and convenient easy-to-use to user, the present invention is directed to the problem existing in currently available technology, a kind of method of Chinese character input of applicable sight line has been proposed.
Whole implementing procedure of the present invention as shown in Figure 1.Concrete grammar is as follows:
(1) there is the problem of unconscious twitching of the eyelid for people's sight line, can adopt and use the character zone of large-size to solve.But, on screen, can be limited for the region showing, therefore, in order to show larger character size on limited area, the present invention has adopted stroke input method input.Its keyboard layout as shown in Figure 2.Few (totally five of its total required character code number of stroke input method, be respectively horizontal (one), perpendicular (Shu), skims (Pie) point (Dian), folding (Ya)), and there is good input speed, and the lower repetition rate of coding, and this input method is simple and easy to use, without study, these features make it be suitable as very much the input mode based on eye tracking.
(2) be the feature of a continuous process for the input of sight line, proposed a kind of dynamic virtual keyboard layout, candidate word and next input word are positioned over respectively the input mode of current input character both sides.This dummy keyboard initial layout as shown in Figure 2, vertically in one line on computer screen.In the time that user watches one of them character code attentively, as shown in Figure 3, eject possible next input word in this character one side, eject candidate word at opposite side.Now, appear at candidate word region if user expects the character of input, watched this word attentively and can complete input, if user expects the character of input and not yet appears at candidate word region, user's sight line moves to opposite side, watches the next character code that needs input attentively, continues the next stroke of input.Now, the dummy keyboard blanking of initial position, to avoid interference the input of current character code.And centered by the current character code of being watched attentively of user, possible next input word and candidate word are ejected respectively in the left and right sides.As shown in Figure 4.If user expects the character of input and has appeared at candidate block, watches this word attentively and complete input.If user expects the character of input and occurs not yet, continue to watch attentively the next character code of opposite side.This input mode repeats said process, until user completes input.By adopting dynamic virtual keyboard, candidate word and next input word are positioned over respectively keyboard layout's mode of current input word both sides, the present invention has well solved the input ambiguity that the continuous input path that exists in the character input modes based on sight line causes, and in each word input process, starts and the problem of end judgement on opportunity.
The same hardware independent of this input method, can utilize any eye movement instrument to carry out on computers word input.This example by the Tobii x120 Table top type eye movement instrument that adopts the Tobii company of Sweden to produce with the blinkpunkt that obtains user the position on computer screen, and the logical computing machine of a Daepori carries out the description of word input as experiment porch.
Exemplifying embodiment one:
Character code of this example demonstration input can complete the Chinese character " I " of input.Concrete steps are as follows:
1) start computer, open a word processor, start this input method.Now, the content showing on computer screen as shown in Figure 6.
2) user watches first character code " slash (Pie) " of Chinese character " I " attentively.Now, the content showing on computer screen as shown in Figure 7.
3) because " I " word is comparatively conventional, this time " I " word appeared at selected word district.Watch to select this word attentively.Now, the content showing on computer screen as shown in Figure 8.
4) complete the input of " I " word.Now dummy keyboard restPoses, and the content showing on computer screen as shown in Figure 9.
Exemplifying embodiment two:
This example demonstration completes after the input of last Chinese character " I ", continue input need to input two character codes with complete input Chinese character " ".Concrete steps are as follows:
1) user watch attentively Chinese character " " first character code " horizontal () ", now, the content showing on computer screen is as shown in figure 10.
2) due to " " word not yet appears at candidate block, user can continue to watch attentively to the right " " second character code of word " skim (Pie) ".Now, the content showing on computer screen as shown in figure 11.
3) complete after the selection of two strokes, " " word appeared at candidate block, user now can watch this word attentively to complete the input of this word.Now, the content showing on computer screen as shown in figure 12.
4) complete " " word input.Now dummy keyboard restPoses, and the content showing on computer screen as shown in figure 13.
Exemplifying embodiment three:
The demonstration of this example need to be inputted three character codes to complete the Chinese character " defeated " of input.Concrete steps are as follows:
1) user watches first character code " horizontal () " of Chinese character " defeated " attentively, and now, the content showing on computer screen as shown in figure 14.
2), because " defeated " word not yet appears at candidate block, user can continue to watch attentively second character code " folding (Ya) " of " defeated " word to the right.Now, the content showing on computer screen as shown in figure 15.
3) " defeated " word does not appear at candidate block yet, and user continues to watch attentively the 3rd character code " perpendicular (Shu) " of " defeated " word to the right.Now, the content showing on computer screen as shown in figure 16.
4) complete after the selection of three strokes, " defeated " word has appeared at candidate block, and user now can watch this word attentively to complete the input of this word.Now, the content showing on computer screen as shown in figure 17.
5) complete the input of " defeated " word.Now dummy keyboard restPoses, and the content showing on computer screen as shown in figure 18.
6) Figure 19 has shown the motion track and the order that complete user's blinkpunkt in the input of " defeated " word.Wherein circle represents user's the input word of watching attentively, the order that the other numeral of circle is watched attentively.Can find out from this example, user only needs short quick glance, can complete the input of a Chinese character.
Claims (2)
1. a Chinese character input method that is applicable to sight line input, is characterized in that comprising the steps:
(1) adopt stroke to input as input mode, character code is vertically in one line on screen, and described character code is horizontal, vertical, left, points, discount;
(2) in the time that user watches any character code attentively, according to the current character code of watching attentively of user, generate a candidate block and next character code district to be entered, be vertically arranged in respectively the both sides of current input word;
(3) appeared at candidate word region if user expects the character of input, user watches this word attentively, after setting-up time, inputs this character, this end of input; Otherwise, proceed to next step;
(4) if expecting the character of input, user not yet appears at candidate word region, user's sight line moves to opposite side, watch the next character code that needs input attentively, the now character code blanking of initial position, and centered by the current character code of being watched attentively of user, possible next input word and candidate word are ejected respectively in the left and right sides;
(5) repeating step (3)～step (4), until user completes input.
2. the Chinese character input method that is applicable to sight line input according to claim 1, is characterized in that: described setting-up time is 0.5～3 second.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110455791.3A CN102609086B (en) | 2011-12-26 | 2011-12-26 | Chinese character input method applicable to gaze input |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110455791.3A CN102609086B (en) | 2011-12-26 | 2011-12-26 | Chinese character input method applicable to gaze input |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102609086A CN102609086A (en) | 2012-07-25 |
| CN102609086B true CN102609086B (en) | 2014-09-10 |
Family
ID=46526526
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201110455791.3A Expired - Fee Related CN102609086B (en) | 2011-12-26 | 2011-12-26 | Chinese character input method applicable to gaze input |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102609086B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103631364B (en) * | 2012-08-20 | 2017-06-27 | 联想(北京)有限公司 | A kind of control method and electronic equipment |
| CN105005728A (en) * | 2015-07-29 | 2015-10-28 | 南京大学 | Password input device with vibration feedback based on eye movement input |
| TWI631484B (en) * | 2017-03-07 | 2018-08-01 | 緯創資通股份有限公司 | Direction-based text input method, system and computer-readable recording medium using the same |
| CN111145858B (en) * | 2019-11-29 | 2024-01-23 | 淮阴工学院 | Medicine self-service vending system and method based on face recognition |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5649061A (en) * | 1995-05-11 | 1997-07-15 | The United States Of America As Represented By The Secretary Of The Army | Device and method for estimating a mental decision |
| CN101201696A (en) * | 2007-11-29 | 2008-06-18 | 浙江大学 | Chinese input BCI system based on P300 brain electric potential |
| CN101515199A (en) * | 2009-03-24 | 2009-08-26 | 北京理工大学 | Character input device based on eye tracking and P300 electrical potential of the brain electricity |
-
2011
- 2011-12-26 CN CN201110455791.3A patent/CN102609086B/en not_active Expired - Fee Related
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5649061A (en) * | 1995-05-11 | 1997-07-15 | The United States Of America As Represented By The Secretary Of The Army | Device and method for estimating a mental decision |
| CN101201696A (en) * | 2007-11-29 | 2008-06-18 | 浙江大学 | Chinese input BCI system based on P300 brain electric potential |
| CN101515199A (en) * | 2009-03-24 | 2009-08-26 | 北京理工大学 | Character input device based on eye tracking and P300 electrical potential of the brain electricity |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102609086A (en) | 2012-07-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Dudley et al. | Performance envelopes of virtual keyboard text input strategies in virtual reality | |
| Kristensson et al. | The potential of dwell-free eye-typing for fast assistive gaze communication | |
| Hansen et al. | Command without a click: Dwell time typing by mouse and gaze selections | |
| Møllenbach et al. | Eye movements in gaze interaction | |
| CN102609086B (en) | Chinese character input method applicable to gaze input | |
| Møllenbach et al. | Single gaze gestures | |
| Kin et al. | Two-handed marking menus for multitouch devices | |
| Jantunen | Signs and transitions: Do they differ phonetically and does it matter? | |
| CN104066012A (en) | Method for inputting Chinese character in smart TV and device thereof | |
| CN102339128A (en) | Virtual keyboard design scheme for inputting Chinese characters by brain waves | |
| Ren et al. | Towards the design of effective freehand gestural interaction for interactive TV | |
| Porta | A study on text entry methods based on eye gestures | |
| Ma et al. | Trigger motion and interface optimization of an eye-controlled human-computer interaction system based on voluntary eye blinks | |
| Miniotas et al. | Symbol Creator: An Alternative Eye-based Text Entry Technique with Low Demand for Screen Space. | |
| Mifsud et al. | HMM-based gesture recognition for eye-swipe typing | |
| Zuo et al. | Study on the brightness and graphical display object directions of the single-gaze-gesture user interface | |
| Istance et al. | Supporting making fixations and the effect on gaze gesture performance | |
| Dickie et al. | LookPoint: an evaluation of eye input for hands-free switching of input devices between multiple computers | |
| Zhang et al. | Target selection by gaze pointing and manual confirmation: performance improved by locking the gaze cursor | |
| HOLT et al. | Which fragments of a sign enable its recognition? | |
| US20220129069A1 (en) | Information processing apparatus, information processing method, and program | |
| Zhang et al. | The Study of Two Novel Speech-Based Selection Techniques in Voice-User Interfaces | |
| Tula et al. | Meta-keys: extending the functionality of gaze-based interaction. | |
| Huang et al. | Ergonomics research on eye–hand control dual channel interaction | |
| Diaz Tula et al. | Facilitating gaze interaction using the gap and overlap effects |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20140910 Termination date: 20141226 |
|
| EXPY | Termination of patent right or utility model |