CN102609086A - Chinese character input method applicable to gaze input - Google Patents
Chinese character input method applicable to gaze input Download PDFInfo
- Publication number
- CN102609086A CN102609086A CN2011104557913A CN201110455791A CN102609086A CN 102609086 A CN102609086 A CN 102609086A CN 2011104557913 A CN2011104557913 A CN 2011104557913A CN 201110455791 A CN201110455791 A CN 201110455791A CN 102609086 A CN102609086 A CN 102609086A
- Authority
- CN
- China
- Prior art keywords
- input
- character
- user
- character code
- attentively
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Input From Keyboards Or The Like (AREA)
Abstract
The invention discloses a Chinese character input method applicable to gaze input, which includes the steps: generating a candidate character area and a to-be-inputted next character code area according to currently gazed character codes of a user by utilizing stroke input as an input mode; if one character expected to be inputted by the user appears in the candidate character area, leading the user to gaze the character, and inputting the character after a setting time so that the input is completed; otherwise, leading the user to gaze a next character code needing to be inputted, and taking the character code which is currently gazed by the user as a center, wherein the next possibly inputted character code and the next possibly inputted candidate character are popped out from the left side and the right side; and completing user input. Usability and input efficiency of the gaze-based character input mode are improved.
Description
Technical field
The invention belongs to eye tracking and use and literal input field, relate to the line-of-sight applications analysis, and the solution of literal input.
Background technology
Man-machine interaction based on vision is the hot issue of present image process field; The direction of its ultimate principle for deciding the user to watch attentively according to the characteristic of eyes and position and some other face clue; It as a kind of optional or complementary computing machine input channel, for man-machine interaction provides a kind of new mode.Along with the sight line tracer technique is ripe day by day, the time and space precision that present eye-movement measurement reaches is for replacing traditional pointing apparatus with the sight line tracer technique, and becoming a kind of brand-new input channel provides possibility.
The dummy keyboard that existing literal input based on eye tracking is similar on the screen that uses a computer is imported, and its interface is identical substantially, and the action of different is indication and triggering selection is by people's eye fixation information, rather than mouse or other input equipment are carried out.
Although the eye tracking technology is ripe relatively; And reached quite high precision (about 0.5-1 °); But be subject to the characteristic of sight line input mode, the input speed of existing sight line input method is extremely slow, and this has hindered the practical application of sight line input to a great extent.
Utilize sight line to import three problems of main existence: the one, there is unconscious twitching of the eyelid in people's sight line, promptly watches certain when point attentively as the user, its blinkpunkt and non-stable this place that drops on, but to change the time be one of the center among a small circle in beating at random.This is that physiological mechanism by human eye determines.The 2nd, with the continuous discrete character of process input.The sight line input mode is a continuous process, knocks keyboard unlike traditional with hand, and obtaining is the input of series of discrete, and the input of sight line is a track, and we are difficult to the actual intention of judges is to import which character from this track.As: adopt spelling input method input Chinese character " I "; Traditional keyboard entry method requires user's key tap " w " successively; " o " can accomplish input, but when adopting the sight line input mode, the user watches " w " and " o " character of the dummy keyboard on the computer screen successively attentively; Its blinkpunkt will inevitably pass through the character in the middle of " w " and " o ", causes the ambiguity of input information.The 3rd problem is the start-stop problem of input, and promptly same, the input of sight line is a continuous process, and how when judges begins input, when finish input, and whether be insignificant input, like the user stupefied etc. facing to screen.
To first problem, can adopt and use the character zone of large-size to solve.To second problem, the Shumin Zhai of IBM Almaden Research Center and Per Ola Kristensson have proposed a kind of input mode---ShapeWriter of slip.ShapeWriter is through having solved the problem with continuous process input discrete character with the continuous character that will import that slips over, yet ShapeWriter only is applicable to English input, and it still solves start-stop decision problem of input.
Summary of the invention
In order to overcome the deficiency of prior art, the present invention provides a kind of Chinese character input method that is applicable to the sight line input, can solve the start-stop problem of input, carries out the literal input quickly and accurately.
The technical solution adopted for the present invention to solve the technical problems may further comprise the steps:
(1) adopt the stroke input as basic input mode.Because stroke input method contains the code that only five total, respectively horizontal (a), vertical (Shu), write (Pie), points (Dian), folding (Ya).Relative other input modes commonly used (phonetic, five), the character code sum is few, so each character zone can be provided with relatively large.These character codes are vertically in one line on screen, as the initial layout of this input method.
(2) when the user watches any character code of this input method initial layout attentively, promptly begin input process.At this moment,, generate a candidate block and next character code district to be imported, vertically be arranged in the both sides of current input character code respectively according to the current character code of watching attentively of user.
(3) if the character of user expectation input has appeared at the candidate zone, then the user watches this word attentively, through after the setting-up time, thinks that this character is the character of user expectation input, so import this character, this EOI.Otherwise, change next step over to.Whether the current character of watching attentively of judges is the time period adjustable length of the character of the actual expectation input of user, according to the skill level that the user uses this input method, can between 0.5～3 second, adjust.
(4) if the character of user expectation input does not appear at the candidate zone as yet; Then user's sight line moves to opposite side; Watching the next one attentively needs the character code of input; Promptly continue the next stroke of input, and be the center with the current character code of being watched attentively of user, the left and right sides is ejected possible next one input character code and candidate respectively.
(5) repeating step (3)～step (4) is accomplished input until the user.
In the described step (4), when user's sight line moves to opposite side, when watching the next one attentively and needing the character code of input, the character code blanking of initial position is to avoid interference the input of current character code.
The invention has the beneficial effects as follows:
Through adopting dynamic virtual keyboard; Candidate is imported the keyboard layout mode that character code is positioned over current input character code both sides respectively with the next one; The present invention has well solved the input ambiguity that the continuous input path that exists in the literal input mode based on sight line causes; And beginning and the problem judged on end opportunity in each word input process, improved ease for use and input efficiency based on the literal input mode of sight line, put forward a kind of brand-new literal input mode to computer user; Need not to use hand, only need to stare at screen and see that can accomplish literal imports with eyes.This makes inconvenient user with the manual manipulation computer also can successfully carry out the input of literal.
Below in conjunction with accompanying drawing and embodiment the present invention is further specified.
Description of drawings
Fig. 1, techniqueflow of the present invention.
Fig. 2, the virtual keyboard layout mode that the present invention is initial.
Fig. 3, when the user watches a character code attentively, the layout type of dummy keyboard.Wherein, 1 is the candidate block, and 2 is current character code input field, and 3 is next character code input field, and 4 are the current position of watching attentively of user.
Fig. 4, when the user watches second character code attentively, the layout type of dummy keyboard.5 is the character code in the last character code input field, for avoiding interference the input of current character code, should reduce the visual attraction of this zone to the user, and its color is thin out or it is vanished from sight.
Fig. 5, the outward appearance of dummy keyboard when selecting the word of user expectation input.
Fig. 6, during actual input is used, the demonstration of the original state of dummy keyboard on computer screen.6 is computer screen.7 is the literal input area, can be general word processor.
Figure 7, the actual input applications, the input of Chinese characters "I" first word code "write (Pie)" is a computer screen display.
Fig. 8 during actual input is used, selects the content of candidate " I " computer-chronograph screen display.
Fig. 9, during actual input is used, after the input of completion Chinese character " I ", the computer screen content displayed.
Figure 10, during actual input is used, the input Chinese character " " the content of first character code " horizontal () " computer-chronograph screen display.
Figure 11, the actual input applications, the input characters "in the" second code "write (Pie)" is a computer screen display.
Figure 12, during actual input is used, select candidate " " content of computer-chronograph screen display.
Figure 13, during actual input is used, accomplish Chinese character " " input after, the computer screen content displayed.
Figure 14, during actual input is used, the content of first character code that the input Chinese character " is failed " " horizontal () " computer-chronograph screen display.
Figure 15, the actual input applications, the input of Chinese characters "lose" the second word code "fold (Ya)" is a computer screen display.
Figure 16, the actual input applications, the input of Chinese characters "lose" the first three words code "vertical (Shu)" is a computer screen display.
Figure 17 during actual input is used, selects candidate " to fail " content of computer-chronograph screen display.
Figure 18, during actual input is used, after the input that the completion Chinese character " is failed ", the computer screen content displayed.
Figure 19, in the process that the input Chinese character " is failed ", the position of blinkpunkt and motion track thereof.Wherein, circle is represented the input character code of once watching attentively, the order that the numeral on its next door is watched attentively.
Embodiment
For ease of adopting sight line to import, improve the literal input efficiency, and convenient easy-to-use to the user, the present invention is directed to the problem that exists in the present prior art, a kind of method of Chinese character input of suitable sight line has been proposed.
Whole implementing procedure of the present invention is as shown in Figure 1.Concrete grammar is following:
(1) there is the problem of unconscious twitching of the eyelid to people's sight line, can adopts and use the character zone of large-size to solve.Yet the zone that can supply show on the screen is limited, and therefore in order on limited area, to show bigger character size, the present invention has adopted stroke input method input.Its keyboard layout is as shown in Figure 2.Stroke input method code required for the total number of small (a total of five, namely horizontal (a), vertical (Shu), write (Pie), points (Dian), folding (Ya)), and has a good input speed, and lower re-rate, and the input method is simple to use, no learning, these features make it ideal for use as an input method based gaze tracking.
(2) input to sight line is the characteristics of a continuous process, has proposed a kind of dynamic virtual keyboard layout, and candidate is imported the input mode that character code is positioned over the current input character both sides respectively with the next one.This dummy keyboard initial layout is as shown in Figure 2, and is vertically in one line on computer screen.When the user watches one of them character code attentively, as shown in Figure 3, eject possible next one input character code in this character one side, eject candidate at opposite side.At this moment, if the character of user expectation input has appeared at the candidate zone, then watch this word attentively and can accomplish input; If the character of user expectation input does not appear at the candidate zone as yet; Then user's sight line moves to opposite side, watches the character code that the next one needs input attentively, promptly continues the next stroke of input.At this moment, the dummy keyboard blanking of initial position is to avoid interference the input of current character code.And with the current character code of being watched attentively of user is the center, and the left and right sides is ejected possible next one input character code and candidate respectively.As shown in Figure 4.If the character of user expectation input has appeared at the candidate block, then watch this word attentively and accomplish input.If the character of user expectation input does not occur yet, then continue to watch attentively the next character code of opposite side.This input mode repeats said process, accomplishes input until the user.Through adopting dynamic virtual keyboard; Candidate is imported the keyboard layout mode that character code is positioned over current input character code both sides respectively with the next one; The present invention has well solved the input ambiguity that the continuous input path that exists in the literal input mode based on sight line causes, and the problem that beginning and end are judged opportunity in each word input process.
The same hardware independent of this input method can utilize any eye movement appearance to carry out the literal input on computers.Blinkpunkt the position on computer screen of Tobii x120 Table top type eye movement appearance that this example will adopt the Tobii company of Sweden to produce to obtain the user, and the logical computing machine of a Daepori carries out the description of literal input as experiment porch.
Exemplifying embodiment one:
Character code of this example demonstration input can be accomplished the Chinese character " I " of input.Concrete steps are following:
1) starts computer, open a word processor, start this input method.At this moment, content displayed is as shown in Figure 6 on the computer screen.
2) Users watching characters "I" first word code "write (Pie)."At this moment, content displayed is as shown in Figure 7 on the computer screen.
3) since " I " word comparatively commonly used, this time " I " word appeared at the word selection district.Watch attentively to select this word.At this moment, content displayed is as shown in Figure 8 on the computer screen.
4) accomplish the input of " I " word.This moment, dummy keyboard restPosed, and content displayed is as shown in Figure 9 on the computer screen.
Exemplifying embodiment two:
This example demonstration after the input of accomplishing last Chinese character " I ", continue input need two character codes of input with accomplish the Chinese character imported " ".Concrete steps are following:
1) user watch attentively Chinese character " " first character code " horizontal () ", at this moment, content displayed is shown in figure 10 on the computer screen.
2) As the "in" word has not yet appeared in the candidate area, you can continue to the right eye "in the" second code word "write (Pie)."At this moment, content displayed is shown in figure 11 on the computer screen.
3) after the selection of accomplishing two strokes, " " word appeared at the candidate block, the user can watch this word attentively to accomplish the input of this word this moment.At this moment, content displayed is shown in figure 12 on the computer screen.
4) accomplish " " the word input.This moment, dummy keyboard restPosed, and content displayed is shown in figure 13 on the computer screen.
Exemplifying embodiment three:
The demonstration of this example needs three character codes of input " to fail " with the Chinese character of accomplishing input.Concrete steps are following:
1) user watches first character code " horizontal () " that Chinese character " is failed " attentively, and at this moment, content displayed is shown in figure 14 on the computer screen.
2) As the "lose" the word has not yet appeared in the candidate area, you can continue to the right eye "lose" the second code word "discount (Ya)."At this moment, content displayed is shown in figure 15 on the computer screen.
3) "lose" the word has not yet appeared in the candidate area, the user continues to the right eye "lose" the first three words code word "vertical (Shu)."At this moment, content displayed is shown in figure 16 on the computer screen.
4) after the selection of accomplishing three strokes, " failing " word has appeared at the candidate block, and the user can watch this word attentively to accomplish the input of this word this moment.At this moment, content displayed is shown in figure 17 on the computer screen.
5) accomplish the input of " failing " word.This moment, dummy keyboard restPosed, and content displayed is shown in figure 18 on the computer screen.
6) Figure 19 has shown that completion " fails " motion track and the order of user's blinkpunkt in the word input.Wherein circle is represented user's the input character code of watching attentively, the order that the other numeral of circle is watched attentively.Can find out that from this example the user only needs short quick glance, can accomplish the input of a Chinese character.
Claims (3)
1. a Chinese character input method that is applicable to the sight line input is characterized in that comprising the steps:
(1) adopt the stroke input as input mode, character code is vertically in one line on screen, and described character code is horizontal, vertical, left, points, discount;
(2) when the user watches any character code attentively, according to the current character code of watching attentively of user, generate a candidate block and next character code district to be imported, vertically be arranged in the both sides of current input character code respectively;
(3) if the character of user expectation input has appeared at the candidate zone, then the user watches this word attentively, through after the setting-up time, imports this character, this EOI; Otherwise, change next step over to;
(4) if the character of user expectation input does not appear at the candidate zone as yet; Then user's sight line moves to opposite side; Watching the next one attentively needs the character code of input, and is the center with the current character code of being watched attentively of user, and the left and right sides is ejected possible next one input character code and candidate respectively;
(5) repeating step (3)～step (4) is accomplished input until the user.
2. the Chinese character input method that is applicable to the sight line input according to claim 1, it is characterized in that: described setting-up time is 0.5～3 second.
3. the Chinese character input method that is applicable to sight line input according to claim 1 is characterized in that: in the described step (4), and when user's sight line moves to opposite side, when watching the character code that next one need to import attentively, the character code blanking of initial position.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110455791.3A CN102609086B (en) | 2011-12-26 | 2011-12-26 | Chinese character input method applicable to gaze input |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110455791.3A CN102609086B (en) | 2011-12-26 | 2011-12-26 | Chinese character input method applicable to gaze input |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102609086A true CN102609086A (en) | 2012-07-25 |
| CN102609086B CN102609086B (en) | 2014-09-10 |
Family
ID=46526526
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201110455791.3A Expired - Fee Related CN102609086B (en) | 2011-12-26 | 2011-12-26 | Chinese character input method applicable to gaze input |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102609086B (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103631364A (en) * | 2012-08-20 | 2014-03-12 | 联想(北京)有限公司 | Control method and electronic device |
| CN105005728A (en) * | 2015-07-29 | 2015-10-28 | 南京大学 | Password input device with vibration feedback based on eye movement input |
| TWI631484B (en) * | 2017-03-07 | 2018-08-01 | 緯創資通股份有限公司 | Direction-based text input method, system and computer-readable recording medium using the same |
| CN111145858A (en) * | 2019-11-29 | 2020-05-12 | 淮阴工学院 | Face recognition-based medicine self-service vending system and method |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5649061A (en) * | 1995-05-11 | 1997-07-15 | The United States Of America As Represented By The Secretary Of The Army | Device and method for estimating a mental decision |
| CN101201696A (en) * | 2007-11-29 | 2008-06-18 | 浙江大学 | Chinese input BCI system based on P300 brain electric potential |
| CN101515199A (en) * | 2009-03-24 | 2009-08-26 | 北京理工大学 | Character input device based on eye tracking and P300 electrical potential of the brain electricity |
-
2011
- 2011-12-26 CN CN201110455791.3A patent/CN102609086B/en not_active Expired - Fee Related
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5649061A (en) * | 1995-05-11 | 1997-07-15 | The United States Of America As Represented By The Secretary Of The Army | Device and method for estimating a mental decision |
| CN101201696A (en) * | 2007-11-29 | 2008-06-18 | 浙江大学 | Chinese input BCI system based on P300 brain electric potential |
| CN101515199A (en) * | 2009-03-24 | 2009-08-26 | 北京理工大学 | Character input device based on eye tracking and P300 electrical potential of the brain electricity |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103631364A (en) * | 2012-08-20 | 2014-03-12 | 联想(北京)有限公司 | Control method and electronic device |
| CN103631364B (en) * | 2012-08-20 | 2017-06-27 | 联想(北京)有限公司 | A kind of control method and electronic equipment |
| CN105005728A (en) * | 2015-07-29 | 2015-10-28 | 南京大学 | Password input device with vibration feedback based on eye movement input |
| TWI631484B (en) * | 2017-03-07 | 2018-08-01 | 緯創資通股份有限公司 | Direction-based text input method, system and computer-readable recording medium using the same |
| CN111145858A (en) * | 2019-11-29 | 2020-05-12 | 淮阴工学院 | Face recognition-based medicine self-service vending system and method |
| CN111145858B (en) * | 2019-11-29 | 2024-01-23 | 淮阴工学院 | Medicine self-service vending system and method based on face recognition |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102609086B (en) | 2014-09-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Hansen et al. | Command without a click: Dwell time typing by mouse and gaze selections | |
| Grubert et al. | Text entry in immersive head-mounted display-based virtual reality using standard keyboards | |
| Rajanna et al. | Gaze typing in virtual reality: impact of keyboard design, selection method, and motion | |
| Kristensson et al. | The potential of dwell-free eye-typing for fast assistive gaze communication | |
| Majaranta et al. | Text entry by gaze: Utilizing eye-tracking | |
| KR20180083252A (en) | System and method for biomechanically based eye signals for interacting with real and virtual objects | |
| JP2002324064A (en) | System and method for acceleration of text input of ideography-based language such as kanji character | |
| CN102609086B (en) | Chinese character input method applicable to gaze input | |
| CN111586459B (en) | Method and device for controlling video playing, electronic equipment and storage medium | |
| Jantunen | Signs and transitions: Do they differ phonetically and does it matter? | |
| CN104066012A (en) | Method for inputting Chinese character in smart TV and device thereof | |
| CN102339128A (en) | Virtual keyboard design scheme for inputting Chinese characters by brain waves | |
| Ren et al. | Towards the design of effective freehand gestural interaction for interactive TV | |
| Liu et al. | Robust eye-based dwell-free typing | |
| EP1756700B1 (en) | System and method for bodily controlled data input | |
| Sengupta et al. | Impact of variable positioning of text prediction in gaze-based text entry | |
| Miniotas et al. | Symbol Creator: An Alternative Eye-based Text Entry Technique with Low Demand for Screen Space. | |
| Dickie et al. | LookPoint: an evaluation of eye input for hands-free switching of input devices between multiple computers | |
| CN102707793A (en) | Eye-control mouse | |
| Tuisku et al. | Text entry by gazing and smiling | |
| HOLT et al. | Which fragments of a sign enable its recognition? | |
| Špakov et al. | Scrollable Keyboards for Casual Eye Typing. | |
| US20220129069A1 (en) | Information processing apparatus, information processing method, and program | |
| Diaz Tula et al. | Facilitating gaze interaction using the gap and overlap effects | |
| CN112698729B (en) | Character input method based on combination of brain signals and voice |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20140910 Termination date: 20141226 |
|
| EXPY | Termination of patent right or utility model |