CN111930234A - Input method and device based on eye control, electronic equipment and storage medium - Google Patents
Input method and device based on eye control, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN111930234A CN111930234A CN202010779441.1A CN202010779441A CN111930234A CN 111930234 A CN111930234 A CN 111930234A CN 202010779441 A CN202010779441 A CN 202010779441A CN 111930234 A CN111930234 A CN 111930234A
- Authority
- CN
- China
- Prior art keywords
- eye
- input method
- input
- signal instruction
- movement
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
Abstract
The invention discloses an input method based on eye control, which comprises the following steps: collecting eye movements; identifying the eye movement to acquire a signal instruction corresponding to the eye movement; and displaying corresponding information according to the signal instruction. According to the invention, the coding instruction corresponding to the eye action is preset, and when the eye action is acquired, the corresponding coding instruction can be rapidly acquired, so that the information corresponding to the coding instruction is acquired and displayed, and the problem that the information input problem of special crowds in special occasions with special scenes aiming at the intelligent equipment cannot be solved in the prior art is solved.
Description
Technical Field
The present invention relates to the field of information input technologies, and in particular, to an input method and apparatus based on eye control, an electronic device, and a storage medium.
Background
Various smart devices have been derived in our lives that require a user to actively input signals to manipulate the intelligence. These smart devices mainly input signal commands by means of double-handed tapping, touching, sliding, or by means of voice messages. However, in a special scene, for example, in a case where it is desired to release both hands and make no sound, or in a deaf-mute with incomplete limbs, there is a serious problem in inputting information using these smart devices.
Disclosure of Invention
In order to overcome the defects of the prior art, one of the objectives of the present invention is to provide an input method based on eye control, which can solve the problem that the intelligent device in the prior art cannot provide a convenient information input mode for special people and special scenes.
The second objective of the present invention is to provide an input device based on eye control, which can solve the problem that the intelligent device in the prior art cannot provide a convenient information input mode for special people and special scenes.
The invention further aims to provide electronic equipment, which can solve the problem that intelligent equipment in the prior art cannot provide a convenient information input mode for special people and special scenes.
The fourth objective of the present invention is to provide a storage medium, which can solve the problem that the intelligent device in the prior art cannot provide a convenient information input mode for special people and special scenes.
One of the purposes of the invention is realized by adopting the following technical scheme:
the input method based on the eye control comprises the following steps:
collecting eye movements;
identifying the eye movement to acquire a signal instruction corresponding to the eye movement;
and displaying corresponding information according to the signal instruction.
Preferably, the eye movement comprises a continuous blinking number, an eye rotation, a no-movement holding time period.
Preferably, the eyeball rotation comprises an eyeball rotation direction and a same-direction eyeball rotation number.
Preferably, the eye movements are captured by a camera.
Preferably, the method further comprises the following steps: and converting the information into corresponding audio and broadcasting the audio according to the corresponding information.
Preferably, the "displaying the corresponding information according to the signal instruction" specifically includes:
displaying a plurality of characters matched with the signal instruction;
receiving another eye movement input by the user to select a target character among the plurality of characters;
and displaying the target character as corresponding information.
The second purpose of the invention is realized by adopting the following technical scheme:
an input device based on eye control, comprising the following units:
a collecting unit: configured to capture eye movements;
an identification unit: configured to recognize the eye movement to acquire a signal instruction corresponding to the eye movement;
a display unit: configured to display the corresponding information according to the signal instruction.
Preferably, the eye movement comprises a continuous blinking number, an eye rotation, a no-movement holding time period.
The third purpose of the invention is realized by adopting the following technical scheme:
an electronic device having a memory, a processor, and a computer readable program stored in the memory and executable by the processor, the computer readable program when executed by the processor implementing an eye control based input method according to one of the objects of the present invention.
The fourth purpose of the invention is realized by adopting the following technical scheme:
a storage medium having a computer readable program stored thereon which is executable by a processor, wherein the computer readable program, when executed by the processor, implements an eye control-based input method according to one of the objects of the present invention.
Compared with the prior art, the invention has the beneficial effects that:
according to the invention, the coding instruction corresponding to the eye action is preset, and when the eye action is acquired, the corresponding coding instruction can be rapidly acquired, so that the information corresponding to the coding instruction is acquired and displayed, and the problem that the information input problem of special crowds in special occasions with special scenes aiming at the intelligent equipment cannot be solved in the prior art is solved.
Drawings
Fig. 1 is a flow chart of an input method based on eye control according to the present invention.
Detailed Description
The invention will be further described with reference to the accompanying drawings and the detailed description below:
the invention provides an input method based on eye control, as shown in fig. 1, comprising the following steps:
s1: eye movements are collected.
In this step, for example, the smart device is a mobile phone, and the eye movement may be acquired by a camera carried by the mobile phone. Before the eye movement is acquired, the process of acquiring the eye movement by the camera may of course be initiated in some other conventional manner.
S2: and identifying the eye action to acquire a signal instruction corresponding to the eye action.
The method comprises the steps that codes corresponding to different eye actions are written in the intelligent device in advance, the codes are signal instructions, each code corresponds to information, when the eye actions are identified, the corresponding codes can be matched in the storage rapidly, and the information can be obtained after the codes are obtained. In this embodiment, the information may be voice, video, or picture. More specifically, when information is input, the device is controlled by eye movement, and the device may be a character or an executed action.
S3: and displaying corresponding information according to the signal instruction.
After S3, converting the information into corresponding audio and broadcasting the audio according to the corresponding information may be further performed.
As a preferred embodiment, the eye movements include the number of consecutive blinks, eye rotations, duration of no-movement hold. For example, blinking once, for one signal, and blinking twice, for a different signal. The eyeball rotation comprises eyeball rotation direction and same-direction eyeball rotation times.
For example, pinyin input is controlled through eye movement, and the implementation mode includes that blink times represent initial consonants and vowels, and eyeball rotation represents input of whole syllables; the watching duration represents the input of the first initial consonant or vowel; clockwise rotation of the eyeball represents the end of the input.
The following is illustrated by way of example: if the user wants to input the character 'must', quickly blinking twice towards a camera of the intelligent device to represent that the initial consonant list starts to be input, then displaying the initial consonant list by the intelligent device, watching the camera for 1 second by the user to represent that the first letter b of the initial consonant is input, controlling the eyeball to rotate clockwise once by the user, and representing that the input of the letter b is ended; and then the user blinks three times fast towards the camera to represent the input of the single vowel, the intelligent device displays the single vowel list, the user watches the camera temple and represents the input of the fourth letter i in the single vowel list, and then the user rotates the eyeball clockwise to finish the input.
In this embodiment, "displaying the corresponding information according to the signal instruction" specifically includes:
displaying a plurality of characters matched with the signal instruction;
receiving another eye movement input by the user to select a target character among the plurality of characters;
and displaying the target character as corresponding information.
That is, for example, the first letter "Y" of the pinyin is entered by a first eye action, a number of commonly used characters matching the first letter Y, such as one, two, one, and so on, are automatically displayed, and the user may further perform a second eye action to select a target character from the several characters of "one, two, one, and so on.
In another aspect, the present invention provides an input device based on eye control, including the following units: a collecting unit: configured to capture eye movements; an identification unit: configured to recognize the eye movement to acquire a signal instruction corresponding to the eye movement; a display unit: configured to display the corresponding information according to the signal instruction.
The input device based on the eye control is substantially the same as the input method based on the eye control. Correspondingly, the eye movement comprises the continuous blinking times, the eyeball rotation and the no-movement holding time. The eyeball rotation comprises eyeball rotation direction and same-direction eyeball rotation times.
In another aspect, the present invention also provides an electronic device having a memory, a processor, and a computer readable program stored in the memory and executable by the processor, wherein the computer readable program when executed by the processor implements the input method based on eye control according to any one of the present invention.
The present invention also provides a storage medium having a computer readable program stored thereon that is executable by a processor, the computer readable program, when executed by the processor, implementing an eye control-based input method according to any one of the present invention.
Various other modifications and changes may be made by those skilled in the art based on the above-described technical solutions and concepts, and all such modifications and changes should fall within the scope of the claims of the present invention.
Claims (10)
1. An input method based on eye control, characterized by comprising the steps of:
collecting eye movements;
identifying the eye movement to acquire a signal instruction corresponding to the eye movement;
and displaying corresponding information according to the signal instruction.
2. The input method of claim 1, wherein the eye movements comprise a number of consecutive blinks, eye rotations, duration of no-movement hold.
3. The input method according to claim 2, wherein the eyeball rotation includes an eyeball rotation direction and a same-direction eyeball rotation number.
4. The input method according to claim 1, wherein the eye movement is captured by a camera.
5. The input method of claim 1, further comprising the steps of: and converting the information into corresponding audio and broadcasting the audio according to the corresponding information.
6. The input method according to claim 1, wherein displaying the corresponding information according to the signal instruction specifically includes:
displaying a plurality of characters matched with the signal instruction;
receiving another eye movement input by the user to select a target character among the plurality of characters;
and displaying the target character as corresponding information.
7. Input device based on eye control, characterized by comprising the following units:
a collecting unit: configured to capture eye movements;
an identification unit: configured to recognize the eye movement to acquire a signal instruction corresponding to the eye movement;
a display unit: configured to display the corresponding information according to the signal instruction.
8. The input device of claim 7, wherein the eye movements comprise a number of consecutive blinks, eye rotations, duration of no-movement hold.
9. An electronic device having a memory, a processor, and a computer readable program stored in the memory and executable by the processor, wherein the computer readable program when executed by the processor implements the eye control based input method of any one of claims 1-6.
10. A storage medium having a computer readable program stored thereon which is executable by a processor, wherein the computer readable program, when executed by the processor, implements the eye control based input method of any one of claims 1-6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010779441.1A CN111930234A (en) | 2020-08-05 | 2020-08-05 | Input method and device based on eye control, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010779441.1A CN111930234A (en) | 2020-08-05 | 2020-08-05 | Input method and device based on eye control, electronic equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111930234A true CN111930234A (en) | 2020-11-13 |
Family
ID=73307590
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010779441.1A Pending CN111930234A (en) | 2020-08-05 | 2020-08-05 | Input method and device based on eye control, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111930234A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114546102A (en) * | 2020-11-26 | 2022-05-27 | 幻蝎科技(武汉)有限公司 | Eye tracking sliding input method and system, intelligent terminal and eye tracking device |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105373720A (en) * | 2015-10-28 | 2016-03-02 | 广东欧珀移动通信有限公司 | Module control method and device applied to mobile terminal |
| CN108351685A (en) * | 2015-08-15 | 2018-07-31 | 谷歌有限责任公司 | System and method for the ocular signal based on biomethanics interacted with true and virtual objects |
| CN111459285A (en) * | 2020-04-10 | 2020-07-28 | 康佳集团股份有限公司 | Display device control method based on eye control technology, display device and storage medium |
-
2020
- 2020-08-05 CN CN202010779441.1A patent/CN111930234A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108351685A (en) * | 2015-08-15 | 2018-07-31 | 谷歌有限责任公司 | System and method for the ocular signal based on biomethanics interacted with true and virtual objects |
| CN105373720A (en) * | 2015-10-28 | 2016-03-02 | 广东欧珀移动通信有限公司 | Module control method and device applied to mobile terminal |
| CN111459285A (en) * | 2020-04-10 | 2020-07-28 | 康佳集团股份有限公司 | Display device control method based on eye control technology, display device and storage medium |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114546102A (en) * | 2020-11-26 | 2022-05-27 | 幻蝎科技(武汉)有限公司 | Eye tracking sliding input method and system, intelligent terminal and eye tracking device |
| CN114546102B (en) * | 2020-11-26 | 2024-02-27 | 幻蝎科技(武汉)有限公司 | Eye movement tracking sliding input method, system, intelligent terminal and eye movement tracking device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107004414B (en) | Information processing apparatus, information processing method, and recording medium | |
| CN105357631A (en) | Terminal use time control method and associated equipment | |
| CN102163377A (en) | Facial tracking electronic reader | |
| CN104115100A (en) | Head-mounted display, program for controlling head-mounted display, and method of controlling head-mounted display | |
| CN104320688A (en) | Video play control method and device | |
| CN106921883B (en) | Video playing processing method and device | |
| US8793129B2 (en) | Image display device for identifying keywords from a voice of a viewer and displaying image and keyword | |
| CN104035656A (en) | User interface and method | |
| CN107731020B (en) | Multimedia playing method, device, storage medium and electronic equipment | |
| CN112437353A (en) | Video processing method, video processing apparatus, electronic device, and readable storage medium | |
| KR20210110852A (en) | Image deformation control method, device and hardware device | |
| CN113689530B (en) | Method and device for driving digital person and electronic equipment | |
| CN107390874A (en) | A kind of intelligent terminal control method and control device based on human eye | |
| CN111930234A (en) | Input method and device based on eye control, electronic equipment and storage medium | |
| EP2981059A1 (en) | Image recording device, image recoding method, and program | |
| CN114489331A (en) | Method, apparatus, device and medium for interaction of separated gestures distinguished from button clicks | |
| JP6085067B2 (en) | User data update method, apparatus, program, and recording medium | |
| CN113556599A (en) | Video teaching method and device, television and storage medium | |
| CN111464859A (en) | Online video display method and device | |
| CN110971924A (en) | Method, device, storage medium and system for beautifying in live broadcast process | |
| CN111079503B (en) | Character recognition method and electronic equipment | |
| CN111638918A (en) | Method and apparatus for presenting information | |
| JP6437257B2 (en) | Work process learning support system | |
| CN113450627A (en) | Experiment project operation method and device, electronic equipment and storage medium | |
| CN108932448B (en) | Electronic screen-based click-to-read code identification method, terminal and click-to-read pen |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20201113 |