CN107479713A - The man-machine interaction method and mobile device of a kind of mobile device - Google Patents
The man-machine interaction method and mobile device of a kind of mobile device Download PDFInfo
- Publication number
- CN107479713A CN107479713A CN201710714499.6A CN201710714499A CN107479713A CN 107479713 A CN107479713 A CN 107479713A CN 201710714499 A CN201710714499 A CN 201710714499A CN 107479713 A CN107479713 A CN 107479713A
- Authority
- CN
- China
- Prior art keywords
- eyeball
- mobile device
- man
- machine interaction
- memory
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
Abstract
The invention provides a kind of man-machine interaction method of mobile device, comprise the following steps：A, startup power supply, range sensor work, judges human body distance；B, eyeball tracking working sensor, record initial eyeball image and store in memory, timer starts timing；C, default time-count cycle is completed, eyeball image is recorded again and stores in memory, timer works on after resetting；D, the eyeball image in memory is analyzed controller, judges whether eyeball changes；E, eye movement distance and direction are judged；F, controller indication display makes corresponding action, additionally provides a kind of mobile device.The present invention only can be achieved with man-machine interaction, such as page turning or switching song by the eyeball action of people, improve the operating efficiency and convenience of user, while cause man-machine interaction more accurately and reliably, bring the good man-machine interaction experience of user.
Description
Technical field
The present invention relates to human-computer interaction technique field, the man-machine interaction method of more particularly to a kind of mobile device and movement are set
It is standby.
Background technology
Current various Intelligent mobile equipments become increasingly popular, during the mode of man-machine interaction is also evolving.Modern computer
System realizes the mode of man-machine interaction mainly by interactive devices such as microphone, keyboard, mouse, stylus, inductive rod, touch-screens,
Aforesaid way usually requires the operation that people is manual or is repeated, and some also needs to people and is trained ability in advance skillfully
Grasp.
In existing technology, electronic apparatus application human eye be present as a kind of input unit, reached more preferable people
Machine interactive experience.But current this input method is mostly by detecting human eye sight present convergence in some position of screen, when
Human eye sight falls in the lower end of screen, then screen downward page turning automatically.The mode of this man-machine interaction rest on only with
Human eye sight drop point is as input information, and when practical application, the reaction that electronic equipment is made according to input information is relative
In human eye action, often accuracy and flexibility be not high, and hysteresis is obvious, therefore can not reach good man-machine friendship
Mutually experience.
The content of the invention
(1) technical problem solved
In order to solve the above problems, the invention provides a kind of man-machine interaction method of mobile device and mobile device, make
Obtain man-machine interaction more accurately and reliably, improves the operating efficiency and convenience of user, so as to the man-machine interaction body good to user
Test.
(2) technical scheme
A kind of man-machine interaction method of mobile device, comprises the following steps：
A, startup power supply, range sensor work, judges human body distance；
B, eyeball tracking working sensor, record initial eyeball image and store in memory, timer starts timing；
C, default time-count cycle is completed, eyeball image is recorded again and stores in memory, timer continues after resetting
Work；
D, the eyeball image in memory is analyzed controller, judges whether eyeball changes；
E, eye movement distance and direction are judged；
F, controller indication display makes corresponding action.
Further, the default health between human body and the mobile device of the range sensor browses distance, described
It is 35~45 centimetres that health, which browses distance,.
Further, it is 0.1~1 second that time-count cycle is preset described in the timer, and the timer completes a timing
Reset after cycle.
Further, the judgment threshold of the eye movement distance is preset.
Further, eyeball action and the corresponding relation of the display feedback action are preset.
A kind of mobile device, including power supply, range sensor, eyeball tracking sensor, controller, timer, memory
And display.
(3) beneficial effect
The invention provides a kind of man-machine interaction method of mobile device and mobile device, is only acted just by the eyeball of people
Man-machine interaction, such as page turning or switching song can be realized, improves the operating efficiency and convenience of user, while cause man-machine
Interaction more accurately and reliably, has brought the good man-machine interaction experience of user.
Brief description of the drawings
Fig. 1 is a kind of man-machine interaction method schematic flow sheet of mobile device involved in the present invention.
Fig. 2 is a kind of structural representation of mobile device involved in the present invention.
Embodiment
Embodiment involved in the present invention is described in further details below in conjunction with the accompanying drawings.
The present invention is built upon on the premise with the mobile device based on human eyeball's tracing sensor this peripheral hardware
's.Human eyeball's tracing sensor is the image acquisition device for being had based on human eyeball's capturing technology eye recognition function.Mesh
Before, the image acquisition device is applied to digital vedio recording field.Meanwhile mobile device be specifically including but not limited to e-book,
MP4 players, smart mobile phone, tablet personal computer etc..
Embodiment 1：
As shown in figure 1, a kind of man-machine interaction method of mobile device, comprises the following steps：
A, startup power supply, range sensor work, judges human body distance；
B, eyeball tracking working sensor, record initial eyeball image and store in memory, timer starts timing；
C, default time-count cycle is completed, eyeball image is recorded again and stores in memory, timer continues after resetting
Work；
D, the eyeball image in memory is analyzed controller, judges whether eyeball changes；
E, eye movement distance and direction are judged；
F, controller indication display makes corresponding action.
The default health between human body and mobile device of range sensor browses distance, and it is 35~45 lis that health, which browses distance,
Rice, its actual range can make the appropriate adjustments according to the size of mobile device display screen.When between human body and mobile device
When distance meets the scope, eyeball tracking sensor is activated start-up operation, improves the accuracy and reliability of positioning.
In order that mobile device reaction is more flexible, timer preset time-count cycle as 0.1~1 second, and timer completes one
Reset after secondary time-count cycle.
The judgment threshold of default eye movement distance, when controller judges that eyeball changes, and move distance exceedes threshold
When value, controller carries out next step action.
Default eyeball action and the corresponding relation of display feedback action, such as when the upward vertical offset of eyeball reaches
When predetermined threshold value, controller indication display stirs forward the page；When the downwardly vertical offset of eyeball reaches default threshold
When value, controller indication display stirs the page backward；When the transversal displacement to the left of eyeball reach predetermined threshold value when
Wait, controller indication display switches a upper song；When the transversal displacement to the right of eyeball reaches predetermined threshold value, control
Device indication display processed switches next song.
Above-mentioned health browses distance threshold or time-count cycle or eye movement distance threshold, can be system default value
Or set by User Defined.
Human eyeball's Dynamic Monitoring is based on face recognition technology, is contrasted comprising Face datection, face tracking and face
Etc. problem.Face datection refers to judge whether face simultaneously in dynamic scene, a frame video flowing or a still image
Face is separated from complex background, and preserved automatically, this human face detection tech is widely used to digital vedio recording
The fields such as device.Face datection includes the methods of reference template, face rule, sample learning, complexion model and sub-face of feature.
In face characteristic, identification of the eyes for face plays very important effect, exactly position human eye be Automatic face recognition,
The key link of the technologies such as man-machine interaction.At present, conventional Ins location method includes：First, Gray Projection method, it is special using face
The gray value difference of sign and the geometry distribution relation of face, to determine the position of eyeball.This method is fairly simple, but gray scale
The distribution of information is widely different with different faces, therefore this method positional accuracy is unstable, be easily trapped into Local Minimum and
Positioning is caused to fail；2nd, edge extracting method, face edge is detected using Sobel operators, and it may be eyeball to find out wherein
Region, the region of best match is then determined using the result of Hough transform, the position as eyeball.This method needs big
The pretreatment of amount, and by illumination and what is blocked have a great influence；3rd, template matching method, using variable formwork positioning eyeball, and
The template matching method based on region of interest is proposed on the basis of this, this method is existed using left eye ball template and right eye ball template
Matched in image, it is not necessary to substantial amounts of priori, but it is required and computationally intensive to initial position.Although with
Upper method respectively has its quality, but with other image procossing measures such as the improvement of algorithm and combination illumination compensations, in certain journey
Accuracy requirement of the mobile device for Ins location can have been met on degree.
The man-machine interaction method of the present embodiment gathers user eyeball information in real time, records current eyeball action and direction, when
When user eyeball acts, by gathering enough eyeball images within an interval short enough time-count cycle and being handled
Analysis, the direction of motion and the eyeball action of eyeball are judged, so that controller is sent according to the user of analysis gained by eyes
Command information and carry out corresponding interactive operation, user is realized corresponding operation by eyeball action, obtain good
Good man-machine interaction experience.
Embodiment 2：
As shown in Fig. 2 a kind of mobile device, including power supply, range sensor, eyeball tracking sensor, controller, timing
Device, memory and display.
Mobile device is in normal work, and range sensor judges that the health between human body and mobile device browses distance,
When in 35~45 the inside, eyeball tracking sensor is activated start-up operation, and records initial eyeball image store
In memory, while timer starts timing.After completing 0.1~1 second time-count cycle, 0.2 second is typically set at, eyeball
Tracing sensor records eyeball image store in memory again, while is worked on after timer clearing.Controller is to depositing
The two width eyeball images stored in reservoir are analyzed, and judge whether eyeball changes, if changing, judge eyeball
Move distance and direction, it is compared with the default judgment threshold of move distance up and down, if the judgement more than correspondence direction
Threshold value, controller indication display make corresponding action.
The invention provides a kind of man-machine interaction method of mobile device and mobile device, is only acted just by the eyeball of people
Man-machine interaction, such as page turning or switching song can be realized, improves the operating efficiency and convenience of user, while cause man-machine
Interaction more accurately and reliably, has brought the good man-machine interaction experience of user.
The above-described embodiments are merely illustrative of preferred embodiments of the present invention, not to the structure of the present invention
Think and scope is defined.On the premise of design concept of the present invention is not departed from, technology of the ordinary people in the field to the present invention
The all variations and modifications that scheme is made, all should drop into protection scope of the present invention, the claimed technology contents of the present invention,
All record in detail in the claims.
Claims (6)
- A kind of 1. man-machine interaction method of mobile device, it is characterised in that：Comprise the following steps：A, startup power supply, range sensor work, judges human body distance；B, eyeball tracking working sensor, record initial eyeball image and store in memory, timer starts timing；C, default time-count cycle is completed, eyeball image is recorded again and stores in memory, timer works on after resetting；D, the eyeball image in memory is analyzed controller, judges whether eyeball changes；E, eye movement distance and direction are judged；F, controller indication display makes corresponding action.
- A kind of 2. man-machine interaction method of mobile device according to claim 1, it is characterised in that：The range sensor Default health between human body and the mobile device browses distance, and it is 35~45 centimetres that the health, which browses distance,.
- A kind of 3. man-machine interaction method of mobile device according to claim 1, it is characterised in that：Described in the timer Default time-count cycle is 0.1~1 second, and the timer is reset after completing a time-count cycle.
- A kind of 4. man-machine interaction method of mobile device according to claim 1, it is characterised in that：The default eyeball fortune The judgment threshold of dynamic distance.
- A kind of 5. man-machine interaction method of mobile device according to claim 1, it is characterised in that：Default eyeball action with The corresponding relation of the display feedback action.
- A kind of 6. mobile device, it is characterised in that：Including power supply, range sensor, eyeball tracking sensor, controller, timing Device, memory and display.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710714499.6A CN107479713A (en) | 2017-08-18 | 2017-08-18 | The man-machine interaction method and mobile device of a kind of mobile device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710714499.6A CN107479713A (en) | 2017-08-18 | 2017-08-18 | The man-machine interaction method and mobile device of a kind of mobile device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107479713A true CN107479713A (en) | 2017-12-15 |
Family
ID=60601782
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710714499.6A Pending CN107479713A (en) | 2017-08-18 | 2017-08-18 | The man-machine interaction method and mobile device of a kind of mobile device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107479713A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105700677A (en) * | 2015-12-29 | 2016-06-22 | 努比亚技术有限公司 | Mobile terminal and control method thereof |
| CN109121194A (en) * | 2018-08-31 | 2019-01-01 | 百度在线网络技术（北京）有限公司 | The method and apparatus of state conversion for electronic equipment |
| CN111223251A (en) * | 2019-12-31 | 2020-06-02 | 航天信息股份有限公司 | Method and system for processing information based on eyeball tracking technology |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102819403A (en) * | 2012-08-28 | 2012-12-12 | 广东欧珀移动通信有限公司 | Terminal equipment and man-machine interaction method thereof |
| CN103294198A (en) * | 2013-05-23 | 2013-09-11 | 深圳先进技术研究院 | Mobile terminal based human-computer interaction method and system |
| CN103699210A (en) * | 2012-09-27 | 2014-04-02 | 北京三星通信技术研究有限公司 | Mobile terminal and control method thereof |
| CN103869958A (en) * | 2012-12-18 | 2014-06-18 | 原相科技股份有限公司 | Electronic device control method and electronic device |
-
2017
- 2017-08-18 CN CN201710714499.6A patent/CN107479713A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102819403A (en) * | 2012-08-28 | 2012-12-12 | 广东欧珀移动通信有限公司 | Terminal equipment and man-machine interaction method thereof |
| CN103699210A (en) * | 2012-09-27 | 2014-04-02 | 北京三星通信技术研究有限公司 | Mobile terminal and control method thereof |
| CN103869958A (en) * | 2012-12-18 | 2014-06-18 | 原相科技股份有限公司 | Electronic device control method and electronic device |
| CN103294198A (en) * | 2013-05-23 | 2013-09-11 | 深圳先进技术研究院 | Mobile terminal based human-computer interaction method and system |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105700677A (en) * | 2015-12-29 | 2016-06-22 | 努比亚技术有限公司 | Mobile terminal and control method thereof |
| CN109121194A (en) * | 2018-08-31 | 2019-01-01 | 百度在线网络技术（北京）有限公司 | The method and apparatus of state conversion for electronic equipment |
| CN109121194B (en) * | 2018-08-31 | 2019-12-10 | 百度在线网络技术（北京）有限公司 | Method and apparatus for state transition of electronic device |
| CN111223251A (en) * | 2019-12-31 | 2020-06-02 | 航天信息股份有限公司 | Method and system for processing information based on eyeball tracking technology |
| CN111223251B (en) * | 2019-12-31 | 2023-01-10 | 航天信息股份有限公司 | Method and system for processing information based on eyeball tracking technology |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108960163B (en) | Gesture recognition method, device, equipment and storage medium | |
| Hsieh et al. | A real time hand gesture recognition system using motion history image | |
| US9349039B2 (en) | Gesture recognition device and control method for the same | |
| CN102819403A (en) | Terminal equipment and man-machine interaction method thereof | |
| CN103164022B (en) | Many fingers touch method and device, portable terminal | |
| CN103150019A (en) | Handwriting input system and method | |
| CN101976330B (en) | Gesture recognition method and system | |
| CN105631399A (en) | Fast object tracking framework for sports video recognition | |
| CN107818180A (en) | Video correlating method, image display method, device and storage medium | |
| CN109375765B (en) | Eyeball tracking interaction method and device | |
| CN103824481A (en) | Method and device for detecting user recitation | |
| WO2018000519A1 (en) | Projection-based interaction control method and system for user interaction icon | |
| CN103985137A (en) | Moving object tracking method and system applied to human-computer interaction | |
| CN102609093A (en) | Method and device for controlling video playing by using gestures | |
| CN103106388B (en) | Method and system of image recognition | |
| CN107479713A (en) | The man-machine interaction method and mobile device of a kind of mobile device | |
| CN102708358A (en) | Reading-trajectory recognizing method | |
| CN102841676A (en) | Webpage browsing control system and method | |
| WO2012142869A1 (en) | Method and apparatus for automatically adjusting terminal interface display | |
| CN107526994A (en) | A kind of information processing method, device and mobile terminal | |
| CN106814853A (en) | A kind of eye control tracking based on machine learning | |
| CN111656313A (en) | Screen display switching method, display device and movable platform | |
| CN104268864A (en) | Card edge extracting method and device | |
| CN104615231A (en) | Determination method for input information, and equipment | |
| CN108108709B (en) | Identification method and device and computer storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20171215 |
|
| RJ01 | Rejection of invention patent application after publication |