CN202587119U - System for controlling mobile phone interaction based on eye movement trajectory - Google Patents

System for controlling mobile phone interaction based on eye movement trajectory Download PDF

Info

Publication number
CN202587119U
CN202587119U CN201220128291.9U CN201220128291U CN202587119U CN 202587119 U CN202587119 U CN 202587119U CN 201220128291 U CN201220128291 U CN 201220128291U CN 202587119 U CN202587119 U CN 202587119U
Authority
CN
China
Prior art keywords
mobile phone
vision
microcontroller
user
eye movement
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201220128291.9U
Other languages
Chinese (zh)
Inventor
朱益
张冒磊
曾坚
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Jinli Communication Equipment Co Ltd
Original Assignee
Shenzhen Jinli Communication Equipment Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Jinli Communication Equipment Co Ltd filed Critical Shenzhen Jinli Communication Equipment Co Ltd
Priority to CN201220128291.9U priority Critical patent/CN202587119U/en
Application granted granted Critical
Publication of CN202587119U publication Critical patent/CN202587119U/en
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Images

Landscapes

  • Telephone Function (AREA)

Abstract

The utility model discloses a system for controlling mobile phone interaction based on eye movement trajectory. The system comprises a mobile phone body, a main circuit board and a display screen, wherein the main circuit board and the display screen are arranged in the mobile phone body; a mobile phone CPU (central processing unit), a microcontroller, a vision system micro-processing chip, a vision sensor and a vision collector are arranged on the main circuit board; the vision collector is connected with the vision sensor; the vision sensor is connected with the microcontroller through the vision system micro-processing chip; and the microcontroller is connected with the mobile phone CPU. According to the system and the method for controlling mobile phone interaction based on eye movement trajectory disclosed by the utility model, the human eye movement trajectory is collected mainly by the vision collector, the vision sensor and the like; by comparison with the reference trajectory in a memory unit by the microcontroller, a relative operation instruction is formed and is correspondingly controlled by the mobile phone CPU. According to the system, the interaction operation of the mobile phone system is achieved without using fingers of the user, the possibility of completely replacing the operation of hands to the mobile phone by the vision control is achieved, the user is convenient to use and operate the mobile phone, the hands are released at the same time; in this way, the problem that other operations cannot be performed as the hands of user are occupied for using the mobile phone is solved.

Description

A kind of system based on eyeball moving track control mobile phone interaction
Technical field
The utility model relates to mobile phone, and what be specifically related to is a kind of system based on eyeball moving track control mobile phone interaction, through the movement locus of user's eyeball being realized to the controling of mobile phone, thereby reaches the purpose of liberation user both hands.
Background technology
Along with the fast development of smart mobile phone, through realizations such as gesture motion, voice controling of mobile phone become a reality, though above-mentioned two kinds of modes of operation bring great convenience to the cellphone subscriber; But because the limitation of its environment for use; In some specific environment, use also very inconvenience, need user's both hands or one hand that mobile phone collection terminal camera is operated such as the gesture motion operating handset; In comparatively cold environment; The user is unwilling to carry out this operation usually, can't use in the environment that voice operating is then relatively made a lot of noise at environment, especially noise is bigger, and it needs a comparatively quietly environment.
And according to discovering, human eye is when watching mobile phone screen, and motion up and down is similar; Be that foundation can be arranged, track is arranged, model is arranged; Therefore can realize controling with the movement locus of human eye to mobile phone; Realize mobile phone interaction, this mode can greatly be liberated user's both hands, avoids problems such as voice, the existing environment for use restriction of gesture operation.
The utility model content
The purpose of the utility model is to provide a kind of system based on eyeball moving track control mobile phone interaction; Need use drawbacks such as finger control, voice operating and mobile phone operation to solve present mobile phone; Realize mobile phone through human eye vision control, made things convenient for user's diversity to use.
The purpose of the utility model realizes through following technical scheme.
A kind of system based on eyeball moving track control mobile phone interaction; Comprise mobile phone body and be installed in main circuit board and the display screen in the mobile phone body; Said main circuit board is provided with mobile phone CPU, microcontroller, the little process chip of vision system, vision sensor and vision collecting device; Said vision collecting device is connected with vision sensor, and vision sensor is connected with microcontroller through the little process chip of vision system, and said microcontroller is connected with mobile phone CPU.
Preferably, said microcontroller also be connected with one store the vision system programmed algorithm memory, be solidified with vision system programmed algorithm, reference trajectory data and the operation sequence corresponding in this memory with these reference trajectory data.
The utility model compared with prior art; Beneficial effect is: the system based on eyeball moving track control mobile phone interaction that the utility model provides; Main through collection human eye movement tracks such as vision collecting device, vision sensors; And corresponding compare through the reference trajectory in microcontroller and the memory, form corresponding operational order, by the control operation of mobile phone CPU correspondence.The utility model need not the user and uses finger that cell phone system is carried out interactive operation; Make vision control replace both hands that the operation of mobile phone is become possibility fully; Greatly made things convenient for the use operation of user to mobile phone; Simultaneously also liberated both hands, solved the user and in using the mobile phone process, need make with the hands, and the problem that can not carry out other operations.
Description of drawings
Fig. 1 is the system principle diagram of the utility model.
Embodiment
For the purpose, technical scheme and the advantage that make the utility model is clearer,, the utility model is further elaborated below in conjunction with accompanying drawing and embodiment.Should be appreciated that specific embodiment described herein only in order to explanation the utility model, and be not used in qualification the utility model.
See also shown in Figure 1ly, Fig. 1 is the system principle diagram of the utility model.The utility model provides a kind of system based on eyeball moving track control mobile phone interaction; This system is provided with little process chip of vision system and microcontroller in mobile phone, vision control little process chip and microcontroller all the time with mobile phone in power supply be in connection status, (move up and down when the user carries out eye movement; Open eyes and close one's eyes) when operating; Utilize vision collecting device collection user eyeball moving track information, vision system is controlled little process chip this eyeball moving track information is handled, and microcontroller is analyzed coupling according to information after handling and the data message in the memory; Whether the result's decision according to after the analyzing and processing coupling wants operating handset; If coupling is passed through, then control mobile phone by the eye movement instruction, mobile phone is in is controlled state.
Wherein this system includes mobile phone body and is installed in main circuit board, the display screen in the mobile phone body, and said main circuit board is provided with mobile phone CPU, microcontroller, vision system program storage, the little process chip of vision system, vision sensor and vision collecting device.
Microcontroller is connected with mobile phone CPU; Mobile phone CPU is connected with mobile phone display screen, the eyeball moving track information that eyeball vision track collector is used to gather external user, and this information sent to vision sensor; The information of transducer after with this Treatment Analysis sends to the little process chip of vision system; The little process chip of vision is used for this eyeball moving track information is handled, and converts the analog voice signal that collects to audio digital signals, and sends microcontroller.
Memory is connected with microcontroller, and is solidified with vision system programmed algorithm, reference trajectory data and the operation sequence corresponding with these reference trajectory data in the memory.
In addition; Microcontroller in the utility model is in connection status with battery of mobile phone all the time; So that be under the state such as close at mobile phone, the little process chip of vision system and other modules can be in running order, the operation that can be correlated with to user's eyeball moving track instruction.
The utility model when work at first the vision collecting device gather the oculomotor trace information of user; Through vision sensor those information are sent to the little process chip of vision system; Program and algorithm that chip calls in the memory convert thereof into digital signal and send to microcontroller; Microcontroller carries out analyzing and processing with the data message in this digital signal and the memory; And mate contrast with the reference trajectory data in the memory, if the coupling contrast is not passed through, then cell phone system is not carried out interactive operation etc.; If pass through, then microcontroller starts mobile phone CPU, and mobile phone CPU controls cell phone system, realizes start, and changeover program gets into application menu and waits operation alternately.
No matter the utility model is under mobile phone shutdown or holding state; The little process chip of vision system and the microcontroller that are installed in the mobile phone all are in mode of operation; Through the little process chip of vision system analyzing and processing is carried out in the user's eyeball moving track instruction that collects, and the instruction that collects is compared, if mate with predefined user instruction through microcontroller; Then control mobile phone CPU; The also passive interactive action of making of while cell phone system, mobile phone also is in to be accepted in the command status, and mobile phone is also waiting for that follow-up eyeball moving track information realizes control operation.Compared with prior art; The utility model need not the user and uses the bimanualness mobile phone; For using mobile phone that other mode is provided under the particular locality specific environment; Also improved the efficient the when user carries out other work when using mobile phone, made this kind mode replace both hands that the operation of mobile phone is become possibility alternately, greatly made things convenient for the use operation of user mobile phone.
The above is merely the preferred embodiment of the utility model; Not in order to restriction the utility model; Any modification of being done within all spirit and principles at the utility model, be equal to replacement and improvement etc., all should be included within the protection range of the utility model.

Claims (1)

1. system based on eyeball moving track control mobile phone interaction; Comprise mobile phone body and be installed in main circuit board and the display screen in the mobile phone body; It is characterized in that said main circuit board is provided with mobile phone CPU, microcontroller, the little process chip of vision system, vision sensor and vision collecting device; Said vision collecting device is connected with vision sensor, and vision sensor is connected with microcontroller through the little process chip of vision system, and said microcontroller is connected with mobile phone CPU.
CN201220128291.9U 2012-03-30 2012-03-30 System for controlling mobile phone interaction based on eye movement trajectory Expired - Fee Related CN202587119U (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201220128291.9U CN202587119U (en) 2012-03-30 2012-03-30 System for controlling mobile phone interaction based on eye movement trajectory

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201220128291.9U CN202587119U (en) 2012-03-30 2012-03-30 System for controlling mobile phone interaction based on eye movement trajectory

Publications (1)

Publication Number Publication Date
CN202587119U true CN202587119U (en) 2012-12-05

Family

ID=47256475

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201220128291.9U Expired - Fee Related CN202587119U (en) 2012-03-30 2012-03-30 System for controlling mobile phone interaction based on eye movement trajectory

Country Status (1)

Country Link
CN (1) CN202587119U (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105700677A (en) * 2015-12-29 2016-06-22 努比亚技术有限公司 Mobile terminal and control method thereof
US10303243B2 (en) 2017-01-26 2019-05-28 International Business Machines Corporation Controlling devices based on physical gestures

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105700677A (en) * 2015-12-29 2016-06-22 努比亚技术有限公司 Mobile terminal and control method thereof
US10303243B2 (en) 2017-01-26 2019-05-28 International Business Machines Corporation Controlling devices based on physical gestures

Similar Documents

Publication Publication Date Title
CN102611801A (en) System and method for controlling mobile phone interaction based on eye movement trajectory
CN109445572A (en) The method, graphical user interface and terminal of wicket are quickly recalled in full screen display video
CN204129661U (en) Wearable device and there is the speech control system of this wearable device
CN110531864A (en) A kind of gesture interaction method, device and terminal device
CN109032734A (en) A kind of background application display methods and mobile terminal
CN104765460A (en) Intelligent ring and method for controlling intelligent terminal through intelligent ring via gestures
CN110362244A (en) A kind of split screen method and electronic equipment
JP7397861B2 (en) Stylus pen detection method, system and related equipment
CN104423822B (en) Record the method and device of automatic test script
CN103167151A (en) Automatic screen-locking system and method for mobile phone placed in pocket
CN103280232B (en) audio recording method, device and terminal device
CN108737904A (en) A kind of video data handling procedure and mobile terminal
CN204705845U (en) A kind of wearable electronic
CN110518707A (en) Transmitting end equipment, receiving device and wireless charging method
CN110058836A (en) A kind of output method and terminal device of audio signal
CN108717324A (en) Intelligent wearable device and its control method, computer readable storage medium
CN107832601A (en) A kind of application control method and mobile terminal
CN107889177A (en) Method for switching network and device
CN204990678U (en) Multi -functional omnipotent remote controller
CN108765907A (en) Remote controler for controlling mobile phone and tablet computer and increase individual features
CN202587119U (en) System for controlling mobile phone interaction based on eye movement trajectory
CN202795696U (en) Intelligent home security and protection system under JAVA platform
CN204256444U (en) A kind of ultra-low power consumption wireless intelligent control system being applicable to body sense or Sound control
CN107678824A (en) Screen picture switching method and device based on system switching
CN202424833U (en) System of full-voice control mobile terminal

Legal Events

Date Code Title Description
C14 Grant of patent or utility model
GR01 Patent grant
PP01 Preservation of patent right

Effective date of registration: 20180806

Granted publication date: 20121205

PP01 Preservation of patent right
PD01 Discharge of preservation of patent

Date of cancellation: 20190925

Granted publication date: 20121205

PD01 Discharge of preservation of patent
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20121205

Termination date: 20180330

CF01 Termination of patent right due to non-payment of annual fee