CN105847538A - Mobile phone and method for controlling operations of VR (Virtual Reality) glasses based on eyeball tracking - Google Patents

Mobile phone and method for controlling operations of VR (Virtual Reality) glasses based on eyeball tracking Download PDF

Info

Publication number
CN105847538A
CN105847538A CN201610154213.9A CN201610154213A CN105847538A CN 105847538 A CN105847538 A CN 105847538A CN 201610154213 A CN201610154213 A CN 201610154213A CN 105847538 A CN105847538 A CN 105847538A
Authority
CN
China
Prior art keywords
gaze
eyeball
unit
action
glasses
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201610154213.9A
Other languages
Chinese (zh)
Other versions
CN105847538B (en
Inventor
金鑫
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Thunderbird innovation technology (Shenzhen) Co.,Ltd.
Original Assignee
Huizhou TCL Mobile Communication Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huizhou TCL Mobile Communication Co Ltd filed Critical Huizhou TCL Mobile Communication Co Ltd
Priority to CN201610154213.9A priority Critical patent/CN105847538B/en
Publication of CN105847538A publication Critical patent/CN105847538A/en
Application granted granted Critical
Publication of CN105847538B publication Critical patent/CN105847538B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/72409User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories
    • H04M1/72415User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories for remote control of appliances
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013Eye tracking input arrangements

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Telephone Function (AREA)
  • Eye Examination Apparatus (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The invention discloses a mobile phone and a method for controlling operations of a pair of VR (Virtual Reality) glasses based on eyeball tracking. The mobile phone comprises a setting unit, a capture unit, an eyeball tracking unit, a judgment unit and a control unit, wherein the setting unit sets an eyeball gazing direction and controls the VR glasses to execute a corresponding relation between the corresponding operations; the capture unit captures and outputs a facial image of a user; the eyeball tracking unit identifies eyeballs of the user from the captured image and monitors and outputs the eyeball gazing direction; the judgment unit judges whether the eyeball gazing direction is in a first or second gazing direction; when the eyeball gazing direction is not in the first or second gazing direction, the judgment unit does not act; when the eyeball gazing direction is in the first or second gazing direction, the judgment unit judges whether the retention time of the eyeballs in any gazing direction reaches the preset time; when the retention time does not reach the d time, the judgment unit does not output a control signal; when the retention time reaches the preset time, the judgment unit outputs the control signal; the control unit controls the VR glasses to execute the corresponding actions, so that the operations of the VR glasses are controlled through eyeball tracking, and thus the user experience is improved.

Description

Mobile phone and the method for the operation of VR glasses is controlled based on eyeball tracking
Technical field
The present invention relates to wearable device field, particularly relate to a kind of based on eyeball tracking control VR The mobile phone of glasses operation and method.
Background technology
VR glasses i.e. " virtual reality glasses " (Virtual Reality Glasses) passes through hands at present Machine as display screen, and by connect the modes such as controller or the blue Tooth remote controller of mobile phone realize right The control of VR glasses operation, but after putting on VR glasses, human eye cannot see controller, uses Family is the most inconvenient to the operation of VR glasses so that Consumer's Experience is poor.
Summary of the invention
The technical problem that present invention mainly solves is to provide a kind of based on eyeball tracking control VR glasses The mobile phone of operation and method, to control the operation of VR glasses by following the trail of eyeball, improve user's body Test.
For solving above-mentioned technical problem, the technical scheme that the present invention uses is: provide a kind of base The mobile phone of VR glasses operation is controlled in eyeball tracking, including:
Unit is set, performs corresponding for arranging the eyeball fixes direction of user to controlling VR glasses Operation corresponding relation, when described eyeball fixes direction is in the first direction of gaze, described accordingly Operation is the first action, when described eyeball fixes direction is in the second direction of gaze, described accordingly Operation is the second action;
Capturing unit, for capturing the face image of user and by the image output of capture;
Eyeball tracking unit, connects described capturing unit, for receiving capture from described capturing unit Image and from described image, identify the eyeball of user and monitor eyeball fixes direction, and by institute State the output of eyeball fixes direction;
Judging unit, connects and described arranges unit, for receiving eyeball fixes from the described unit that arranges Direction performs the corresponding relation of corresponding operating with controlling VR glasses, and described judging unit is also connected with institute State eyeball tracking unit, for receiving described eyeball fixes direction from described eyeball tracking unit and sentencing Whether disconnected described eyeball fixes direction is in the first direction of gaze or the second direction of gaze, described When eyeball fixes direction is not at the first direction of gaze or the second direction of gaze, described judging unit It is failure to actuate;When described eyeball fixes direction is in the first direction of gaze or the second direction of gaze, Described judging unit judges whether described eyeball presets the time of staying of described direction of gaze arbitrary Reach Preset Time, be not reaching in described eyeball arbitrary time of staying presetting described direction of gaze During Preset Time, described judging unit does not export control signal;Arbitrary default described at described eyeball When the time of staying of direction of gaze reaches Preset Time, described judging unit output control signal;And
Control unit, connects described judging unit, for receiving described control from described judging unit Signal also performs the first action or the second action according to described control signal control VR glasses.
Wherein, described capturing unit is the photographic head of mobile phone.
Wherein, described first direction of gaze is left side direction of gaze, and described first action is dynamic for confirming Making, described second direction of gaze is the right direction of gaze, and described second action is cancellation action.
Wherein, described first direction of gaze is the right direction of gaze, and described first action is dynamic for confirming Making, described second direction of gaze is left side direction of gaze, and described second action is cancellation action.
Wherein, the value of described Preset Time is 300 milliseconds to 500 milliseconds.
For solving above-mentioned technical problem, another technical solution used in the present invention is: provide one The method controlling the operation of VR glasses based on eyeball tracking, including:
By arranging unit, the eyeball fixes direction of user behaviour corresponding to controlling the execution of VR glasses is set The corresponding relation made, when described eyeball fixes direction is in the first direction of gaze, described corresponding behaviour As the first action, when described eyeball fixes direction is in the second direction of gaze, described corresponding behaviour As the second action;
By the face image of capturing unit capture user and the image of capture is exported;
The image of capture is received and from described image from described capturing unit by eyeball tracking unit In identify the eyeball of user and monitor eyeball fixes direction, and by defeated for described eyeball fixes direction Go out;
Held with controlling VR glasses from the described unit reception eyeball fixes direction that arranges by judging unit The corresponding relation of row corresponding operating, receives from described eyeball tracking unit also by described judging unit Described eyeball fixes direction and judge described eyeball fixes direction whether be in the first direction of gaze or Person's the second direction of gaze;
When described eyeball fixes direction is not at the first direction of gaze or the second direction of gaze, institute State judging unit to be failure to actuate;
When described eyeball fixes direction is in the first direction of gaze or the second direction of gaze, described Judging unit judges whether described eyeball reached in arbitrary time of staying presetting described direction of gaze Preset Time;
It is not reaching to Preset Time in described eyeball arbitrary time of staying presetting described direction of gaze Time, described judging unit does not export control signal;
When described eyeball arbitrary time of staying presetting described direction of gaze reaches Preset Time, institute State judging unit output control signal;And
Described control signal is received and according to described control from described judging unit by control unit Signal controls VR glasses and performs the first action or the second action.
Wherein, described capturing unit is the photographic head of mobile phone.
Wherein, described first direction of gaze is left side direction of gaze, and described first action is dynamic for confirming Making, described second direction of gaze is the right direction of gaze, and described second action is cancellation action.
Wherein, described first direction of gaze is the right direction of gaze, and described first action is dynamic for confirming Making, described second direction of gaze is left side direction of gaze, and described second action is cancellation action.
Wherein, the value of described Preset Time is 300 milliseconds to 500 milliseconds.
The invention has the beneficial effects as follows: be different from the situation of prior art, the present invention described based on The mobile phone of eyeball tracking control VR glasses operation and method arrange the eyeball of user by arranging unit Direction of gaze performs the corresponding relation of corresponding operating with controlling VR glasses, by described capturing unit Capture the face image of user and output it to described eyeball tracking unit, so that described eyeball chases after Track unit obtains the direction of gaze of user's eyeball according to the image received, and by described judgement Unit output control signal is so that described control unit controls VR glasses and performs corresponding operating, with this Realize controlling by following the trail of eyeball the operation of VR glasses, improve Consumer's Experience.
Accompanying drawing explanation
Fig. 1 is the block diagram of the mobile phone controlling the operation of VR glasses based on eyeball tracking of the present invention;
Fig. 2 is the flow chart of the method controlling the operation of VR glasses based on eyeball tracking of the present invention.
Detailed description of the invention
Refer to Fig. 1, be the mobile phone 1 controlling the operation of VR glasses based on eyeball tracking of the present invention Block diagram.As it is shown in figure 1, the described mobile phone 1 controlling the operation of VR glasses based on eyeball tracking Including arranging unit 110, perform with controlling VR glasses for arranging the eyeball fixes direction of user The corresponding relation of corresponding operating, when described eyeball fixes direction is in the first direction of gaze, described Corresponding operating is the first action, when described eyeball fixes direction is in the second direction of gaze, described Corresponding operating is the second action;Capturing unit 120, for capturing the face image of user and will catch The image output obtained;Eyeball tracking unit 130, connects described capturing unit 120, for from institute State capturing unit 120 receive the image of capture and from described image, identify the eyeball of user and supervise Survey eyeball fixes direction, and described eyeball fixes direction is exported;Judging unit 140, connects institute State and unit 110 is set, for receiving eyeball fixes direction from the described unit 110 that arranges and control VR Glasses perform the corresponding relation of corresponding operating, and described judging unit 140 is also connected with described eyeball tracking Unit 130, for receiving described eyeball fixes direction from described eyeball tracking unit 130 and judging Whether described eyeball fixes direction is in the first direction of gaze or the second direction of gaze, at described eye When ball direction of gaze is not at the first direction of gaze or the second direction of gaze, described judging unit 140 are failure to actuate;It is in the first direction of gaze or the second direction of gaze in described eyeball fixes direction Time, described judging unit 140 judges that described eyeball is when arbitrary stop presetting described direction of gaze Between whether reach Preset Time, described eyeball arbitrary preset described direction of gaze the time of staying do not have Having when reaching Preset Time, described judging unit 140 does not export control signal;Appoint at described eyeball When one time of staying presetting described direction of gaze reached Preset Time, described judging unit 140 is defeated Go out control signal;Control unit 150, connects described judging unit 140, for from described judgement Unit 140 receives described control signal and controls VR glasses execution first according to described control signal Action or the second action.
In the present embodiment, described first direction of gaze is left side direction of gaze, described first action For confirmation action, described second direction of gaze is the right direction of gaze, and described second action is for cancelling Action, or described first direction of gaze alternatively the right direction of gaze, described first action is true Recognizing action, described second direction of gaze is alternatively left side direction of gaze, and described second action is for cancelling Action.
In other embodiments, described first direction of gaze or described second direction of gaze are alternatively In edge direction, lower edge direction, upper left, direction of sitting down, upper right or lower right Any one, described first action or described second action are alternatively forward motion or return dynamic Make, or need the action of other operations carried out for user, or user is as required to multiple Direction of gaze is combined and to tackling the operation that multiple actions are combined, user can be according to need Relative set is carried out by the described unit 110 that arranges.
In the present embodiment, described mobile phone 1 is as the display screen of VR glasses, in described mobile phone 1 Also include memorizer and processor, the described unit 110, described capturing unit 120, described of arranging Eyeball tracking unit 130, described judging unit 140 and described control unit 150 are stored in described In memorizer, described processor is to the described unit 110, described capturing unit 120, described of arranging Eyeball tracking unit 130, described judging unit 140 and described control unit 150 perform, Other elements and application program in described mobile phone 1 are identical with common mobile phone, do not repeat them here.
In the present embodiment, described capturing unit 120 is the front-facing camera of mobile phone.Described pre- If the value of time is 300 milliseconds to 500 milliseconds.
Refer to Fig. 2, be the method controlling the operation of VR glasses based on eyeball tracking of the present invention Flow chart.As in figure 2 it is shown, described method based on eyeball tracking control VR glasses operation includes:
Step S1: eyeball fixes direction and the control VR eye of user are set by arranging unit 110 Mirror performs the corresponding relation of corresponding operating, is in the first direction of gaze in described eyeball fixes direction Time, described corresponding operating is the first action, is in the second direction of gaze in described eyeball fixes direction Time, described corresponding operating is the second action;
Step S2: capture the face image of user and by defeated for the image of capture by capturing unit 120 Go out;
Step S3: received the figure of capture by eyeball tracking unit 130 from described capturing unit 120 Picture also identifies the eyeball of user from described image and monitors eyeball fixes direction, and by described eye Ball direction of gaze exports;
Step S4: receive eyeball fixes direction from the described unit 110 that arranges by judging unit 140 With control VR glasses perform corresponding operating corresponding relation, also by described judging unit 140 from Described eyeball tracking unit 130 receives described eyeball fixes direction and judges described eyeball fixes direction Whether it is in the first direction of gaze or the second direction of gaze;
Step S5: be not at the first direction of gaze or second side of watching attentively in described eyeball fixes direction Xiang Shi, described judging unit 140 is failure to actuate;
Step S6: be in the first direction of gaze or the second direction of gaze in described eyeball fixes direction Time, described judging unit 140 judges that described eyeball is when arbitrary stop presetting described direction of gaze Between whether reach Preset Time;
Step S7: be not reaching to pre-in described eyeball arbitrary time of staying presetting described direction of gaze If during the time, described judging unit 140 does not export control signal;
Step S8: when described eyeball arbitrary time of staying presetting described direction of gaze reaches to preset Between time, described judging unit 140 exports control signal;And
Step S9: receive described control signal from described judging unit 140 by control unit 150 And perform the first action or the second action according to described control signal control VR glasses.
Described mobile phone based on eyeball tracking control VR glasses operation and method set by arranging unit Put the eyeball fixes direction of user and control the corresponding relation of VR glasses execution corresponding operating, passing through Described capturing unit captures the face image of user and outputs it to described eyeball tracking unit, with Described eyeball tracking unit is made to obtain the direction of gaze of user's eyeball according to the image received, and By described judging unit output control signal so that described control unit controls VR glasses and performs phase Should operate, the operation realizing controlling VR glasses by following the trail of eyeball with this, improve Consumer's Experience.
The foregoing is only embodiments of the present invention, not thereby limit the patent model of the present invention Enclosing, every equivalent structure utilizing description of the invention and accompanying drawing content to be made or equivalence flow process become Change, or be directly or indirectly used in other relevant technical fields, be the most in like manner included in the present invention's In scope of patent protection.

Claims (10)

1. the mobile phone controlling the operation of VR glasses based on eyeball tracking, it is characterised in that described Mobile phone includes:
Unit is set, performs corresponding for arranging the eyeball fixes direction of user to controlling VR glasses Operation corresponding relation, when described eyeball fixes direction is in the first direction of gaze, described accordingly Operation is the first action, when described eyeball fixes direction is in the second direction of gaze, described accordingly Operation is the second action;
Capturing unit, for capturing the face image of user and by the image output of capture;
Eyeball tracking unit, connects described capturing unit, for receiving capture from described capturing unit Image and from described image, identify the eyeball of user and monitor eyeball fixes direction, and by institute State the output of eyeball fixes direction;
Judging unit, connects and described arranges unit, for receiving eyeball fixes from the described unit that arranges Direction performs the corresponding relation of corresponding operating with controlling VR glasses, and described judging unit is also connected with institute State eyeball tracking unit, for receiving described eyeball fixes direction from described eyeball tracking unit and sentencing Whether disconnected described eyeball fixes direction is in the first direction of gaze or the second direction of gaze, described When eyeball fixes direction is not at the first direction of gaze or the second direction of gaze, described judging unit It is failure to actuate;When described eyeball fixes direction is in the first direction of gaze or the second direction of gaze, Described judging unit judges whether described eyeball presets the time of staying of described direction of gaze arbitrary Reach Preset Time, be not reaching in described eyeball arbitrary time of staying presetting described direction of gaze During Preset Time, described judging unit does not export control signal;Arbitrary default described at described eyeball When the time of staying of direction of gaze reaches Preset Time, described judging unit output control signal;And
Control unit, connects described judging unit, for receiving described control from described judging unit Signal also performs the first action or the second action according to described control signal control VR glasses.
The mobile phone controlling the operation of VR glasses based on eyeball tracking the most according to claim 1, It is characterized in that, described capturing unit is the photographic head of mobile phone.
The mobile phone controlling the operation of VR glasses based on eyeball tracking the most according to claim 1, It is characterized in that, described first direction of gaze is left side direction of gaze, and described first action is for confirming Action, described second direction of gaze is the right direction of gaze, and described second action is cancellation action.
The mobile phone controlling the operation of VR glasses based on eyeball tracking the most according to claim 1, It is characterized in that, described first direction of gaze is the right direction of gaze, and described first action is for confirming Action, described second direction of gaze is left side direction of gaze, and described second action is cancellation action.
5. according to operating based on eyeball tracking control VR glasses described in any one of claim 1-4 Mobile phone, it is characterised in that the value of described Preset Time is 300 milliseconds to 500 milliseconds.
6. the method controlling the operation of VR glasses based on eyeball tracking, it is characterised in that described The method controlling the operation of VR glasses based on eyeball tracking includes:
By arranging unit, the eyeball fixes direction of user behaviour corresponding to controlling the execution of VR glasses is set The corresponding relation made, when described eyeball fixes direction is in the first direction of gaze, described corresponding behaviour As the first action, when described eyeball fixes direction is in the second direction of gaze, described corresponding behaviour As the second action;
By the face image of capturing unit capture user and the image of capture is exported;
The image of capture is received and from described image from described capturing unit by eyeball tracking unit In identify the eyeball of user and monitor eyeball fixes direction, and by defeated for described eyeball fixes direction Go out;
Held with controlling VR glasses from the described unit reception eyeball fixes direction that arranges by judging unit The corresponding relation of row corresponding operating, receives from described eyeball tracking unit also by described judging unit Described eyeball fixes direction and judge described eyeball fixes direction whether be in the first direction of gaze or Person's the second direction of gaze;
When described eyeball fixes direction is not at the first direction of gaze or the second direction of gaze, institute State judging unit to be failure to actuate;
When described eyeball fixes direction is in the first direction of gaze or the second direction of gaze, described Judging unit judges whether described eyeball reached in arbitrary time of staying presetting described direction of gaze Preset Time;
It is not reaching to Preset Time in described eyeball arbitrary time of staying presetting described direction of gaze Time, described judging unit does not export control signal;
When described eyeball arbitrary time of staying presetting described direction of gaze reaches Preset Time, institute State judging unit output control signal;And
Described control signal is received and according to described control from described judging unit by control unit Signal controls VR glasses and performs the first action or the second action.
The method controlling the operation of VR glasses based on eyeball tracking the most according to claim 6, It is characterized in that, described capturing unit is the photographic head of mobile phone.
The method controlling the operation of VR glasses based on eyeball tracking the most according to claim 6, It is characterized in that, described first direction of gaze is left side direction of gaze, and described first action is for confirming Action, described second direction of gaze is the right direction of gaze, and described second action is cancellation action.
The method controlling the operation of VR glasses based on eyeball tracking the most according to claim 6, It is characterized in that, described first direction of gaze is the right direction of gaze, and described first action is for confirming Action, described second direction of gaze is left side direction of gaze, and described second action is cancellation action.
10. according to grasping based on eyeball tracking control VR glasses described in any one of claim 6-9 The method made, it is characterised in that the value of described Preset Time is 300 milliseconds to 500 milliseconds.
CN201610154213.9A 2016-03-16 2016-03-16 Mobile phone and method for controlling VR (virtual reality) glasses operation based on eyeball tracking Active CN105847538B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610154213.9A CN105847538B (en) 2016-03-16 2016-03-16 Mobile phone and method for controlling VR (virtual reality) glasses operation based on eyeball tracking

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610154213.9A CN105847538B (en) 2016-03-16 2016-03-16 Mobile phone and method for controlling VR (virtual reality) glasses operation based on eyeball tracking

Publications (2)

Publication Number Publication Date
CN105847538A true CN105847538A (en) 2016-08-10
CN105847538B CN105847538B (en) 2021-06-01

Family

ID=56587937

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610154213.9A Active CN105847538B (en) 2016-03-16 2016-03-16 Mobile phone and method for controlling VR (virtual reality) glasses operation based on eyeball tracking

Country Status (1)

Country Link
CN (1) CN105847538B (en)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106448337A (en) * 2016-09-20 2017-02-22 山西省交通科学研究院 VR technology based automobile driving simulation device
CN106454098A (en) * 2016-10-31 2017-02-22 深圳晨芯时代科技有限公司 Virtual reality shooting and displaying method and system
CN106501962A (en) * 2017-01-05 2017-03-15 电子科技大学中山学院 3D display device with lens in delayed motion
CN107562208A (en) * 2017-09-27 2018-01-09 上海展扬通信技术有限公司 The intelligent terminal control method and intelligent terminal control system of a kind of view-based access control model
CN107943296A (en) * 2017-11-30 2018-04-20 歌尔科技有限公司 Applied to the control method and equipment in headset equipment
CN108663806A (en) * 2017-03-31 2018-10-16 及至微机电股份有限公司 Imaing projector with pupil tracing function and its pupil position follow-up mechanism
CN110188488A (en) * 2019-06-03 2019-08-30 中国石油大学(华东) A kind of sea bed gas hydrate is appeared and the emulation mode and system of surrounding enviroment
WO2021164511A1 (en) * 2020-02-20 2021-08-26 中国银联股份有限公司 Information processing method and system based on eyeball tracking, and payment processing method based on eyeball tracking
CN113589523A (en) * 2021-07-06 2021-11-02 江西影创信息产业有限公司 MR glasses with high-precision motion tracking and positioning functions

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103118159A (en) * 2013-01-17 2013-05-22 广东欧珀移动通信有限公司 Method and device of operating mobile terminal
CN103383596A (en) * 2012-05-02 2013-11-06 Lg电子株式会社 Mobile terminal and control method thereof
CN103500061A (en) * 2013-09-26 2014-01-08 三星电子(中国)研发中心 Method and equipment for controlling displayer
CN104076512A (en) * 2013-03-25 2014-10-01 精工爱普生株式会社 Head-mounted display device and method of controlling head-mounted display device
CN104216508A (en) * 2013-05-31 2014-12-17 中国电信股份有限公司 Method and device for operating function key through eye movement tracking technique
CN104391572A (en) * 2014-11-10 2015-03-04 苏州佳世达电通有限公司 Electronic device with eyeball tracking function and control method of electronic device
CN105334961A (en) * 2015-10-27 2016-02-17 惠州Tcl移动通信有限公司 Method for controlling mobile terminal based on eyeball tracking and mobile terminal

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103383596A (en) * 2012-05-02 2013-11-06 Lg电子株式会社 Mobile terminal and control method thereof
CN103118159A (en) * 2013-01-17 2013-05-22 广东欧珀移动通信有限公司 Method and device of operating mobile terminal
CN104076512A (en) * 2013-03-25 2014-10-01 精工爱普生株式会社 Head-mounted display device and method of controlling head-mounted display device
CN104216508A (en) * 2013-05-31 2014-12-17 中国电信股份有限公司 Method and device for operating function key through eye movement tracking technique
CN103500061A (en) * 2013-09-26 2014-01-08 三星电子(中国)研发中心 Method and equipment for controlling displayer
CN104391572A (en) * 2014-11-10 2015-03-04 苏州佳世达电通有限公司 Electronic device with eyeball tracking function and control method of electronic device
CN105334961A (en) * 2015-10-27 2016-02-17 惠州Tcl移动通信有限公司 Method for controlling mobile terminal based on eyeball tracking and mobile terminal

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106448337A (en) * 2016-09-20 2017-02-22 山西省交通科学研究院 VR technology based automobile driving simulation device
CN106454098A (en) * 2016-10-31 2017-02-22 深圳晨芯时代科技有限公司 Virtual reality shooting and displaying method and system
CN106501962A (en) * 2017-01-05 2017-03-15 电子科技大学中山学院 3D display device with lens in delayed motion
CN108663806A (en) * 2017-03-31 2018-10-16 及至微机电股份有限公司 Imaing projector with pupil tracing function and its pupil position follow-up mechanism
CN107562208A (en) * 2017-09-27 2018-01-09 上海展扬通信技术有限公司 The intelligent terminal control method and intelligent terminal control system of a kind of view-based access control model
CN107943296A (en) * 2017-11-30 2018-04-20 歌尔科技有限公司 Applied to the control method and equipment in headset equipment
CN110188488A (en) * 2019-06-03 2019-08-30 中国石油大学(华东) A kind of sea bed gas hydrate is appeared and the emulation mode and system of surrounding enviroment
CN110188488B (en) * 2019-06-03 2023-04-07 中国石油大学(华东) Simulation method and system for seabed natural gas hydrate outcrop and surrounding environment
WO2021164511A1 (en) * 2020-02-20 2021-08-26 中国银联股份有限公司 Information processing method and system based on eyeball tracking, and payment processing method based on eyeball tracking
CN113589523A (en) * 2021-07-06 2021-11-02 江西影创信息产业有限公司 MR glasses with high-precision motion tracking and positioning functions

Also Published As

Publication number Publication date
CN105847538B (en) 2021-06-01

Similar Documents

Publication Publication Date Title
CN105847538A (en) Mobile phone and method for controlling operations of VR (Virtual Reality) glasses based on eyeball tracking
CN104834446B (en) A kind of display screen multi-screen control method and system based on eyeball tracking technology
CN105847540A (en) Method and mobile phone for controlling picture movement of VR (Virtual Reality) glasses based on eyeball tracking and VR glasses
CN107223223B (en) Control method and system for first-view-angle flight of unmanned aerial vehicle and intelligent glasses
JP6534292B2 (en) Head mounted display and control method of head mounted display
US20150378431A1 (en) Eye-controlled user interface
JP6452440B2 (en) Image display system, image display apparatus, image display method, and program
CN107533640A (en) Sight corrects
JP2011257682A (en) Display control program, display controller, display control method and display control system
CN103513768A (en) Control method and device based on posture changes of mobile terminal and mobile terminal
CN104375648A (en) Wrist type device and using method thereof
KR20170078488A (en) Apparatus and method for recognizing hand gestures in a virtual reality headset
CN107169309A (en) Visual field detection method, system and detection means based on wear-type detection device
CN105260697A (en) Method for preventing eye fatigue and applicable mobile device
CN109782968B (en) Interface adjusting method and terminal equipment
KR20130059827A (en) Glasses type camera using by pupil tracker
CN106292994A (en) The control method of virtual reality device, device and virtual reality device
US20160321786A1 (en) Display device and picture display method
CN106791792B (en) Adjust the method and system that VR equipment shows image
US20090245572A1 (en) Control apparatus and method
CN108549485B (en) Information processing method and wearable electronic equipment
CN110174937A (en) Watch the implementation method and device of information control operation attentively
KR20130067902A (en) Mobile communication terminal in form of spectacles
WO2023230291A2 (en) Devices, methods, and graphical user interfaces for user authentication and device management
CN115866388B (en) Intelligent glasses shooting control method and device, storage medium and electronic equipment

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right

Effective date of registration: 20220128

Address after: 518000 a501, building D4, TCL Science Park, No. 1001, Zhongshan Park Road, Shuguang community, Xili street, Nanshan District, Shenzhen, Guangdong

Patentee after: Thunderbird innovation technology (Shenzhen) Co.,Ltd.

Address before: 516006 Zhongkai hi tech Zone, Huizhou, Guangdong, 86 Chang seven Road West

Patentee before: HUIZHOU TCL MOBILE COMMUNICATION Co.,Ltd.

TR01 Transfer of patent right