CN103294180B - The method of controlling a human-machine interactive electronic terminal and - Google Patents

The method of controlling a human-machine interactive electronic terminal and Download PDF

Info

Publication number
CN103294180B
CN103294180B CN201210051834.6A CN201210051834A CN103294180B CN 103294180 B CN103294180 B CN 103294180B CN 201210051834 A CN201210051834 A CN 201210051834A CN 103294180 B CN103294180 B CN 103294180B
Authority
CN
China
Prior art keywords
operation
user
head
electronic terminal
eye
Prior art date
Application number
CN201210051834.6A
Other languages
Chinese (zh)
Other versions
CN103294180A (en
Inventor
甘大勇
Original Assignee
联想(北京)有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 联想(北京)有限公司 filed Critical 联想(北京)有限公司
Priority to CN201210051834.6A priority Critical patent/CN103294180B/en
Publication of CN103294180A publication Critical patent/CN103294180A/en
Application granted granted Critical
Publication of CN103294180B publication Critical patent/CN103294180B/en

Links

Abstract

本发明公开了一种人机交互控制方法及电子终端。 The present invention discloses a method for interactive control and an electronic terminal. 所述电子终端具有显示单元,所述方法包括:监测用户的眼动;根据所述眼动确定所述用户的视点;将所述视点确认在所述显示单元上的坐标点;识别所述用户的头部动作;根据所述头部动作对所述坐标点对应的操作对象进行相应的操作。 The electronic terminal having a display unit, the method comprising: monitoring a user's eye; the user is automatically determined based on the viewpoint of the eye; the acknowledgment viewpoint coordinate point on the display unit; identifying the user head operation; corresponding to the operation on the operation target based on the coordinate point corresponding to the head motion.

Description

一种人机交互控制方法及电子终端 The method of controlling a human-machine interactive electronic terminal and

技术领域 FIELD

[0001]本发明涉及计算机技术领域,尤其涉及一种人机交互控制方法及电子终端。 [0001] The present invention relates to computer technologies, and particularly to a control method and an electronic interactive terminal.

背景技术 Background technique

[0002]随着计算机技术的发展和消费者需求的增多,越来越多的电子产品问世,而且对这些电子产品的控制技术也越来越多,例如通过鼠标、触控板进行控制,为了更方便用户使用电子产品,现有技术中出现了眼动控制,即通过检测用户的眼动,进而确认用户的视点,并通过眨眼的动作进行确认,对于如眼镜式电子终端的电子产品而言,眼动控制是一种比较方便的控制方式,但是因为通过眨眼确认,所以控制难度比较大,效率较低,而且容易误操作。 [0002] With the increasing development of computer technology and consumer demand, more and more electronic products come out, but also more and more to control these electronic products, for example, is controlled by mouse, touch pad, in order more user-friendly electronic products, the prior art appears in the control eye, i.e. by detecting the user's eye movement, and thus confirm the user's viewpoint, and confirmed by blinking operation, for spectacle-type electronic terminal electronic products , eye movement control is a convenient way of control, but because confirmed by blinking, the control more difficult, less efficient, and easy to misuse.

发明内容 SUMMARY

[0003]本发明提供一种人机交互控制方法及电子终端,用以解决现有技术中存在的通过眨眼确认眼动控制光标输入产生的控制难度大,效率低且容易误操作,以及用户体验差的问题。 [0003] The present invention provides a method for interactive control and an electronic terminal to solve the prior art by the presence of eye blinking acknowledgment control cursor input control difficult resulting large, inefficient and easy to misuse, and user experience poor.

[0004]本发明一方面提供了一种人机交互控制方法,应用于一具有显示单元的电子终端,所述方法包括:监测用户的眼动;根据所述眼动确定所述用户的视点;将所述视点确认在所述显示单元上的坐标点;识别所述用户的头部动作;根据所述头部动作对所述坐标点对应的操作对象进行相应的操作。 [0004] In one aspect the present invention provides an interactive control method applied to an electronic terminal having a display unit, the method comprising: monitoring a user's eye; determining a viewpoint movement according to the eyes of the user; the acknowledgment viewpoint coordinate point on the display unit; identifying the head of the user operation; corresponding to the operation on the operation target based on the coordinate point corresponding to the head motion.

[0005] 优选地,在所述将所述视点确认在所述显示单元上的坐标点时,将所述显示单元上的光标移动到所述坐标点对应的位置上。 [0005] Preferably, the acknowledgment when the viewpoint coordinate points on the display unit, the cursor is moved to a position corresponding to the coordinate point on the display unit.

[0006]优选地,在所述根据所述头部动作对所述坐标点对应的操作对象进行相应的操作之前,还判断所述头部动作是否满足预定条件。 [0006] Preferably, prior to the operation on the operation corresponding to the coordinate point corresponding to the object according to the operation of the head, said head portion further determines whether the operation meets a predetermined condition.

[0007]优选地,所述根据所述眼动确定所述用户的视点具体为:计算所述用户的两只眼睛的视线的交汇点。 Computing the intersection of the line of sight of both eyes of the user: [0007] Preferably, the eye of the user is determined according to the specific viewpoint.

[0008]优选地,所述将所述视点确认在所述显示单元上的坐标点具体为:计算所述交汇点在所述显示单元上的坐标位置。 [0008] Preferably, the acknowledgment in the viewpoint coordinate point on the display unit is specifically: calculating the coordinate position of the intersection on the display unit.

[0009]优选地,所述根据所述眼动确定所述用户的视点具体为:计算所述用户的至少一个瞳孔在眼睛中的移动距离。 At least one calculated moving distance of the pupil in the eye of the user: [0009] Preferably, the eye of the user is determined according to the specific viewpoint.

[0010] 优选地,所述将所述视点确认在所述显示单元上的坐标点具体为:基于一移动距离和显示单元之间的对应关系表,及根据所述移动距离获得所述视点在所述显示单元上的坐标点。 [0010] Preferably, the acknowledgment in the viewpoint coordinate point on the display unit is as follows: based on the correspondence table between a movement distance and the display unit, and is obtained based on the moving distance of the viewpoint coordinate points on the display unit.

[0011]优选地,所述电子终端还包括结构部件、眼动监测部件和传感器,所述结构部件用于将所述电子终端佩戴于所述用户的身体上,所述眼动监测部件位于所述结构部件上,当所述电子终端佩戴于所述用户的身体上时,所述监测用户的眼动具体为:通过所述眼动监测部件监测所述用户的眼动。 [0011] Preferably, the electronic terminal further comprises a structural member, and means to monitor eye movement sensor, said structural member for electronic terminal worn on the body of the user, said eye-monitoring means located in the the above-described structural components, the electronic terminal when worn on the user's body, to monitor the user's eye is specifically: the eye by said monitoring means monitoring the user's eye.

[0012]优选地,所述传感器位于所述结构部件上,所述识别所述用户的头部动作具体为:通过所述传感器识别所述用户的头部动作。 [0012] Preferably, the sensor is located on the structural member, the head of the user to identify particular action: action recognition by the sensor head of the user.

[0013]优选地,所述电子终端还包括按键,在所述根据所述头部动作对所述坐标点对应的操作对象进行相应的操作之前,还判断所述按键是否被按下,如果是,则根据所述头部动作和所述按键被按下的状态对所述坐标点对应的操作对象进行相应的操作。 [0013] Preferably, the terminal further includes an electronic key, prior to the operation on the operation corresponding to the coordinate point corresponding to the object according to the operation of the head, further determining whether the key is pressed, if , a corresponding operation is performed on the operation target in accordance with the coordinate point corresponding to the head of the key is pressed and the operation state.

[0014]本发明另一方面还提供一种电子终端,包括:显示单元;眼动监测部件,用于监测所述用户的眼动;处理单元,用于根据所述眼动确定所述用户的视点,并将所述视点确认在所述显示单元上的坐标点;头部动作识别部件,用于识别所述用户的头部动作;以及,控制单元,用于根据所述头部动作对所述坐标点对应的操作对象进行相应的操作。 [0014] In another aspect of the present invention further provides an electronic terminal, comprising: a display unit; eye movement monitoring means for monitoring the user's eye; a processing unit for determining the user according to the movement of the eye viewpoint, and the viewpoint coordinate point confirmed on the display unit; head motion recognition means for recognizing the user's head movements; and a control unit for the operation of the head said coordinate point corresponding to the operation target corresponding operation.

[0015]优选地,所述电子终端为眼镜式电子终端,所述终端还包括结构部件,用于将所述电子终端佩戴于用户的身体上。 [0015] Preferably, the electronic terminal is a glasses-type electronic terminal, the terminal further comprises a structural member for the electronic terminal is worn on the user's body.

[0016]优选地,所述眼动监测部件位于所述结构部件上。 [0016] Preferably, said monitoring means positioned on the eye of the structural member.

[0017]优选地,所述头部动作识别部件位于所述结构部件上。 [0017] Preferably, the operation of the head member positioned on the structure identification member.

[0018]优选地,所述眼动监测部件为摄像头。 [0018] Preferably, the eye member is a monitoring camera.

[0019]优选地,所述头部动作识别部件为摄像头或重力传感器。 [0019] Preferably, the head identification operation member is a gravity sensor or a camera.

[0020]优选地,所述电子终端还包括按键,所述控制单元在根据所述头部动作对所述坐标点对应的操作对象进行相应的操作之前,所述控制单元还判断所述按键是否被按下,如果是,所述控制单元则根据所述头部动作和所述按键被按下的状态对所述坐标点对应的操作对象进行相应的操作。 [0020] Preferably, the terminal further includes an electronic key, the control unit prior to the operation target of the operation corresponding to the coordinate point corresponding to the head according to the operation, the control unit further determines whether or not the key it is depressed, and if so, the control unit of the operation corresponding to the operation target based on the coordinate point corresponding to the head portion and the operation state of a key is pressed.

[0021]优选地,所述电子终端还包括判断单元,用于判断所述头部动作识别部件识别的所述头部动作是否满足预定条件,如果是,则所述控制单元根据所述头部动作对所述坐标点对应的操作对象进行相应的操作。 [0021] Preferably, the electronic terminal further comprises judging means for determining whether the operation of the head head motion recognizing unit satisfies a predetermined condition, if so, the control unit according to the head operation of the operation target coordinate point corresponding to the corresponding operation.

[0022]本发明有益效果如下: [0022] Advantageous effects of the present invention are as follows:

[0023] 本发明一实施例通过监测用户的眼动,进而确定用户的视点在显示单元上的位置,然后通过用户的头部动作触发对视点选中的操作对象的相应操作,该技术方案触发确认是通过头部动作,所以容易控制,效率高,不容易误操作。 [0023] Example embodiment of the present invention a user by monitoring the eye, and to determine the viewpoint position of the user on the display unit, and then trigger the operation of the operation target viewpoint selected by a user's head movements, this solution confirm the trigger by head movements, it is easy to control, high efficiency, is not easy to misuse.

[0024]进一步,本发明一实施例中还判断头部动作是否满足预定条件,如果满足,才对相应操作对象进行操作,如果不满足,则不操作,所以可以进一步提高控制效率,避免了误操作。 [0024] Further, a further embodiment of the present invention determines the operation of the head satisfies a predetermined condition, if so, the corresponding operation target operating fishes, if not, no operation, it is possible to further improve the control efficiency, avoid erroneous operating.

[0025]更进一步,本发明一实施例中还提供了按键,结合手指按压按键的状态和头部动作一起触发相应的操作,如此可以增加头部动作所对应的操作,所以使得操作更加丰富,更方便控制电子终端。 [0025] Still further, the present invention further provides an embodiment of a key, the keys in conjunction with the pressing finger state and head movements with trigger corresponding actions, which may increase the operation corresponding to the operation of the head, so making the operation more abundant, electronic control terminal more convenient.

[0026]再进一步,本发明一实施例中在眼镜式电子终端上集合了眼动监测部件和传感器,所以当用户戴上眼镜式电子终端时,眼动监测部件可以监测用户的眼动,传感器可以感知用户的头部动作,所以用户可以很方便的控制和操作该眼镜式电子终端。 [0026] Still further, the present invention is an embodiment of a set of eye movement monitoring sensor member and the spectacles-type electronic terminal when the electronic terminal user wear glasses, eye movement monitoring means may monitor the user's eye movement sensor can be perceived by the user's head movements, the user can easily control and operation of the spectacle-type electronic terminal.

附图说明 BRIEF DESCRIPTION

[0027]图1为本发明一实施例中的人机交互控制方法的流程图; [0027] FIG. 1 is a flowchart of a method of interactive control of a man-machine embodiment embodiment of the invention;

[0028]图2为本发明第一实施例中的电子终端的功能框图; [0028] Figure 2 a functional block diagram of the electronic terminal according to a first embodiment of the present invention;

[0029]图3为本发明一实施例中的眼镜式电子终端的结构图; [0029] Fig 3 block diagram of the glasses-type electronic terminal according to an embodiment of the present invention;

[0030]图4为本发明一实施例中眼镜式电子终端的功能框图; [0030] FIG 4 functional block diagram of a glasses-type electronic apparatus of the present embodiment of the invention;

[0031]图5A-图5B为本发明一实施例中放大图像的原理图。 [0031] FIG. 5A- FIG. 5B present schematic enlarged image of an embodiment of the invention embodiment.

具体实施方式 Detailed ways

[O O3 2 ] 本发明一实施例提供一种人机交互控制方法,应用于一电子终端,该电子终端例如为手机、、笔记本电脑、平板电脑、眼镜式电子终端或掌上游戏机或其他电子终端。 [O O3 2] an embodiment of the present invention provides an interactive control method applied to an electronic terminal, the electronic terminal, for example ,, mobile phones laptop computers, tablet computers, electronic eyewear terminal or handheld games or other electronic terminal. 该电子终端包括一显示单元,请参考图1,图1为本实施例中人机交互控制方法的流程图,该方法包括: The electronic terminal comprises a display unit, refer to FIG. 1, FIG. 1 is a flowchart example of interactive control method of the present embodiment, the method comprising:

[0033]步骤101:监测用户的眼动; [0033] Step 101: the user's eye movement monitoring;

[0034]步骤102:根据眼动确定用户的视点; [0034] Step 102: the eye is determined according to the user's viewpoint;

[0035] 步骤103:将视点确认在显示单元上的坐标点; [0035] Step 103: Confirm the viewpoint coordinate point on the display unit;

[0036]步骤104:识别用户的头部动作; [0036] Step 104: identifying the user's head movements;

[0037]步骤105:根据头部动作对坐标点对应的操作对象进行相应的操作。 [0037] Step 105: the operation corresponding to the coordinate point corresponding to the operation target in accordance with the operation of the head.

[0038]在步骤102中,根据眼动确定用户的视点,具体有但不限于以下两种:第一种,当步骤101中监测到用户的眼动了,则计算用户的两只眼睛的视线的交汇点,该交汇点则确定为用户的视点;第二种,当步骤101中监测到用户的眼动了,可以只监测用户的一只眼睛的瞳孔相对前一次在眼睛中的位置的变化,例如计算瞳孔移动的距离,进一步可以监测瞳孔移动的方向,确定瞳孔移动的距离和/或瞳孔移动的方向即为确定用户的视点,当然,在其他实施例中,也可以监测两个瞳孔位置的变化,也可以采用其他方法确认视点,本发明不作限制。 [0038] In step 102, the eye is determined according to the user's viewpoint, specifically but not limited to the following two: first, when the monitoring step 101 to the user's eye, the line of sight of two eyes of the user is calculated intersection, the intersection is determined as the viewpoint of the user; the second, when the monitoring step 101 to the user's eye, the change can be monitored only in a position opposite the front eye pupil of an eye of a user , such as calculating the distance of movement of the pupil, the pupil may further monitor the direction of movement, is determined from the movement of the pupil and / or direction of movement of the pupil is the viewpoint of the user is determined, of course, in other embodiments, two pupil position may be monitored changes, other methods may be used to confirm the viewpoint, the present invention is not limited.

[0039]进一步,在第一种情况下,步骤103的实施具体为:将步骤102确认出的交汇点在显示单元上的坐标位置确认出来,所以即可确定出视点所选中的操作对象。 [0039] Further, in the first case, the embodiment of step 103 specifically is: step 102 confirmed the intersection coordinate position on the display unit out of the confirmation, the operation target can be determined so that the selected viewpoint. 在第二种情况下,步骤103的实施具体为:在步骤102中已确定出瞳孔的移动距离和/或瞳孔移动的方向,所以可以通过查表的形式获得视点在显示单元上的坐标点,即瞳孔移动距离和/或瞳孔移动方向和显示单元之间具有对应关系,然后将这种对应关系制成一个查询表,可以保存在电子终端中,当确定出瞳孔移动距离和/或瞳孔移动方向时,即可查询此表,就可得知视点在显示单元上的坐标点。 In the second case, the implementation of step 103 specifically is: the direction of movement is determined from the pupil and / or pupil at step 102 the mobile, can be obtained in the viewpoint coordinate point on the display unit in the form of look-up table, i.e., the pupil has a correspondence relation between the moving distance and / or direction of movement of the pupil and the display unit, then a query is made of this correspondence table may be stored in an electronic terminal, when it is determined that the pupil movement distance and / or direction of movement of the pupil when, to query this table, you can know the view point coordinates on the display unit.

[0040]进一步,为了更人性化的操作电子终端,实现对电子终端的眼动控制,在步骤103,将视点确认在显示单元上的坐标点时,还将显示单元上的光标移动到坐标点对应的位置上,用户可以有光标随着眼动而动的感觉,所以用户体验好。 [0040] Further, in order to more user-friendly operation of electronic terminals, electronic control of the eye of the terminal, at step 103, the viewpoint confirmed at the coordinate points on the display unit, the cursor moves to the cell coordinate point also show corresponding to the position, the user can have the feeling of moving the cursor with eye movements, so the user experience is good.

[0041]在步骤104中,可以通过重力传感器或者摄像头识别用户的头部动作,这些动作对应不同的指令,而不同的指令可以实现不同的操作,例如当步骤103中确定出的坐标点对应的是一个窗口的关闭按钮,这时用户的头部动作为点头,则表示确认,所以就会产生一指令,关闭了该窗口(即执行步骤105),即例如是单击鼠标左键的功能。 [0041] In step 104, by a gravity sensor or head motion camera identifying the user, these actions correspond to different instructions, but different instructions may implement different operations, for example, when the step 103 determines the coordinate point corresponding to is a close button of the window, then the user is nodding head motion, said acknowledgment, so that a command is generated to close the window (i.e., step 105), i.e., for example, left-click function. 再例如,当识别出用户的头部动作是向左转头,则坐标点对应的操作对象就会被执行返回操作;当识别出用户的头部动作是向上仰头,则坐标点对应的操作对象就会被执行出菜单的操作;当识别出用户的头部动作是向前倾,则坐标点对应的操作对象就会被放大;当识别出用户的头部动作是向后倾,则坐标点对应的操作对象就会被缩小。 For another example, when recognizing the user's head movements is turned to the left, the operation target point corresponding to coordinate the returning operation is executed; when recognizing the user's head motion is upward, upward, then the operation coordinate corresponding to the point the object is executed an operation menu; when recognizing the user's head is leaning forward operation, the operation point corresponding to the coordinates of the object will be amplified; when recognizing the user's head is thrown back operation, the coordinates point corresponding to the operation target will be reduced. 在本实施例中,头部动作和对应的操作也可以制作成表,当识别出头部动作,就进行查表,就可查到头部动作对应的操作。 In the present embodiment, head movement and the corresponding operations may also be made into a table, head movement when it is recognized, on the look-up table, can be found in the head of an operation corresponding to the operation.

[0042]为了进一步增加头部动作的数量,进而增加操作的数量,可在电子终端上设置按键,例如是触摸按键或者是实体按键,用户可以结合手指按压按键的状态和头部动作一起触发相应的操作。 [0042] In order to further increase the number of head movements, thereby increasing the number of operation buttons may be provided on the electronic terminal, for example, physical keys or touch keys, the user may press the keys in conjunction with the state of the finger and trigger the corresponding head movements with operation. 所以在执行步骤105之前,还判断按键是否被按下,例如当判断结果为用户单指按压按键时,而且步骤104识别出用户的头部动作为上下摆头,则坐标点对应的操作对象被执行上下滚屏的操作;如果步骤104识别出用户的头部动作为左右摆头,则坐标点对应的操作对象被执行左右滚屏的操作。 Therefore, before performing step 105, further determines whether a key is pressed, for example when the judgment result of the user pressing a single button means, and step 104 identifies the user's head movements up and down swing, the point corresponding to the operation target coordinates are perform scroll up and down operations; if step 104 identifies the user's head movements about swing, the coordinate point corresponding to the operation target around scrolling operation is performed. 当判断结果为用户两指按下按键时,而且步骤104识别出用户的头部动作为左右摆头时,则坐标点对应的操作对象被执行翻页的操作。 When the determination result of the user pressing the button with two fingers, and step 104 identifies the user's head movements about swing, the coordinate point corresponding to the operation target page turning operation is performed. 当然,在其他实施例中,也可以是其他数量的手指按下按键,配合头部动作实现更多的操作。 Of course, in other embodiments, but it may be other numbers of fingers pressing the button, with the head movement operation to achieve more.

[0043]进一步,用户可以结合手指按压按键的状态和眼动对电子终端进行控制,例如,当用户三指按下按键时,且瞳孔从左往右移动时,可生成将坐标点对应的操作对象(例如图标或者窗口)从左往右移动的指令,使得图标或者窗口的位置从左往右移动;在另一实施例中,例如当三指按下按键时,转动瞳孔可以实现圈选的特殊操作。 [0043] Further, the user may press the keys in conjunction with the state of the finger and eye movement control of the electronic terminal, e.g., three fingers when the user presses the button, and moves from left to right pupil, can generate a coordinate point corresponding to the operation an object (e.g., an icon or window) instruction moves from left to right, so that the position of the icon or window is moved from left to right; in another embodiment, for example when the key is pressed three fingers, the rotation of the pupil can be achieved circled special operations. 当然,在其他实施例中,也可以是其他数量的手指按下按键,配合眼动实现更多的操作。 Of course, in other embodiments, but it may be other numbers of fingers pressing the button, with the eye to achieve more operation.

[0044]为了更准确的控制电子终端,避免误操作,在步骤105之前还判断头部动作是否满足预定条件,例如判断向左转头的头部动作是否转动超过10度,头部动作为向前倾是不是超过20度等,只有当满足预定条件时,才执行步骤105。 [0044] For a more accurate control of the electronic terminal, to avoid misuse, prior to the step 105 further determines whether the operation of the head satisfies a predetermined condition, for example determining whether left rotation operation of the head turned more than 10 degrees, the operation of the head is not more than 20 degrees forward, etc., only when a predetermined condition is satisfied, it executes step 105.

[0045]在另一实施例中,电子终端例如是眼镜式电子终端,电子终端包括结构部件,眼动监测部件和传感器,结构部件例如为镜架,用于将电子终端佩戴于用户的身体上,眼动监测部件可位于结构部件上,当电子终端佩戴于用户的身体上,通过眼动监测部件监测用户的眼动,进一步,传感器也可位于结构部件上,例如是重力传感器,通过传感器可以识别用户的头部动作。 [0045] In another embodiment, the electronic terminal, for example, a glasses-type electronic terminal, the terminal including an electronic structural component, and eye movement monitoring sensor member, for example, the frame structure member for electronic terminal worn on the user's body , eye movement monitoring means may be located on the structural component, when the electronic terminal worn on the user's body, the eye via eye movement monitoring means to monitor a user's motion, further, the sensor may be positioned on the structural member, for example, a gravity sensor, the sensor may identify the user's head movements. 因此,当用户将电子终端佩戴在身体上时,可方便的通过眼动和头部动作,进一步还可以通过按键结合来控制电子终端,控制效率高,不容易误操作。 Thus, when a user holds the electronic terminal is worn on the body, can easily by eye and head movements, can also be further controlled by electronic terminal binding key, the control efficiency is high, not easy to misuse.

[0046]以上各实施例中的控制方法可以单独使用,也可结合使用,本领域技术人员可根据实际情况设置。 [0046] The control method according to the above embodiments may be used alone or in combination, may be disposed skilled in the art according to the actual situation.

[0047]本发明另一实施例中还提供一种电子终端,请参考图2,该电子终端包括:显示单元201;眼动监测部件202,用于监测用户的眼动;处理单元203,用于根据眼动确定用户的视点,并将视点确认在显示单元201上的坐标点;头部动作识别部件204,用于识别用户的头部动作;以及,控制单元205,用于根据头部动作对坐标点对应的操作对象进行相应的操作。 [0047] Another embodiment of the present invention further provides an electronic terminal, refer to Figure 2, the electronic terminal comprising: a display unit 201; eye movement monitoring means 202 for monitoring the user's eye; processing unit 203, with the eye to determine the user's viewpoint, and the viewpoint confirmed on the display unit 201 coordinate points; head motion recognizing means 204 for recognizing the user's head movements; and a control unit 205, according to the operation of the head operation target coordinate point corresponding to the corresponding operation.

[0048] 其中,眼动监测部件202例如为摄像头,处理单元203和控制单元205可以是独立的单元也可以是同一个单元,头部动作识别部件204例如也可以是摄像头。 [0048] wherein, eye movement monitoring member 202, for example, a camera, a processing unit 203 and the control unit 205 may be a separate unit or may be a single unit, the head identification operation member 204 may be, for example, a camera.

[0049]进一步,电子终端例如是眼镜式电子终端,请参考图3,眼镜式电子终端包括结构部件300,结构部件包括鼻托301和耳架302,用于将该电子终端佩戴于用户的身体上;眼动监测部件202可位于结构部300上,例如位于鼻托301处,也可以位于显示单元201上,只要能监测到用户的眼动即可。 [0049] Further, for example, a glasses-type electronic terminal electronic terminal, please refer to FIG. 3, glasses-type electronic terminal 300 comprises a structural member, the structural member comprises a nose support frame 301 and ear 302, to the electronic terminal worn on the user's body on; eye movement monitoring member 202 may be positioned on the structure 300, for example, positioned at the nose pad 301 may be located on the display unit 201, as long as the user can detect the movement of the eye can. 当电子终端佩戴于用户的身体上,通过眼动监测部件202监测用户的眼动,进一步,头部动作识别部件204也可位于结构部件300上,例如是耳架302上,当然也可以位于鼻托301上,只要头部动作识别部件204可以接触到用户的头部并能识别头部动作即可;头部识别部件204例如是重力传感器,通过重力传感器可以识别用户的头部动作。 When the electronic terminal worn on the user's body, through the eye eye monitor 202 monitors the user's member, further, the operation of identifying the head member 204 may also be located on the structural member 300, for example, a frame 302 on the ear, of course, also be located in the nose the holder 301, recognition means 204 as long as the operation of the head may contact the user's head and can recognize the operation of the head; a head member 204, for example, identifying a gravity sensor, may be identified by the user's head movements gravity sensor. 因此,当用户将电子终端佩戴在身体上时,可方便的通过眼动和头部动作对电子终端进行控制,控制效率高,不容易误操作。 Thus, when a user holds the electronic terminal is worn on the body, can be easily carried out by eye and head movements of the electronic terminal control, high control efficiency is not easy to misuse.

[0050]在本实施例中,显示单元201例如是眼镜式电子终端的镜片本身,所以用户可以观看眼镜式电子终端的镜片上的内容,但是用户也可以观看显示在虚拟的显示空间中的内容,这样,显示的内容离用户眼睛有一定距离,所以用户看起来会更舒服,在下文中,将参考附图详细描述本发明的优选实施例。 [0050] In the present embodiment, the display unit 201, for example, a lens glasses-type electronic terminal itself, the user can view the content on the lens eyeglasses electronic terminal, but the user may be content in the virtual display space is viewing the display so that the content displayed from the user's eyes at a distance, the user will look more comfortable, in the following, with reference to a preferred embodiment of the present invention is described in detail with accompanying drawings. 注意,在本说明书和附图中,具有基本上相同步骤和元素用相同的附图标记来表示,且对这些步骤和元素的重复解释将被省略。 Note that, in this specification and the drawings, elements having substantially the same step and are denoted by the same reference numerals, and repeated explanation will be omitted these steps and elements.

[0051] 如图4所示,眼镜式电子终端还包括图像处理单元410、第一光学系统430和第一视窗440。 As shown in [0051] FIG. 4, a glasses-type electronic terminal further includes an image processing unit 410, a first optical system 430 and a first window 440. 图像处理单元410可提供第一图像。 The image processing unit 410 may provide a first image. 第一图像可以是,例如,图片、视频图像或者文本,图片,文本和图片的组合等。 The first image may be, for example, images, video images or text, image, text, pictures and the like, and combinations. 图像处理单元410可以是眼镜式电子终端的中央处理单元(例如CPU),可替换地,也可以是在物理或逻辑上独立设置的图像处理单元。 The image processing unit 410 may be a central processing unit (e.g. CPU) glasses-type electronic terminal, alternatively, may be an image processing on a physical or logical unit provided independently.

[0052] 显示单元201可显示图像处理单元410提供的第一图像。 [0052] The display unit 201 may display a first image processing unit 410 is provided. 根据本发明的一个示例,显示单元201可以是其屏幕的尺寸小于现有电子终端的屏幕的尺寸的微型显示单元。 According to one example of the present invention, the display unit 201 may be smaller than the size of the screen size of the screen of the conventional miniature electronic terminal display unit. 在本发明的实施例中,显示单元201的尺寸为与该眼镜式电子终端的镜片尺寸一致。 In an embodiment of the present invention, the size of the display unit 201 to coincide with the size of the eyeglass lens electronic terminal. 该镜片与人眼的标准尺寸相符。 The human eye lens is consistent with standard size. 此外,根据本发明的另一实施例,显示单元201具有较高的分辨率。 Further, according to another embodiment of the present invention, the display unit 201 having a higher resolution. 具体地,显示单元201的屏幕的分辨率可高于现有电子终端的屏幕的分辨率。 In particular, the screen resolution of the display unit 201 may be higher than the resolution of the screen of a conventional electronic terminal. 例如,显示单元201可采用符合高清或全高清标准的分辨率。 For example, the display 201 may be used in line with the resolution of high-definition or standard definition full unit.

[0053]第一光学系统430可接收从显示单元201发出的光线,并对从显示单元201发出的光线进行光路转换,以形成第一放大虚像,其中第一光学系统430与显示单元201之间的光路的长度小于第一光学系统的焦距。 [0053] The first optical system 430 may receive light emitted from the display unit 201, and converts light from the optical path emitted from the display unit 201, to form a first enlarged virtual image, wherein between the first optical system 430 and the display unit 201 the optical path length of less than the focal length of the first optical system. 也就是说,第一光学系统430具有正屈光力。 That is, the first optical system 430 having a positive refractive power. 可预先设定第一光学系统430的放大倍数。 Magnification can be set in advance of the first optical system 430. 可替换地,第一光学系统430可包括第一调节部件以调整第一光学系统430的放大倍数,稍后将对此进行详细描述。 Alternatively, the first optical system 430 may comprise a first adjustable member to adjust the magnification of the first optical system 430 will be described in detail later. 第一放大虚像的面积大于第一显示单元的显示区域的面积。 A first enlarged virtual image is larger than the area of ​​the display region of the first display unit.

[0054]根据本发明的一个示例,第一光学系统430至少包括具有正屈光力的透镜组件。 [0054] According to an example of the present invention, comprises at least a first optical system 430 having a positive refractive power of the lens assembly. 图5A是示出根据本发明的一个示例的透镜组件的示意图。 FIG 5A is a diagram illustrating an example of a lens assembly according to the invention. 如图5A所示,透镜组件可包括一个凸透镜510。 As shown in FIG. 5A lens assembly 510 may include a convex lens. 凸透镜510可接收从显示单元201发出的光线,并对从显示单元201发出的光线进行光路转换,以形成第一放大虚像520。 Lens 510 may receive light emitted from the display unit 201, and converts light from the optical path emitted from the display unit 201, first to form an enlarged virtual image 520.

[0055]虽然在图5A中以一条光线为例描述了对从显示单元201发出的光线进行的光路转换,但是应注意实际上从显示单元201发出的为由多条光线构成的一组光线,并且该组光线通过凸透镜510进行光路转换,以形成第一放大虚像520。 [0055] Although an example in FIG. 5A a ray described light rays emitted from the display unit 201 for converting optical path, it should be noted that a set of light rays actually constituted by a plurality of light emitted from the display unit 201, and the set of light through the optical path conversion lens 510 to form a first enlarged virtual image 520.

[0056]此外,为了减少像差、避免色散等对成像造成的干扰,带给用户更好的视觉体验,也可由包含凸透镜和凹透镜的多个透镜形成透镜组件。 [0056] Further, in order to reduce aberrations, to avoid interference caused by dispersion, imaging, a better user viewing experience, comprising a plurality of lenses may also be formed of convex and concave lens assembly. 如上所述,该多个透镜形成透镜组件具有正屈光力,即,可等效为凸透镜。 As described above, the plurality of lenses forming a lens assembly having a positive refractive power, i.e., may be equivalent to a convex lens. 图5B是示出根据本发明的另一示例的透镜组件的示意图。 FIG 5B is a diagram showing another example of a lens assembly according to the invention. 如图5B所示,透镜组件可包括单凸透镜520、单凸透镜530和凹凸镜540。 As shown in FIG. 5B lens assembly 520 may comprise a single lens, single lens 530 and convex mirror 540.

[0057]图像处理单元410、显示单元201和第一光学系统430可设置在眼镜式电子终端的内部。 [0057] The image processing unit 410, display unit 201 and the first optical system 430 may be disposed inside the eyeglass-type electronic terminal. 第一视窗440可是设置在眼镜式电子终端的第一外表面上,当用户佩戴上所述眼镜式电子终端时,第一视窗440正对着用户的眼睛。 However, first window 440 disposed on the outer surface of the first glasses-type electronic terminal, when the user wears the glasses-type electronic terminal, a first window 440 facing the user's eyes. 用户能够通过第一光学系统430观看到第一放大虚像520。 User can view the enlarged virtual image of the first 520 of the first optical system 430. 根据本发明的一个示例,第一视窗440的大小可与人眼的大小相对应,优选的,第一视窗440可以与眼镜式电子终端的镜片大小一致。 According to one example of the present invention, a first window size 440 may correspond to the size of the human eye, preferably, a first window 440 may be consistent with a glasses-type lens size electronic terminal.

[0058]根据本发明的一个示例,在眼镜式电子终端中,显示单元201设置在第一光学系统430的一侧,第一光学系统430允许用户在与显示单元201相对的、该第一光学系统430的另一侧,观看第一放大虚像520。 [0058] According to an example of the present invention, the glasses-type electronic terminal, the display unit 201 is provided at a side of the first optical system 430, a first optical system 430 allows a user 201 in the display unit opposite the first optical the other side of the system 430, a first view an enlarged virtual image 520.

[0059]通过上述本发明实施例提供的眼镜式电子终端,用户可观看的图像尺寸不受眼镜式电子终端自身镜片(即屏幕)尺寸的限制,用户可通过该眼镜式电子终端观看到具有较大尺寸的显示图像。 [0059] The glasses-type electronic terminal provided by the embodiment of the present invention, the user can view the image size is not limited lens glasses-type electronic terminal itself (i.e., screen) size, the user can view through the glasses having relatively electron-terminal large size display image. 换句话说,当用户佩戴上该眼镜式电子终端时,看到显示图像的尺寸比所述眼镜式电子终端的镜片(即,屏幕)的尺寸大,同时看到的显示图像的距离大于人眼到镜片(佩戴上该眼镜式电子终端)的距离。 In other words, when the user wears the glasses-type electronic terminal, see a large display image than the lens (i.e., screen) of the spectacle-type electronic terminal size, the display image while the distance is greater than the human eye can see the lens (glasses-type worn on the electronic terminal) distance.

[0060]进一步,电子终端还包括按键,可以是触摸按键也可以是实体按键,用户可以结合手指按压按键的状态和头部动作一起触发相应的操作。 [0060] Further, the terminal further includes an electronic key, it may be a touch keys may be physical keys, the user may press the keys in conjunction with the state of the finger and a head portion with an operation trigger corresponding actions. 所以控制单元205在根据头部动作对坐标点对应的操作对象进行相应操作之前,还判断按键是否被按下,如果是,则控制单元205根据头部动作和按键被按下的状态对该操作对象进行相应的操作。 Therefore, the control unit 205 prior to the operation on the operation target in accordance with the coordinate point corresponding to head movements, further determines whether the key has been pressed, and if so, the head 205 according to the operation key is pressed and the operation state, the control unit object corresponding operation. 因此,增加了头部动作的数量,进而增加了操作的数量。 Thus, increasing the number of head movements, thereby increasing the number of operations.

[0061]在另一实施例中,电子终端还包括判断单元,用于判断头部动作识别部件识别的头部动作是否满足预定条件,如果是,则控制单元205根据头部动作对坐标点对应的操作对象进行相应的操作,例如判断向左转头的头部动作是否转动超过10度,头部动作为向前倾是不是超过20度等,所以可以更准备的控制电子终端,避免误操作。 [0061] In another embodiment, the electronic terminal further includes determining means for determining whether operation of the head of head movement recognizing unit satisfies a predetermined condition, if so, unit 205 according to the coordinate point corresponding to the operation of the control head the operation target corresponding operation, for example, determine whether the operation of the left rotor head is rotated over 10 degrees, the operation of the forward head portion is not more than 20 degrees and the like, can be also prepared control electronic terminal, to avoid misuse .

[0062]本实施例中的电子终端和前述实施例中的人机交互控制方法是基于同一构思下的发明,通过前述对第一实施例中人机交互控制方法及其各种变化形式的详细描述,本领域技术人员可以清楚的了解本实施例中电子终端的实施过程,所以为了说明书的简洁,在此不再赘述。 [0062] Examples of the present embodiment and the preceding embodiment electronic terminal interactive control method according to the invention is based on the same concept, for example by the aforementioned detailed interactive control method of the first embodiment and its various variations of description, those skilled in the art can clearly understand the embodiments of the process in an electronic terminal according to the present embodiment, the description for brevity, are not repeated herein.

[0063]通过本发明中的上述实施例中的一个实施例或多个实施例,至少可以实现如下技术效果: [0063] The embodiment of the present invention by the above-described embodiment one or more embodiments embodiment, at least the following technical effects can be achieved:

[0064] 本发明一实施例通过监测用户的眼动,进而确定用户的视点在显示单元上的位置,然后通过用户的头部动作触发对视点选中的操作对象的相应操作,该技术方案触发确认是通过头部动作,所以容易控制,效率高,不容易误操作。 [0064] Example embodiment of the present invention a user by monitoring the eye, and to determine the viewpoint position of the user on the display unit, and then trigger the operation of the operation target viewpoint selected by a user's head movements, this solution confirm the trigger by head movements, it is easy to control, high efficiency, is not easy to misuse.

[0065]进一步,本发明一实施例中还判断头部动作是否满足预定条件,如果满足,才对相应操作对象进行操作,如果不满足,则不操作,所以可以进一步提高控制效率,避免了误操作。 [0065] Further, a further embodiment of the present invention determines the operation of the head satisfies a predetermined condition, if so, the corresponding operation target operating fishes, if not, no operation, it is possible to further improve the control efficiency, avoid erroneous operating.

[0066]更进一步,本发明一实施例中还提供了按键,结合手指按压按键的状态和头部动作一起触发相应的操作,如此可以增加头部动作所对应的操作,所以使得操作更加丰富,更方便控制电子终端。 [0066] Still further, the present invention further provides an embodiment of a key, the keys in conjunction with the pressing finger state and head movements with trigger corresponding actions, which may increase the operation corresponding to the operation of the head, so making the operation more abundant, electronic control terminal more convenient.

[0067]再进一步,本发明一实施例中在眼镜式电子终端上集合了眼动监测部件和传感器,所以当用户戴上眼镜式电子终端时,眼动监测部件可以监测用户的眼动,传感器可以感知用户的头部动作,所以用户可以很方便的控制和操作该眼镜式电子终端。 [0067] Still further, the present invention is an embodiment of a set of eye movement monitoring sensor member and the spectacles-type electronic terminal when the electronic terminal user wear glasses, eye movement monitoring means may monitor the user's eye movement sensor can be perceived by the user's head movements, the user can easily control and operation of the spectacle-type electronic terminal.

[0068]显然,本领域的技术人员可以对本发明进行各种改动和变型而不脱离本发明的精神和范围。 [0068] Obviously, those skilled in the art can make various modifications and variations to the invention without departing from the spirit and scope of the invention. 这样,倘若本发明的这些修改和变型属于本发明权利要求及其等同技术的范围之内,则本发明也意图包含这些改动和变型在内。 Thus, if these modifications and variations of the present invention fall within the claims of the invention and the scope of equivalents thereof, the present invention intends to include these modifications and variations.

Claims (16)

1.一种人机交互控制方法,应用于一具有显示单元的电子终端,其特征在于,所述方法包括: 监测用户的眼动; 根据所述眼动确定所述用户的视点; 将所述视点确认在所述显示单元上的坐标点; 识别所述用户的头部动作; 根据所述头部动作对所述坐标点对应的操作对象进行相应的操作; 其中,所述电子终端还包括按键,在所述根据所述头部动作对所述坐标点对应的操作对象进行相应的操作之前,还判断所述按键是否被按下,如果是,则根据所述头部动作和所述按键被按下的状态对所述坐标点对应的操作对象进行相应的操作。 An interactive control method applied to an electronic terminal having a display unit, wherein, said method comprising: monitoring a user's eye; the user is automatically determined based on the viewpoint of the eye; the confirm the viewpoint coordinate point on the display unit; identifying the head of the user operation; corresponding to the operation on the operation target based on the coordinate point corresponding to head movements; wherein said electronic terminal further comprises a key , prior to the operation on the operation corresponding to the coordinate point corresponding to the object according to the operation of the head, further determining whether the key has been pressed, and if yes, according to the head and the operation keys are pushed state of the operation target coordinate point corresponding to the corresponding operation.
2.如权利要求1所述的方法,其特征在于,在所述将所述视点确认在所述显示单元上的坐标点时,将所述显示单元上的光标移动到所述坐标点对应的位置上。 2. The method according to claim 1, wherein, in said acknowledgment when the viewpoint coordinate points on the display unit, the display of the cursor on the coordinate point corresponding to the unit position.
3.如权利要求1所述的方法,其特征在于,在所述根据所述头部动作对所述坐标点对应的操作对象进行相应的操作之前,还判断所述头部动作是否满足预定条件。 3. The method according to previous claim 1, characterized in that, corresponding to the operation on the operation target coordinate point corresponding to the operation according to the head, the head portion further determines whether the operation meets a predetermined condition .
4.如权利要求1所述的方法,其特征在于,所述根据所述眼动确定所述用户的视点具体为:计算所述用户的两只眼睛的视线的交汇点。 4. The method according to claim 1, wherein said determination of said eye based on the viewpoint of the user specifically is: calculating the intersection point of the line of sight of both eyes of the user.
5.如权利要求4所述的方法,其特征在于,所述将所述视点确认在所述显示单元上的坐标点具体为:计算所述交汇点在所述显示单元上的坐标位置。 5. The method according to claim 4, wherein said acknowledgment of said viewpoint coordinate point on the display unit is specifically: calculating the coordinate position of the intersection on the display unit.
6.如权利要求1所述的方法,其特征在于,所述根据所述眼动确定所述用户的视点具体为:计算所述用户的至少一个瞳孔在眼睛中的移动距离。 6. The method according to claim 1, wherein said determination of said eye based on the viewpoint of the user specifically is: the at least one calculated moving distance of the pupil in the eye of the user.
7.如权利要求6所述的方法,其特征在于,所述将所述视点确认在所述显示单元上的坐标点具体为:基于一移动距离和显示单元之间的对应关系表,及根据所述移动距离获得所述视点在所述显示单元上的坐标点。 7. The method according to claim 6, wherein said acknowledgment of said viewpoint coordinate point on the display unit specifically comprises: a correspondence table based on a moving distance between the display unit and in accordance with the moving distance of the viewpoint obtained in the coordinate points on the display unit.
8.如权利要求1所述的方法,其特征在于,所述电子终端还包括结构部件、眼动监测部件和传感器,所述结构部件用于将所述电子终端佩戴于所述用户的身体上,所述眼动监测部件位于所述结构部件上,当所述电子终端佩戴于所述用户的身体上时,所述监测用户的眼动具体为:通过所述眼动监测部件监测所述用户的眼动。 8. The method according to claim 1, wherein said electronic terminal further comprises a structural member, and means to monitor eye movement sensor, said structural member for electronic terminal worn on the body of the user the eye movement monitoring means located on said structural member, when worn on the body of the electronic terminal to the user, the user's eye movement monitoring in particular: the eye by said monitoring means monitoring user the eye movement.
9.如权利要求8所述的方法,其特征在于,所述传感器位于所述结构部件上,所述识别所述用户的头部动作具体为:通过所述传感器识别所述用户的头部动作。 9. The method according to claim 8, wherein said sensor is located on the structural member, the head of the user to identify particular action: identifying the user by the sensor head gestures .
10.一种电子终端,其特征在于,包括: 显示单元; 眼动监测部件,用于监测用户的眼动; 处理单元,用于根据所述眼动确定所述用户的视点,并将所述视点确认在所述显示单元上的坐标点; 头部动作识别部件,用于识别所述用户的头部动作;以及控制单元,用于根据所述头部动作对所述坐标点对应的操作对象进行相应的操作; 其中,所述电子终端还包括按键,所述控制单元在根据所述头部动作对所述坐标点对应的操作对象进行相应的操作之前,所述控制单元还判断所述按键是否被按下,如果是,所述控制单元则根据所述头部动作和所述按键被按下的状态对所述坐标点对应的操作对象进行相应的操作。 An electronic terminal, characterized by comprising: a display unit; eye movement monitoring means for monitoring a user's eye; a processing unit for determining the motion of the user's eyes according to the viewpoint, and the confirm the viewpoint coordinate point on the display unit; head motion recognition means for recognizing the user's head movements; and a control unit for operating an object corresponding to the coordinate point in accordance with the operation of the head corresponding operation; wherein said terminal further includes an electronic key, the control unit prior to operation of the operation corresponding to the coordinate point corresponding to the object in accordance with operation of the head, said control means further determines the key it is depressed, and if so, the control unit of the operation corresponding to the operation target based on the coordinate point corresponding to the head portion and the operation state of a key is pressed.
11.如权利要求10所述的电子终端,其特征在于,所述电子终端为眼镜式电子终端,所述终端还包括结构部件,用于将所述电子终端佩戴于用户的身体上。 11. The electronic terminal according to claim 10, wherein said electronic terminal is a glasses-type electronic terminal, the terminal further comprises a structural member for the electronic terminal is worn on the user's body.
12.如权利要求11所述的电子终端,其特征在于,所述眼动监测部件位于所述结构部件上。 12. The electronic terminal as claimed in claim 11, wherein said monitoring means is located on the eye of the structural member.
13.如权利要求11所述的电子终端,其特征在于,所述头部动作识别部件位于所述结构部件上。 13. The electronic terminal as claimed in claim 11, wherein the head member located on said motion recognition structural member.
14.如权利要求12所述的电子终端,其特征在于,所述眼动监测部件为摄像头。 14. The electronic terminal as claimed in claim 12, wherein said member is eye monitoring camera.
15.如权利要求10所述的电子终端,其特征在于,所述头部动作识别部件为摄像头或重力传感器。 15. The electronic terminal according to claim 10, wherein said member is a head motion recognition camera or a gravity sensor.
16.如权利要求10所述的电子终端,其特征在于,所述电子终端还包括判断单元,用于判断所述头部动作识别部件识别的所述头部动作是否满足预定条件,如果是,则所述控制单元根据所述头部动作对所述坐标点对应的操作对象进行相应的操作。 16. The electronic terminal according to claim 10, wherein said electronic terminal further includes determining means for determining the operation of the head portion of the head of the motion recognizing unit satisfies a predetermined condition, if so, the control unit of the operation corresponding to the operation target based on the coordinate point corresponding to the head motion.
CN201210051834.6A 2012-03-01 2012-03-01 The method of controlling a human-machine interactive electronic terminal and CN103294180B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201210051834.6A CN103294180B (en) 2012-03-01 2012-03-01 The method of controlling a human-machine interactive electronic terminal and

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201210051834.6A CN103294180B (en) 2012-03-01 2012-03-01 The method of controlling a human-machine interactive electronic terminal and

Publications (2)

Publication Number Publication Date
CN103294180A CN103294180A (en) 2013-09-11
CN103294180B true CN103294180B (en) 2017-02-15

Family

ID=49095207

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201210051834.6A CN103294180B (en) 2012-03-01 2012-03-01 The method of controlling a human-machine interactive electronic terminal and

Country Status (1)

Country Link
CN (1) CN103294180B (en)

Families Citing this family (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104461418B (en) * 2013-09-23 2017-12-26 联想(北京)有限公司 An information processing method of an electronic device and
CN103777759A (en) * 2014-02-18 2014-05-07 马根昌 Electronic glass action identification system
CN105204604B (en) * 2014-05-30 2019-03-01 华为技术有限公司 A kind of eyeball interactive control equipment
CN105511846B (en) * 2014-09-24 2018-12-14 联想(北京)有限公司 And a display control method of the electronic device
CN104808789B (en) * 2015-04-03 2018-05-11 孙建康 A mobile terminal control apparatus noncontact
CN105992036A (en) * 2015-04-10 2016-10-05 乐视网信息技术(北京)股份有限公司 Control method and control device of terminal device, and terminal device
CN106155296A (en) * 2015-04-20 2016-11-23 北京智谷睿拓技术服务有限公司 Control method and apparatus
CN104954574A (en) * 2015-06-23 2015-09-30 上海卓易科技股份有限公司 Automatic mobile terminal operation method and mobile terminal
CN106325480A (en) * 2015-06-30 2017-01-11 天津三星电子有限公司 Line-of-sight tracing-based mouse control device and method
CN105867600A (en) * 2015-11-06 2016-08-17 乐视移动智能信息技术(北京)有限公司 Interaction method and device
CN106055102A (en) * 2016-05-30 2016-10-26 北京奇艺世纪科技有限公司 Virtual reality equipment control method and apparatus
CN106325517A (en) * 2016-08-29 2017-01-11 袁超 Target object trigger method and system and wearable equipment based on virtual reality
CN106681509A (en) * 2016-12-29 2017-05-17 北京七鑫易维信息技术有限公司 Interface operating method and system
CN107515670A (en) * 2017-01-13 2017-12-26 维沃移动通信有限公司 Automatic page turning method and mobile terminal
WO2018184242A1 (en) * 2017-04-08 2018-10-11 闲客智能(深圳)科技有限公司 Image analysis-based eye movement direction identification method and device

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1694045A (en) * 2005-06-02 2005-11-09 北京中星微电子有限公司 Non-contact type visual control operation system and method
CN101890719A (en) * 2010-07-09 2010-11-24 中国科学院深圳先进技术研究院 Robot remote control device and robot system
CN101995944A (en) * 2009-08-24 2011-03-30 仇锐铿 Electrooculogram control system and method for controlling cursor by using eye electricity control system
CN201945946U (en) * 2011-01-20 2011-08-24 叶尔肯·拜山 Head control mouse

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1357862A (en) * 2000-12-06 2002-07-10 英业达股份有限公司 Cursor clicking and selecting method and device in windows
CN100342388C (en) * 2003-07-18 2007-10-10 万众一 Intelligent control method for visual tracking
CN1740951A (en) * 2004-08-25 2006-03-01 西门子公司 Apparatus for controlling equipment by human eyes
CN102906623A (en) * 2010-02-28 2013-01-30 奥斯特豪特集团有限公司 Local advertising content on an interactive head-mounted eyepiece

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1694045A (en) * 2005-06-02 2005-11-09 北京中星微电子有限公司 Non-contact type visual control operation system and method
CN101995944A (en) * 2009-08-24 2011-03-30 仇锐铿 Electrooculogram control system and method for controlling cursor by using eye electricity control system
CN101890719A (en) * 2010-07-09 2010-11-24 中国科学院深圳先进技术研究院 Robot remote control device and robot system
CN201945946U (en) * 2011-01-20 2011-08-24 叶尔肯·拜山 Head control mouse

Also Published As

Publication number Publication date
CN103294180A (en) 2013-09-11

Similar Documents

Publication Publication Date Title
CN104205193B (en) Augmented reality display light guide
CN104145232B (en) Watch for system interaction
WO2010062117A2 (en) Immersive display system for interacting with three-dimensional content
US9727132B2 (en) Multi-visor: managing applications in augmented reality environments
KR101004930B1 (en) Full browsing method using gaze detection and handheld terminal performing the method
JP6002424B2 (en) User's line of sight, and feedback providing system according to gestures and methods
US8994672B2 (en) Content transfer via skin input
EP2784632A2 (en) Head-mounted display device and method of controlling head-mounted display device
JP6195893B2 (en) Shape recognition apparatus, the shape recognition program, and a shape recognition method
CN104423584B (en) The method of the wearable device and a contents output
US9866754B2 (en) Power management in an eye-tracking system
CN103347437B (en) Gaze detection 3d mapping environment
JP6096276B2 (en) Display selective backlight based on eye-tracking
US10203764B2 (en) Systems and methods for triggering actions based on touch-free gesture detection
US9069164B2 (en) Methods and systems for a virtual input device
US8217856B1 (en) Head-mounted display that displays a visual representation of physical interaction with an input interface located outside of the field of view
US9081416B2 (en) Device, head mounted display, control method of device and control method of head mounted display
US8228315B1 (en) Methods and systems for a virtual input device
CN102789313B (en) User interaction system and method
US20150143283A1 (en) Information processing device, display control method, and program
US10191281B2 (en) Head-mounted display for visually recognizing input
KR101570800B1 (en) Systems and methods for controlling a cursor on a display using a trackpad input device
JP5884502B2 (en) Head-mounted display
CN103688231A (en) Nose bridge sensor
CN104246682A (en) Enhanced virtual touchpad and touchscreen

Legal Events

Date Code Title Description
C06 Publication
C10 Entry into substantive examination
C14 Grant of patent or utility model