CN103500061B - Control the method and apparatus of display - Google Patents

Control the method and apparatus of display Download PDF

Info

Publication number
CN103500061B
CN103500061B CN201310445336.4A CN201310445336A CN103500061B CN 103500061 B CN103500061 B CN 103500061B CN 201310445336 A CN201310445336 A CN 201310445336A CN 103500061 B CN103500061 B CN 103500061B
Authority
CN
China
Prior art keywords
human eye
screen
fixation point
action
electronic glasses
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201310445336.4A
Other languages
Chinese (zh)
Other versions
CN103500061A (en
Inventor
高伟
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Samsung Electronics China R&D Center
Samsung Electronics Co Ltd
Original Assignee
Samsung Electronics China R&D Center
Samsung Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Samsung Electronics China R&D Center, Samsung Electronics Co Ltd filed Critical Samsung Electronics China R&D Center
Priority to CN201310445336.4A priority Critical patent/CN103500061B/en
Publication of CN103500061A publication Critical patent/CN103500061A/en
Application granted granted Critical
Publication of CN103500061B publication Critical patent/CN103500061B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Abstract

A kind of method and apparatus of control display.Methods described includes：Human eye, which is shot, by electronic glasses obtains eye image；Human eye feature information is extracted from eye image；Detect the eye positions and attitude information of electronic glasses；Human eye fixation point on screen is detected according to human eye feature information, eye positions and attitude information；Human eye action is detected according to the situation of change of the human eye fixation point in human eye feature information and/or screen；The operation of display is controlled according to the human eye fixation point in human eye action and screen.Display can be controlled according to eye image according to the present invention.

Description

Control the method and apparatus of display
Technical field
The present invention relates to the control field of display, more particularly, it is related to a kind of method and apparatus of control display.
Background technology
In the life of people, display has become an indispensable part, either television indicator, or electricity Brain display, user is increasingly desirable for more that easily control method controls display.
Under existing technical conditions, user is controlled usually using the button on hand-held remote control device or display pannel Display processed, this causes operating process to be unable to do without the participation of hand, and people can not free hand from control device, especially right It is more inconvenient for both hands handicapped person.
Accordingly, it would be desirable to a kind of method and apparatus for controlling display, with being capable of obstructed remarkable hand control display.
The content of the invention
It is an object of the invention to provide a kind of method and apparatus of control display, it can be controlled according to eye image Display processed.
The first aspect of the present invention provides a kind of method for controlling display, including：Human eye is shot by electronic glasses to obtain Obtain eye image；Human eye feature information is extracted from eye image；Detect the eye positions and attitude information of electronic glasses；According to Human eye fixation point on human eye feature information, eye positions and attitude information detection screen；According to human eye feature information and/or screen The situation of change detection human eye action of human eye fixation point on curtain；It is aobvious according to the human eye fixation point control in human eye action and screen Show the operation of device.
Alternatively, the step of the human eye fixation point on screen is detected according to human eye feature information, eye positions and attitude information Suddenly include：Human eye fixation point on electronic glasses is obtained according to human eye feature information；According to the human eye fixation point on electronic glasses, Eye positions and attitude information obtain the human eye fixation point on screen.
Alternatively, the human eye feature information is the positional information of pupil center and corneal reflection point, according to human eye feature The step of human eye fixation point on information acquisition electronic glasses, includes：According to pupil center and the positional information meter of corneal reflection point Calculate human eye fixation point of the human eye sight on electronic glasses.
Alternatively, the human eye action include closing one's eyes, watch attentively, twitching of the eyelid, at least one in smooth motion.
Alternatively, when corneal reflection point can not be obtained in first scheduled time from human eye feature information, human eye action It is detected as closing one's eyes；When the human eye fixation point on screen keeps constant within second scheduled time, human eye action is detected as watching attentively； When moving range exceedes predetermined threshold to the human eye fixation point on screen within the 3rd scheduled time, human eye action is detected as eye Jump；When the human eye fixation point on screen is moved at a predetermined velocity, human eye action is detected as smooth motion.
Alternatively, the behaviour of display is controlled according to the human eye fixation point in human eye action and screen in different modes Make.
Alternatively, the step of controlling the operation of display according to the human eye fixation point in human eye action and screen includes：When During display image screen, proceeded as follows according to the human eye fixation point control display in human eye action and screen：Work as human eye Act to watch attentively, and the human eye fixation point on screen be located at screen intermediate region when, be pointed to the human eye fixation point on screen Neighbouring image is amplified and shown；In the case where the image of screen display is moving image, when human eye action is smooth During tracking, the object that human eye is followed the trail of is determined according to the human eye fixation point on the screen in smooth tracing process, by human eye institute The object of tracking is illustrated in the center of screen；When human eye action to watch attentively, and the human eye fixation point on screen is located at screen side During battery limit (BL) domain, the direction that image is directed away from into the border is moved.
Alternatively, the step of controlling the operation of display according to the human eye fixation point in human eye action and screen includes：When During screen display user interface, proceeded as follows according to the human eye fixation point control display in human eye action and screen：When Human eye fixation point on screen is located at a functional area, when then human eye action is closes one's eyes, and runs corresponding with the functional area Function；When human eye action is that human eye fixation point in smooth motion, and screen from a functional area is moved to another functional areas During domain, focus is switched to another region.
Alternatively, the method for the control display also includes：According to human eye feature information, eye positions and attitude information Viewing angle during detection viewing screen；The depth of screen is adjusted according to viewing angle.
Alternatively, the step of adjusting the depth of screen according to viewing angle includes：When viewing angle exceedes predetermined angular threshold During value, the depth in the region on screen close to electronic glasses is turned down, the depth in the region away from electronic glasses on screen is adjusted Greatly so that viewing angle is less than or equal to predetermined angular threshold value.
The second aspect of the present invention provides a kind of equipment for controlling display, including：Eye image acquiring unit, passes through electricity Sub- glasses shoot human eye and obtain eye image；Feature extraction unit, extracts human eye feature information from eye image；Position and attitude Detection unit, detects the eye positions and attitude information of electronic glasses；Blinkpunkt detection unit, according to human eye feature information, eye Human eye fixation point on mirror position and attitude information detection screen；Human eye action detection unit, according to human eye feature information and/or The situation of change detection human eye action of human eye fixation point on screen；Control unit, according to the human eye in human eye action and screen Blinkpunkt controls the operation of display.
Alternatively, blinkpunkt detection unit includes：Glasses blinkpunkt detection unit, electronics is obtained according to human eye feature information Human eye fixation point on glasses；Screen blinkpunkt detection unit, according to the human eye fixation point on electronic glasses, eye positions and appearance Human eye fixation point on state information acquisition screen.
Alternatively, the human eye feature information is the positional information of pupil center and corneal reflection point, the inspection of glasses blinkpunkt Surveying unit includes：Computing unit, human eye sight is gone out in electronic eyes according to the positional information calculation of pupil center and corneal reflection point Human eye fixation point on mirror.
Alternatively, human eye action detection unit be used for detecting eye closing, watch attentively, twitching of the eyelid, at least one people in smooth motion Eye action.
Alternatively, when corneal reflection point can not be obtained in first scheduled time from human eye feature information, human eye action It is detected as closing one's eyes；When the human eye fixation point on screen keeps constant within second scheduled time, human eye action is detected as watching attentively； When moving range exceedes predetermined threshold to the human eye fixation point on screen within the 3rd scheduled time, human eye action is detected as eye Jump；When the human eye fixation point on screen is moved at a predetermined velocity, human eye action is detected as smooth motion.
Alternatively, control unit controls to show in different modes according to the human eye fixation point in human eye action and screen The operation of device.
Alternatively, when display image screen, control unit is controlled according to the human eye fixation point in human eye action and screen Display is proceeded as follows：When human eye action is watches attentively, and the human eye fixation point on screen is when being located at screen intermediate region, The image near human eye fixation point being pointed on screen is amplified and shown；It is moving image in the image of screen display In the case of, when human eye action is smooth follows the trail of, people is determined according to the human eye fixation point on the screen in smooth tracing process The object that eye is followed the trail of, the object that human eye is followed the trail of is illustrated in the center of screen；When human eye action to watch attentively, and on screen Human eye fixation point be located at screen border region when, by image be directed away from the border direction move.
Alternatively, when screen display user interface, control unit is according to the human eye fixation point in human eye action and screen Control display is proceeded as follows：When the human eye fixation point on screen is located at a functional area, then human eye action is eye closing When, run function corresponding with the functional area；When human eye action is human eye fixation point in smooth motion, and screen from one When functional area is moved to another functional area, focus is switched to another region.
Alternatively, the equipment of the control display also includes：Viewing angle detection unit, according to human eye feature information, Viewing angle when eye positions and attitude information detection viewing screen；Depth adjustment unit, screen is adjusted according to viewing angle Depth.
Alternatively, when viewing angle exceedes predetermined angular threshold value, depth adjustment unit by screen close to electronic glasses The depth in region turn down, the depth in the region away from electronic glasses on screen is tuned up so that viewing angle is less than or equal to angle Spend predetermined threshold.
The third aspect of the present invention provides a kind of method of utilization electronic glasses Remote Control Indicator, including：Pass through electronic eyes Mirror shoots human eye and obtains eye image；Human eye feature information is extracted from eye image；Detect electronic glasses eye positions and Attitude information；The characteristic information of eye image shot and the eye positions of electronic glasses and attitude information are sent to display Device.
The fourth aspect of the present invention provides a kind of equipment of utilization electronic glasses Remote Control Indicator, including：Eye image is obtained Unit is taken, eye image is obtained by shooting human eye；Feature extraction unit, extracts human eye feature information from eye image；Position Posture detecting unit is put, the eye positions and attitude information of electronic glasses are detected；Transmitting element, sends the eye image of shooting The eye positions and attitude information of characteristic information and electronic glasses are to display.
The fifth aspect of the present invention provides a kind of method for controlling display, including：The people shot is received from electronic glasses The characteristic information of eye pattern picture and the eye positions of electronic glasses and attitude information；According to human eye feature information, eye positions and Human eye fixation point on attitude information detection screen；According to the change of the human eye fixation point in human eye feature information and/or screen Situation detects human eye action；The operation of display is controlled according to the human eye fixation point in human eye action and screen.
Alternatively, the step of the human eye fixation point on screen is detected according to human eye feature information, eye positions and attitude information Suddenly include：Human eye fixation point on electronic glasses is obtained according to human eye feature information；According to the human eye fixation point on electronic glasses, Eye positions and attitude information obtain the human eye fixation point on screen.
Alternatively, the human eye feature information is the positional information of pupil center and corneal reflection point, according to human eye feature The step of human eye fixation point on information acquisition electronic glasses, includes：According to pupil center and the positional information meter of corneal reflection point Calculate blinkpunkt of the human eye sight on electronic glasses.
Alternatively, the human eye action include closing one's eyes, watch attentively, twitching of the eyelid, at least one in smooth motion.
Alternatively, when corneal reflection point can not be obtained in first scheduled time from human eye feature information, human eye action It is detected as closing one's eyes；When the human eye fixation point on screen keeps constant within second scheduled time, human eye action is detected as watching attentively； When moving range exceedes predetermined threshold to the human eye fixation point on screen within the 3rd scheduled time, human eye action is detected as eye Jump；When the human eye fixation point on screen is moved at a predetermined velocity, human eye action is detected as smooth motion.
Alternatively, the behaviour of display is controlled according to the human eye fixation point in human eye action and screen in different modes Make.
Alternatively, the step of controlling the operation of display according to the human eye fixation point in human eye action and screen includes：When During display image screen, proceeded as follows according to the human eye fixation point control display in human eye action and screen：Work as human eye Act to watch attentively, and the human eye fixation point on screen be located at screen intermediate region when, be pointed to the human eye fixation point on screen Neighbouring image is amplified and shown；In the case where the image of screen display is moving image, when human eye action is smooth During tracking, the object that human eye is followed the trail of is determined according to the human eye fixation point on the screen in smooth tracing process, by human eye institute The object of tracking is illustrated in the center of screen；When human eye action to watch attentively, and the human eye fixation point on screen is located at screen side During battery limit (BL) domain, the direction that image is directed away from into the border is moved.
Alternatively, the step of controlling the operation of display according to the human eye fixation point in human eye action and screen includes：When During screen display user interface, proceeded as follows according to the human eye fixation point control display in human eye action and screen：When Human eye fixation point on screen is located at a functional area, when then human eye action is closes one's eyes, and runs corresponding with the functional area Function；When human eye action is that human eye fixation point in smooth motion, and screen from a functional area is moved to another functional areas During domain, focus is switched to another region.
Alternatively, the method for the control display also includes：According to human eye feature information, eye positions and attitude information Viewing angle during detection viewing screen；The depth of screen is adjusted according to viewing angle.
Alternatively, the step of adjusting the depth of screen according to viewing angle includes：When viewing angle exceedes predetermined angular threshold During value, depth adjustment unit turns the depth in the region on screen close to electronic glasses down, by remote electronic glasses on screen The depth in region is tuned up so that viewing angle is less than or equal to angle predetermined threshold.
The sixth aspect of the present invention provides a kind of equipment for controlling display, including：Receiving unit, is received from electronic glasses The characteristic information of the eye image of shooting and the eye positions of electronic glasses and attitude information；Blinkpunkt detection unit, according to Human eye fixation point on human eye feature information, eye positions and attitude information detection screen；Human eye action detection unit, according to people The situation of change detection human eye action of eye characteristic information and/or the human eye fixation point on screen；Control unit, according to human eye action The operation of display is controlled with the human eye fixation point on screen.
Alternatively, blinkpunkt detection unit includes：Glasses blinkpunkt detection unit, electronics is obtained according to human eye feature information Human eye fixation point on glasses；Screen blinkpunkt detection unit, according to the human eye fixation point on electronic glasses, eye positions and appearance Human eye fixation point on state information acquisition screen.
Alternatively, the human eye feature information is the positional information of pupil center and corneal reflection point, the inspection of glasses blinkpunkt Surveying unit includes：Computing unit, human eye sight is gone out in electronic eyes according to the positional information calculation of pupil center and corneal reflection point Human eye fixation point on mirror.
Alternatively, human eye action detection unit be used for detecting eye closing, watch attentively, twitching of the eyelid, at least one people in smooth motion Eye action.
Alternatively, when corneal reflection point can not be obtained in first scheduled time from human eye feature information, human eye action It is detected as closing one's eyes；When the human eye fixation point on screen keeps constant within second scheduled time, human eye action is detected as watching attentively； When moving range exceedes predetermined threshold to the human eye fixation point on screen within the 3rd scheduled time, human eye action is detected as eye Jump；When the human eye fixation point on screen is moved at a predetermined velocity, human eye action is detected as smooth motion.
Alternatively, control unit controls to show in different modes according to the human eye fixation point in human eye action and screen The operation of device.
Alternatively, when display image screen, control unit is controlled according to the human eye fixation point in human eye action and screen Display is proceeded as follows：When human eye action is watches attentively, and the human eye fixation point on screen is when being located at screen intermediate region, The image near human eye fixation point being pointed on screen is amplified and shown；It is moving image in the image of screen display In the case of, when human eye action is smooth follows the trail of, people is determined according to the human eye fixation point on the screen in smooth tracing process The object that eye is followed the trail of, the object that human eye is followed the trail of is illustrated in the center of screen；When human eye action to watch attentively, and on screen Human eye fixation point be located at screen border region when, by image be directed away from the border direction move.
Alternatively, when screen display user interface, control unit is according to the human eye fixation point in human eye action and screen Control display is proceeded as follows：When the human eye fixation point on screen is located at a functional area, then human eye action is eye closing When, run function corresponding with the functional area；When human eye action is human eye fixation point in smooth motion, and screen from one When functional area is moved to another functional area, focus is switched to another region.
Alternatively, the equipment of the control display also includes：Viewing angle detection unit, according to human eye feature information, Viewing angle when eye positions and attitude information detection viewing screen；Depth adjustment unit, screen is adjusted according to viewing angle Depth.
Alternatively, when viewing angle exceedes predetermined angular threshold value, depth adjustment unit by screen close to electronic glasses The depth in region turn down, the depth in the region away from electronic glasses on screen is tuned up so that viewing angle is less than or equal to pre- Determine angle threshold.
The seventh aspect of the present invention provides a kind of method of utilization electronic glasses Remote Control Indicator, including：Pass through electronic eyes Mirror shoots human eye and obtains eye image；Human eye feature information is extracted from eye image；Detect electronic glasses eye positions and Attitude information；Human eye fixation point on screen is detected according to human eye feature information, eye positions and attitude information；It is special according to human eye The situation of change detection human eye action of reference breath and/or the human eye fixation point on screen；By the operation for controlling display Human eye fixation point in human eye action and screen is sent to display.
Alternatively, the step of the human eye fixation point on screen is detected according to human eye feature information, eye positions and attitude information Suddenly include：Human eye fixation point on electronic glasses is obtained according to human eye feature information；According to the human eye fixation point on electronic glasses, Eye positions and attitude information obtain the human eye fixation point on screen.
Alternatively, the human eye feature information is the positional information of pupil center and corneal reflection point, according to human eye feature The step of human eye fixation point on information acquisition electronic glasses, includes：According to pupil center and the positional information meter of corneal reflection point Calculate human eye fixation point of the human eye sight on electronic glasses.
Alternatively, the human eye action include closing one's eyes, watch attentively, twitching of the eyelid, at least one in smooth motion.
Alternatively, when corneal reflection point can not be obtained in first scheduled time from human eye feature information, human eye action It is detected as closing one's eyes；When the human eye fixation point on screen keeps constant within second scheduled time, human eye action is detected as watching attentively； When moving range exceedes predetermined threshold to the human eye fixation point on screen within the 3rd scheduled time, human eye action is detected as eye Jump；When the human eye fixation point on screen is moved at a predetermined velocity, human eye action is detected as smooth motion.
The eighth aspect of the present invention provides a kind of equipment of utilization electronic glasses Remote Control Indicator, including：Eye image is obtained Unit is taken, eye image is obtained by shooting human eye；Feature extraction unit, extracts human eye feature information from eye image；Position Posture detecting unit is put, the eye positions and attitude information of electronic glasses are detected；Blinkpunkt detection unit, believes according to human eye feature Human eye fixation point on breath, eye positions and attitude information detection screen；Human eye action detection unit, according to human eye feature information And/or the situation of change detection human eye action of the human eye fixation point on screen；Transmitting element, by the operation for controlling display Human eye action and screen on human eye fixation point be sent to display.
Alternatively, blinkpunkt detection unit includes：Glasses blinkpunkt detection unit, electronics is obtained according to human eye feature information Human eye fixation point on glasses；Screen blinkpunkt detection unit, according to the human eye fixation point on electronic glasses, eye positions and appearance Human eye fixation point on state information acquisition screen.
Alternatively, the human eye feature information is the positional information of pupil center and corneal reflection point, the inspection of glasses blinkpunkt Surveying unit includes：Computing unit, human eye sight is gone out in electronic eyes according to the positional information calculation of pupil center and corneal reflection point Human eye fixation point on mirror.
Alternatively, blinkpunkt detection unit be used for detecting eye closing, watch attentively, twitching of the eyelid, at least one human eye in smooth motion Action.
Alternatively, when corneal reflection point can not be obtained in first scheduled time from human eye feature information, human eye action It is detected as closing one's eyes；When the human eye fixation point on screen keeps constant within second scheduled time, human eye action is detected as watching attentively； When moving range exceedes predetermined threshold to the human eye fixation point on screen within the 3rd scheduled time, human eye action is detected as eye Jump；When the human eye fixation point on screen is moved at a predetermined velocity, human eye action is detected as smooth motion.
The ninth aspect of the present invention provides a kind of method for controlling display, including：Control display is received from electronic glasses Human eye fixation point in the human eye action and screen of the operation of device；It is aobvious according to the human eye fixation point control in human eye action and screen Show the operation of device.
Alternatively, the behaviour of display is controlled according to the human eye fixation point in human eye action and screen in different modes Make.
Alternatively, the step of controlling the operation of display according to the human eye fixation point in human eye action and screen includes：When During display image screen, proceeded as follows according to the human eye fixation point control display in human eye action and screen：Work as human eye Act to watch attentively, and the human eye fixation point on screen be located at screen intermediate region when, be pointed to the human eye fixation point on screen Neighbouring image is amplified and shown；In the case where the image of screen display is moving image, when human eye action is smooth During tracking, the object that human eye is followed the trail of is determined according to the human eye fixation point on the screen in smooth tracing process, by human eye institute The object of tracking is illustrated in the center of screen；When human eye action to watch attentively, and the human eye fixation point on screen is located at screen side During battery limit (BL) domain, the direction that image is directed away from into the border is moved.
Alternatively, the step of controlling the operation of display according to the human eye fixation point in human eye action and screen includes：When During screen display user interface, proceeded as follows according to the human eye fixation point control display in human eye action and screen：When Human eye fixation point on screen is located at a functional area, when then human eye action is closes one's eyes, and runs corresponding with the functional area Function；When human eye action is that human eye fixation point in smooth motion, and screen from a functional area is moved to another functional areas During domain, focus is switched to another region.
The tenth aspect of the present invention provides a kind of equipment for controlling display, including：Receiving unit, is received from electronic glasses Human eye fixation point in the human eye action and screen of the operation of control display；Control unit, according in human eye action and screen Human eye fixation point control display operation.
Alternatively, control unit controls to show in different modes according to the human eye fixation point in human eye action and screen The operation of device.
Alternatively, when display image screen, control unit is controlled according to the human eye fixation point in human eye action and screen Display is proceeded as follows：When human eye action is watches attentively, and the human eye fixation point on screen is when being located at screen intermediate region, The image near human eye fixation point being pointed on screen is amplified and shown；It is moving image in the image of screen display In the case of, when human eye action is smooth follows the trail of, people is determined according to the human eye fixation point on the screen in smooth tracing process The object that eye is followed the trail of, the object that human eye is followed the trail of is illustrated in the center of screen；When human eye action to watch attentively, and on screen Human eye fixation point be located at screen border region when, by image be directed away from the border direction move.
Alternatively, when screen display user interface, control unit is according to the human eye fixation point in human eye action and screen Control display is proceeded as follows：When the human eye fixation point on screen is located at a functional area, then human eye action is eye closing When, run function corresponding with the functional area；When human eye action is human eye fixation point in smooth motion, and screen from one When functional area is moved to another functional area, focus is switched to another region.
According to the method and apparatus of the control display of the present invention, display can be controlled according to eye image, by user Both hands freed from remote control.
Brief description of the drawings
By the description carried out below in conjunction with the accompanying drawings to embodiment, these and/or other aspect of the invention is incited somebody to action with advantage It can be made apparent from and it is more readily appreciated that wherein：
Fig. 1 shows the flow chart of the method for the control display according to the first exemplary embodiment of the present invention.
Fig. 2 shows the block diagram of the equipment of the control display according to the second exemplary embodiment of the present invention.
Fig. 3 shows the stream of the method for the utilization electronic glasses Remote Control Indicator of the 3rd exemplary embodiment according to the present invention Cheng Tu.
Fig. 4 shows the frame of the equipment of the utilization electronic glasses Remote Control Indicator of the 4th exemplary embodiment according to the present invention Figure.
Fig. 5 shows the flow chart of the method for the control display according to the 5th exemplary embodiment of the present invention.
Fig. 6 shows the block diagram of the equipment of the control display according to the 6th exemplary embodiment of the present invention.
Fig. 7 shows the stream of the method for the utilization electronic glasses Remote Control Indicator of the 7th exemplary embodiment according to the present invention Cheng Tu.
Fig. 8 shows the frame of the equipment of the utilization electronic glasses Remote Control Indicator of the 8th exemplary embodiment according to the present invention Figure.
Fig. 9 shows the flow chart of the method for the control display according to the 9th exemplary embodiment of the present invention.
Figure 10 shows the block diagram of the equipment of the control display according to the tenth exemplary embodiment of the present invention.
Embodiment
The embodiment of the present invention is described in detail now, its example is illustrated in the accompanying drawings.Below with reference to the accompanying drawings Embodiment is described to explain the present invention.
Fig. 1 shows the flow chart of the method for the control display according to the first exemplary embodiment of the present invention.
In step 101, the eye image shot by electronic glasses is obtained.User's carrying electronic eye when watching screen Mirror, the eyes for shooting user by the image capturing device on electronic glasses obtain the eye image of user.
In step 102, human eye feature information is extracted from eye image.Human eye feature information is can to characterize human eye sight Information.For example, human eye feature information can be the positional information of pupil center and corneal reflection point, according to pupil center and angle The positional information of film pip can obtain human eye sight information.
In step 103, the eye positions and attitude information of electronic glasses are detected.Eye positions and the posture letter of electronic glasses Predetermined coordinate system can be used to be expressed for breath.
In step 104, the human eye fixation point on screen is detected according to human eye feature information, eye positions and attitude information. The human eye fixation point on electronic glasses is obtained according to human eye feature information first.Then according to people's eye fixation on electronic glasses Point, eye positions and attitude information obtain the human eye fixation point on screen.
Specifically, it can be realized by existing Eye Tracking Technique and electronic glasses coordinate is obtained according to human eye feature information The human eye sight fastened, the human eye fixation point on electronic glasses is obtained further according to the human eye sight on electronic glasses coordinate system.So Afterwards, corresponding coordinate transform is carried out according to the human eye fixation point on electronic glasses and the position of electronic glasses and attitude information, Obtain the human eye fixation point on screen.
In one embodiment, the human eye feature information is the positional information of pupil center and corneal reflection point, according to The positional information calculation of pupil center and corneal reflection point goes out human eye fixation point of the human eye sight on electronic glasses.That is, use Pupil-corneal reflection vector method analysis human eye feature information obtains the human eye sight on electronic glasses coordinate system, according to electronic eyes Human eye sight on mirror coordinate system obtains the human eye fixation point on electronic glasses.
In step 105, detect that human eye is moved according to the situation of change of the human eye fixation point in human eye feature information and/or screen Make.Including closing one's eyes, watching attentively, twitching of the eyelid, the human eye action such as smooth motion.When can not be from human eye feature information in first scheduled time When obtaining corneal reflection point, human eye action is detected as closing one's eyes.When the human eye fixation point on screen is kept within second scheduled time When constant, human eye action is detected as watching attentively；When the human eye fixation point on screen, moving range exceedes in advance within the 3rd scheduled time When determining threshold value, human eye action is detected as twitching of the eyelid；When the human eye fixation point on screen is moved at a predetermined velocity, human eye action detection For smooth motion.Above predetermined value can be with preset or be configured by user.
In step 106, the operation of display is controlled according to the human eye fixation point in human eye action and screen.Specifically, The various operations of display can be controlled by the various combination of the human eye fixation point in human eye action and screen.
For example, the human eye fixation point on screen is equivalent to the position where cursor when using mouse control display, or The position chosen using remote control during remote control control display, human eye action is equivalent to click mouse or presses remote control Button.For example, eye closing acts equivalent to click left mouse button or pressed the ACK button of remote control.
Preferably, the behaviour of display is controlled according to the human eye fixation point in human eye action and screen in different modes Make.
In view mode, when human eye action to watch attentively, and the human eye fixation point on screen is located at screen intermediate region When, the image for being pointed to blinkpunkt near zone is amplified and shown, facilitates user to can be clearly seen that oneself is of interest thin Micro- image.Here, the size of the blinkpunkt near zone amplified can be with preset or be configured by user.In screen display Image be moving image in the case of, when human eye action is smooth follows the trail of, according on the screen in smooth tracing process Human eye fixation point determine the object that human eye is followed the trail of, the information of the object is extracted from TV programme stream, to the object carry out Follow the trail of, the object followed the trail of is illustrated in the center of screen.When human eye action to watch attentively, and the human eye fixation point position on screen When screen border region, the direction that image is directed away from into the border is moved.For example：When human eye action to watch attentively, and shield When human eye fixation point on curtain is located at screen left margin region, image is moved to the right, the picture showing that left side is not showed Out.
Under user interface mode, the image of screen is divided into several regions, each specific function of Regional Representative.When Human eye fixation point on screen is located at a functional area, when then human eye action is closes one's eyes, and runs corresponding with the functional area Function.
For example：When user watches page-turning function region attentively, when then closing one's eyes, page-turning function is run.When human eye action is Human eye fixation point in smooth motion, and screen from a functional area be moved to another functional area when, focus is switched to Another region（That is, another region is chosen from choosing a region to be changed into）.
Moreover, it should be understood that function, which can also be, calls various application software, the built-in function of application software, display Built-in function（For example, brightness regulation, mode tuning etc.）Or the function of User Defined setting etc..
In addition, viewing angle when viewing screen is detected according to human eye feature information, eye positions and attitude information, then The depth of screen is adjusted according to viewing angle.When viewing angle exceedes predetermined angular threshold value, by close electronic glasses on screen The depth in region turn down, the depth in the region away from electronic glasses on screen is tuned up so that viewing angle is less than or equal to pre- Angle threshold is determined, so as to play the purpose of protect eyes.
It should be understood that step 101-106 can be all by electronic glasses（Or the remote control with electronic glasses）Or it is aobvious Show device to realize；Or part is by electronic glasses（Or the remote control with electronic glasses）Realize, other parts are by display To realize.
Fig. 2 shows the block diagram of the equipment of the control display according to the second exemplary embodiment of the present invention.
As shown in Fig. 2 being included according to the equipment 200 of the control display of the present invention：Eye image acquiring unit 201, spy Levy extraction unit 202, position and attitude detection unit 203, blinkpunkt detection unit 204, human eye action detection unit 205, control Unit 206.
Eye image acquiring unit 201 is used to shoot human eye acquisition eye image by using electronic glasses.Electronic glasses There can be CMOS（Complementary metal oxide semiconductor）Sensor, CCD（Charge coupling device）The various filming apparatus such as sensor.
Feature extraction unit 202 is used to extract human eye feature information from the eye image obtained.Human eye feature information is The information of human eye sight can be characterized.For example, human eye feature information can be the positional information of pupil center and corneal reflection point, Human eye sight information can be obtained according to the positional information of pupil center and corneal reflection point.
Position and attitude detection unit 203 is used for the eye positions and attitude information for detecting electronic glasses.Position and attitude is detected Unit 203 can be various position and attitude detection means.
Blinkpunkt detection unit 204 is used to be detected on screen according to human eye feature information, eye positions and attitude information Human eye fixation point.
Blinkpunkt detection unit 204 includes glasses blinkpunkt detection unit（It is not shown）With screen blinkpunkt detection unit （It is not shown）.Glasses blinkpunkt detection unit is used to obtain the human eye fixation point on electronic glasses according to human eye feature information.Tool Say, glasses blinkpunkt detection unit can be realized by existing Eye Tracking Technique obtains electronics according to human eye feature information body Human eye sight on glasses coordinate system, the human eye obtained further according to the human eye sight on electronic glasses coordinate system on electronic glasses is noted Viewpoint.Screen blinkpunkt detection unit is used for according to the human eye fixation point and the position of electronic glasses and posture on electronic glasses Information carries out corresponding coordinate transform, obtains the human eye fixation point on screen.
In one embodiment, the human eye feature information is the positional information of pupil center and corneal reflection point, glasses Blinkpunkt detection unit also includes computing unit（It is not shown）.Computing unit is believed according to the position of pupil center and corneal reflection point Breath calculates human eye fixation point of the human eye sight on electronic glasses.That is, human eye spy is analyzed using pupil-corneal reflection vector method Reference breath obtains the human eye sight on electronic glasses coordinate system, and electronic eyes is obtained according to the human eye sight on electronic glasses coordinate system Human eye fixation point on mirror.
Human eye action detection unit 205 is used for the change according to the human eye fixation point in human eye feature information and/or screen Situation detects human eye action.Including closing one's eyes, watching attentively, twitching of the eyelid, the human eye action such as smooth motion.When can not be from first scheduled time When obtaining corneal reflection point in human eye feature information, human eye action is detected as closing one's eyes.When the human eye fixation point on screen is second When keeping constant in the scheduled time, human eye action is detected as watching attentively；When the human eye fixation point on screen is within the 3rd scheduled time When moving range exceedes predetermined threshold, human eye action is detected as twitching of the eyelid；When the human eye fixation point on screen is moved at a predetermined velocity When, human eye action is detected as smooth motion.Above predetermined value can be with preset or be configured by user.
Control unit 206 is used for the operation that display is controlled according to the human eye fixation point in human eye action and screen.Specifically Say that control unit 206 can control each of display by the various combination of the human eye fixation point in human eye action and screen in ground Plant operation.
For example, the human eye fixation point on screen is equivalent to the position where cursor when using mouse control display, or The position chosen using remote control during remote control control display, human eye action is equivalent to click mouse or presses remote control Button.For example, eye closing acts equivalent to click left mouse button or pressed the ACK button of remote control.
Preferably, control unit 206 is controlled according to the human eye fixation point in human eye action and screen in different modes The operation of display.
In view mode, when human eye action to watch attentively, and the human eye fixation point on screen is located at screen intermediate region When, the image for being pointed to blinkpunkt near zone is amplified and shown, facilitates user to can be clearly seen that oneself is of interest thin Micro- image.The size of the blinkpunkt near zone amplified can be with preset or be configured by user.In the figure of screen display In the case of being moving image, when human eye action is smooth follows the trail of, according to the people on the screen in smooth tracing process Eye fixation point determines the object that human eye is followed the trail of, and the information of the object is extracted from TV programme stream, and the object is tracked, The object followed the trail of is illustrated in the center of screen.When human eye action to watch attentively, and the human eye fixation point on screen is located at screen During curtain borderline region, the direction that image is directed away from into the border is moved.For example：When human eye action to watch attentively, and on screen Human eye fixation point be located at screen left margin region when, image is moved to the right, the picture showing that left side does not show is come out.
Under user interface mode, the image of screen is divided into several regions, each specific function of Regional Representative.When Human eye fixation point on screen is located at a functional area, when then human eye action is closes one's eyes, and runs corresponding with the functional area Function.
For example：When user watches page-turning function region attentively, when then closing one's eyes, page-turning function is run.When human eye action is Human eye fixation point in smooth motion, and screen from a functional area be moved to another functional area when, focus is switched to Another region（That is, another region is chosen from choosing a region to be changed into）.
Controlling the equipment 200 of display also includes viewing angle detection unit（It is not shown）With depth adjustment unit（Do not show Go out）.Viewing angle detection unit detects viewing angle during viewing screen according to human eye feature information, eye positions and attitude information Degree, depth adjustment unit adjusts the depth of screen according to viewing angle.When viewing angle exceedes predetermined angular threshold value, by screen The depth in the upper region close to electronic glasses is turned down, and the depth in the region away from electronic glasses on screen is tuned up so that viewing Angle is less than or equal to predetermined angular threshold value, plays the purpose of protect eyes.
It should be understood that unit 101-106 can all be arranged in electronic glasses（Or the remote control with electronic glasses） Or in display；Or it is partially disposed on electronic glasses（Or the remote control with electronic glasses）In, other parts are arranged in In display.
Fig. 3 shows the stream of the method for the utilization electronic glasses Remote Control Indicator of the 3rd exemplary embodiment according to the present invention Cheng Tu.
In step 301, the eye image shot by electronic glasses is obtained.User's carrying electronic eye when watching screen Mirror, the eyes for shooting user by the image capturing device on electronic glasses obtain the eye image of user.
In step 302, human eye feature information is extracted from eye image.Human eye feature information is can to characterize human eye sight Information.For example, human eye feature information can be the positional information of pupil center and corneal reflection point, according to pupil center and angle The positional information of film pip can obtain human eye sight information.
In step 303, the eye positions and attitude information of electronic glasses are detected.Eye positions and the posture letter of electronic glasses Predetermined coordinate system can be used to be expressed for breath.
In step 304, the characteristic information of eye image shot and the eye positions of electronic glasses and posture letter are sent Cease display.
It should be understood that above step can be by electronic glasses or remote control with electronic glasses is realized.
Fig. 4 shows the frame of the equipment of the utilization electronic glasses Remote Control Indicator of the 4th exemplary embodiment according to the present invention Figure.
As shown in figure 4, being included according to the equipment 400 of the utilization electronic glasses Remote Control Indicator of the present invention：Eye image is obtained Take unit 401, feature extraction unit 402, position and attitude detection unit 403, transmitting element 404.
Eye image acquiring unit 401 is used to obtain eye image by shooting human eye.Eye image acquiring unit 401 can To be CMOS（Complementary metal oxide semiconductor）Sensor, CCD（Charge coupling device）The various filming apparatus such as sensor.
Feature extraction unit 402 is used to extract human eye feature information from the eye image obtained.Human eye feature information is The information of human eye sight can be characterized.For example, human eye feature information can be the positional information of pupil center and corneal reflection point, Human eye sight information can be obtained according to the positional information of pupil center and corneal reflection point.
Position and attitude detection unit 403 is used for the eye positions and attitude information for detecting electronic glasses.Position and attitude is detected Unit 403 can be various position and attitude detection means.
Transmitting element 404 is used to send the characteristic information of eye image shot and the eye positions of electronic glasses and appearance State information is to display.Transmitting element 404 can be various wireless data transmission devices.
It should be understood that equipment 400 can be implemented as electronic glasses or the remote control with electronic glasses.
Fig. 5 shows the flow chart of the method for the control display according to the 5th exemplary embodiment of the present invention.
In step 501, the characteristic information of the eye image shot and the glasses position of electronic glasses are received from electronic glasses Put and attitude information.
In step 502, the human eye fixation point on screen is detected according to human eye feature information, eye positions and attitude information. The human eye fixation point on electronic glasses is obtained according to human eye feature information first.Then according to people's eye fixation on electronic glasses Point, eye positions and attitude information obtain the human eye fixation point on screen.Specifically, existing Eye Tracking Technique can be passed through The human eye sight obtained according to human eye feature information on electronic glasses coordinate system is realized, further according to the people on electronic glasses coordinate system An eye line obtains the human eye fixation point on electronic glasses.Then, according to the human eye fixation point and electronic glasses on electronic glasses Position and attitude information carry out corresponding coordinate transform, obtain the human eye fixation point on screen.
In one embodiment, the human eye feature information is the positional information of pupil center and corneal reflection point, according to The positional information calculation of pupil center and corneal reflection point goes out human eye fixation point of the human eye sight on electronic glasses.That is, use Pupil-corneal reflection vector method analysis human eye feature information obtains the human eye sight on electronic glasses coordinate system, according to electronic eyes Human eye sight on mirror coordinate system obtains the human eye fixation point on electronic glasses.
In step 503, detect that human eye is moved according to the situation of change of the human eye fixation point in human eye feature information and/or screen Make.Including closing one's eyes, watching attentively, twitching of the eyelid, the human eye action such as smooth motion.When can not be from human eye feature information in first scheduled time When obtaining corneal reflection point, human eye action is detected as closing one's eyes.When the human eye fixation point on screen is kept within second scheduled time When constant, human eye action is detected as watching attentively；When the human eye fixation point on screen, moving range exceedes in advance within the 3rd scheduled time When determining threshold value, human eye action is detected as twitching of the eyelid；When the human eye fixation point on screen is moved at a predetermined velocity, human eye action detection For smooth motion.Above predetermined value can be with preset or be configured by user.
In step 504, the operation of display is controlled according to the human eye fixation point in human eye action and screen.Specifically, The various operations of display can be controlled by the various combination of the human eye fixation point in human eye action and screen.
For example, the human eye fixation point on screen is equivalent to the position where cursor when using mouse control display, or The position chosen using remote control during remote control control display, human eye action is equivalent to click mouse or presses remote control Button.For example, eye closing acts equivalent to click left mouse button or pressed the ACK button of remote control.
Preferably, the behaviour of display is controlled according to the human eye fixation point in human eye action and screen in different modes Make.
In view mode, when human eye action to watch attentively, and the human eye fixation point on screen is located at screen intermediate region When, the image for being pointed to blinkpunkt near zone is amplified and shown, facilitates user to can be clearly seen that oneself is of interest thin Micro- image.Wherein, the size of the blinkpunkt near zone amplified can be with preset or be configured by user.In screen display Image be moving image in the case of, when human eye action is smooth follows the trail of, according on the screen in smooth tracing process Human eye fixation point determine the object that human eye is followed the trail of, the information of the object is extracted from TV programme stream, to the object carry out Follow the trail of, the object followed the trail of is illustrated in the center of screen.When human eye action to watch attentively, and the human eye fixation point position on screen When screen border region, the direction that image is directed away from into the border is moved.For example：When human eye action to watch attentively, and shield When human eye fixation point on curtain is located at screen left margin region, image is moved to the right, the picture showing that left side is not showed Out.
Under user interface mode, the image of screen is divided into several regions, each specific function of Regional Representative.When Human eye fixation point on screen is located at a functional area, when then human eye action is closes one's eyes, and runs corresponding with the functional area Function.
For example：When user watches page-turning function region attentively, when then closing one's eyes, page-turning function is run.When human eye action is Human eye fixation point in smooth motion, and screen from a functional area be moved to another functional area when, focus is switched to Another region（That is, another region is chosen from choosing a region to be changed into）.
In addition, viewing angle when viewing screen is detected according to human eye feature information, eye positions and attitude information, then The depth of screen is adjusted according to viewing angle.When viewing angle exceedes predetermined angular threshold value, by close electronic glasses on screen The depth in region turn down, the depth in the region away from electronic glasses on screen is tuned up so that viewing angle is less than or equal to pre- Angle threshold is determined, so as to play the purpose of protect eyes.
It should be understood that above step can be realized by display.
Fig. 6 shows the block diagram of the equipment of the control display according to the 6th exemplary embodiment of the present invention.
As shown in fig. 6, being included according to the equipment 600 of the control display of the present invention：Receiving unit 601, blinkpunkt detection Unit 602, human eye action detection unit 603, control unit 604.
Receiving unit 601 is used for the characteristic information and the eye of electronic glasses that the eye image shot is received from electronic glasses Mirror position and attitude information.
Blinkpunkt detection unit 602 is used to be detected on screen according to human eye feature information, eye positions and attitude information Human eye fixation point.
Blinkpunkt detection unit 602 includes glasses blinkpunkt detection unit（It is not shown）With screen blinkpunkt detection unit （It is not shown）.Glasses blinkpunkt detection unit is used to obtain the human eye fixation point on electronic glasses according to human eye feature information.Tool Say, glasses blinkpunkt detection unit can be realized by existing Eye Tracking Technique obtains electronics according to human eye feature information body Human eye sight on glasses coordinate system, the human eye obtained further according to the human eye sight on electronic glasses coordinate system on electronic glasses is noted Viewpoint.Screen blinkpunkt detection unit is used for according to the human eye fixation point and the position of electronic glasses and posture on electronic glasses Information carries out corresponding coordinate transform, obtains the human eye fixation point on screen.
In one embodiment, the human eye feature information is the positional information of pupil center and corneal reflection point, glasses Blinkpunkt detection unit also includes computing unit（It is not shown）.Computing unit is believed according to the position of pupil center and corneal reflection point Breath calculates human eye fixation point of the human eye sight on electronic glasses.That is, human eye spy is analyzed using pupil-corneal reflection vector method Reference breath obtains the human eye sight on electronic glasses coordinate system, and electronic eyes is obtained according to the human eye sight on electronic glasses coordinate system Human eye fixation point on mirror.
Human eye action detection unit 603 is used for the change according to the human eye fixation point in human eye feature information and/or screen Situation detects human eye action.Including closing one's eyes, watching attentively, twitching of the eyelid, the human eye action such as smooth motion.When can not be from first scheduled time When obtaining corneal reflection point in human eye feature information, human eye action is detected as closing one's eyes.When the human eye fixation point on screen is second When keeping constant in the scheduled time, human eye action is detected as watching attentively；When the human eye fixation point on screen is within the 3rd scheduled time When moving range exceedes predetermined threshold, human eye action is detected as twitching of the eyelid；When the human eye fixation point on screen is moved at a predetermined velocity When, human eye action is detected as smooth motion.Above predetermined value can be with preset or be configured by user.
Control unit 604 is used for the operation that display is controlled according to the human eye fixation point in human eye action and screen.Specifically Ground is said, the various operations of display can be controlled by the various combination of the human eye fixation point in human eye action and screen.
For example, the human eye fixation point on screen is equivalent to the position where cursor when using mouse control display, or The position chosen using remote control during remote control control display, human eye action is equivalent to click mouse or presses remote control Button.For example, eye closing acts equivalent to click left mouse button or pressed the ACK button of remote control.
Preferably, control unit 604 is controlled according to the human eye fixation point in human eye action and screen in different modes The operation of display.
In view mode, when human eye action to watch attentively, and the human eye fixation point on screen is located at screen intermediate region When, the image for being pointed to blinkpunkt near zone is amplified and shown, facilitates user to can be clearly seen that oneself is of interest thin Micro- image.Wherein, the size of the blinkpunkt near zone amplified can be with preset or be configured by user.In screen display Image be moving image in the case of, when human eye action is smooth follows the trail of, according on the screen in smooth tracing process Human eye fixation point determine the object that human eye is followed the trail of, the information of the object is extracted from TV programme stream, to the object carry out Follow the trail of, the object followed the trail of is illustrated in the center of screen.When human eye action to watch attentively, and the human eye fixation point position on screen When screen border region, the direction that image is directed away from into the border is moved.For example：When human eye action to watch attentively, and shield When human eye fixation point on curtain is located at screen left margin region, image is moved to the right, the picture showing that left side is not showed Out.
Under user interface mode, the image of screen is divided into several regions, each specific function of Regional Representative.When Human eye fixation point on screen is located at a functional area, when then human eye action is closes one's eyes, and runs corresponding with the functional area Function.
For example：When user watches page-turning function region attentively, when then closing one's eyes, page-turning function is run.When human eye action is Human eye fixation point in smooth motion, and screen from a functional area be moved to another functional area when, focus is switched to Another region（That is, another region is chosen from choosing a region to be changed into）.
Controlling the equipment 600 of display also includes viewing angle detection unit（It is not shown）With depth adjustment unit（Do not show Go out）.Viewing angle detection unit detects viewing angle during viewing screen according to human eye feature information, eye positions and attitude information Degree, depth adjustment unit adjusts the depth of screen according to viewing angle.When viewing angle exceedes predetermined angular threshold value, by screen The depth in the upper region close to electronic glasses is turned down, and the depth in the region away from electronic glasses on screen is tuned up so that viewing Angle is less than or equal to predetermined angular threshold value, plays the purpose of protect eyes.
It should be understood that equipment 600 can be arranged in the display.
Fig. 7 shows the stream of the method for the utilization electronic glasses Remote Control Indicator of the 7th exemplary embodiment according to the present invention Cheng Tu.
In step 701, the eye image shot by electronic glasses is obtained.User's carrying electronic eye when watching screen Mirror, the eyes for shooting user by the image capturing device on electronic glasses obtain the eye image of user.
In step 702, human eye feature information is extracted from eye image.Human eye feature information is can to characterize human eye sight Information.For example, human eye feature information can be the positional information of pupil center and corneal reflection point, according to pupil center and angle The positional information of film pip can obtain human eye sight information.
In step 703, the eye positions and attitude information of electronic glasses are detected.Eye positions and the posture letter of electronic glasses Predetermined coordinate system can be used to be expressed for breath.
In step 704, the human eye fixation point on screen is detected according to human eye feature information, eye positions and attitude information. The human eye fixation point on electronic glasses is obtained according to human eye feature information first.Then according to people's eye fixation on electronic glasses Point, eye positions and attitude information obtain the human eye fixation point on screen.Specifically, existing Eye Tracking Technique can be passed through The human eye sight obtained according to human eye feature information on electronic glasses coordinate system is realized, further according to the people on electronic glasses coordinate system An eye line obtains the human eye fixation point on electronic glasses.Then, according to the human eye fixation point and electronic glasses on electronic glasses Position and attitude information carry out corresponding coordinate transform, obtain the human eye fixation point on screen.
In one embodiment, the human eye feature information is the positional information of pupil center and corneal reflection point, according to The positional information calculation of pupil center and corneal reflection point goes out human eye fixation point of the human eye sight on electronic glasses.That is, use Pupil-corneal reflection vector method analysis human eye feature information obtains the human eye sight on electronic glasses coordinate system, according to electronic eyes Human eye sight on mirror coordinate system obtains the human eye fixation point on electronic glasses.
In step 705, detect that human eye is moved according to the situation of change of the human eye fixation point in human eye feature information and/or screen Make.Including closing one's eyes, watching attentively, twitching of the eyelid, the human eye action such as smooth motion.When can not be from human eye feature information in first scheduled time When obtaining corneal reflection point, human eye action is detected as closing one's eyes.When the human eye fixation point on screen is kept within second scheduled time When constant, human eye action is detected as watching attentively；When the human eye fixation point on screen, moving range exceedes in advance within the 3rd scheduled time When determining threshold value, human eye action is detected as twitching of the eyelid；When the human eye fixation point on screen is moved at a predetermined velocity, human eye action detection For smooth motion.Above predetermined value can be with preset or be configured by user.
In step 706, the characteristic information of eye image shot and the eye positions of electronic glasses and posture letter are sent Cease display.
It should be understood that above step can be by electronic glasses or remote control with electronic glasses is realized.
Fig. 8 shows the frame of the equipment of the utilization electronic glasses Remote Control Indicator of the 8th exemplary embodiment according to the present invention Figure.
As shown in figure 8, being included according to the equipment 800 of the control display of the present invention：Eye image acquiring unit 801, spy Levy extraction unit 802, position and attitude detection unit 803, blinkpunkt detection unit 804, human eye action detection unit 805, transmission Unit 806.
Eye image acquiring unit 801 is used to obtain eye image by shooting human eye.Eye image acquiring unit 801 can To be CMOS（Complementary metal oxide semiconductor）Sensor, CCD（Charge coupling device）The various filming apparatus such as sensor.
Feature extraction unit 802 is used to extract human eye feature information from the eye image obtained.Human eye feature information is The information of human eye sight can be characterized.For example, human eye feature information can be the positional information of pupil center and corneal reflection point, Human eye sight information can be obtained according to the positional information of pupil center and corneal reflection point.
Position and attitude detection unit 803 is used for the eye positions and attitude information for detecting electronic glasses.Position and attitude is detected Unit 803 can be various position and attitude detection means.
Blinkpunkt detection unit 804 is used to be detected on screen according to human eye feature information, eye positions and attitude information Human eye fixation point.
Blinkpunkt detection unit 804 includes glasses blinkpunkt detection unit（It is not shown）With screen blinkpunkt detection unit （It is not shown）.Glasses blinkpunkt detection unit is used to obtain the human eye fixation point on electronic glasses according to human eye feature information.Tool Say, glasses blinkpunkt detection unit can be realized by existing Eye Tracking Technique obtains electronics according to human eye feature information body Human eye sight on glasses coordinate system, the human eye obtained further according to the human eye sight on electronic glasses coordinate system on electronic glasses is noted Viewpoint.Screen blinkpunkt detection unit is used for according to the human eye fixation point and the position of electronic glasses and posture on electronic glasses Information carries out corresponding coordinate transform, obtains the human eye fixation point on screen.
In one embodiment, the human eye feature information is the positional information of pupil center and corneal reflection point, glasses Blinkpunkt detection unit also includes computing unit（It is not shown）.Computing unit is believed according to the position of pupil center and corneal reflection point Breath calculates human eye fixation point of the human eye sight on electronic glasses.That is, human eye spy is analyzed using pupil-corneal reflection vector method Reference breath obtains the human eye sight on electronic glasses coordinate system, and electronic eyes is obtained according to the human eye sight on electronic glasses coordinate system Human eye fixation point on mirror.
Human eye action detection unit 805 is used for the change according to the human eye fixation point in human eye feature information and/or screen Situation detects human eye action.Including closing one's eyes, watching attentively, twitching of the eyelid, the human eye action such as smooth motion.When can not be from first scheduled time When obtaining corneal reflection point in human eye feature information, human eye action is detected as closing one's eyes.When the human eye fixation point on screen is second When keeping constant in the scheduled time, human eye action is detected as watching attentively；When the human eye fixation point on screen is within the 3rd scheduled time When moving range exceedes predetermined threshold, human eye action is detected as twitching of the eyelid；When the human eye fixation point on screen is moved at a predetermined velocity When, human eye action is detected as smooth motion.Above predetermined value can be with preset or be configured by user.
Transmitting element 806 is used to send the characteristic information of eye image shot and the eye positions of electronic glasses and appearance State information is to display.Transmitting element 806 can be various wireless data transmission devices.
It should be understood that equipment 800 can be implemented as electronic glasses or the remote control with electronic glasses.
Fig. 9 shows the flow chart of the method for the control display according to the 9th exemplary embodiment of the present invention.
In step 901, the characteristic information of the eye image shot and the glasses position of electronic glasses are received from electronic glasses Put and attitude information.
In step 902, the operation of display is controlled according to the human eye fixation point in human eye action and screen.Specifically, The various operations of display can be controlled by the various combination of the human eye fixation point in human eye action and screen.
For example, the human eye fixation point on screen is equivalent to the position where cursor when using mouse control display, or The position chosen using remote control during remote control control display, human eye action is equivalent to click mouse or presses remote control Button.For example, eye closing acts equivalent to click left mouse button or pressed the ACK button of remote control.
Preferably, the behaviour of display is controlled according to the human eye fixation point in human eye action and screen in different modes Make.
In view mode, when human eye action to watch attentively, and the human eye fixation point on screen is located at screen intermediate region When, the image for being pointed to blinkpunkt near zone is amplified and shown, facilitates user to can be clearly seen that oneself is of interest thin Micro- image.Wherein, the size of the blinkpunkt near zone amplified can be with preset or be configured by user.In screen display Image be moving image in the case of, when human eye action is smooth follows the trail of, according on the screen in smooth tracing process Human eye fixation point determine the object that human eye is followed the trail of, the information of the object is extracted from TV programme stream, to the object carry out Follow the trail of, the object followed the trail of is illustrated in the center of screen.When human eye action to watch attentively, and the human eye fixation point position on screen When screen border region, the direction that image is directed away from into the border is moved.For example：When human eye action to watch attentively, and shield When human eye fixation point on curtain is located at screen left margin region, image is moved to the right, the picture showing that left side is not showed Out.
Under user interface mode, the image of screen is divided into several regions, each specific function of Regional Representative.When Human eye fixation point on screen is located at a functional area, when then human eye action is closes one's eyes, and runs corresponding with the functional area Function.
For example：When user watches page-turning function region attentively, when then closing one's eyes, page-turning function is run.When human eye action is Human eye fixation point in smooth motion, and screen from a functional area be moved to another functional area when, focus is switched to Another region（That is, another region is chosen from choosing a region to be changed into）.
It should be understood that above step can be realized by display.
Figure 10 shows the block diagram of the equipment of the control display according to the tenth exemplary embodiment of the present invention.
As shown in Figure 10, included according to the equipment 1000 of the control display of the present invention：Receiving unit 1001, control unit 1002。
Receiving unit 1001 is used for the characteristic information and electronic glasses that the eye image shot is received from electronic glasses Eye positions and attitude information.
Control unit 1002 is used for the operation that display is controlled according to the human eye fixation point in human eye action and screen.Specifically Ground is said, the various operations of display can be controlled by the various combination of the human eye fixation point in human eye action and screen.
For example, the human eye fixation point on screen is equivalent to the position where cursor when using mouse control display, or The position chosen using remote control during remote control control display, human eye action is equivalent to click mouse or presses remote control Button.For example, eye closing acts equivalent to click left mouse button or pressed the ACK button of remote control.
Preferably, control unit 1002 is controlled according to the human eye fixation point in human eye action and screen in different modes The operation of display.
In view mode, when human eye action to watch attentively, and the human eye fixation point on screen is located at screen intermediate region When, the image for being pointed to blinkpunkt near zone is amplified and shown, facilitates user to can be clearly seen that oneself is of interest thin Micro- image.Wherein, the size of the blinkpunkt near zone amplified can be with preset or be configured by user.In screen display Image be moving image in the case of, when human eye action is smooth follows the trail of, according on the screen in smooth tracing process Human eye fixation point determine the object that human eye is followed the trail of, the information of the object is extracted from TV programme stream, to the object carry out Follow the trail of, the object followed the trail of is illustrated in the center of screen.When human eye action to watch attentively, and the human eye fixation point position on screen When screen border region, the direction that image is directed away from into the border is moved.For example：When human eye action to watch attentively, and shield When human eye fixation point on curtain is located at screen left margin region, image is moved to the right, the picture showing that left side is not showed Out.
Under user interface mode, the image of screen is divided into several regions, each specific function of Regional Representative.When Human eye fixation point on screen is located at a functional area, when then human eye action is closes one's eyes, and runs corresponding with the functional area Function.
For example：When user watches page-turning function region attentively, when then closing one's eyes, page-turning function is run.When human eye action is Human eye fixation point in smooth motion, and screen from a functional area be moved to another functional area when, focus is switched to Another region（That is, another region is chosen from choosing a region to be changed into）.
It should be understood that equipment 1000 may be arranged in display.
In addition, computer program is may be implemented as according to the above method of the exemplary embodiment of the present invention, so as to work as When running the program, the above method is realized.According to the present invention exemplary embodiment control display equipment in each Unit can be implemented nextport hardware component NextPort.Processing of the those skilled in the art according to performed by the unit of restriction, can for example make Use field programmable gate array（FPGA）Or application specific integrated circuit（ASIC）To realize unit.
Although having show and described some embodiments of the present invention, it will be understood by those skilled in the art that not taking off , can be to these embodiments in the case of from the principle of the invention and spirit that its scope is limited by claim and its equivalent Modify.

Claims (20)

1. a kind of method for controlling display, including：
Human eye, which is shot, by electronic glasses obtains eye image；
Human eye feature information is extracted from eye image, wherein, the human eye feature information is pupil center and corneal reflection point Positional information；
Detect the eye positions and attitude information of electronic glasses；
Human eye fixation point of the human eye sight on electronic glasses is gone out according to the positional information calculation of pupil center and corneal reflection point；
Human eye fixation point on screen is obtained according to the human eye fixation point on electronic glasses, eye positions and attitude information；
Human eye action is detected according to the situation of change of the human eye fixation point in human eye feature information and/or screen；
The operation of display is controlled according to the human eye fixation point in human eye action and screen.
2. the method for claim 1, wherein the human eye action include closing one's eyes, watch attentively, twitching of the eyelid, in smooth motion At least one.
3. method as claimed in claim 2, wherein,
When that can not obtain corneal reflection point in first scheduled time from human eye feature information, human eye action is detected as closing one's eyes；
When the human eye fixation point on screen keeps constant within second scheduled time, human eye action is detected as watching attentively；
When moving range exceedes predetermined threshold to the human eye fixation point on screen within the 3rd scheduled time, human eye action is detected as Twitching of the eyelid；
When the human eye fixation point on screen is moved at a predetermined velocity, human eye action is detected as smooth motion.
4. the method for claim 1, wherein in different modes according to people's eye fixation in human eye action and screen The operation of point control display.
5. display is the method for claim 1, wherein controlled according to the human eye fixation point in human eye action and screen The step of operation, includes：When display image screen, entered according to the human eye fixation point control display in human eye action and screen The following operation of row：
When human eye action is watches attentively, and the human eye fixation point on screen is when being located at screen intermediate region, is pointed on screen Image near human eye fixation point is amplified and shown；
In the case where the image of screen display is moving image, when human eye action is smooth follows the trail of, according to smoothly following the trail of During screen on human eye fixation point determine the object that human eye is followed the trail of, the object that human eye is followed the trail of is illustrated in screen Center；
When human eye action is watches attentively, and the human eye fixation point on screen is when being located at screen border region, and image is directed away from The direction movement on the border.
6. display is the method for claim 1, wherein controlled according to the human eye fixation point in human eye action and screen The step of operation, includes：When screen display user interface, controlled to show according to the human eye fixation point in human eye action and screen Device is proceeded as follows：
When the human eye fixation point on screen is located at a functional area, and then human eye action is closes one's eyes, operation and the functional area Corresponding function；
When human eye action is that human eye fixation point in smooth motion, and screen from a functional area is moved to another functional area When, focus is switched to another region.
7. the method as described in claim 1, in addition to：
Viewing angle during viewing screen is detected according to human eye feature information, eye positions and attitude information；
The depth of screen is adjusted according to viewing angle.
8. method as claimed in claim 7, wherein, the step of adjusting the depth of screen according to viewing angle includes：
When viewing angle exceedes predetermined angular threshold value, the depth in the region on screen close to electronic glasses is turned down, by screen The depth in the upper region away from electronic glasses is tuned up so that viewing angle is less than or equal to predetermined angular threshold value.
9. a kind of equipment for controlling display, including：
Eye image acquiring unit, shoots human eye by electronic glasses and obtains eye image；
Feature extraction unit, extracts human eye feature information from eye image, wherein, the human eye feature information is pupil center With the positional information of corneal reflection point；
Position and attitude detection unit, detects the eye positions and attitude information of electronic glasses；
Glasses blinkpunkt detection unit, human eye sight is gone out in electronics according to the positional information calculation of pupil center and corneal reflection point Human eye fixation point on glasses；
Screen blinkpunkt detection unit, screen is obtained according to the human eye fixation point on electronic glasses, eye positions and attitude information On human eye fixation point；
Human eye action detection unit, people is detected according to the situation of change of the human eye fixation point in human eye feature information and/or screen Eye action；
Control unit, the operation of display is controlled according to the human eye fixation point in human eye action and screen.
10. equipment as claimed in claim 9, wherein, human eye action detection unit be used for detecting eyes closing, watch attentively, twitching of the eyelid, smoothly At least one human eye action in motion.
11. equipment as claimed in claim 10, wherein,
When that can not obtain corneal reflection point in first scheduled time from human eye feature information, human eye action is detected as closing one's eyes；
When the human eye fixation point on screen keeps constant within second scheduled time, human eye action is detected as watching attentively；
When moving range exceedes predetermined threshold to the human eye fixation point on screen within the 3rd scheduled time, human eye action is detected as Twitching of the eyelid；
When the human eye fixation point on screen is moved at a predetermined velocity, human eye action is detected as smooth motion.
12. equipment as claimed in claim 9, wherein, control unit is in different modes according in human eye action and screen Human eye fixation point control display operation.
13. equipment as claimed in claim 9, wherein, when display image screen, control unit is according to human eye action and screen On human eye fixation point control display proceed as follows：
When human eye action is watches attentively, and the human eye fixation point on screen is when being located at screen intermediate region, is pointed on screen Image near human eye fixation point is amplified and shown；
In the case where the image of screen display is moving image, when human eye action is smooth follows the trail of, according to smoothly following the trail of During screen on human eye fixation point determine the object that human eye is followed the trail of, the object that human eye is followed the trail of is illustrated in screen Center；
When human eye action is watches attentively, and the human eye fixation point on screen is when being located at screen border region, and image is directed away from The direction movement on the border.
14. equipment as claimed in claim 9, wherein, when screen display user interface, control unit according to human eye action and Human eye fixation point control display on screen is proceeded as follows：
When the human eye fixation point on screen is located at a functional area, and then human eye action is closes one's eyes, operation and the functional area Corresponding function；
When human eye action is that human eye fixation point in smooth motion, and screen from a functional area is moved to another functional area When, focus is switched to another region.
15. equipment as claimed in claim 9, in addition to：
Viewing angle detection unit, viewing during viewing screen is detected according to human eye feature information, eye positions and attitude information Angle；
Depth adjustment unit, the depth of screen is adjusted according to viewing angle.
16. equipment as claimed in claim 15, wherein, when viewing angle exceedes predetermined angular threshold value, depth adjustment unit The depth in the region on screen close to electronic glasses is turned down, the depth in the region away from electronic glasses on screen is tuned up, made Obtain viewing angle and be less than or equal to angle predetermined threshold.
17. a kind of method for controlling display, including：
The human eye feature information of eye image shot and the eye positions of electronic glasses and posture letter are received from electronic glasses Breath, wherein, the human eye feature information is the positional information of pupil center and corneal reflection point；
Human eye fixation point of the human eye sight on electronic glasses is gone out according to the positional information calculation of pupil center and corneal reflection point；
Human eye fixation point on screen is obtained according to the human eye fixation point on electronic glasses, eye positions and attitude information；
Human eye action is detected according to the situation of change of the human eye fixation point in human eye feature information and/or screen；
The operation of display is controlled according to the human eye fixation point in human eye action and screen.
18. a kind of equipment for controlling display, including：
Receiving unit, the human eye feature information and the eye positions of electronic glasses of the eye image shot are received from electronic glasses And attitude information, wherein, the human eye feature information is the positional information of pupil center and corneal reflection point；
Glasses blinkpunkt detection unit, human eye sight is gone out in electronics according to the positional information calculation of pupil center and corneal reflection point Human eye fixation point on glasses；
Screen blinkpunkt detection unit, screen is obtained according to the human eye fixation point on electronic glasses, eye positions and attitude information On human eye fixation point；
Human eye action detection unit, people is detected according to the situation of change of the human eye fixation point in human eye feature information and/or screen Eye action；
Control unit, the operation of display is controlled according to the human eye fixation point in human eye action and screen.
19. a kind of method of utilization electronic glasses Remote Control Indicator, including：
Human eye, which is shot, by electronic glasses obtains eye image；
Human eye feature information is extracted from eye image, wherein, the human eye feature information is pupil center and corneal reflection point Positional information；
Detect the eye positions and attitude information of electronic glasses；
Human eye fixation point of the human eye sight on electronic glasses is gone out according to the positional information calculation of pupil center and corneal reflection point；
Human eye fixation point on screen is obtained according to the human eye fixation point on electronic glasses, eye positions and attitude information；
Human eye action is detected according to the situation of change of the human eye fixation point in human eye feature information and/or screen；
By for controlling the human eye fixation point in the human eye action and screen of the operation of display to be sent to display.
20. a kind of equipment of utilization electronic glasses Remote Control Indicator, including：
Eye image acquiring unit, shoots human eye by electronic glasses and obtains eye image；
Feature extraction unit, extracts human eye feature information from eye image, wherein, the human eye feature information is pupil center With the positional information of corneal reflection point；
Position and attitude detection unit, detects the eye positions and attitude information of electronic glasses；
Glasses blinkpunkt detection unit, human eye sight is gone out in electronics according to the positional information calculation of pupil center and corneal reflection point Human eye fixation point on glasses；
Screen blinkpunkt detection unit, screen is obtained according to the human eye fixation point on electronic glasses, eye positions and attitude information On human eye fixation point；
Human eye action detection unit, people is detected according to the situation of change of the human eye fixation point in human eye feature information and/or screen Eye action；
Transmitting element, by for controlling the human eye fixation point in the human eye action and screen of the operation of display to be sent to display Device.
CN201310445336.4A 2013-09-26 2013-09-26 Control the method and apparatus of display Active CN103500061B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201310445336.4A CN103500061B (en) 2013-09-26 2013-09-26 Control the method and apparatus of display

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201310445336.4A CN103500061B (en) 2013-09-26 2013-09-26 Control the method and apparatus of display

Publications (2)

Publication Number Publication Date
CN103500061A CN103500061A (en) 2014-01-08
CN103500061B true CN103500061B (en) 2017-11-07

Family

ID=49865277

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201310445336.4A Active CN103500061B (en) 2013-09-26 2013-09-26 Control the method and apparatus of display

Country Status (1)

Country Link
CN (1) CN103500061B (en)

Families Citing this family (33)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103777759A (en) * 2014-02-18 2014-05-07 马根昌 Electronic glass action identification system
CN103853330B (en) * 2014-03-05 2017-12-01 努比亚技术有限公司 Method and mobile terminal based on eyes control display layer switching
US20150261293A1 (en) * 2014-03-12 2015-09-17 Weerapan Wilairat Remote device control via gaze detection
CN103885592B (en) * 2014-03-13 2017-05-17 宇龙计算机通信科技(深圳)有限公司 Method and device for displaying information on screen
CN103914151B (en) * 2014-04-08 2016-08-17 小米科技有限责任公司 Method for information display and device
CN103974115B (en) * 2014-04-23 2017-07-11 京东方科技集团股份有限公司 A kind of high resolution display method and system
WO2015170142A1 (en) 2014-05-08 2015-11-12 Sony Corporation Portable electronic equipment and method of controlling a portable electronic equipment
US20160011657A1 (en) * 2014-07-14 2016-01-14 Futurewei Technologies, Inc. System and Method for Display Enhancement
CN105589646A (en) * 2014-10-23 2016-05-18 宇龙计算机通信科技(深圳)有限公司 Screen capturing method and system
US10228904B2 (en) * 2014-11-12 2019-03-12 Lenovo (Singapore) Pte. Ltd. Gaze triggered voice recognition incorporating device velocity
KR101619661B1 (en) * 2014-12-08 2016-05-10 현대자동차주식회사 Detection method of face direction of driver
CN105786374A (en) * 2014-12-25 2016-07-20 联想(北京)有限公司 Object browsing mode switching method and terminal device
CN104677377A (en) * 2015-02-10 2015-06-03 奇瑞汽车股份有限公司 Vehicle navigation method and system
CN104866100B (en) * 2015-05-27 2018-11-23 京东方科技集团股份有限公司 Eye control device and its eye prosecutor method and eye control system
CN106325695A (en) * 2015-06-29 2017-01-11 宇龙计算机通信科技(深圳)有限公司 Intelligent display method and device for terminal, and terminal
CN105892642A (en) * 2015-12-31 2016-08-24 乐视移动智能信息技术（北京）有限公司 Method and device for controlling terminal according to eye movement
CN105425971B (en) * 2016-01-15 2018-10-26 中意工业设计（湖南）有限责任公司 A kind of exchange method, device and the near-eye display at eye movement interface
CN105847540A (en) * 2016-03-16 2016-08-10 惠州Tcl移动通信有限公司 Method and mobile phone for controlling picture movement of VR (Virtual Reality) glasses based on eyeball tracking and VR glasses
CN105847538B (en) * 2016-03-16 2021-06-01 惠州Tcl移动通信有限公司 Mobile phone and method for controlling VR (virtual reality) glasses operation based on eyeball tracking
CN105929957A (en) * 2016-04-26 2016-09-07 深圳市奋达科技股份有限公司 Control method, apparatus and device for intelligent glasses
JP6729054B2 (en) * 2016-06-23 2020-07-22 富士ゼロックス株式会社 Information processing apparatus, information processing system, and image forming apparatus
CN106060544B (en) * 2016-06-29 2020-04-28 华为技术有限公司 Image coding method, related equipment and system
CN107092346B (en) * 2017-03-01 2021-12-24 联想(北京)有限公司 Information processing method and electronic equipment
CN107247511B (en) * 2017-05-05 2019-07-16 浙江大学 A kind of across object exchange method and device captured based on eye movement in virtual reality
CN109141461A (en) * 2017-06-13 2019-01-04 博世汽车部件(苏州)有限公司 Automobile digital map navigation control system and method
CN109213323B (en) * 2018-08-28 2022-04-29 北京航空航天大学青岛研究院 Method for realizing screen attitude estimation based on eye movement interaction technology
CN109669615A (en) * 2018-12-26 2019-04-23 北京七鑫易维信息技术有限公司 Information control method, system, storage medium and electronic equipment
CN111736698A (en) * 2020-06-23 2020-10-02 中国人民解放军63919部队 Sight line pointing method for manual auxiliary positioning
CN114071150B (en) * 2020-07-31 2023-06-16 京东方科技集团股份有限公司 Image compression method and device, image display method and device and medium
CN112965607A (en) * 2021-04-14 2021-06-15 杭州艾斯凯尔科技有限公司 Glasses mouse and control method thereof
CN113362775B (en) * 2021-06-24 2023-03-21 东莞市小精灵教育软件有限公司 Display screen control method and device, electronic equipment and storage medium
CN113864579A (en) * 2021-08-24 2021-12-31 华人运通(江苏)技术有限公司 Screen adjusting device, display device and vehicle
CN116052235B (en) * 2022-05-31 2023-10-20 荣耀终端有限公司 Gaze point estimation method and electronic equipment

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101893934A (en) * 2010-06-25 2010-11-24 宇龙计算机通信科技(深圳)有限公司 Method and device for intelligently adjusting screen display
CN101989126A (en) * 2009-08-07 2011-03-23 深圳富泰宏精密工业有限公司 Handheld electronic device and automatic screen picture rotating method thereof
CN102087582A (en) * 2011-01-27 2011-06-08 广东威创视讯科技股份有限公司 Automatic scrolling method and device
CN202795232U (en) * 2012-09-17 2013-03-13 武汉元宝创意科技有限公司 Demonstration system based on sightline tracking technology
CN102981620A (en) * 2012-11-27 2013-03-20 中兴通讯股份有限公司 Terminal operation method and terminal

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
AU2011204946C1 (en) * 2011-07-22 2012-07-26 Microsoft Technology Licensing, Llc Automatic text scrolling on a head-mounted display

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101989126A (en) * 2009-08-07 2011-03-23 深圳富泰宏精密工业有限公司 Handheld electronic device and automatic screen picture rotating method thereof
CN101893934A (en) * 2010-06-25 2010-11-24 宇龙计算机通信科技(深圳)有限公司 Method and device for intelligently adjusting screen display
CN102087582A (en) * 2011-01-27 2011-06-08 广东威创视讯科技股份有限公司 Automatic scrolling method and device
CN202795232U (en) * 2012-09-17 2013-03-13 武汉元宝创意科技有限公司 Demonstration system based on sightline tracking technology
CN102981620A (en) * 2012-11-27 2013-03-20 中兴通讯股份有限公司 Terminal operation method and terminal

Also Published As

Publication number Publication date
CN103500061A (en) 2014-01-08

Similar Documents

Publication Publication Date Title
CN103500061B (en) Control the method and apparatus of display
CN103513768B (en) A kind of control method based on mobile terminal attitudes vibration and device, mobile terminal
KR101585466B1 (en) Method for Controlling Operation of Electronic Appliance Using Motion Detection and Electronic Appliance Employing the Same
CN108153424B (en) Eye movement and head movement interaction method of head display equipment
KR102568708B1 (en) Apparatus and method for recognizing hand gestures in a virtual reality headset
WO2018072339A1 (en) Virtual-reality helmet and method for switching display information of virtual-reality helmet
US9886086B2 (en) Gesture-based reorientation and navigation of a virtual reality (VR) interface
JP6340301B2 (en) Head mounted display, portable information terminal, image processing apparatus, display control program, display control method, and display system
US9412190B2 (en) Image display system, image display apparatus, image display method, and non-transitory storage medium encoded with computer readable program
JP2013258614A (en) Image generation device and image generation method
US8675136B2 (en) Image display apparatus and detection method
US20120121185A1 (en) Calibrating Vision Systems
CN108491072B (en) Virtual reality interaction method and device
GB2474536A (en) Computer vision gesture based control by hand shape recognition and object tracking
GB2507963A (en) Controlling a Graphical User Interface
US20140053115A1 (en) Computer vision gesture based control of a device
US20140118244A1 (en) Control of a device by movement path of a hand
WO2013175701A1 (en) Video analysis device, video analysis method, and point-of-gaze display system
CN112666705A (en) Eye movement tracking device and eye movement tracking method
CN108549485B (en) Information processing method and wearable electronic equipment
CN107404626B (en) Video live broadcast system based on robot
CN103150021A (en) Electronic book reading control system and electronic book reading control method
KR101856547B1 (en) Method for processing of signal of user and apparatus for performing the method
JP7026638B2 (en) Head rotation tracking device for recognizing video highlights
JP2015052895A (en) Information processor and method of processing information

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant