CN106502378A - The control method at a kind of electronic equipment interface and electronic equipment - Google Patents
The control method at a kind of electronic equipment interface and electronic equipment Download PDFInfo
- Publication number
- CN106502378A CN106502378A CN201610811405.2A CN201610811405A CN106502378A CN 106502378 A CN106502378 A CN 106502378A CN 201610811405 A CN201610811405 A CN 201610811405A CN 106502378 A CN106502378 A CN 106502378A
- Authority
- CN
- China
- Prior art keywords
- user
- information
- sight line
- electronic equipment
- control instruction
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
- Position Input By Displaying (AREA)
Abstract
The embodiment of the present application discloses the control method at a kind of electronic equipment interface and electronic equipment.The control method at a kind of electronic equipment interface includes：User's sight line is obtained by the sight line harvester of electronic equipment；User's sight line is analyzed, the variation track information of user's sight line is obtained；Control instruction is generated according to the variation track information of user's sight line；The electronic equipment current display interface is controlled according to the control instruction.The technical scheme of the embodiment of the present invention be easy to user inconvenience handss operation electronic equipment in the case of, the control to interface of electronic equipment is realized with eyes, offer convenience to the use of user, the mode of operation of electronic equipment is also enriched simultaneously, increase interest of the user using electronic equipment, lift Consumer's Experience.
Description
Technical field
The present invention relates to electronic equipment control field, the more particularly to control method at a kind of electronic equipment interface and electronics set
Standby.
Background technology
With the fast development of science and technology, electronic equipment is increasingly popularized in the life of people, such as smart mobile phone,
Panel computer, intelligent watch etc..People can obtain information in daily life by this class of electronic devices, for example, inquire about traffic
Information, Weather information, recreational facilities information, Domestic News etc..Therefore, for the application of this kind of product, people has been penetrated into
Live in every aspect.
At present, for the control mode of this kind of Product Interface is substantially touch, user is needed to touch its screen with handss
Operated, in the case that user's both hands hold thing or one-handed performance shakiness, although have been realized in Voice command work(
Can, but the application of this function is also restricted, such as in public, when surrounding is more noisy, Voice command work(
The effect of energy is unsatisfactory, result in operation inconvenience of the user in such cases to electronic equipment.
Content of the invention
Control method and the electronic equipment at a kind of electronic equipment interface is embodiments provided, to providing a kind of working as
When user's both hands hold thing or unstable one-handed performance, user can be facilitated to make with the method at eyes control electronics interface
With while also enriching the mode of operation of electronic equipment, interest of the increase user using electronic equipment lifts Consumer's Experience.
Embodiment of the present invention first aspect provides the control method at a kind of electronic equipment interface, including：
User's sight line is obtained by the sight line harvester of electronic equipment；
User's sight line is analyzed, the variation track information of user's sight line is obtained；
Control instruction is generated according to the variation track information of user's sight line；
The electronic equipment current display interface is controlled according to the control instruction.
In conjunction with the embodiment of the present invention in a first aspect, in the first implementation of embodiment of the present invention first aspect, institute
State and user's sight line is obtained by electronic equipment sight line harvester, including：Front-facing camera using the electronic equipment is to institute
The eyeball for stating user is tracked, and identifies the position and direction of the user eyeball, according to the position of the user eyeball and
The particular location that the incident point that user's pupil described in Orientation is focused on is projected in the electronic equipment current display interface, so as to
Obtain user's sight line.
In conjunction with the embodiment of the present invention in a first aspect, in second implementation of embodiment of the present invention first aspect, institute
State and user's sight line is obtained by electronic equipment sight line harvester, including：Using infrared camera, by the eyes of user
The infrared light of pupillary reflex is obtaining user's sight line.
In conjunction with embodiment of the present invention first aspect or embodiment of the present invention first aspect the first in second appoint
A kind of implementation, in the third implementation of embodiment of the present invention first aspect, the variation track of user's sight line
Information includes following at least one：
Information is moved to left, information, upper shifting information is moved to right, is moved down information, information of blinking at least one times, fixed project information；Its
Described in fix project information refer to user's sight line fix be incident upon the current display interface predeterminable area when be up to
Arrive preset time threshold.
In conjunction with embodiment of the present invention first aspect or embodiment of the present invention first aspect the first in the third appoint
A kind of implementation, in the 4th kind of implementation of embodiment of the present invention first aspect, the control instruction include with down to
Few one kind：
Left cunning, right cunning, upper cunning, downslide, scaling, sectional drawing, click, length are pressed, are pulled.
Embodiment of the present invention second aspect provides a kind of electronic equipment, including：
Acquiring unit, for obtaining user's sight line by the sight line harvester of electronic equipment；
Analytic unit, for being analyzed to user's sight line, obtains the variation track information of user's sight line；
Instruction generation unit, for generating control instruction according to the variation track information of user's sight line；
Performance element, for being controlled to the electronic equipment current display interface according to the control instruction.
In conjunction with embodiment of the present invention second aspect, in the first implementation of embodiment of the present invention second aspect, institute
Stating acquiring unit also includes：
Track identification unit, for being chased after to the eyeball of the user using the front-facing camera of the electronic equipment
Track, identifies the position and direction of the user eyeball；
Analysis acquiring unit, the throwing that user's pupil is focused on for the position according to the user eyeball and described in Orientation
The particular location that exit point is projected in the electronic equipment current display interface, so that obtain user's sight line.
In conjunction with embodiment of the present invention second aspect, in second implementation of embodiment of the present invention second aspect, institute
Acquiring unit is stated specifically for using infrared camera, the infrared light by the pupillary reflex of the eyes of user is to obtain
State user's sight line.
In conjunction with embodiment of the present invention second aspect or embodiment of the present invention second aspect the first in second appoint
A kind of implementation, in the third implementation of embodiment of the present invention second aspect, the variation track of user's sight line
Information includes following at least one：
Information is moved to left, information, upper shifting information is moved to right, is moved down information, information of blinking at least one times, fixed project information；Its
Described in fix project information refer to user's sight line fix be incident upon the current display interface predeterminable area when be up to
Arrive preset time threshold.
In conjunction with embodiment of the present invention second aspect or embodiment of the present invention second aspect the first in the third appoint
A kind of implementation, in the 4th kind of implementation of embodiment of the present invention second aspect, the control instruction include with down to
Few one kind：
Left cunning, right cunning, upper cunning, downslide, scaling, sectional drawing, click, length are pressed, are pulled.
As can be seen that the scheme of the present embodiment simplifies operational approach of the user to electronic equipment, when user's both hands are held
When thing or unstable one-handed performance, interface of electronic equipment can be controlled with eyes, be user-friendly to, while also enriching
The mode of operation of electronic equipment, increases interest of the user using electronic equipment, lifts Consumer's Experience.
Description of the drawings
For the technical scheme being illustrated more clearly that in the embodiment of the present invention, below will be attached to used needed for embodiment
Figure is briefly described, it should be apparent that, drawings in the following description are only some embodiments of the present invention, for this area
For those of ordinary skill, on the premise of not paying creative work, can be with according to these other accompanying drawings of accompanying drawings acquisition.
Fig. 1 is the control method flow chart at a kind of electronic equipment interface provided in an embodiment of the present invention；
Fig. 2-a provide a kind of scene presentation flow chart for the embodiment of the present invention；
Fig. 2-b are a kind of scene hint effect figure provided in an embodiment of the present invention；
Fig. 3 is a kind of electronic equipment structural representation provided in an embodiment of the present invention；
Fig. 4 is a kind of structural representation of acquiring unit provided in an embodiment of the present invention；
Fig. 5 is another kind of electronic devices structure schematic diagram provided in an embodiment of the present invention.
Specific embodiment
Control method and the electronic equipment at a kind of electronic equipment interface is embodiments provided, to providing a kind of working as
When user's both hands hold thing or unstable one-handed performance, user can be facilitated to make with the method at eyes control electronics interface
With while also enriching the mode of operation of electronic equipment, interest of the increase user using electronic equipment lifts Consumer's Experience.
The term " comprising " and " having " occurred in description of the invention, claims and accompanying drawing and their any changes
Shape, it is intended that cover non-exclusive including.For example contain the process of series of steps or unit, method, system, product or
Equipment is not limited to the step of listing or unit, but alternatively also includes the step of not listing or unit, or optional
Ground also includes other steps intrinsic for these processes, method, product or equipment or unit.
The flow chart that the lower the embodiment of the present application scheme of introduction of illustrating with reference to relevant drawings first below may be used.
Referring specifically to shown in Fig. 1, Fig. 1 is the control method flow process at a kind of electronic equipment interface provided in an embodiment of the present invention
Figure, specifically includes：
Step S101, the sight line harvester acquisition user's sight line for passing through electronic equipment.
Wherein, the electronic equipment for referring in the embodiment of the present invention can for example be mobile phone, panel computer, palm PC, intelligence
Wrist-watch or other mobile terminals.
Wherein, the sight line harvester for referring in the embodiment of the present invention can for example be front-facing camera, infrared camera, biography
Sensor etc..
Optionally, the eyeball of the user is tracked using the front-facing camera of the electronic equipment, identifies institute
The position and direction of user eyeball is stated, the projection that user's pupil is focused on according to the position of the user eyeball and described in Orientation
Particular location of the point in electronic equipment current display interface projection, so that obtain user's sight line.
Optionally, using infrared camera and front-facing camera, the eyes of user is collected by front-facing camera
The infrared light sent by infrared camera of pupillary reflex, so that obtain user's sight line.
Step S102, user's sight line is analyzed, obtains the variation track information of user's sight line.
Wherein, the variation track information of user's sight line can include following at least one：
Information is moved to left, information, upper shifting information is moved to right, is moved down information, information of blinking at least one times, fixed project information；Its
Described in fix project information refer to user's sight line fix be incident upon the current display interface predeterminable area when be up to
Arrive preset time threshold.It is appreciated that user's sight line variation track information be not limited to have listed this is several.
Wherein, blink information can include once blink information and information of blinking twice at least one times；When once blinking it
When dead time afterwards is more than time threshold X (value of X can for example be 1s, 1.5s, 2s), judge that blink release, system are protected
Deposit once blink information；When continuous number of winks be twice and second blink after dead time be more than time threshold X when,
Judge that blink release, system preserve the information that blink twice.
Wherein, the duration that user's sight line fixation is incident upon the current display interface predeterminable area reaches Preset Time
During threshold value Y (value of Y can for example be 1s, 1.5s, 2s), it is judged as fixing projection action, system preserves fixed project information.
Step S103, according to the variation track information of user's sight line generate control instruction.
Wherein, the control instruction can include following at least one：Left cunning, right cunning, upper cunning, downslide, scaling, sectional drawing,
Click on, length is pressed, pulled.It is appreciated that the control instruction be not limited to have listed this is several.
Preferably, user can be according to the use habit of oneself, default control instruction database on an electronic device, and different regards
Line variation track corresponds to different control instructions.When user's sight line changes, can in default control instruction storehouse,
According to the variation track information of user's sight line, corresponding control instruction is called.
Optionally, electronic equipment carries a control instruction storehouse, and specific sight line variation track information is corresponding to specific
Control instruction.User can call corresponding control instruction according to explanation with specific sight line variation track information.
For example, when the user's sight line variation track information for obtaining is for moving to left information, the control instruction of the left cunning in interface is generated；
When the user's sight line variation track information for obtaining is for moving to right information, the control instruction of the right cunning in interface is generated；
When the user's sight line variation track information for obtaining is upper shifting information, sliding control instruction on interface is generated；
When the user's sight line variation track information for obtaining is for moving down information, the control instruction that interface glides is generated；
When the user's sight line variation track information for obtaining information and moves down letter for moving to right information and upper shifting information or moving to left
During breath, the instruction that interface is amplified is generated；Wherein, move to right information and upper shifting information can be while obtain；Move to left information and move down letter
Breath can be obtained simultaneously；
When the user's sight line variation track information for obtaining for move to right information and move down information or move to left information and upper shifting letter
During breath, the control instruction that interface reduces is generated；Wherein, move to right information and move down information can be while obtaining；Move to left information and upper
Shifting information can be obtained simultaneously；
When the user's sight line variation track information for obtaining is once to blink information, generates and click on control instruction；
When the user's sight line variation track information for obtaining is to blink information twice, sectional drawing control instruction is generated；
When the user's sight line variation track information for obtaining is for fixing project information, generate long by control instruction；Wherein institute
State fixed project information refer to user's sight line fix be incident upon the current display interface predeterminable area duration reach pre-
If time threshold；
When the user's sight line variation track information for obtaining is for fixing project information and mobile message, generates and pull instruction；
Wherein mobile message can include：Information is moved to left, move to right information, upper shifting information, move down information, the dragging instruction of generation includes
Drag direction instruction is corresponding with the directional information that mobile message includes.
The corresponding control instruction produced above according to user's sight line variation track information is preferred version, but does not limit
In this scheme, it is possibility to have other schemes.
Again for example, when the user's sight line variation track information for obtaining is for moving to left information, the control for generating the right cunning in interface refers to
Order；
When the user's sight line variation track information for obtaining is for moving to right information, the control instruction of the left cunning in interface is generated；
When the user's sight line variation track information for obtaining is upper shifting information, the control instruction that interface glides is generated；
When the user's sight line variation track information for obtaining is for moving down information, sliding control instruction on interface is generated；
When the user's sight line variation track information for obtaining information and moves down letter for moving to right information and upper shifting information or moving to left
During breath, the instruction that interface reduces is generated；Wherein, move to right information and upper shifting information can be while obtain；Move to left information and move down letter
Breath can be obtained simultaneously；
When the user's sight line variation track information for obtaining for move to right information and move down information or move to left information and upper shifting letter
During breath, the control instruction that interface is amplified is generated；Wherein, move to right information and move down information can be while obtaining；Move to left information and upper
Shifting information can be obtained simultaneously.
Step S104, the electronic equipment current display interface is controlled according to the control instruction.
Optionally, when the control instruction for left sliding when, the current display interface of the electronic equipment is turned left cunning；
When the control instruction for right sliding when, the current display interface of the electronic equipment is turned right cunning；
When the control instruction is upper sliding, the current display interface of the electronic equipment is up slided；
When the control instruction is for gliding, the current display interface of the electronic equipment slides down；
When the control instruction is for amplifying, the current display interface of the electronic equipment is exaggerated；
When the control instruction is for reducing, the current display interface of the electronic equipment is reduced；
When the control instruction is for clicking on, user's sight line fixes the preset areas for being incident upon the current display interface
Domain is clicked；
When the control instruction is sectional drawing, the current display interface of the electronic equipment is by sectional drawing, and preserves sectional drawing knot
Really；
When the control instruction is for growing on time, user's sight line fixes the preset areas for being incident upon the current display interface
Domain is long pressed；
When the control instruction is for pulling, user's sight line fixes the preset areas for being incident upon the current display interface
Domain is dragged；Wherein, icon can be included in this predeterminable area.
As can be seen that the scheme of the present embodiment simplifies operational approach of the user to electronic equipment.When user's both hands are held
When thing or unstable one-handed performance, interface of electronic equipment can be controlled with eyes, be user-friendly to, while also enriching
The mode of operation of electronic equipment, increases interest of the user using electronic equipment, lifts Consumer's Experience.
In order to more fully understand and implement said method and the using effect of the embodiment of the present invention, with reference to specific
Application scenarios are being illustrated.
Refer to Fig. 2-a and Fig. 2-b, Fig. 2-a provides a kind of scene presentation flow chart for the embodiment of the present invention；Fig. 2-b are
A kind of scene hint effect figure provided in an embodiment of the present invention, by taking mobile phone as an example.Wherein, 210 is the front-facing camera of mobile phone,
220 is the eyes of user.
Wherein, as shown in Fig. 2-a, when user needs mobile phone to show unlock interface, the process may comprise steps of：
Step S201, user press power key, and mobile phone screen is lighted, and current display interface shows " slip to unlock "；Such as
Shown in display interface of mobile phone before the movement of Fig. 2-b eyes of user；
Step S202, eyes of user stare at mobile phone screen any position and see from left to right；
Step S203, the front-facing camera of mobile phone obtain user's sight line；
Step S204, user's sight line is analyzed, the variation track information of user's sight line is obtained for moving to right information；
Step S205, according to obtain move to right information generate move to right control instruction, mobile phone screen is moved to right, show " please be input into
The unlock interface of password "；As shown in the display interface of mobile phone after the movement of Fig. 2-b eyes of user.
As can be seen that the scheme of the present embodiment simplifies operational approach of the user to electronic equipment.When user's both hands are held
When thing or unstable one-handed performance, interface of electronic equipment can be controlled with eyes, be user-friendly to, while also enriching
The mode of operation of electronic equipment, increases interest of the user using electronic equipment, lifts Consumer's Experience.
In order to preferably implement the such scheme of the embodiment of the present invention, the present invention also correspondingly provides a kind of electronic equipment,
The a kind of electronic equipment structural representation that one embodiment of the present of invention as shown in Figure 3 is provided, electronic equipment 300 can be wrapped
Include：Acquiring unit 310, analytic unit 320, instruction generation unit 330 and performance element 340.
Wherein, acquiring unit 310, for obtaining user's sight line by the sight line harvester of electronic equipment.
Specifically, the structural representation of a kind of acquiring unit provided in an embodiment of the present invention as shown in Figure 4, acquiring unit
310 include：Track identification unit 3110 and analysis acquiring unit 3120, wherein,
Track identification unit 3110, is carried out to the eyeball of the user for the front-facing camera using the electronic equipment
Follow the trail of, identify the position and direction of the user eyeball；
Analysis acquiring unit 3120, user's pupil is focused on for the position according to the user eyeball and described in Orientation
The particular location that projects in the electronic equipment current display interface of incident point, so as to obtain user's sight line.
Optionally, the acquiring unit is specifically for using infrared camera and front-facing camera, by front-facing camera
To collect the infrared light sent by infrared camera of the pupillary reflex of the eyes of user, so as to obtain user's sight line.
Analytic unit 320, for being analyzed, obtains the variation track letter of user's sight line to user's sight line
Breath.
Wherein, the variation track information of user's sight line can include following at least one：Move to left information, move to right letter
Breath, upper shifting information, move down information, blink information, fixed project information at least one times；Wherein described fixed project information refers to institute
State user's sight line and fix and be incident upon the duration of the current display interface predeterminable area and reach preset time threshold.It is appreciated that
The variation track information of user's sight line be not limited to have listed this is several.
Wherein, blink information can include once blink information and information of blinking twice at least one times；When once blinking it
When dead time afterwards is more than time threshold X (value of X can for example be 1s, 1.5s, 2s), judge that blink release, system are protected
Deposit once blink information；When continuous number of winks be twice and second blink after dead time be more than time threshold X when,
Judge that blink release, system preserve the information that blink twice.
Wherein, the duration that user's sight line fixation is incident upon the current display interface predeterminable area reaches Preset Time
During threshold value Y (value of Y can for example be 1s, 1.5s, 2s), it is judged as fixing projection action, system preserves fixed project information.
Instruction generation unit 330, for generating control instruction according to the variation track information of user's sight line.
Wherein, the control instruction can include following at least one：Left cunning, right cunning, upper cunning, downslide, scaling, sectional drawing,
Click on, length is pressed, pulled.It is appreciated that the control instruction be not limited to have listed this is several.
Preferably, user can be according to the use habit of oneself, default control instruction database on an electronic device, and different regards
Line variation track corresponds to different control instructions.When user's sight line changes, can in default control instruction storehouse,
According to the variation track information of user's sight line, corresponding control instruction is called.
Optionally, electronic equipment carries a control instruction storehouse, and specific sight line variation track information is corresponding to specific
Control instruction.User can call corresponding control instruction according to explanation with specific sight line variation track information.
For example, when the user's sight line variation track information for obtaining is for moving to left information, the control instruction of the left cunning in interface is generated；
When the user's sight line variation track information for obtaining is for moving to right information, the control instruction of the right cunning in interface is generated；
When the user's sight line variation track information for obtaining is upper shifting information, sliding control instruction on interface is generated；
When the user's sight line variation track information for obtaining is for moving down information, the control instruction that interface glides is generated；
When the user's sight line variation track information for obtaining information and moves down letter for moving to right information and upper shifting information or moving to left
During breath, the instruction that interface is amplified is generated；Wherein, move to right information and upper shifting information can be while obtain；Move to left information and move down letter
Breath can be obtained simultaneously；
When the user's sight line variation track information for obtaining for move to right information and move down information or move to left information and upper shifting letter
During breath, the control instruction that interface reduces is generated；Wherein, move to right information and move down information can be while obtaining；Move to left information and upper
Shifting information can be obtained simultaneously；
When the user's sight line variation track information for obtaining is once to blink information, generates and click on control instruction；
When the user's sight line variation track information for obtaining is to blink information twice, sectional drawing control instruction is generated；
When the user's sight line variation track information for obtaining is for fixing project information, generate long by control instruction；Wherein institute
State fixed project information refer to user's sight line fix be incident upon the current display interface predeterminable area duration reach pre-
If time threshold；
When the family sight line variation track information for obtaining is to fix project information and mobile message, generates and pull instruction；
Wherein mobile message includes：Information is moved to left, information, upper shifting information is moved to right, is moved down information, the dragging of generation instructs the dragging for including
Direction instruction is corresponding with the directional information that mobile message includes.
The corresponding control instruction produced above according to user's sight line variation track information is preferred version, but does not limit
In this scheme, it is possibility to have other schemes.
Again for example, when the user's sight line variation track information for obtaining be a left side when the user's sight line variation track information that obtain
During shifting information, the control instruction of the right cunning in interface is generated；
When the user's sight line variation track information for obtaining is for moving to right information, the control instruction of the left cunning in interface is generated；
When the user's sight line variation track information for obtaining is upper shifting information, the control instruction that interface glides is generated；
When the user's sight line variation track information for obtaining is for moving down information, sliding control instruction on interface is generated；
When the user's sight line variation track information for obtaining information and moves down letter for moving to right information and upper shifting information or moving to left
During breath, the instruction that interface reduces is generated；Wherein, move to right information and upper shifting information can be while obtain；Move to left information and move down letter
Breath can be obtained simultaneously；
When the user's sight line variation track information for obtaining for move to right information and move down information or move to left information and upper shifting letter
During breath, the control instruction that interface is amplified is generated；Wherein, move to right information and move down information can be while obtaining；Move to left information and upper
Shifting information can be obtained simultaneously.
Performance element 340, for being controlled to the electronic equipment current display interface according to the control instruction.
Optionally, when the control instruction for left sliding when, the current display interface of the electronic equipment is turned left cunning；
When the control instruction for right sliding when, the current display interface of the electronic equipment is turned right cunning；
When the control instruction is upper sliding, the current display interface of the electronic equipment is up slided；
When the control instruction is for gliding, the current display interface of the electronic equipment slides down；
When the control instruction is for amplifying, the current display interface of the electronic equipment is exaggerated；
When the control instruction is for reducing, the current display interface of the electronic equipment is reduced；
When the control instruction is sectional drawing, the current display interface of the electronic equipment is by sectional drawing, and preserves sectional drawing knot
Really；
When the control instruction is for clicking on, user's sight line fixes the preset areas for being incident upon the current display interface
Domain is clicked；
When the control instruction is for growing on time, user's sight line fixes the preset areas for being incident upon the current display interface
Domain is long pressed；
When the control instruction is for pulling, user's sight line fixes the preset areas for being incident upon the current display interface
Domain is dragged；Wherein, icon can be included in this predeterminable area.
As can be seen that the scheme of the present embodiment simplifies operational approach of the user to electronic equipment.When user's both hands are held
When thing or unstable one-handed performance, interface of electronic equipment can be controlled with eyes, be user-friendly to, while also enriching
The mode of operation of electronic equipment, increases interest of the user using electronic equipment, lifts Consumer's Experience.
Fig. 5 is referred to, Fig. 5 is another kind of electronic devices structure schematic diagram provided in an embodiment of the present invention.Wherein, such as Fig. 5
Shown, electronic equipment 500 can include：At least one processor 510, such as CPU, user interface 530, memorizer 540, at least
One communication bus 520 and display screen 550.Wherein, communication bus 520 is used for realizing the connection communication between these components.
Wherein, user interface 530 can be front-facing camera.Memorizer 540 can be high-speed RAM memorizer, it is also possible to be non-shakiness
Fixed memorizer (non-volatile memory), for example, at least one disk memory.Memorizer 540 optionally can be with
It is at least one storage system for being located remotely from aforementioned processor 510.As shown in figure 5, as a kind of computer-readable storage medium
Operating system, network communication module, Subscriber Interface Module SIM and interface control program can be included in memorizer 540.
In the electronic equipment 500 shown in Fig. 5, processor 510 can be used for calling the interface control stored in memorizer 540
Processing procedure sequence, and execute following operation：
User's sight line is obtained by user interface 530；
User's sight line is analyzed, the variation track information of user's sight line is obtained；
Control instruction is generated according to the variation track information of user's sight line；
The electronic equipment current display interface is controlled according to the control instruction, is shown by display screen 550
Out.
Specifically, user interface 530 obtains user's sight line, can include：Using eye of the front-facing camera to the user
Ball is tracked, and identifies the position and direction of the user eyeball, according to position and the Orientation institute of the user eyeball
The particular location that the incident point of user's pupil focusing projects is stated in the electronic equipment current display interface, so as to obtain the use
Family sight line.
User interface 530 obtains user's sight line, can also include：Using infrared camera, by the eyes of user
The infrared light of pupillary reflex is obtaining user's sight line.
Specifically, the variation track information of user's sight line can include following at least one：
Information is moved to left, information, upper shifting information is moved to right, is moved down information, information of blinking at least one times, fixed project information；Its
Described in fix project information refer to user's sight line fix be incident upon the current display interface predeterminable area when be up to
Arrive preset time threshold.It is appreciated that user's sight line variation track information be not limited to have listed this is several.
Specifically, the control instruction can include following at least one：
Left cunning, right cunning, upper cunning, downslide, scaling, sectional drawing, click, length are pressed, are pulled.It is appreciated that the control instruction is not
It is defined in this that listed several.
As can be seen that the scheme of the present embodiment simplifies operational approach of the user to electronic equipment.When user's both hands are held
When thing or unstable one-handed performance, interface of electronic equipment can be controlled with eyes, be user-friendly to, while also enriching
The mode of operation of electronic equipment, increases interest of the user using electronic equipment, lifts Consumer's Experience.
The control method at the above a kind of electronic equipment interface provided by the embodiment of the present invention and electronic equipment are carried out
Detailed introduction, specific case used herein have carried out detailed elaboration, above reality to the specific implementation step of the present invention
The explanation for applying example is only intended to help and understands the method for the present invention and its core concept；General technology simultaneously for this area
Personnel, according to the thought of the present invention, will change in specific embodiments and applications, in sum, this theory
Bright book content should not be construed as limiting the invention.
Claims (10)
1. the control method at a kind of electronic equipment interface, it is characterised in that include：
User's sight line is obtained by the sight line harvester of electronic equipment；
User's sight line is analyzed, the variation track information of user's sight line is obtained；
Control instruction is generated according to the variation track information of user's sight line；
The electronic equipment current display interface is controlled according to the control instruction.
2. the method for claim 1, it is characterised in that described user is obtained by electronic equipment sight line harvester regard
Line, including：
The eyeball of the user is tracked using the front-facing camera of the electronic equipment, identifies the user eyeball
Position and direction, the incident point that user's pupil is focused on according to the position of the user eyeball and described in Orientation is in the electronics
The particular location of equipment current display interface projection, so that obtain user's sight line.
3. the method for claim 1, it is characterised in that described user is obtained by electronic equipment sight line harvester regard
Line, including：
Using infrared camera, user's sight line is obtained by the infrared light of the pupillary reflex of the eyes of user.
4. the method as described in any one of claim 1-3, it is characterised in that the variation track information of user's sight line includes
Following at least one：
Information is moved to left, information, upper shifting information is moved to right, is moved down information, information of blinking at least one times, fixed project information；Wherein institute
State fixed project information refer to user's sight line fix be incident upon the current display interface predeterminable area duration reach pre-
If time threshold.
5. the method as described in any one of claim 1-4, it is characterised in that the control instruction includes following at least one：
Left cunning, right cunning, upper cunning, downslide, scaling, sectional drawing, click, length are pressed, are pulled.
6. a kind of electronic equipment, it is characterised in that include：
Acquiring unit, for obtaining user's sight line by the sight line harvester of electronic equipment；
Analytic unit, for being analyzed to user's sight line, obtains the variation track information of user's sight line；
Instruction generation unit, for generating control instruction according to the variation track information of user's sight line；
Performance element, for being controlled to the electronic equipment current display interface according to the control instruction.
7. electronic equipment as claimed in claim 6, it is characterised in that the acquiring unit also includes：
Track identification unit, for being tracked to the eyeball of the user using the front-facing camera of the electronic equipment, is known
Do not go out the position and direction of the user eyeball；
Analysis acquiring unit, the incident point that user's pupil is focused on for the position according to the user eyeball and described in Orientation
In the particular location of electronic equipment current display interface projection, so as to obtain user's sight line.
8. electronic equipment as claimed in claim 6, it is characterised in that the acquiring unit is specifically for using infrared photography
Head, obtains user's sight line by the infrared light of the pupillary reflex of the eyes of user.
9. the electronic equipment as described in any one of claim 6-8, it is characterised in that the variation track information of user's sight line
Including following at least one：
Information is moved to left, information, upper shifting information is moved to right, is moved down information, information of blinking at least one times, fixed project information；Wherein institute
State fixed project information refer to user's sight line fix be incident upon the current display interface predeterminable area duration reach pre-
If time threshold.
10. the electronic equipment as described in any one of claim 6-9, the control instruction include following at least one：
Left cunning, right cunning, upper cunning, downslide, scaling, sectional drawing, click, length are pressed, are pulled.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610811405.2A CN106502378A (en) | 2016-09-08 | 2016-09-08 | The control method at a kind of electronic equipment interface and electronic equipment |
| PCT/CN2016/111287 WO2018045669A1 (en) | 2016-09-08 | 2016-12-21 | Method for controlling interface of electronic device and electronic device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610811405.2A CN106502378A (en) | 2016-09-08 | 2016-09-08 | The control method at a kind of electronic equipment interface and electronic equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106502378A true CN106502378A (en) | 2017-03-15 |
Family
ID=58291363
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610811405.2A Pending CN106502378A (en) | 2016-09-08 | 2016-09-08 | The control method at a kind of electronic equipment interface and electronic equipment |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN106502378A (en) |
| WO (1) | WO2018045669A1 (en) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107492339A (en) * | 2017-06-30 | 2017-12-19 | 柳州贵族酒业有限公司 | A kind of pupil control LED shows glass curtain wall |
| CN107596690A (en) * | 2017-10-10 | 2018-01-19 | 网易（杭州）网络有限公司 | interface display method and terminal device |
| CN109462694A (en) * | 2018-11-19 | 2019-03-12 | 维沃移动通信有限公司 | A kind of control method and mobile terminal of voice assistant |
| CN109739344A (en) * | 2018-11-20 | 2019-05-10 | 平安科技（深圳）有限公司 | Unlocking method, device, equipment and storage medium based on eyeball moving track |
| CN109828812A (en) * | 2018-12-29 | 2019-05-31 | 维沃移动通信有限公司 | Screenshot method, device and terminal device |
| CN110069960A (en) * | 2018-01-22 | 2019-07-30 | 北京亮亮视野科技有限公司 | Filming control method, system and intelligent glasses based on sight motion profile |
| CN111045516A (en) * | 2019-12-05 | 2020-04-21 | 珠海格力电器股份有限公司 | Terminal operation method and device, terminal and storage medium |
| CN112967796A (en) * | 2019-12-13 | 2021-06-15 | 深圳迈瑞生物医疗电子股份有限公司 | Non-contact control method and device for in-vitro diagnostic equipment and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130300652A1 (en) * | 2011-11-30 | 2013-11-14 | Google, Inc. | Unlocking a Screen Using Eye Tracking Information |
| CN104360751A (en) * | 2014-12-05 | 2015-02-18 | 三星电子（中国）研发中心 | Method and equipment realizing intelligent control |
| CN104461014A (en) * | 2014-12-26 | 2015-03-25 | 小米科技有限责任公司 | Screen unlocking method and device |
| CN105320261A (en) * | 2015-01-07 | 2016-02-10 | 维沃移动通信有限公司 | Control method for mobile terminal and mobile terminal |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101308400A (en) * | 2007-05-18 | 2008-11-19 | 肖斌 | Novel human-machine interaction device based on eye-motion and head motion detection |
| CN104023127A (en) * | 2014-05-16 | 2014-09-03 | 深圳市中兴移动通信有限公司 | Short message processing method and device |
| CN104536654B (en) * | 2014-12-25 | 2018-02-02 | 小米科技有限责任公司 | Menu choosing method, device and Intelligent worn device in Intelligent worn device |
| CN105892642A (en) * | 2015-12-31 | 2016-08-24 | 乐视移动智能信息技术（北京）有限公司 | Method and device for controlling terminal according to eye movement |
-
2016
- 2016-09-08 CN CN201610811405.2A patent/CN106502378A/en active Pending
- 2016-12-21 WO PCT/CN2016/111287 patent/WO2018045669A1/en active Application Filing
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130300652A1 (en) * | 2011-11-30 | 2013-11-14 | Google, Inc. | Unlocking a Screen Using Eye Tracking Information |
| CN104360751A (en) * | 2014-12-05 | 2015-02-18 | 三星电子（中国）研发中心 | Method and equipment realizing intelligent control |
| CN104461014A (en) * | 2014-12-26 | 2015-03-25 | 小米科技有限责任公司 | Screen unlocking method and device |
| CN105320261A (en) * | 2015-01-07 | 2016-02-10 | 维沃移动通信有限公司 | Control method for mobile terminal and mobile terminal |
Non-Patent Citations (1)
| Title |
|---|
| 杜坤坤等: "《情感机器人》", 31 October 2012, 机械工业出版社 * |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107492339A (en) * | 2017-06-30 | 2017-12-19 | 柳州贵族酒业有限公司 | A kind of pupil control LED shows glass curtain wall |
| CN107596690A (en) * | 2017-10-10 | 2018-01-19 | 网易（杭州）网络有限公司 | interface display method and terminal device |
| CN107596690B (en) * | 2017-10-10 | 2020-12-08 | 网易（杭州）网络有限公司 | Interface display method and terminal equipment |
| CN110069960A (en) * | 2018-01-22 | 2019-07-30 | 北京亮亮视野科技有限公司 | Filming control method, system and intelligent glasses based on sight motion profile |
| CN109462694A (en) * | 2018-11-19 | 2019-03-12 | 维沃移动通信有限公司 | A kind of control method and mobile terminal of voice assistant |
| CN109739344A (en) * | 2018-11-20 | 2019-05-10 | 平安科技（深圳）有限公司 | Unlocking method, device, equipment and storage medium based on eyeball moving track |
| CN109739344B (en) * | 2018-11-20 | 2021-12-14 | 平安科技（深圳）有限公司 | Unlocking method, device and equipment based on eyeball motion track and storage medium |
| CN109828812A (en) * | 2018-12-29 | 2019-05-31 | 维沃移动通信有限公司 | Screenshot method, device and terminal device |
| CN109828812B (en) * | 2018-12-29 | 2022-06-17 | 维沃移动通信有限公司 | Screenshot method and device and terminal equipment |
| CN111045516A (en) * | 2019-12-05 | 2020-04-21 | 珠海格力电器股份有限公司 | Terminal operation method and device, terminal and storage medium |
| CN112967796A (en) * | 2019-12-13 | 2021-06-15 | 深圳迈瑞生物医疗电子股份有限公司 | Non-contact control method and device for in-vitro diagnostic equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2018045669A1 (en) | 2018-03-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106502378A (en) | The control method at a kind of electronic equipment interface and electronic equipment | |
| KR102025291B1 (en) | User interface for camera effects | |
| EP3576014A1 (en) | Fingerprint recognition method, electronic device, and storage medium | |
| CN105718043B (en) | Method and apparatus for controlling electronic device | |
| CN101291364B (en) | Interaction method and device of mobile communication terminal, and mobile communication terminal thereof | |
| EP2660681A2 (en) | Mobile terminal and control method thereof | |
| CN109219796A (en) | Digital touch on real-time video | |
| CN105940365B (en) | A kind of notification information processing method, device and terminal | |
| EP3293620A1 (en) | Multi-screen control method and system for display screen based on eyeball tracing technology | |
| US11588969B2 (en) | Devices, methods, and graphical user interfaces for assisted photo-taking | |
| CN108958587B (en) | Split screen processing method and device, storage medium and electronic equipment | |
| CN112306220A (en) | Control method and device based on limb identification, electronic equipment and storage medium | |
| CN110196646A (en) | A kind of data inputting method and mobile terminal | |
| CN112214112A (en) | Parameter adjusting method and device | |
| CN112817443A (en) | Display interface control method, device and equipment based on gestures and storage medium | |
| CN111596760A (en) | Operation control method and device, electronic equipment and readable storage medium | |
| CN103974107A (en) | Television eye movement control method and device and television | |
| CN112954209B (en) | Photographing method and device, electronic equipment and medium | |
| CN106610722A (en) | Terminal control method and system | |
| CN112114653A (en) | Terminal device control method, device, equipment and storage medium | |
| CN112243065B (en) | Video recording method and device | |
| Kajan et al. | PeepList: Adapting ex-post interaction with pervasive display content using eye tracking | |
| CN104657117A (en) | Information processing method and electronic device | |
| CN104571858B (en) | A kind of terminal | |
| CN113377478B (en) | Entertainment industry data labeling method, device, storage medium and equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170315 |
|
| RJ01 | Rejection of invention patent application after publication |