CN109992094A - Interactive approach and electronic device for user interface - Google Patents
Interactive approach and electronic device for user interface Download PDFInfo
- Publication number
- CN109992094A CN109992094A CN201711482541.2A CN201711482541A CN109992094A CN 109992094 A CN109992094 A CN 109992094A CN 201711482541 A CN201711482541 A CN 201711482541A CN 109992094 A CN109992094 A CN 109992094A
- Authority
- CN
- China
- Prior art keywords
- page
- identification signal
- instruction
- indicator
- user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/012—Head tracking input arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
- Position Input By Displaying (AREA)
Abstract
A kind of interactive approach, a user interface for an electronic device, the user interface includes a display device, which includes the head biological identification signal for detecting a user, and controls the display device according to the head biological identification signal and show a page；The eye biological identification signal of the user is detected, and the position of an indicator on this page is controlled according to the eye biological identification signal；And the instruction of the user is detected, and when detecting the instruction, according to the position of the indicator on this page, controls the electronic device and execute a specific function.
Description
[technical field]
The present invention refers to a kind of interactive approach for user interface, and espespecially one kind can allow user without using hand
The method that portion interacts in the case where operating with user interface.
[background technique]
The user interface of electronic device usually contains multiple stratum (hierarchy), when user operates,
It may switch between the different pages in same layer, or be switched to the next layer of page or picture.For example, in a menu mould
Under formula, user may click some project and execute specific function, or clicks a certain project and enter next stratum
Menu.In general, in computer or hand hands- operation, user need to be carried out with touch control gesture, or pass through keyboard or mouse etc.
Input interface input instruction.In other words, traditional mobile phone or computation mode are required to carry out using hand or hands, and
User needs the information watched attentively on screen for a long time to realize and interact with the user interface of electronic device.However, above-mentioned
When mode of operation can not be applied to drive, if driver need to vacate hand or hands to operate electronic device, it is easy to divert one's attention and shadow
Ring traffic safety.In view of this, being supplied to motorist it is really necessary to propose a kind of electronic device interactive approach being more suitable for
It uses.
[summary of the invention]
The main object of the present invention be to provide one kind can allow user without using operation by human hand with
The method of user interface interaction to solve the problems, such as that driver easily diverts one's attention, while reducing driver and operating answering for electronic device
Miscellaneous degree simultaneously improves traffic safety.
The invention discloses a kind of interactive approaches, and for a user interface of an electronic device, which includes
One display device, which includes: the head biological identification signal of one user of detecting, and is distinguished according to the head biology
Knowledge signal controls the display device and shows a page；The eye biological identification signal of the user is detected, and raw according to the eye
Object identification signal controls the position of an indicator on this page；And the instruction of the user is detected, and detecting this
When instruction, according to the position of the indicator on this page, controls the electronic device and execute a specific function.
The present invention also discloses a kind of electronic device, includes a user interface and a processing unit.The user interface
For interacting with a user, which includes a display device and a sensing device.The sensing device is used
To detect the head biological identification signal and eye biological identification signal of the user.The processing unit is coupled to user circle
Face, for executing following steps: according to the head biological identification signal, controlling the display device and show a page；According to the eye
Portion's biological identification signal, the position of one indicator of control on this page；And in the instruction for detecting the user, root
According to the position of the indicator on this page, controls the electronic device and execute a specific function.
The present invention also discloses the user interface that a kind of interactive approach is used for an electronic device, which includes
One display device, which includes: the eye biological identification signal of one user of detecting, and according to eye biology
Identification signal controls position of the indicator on the page that the display device is shown；And detect the face of the user
Instruction, and when detecting face instruction, according to the position of the indicator on this page, controls the electronic device and execute one
Specific function；Wherein, face instruction is composed of multiple facial actions.
The present invention also discloses a kind of electronic device, includes a user interface and a processing unit.The user interface
For interacting with a user, which includes a display device and a sensing device.The sensing device is used
To detect an eye biological identification signal and the face instruction of the user, wherein face instruction is moved by multiple faces
It is composed.The processing unit is coupled to the user interface, for executing following steps: being believed according to the eye biological identification
Number, control position of the indicator on the page that the display device is shown；And when detecting face instruction, according to
The position of the indicator on this page controls the electronic device and executes a specific function.
[Detailed description of the invention]
Fig. 1 is the schematic diagram of one electronic device of the embodiment of the present invention；
Fig. 2A is the schematic diagram that the embodiment of the present invention controls display panning by headwork；
Fig. 2 B is the schematic diagram that the embodiment of the present invention controls that display picture is zoomed in or out by headwork；
Fig. 2 C is the schematic diagram that the embodiment of the present invention is indicated by indicator；
Fig. 3 is the schematic diagram that the embodiment of the present invention one interacts process；
Fig. 4 A~4C is painted a kind of Detailed Operation mode for controlling display device by headwork and showing a page；
Fig. 5 is user by staring the schematic diagram mobile come control instructions symbol.
[appended drawing reference]
10: electronic device, 100: user interface, 102: display device, 104: sensing device, 110: processing unit,
120: user input unit, 30: interaction process, 300~308: step, 400: the page.
[specific embodiment]
Fig. 1 is one embodiment of the invention.Electronic device 10 includes a user interface 100 and a processing unit 110.Make
User interface 100 provides the medium interacted with user, and it includes have a display device 102 and a sensing device 104, electronics
It includes a user input unit 120 that device 10 is also alternative.Sensing device 104 can be used to detect user head, eye
Biological identification signal.Processing unit 110 is coupled to user interface 100, can be controlled and be shown according to head biological identification signal
Device 102 shows a page；And the position of an indicator on this page is controlled according to eye biological identification signal.User is defeated
Entering device 120 can receive the order of user, with the position according to the indicator on this page, controls electronic device 10 and executes
One specific function.
In one embodiment, sensing device 104 can be used to detect the eye biological identification signal of user, and detect use
Face's biological identification signal of person is instructed as a face.Processing unit 110 can control one according to eye biological identification signal and refer to
Show the position accorded on the page that display device 102 is shown, and when face's instruction is detected, according to indicator in the page
On position control electronic device 10 execute a specific function.Above-mentioned face's instruction can be composed of multiple facial actions.
In one embodiment, sensing device 104 can be used to detect the biological identification letter of user head, eye and face
Number.Processing unit 110 is coupled to user interface 100, and the display of display device 102 one can be controlled according to head biological identification signal
The page；The position of an indicator on this page is controlled according to eye biological identification signal；And according to face's biological identification signal
And the position of the indicator on this page, control electronic device 10 execute a specific function.
In one embodiment, the head biological identification signal for the user that sensing device 104 is detected include head pose,
Head position, head movement and any head pose, position and/or the combination of movement.Head position represents head and sensing
Relative position between device, or represent the relative position between head and display.Head pose representative nods, shakes the head or side head
Deng.
In one embodiment, the eye biological identification signal for the user that sensing device 104 is detected includes to stare vector
And fixation point.Vector is stared to represent through head position, head pose, iris reflex light, iris position and/or pupil position institute
The expression in the eyes gaze-direction derived.Staring vector can realize in world coordinate system, face's coordinate system or screen coordinate system.It stares
Point represents the crosspoint for staring vector and screen.
In one embodiment, the face's biological identification signal for the user that sensing device 104 is detected include face feature,
The combination of facial action, a series of facial action or any face feature and/or movement.
In one embodiment, sensing device 104 may include any kind of sensor, for obtaining various biological identification letters
Number, such as the combination of visible light photography machine, infrared camera, OPTICAL SENSORS or a variety of sensors, and it is without being limited thereto.
In one embodiment, processing unit 110 can turn the biological identification signal of user head, eye and/or face
Different instruction is changed into, to control the picture shown in display device 102.
In one embodiment, the mode of the above-mentioned display page is flat comprising the picture for controlling display by particular header action
It moves (pan).Particular header action can by head pose, head position, head be mobile or any head pose, position and/or
Mobile combination is realized.By taking Fig. 2A as an example for example, when user head inclines to the left, the picture of display can control to the left
Translation.
In one embodiment, the mode of the above-mentioned display page includes that the picture contracting of display is controlled by particular header action
Small (zoom-out) or amplification (zoom-in).Particular header action can be mobile by head pose, head position, head, or appoints
What head pose, position and/or combination of movement is realized.For example, working as user head towards screen by taking Fig. 2 B as an example
Direction it is mobile when, can control the picture amplification of display.
To realize translation and the scaling in above-described embodiment, the background area of active region (active area) can on screen
A virtual image is presented, active region is less than the region model of virtual image for the subclass of virtual image and the regional scope of active region
It encloses.
In one embodiment, above-mentioned one indicator of control can come real in several ways in the step of position on the page
It is existing.For example, can indicate on the active region of screen with cursor, or pass through the side such as cognizable color, wire, convex surface or concave surface
Formula indicates specific region, form and/or image.By taking Fig. 2 C as an example for example, on screen 20, cursor and wire are used
To indicate specific project.
In one embodiment, user input unit 120 can receive the order of user in any manner, such as by pressing
Pressing entity key, input certain gestures or by touch control screen input etc., but not limited to this.
In one embodiment, the above-mentioned position according to the indicator on the page, it is specific that control electronic device 10 executes one
The step of function, can be realized in several ways.For example, can refer to according to the selected region of indicator, form and/or image
Show that specific function is performed, the region, form and/or image can correspond to calling specific function or instruction.For example, it calls
Function, which can be, opens application program, returns to primary option menu, drop down menu, restarting etc., but not limited to this.
In this case, user can operate electronic device by the biological identification signal of head, eye and/or face
10, while checking the image content in display device 102, Lai Dacheng user interacts with user interface 100.
In one embodiment, display device 102 can be any kind of display, such as liquid crystal display (Liquid
Crystal Display, LCD), organic light emitting diode display (Organic Light Emitting Diode
Display, OLED Display) etc..
In one embodiment, processing unit 110 can be a central processing unit (Central Processing Unit,
CPU), a microprocessor (microprocessor), a micro controller unit (Micro Controller Unit, MCU) or one
Application-specific integrated circuit (Application-Specific Integrated Circuit, ASIC) is not limited by hard
Part or software mode are realized.
In one embodiment, electronic device 10 can be a device for vehicular electronic.
Fig. 3 is the schematic diagram that the embodiment of the present invention one interacts process 30.Interaction process 30 can be used for an electronic device, such as scheme
Electronic device 10 in 1, for being interacted with user.As shown in figure 3, interaction process 30 comprises the steps of:
Step 300: starting.
Step 302: detect the head biological identification signal of user, such as head pose, head position, head it is mobile,
Or any head pose, position and/or the combination of movement, and display device is controlled according to the head biological identification signal detected
Show a page.
Step 304: detect the eye biological identification signal of user, such as stare vector, fixation point or stare vector and
The combination of fixation point, and position of the indicator on the page is controlled according to the eye biological identification signal detected.
Step 306: detecting an instruction or the face's biological identification signal of user, and detecting instruction or face's biology
When identification signal, according to position of the indicator on the page, controls electronic device and execute a specific function.
Step 308: terminating.
According to interaction process 30, sensing device 104 can detect the head biological identification signal of user, processing unit 110
Display device 102 can be controlled according to head biological identification signal show a page.For example, processing unit 110 can basis
Head biological identification signal controls in display device 102 picture that shows to a specific direction scrolling or movement.Such as driver
The option that application program, contact person or pattern switching may be just looked on a menu, if sensing device 104 detects driving
When the head of people is moved to the left, the picture in display device 102 can be moved to the left, to show the option on more right side；Conversely, if sense
When the head that survey device 104 detects driver moves right, the picture in display device 102 can move right, to show more
The option in left side.In another embodiment, the choosing in the display of display device 102 left side can also be controlled by headwork to the left
, and control by headwork to the right the option on the display of display device 102 right side.Alternatively, driver may be just clear
Look at some page, processing unit 110 can according to the head biological identification signal detected come the scrolling page, as user with
The mode of the mouse roller scrolling page, but in this instance, user is without starting can be completed.
In another embodiment, processing unit 110 can also control in display device 102 according to head biological identification signal
(zoom-out) is reduced in the picture amplification (zoom-in) of display.Such as head part is driven close to sensing device 104 when detecting
When, it can control picture amplification, to highlight the option to be checked of user；Head part is driven far from sensing device 104 when detecting
When, control picture reduces, and makes to select comprising more multi-option for driver in picture.In addition, the direction mobile in addition to detecting head
In addition, processing unit 110 can also detect whether head tilts or turn to the left or to the right, to carry out the judgement of headwork.Example
If head "Left"-deviationist can control page scrolling to the left, Right deviation can control the page to scroll to the right.It is any to be believed by head biological identification
Number scope of the invention is belonged to control the mode that the page is shown.
Fig. 4 A~4C is painted a kind of display device 102 that controls by head biological identification signal and shows a page 400
Detailed Operation mode.It include a list on the page 400, it includes have multiple options, such as setting, information pattern, GPS mode.
As shown in Figure 4 A, the page 400 only shows that complete " information pattern " option, other options are not shown in the page 400 completely.When making
When user is intended to watch other options, head pose, position and/or the mobile content to control the display of the page 400 can be passed through.Such as figure
Shown in 4B, user can move right head.When sensing device 104, which detects head, to move to right, the content of picture can be inclined
Tiltedly, to highlight the option on right side, user can select " GPS mode " option on right side easily at this time.As shown in Figure 4 C, it uses
Head can be moved to the left by person, and when sensing device 104, which detects head, to move to left, the content of picture can be inclined to other direction
Tiltedly, to highlight the option in left side, user can select " setting " option in left side easily at this time.
In the above-described embodiments, the list that the page 400 is shown is that multiple options form a line；And in another embodiment,
Multiple options can be arranged as arc-shaped.In this case, when detecting user head and moving to right, it can control option according to clockwise
Direction is mobile；When detecting user head and moving to left, it can control option mobile according to counter clockwise direction.
In this instance, electronic device 10 can be a such as device for vehicular electronic, can by vehicle drive people easily into
Row manipulation.Therefore, display device 102 can be the instrument board of vehicle, and the page 400 and list of display include various be relevant to
The information of driving.For example, various running informations can be shown in display device 102, such as day into after " information pattern " option
Gas, time, travel distance etc.；Into after " GPS mode " option, GPS navigation information can be shown in display device 102, as
Figure and destination information etc.；" setting " option is then used to enter setting menu, to carry out every setting.Option on list is unlimited
It also may include the choosings such as speedometer, drive recorder, connection running gear in other embodiments in the explanation of above-described embodiment
?.Above-mentioned option can be set in the list of Fig. 4 A~4C, unidirectional come control table by head pose, position and/or movement
A left side is scrolled to the right or is moved to show different options.
Sensing device 104 can detect the eye biological identification signal of user, and processing unit 110 can be according to eye biology
Identification signal controls position of the indicator on the page.Indicator can be presented by various forms, such as cursor, pattern, frame
Line indicates that user is intended to project or the region of selection by specific color.Fig. 5 explanation stares " information mould as user
When formula " option, processing unit 110 can control indicator to be moved on " information pattern " option.In this instance, the display of indicator
Mode is to be indicated on indicated option with the wire compared with runic, but those skilled in the art is it will be appreciated that indicator
It can present otherwise, such as the option for being intended to selection be marked with brighter wire, or on the option for being intended to selection
It is marked with particular color, as long as the representation of indicator can allow user clearly to know indicator position.
In another embodiment, indicator can also be presented in the form of a cursor, and the position control cursor stared according to user's expression in the eyes
It is mobile to any direction.It is mobile as user is referred to mouse or sliding touch gesture control to carry out control instructions symbol with eye gaze
Show symbol movement.
User input unit 120 is available for users to input instruction, makes processing unit 110 according to indicator on the page
Position, control electronic device 10 execute a specific function.In one embodiment, control electronic device 10 executes the finger of specific function
The face of the user detected by sensing device 104 is enabled to instruct, if carrying out control instructions symbol movement above by eye gaze
Mode can be analogized to be mobile by mouse or sliding touch gesture control indicator, then controlling electronics dress by face's instruction
Setting 10 execution specific functions can analogize to click the acknowledgement key of mouse, keyboard or touch control screen to execute specific function.
Face's instruction can be realized in several ways.For example, face's instruction can be any countenance, such as
It smiles, laugh, opening one's mouth, the askew side of nose etc., countenance is also possible to the dynamic combined of a succession of facial action.Countenance
It can preset, for example, user can set smile (i.e. the corners of the mouth raises up) and instruct as face, when sensing device 104 is detectd
When measuring user's corners of the mouth and raising up, that is, it can determine whether the face's instruction for receiving smile.It is illustrated below by taking A~5 Fig. 4 as an example.
User can be accorded with by expression in the eyes control instructions and be moved between different options, if user is intended to select " information pattern " option,
Controllable indicator is moved on " information pattern " option, and starts to smile.After sensing device 104 detects smile, place
Reason device 110 can determine whether to receive confirmation instruction, and then controls electronic device 10 and enter information pattern, such as pass through display
Device 102 shows various running informations.
In another embodiment, each user can set respective countenance.Processing unit 110 is in addition to judging face
Except expression, personal face feature must also be judged.In one embodiment, an automobile may be used in conjunction with by man and wife, Fu Qike
Different countenances can be used to set, such as husband sets the face's instruction smiled as confirmation, wife sets blink conduct
The face of confirmation instructs.When husband drive when, system can judge according to face feature motorist for husband, and detecting smile
Expression when judgement receive confirmation instruction；When wife drives, system can be judged according to face feature motorist for wife, and
In the expression for detecting blink, judgement receives confirmation instruction.
The above-mentioned detecting about head, eye and face can pass through computer vision (Computer Vision) technology
To realize.Sensing device 104 can obtain include user head image, then, processing unit 110 can carry out the image
Reduced sampling (Down Sampling) then takes out the head phantom of user to reduce data volume by human face detection technology,
To set the bounding box (Bounding Box) for corresponding to head phantom.Reduced sampling can reduce data volume and improve subsequent arithmetic
The speed of processing, but in another embodiment, the step of reduced sampling can also be omitted, directly to acquired by sensing device 104
Image executes human face detection technology.Processing unit 110 intercepts the presentation content inside bounding box to carry out subsequent processing.It is relevant to
The judgement on head, eye and facial action can be obtained by bounding box internal image.
Processing unit 110 can be detected (Facial Landmark Detection) technology by human face characteristic point and be obtained respectively
A organ on the face, such as eyes, mouth, nose, characteristic point position.Processing unit 110 can obtain the head biology of user
Identification signal to judge headwork, such as head position, whether move, rotate or tilt.Processing unit 110 can be directed to eye
The image of eyeball judges the position of pupil and/or the light of pupillary reflex, stares vector and fixation point to obtain.Processing unit 110
It can also be changed according to the local location of organ on the face, or countenance is judged according to a succession of dynamic change of face feature,
Such as it is judged as smile when detecting the corners of the mouth and raising up, while face spy can be judged according to the integral position of each organ on the face
Sign.The present invention can manipulate electronic device running by the biological identification signal of detecting head, eye and face, and about head
Various feasible modes can be used in the detecting in portion, eye and face, not should be limitation of the invention.
The present invention provides one kind, and user can be allowed to carry out without using operation by human hand with user interface
The method of interaction, those skilled in the art, which works as, to modify or change accordingly, and without being limited thereto.For example, upper
It states in embodiment, system detects to obtain instruction user head, eye and face, to show in user interface
The corresponding page executes specific function on the electronic device simultaneously, and user need not be instructed by gesture input can be with electronics
Device is interacted.But in another embodiment, user can also by pressing physical button or with certain gestures come execute really
Recognizing instruction or spoken commands, (pressing physical button, gesture and spoken commands are available to control electronic device execution specific function
To replace aforementioned face to instruct).In general, multiple physical buttons can be arranged in auto electronic system on the steering wheel, do not dropping
In the case of low convenience and traffic safety, the medium instructed by physical button as input validation can also be changed, driver can be light
It changes places and presses key on steering wheel to be inputted.Alternatively, processing unit 110 can also have voice detecting/discriminating function, with
Phonetic order is inputted for user.In addition, interactive approach proposed by the invention cannot be only used for auto electronic system, can also answer
For other types of electronic system, such as game machine, E-book reader.As long as user interface can be by detecting user
Head, eye and facial action and/or feature realize the function mode interacted with user, in scope of the invention.
In one embodiment of this invention, the user interface of electronic device can be distinguished by detecting the head biology of user
Know signal to show to carry out the page, scrolling, movement and/or the scaling of the page are controlled with headwork.Then detecting uses
The eye biological identification signal of person controls position of the indicator on the page with the position stared according to user's expression in the eyes.
Then, when detecting particular facial instruction, specific function is can be performed in electronic device, such as enters a certain menu or operation mould
Formula.In this case, user can be inputted by head, eye and face and be instructed in the case where that need not pass through operation by human hand,
It is interacted with realizing with user interface.
The foregoing is merely presently preferred embodiments of the present invention, all equivalent changes done according to scope of the present invention patent with repair
Decorations, should all belong to the scope of the present invention.
Claims (16)
1. a kind of interactive approach, for a user interface of an electronic device, which includes a display device, should
Interactive approach includes:
The head biological identification signal of a user is detected, and the display device is controlled according to the head biological identification signal and is shown
Show a page；
The eye biological identification signal of the user is detected, and an indicator is controlled at this according to the eye biological identification signal
Position on the page；And
The instruction of the user is detected, and when detecting the instruction, according to the position of the indicator on this page, control
The electronic device executes a specific function.
2. interactive approach as described in claim 1 is shown wherein controlling the display device according to the head biological identification signal
The step of page, includes:
According to the head biological identification signal, the picture that shows in the display device is controlled to a specific direction scrolling or movement,
Or control the picture shown in the display device and zoom in or out, to show the page.
3. interactive approach as described in claim 1, wherein the indicator includes a cursor, a pattern, a wire or specific
Color is used to refer to be intended to the project of selection or region.
4. interactive approach as described in claim 1, wherein the instruction includes static face's instruction or multiple facial actions
Dynamic combined.
5. interactive approach as described in claim 1 wherein shows a list on the page, which includes multiple options, with
And when detecting the instruction, according to the position of the indicator on this page, controls the electronic device and execute the specific function
The step of include:
When detecting the instruction, according to the position of the indicator on this page, select in multiple option by the instruction
One of symbol instruction.
6. a kind of electronic device, includes:
One user interface, for interacting with a user, which includes:
One display device；And
One sensing device, for detecting the head biological identification signal and an eye biological identification signal of the user；And
One processing unit is coupled to the user interface, for executing following steps:
According to the head biological identification signal, controls the display device and show a page；
According to the eye biological identification signal, the position of an indicator on this page is controlled；And detecting the user
An instruction when, according to the position of the indicator on this page, control the electronic device and execute a specific function.
7. electronic device as claimed in claim 6 is shown wherein controlling the display device according to the head biological identification signal
The step of page, includes:
According to the head biological identification signal, the picture that shows in the display device is controlled to a specific direction scrolling or movement,
Or control the picture shown in the display device and zoom in or out, to show the page.
8. electronic device as claimed in claim 6, wherein the indicator includes a cursor, a pattern, a wire or specific
Color is used to refer to be intended to the project of selection or region.
9. electronic device as claimed in claim 6, wherein the instruction includes static face's instruction or multiple facial actions
Dynamic combined.
10. electronic device as claimed in claim 6 wherein shows a list on the page, which includes multiple options, with
And when detecting face instruction, according to the position of the indicator on this page, controlling the electronic device, to execute this specific
The step of function, includes:
When detecting face instruction, according to the position of the indicator on this page, select in multiple option by this
One of indicator instruction.
11. a kind of interactive approach, for a user interface of an electronic device, which includes a display device,
The interactive approach includes:
The eye biological identification signal of a user is detected, and an indicator is controlled at this according to the eye biological identification signal
The position on a page that display device is shown；And
The face instruction of the user is detected, and when detecting face instruction, on this page according to the indicator
Position controls the electronic device and executes a specific function；
Wherein, face instruction is composed of multiple facial actions.
12. interactive approach as claimed in claim 11, also includes:
The head biological identification signal of the user is detected, and the display device is controlled according to the head biological identification signal and is shown
Show the page.
13. interactive approach as claimed in claim 12, wherein it is aobvious to control the display device according to the head biological identification signal
The step of showing the page includes:
According to the head biological identification signal, the picture that shows in the display device is controlled to a specific direction scrolling or movement,
Or control the picture shown in the display device and zoom in or out, to show the page.
14. interactive approach as claimed in claim 11, wherein the indicator includes a cursor, a pattern, a wire or spy
Determine color, is used to refer to be intended to the project of selection or region.
15. interactive approach as claimed in claim 11 wherein shows a list on the page, which includes multiple options,
And it when detecting face instruction, according to the position of the indicator on this page, controls the electronic device and executes the spy
The step of determining function includes:
When detecting face instruction, according to the position of the indicator on this page, select in multiple option by this
One of indicator instruction.
16. a kind of electronic device, includes:
One user interface, for interacting with a user, which includes:
One display device；And
One sensing device, for detecting an eye biological identification signal and the face instruction of the user, wherein the face refers to
Order is composed of multiple facial actions；And
One processing unit is coupled to the user interface, for executing following steps:
According to the eye biological identification signal, position of the indicator on the page that the display device is shown is controlled；And
When detecting face instruction, according to the position of the indicator on this page, controls the electronic device and execute a spy
Determine function.
Priority Applications (4)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711482541.2A CN109992094A (en) | 2017-12-29 | 2017-12-29 | Interactive approach and electronic device for user interface |
| TW107202864U TWM561857U (en) | 2017-12-29 | 2018-03-05 | Electronic device interacting with user |
| TW107107288A TW201931096A (en) | 2017-12-29 | 2018-03-05 | Interaction method for user interface and electronic device thereof |
| US16/234,579 US20190138086A1 (en) | 2017-11-09 | 2018-12-28 | Human machine interface |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711482541.2A CN109992094A (en) | 2017-12-29 | 2017-12-29 | Interactive approach and electronic device for user interface |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109992094A true CN109992094A (en) | 2019-07-09 |
Family
ID=67109142
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711482541.2A Pending CN109992094A (en) | 2017-11-09 | 2017-12-29 | Interactive approach and electronic device for user interface |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109992094A (en) |
-
2017
- 2017-12-29 CN CN201711482541.2A patent/CN109992094A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11816296B2 (en) | External user interface for head worn computing | |
| US11886638B2 (en) | External user interface for head worn computing | |
| US9946338B2 (en) | Information processing to vary screen display based on a gaze point of the user | |
| KR102230172B1 (en) | Systems and methods for biomechanically-based eye signals for interacting with real and virtual objects | |
| US10001838B2 (en) | Feature tracking for device input | |
| KR20230170086A (en) | Hand gestures for animating and controlling virtual and graphical elements | |
| US20170100664A1 (en) | External user interface for head worn computing | |
| US20170017323A1 (en) | External user interface for head worn computing | |
| KR101919009B1 (en) | Method for controlling using eye action and device thereof | |
| WO2017015093A1 (en) | External user interface for head worn computing | |
| KR20160080109A (en) | Systems and techniques for user interface control | |
| WO2012119371A1 (en) | User interaction system and method | |
| CN102880304A (en) | Character inputting method and device for portable device | |
| CN108369451B (en) | Information processing apparatus, information processing method, and computer-readable storage medium | |
| CN110908569A (en) | Interaction method and device for virtual and real images | |
| US10444831B2 (en) | User-input apparatus, method and program for user-input | |
| KR20140132906A (en) | Device and method for mobile tooltip using eye detecting | |
| US20230259265A1 (en) | Devices, methods, and graphical user interfaces for navigating and inputting or revising content | |
| US20190138086A1 (en) | Human machine interface | |
| CN109992094A (en) | Interactive approach and electronic device for user interface | |
| US20230100689A1 (en) | Methods for interacting with an electronic device | |
| CN110850975B (en) | Electronic system with palm recognition, vehicle and operation method thereof | |
| US20240078846A1 (en) | Grid-Based Enrollment for Face Authentication | |
| TW201931096A (en) | Interaction method for user interface and electronic device thereof | |
| US20240103682A1 (en) | Devices, Methods, and Graphical User Interfaces for Interacting with Window Controls in Three-Dimensional Environments |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20190709 |