CN105824422B - A kind of information processing method and electronic equipment - Google Patents
A kind of information processing method and electronic equipment Download PDFInfo
- Publication number
- CN105824422B CN105824422B CN201610195384.6A CN201610195384A CN105824422B CN 105824422 B CN105824422 B CN 105824422B CN 201610195384 A CN201610195384 A CN 201610195384A CN 105824422 B CN105824422 B CN 105824422B
- Authority
- CN
- China
- Prior art keywords
- display object
- area
- display
- gaze
- user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/16—Sound input; Sound output
- G06F3/167—Audio in a user interface, e.g. using voice commands for navigating, audio feedback
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- General Health & Medical Sciences (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses a kind of information processing method and electronic equipment, the information processing method includes: the first direction of gaze for obtaining the eyeball of user for display interface；The first display object is determined from the display image based on first direction of gaze；Obtain the location information of the first display object；Based on the location information, judge that the first display object whether in the first predeterminable area, and generates the first judging result；When first judging result is no, the first display object is shown enlarged in first predeterminable area.The above method and electronic equipment provided by the invention, solve in the prior art due to user concern object amplification display position be it is fixed, there are technical problems inconvenient for operation.
Description
Technical field
The present invention relates to electronic technology field, in particular to a kind of information processing method and electronic equipment.
Background technique
Eye movement tracer technique, also known as sight line tracking system are the eye movement information (notes including eyeball by detecting user
The position of viewpoint, fixation time or fixation times etc.) it realizes to oculomotor tracking.Eye movement tracer technique is more and more mature,
Application range is also more and more extensive.In field of human-computer interaction, user is when use has the electronic equipment of eye movement tracking function
It waits, control instruction controlling electronic devices can be generated according to the eye movement information of user.
It, can be by this area in the prior art when user watches a certain region of display interface attentively more than preset duration
Amplify display in the original location in domain.
But present inventor during inventive technique scheme, has found above-mentioned technology extremely in realizing the embodiment of the present application
Have the following technical problems less: due to the position of the object amplification display of the concern of user in the prior art be it is fixed, do not meet
The use habit of user, there are technical problems inconvenient for operation.
Summary of the invention
The present invention provides a kind of information processing method and electronic equipment, solves in the prior art due to the object of user's concern
Amplification display position be it is fixed, there are technical problems inconvenient for operation.
On the one hand the embodiment of the present invention provides a kind of information processing method, comprising:
The eyeball for obtaining user is directed to the first direction of gaze of display interface；
The first display object is determined from the display image based on first direction of gaze；
Obtain the location information of the first display object；
Based on the location information, judge that the first display object whether in the first predeterminable area, and generates first
Judging result；
When first judging result is no, the first display object is shown enlarged in first predeterminable area
It is interior.
Optionally, described to determine the first display object from the display image based on first direction of gaze, specifically
Include:
Based on first direction of gaze, target area is determined from the display interface；
The first display object is determined based on the target area.
Optionally, described that the first display object is determined based on the target area, it specifically includes:
Determine that at a distance from the target area be first area less than the region of preset threshold based on the target area；
The image that the first area is shown is as the first display object.
Optionally, described that the first display object is determined based on the target area, it specifically includes:
Determine that at a distance from the target area be first area less than the region of preset threshold based on the target area；
Based on the first area, extracting from the first area can operation mark, wherein user can grasp for described
Make a check mark be able to carry out when operating with it is described can the corresponding operational order of operation mark；
Will described in can operation mark as it is described first display object.
Optionally, it is described by it is described first display object be shown enlarged in first predeterminable area before, further includes:
Judge whether to detect the operation for enabling enlarging function, obtains the second judging result；
Second judging result is that the first display object is shown enlarged in first predeterminable area when being.
Optionally, it is described by it is described first display object be shown enlarged in first predeterminable area before, further includes:
Obtain the size of the first display object；
Judge whether the size is less than pre-set dimension, obtains third judging result；
The third judging result is that the first display object is shown enlarged in first predeterminable area when being
It is interior.
Optionally, it is described by it is described first display object be shown enlarged in first predeterminable area after, further includes:
Detection obtains the eyeball for the second direction of gaze and fixation time of the first display object；
Target identification is determined from the first display object based on second direction of gaze and fixation time, wherein
User can execute operational order corresponding with the target identification when operating for the target identification；
When the fixation time is greater than preset duration, operational order corresponding with the target identification is executed.
On the other hand the embodiment of the present invention provides a kind of electronic equipment, comprising:
Shell；
Storage unit is arranged in the shell, for storing at least one program module；
At least one processor, it is disposed in the housing, it is connect with the storage unit, at least one described processor
By the way that at least one described program module is obtained and run from the storage unit, for obtaining the eyeball of user for display
First direction of gaze at interface；The first display object is determined from the display image based on first direction of gaze；It obtains
The location information of the first display object；Based on the location information, judge whether the first display object is pre- first
If in region, and generating the first judging result；When first judging result is no, by the first display object amplification display
In first predeterminable area.
Optionally, at least one described processor is also used to:
Based on first direction of gaze, target area is determined from the display interface；
The first display object is determined based on the target area.
Optionally, at least one described processor is also used to:
Determine that at a distance from the target area be first area less than the region of preset threshold based on the target area；
The image that the first area is shown is as the first display object.
Optionally, at least one described processor is also used to:
Determine that at a distance from the target area be first area less than the region of preset threshold based on the target area；
Based on the first area, extracting from the first area can operation mark, wherein user can grasp for described
Make a check mark be able to carry out when operating with it is described can the corresponding operational order of operation mark；
Will described in can operation mark as it is described first display object.
Optionally, at least one described processor is also used to:
It is described by it is described first display object be shown enlarged in first predeterminable area before, judge whether to detect
The operation of enlarging function is enabled, the second judging result is obtained；
Second judging result is that the first display object is shown enlarged in first predeterminable area when being.
Optionally, at least one described processor is also used to:
It is described the first display object is shown enlarged in first predeterminable area before, it is aobvious to obtain described first
Show the size of object；
Judge whether the size is less than pre-set dimension, obtains third judging result；
The third judging result is that the first display object is shown enlarged in first predeterminable area when being
It is interior.
Optionally, at least one described processor is also used to:
It is described the first display object is shown enlarged in first predeterminable area after, detection obtains the eye
Second direction of gaze and fixation time of the ball for the first display object；
Target identification is determined from the first display object based on second direction of gaze and fixation time, wherein
User can execute operational order corresponding with the target identification when operating for the target identification；
When the fixation time is greater than preset duration, operational order corresponding with the target identification is executed.
Said one or multiple technical solutions in the embodiment of the present application at least have following one or more technology effects
Fruit:
One, due to being directed to display interface using the eyeball for obtaining user in technical solution in the embodiment of the present application
The first direction of gaze；The first display object is determined from the display image based on first direction of gaze；Described in acquisition
The location information of first display object；Based on the location information, judge the first display object whether in the first preset areas
In domain, and generate the first judging result；When first judging result is no, the first display object is shown enlarged in institute
State the technological means in the first predeterminable area.In this way, predeterminable area can be arranged according to the use habit of user, and by user's
Perpetual object is shown enlarged in predeterminable area.So realizing the technical effect for facilitating operation.
Two, due in technical solution in the embodiment of the present application, use based on the target area determine with it is described
The region that the distance of target area is less than preset threshold is first area；The image that the first area is shown is as described
The technological means of one display object.In this way, since the electronic equipment in the prior art with eye movement tracking function is obtaining eye movement
Be when information be not it is very accurate, the object that electronic equipment is determined may not be the object that user is actually subjected to operation, so,
After the target area for determining user's concern, display is amplified into the region of close-proximity target zone, it in this way can be according to user's needle
Operation object is accurately determined to the information of watching attentively in amplified region.So realizing the skill for improving electronic equipment accuracy
Art effect.
Three, due in technical solution in the embodiment of the present application, use based on the target area determine with it is described
The region that the distance of target area is less than preset threshold is first area；Based on the first area, from the first area
Extracting can operation mark, wherein user for it is described can operation mark operation when be able to carry out with it is described can operation mark it is corresponding
Operational order；Using it is described can operation mark as it is described first display object technological means.In this way, according to user's concern
The first area of close-proximity target zone is determined in target area, then removes background from first area, and extracting can operation mark
Amplification display.So reduce user in the first display object watches object attentively, user can very easily determine to pay close attention to
Object can be further improved the accuracy of electronic equipment, improve the technical effect of the use feeling of user.
Four, due in technical solution in the embodiment of the present application, using judging whether to detect enabling enlarging function
Operation, obtain the second judging result；Second judging result is when being, the first display object is shown enlarged in described the
Technological means in one predeterminable area.In this way, first can shown again after user's confirmation according to the demand of user
Object amplification avoids the problem of the first display object is amplified display when not needing amplification display by user, effectively subtracts
Maloperation is lacked.
Detailed description of the invention
Technical solution in ord to more clearly illustrate embodiments of the present application or in prior art, below retouches embodiment
Attached drawing needed in stating is briefly described, it should be apparent that, the accompanying drawings in the following description is only the one of the application
A little embodiments.
Fig. 1 is a kind of flow chart of the information processing method provided in the embodiment of the present application one；
Fig. 2 is the structure chart of a kind of electronic equipment provided in the embodiment of the present application two；
Fig. 3 is the structure chart of a kind of electronic equipment provided in the embodiment of the present application three.
Specific embodiment
The embodiment of the present application provides a kind of information processing method and electronic equipment, for solving in the prior art due to user
Concern object amplification display position be it is fixed, there are technical problems inconvenient for operation.
In order to solve the above technical problems, general thought is as follows for technical solution in the embodiment of the present application:
The eyeball for obtaining user is directed to the first direction of gaze of display interface；
The first display object is determined from the display image based on first direction of gaze；
Obtain the location information of the first display object；
Based on the location information, judge that the first display object whether in the first predeterminable area, and generates first
Judging result；
When first judging result is no, the first display object is shown enlarged in first predeterminable area
It is interior.
Due in technical solution in the embodiment of the present application, using the first display object for determining user's concern it
Afterwards, whether the first display object is judged in preset position, shows the first display object amplification if not in preset position
Show the technological means in predeterminated position.In this way, the position of amplification display, the side of realizing can be arranged according to the use habit of user
Just the technical effect operated.
A kind of information processing method provided by the embodiments of the present application specifically can be applied to a kind of electronic equipment, be used for basis
The eye movement information controlling electronic devices itself of user, the electronic equipment can be mobile phone, digital camera/tablet computer, notes
The electronic equipments such as this computer are also possible to other electronic equipment, here, just different one schematically illustrating.
With reference to the accompanying drawing to main realization principle, specific embodiment and its correspondence of the embodiment of the present application technical solution
The beneficial effect that can reach is explained in detail.
Embodiment one
Referring to FIG. 1, the embodiment of the present application provides a kind of information processing method, comprising:
S101: the eyeball for obtaining user is directed to the first direction of gaze of display interface；
S102: the first display object is determined from the display image based on first direction of gaze；
It, can basis in multiple objects that user watches attentively after obtaining the first direction of gaze in the embodiment of the present application
Direction of gaze determines the object (the i.e. first display object) of user's concern.
S103: the location information of the first display object is obtained；
S104: being based on the location information, judge that described first shows that object whether in the first predeterminable area, and generates
First judging result；
S105: when first judging result is no, the first display object is shown enlarged in described first and is preset
In region.
In the embodiment of the present application, after determining the first display object, the location information of the first display object is obtained, and sentence
Whether disconnected first display object is in user's need position (i.e. the first predeterminable area) to be shown, if it is not, by the first display pair
As being shown enlarged in the first predeterminable area.
Optionally, described to determine the first display object from the display image based on first direction of gaze, specifically
Include:
Based on first direction of gaze, target area is determined from the display interface；
The first display object is determined based on the target area.
It, can be according to first after obtaining first direction of gaze of the eyeball for display interface in the embodiment of the present application
Direction of gaze determines what user watched attentively is which position (i.e. target area) of display interface.
Two kinds presented below preferred methods determine target area:
The first: obtaining at least one region of eyeball fixes based on the first direction of gaze；
Determine that the longest region of fixation time is target area from least one target area.
When watching display interface attentively of user, user eyeball watch some region of time attentively and longer represent user to the area
The attention rate in domain is higher.So can determine target area according to direction of gaze and fixation time in the embodiment of the present application.
At least one region of eyeball fixes is determined according to direction of gaze, and obtains the time that user watches each region attentively, from least one
The longest region of fixation time is obtained in a region, using this region as target area, the i.e. target area of user's concern.
Specifically, the first direction of gaze that user watches display interface attentively is obtained when user watches display interface attentively, and
The time in each region is watched attentively, if the direction that user watches attentively is a-quadrant, B area and the region C of display interface, if a-quadrant
Fixation time be 0.5s, the fixation time that the fixation time of B area is the region 0.1s and C is 1s.Then determine eyeball fixes C
The time longest in region, using the region C as target area.
Second: at least one region of eyeball fixes is obtained based on the first direction of gaze；
Determine that the most region of unit time fixation times is target area from least one described region.
When eyeball is look at display area, it is possible to disturbing factor is had, so that user may be disturbed factor
Interference occurs to jump view.So can also determine target according to the number in unit time fixation object region in the embodiment of the present application
Region.At least one target area of eyeball fixes is determined according to direction of gaze, and obtain watch attentively in the Subscriber Unit time it is each
The time of target area obtains the most region of fixation times, using this region as target from least one target area
Region.
Specifically, the number watched attentively is respectively 4 if the region watched attentively in user 2s is a-quadrant, B area and the region C
It is secondary, 1 time and 1 time, it is determined that go out watch attentively within the unit time a-quadrant number it is most, so determine a-quadrant be target area.
The first display object can be determined later according to target area by obtaining target area, specifically there is following three kinds of sides
Formula determines the first display object:
The first: is using target area as the first display object.
Second: the first display object is determined based on the target area, is specifically included:
Determine that at a distance from the target area be first area less than the region of preset threshold based on the target area；
The image that the first area is shown is as the first display object.
In the embodiment of the present application, by taking preset threshold is 2cm as an example, after determining target area, distance objective is determined
The region of region 2cm, using the image shown in the region of distance objective region 2cm as the first display image.
The accuracy of eye movement information due to existing electronic equipment in record user when handling visual information is not very
Height, the perpetual object for the user that electronic equipment is determined may not be the object of user's actual concern, so passing through the application
Region near the perpetual object of user, can be determined as the first display object by the method in embodiment, allow use after amplification
Family is selected from the first display object again.So realizing the technical effect for improving the accuracy of electronic equipment.
The third: determining the first display object based on the target area, specifically include:
Determine that at a distance from the target area be first area less than the region of preset threshold based on the target area；
Based on the first area, extracting from the first area can operation mark, wherein user can grasp for described
Make a check mark be able to carry out when operating with it is described can the corresponding operational order of operation mark；
Will described in can operation mark as it is described first display object.
In the embodiment of the present application, by taking preset threshold is 2cm as an example, after determining target area, distance objective region is determined
The region of 2cm be first area, and extract in first area can operation mark, if can operate expression include A icon, B scheme
Mark, C icon and D icon then extract these icons as the first display object.
The method of the embodiment of the present application can by the region determined can operation mark extract, then amplify display,
The background image in region can be got rid of in this way, and more convenient user determines perpetual object from display object, improves
The use feeling of user further improves the precision of electronic equipment.
Optionally, before the first display object being shown enlarged in first predeterminable area, further includes:
Judge whether to detect the operation for enabling enlarging function, obtains the second judging result；
Second judging result is that the first display object is shown enlarged in first predeterminable area when being.
The operation for enabling enlarging function can be the pressing operation for the programmable button on keyboard.The embodiment of the present application
In, for the operation to start enlarging function is the operation of " Ctrl " key on pressing keyboard, determining the first display area
Later, electronic equipment can detect whether user has pressed on keyboard " Ctrl " key, if detecting that " Ctrl " key is pressed it
Afterwards, so that it may which the first display object is shown enlarged in the first predeterminable area.
The operation for enabling enlarging function can be input of the user for the default voice messaging of electronic equipment.The application is real
It applies in example, by taking default voice messaging is " amplification " as an example.After determining the first display area, electronic equipment can be detected whether
Voice messaging is received, after detecting voice messaging, extracts the voice messaging of user's input, and identified, if known
Not Chu user input voice be " amplification " when, then by first show object be shown enlarged in the first predeterminable area.
Optionally, before the first display object being shown enlarged in first predeterminable area, further includes:
Obtain the size of the first display object；
Judge whether the size is less than pre-set dimension, obtains third judging result；
The third judging result is that the first display object is shown enlarged in first predeterminable area when being
It is interior.
In the embodiment of the present application, also need to judge the size of the first display object before amplification display the first display object
Whether it is less than pre-set dimension, if the size of the first display object is less than pre-set dimension, shows the size of the first display object
It is too small, it has not been convenient to user's viewing, so needing the first display object amplification；If the first display size is greater than pre-set dimension,
The size for then showing the first display object has been the size that user facilitates viewing, may result in the if amplifying display again
Size after one display object amplification is greater than the size of display interface, so that amplified first display object is in display interface
Display it is imperfect, the use feeling of user is bad.So the method by the embodiment of the present application can be further improved user
Use feeling.
Optionally, it is described by it is described first display object be shown enlarged in first predeterminable area after, further includes:
Detection obtains the eyeball for the second direction of gaze and fixation time of the first display object；
Target identification is determined from the first display object based on second direction of gaze and fixation time, wherein
User can execute operational order corresponding with the target identification when operating for the target identification；
When the fixation time is greater than preset duration, operational order corresponding with the target identification is executed.
After the first display object is shown enlarged in the first predeterminable area, user can be facilitated to the of amplification
One display object carries out further operating.
In the embodiment of the present application, to include A icon, B icon, C icon in the first display object, preset duration is that 2s is
Example.After the first display object amplification display, determined according to user for the direction of gaze of the first display object of amplification
The multiple objects watched attentively, and watch the fixation time of each object attentively, if user watches A icon 3s attentively, watch B icon 0s, C icon attentively
1s can then determine that user watches the preset duration that the time of A icon is more than attentively, so that it may run the corresponding operation of A icon and refer to
It enables.
It, can be according to user for the eye movement information of amplified first display object by the method for the embodiment of the present application
The object for accurately determining user's actual concern improves the accuracy of electronic equipment eye movement tracking.
Embodiment two
Referring to FIG. 2, the embodiment of the present application also provides a kind of electronic equipment, comprising:
Shell 201；
Storage unit 202 is arranged in the shell 201, for storing at least one program module；
At least one processor 203, be arranged in the shell 201, connect with the storage unit, it is described at least one
Processor 203 from the storage unit 202 by obtaining and running at least one described program module, for obtaining user's
Eyeball is directed to the first direction of gaze of display interface；Determine that first is aobvious from the display image based on first direction of gaze
Show object；Obtain the location information of the first display object；Based on the location information, judge that the first display object is
It is no in the first predeterminable area, and generate the first judging result；When first judging result is no, by first display pair
As being shown enlarged in first predeterminable area.
Optionally, at least one described processor is also used to:
Based on first direction of gaze, target area is determined from the display interface；
The first display object is determined based on the target area.
Optionally, at least one described processor is also used to:
Determine that at a distance from the target area be first area less than the region of preset threshold based on the target area；
The image that the first area is shown is as the first display object.
Optionally, at least one described processor is also used to:
Determine that at a distance from the target area be first area less than the region of preset threshold based on the target area；
Based on the first area, extracting from the first area can operation mark, wherein user can grasp for described
Make a check mark be able to carry out when operating with it is described can the corresponding operational order of operation mark；
Will described in can operation mark as it is described first display object.
Optionally, at least one described processor is also used to:
It is described by it is described first display object be shown enlarged in first predeterminable area before, judge whether to detect
The operation of enlarging function is enabled, the second judging result is obtained；
Second judging result is that the first display object is shown enlarged in first predeterminable area when being.
Optionally, at least one described processor is also used to:
It is described the first display object is shown enlarged in first predeterminable area before, it is aobvious to obtain described first
Show the size of object；
Judge whether the size is less than pre-set dimension, obtains third judging result；
The third judging result is that the first display object is shown enlarged in first predeterminable area when being
It is interior.
Optionally, at least one described processor is also used to:
It is described the first display object is shown enlarged in first predeterminable area after, detection obtains the eye
Second direction of gaze and fixation time of the ball for the first display object；
Target identification is determined from the first display object based on second direction of gaze and fixation time, wherein
User can execute operational order corresponding with the target identification when operating for the target identification；
When the fixation time is greater than preset duration, operational order corresponding with the target identification is executed.
Embodiment three
Referring to FIG. 3, the embodiment of the present application also provides a kind of electronic equipment, comprising:
Obtaining unit 301, the eyeball for obtaining user are directed to the first direction of gaze of display interface；
Determination unit 302, for determining the first display object from the display image based on first direction of gaze；
The acquiring unit 301 is also used to obtain the location information of the first display object；
Whether judging unit 303 judges the first display object in the first preset areas for being based on the location information
In domain, and generate the first judging result；
Amplifying unit 304, for first judging result be it is no when, by it is described first display object be shown enlarged in institute
It states in the first predeterminable area.
Optionally, the determination unit 302 is also used to:
Based on first direction of gaze, target area is determined from the display interface；
The first display object is determined based on the target area.
Optionally, the determination unit 302 is also used to:
Determine that at a distance from the target area be first area less than the region of preset threshold based on the target area；
The image that the first area is shown is as the first display object.
Optionally, the determination unit 302 is also used to:
Determine that at a distance from the target area be first area less than the region of preset threshold based on the target area；
Based on the first area, extracting from the first area can operation mark, wherein user can grasp for described
Make a check mark be able to carry out when operating with it is described can the corresponding operational order of operation mark；
Will described in can operation mark as it is described first display object.
Optionally, the judging unit 303 is also used to: described that the first display object is shown enlarged in described first
Before in predeterminable area, judges whether to detect the operation for enabling enlarging function, obtain the second judging result；
The amplifying unit 304 is also used to: the second judging result is to be shown enlarged in the first display object when being
In first predeterminable area.
Optionally, the obtaining unit 301 is also used to: described that the first display object is shown enlarged in described first
Before in predeterminable area, the size of the first display object is obtained；
The judging unit 303 is also used to: being judged whether the size is less than pre-set dimension, is obtained third judging result；
The amplifying unit 304 is also used to: the third judging result is to show the first display object amplification when being
Show in first predeterminable area.
Optionally, the obtaining unit 301 is also used to: described that the first display object is shown enlarged in described first
After in predeterminable area, detection obtains the eyeball for the second direction of gaze and fixation time of the first display object；
The determination unit 302 is also used to: being based on second direction of gaze and fixation time from first display pair
As middle determining target identification, wherein user can execute corresponding with the target identification when operating for the target identification
Operational order；
The electronic equipment further includes execution unit 305, when being greater than preset duration for the fixation time, execution and institute
State the corresponding operational order of target identification.
Said one or multiple technical solutions in the embodiment of the present application at least have following one or more technology effects
Fruit:
One, due to being directed to display interface using the eyeball for obtaining user in technical solution in the embodiment of the present application
The first direction of gaze；The first display object is determined from the display image based on first direction of gaze；Described in acquisition
The location information of first display object；Based on the location information, judge the first display object whether in the first preset areas
In domain, and generate the first judging result；When first judging result is no, the first display object is shown enlarged in institute
State the technological means in the first predeterminable area.In this way, predeterminable area can be arranged according to the use habit of user, and by user's
Perpetual object is shown enlarged in predeterminable area.Facilitate operating technology effect so realizing.
Two, due in technical solution in the embodiment of the present application, use based on the target area determine with it is described
The region that the distance of target area is less than preset threshold is first area；The image that the first area is shown is as described
The technological means of one display object.In this way, since the electronic equipment in the prior art with eye movement tracking function is obtaining eye movement
It is not to be very accurately when information, the object that electronic equipment is determined may not be the object of user's actual concern, so, true
After the target area for making user's concern, display is amplified into the region of close-proximity target zone, can be directed in this way according to user
The information of watching attentively in amplified region accurately determines perpetual object.So realizing the technology for improving electronic equipment accuracy
Effect.
Three, due in technical solution in the embodiment of the present application, use based on the target area determine with it is described
The region that the distance of target area is less than preset threshold is first area；Based on the first area, from the first area
Extracting can operation mark, wherein user for it is described can operation mark operation when be able to carry out with it is described can operation mark it is corresponding
Operational order；Using it is described can operation mark as it is described first display object technological means.In this way, according to user's concern
The first area of close-proximity target zone is determined in target area, then removes background from first area, and extracting can operation mark
Amplification display.So reducing the object of watching attentively of user, user can very easily determine perpetual object, can be into one
Step improves the accuracy of electronic equipment, improves the technical effect of the use feeling of user.
Four, due in technical solution in the embodiment of the present application, using judging whether to detect enabling enlarging function
Operation, obtain the second judging result；Second judging result is when being, the first display object is shown enlarged in described the
Technological means in one predeterminable area.In this way, first can shown again after user's confirmation according to the demand of user
Object amplification avoids the problem of the first display object is amplified display when not needing amplification display by user, effectively subtracts
Maloperation is lacked.
It should be understood by those skilled in the art that, the embodiment of the present invention can provide as method, system or computer program
Product.Therefore, complete hardware embodiment, complete software embodiment or reality combining software and hardware aspects can be used in the present invention
Apply the form of example.Moreover, it wherein includes the computer of computer usable program code that the present invention, which can be used in one or more,
The computer program implemented in usable storage medium (including but not limited to magnetic disk storage, CD-ROM, optical memory etc.) produces
The form of product.
The present invention is referring to method, the process of equipment (system) and computer program product according to the embodiment of the present application
Figure and/or block diagram describe.It should be understood that every one stream in flowchart and/or the block diagram can be realized by computer program instructions
The combination of process and/or box in journey and/or box and flowchart and/or the block diagram.It can provide these computer programs
Instruct the processor of general purpose computer, special purpose computer, Embedded Processor or other programmable data processing devices to produce
A raw machine, so that being generated by the instruction that computer or the processor of other programmable data processing devices execute for real
The device for the function of being specified in present one or more flows of the flowchart and/or one or more blocks of the block diagram.
These computer program instructions, which may also be stored in, is able to guide computer or other programmable data processing devices with spy
Determine in the computer-readable memory that mode works, so that it includes referring to that instruction stored in the computer readable memory, which generates,
Enable the manufacture of device, the command device realize in one box of one or more flows of the flowchart and/or block diagram or
The function of being specified in multiple boxes.
These computer program instructions also can be loaded onto a computer or other programmable data processing device, so that counting
Series of operation steps are executed on calculation machine or other programmable devices to generate computer implemented processing, thus in computer or
The instruction executed on other programmable devices is provided for realizing in one or more flows of the flowchart and/or block diagram one
The step of function of being specified in a box or multiple boxes.
Specifically, the corresponding computer program instructions of information processing method in the embodiment of the present application can be stored in
CD, hard disk, on the storage mediums such as USB flash disk, when the computer program instructions quilt corresponding with information processing method in storage medium
One electronic equipment reads or is performed, and includes the following steps:
Acquire the current environment parameter of electronic equipment local environment；Based at least one object shown in a scene, really
Fixed the first object to match with the current environment parameter；Based on the current environment parameter, first object is obtained
Target display parameters；First object is shown in the scene with the target display parameters.
Optionally, step " based at least one object shown in a scene, the determining and current environment parameter phase
The corresponding computer program instructions of the first object matched " when executed, specifically comprise the following steps:
It is determined from least one described object and matched first object of the current environment parameter；Or
Based at least one described object, one and matched first object of the current environment parameter are generated.
Optionally, step " determines from least one described object with the current environment parameter matched first pair
As " corresponding computer program instructions when being held, specifically comprise the following steps:
The first corresponding relationship based on environmental parameter and object, it is determining from least one described object to work as front ring with described
Corresponding first object of border parameter.
Optionally, step " based at least one described object, generates one and the current environment parameter matched first
The corresponding computer program instructions of object " when executed, specifically comprise the following steps:
The second corresponding relationship based on environmental parameter and object determines first pair corresponding with the current environment parameter
As；
Judge to whether there is first object at least one described object, obtains the first judging result；
When first judging result is no, first object is generated.
Optionally, step " being based on the current environment parameter, obtain the target display parameters of first object " is corresponding
Computer program instructions when executed, specifically comprise the following steps:
When the current environment parameter is the current wind parameter of the electronic equipment local environment, it is based on the current wind
Force parameter, the current moving direction of acquisition first object and current movement speed, wherein the wind-force parameter is for characterizing
The wind direction and wind-force value of the electronic equipment local environment；Or
When the current environment parameter is the present intensity of the electronic equipment local environment, it is based on the present intensity,
Obtain the target display brightness of first object；Or
When the current environment parameter is the current depth of field of the electronic equipment local environment, it is based on the current depth of field,
Obtain the target display dimensions of first object.
Optionally, the corresponding calculating of step " showing first object in the scene with the target display parameters "
Machine program instruction when executed, specifically comprises the following steps:
In the current moving direction with the first object described in the current movement speed Dynamically Announce in the scene；
Or
First object is shown with the target display brightness in the scene；Or
First object is shown in the scene with the target display dimensions.
Although preferred embodiments of the present invention have been described, it is created once a person skilled in the art knows basic
Property concept, then additional changes and modifications may be made to these embodiments.So it includes excellent that the following claims are intended to be interpreted as
It selects embodiment and falls into all change and modification of the scope of the invention.
Obviously, various changes and modifications can be made to the invention without departing from essence of the invention by those skilled in the art
Mind and range.In this way, if these modifications and changes of the present invention belongs to the range of the claims in the present invention and its equivalent technologies
Within, then the present invention is also intended to include these modifications and variations.
Claims (9)
1. a kind of information processing method, comprising:
The eyeball for obtaining user is directed to the first direction of gaze of display interface；
The first display object is determined from display image based on first direction of gaze；
Obtain the location information of the first display object；
Based on the location information, judge that the first display object whether in the first predeterminable area, and generates the first judgement
As a result；
When first judging result is no, the first display object is shown enlarged in first predeterminable area；
Wherein, first predeterminable area is the position for the amplification display being arranged according to user's use habit；
Wherein, described to determine the first display object from display image based on first direction of gaze, it specifically includes:
Based on first direction of gaze, target area is determined from the display interface；
The first display object is determined based on the target area；
Wherein, described that the first display object is determined based on the target area, it specifically includes:
Determine that at a distance from the target area be first area less than the region of preset threshold based on the target area；
Based on the first area, extracting from the first area can operation mark, wherein user can operate mark for described
Be able to carry out when knowing operation with it is described can the corresponding operational order of operation mark；
Will described in can operation mark as it is described first display object.
2. the method as described in claim 1, which is characterized in that described that the first display object is shown enlarged in described the
Before in one predeterminable area, further includes:
Judge whether to detect the operation for enabling enlarging function, obtains the second judging result；
Second judging result is that the first display object is shown enlarged in first predeterminable area when being.
3. the method as described in claim 1, which is characterized in that described that the first display object is shown enlarged in described the
Before in one predeterminable area, further includes:
Obtain the size of the first display object；
Judge whether the size is less than pre-set dimension, obtains third judging result；
The third judging result is that the first display object is shown enlarged in first predeterminable area when being.
4. the method as described in claim 1, which is characterized in that described that the first display object is shown enlarged in described the
After in one predeterminable area, further includes:
Detection obtains the eyeball for the second direction of gaze and fixation time of the first display object；
Target identification is determined from the first display object based on second direction of gaze and fixation time, wherein user
Operational order corresponding with the target identification can be executed when for target identification operation；
When the fixation time is greater than preset duration, operational order corresponding with the target identification is executed.
5. a kind of electronic equipment, comprising:
Shell；
Storage unit is arranged in the shell, for storing at least one program module；
At least one processor, it is disposed in the housing, it is connect with the storage unit, at least one described processor passes through
At least one described program module is obtained and run from the storage unit, for obtaining the eyeball of user for display interface
The first direction of gaze；The first display object is determined from display image based on first direction of gaze；Obtain described first
Show the location information of object；Based on the location information, judge the first display object whether in the first predeterminable area,
And generate the first judging result；When first judging result is no, the first display object is shown enlarged in described the
In one predeterminable area；
Wherein, first predeterminable area is the position for the amplification display being arranged according to user's use habit；
Wherein, at least one described processor is also used to:
Based on first direction of gaze, target area is determined from the display interface；
The first display object is determined based on the target area；
Wherein, at least one described processor is also used to:
Determine that at a distance from the target area be first area less than the region of preset threshold based on the target area；
Based on the first area, extracting from the first area can operation mark, wherein user can operate mark for described
Be able to carry out when knowing operation with it is described can the corresponding operational order of operation mark；
Will described in can operation mark as it is described first display object.
6. electronic equipment according to claim 5, which is characterized in that at least one described processor is also used to:
It is described by it is described first display object be shown enlarged in first predeterminable area before, judge whether to detect enabling
The operation of enlarging function obtains the second judging result；
Second judging result is that the first display object is shown enlarged in first predeterminable area when being.
7. electronic equipment according to claim 5, which is characterized in that at least one described processor is also used to:
It is described by it is described first display object be shown enlarged in first predeterminable area before, obtain it is described first display pair
The size of elephant；
Judge whether the size is less than pre-set dimension, obtains third judging result；
The third judging result is that the first display object is shown enlarged in first predeterminable area when being.
8. electronic equipment according to claim 5, which is characterized in that at least one described processor is also used to:
It is described the first display object is shown enlarged in first predeterminable area after, detection obtains the eyeball needle
To the second direction of gaze and fixation time of the first display object；
Target identification is determined from the first display object based on second direction of gaze and fixation time, wherein user
Operational order corresponding with the target identification can be executed when for target identification operation；
When the fixation time is greater than preset duration, operational order corresponding with the target identification is executed.
9. a kind of electronic equipment, comprising:
Obtaining unit, the eyeball for obtaining user are directed to the first direction of gaze of display interface；
Determination unit, for determining the first display object from display image based on first direction of gaze；
The obtaining unit is also used to obtain the location information of the first display object；
Judging unit, for be based on the location information, judge it is described first show object whether in the first predeterminable area, and
Generate the first judging result；
Amplifying unit, for first judging result be it is no when, by it is described first display object be shown enlarged in described first
In predeterminable area；
Wherein, first predeterminable area is the position for the amplification display being arranged according to user's use habit；
Wherein, described to determine the first display object from display image based on first direction of gaze, it specifically includes:
Based on first direction of gaze, target area is determined from the display interface；
The first display object is determined based on the target area；
Wherein, described that the first display object is determined based on the target area, it specifically includes:
Determine that at a distance from the target area be first area less than the region of preset threshold based on the target area；
Based on the first area, extracting from the first area can operation mark, wherein user can operate mark for described
Be able to carry out when knowing operation with it is described can the corresponding operational order of operation mark；
Will described in can operation mark as it is described first display object.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610195384.6A CN105824422B (en) | 2016-03-30 | 2016-03-30 | A kind of information processing method and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610195384.6A CN105824422B (en) | 2016-03-30 | 2016-03-30 | A kind of information processing method and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105824422A CN105824422A (en) | 2016-08-03 |
| CN105824422B true CN105824422B (en) | 2019-07-26 |
Family
ID=56525430
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610195384.6A Active CN105824422B (en) | 2016-03-30 | 2016-03-30 | A kind of information processing method and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105824422B (en) |
Families Citing this family (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106791135B (en) * | 2016-12-29 | 2020-12-29 | 努比亚技术有限公司 | Automatic local zooming display method and mobile terminal |
| CN107831976B (en) * | 2017-09-22 | 2020-12-11 | 创新先进技术有限公司 | Message display method and device |
| CN108563330A (en) * | 2018-03-30 | 2018-09-21 | 百度在线网络技术（北京）有限公司 | Using open method, device, equipment and computer-readable medium |
| CN109062409A (en) * | 2018-07-27 | 2018-12-21 | 华勤通讯技术有限公司 | The control method and system of client, mobile terminal |
| CN109271027B (en) * | 2018-09-17 | 2022-10-14 | 北京旷视科技有限公司 | Page control method and device and electronic equipment |
| CN110248254A (en) * | 2019-06-11 | 2019-09-17 | Oppo广东移动通信有限公司 | Display control method and Related product |
| CN113269044A (en) * | 2021-04-27 | 2021-08-17 | 青岛小鸟看看科技有限公司 | Display control method and device of head-mounted display equipment and head-mounted display equipment |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103869946A (en) * | 2012-12-14 | 2014-06-18 | 联想(北京)有限公司 | Display control method and electronic device |
| CN104216624A (en) * | 2013-05-30 | 2014-12-17 | 联想(北京)有限公司 | Display method and electronic device |
| CN105335061A (en) * | 2015-09-23 | 2016-02-17 | 小米科技有限责任公司 | Information display method and apparatus and terminal |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR101009881B1 (en) * | 2008-07-30 | 2011-01-19 | 삼성전자주식회사 | Apparatus and method for zoom display of target area from reproducing image |
-
2016
- 2016-03-30 CN CN201610195384.6A patent/CN105824422B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103869946A (en) * | 2012-12-14 | 2014-06-18 | 联想(北京)有限公司 | Display control method and electronic device |
| CN104216624A (en) * | 2013-05-30 | 2014-12-17 | 联想(北京)有限公司 | Display method and electronic device |
| CN105335061A (en) * | 2015-09-23 | 2016-02-17 | 小米科技有限责任公司 | Information display method and apparatus and terminal |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105824422A (en) | 2016-08-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105824422B (en) | A kind of information processing method and electronic equipment | |
| US11494000B2 (en) | Touch free interface for augmented reality systems | |
| JP7089106B2 (en) | Image processing methods and equipment, electronic devices, computer-readable storage media and computer programs | |
| TWI524210B (en) | Natural gesture based user interface methods and systems | |
| CN102906671B (en) | Gesture input device and gesture input method | |
| CN105009035B (en) | Strengthen touch input using gesture | |
| CN105117156B (en) | A kind of information processing method and electronic equipment | |
| US9978174B2 (en) | Remote sensor access and queuing | |
| EP3120217B1 (en) | Display device and method for controlling the same | |
| CN111045511B (en) | Gesture-based control method and terminal equipment | |
| US10203837B2 (en) | Multi-depth-interval refocusing method and apparatus and electronic device | |
| CN111475059A (en) | Gesture detection based on proximity sensor and image sensor | |
| AU2015296671A1 (en) | Switching between cameras of an electronic device | |
| JP2011108152A (en) | Three-dimensional input display device | |
| CN112044065B (en) | Virtual resource display method, device, equipment and storage medium | |
| CN103608761A (en) | Input device, input method and recording medium | |
| CN112669381A (en) | Pose determination method and device, electronic equipment and storage medium | |
| CN105357434B (en) | A kind of information processing method and electronic equipment | |
| CN103870146A (en) | Information processing method and electronic equipment | |
| CN104020933A (en) | Menu displaying method and device | |
| CN110362206B (en) | Gesture detection method, gesture detection device, terminal and computer readable storage medium | |
| Narayan et al. | Augmenting Moving Planar Surfaces and Spatial Control of Interactive Surfaces Application through Virtual Touch Screen (VIRTOS)-A Case Study | |
| CN112732080A (en) | Operation instruction generation method and device, storage medium and electronic equipment | |
| CN116301418A (en) | Touch waveform triggering method and device and electronic equipment | |
| CN116962836A (en) | Bullet screen alignment method, bullet screen alignment device, bullet screen alignment equipment, storage medium and program product |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |