CN103376892A - Method, device and terminal device for controlling display of display interface - Google Patents

Method, device and terminal device for controlling display of display interface Download PDF

Info

Publication number
CN103376892A
CN103376892A CN2012101227390A CN201210122739A CN103376892A CN 103376892 A CN103376892 A CN 103376892A CN 2012101227390 A CN2012101227390 A CN 2012101227390A CN 201210122739 A CN201210122739 A CN 201210122739A CN 103376892 A CN103376892 A CN 103376892A
Authority
CN
China
Prior art keywords
terminal device
display interface
focus point
point position
amount
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN2012101227390A
Other languages
Chinese (zh)
Other versions
CN103376892B (en
Inventor
甘大勇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Lenovo Beijing Ltd
Original Assignee
Lenovo Beijing Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Lenovo Beijing Ltd filed Critical Lenovo Beijing Ltd
Priority to CN201210122739.0A priority Critical patent/CN103376892B/en
Publication of CN103376892A publication Critical patent/CN103376892A/en
Application granted granted Critical
Publication of CN103376892B publication Critical patent/CN103376892B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Abstract

The invention discloses a method, a device and a terminal device for controlling display of a display interface. The method includes that a terminal device camera is used for conducting real-time recognition, and the first focus point position of the user pupil on the display interface of the terminal device is recorded; when the fact that the shaking quantity of the terminal device is equal to or larger than a first preset threshold is detected, the second focus position of the current user pupil on the display interface is obtained; the second focus point position and the first focus point position are compared, and corresponding X offset, Y offset and Z offset of the second focus point position relative to the first focus point position in the X direction, the Y direction and the Z direction are calculated; contents on the display interface are controlled to move in the X axis, the Y axis and the Z axis according to the offset. By means of the process, offset of the contents on the display interface and focusing of the user pupil in a shaking process can be compensated, eye fatigue and discomfort of a user during recognizing and checking are avoided, and user experience and feel about the mobile terminal are improved.

Description

A kind of method of control display interface display, device and terminal device
Technical field
The present invention relates to technical field of mobile terminals, in particular, relate to a kind of method, device and terminal device of control display interface display.
Background technology
Along with the rhythm of life that people accelerate day by day, for various facilities are provided to people, science and technology is also in continuous fast development.The current the most outstanding sci-tech product that facilitates to people is various portable terminals, as: mobile phone, Pad, e-book and MP5 etc., its advantage that is not limited to space, place and time can make people carry out anywhere or anytime work, study and amusement etc.
But, state in the use in the process of portable terminal, when in mobile process, running into shake, can cause the content of current demonstration on the mobile terminal display screen to see clearly, it is very difficult perhaps to be difficult to make the user to check; When people use portable terminal in the space that automobile, train etc. easily makes portable terminal uninterruptedly or occurs at any time to shake, more increased the difficulty that the user checks current displayed content on the mobile terminal display screen, the long-time lower eyes of user that very easily causes is tired and uncomfortable, thereby low user is to user's experience and the impression of portable terminal.
Summary of the invention
In view of this, the invention provides a kind of method, device and terminal device of control display interface display, to overcome in the prior art owing to check that under jitter conditions the content on the mobile terminal display screen makes user's eye fatigue and discomfort, thereby cause the user who reduces portable terminal to experience and the problem of impression.
For achieving the above object, the invention provides following technical scheme:
A kind of method of control display interface display comprises:
Utilize the camera Real time identification of terminal device, and the first focus point position of recording user pupil on the terminal device display interface;
When the amount of jitter that detects described terminal device is equal to or greater than the first predetermined threshold value, obtain the second focus point position of active user's pupil on described display interface;
More described the second focus point position and described the first focus point position, and calculate relatively described the first focus point position, described the second focus point position corresponding X side-play amount, Y side-play amount and Z side-play amount on three directions of XYZ; Wherein, XYZ is with respect to the XYZ direction of principal axis of described display interface on the three dimensions;
Do the XYZ axially-movable to correct skew according to the content that described X side-play amount, Y side-play amount and Z side-play amount are controlled on the described display interface.
Preferably, the described terminal device camera that utilizes is identified, and the recording user pupil also comprised before the first focus point position on the terminal device display interface:
Detect in real time the amount of jitter of described terminal device, when described amount of jitter was equal to or greater than the second predetermined threshold value, the control camera was opened, and wherein, described the second predetermined threshold value is less than the first predetermined threshold value.
Preferably, also comprise:
Be equal to or greater than when the amount of jitter that is not detecting described terminal device in the situation of the first predetermined threshold value, when detecting the first focus point position of user's pupil on described display interface and changing, return to re-execute and utilize the identification of terminal device camera and recording user pupil first this step of focus point position on the terminal device display interface.
Preferably, the detailed process that detects the amount of jitter of described terminal device comprises:
Utilize gravity meter to measure the current location of described terminal device;
Calculate the difference between described current location and the last position, determine that described difference is the amount of jitter of described terminal device.
Preferably, the detailed process that detects the amount of jitter of described terminal device comprises:
Utilize the current location of the described terminal device of gyroscope survey;
Calculate the difference between described current location and the last position, determine that described difference is the amount of jitter of described terminal device.
Preferably, the detailed process of calculating three directions of XYZ corresponding X side-play amount, Y side-play amount and Z side-play amount comprises:
Obtain X first value, Y first value and Z first value of the corresponding XYZ in described the first focus point position on axially;
Obtain X second value, Y second value and Z second value of the corresponding XYZ of described the second focal position on axially;
Calculate respectively the first difference between described X the first value and X the second value, the second difference between described Y the first value and described Y the second value, and the 3rd difference between described Z the first value and described Z the second value;
Determine that described the first difference is the X side-play amount on the X axis, described the second difference is the Y side-play amount on the Y-axis, and described the 3rd difference is the Z side-play amount on the Z-axis direction.
Preferably, also comprise:
According to the Z side-play amount on the Z-direction, control content on the described display interface and zoom in or out to correct skew on the Z-direction.
A kind of device of control display interface display comprises:
Camera, be used for Real time identification and the first focus point position of recording user pupil on the terminal device display interface, and the amount of jitter of obtaining terminal device active user's pupil second focus point position on described display interface when being equal to or greater than the first predetermined threshold value;
Whether the first detecting unit is equal to or greater than the first predetermined threshold value for detection of the amount of jitter of described terminal device;
Relatively computing unit is used for more described the second focus point position and described the first focus point position, and calculates X side-play amount, Y side-play amount and the Z side-play amount of relatively described the first focus point position, described the second focus point position correspondence on three directions of XYZ; Wherein, XYZ is with respect to the XYZ direction of principal axis of described display interface on the three dimensions;
Control module is used for doing the XYZ axially-movable according to the content on described X side-play amount, Y side-play amount and the Z side-play amount control display interface.
Preferably, also comprise:
Start unit is used for the in real time amount of jitter of the described terminal device of detection, and when described amount of jitter was equal to or greater than the second predetermined threshold value, the control camera was opened, and wherein, described the second predetermined threshold value is less than the first predetermined threshold value.
Preferably, also comprise:
The second detecting unit is used in the situation that does not detect the terminal device amount of jitter, when detecting the first focus point position of user's pupil on described display interface and changing, returns camera.
Preferably, comprise at least in described the first detecting unit: gyroscope or gravity meter, for the current location of measuring described terminal device.
A kind of terminal device is characterized in that, comprising: the device of any one control display interface display described above.
Via above-mentioned technical scheme as can be known, compared with prior art, the invention discloses a kind of method, device and terminal device of control display interface display.By utilizing the camera Real time identification of terminal device, and the first focus point position of recording user pupil on the terminal device display interface; When the amount of jitter that detects described terminal device is equal to or greater than the first predetermined threshold value, obtain the second focus point position of active user's pupil on described display interface; More described the second focus point position and described the first focus point position, and calculate relatively described the first focus point position, the second focus point position corresponding X side-play amount, Y side-play amount and Z side-play amount on three directions of XYZ; Do the XYZ axially-movable to correct skew according to the content that above-mentioned X side-play amount, Y side-play amount and Z side-play amount are controlled on the described display interface.The present invention passes through said process, skew when the content in can the compensate for jitter process on the display interface and the focusing of user's pupil, avoiding occurring when portable terminal is shaken user's pupil can't focus and cause the phenomenon that is difficult to identify, check content on the display screen, avoid the user in identification, eye fatigue and discomfort when checking, the user who has improved portable terminal experiences and impression.
Description of drawings
In order to be illustrated more clearly in the embodiment of the invention or technical scheme of the prior art, the below will do to introduce simply to the accompanying drawing of required use in embodiment or the description of the Prior Art, apparently, accompanying drawing in the following describes only is embodiments of the invention, for those of ordinary skills, under the prerequisite of not paying creative work, can also obtain according to the accompanying drawing that provides other accompanying drawing.
Fig. 1 is the method flow diagram of the embodiment of the invention one disclosed a kind of control display interface display;
Fig. 2 is the method flow diagram of the embodiment of the invention two disclosed a kind of control display interface display;
Fig. 3 is the structural representation of the device of the embodiment of the invention three disclosed a kind of control display interface display;
Fig. 4 is the structural representation of the device of the embodiment of the invention three disclosed another kind of control display interface display.
Fig. 5 a~Fig. 5 b is the diagram in the embodiment of the invention five disclosed concrete application processes.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the invention, the technical scheme in the embodiment of the invention is clearly and completely described, obviously, described embodiment only is the present invention's part embodiment, rather than whole embodiment.Based on the embodiment among the present invention, those of ordinary skills belong to the scope of protection of the invention not making the every other embodiment that obtains under the creative work prerequisite.
A kind of method, device and terminal device of control display interface display are disclosed among the following embodiment of the present invention.Its basic thought is: the camera Real time identification and the first focus point position of recording user pupil on the terminal device display interface that utilize terminal device, occur at terminal device in the situation of shake, obtain the second focus point position of active user's pupil on display interface, from the position that three directions of XYZ compare the first focus point and the second focus point, in the side-play amount that occurs calculating in the situation of deviation on three directions of XYZ, and utilize the content of calculating on the side-play amount control display interface that obtains to do the XYZ axially-movable to correct the skew of pupil focus point on display interface.In simple terms, namely be to utilize camera identification user pupil focus to gather on the display interface point, the content on the control display interface is done corresponding XYZ axially-movable compensation again, uses the inconvenience that brings thereby avoid mobile phone to be dithered as the user.Detailed process is elaborated by following examples.
Embodiment one
As shown in Figure 1, the method flow diagram for the embodiment of the invention one disclosed a kind of control display interface display mainly may further comprise the steps:
Step S101 utilizes the camera Real time identification of terminal device and the first focus point position of recording user pupil on the terminal device display interface.Wherein, described camera can be positioned on the same surface of described terminal device with described display interface, for example, and the front-facing camera on the terminal device.Described camera also can be the camera that can rotate; Can Real time identification when this rotating camera rotates to primary importance and first focus point of recording user pupil on the terminal device display interface get final product.
When the content on the viewing terminal equipment display interface in the environment that the user is moving, thereby terminal device can be because the unstable generation shake of mobile environment, moving like this or terminal device is produced under the environment of shake, the user watches the content on the display interface can cause kopiopia for a long time, especially the jitter conditions at terminal device has no in the art of composition, the irregular situation of milli the easier fatigue of user's eyes.
For this, when the content that is used for being on the above-mentioned environment viewing terminal equipment display interface, execution in step S101 utilizes camera Real time identification and the first focus point position of recording user pupil on the terminal device display interface of terminal device.The first focus point position of carrying out this Procedure Acquisition will be as the reference value of the displaying contents on the follow-up adjustment display interface.
Step S102, whether the amount of jitter that detects described terminal device is equal to or greater than the first predetermined threshold value, and if so, then execution in step S103 if not, then proceeds to detect.
Step S103 obtains the second focus point position of active user's pupil on described display interface.
Carry out above-mentioned steps S102 and step S103, when the module that the gravity meter in utilizing terminal device or gyroscope etc. have a measuring ability detects terminal device shake occurs, obtain the amount of jitter of current terminal device, itself and the first predetermined threshold value of presetting are compared, this first predetermined threshold value is for when shake occurs in terminal device, current shake can affect the amount of jitter of the terminal device of reading, can be set voluntarily by the user, also can obtain its concrete scope according to experimental result.
The process of concrete amount of jitter for the described terminal device of above-mentioned detection comprises:
At first, utilize the current location of gravity meter or the described terminal device of gyroscope survey.
Then, calculate again the difference between described current location and the last position, determine that described difference is the amount of jitter of described terminal device.
In process relatively, if the amount of jitter of current terminal device is equal to or greater than this first predetermined threshold value, illustrate that then the shake of current terminal device has affected the reading that maybe will have influence on the user.Therefore, then execution in step S103, obtain the physical location of active user's pupil on described display interface by the camera of terminal device, namely the second potential focus is put in order to follow-up use.
Step S104, more described the second focus point position and described the first focus point position, and calculate relatively described the first focus point position, described the second focus point position corresponding X side-play amount, Y side-play amount and Z side-play amount on three directions of XYZ.Wherein, XYZ is with respect to the XYZ direction of principal axis of described display interface on the three dimensions.This XYZ axle consists of a coordinate system and is used for identifying three-dimensional three direction in spaces.With respect to display interface, namely take display interface as benchmark, generally speaking, X-axis refers to left and right directions, and Y-axis refers to fore-and-aft direction, and Z axis refers to above-below direction.
Execution in step S104, with the different focus points position on display interface before and after the above-mentioned user's pupil that obtains is when reading same content, be the first focus point position of terminal device when shaking, and the second focus point position of obtaining after shaking of terminal device, two focus point positions are compared, side-play amount take the first focus point position as benchmark the second focus point on three directions of XYZ, i.e. corresponding X side-play amount, Y side-play amount and Z side-play amount.XYZ is specially the axial direction on the three dimensions.
Concrete computation process comprises:
At first, obtain X first value, Y first value and Z first value of the corresponding XYZ in described the first focus point position on axially, and obtain X second value, Y second value and Z second value of described the second focal position correspondence XYZ on axial.
Then, calculate respectively the first difference between described X the first value and X the first value, the second difference between described Y the first value and described Y the second value, and the 3rd difference between described Z the first value and described Z the second value.
At last, determine that described the first difference is the X side-play amount on the X axis, described the second difference is the Y side-play amount on the Y-axis, and described the 3rd difference is the Z side-play amount on the Z-axis direction.
Step S105 does the XYZ axially-movable to correct skew according to the content that described X side-play amount, Y side-play amount and Z side-play amount are controlled on the described display interface.
In the process based on above-mentioned execution in step S101~step S104, when finally obtaining the terminal device shake, make the passive and actual focus point of reading the content on the current display interface of user's pupil that the occurrence of skew occur, and utilize the content on the display interface of the above-mentioned X side-play amount of obtaining, Y side-play amount and Z side-play amount control terminal to do the XYZ axially-movable to correct skew.Namely correct skew from relative angle, in the situation of terminal device shake, make the skew of the relative user's pupil of content on the terminal device display interface and be offset, thereby form relatively static state, skew when the content in the compensate for jitter process on the display interface and the focusing of user's pupil, avoiding occurring when portable terminal is shaken user's pupil can't focus and cause the phenomenon that is difficult to identify, check content on the display screen, avoid the user in identification, eye fatigue and discomfort when checking, the user who has improved portable terminal experiences and impression.
Embodiment two
As shown in Figure 2, the method flow diagram for the embodiment of the invention two disclosed a kind of control display interface display mainly may further comprise the steps:
Step S201, the amount of jitter of sense terminals equipment when described amount of jitter is equal to or greater than the second predetermined threshold value, is controlled camera and is opened in real time.Wherein, described the second predetermined threshold value is less than the first predetermined threshold value.
Based on the reason in above-described embodiment one, when the content on the viewing terminal equipment display interface in the environment that the user is moving, thereby terminal device can be because the unstable generation shake of mobile environment, moving like this or terminal device is produced under the environment of shake, the user watches the content on the display interface can cause kopiopia for a long time, especially the jitter conditions at terminal device has no in the art of composition, the irregular situation of milli the easier fatigue of user's eyes.
Reducing power consumption, and further improving user's experience aspect, when execution in step S201 was equal to or greater than the second predetermined threshold value in the amount of jitter of real-time sense terminals equipment, the control camera was opened.This second predetermined threshold value is less than the first predetermined threshold value, when it is terminal device generation slight jitter, and current shake can be set by the user voluntarily on the amount of jitter of user's reading impact terminal device very hour, also can obtain its concrete scope according to experimental result.
Make the camera self-starting by execution in step S201, further improved user's impression and experience.
Step S202 utilizes the camera Real time identification of terminal device and the first focus point position of recording user pupil on the terminal device display interface.
Step S203, whether the amount of jitter that detects described terminal device is equal to or greater than the first predetermined threshold value, and if so, then execution in step S204 if not, then proceeds to detect.
Step S204 obtains the second focus point position of active user's pupil on described display interface.
Step S205, more described the second focus point position and described the first focus point position, and calculate relatively described the first focus point position, described the second focus point position corresponding X side-play amount, Y side-play amount and Z side-play amount on three directions of XYZ.
Wherein, XYZ is with respect to the XYZ direction of principal axis of described display interface on the three dimensions.This XYZ axle consists of a coordinate system and is used for identifying three-dimensional three direction in spaces.With respect to display interface, namely take display interface as benchmark, generally speaking, X-axis refers to left and right directions, and Y-axis refers to fore-and-aft direction, and Z axis refers to above-below direction.
Step S206 does the XYZ axially-movable to correct skew according to the content that described X side-play amount, Y side-play amount and Z side-play amount are controlled on the described display interface.
In concrete implementation among above-mentioned steps S202~step S206 and above-described embodiment one step S101~step S105 is corresponding one by one, no longer identical implementation is described here, but cross-references.
Same, at the said process that utilizes the present invention real-time two, skew in the time of also can realizing the content on the display interface and user's pupil focusing in the compensate for jitter process, avoiding occurring when portable terminal is shaken user's pupil can't focus and cause the phenomenon that is difficult to identify, check content on the display screen, avoid the user in identification, eye fatigue when checking and uncomfortable purpose, and, experience and impression by the user who makes the camera self-starting further improve terminal device.
On the basis based on the method for the control display interface display among above-described embodiment one or the embodiment two, also comprise, be not equal to or greater than in the situation of the first predetermined threshold value detecting the terminal device amount of jitter, when detecting the first focus point position of user's pupil on display interface and changing, determine that active user's pupil initiatively locks other guide, at this moment, for guaranteeing to occur in the situation of shake at terminal device, guarantee correct as first focus point position of reference value of user's pupil on display interface, re-execute and utilize the identification of terminal device camera and the current first focus point position of recording user pupil on the terminal device display interface.
Equally on the basis based on the method for the control display interface display among above-described embodiment one or the embodiment two, for the compensation of the Z side-play amount on the Z-direction time, zoom in or out the skew of correcting on the Z-direction according to the content on this Z side-play amount control display interface.
Need to prove, long-time or in Preset Time, do not detect in the situation of amount of jitter of terminal device, but terminal device autoshutdown camera.This time can also can be a determined value by setting in real time different value, and the present invention does not limit this.
Embodiment three
Method based on the disclosed a kind of control display interface display of above-described embodiment, the present invention is the corresponding device that discloses a kind of control display interface display also, see also accompanying drawing 3, structural representation for the device of the embodiment of the invention three disclosed a kind of control display interface display, mainly comprise: camera 101, the first detecting units 102, comparison computing unit 103 and control module 104.
Camera 101, be used for Real time identification and the first focus point position of recording user pupil on the terminal device display interface, and the amount of jitter of obtaining terminal device active user's pupil second focus point position on described display interface when being equal to or greater than the first predetermined threshold value.For example, terminal device front-facing camera.This front-facing camera and display unit are positioned on the same surface of described terminal device.
Whether the first detecting unit 102 is equal to or greater than the first predetermined threshold value for detection of the amount of jitter of described terminal device, is equal to or greater than in amount of jitter in the situation of the first predetermined threshold value and returns camera 101.
In this first detecting unit 102, comprise at least: gyroscope or gravity meter (not identifying among the figure), utilize this gyroscope or gravity meter to measure the current location of described terminal device.And then utilize computing module in this first detecting unit 102 (among the figure sign), and calculate the difference between described current location and the last position, determine that described difference is the amount of jitter of described terminal device.And then utilize the more current amount of jitter that gets access to of comparison module (not identifying among the figure) in this first detecting unit 102 whether to be equal to or greater than the first predetermined threshold value; Then in the situation of this amount of jitter more than or equal to the first predetermined threshold value, obtain the second focus point position of active user's pupil on described display interface by camera 101.
Compare computing unit 103, be used for more described the second focus point position and described the first focus point position, when both are inconsistent, calculate X side-play amount, Y side-play amount and the Z side-play amount of relatively described the first focus point position, described the second focus point position correspondence on three directions of XYZ; Wherein, XYZ is the direction on the three dimensions.
Control module 104 is used for doing the XYZ axially-movable according to the content on described X side-play amount, Y side-play amount and the Z side-play amount control display interface.
Concrete implementation in the above-mentioned unit can be referring to disclosed concrete implementation among the invention described above embodiment, and both are identical can cross-references.
See also accompanying drawing 4, on the basis of the device of the disclosed a kind of control display interface display of above-mentioned Fig. 3, the device of the disclosed control display interface display of this Fig. 4 also comprises: start unit 105.
This start unit 105 is used for the in real time amount of jitter of the described terminal device of detection, and when described amount of jitter was equal to or greater than the second predetermined threshold value, the control camera was opened, and wherein, described the second predetermined threshold value is less than the first predetermined threshold value.
Device based on disclosed two class control display interface display in above-mentioned the embodiment of the present application three, in control module 104, for the compensation of the Z side-play amount on the Z-direction, zoom in or out the skew of correcting on the Z-direction according to the content on this Z side-play amount control display interface.
Simultaneously, device based on disclosed two class control display interface display in above-mentioned the embodiment of the present application three, also comprise one second detecting unit (not identifying among the figure), be used for not being equal to or greater than in the situation of the first predetermined threshold value detecting the terminal device amount of jitter, when detecting the first focus point position of user's pupil on described display interface and changing, return camera 101.
Need to prove, on the basis of the device of the invention described above embodiment three disclosed two class control display interface display, the invention also discloses a kind of terminal device, wherein include the device of above-mentioned disclosed any one control display interface display.
By the disclosed device of the invention described above embodiment, and corresponding terminal device, based on utilizing camera identification user pupil focus to gather on the display interface point, content on the control display interface is done corresponding XYZ axially-movable compensation again, skew when the content in can the compensate for jitter process on the display interface and the focusing of user's pupil, avoid when portable terminal is shaken, occurring user's pupil can't focus cause be difficult to identification, check the phenomenon of content on the display screen, avoid the user in identification, eye fatigue when checking and discomfort, the user who has improved portable terminal experiences and impression.
Embodiment five
Disclosed terminal device can be the terminals such as mobile phone, IPD, electric paper book among the invention described above embodiment.For better explanation above-mentioned in the situation of terminal device shake the process of control display interface display, describe by concrete application example here.
When terminal device is the mobile phone with camera, when the user utilizes mobile phone to read, open camera in the environment of the movements such as automobile or train.
Utilize the identification of this camera and record current pupil in the first focus point position that display interface of mobile phone is read.
When detecting mobile phone generation shake, utilize gravity meter or gyroscope to obtain the deviation post of the relatively last position of current phone, and calculate its when skew amount of jitter of producing of corresponding mobile phone, judge whether this amount of jitter is equal to or greater than the first predetermined threshold value, in the situation that is, obtain the second focus point position of current pupil on display interface of mobile phone by camera.
Based on the side-play amount of the current pupil of the second focus point position calculation correspondence on three directions of XYZ that gets access to above-mentioned the first focus point position that gets access to and this moment, then the content on the side-play amount control display interface that utilization gets access to is done the XYZ axially-movable to correct skew.
Said process can represent by Fig. 5 a~Fig. 5 b.Among Fig. 5 a for normal, mobile phone the first focus point position A of user's pupil on mobile phone interface under the jitter conditions do not occur; That identify among Fig. 5 b and B the first focus point position A skew are the second focus point position B of user's pupil on mobile phone interface that obtains under the mobile phone jitter conditions, can be found out by Fig. 5 b to have skew between A and the B.
In addition, in the situation that does not detect the terminal device amount of jitter, when user's pupil initiatively changes the first focus point position on display interface, determine that active user's pupil initiatively locks other guide, re-execute and utilize the identification of terminal device camera and the current first focus point position of recording user pupil on the terminal device display interface.
In sum:
The present invention is by utilizing camera identification user pupil focus to gather on the display interface point, content on the control display interface is done corresponding XYZ axially-movable compensation again, skew when the content in the realization compensate for jitter process on the display interface and the focusing of user's pupil, avoiding occurring when portable terminal is shaken user's pupil can't focus and cause the phenomenon that is difficult to identify, check content on the display screen, avoid the user in identification, eye fatigue and discomfort when checking, improve that user to portable terminal experiences and the purpose of impression.
Each embodiment adopts the mode of going forward one by one to describe in this instructions, and what each embodiment stressed is and the difference of other embodiment that identical similar part is mutually referring to getting final product between each embodiment.For the disclosed device of embodiment, because it is corresponding with the disclosed method of embodiment, so description is fairly simple, relevant part partly illustrates referring to method and gets final product.
The method of describing in conjunction with embodiment disclosed herein or the step of algorithm can directly use the software module of hardware, processor execution, and perhaps the combination of the two is implemented.Software module can place the storage medium of any other form known in random access memory (RAM), internal memory, ROM (read-only memory) (ROM), electrically programmable ROM, electrically erasable ROM, register, hard disk, moveable magnetic disc, CD-ROM or the technical field.
To the above-mentioned explanation of the disclosed embodiments, make this area professional and technical personnel can realize or use the present invention.Multiple modification to these embodiment will be apparent concerning those skilled in the art, and General Principle as defined herein can in the situation that does not break away from the spirit or scope of the present invention, realize in other embodiments.Therefore, the present invention will can not be restricted to these embodiment shown in this article, but will meet the widest scope consistent with principle disclosed herein and features of novelty.

Claims (12)

1. the method for a control display interface display is characterized in that, comprising:
Utilize the camera Real time identification of terminal device, and the first focus point position of recording user pupil on the terminal device display interface;
When the amount of jitter that detects described terminal device is equal to or greater than the first predetermined threshold value, obtain the second focus point position of active user's pupil on described display interface;
More described the second focus point position and described the first focus point position, and calculate relatively described the first focus point position, described the second focus point position corresponding X side-play amount, Y side-play amount and Z side-play amount on three directions of XYZ; Wherein, XYZ is with respect to the XYZ direction of principal axis of described display interface on the three dimensions;
Do the XYZ axially-movable to correct skew according to the content that described X side-play amount, Y side-play amount and Z side-play amount are controlled on the described display interface.
2. method according to claim 1 is characterized in that, the described terminal device camera that utilizes is identified, and the recording user pupil also comprised before the first focus point position on the terminal device display interface:
Detect in real time the amount of jitter of described terminal device, when described amount of jitter was equal to or greater than the second predetermined threshold value, the control camera was opened, and wherein, described the second predetermined threshold value is less than the first predetermined threshold value.
3. method according to claim 1 is characterized in that, also comprises:
Be equal to or greater than when the amount of jitter that is not detecting described terminal device in the situation of the first predetermined threshold value, when detecting the first focus point position of user's pupil on described display interface and changing, return to re-execute and utilize the identification of terminal device camera and recording user pupil first this step of focus point position on the terminal device display interface.
4. the described method of any one is characterized in that according to claim 1~3, and the detailed process that detects the amount of jitter of described terminal device comprises:
Utilize gravity meter to measure the current location of described terminal device;
Calculate the difference between described current location and the last position, determine that described difference is the amount of jitter of described terminal device.
5. the described method of any one is characterized in that according to claim 1~3, and the detailed process that detects the amount of jitter of described terminal device comprises:
Utilize the current location of the described terminal device of gyroscope survey;
Calculate the difference between described current location and the last position, determine that described difference is the amount of jitter of described terminal device.
6. the described method of any one is characterized in that according to claim 1~3, and the detailed process of calculating three directions of XYZ corresponding X side-play amount, Y side-play amount and Z side-play amount comprises:
Obtain X first value, Y first value and Z first value of the corresponding XYZ in described the first focus point position on axially;
Obtain X second value, Y second value and Z second value of the corresponding XYZ of described the second focal position on axially;
Calculate respectively the first difference between described X the first value and X the second value, the second difference between described Y the first value and described Y the second value, and the 3rd difference between described Z the first value and described Z the second value;
Determine that described the first difference is the X side-play amount on the X axis, described the second difference is the Y side-play amount on the Y-axis, and described the 3rd difference is the Z side-play amount on the Z-axis direction.
7. the described method of any one is characterized in that according to claim 1~3, comprising:
According to the Z side-play amount on the Z-direction, control content on the described display interface and zoom in or out to correct skew on the Z-direction.
8. the device of a control display interface display is characterized in that, comprising:
Camera, be used for Real time identification and the first focus point position of recording user pupil on the terminal device display interface, and the amount of jitter of obtaining terminal device active user's pupil second focus point position on described display interface when being equal to or greater than the first predetermined threshold value;
Whether the first detecting unit is equal to or greater than the first predetermined threshold value for detection of the amount of jitter of described terminal device;
Relatively computing unit is used for more described the second focus point position and described the first focus point position, and calculates X side-play amount, Y side-play amount and the Z side-play amount of relatively described the first focus point position, described the second focus point position correspondence on three directions of XYZ; Wherein, XYZ is with respect to the XYZ direction of principal axis of described display interface on the three dimensions;
Control module is used for doing the XYZ axially-movable according to the content on described X side-play amount, Y side-play amount and the Z side-play amount control display interface.
9. device according to claim 8 is characterized in that, also comprises:
Start unit is used for the in real time amount of jitter of the described terminal device of detection, and when described amount of jitter was equal to or greater than the second predetermined threshold value, the control camera was opened, and wherein, described the second predetermined threshold value is less than the first predetermined threshold value.
10. device according to claim 8 is characterized in that, also comprises:
The second detecting unit is used in the situation that does not detect the terminal device amount of jitter, when detecting the first focus point position of user's pupil on described display interface and changing, returns camera.
11. the described device of any one is characterized in that according to claim 8~10, comprises at least in described the first detecting unit: gyroscope or gravity meter, for the current location of measuring described terminal device.
12. a terminal device is characterized in that, comprising: the device of the described control display interface display of any one in the claim 8~11.
CN201210122739.0A 2012-04-24 2012-04-24 Method, device and terminal device for controlling display of display interface Active CN103376892B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201210122739.0A CN103376892B (en) 2012-04-24 2012-04-24 Method, device and terminal device for controlling display of display interface

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201210122739.0A CN103376892B (en) 2012-04-24 2012-04-24 Method, device and terminal device for controlling display of display interface

Publications (2)

Publication Number Publication Date
CN103376892A true CN103376892A (en) 2013-10-30
CN103376892B CN103376892B (en) 2017-02-08

Family

ID=49462115

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201210122739.0A Active CN103376892B (en) 2012-04-24 2012-04-24 Method, device and terminal device for controlling display of display interface

Country Status (1)

Country Link
CN (1) CN103376892B (en)

Cited By (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103677269A (en) * 2013-12-11 2014-03-26 小米科技有限责任公司 Method and device for displaying content and terminal device
CN104135622A (en) * 2014-08-25 2014-11-05 广东欧珀移动通信有限公司 Method and device for optimizing snapshooting through gyroscope and mobile terminal
CN104320545A (en) * 2014-11-14 2015-01-28 陕西亚成微电子股份有限公司 Anti-shake method for mobile phone screen
CN105320254A (en) * 2014-07-25 2016-02-10 腾讯科技(深圳)有限公司 Mobile terminal display control method and device
CN106293045A (en) * 2015-06-30 2017-01-04 北京智谷睿拓技术服务有限公司 Display control method, display control unit and subscriber equipment
CN106293046A (en) * 2015-06-30 2017-01-04 北京智谷睿拓技术服务有限公司 Information processing method, information processor and subscriber equipment
CN106293061A (en) * 2016-07-22 2017-01-04 广东欧珀移动通信有限公司 Control method and control device
CN106371552A (en) * 2015-07-22 2017-02-01 腾讯科技(深圳)有限公司 Control method and device for carrying out media representation at mobile terminals
CN106528029A (en) * 2016-12-17 2017-03-22 北京小米移动软件有限公司 Display method and device
CN106814951A (en) * 2015-11-27 2017-06-09 小米科技有限责任公司 Realize method, device and the electronic equipment of visual balance
CN105573485B (en) * 2015-05-28 2018-12-25 宇龙计算机通信科技(深圳)有限公司 A kind of display content adjustment method and terminal
CN110800308A (en) * 2017-11-08 2020-02-14 谷歌有限责任公司 Methods, systems, and media for presenting a user interface in a wearable device
US10582116B2 (en) 2015-06-30 2020-03-03 Beijing Zhigu Rui Tuo Tech Co., Ltd Shooting control method, shooting control apparatus and user equipment
CN113360804A (en) * 2021-06-03 2021-09-07 北京百度网讯科技有限公司 Interface display method and device, electronic equipment and storage medium
CN117524073A (en) * 2024-01-08 2024-02-06 深圳蓝普视讯科技有限公司 Super high definition image display jitter compensation method, system and storage medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101128792A (en) * 2005-02-25 2008-02-20 日本电气株式会社 Mobile device
CN101625844A (en) * 2008-07-07 2010-01-13 华晶科技股份有限公司 System and method for preventing screen of image display device from vibrating
CN101930302A (en) * 2009-06-19 2010-12-29 宏碁股份有限公司 Electronic device with sway compensating function and object display method thereof
CN102237069A (en) * 2010-05-05 2011-11-09 中国移动通信集团公司 Method and device for preventing screen picture from dithering

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101128792A (en) * 2005-02-25 2008-02-20 日本电气株式会社 Mobile device
CN101625844A (en) * 2008-07-07 2010-01-13 华晶科技股份有限公司 System and method for preventing screen of image display device from vibrating
CN101930302A (en) * 2009-06-19 2010-12-29 宏碁股份有限公司 Electronic device with sway compensating function and object display method thereof
CN102237069A (en) * 2010-05-05 2011-11-09 中国移动通信集团公司 Method and device for preventing screen picture from dithering

Cited By (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103677269A (en) * 2013-12-11 2014-03-26 小米科技有限责任公司 Method and device for displaying content and terminal device
CN105320254A (en) * 2014-07-25 2016-02-10 腾讯科技(深圳)有限公司 Mobile terminal display control method and device
CN104135622A (en) * 2014-08-25 2014-11-05 广东欧珀移动通信有限公司 Method and device for optimizing snapshooting through gyroscope and mobile terminal
CN104135622B (en) * 2014-08-25 2018-05-01 广东欧珀移动通信有限公司 A kind of method, device and mobile terminal of combination gyroscope optimization snap
CN104320545A (en) * 2014-11-14 2015-01-28 陕西亚成微电子股份有限公司 Anti-shake method for mobile phone screen
CN105573485B (en) * 2015-05-28 2018-12-25 宇龙计算机通信科技(深圳)有限公司 A kind of display content adjustment method and terminal
CN106293046A (en) * 2015-06-30 2017-01-04 北京智谷睿拓技术服务有限公司 Information processing method, information processor and subscriber equipment
US11256326B2 (en) 2015-06-30 2022-02-22 Beijing Zhigu Rui Tuo Tech Co., Ltd Display control method, display control apparatus and user equipment
CN106293045A (en) * 2015-06-30 2017-01-04 北京智谷睿拓技术服务有限公司 Display control method, display control unit and subscriber equipment
US10582116B2 (en) 2015-06-30 2020-03-03 Beijing Zhigu Rui Tuo Tech Co., Ltd Shooting control method, shooting control apparatus and user equipment
CN106293045B (en) * 2015-06-30 2019-09-10 北京智谷睿拓技术服务有限公司 Display control method, display control unit and user equipment
US10775883B2 (en) 2015-06-30 2020-09-15 Beijing Zhigu Rui Tuo Tech Co., Ltd Information processing method, information processing apparatus and user equipment
CN106293046B (en) * 2015-06-30 2020-03-17 北京智谷睿拓技术服务有限公司 Information processing method, information processing device and user equipment
CN106371552A (en) * 2015-07-22 2017-02-01 腾讯科技(深圳)有限公司 Control method and device for carrying out media representation at mobile terminals
CN106814951A (en) * 2015-11-27 2017-06-09 小米科技有限责任公司 Realize method, device and the electronic equipment of visual balance
CN106293061A (en) * 2016-07-22 2017-01-04 广东欧珀移动通信有限公司 Control method and control device
CN106528029B (en) * 2016-12-17 2019-10-15 北京小米移动软件有限公司 Display methods and device
CN106528029A (en) * 2016-12-17 2017-03-22 北京小米移动软件有限公司 Display method and device
CN110800308A (en) * 2017-11-08 2020-02-14 谷歌有限责任公司 Methods, systems, and media for presenting a user interface in a wearable device
US11194463B2 (en) 2017-11-08 2021-12-07 Google Llc Methods, systems, and media for presenting offset content
US11861157B2 (en) 2017-11-08 2024-01-02 Google Llc Methods, systems, and media for presenting offset content
CN113360804A (en) * 2021-06-03 2021-09-07 北京百度网讯科技有限公司 Interface display method and device, electronic equipment and storage medium
CN113360804B (en) * 2021-06-03 2024-02-27 北京百度网讯科技有限公司 Interface display method, device, electronic equipment and storage medium
CN117524073A (en) * 2024-01-08 2024-02-06 深圳蓝普视讯科技有限公司 Super high definition image display jitter compensation method, system and storage medium
CN117524073B (en) * 2024-01-08 2024-04-12 深圳蓝普视讯科技有限公司 Super high definition image display jitter compensation method, system and storage medium

Also Published As

Publication number Publication date
CN103376892B (en) 2017-02-08

Similar Documents

Publication Publication Date Title
CN103376892A (en) Method, device and terminal device for controlling display of display interface
US9411413B2 (en) Three dimensional user interface effects on a display
US11206323B2 (en) Method for determining relative positions of dual screens, display control method and terminal
US20130141324A1 (en) User interface control based on head orientation
US20150177334A1 (en) Method for displaying terminal charging status and terminal
CN107168539A (en) A kind of equipment awakening method, device and electronic equipment
CN103179278A (en) Method and device for controlling screen to rotate
CN103414844A (en) Video dithering correction method and device
CN103024191A (en) Screen rotating method, screen rotating device and mobile terminal
CN105721703A (en) Method for carrying out panoramic positioning and orientation by utilizing mobile phone device sensor
CN107580268A (en) A kind of head pose detection method, device and earphone
CN111163303A (en) Image display method, device, terminal and storage medium
CN105512613A (en) Smartphone-based eye fatigue detection method
CN109445620A (en) A kind of interaction pen automatic identifying method
CN113272765A (en) Visual indicator of user attention in AR/VR environment
CN103946887A (en) Gaze position estimation system, control method for gaze position estimation system, gaze position estimation device, control method for gaze position estimation device, program, and information storage medium
CN104299143A (en) Virtual try-in method and device
CN103632627B (en) Method for information display, device and mobile navigation electronic equipment
CN106802716B (en) Data processing method of virtual reality terminal and virtual reality terminal
CN106657976B (en) A kind of visual range extension method, device and virtual reality glasses
CN108027646A (en) A kind of terminal shows anti-fluttering method and device
CN109781144A (en) Data correcting method, device, electronic equipment and computer readable storage medium
CN107302845A (en) The low time delay analogue means and method, the computer program for this method of utilization orientation prediction
CN205880817U (en) AR and VR data processing equipment
CN107463257A (en) A kind of man-machine interaction method and device of Virtual Reality system

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant