CN104679225A - Method and device for adjusting screen of mobile terminal and mobile terminal - Google Patents
Method and device for adjusting screen of mobile terminal and mobile terminal Download PDFInfo
- Publication number
- CN104679225A CN104679225A CN201310625751.8A CN201310625751A CN104679225A CN 104679225 A CN104679225 A CN 104679225A CN 201310625751 A CN201310625751 A CN 201310625751A CN 104679225 A CN104679225 A CN 104679225A
- Authority
- CN
- China
- Prior art keywords
- eyes
- screen
- user
- unit
- angle
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Landscapes
- User Interface Of Digital Computer (AREA)
- Eye Examination Apparatus (AREA)
Abstract
The invention provides a method and a device for adjusting a screen of a mobile terminal and the mobile terminal. The method comprises the steps of acquiring position information of the eyes of a user; acquiring the front sight line of a horizontal connecting line from the left eye to the right eye, projected onto the screen of the mobile terminal according to the position information of the eyes; calculating a first included angle between the front sight line and a horizontal coordinate axis of the mobile terminal and a second included angle between the front sight line and a vertical coordinate axis of the mobile terminal; determining the rotating direction of the screen according to the second included angle, and determining the rotating angle of the screen according to the preset range of the first included angle. According to the technical scheme, the method has the advantages that the display image of the screen can be effectively adjusted according to the position information of the eyes, so that the display image can be kept in the optimal visual state of the eyes all the time, and as a result, the damage to the eyes can be avoided.
Description
Technical field
The present invention relates to mobile communication technology field, particularly a kind of screen adjustment method of mobile terminal, screen adjustment device and mobile terminal.
Background technology
Along with the development and progress of technology; mobile terminal is more and more subject to the favor of user, and people use the time of mobile terminal more and more longer, even may lie upon its side and use; in order to better protect the eyes of user, the rotation adjustment of the most support screen of existing mobile terminal.
Current hand-held mobile terminal mostly only has horizontal screen (landscape) and erects dividing of screen (portrait), and some application programs even do not support the switching of horizontal/vertical screen.Existing horizontal/vertical screen switches employing gravity sensor mostly and realizes, namely by monitoring the coordinate data of gravity sensor and then the direction of Rotation screen.
But, not all situation is all applicable to solving with gravity sensor, that is the direction of on-screen displays is not certain and there is absolute relation in terrestrial attraction direction, such as when user lies on one's side down viewing mobile terminal screen, may find that the visual direction of at this moment human eye becomes an angle of 90 degrees with the font image direction on screen, this does not meet the normal direction of people's vision, can cause larger injury to human eye.In this case, the display direction of the picture of the most applicable user's viewing should be consistent with the positive apparent direction of people.
Therefore, the positive apparent direction how effectively making the display frame of screen remain on people just becomes one of those skilled in the art's problem demanding prompt solution.
Summary of the invention
What the present invention solved is the problem that the display frame of screen in prior art cannot be consistent with the positive apparent direction of people all the time.
For solving the problem, the invention provides a kind of screen adjustment method of mobile terminal, comprising:
Obtain the positional information of two eyes of user;
Obtain left eye to the horizontal line of right eye according to the positional information of two eyes and be projected to positive sight line on the screen of mobile terminal;
Calculate the first angle between described positive sight line and the horizontal axis of mobile terminal and the second angle between described positive sight line and the vertical coordinate axle of described mobile terminal;
According to the sense of rotation of described second angle determination screen, and the anglec of rotation of preset range determination screen residing for described first angle.
Optionally, the positional information of two eyes of described acquisition user comprises:
Obtain the image of the user of viewing screen;
From the image of described user, obtain the human eye area of user and determine multiple candidate's eyes pair;
The multiple candidate's eyes determined pair are mated to obtain the positional information of two eyes of user with the template photo of the described user prestored.
Optionally, from the image of described user, obtain the human eye area of user based on integral projection method and determine multiple candidate's eyes pair.
Optionally, described the multiple candidate's eyes the determined pair step of mating with the template photo of the described user prestored to be comprised:
Obtain the full face of described user in advance and store using the template photo as described user;
Calculate the similarity between each candidate's eyes pair and the template photo of described user respectively;
Using candidate's eyes the highest for similarity to the positional information of the positional information of correspondence as two eyes of described user.
Optionally, described the multiple candidate's eyes the determined pair step of mating with the template photo of the described user prestored to be comprised:
Obtain the full face of described user in advance and store using the template photo as described user;
Obtain according to the template photo of described user and store the two intraocular lateral extents of user and the typical ratio of two outer lateral extents;
Calculate the similarity between each candidate's eyes pair and the template photo of described user respectively;
Judge whether the similarity calculated meets pre-conditioned;
When at least one similarity meets pre-conditioned, using candidate's eyes the highest for similarity to the positional information of the positional information of correspondence as two eyes of described user;
When whole similarities does not all meet pre-conditioned, calculate the ratio of each candidate's eyes centering two intraocular lateral extent and two outer lateral extents; The ratio of two intraocular lateral extents and two outer lateral extents is equaled candidate's eyes of typical ratio to the positional information of two eyes as described user.
Optionally, the described sense of rotation step according to described second angle determination screen comprises: when described second angle is less than 90 degree, determine that the sense of rotation of screen is for turning clockwise; When described second angle is greater than 90 degree, determine that the sense of rotation of screen is for being rotated counterclockwise.
Optionally, the step of the anglec of rotation of described preset range determination screen residing for described first angle comprises:
Judge the current preset scope residing for described first angle;
The anglec of rotation of corresponding screen is determined based on described current preset scope;
When described first angle is within the scope of current preset, described screen keeps static.
Optionally, when described first angle exceeds current preset scope, rejudge the preset range residing for described first angle, and screen is rotated by the anglec of rotation corresponding according to the preset range redefined.
Present invention also offers a kind of screen adjustment device, comprising:
Location information acquiring unit, is suitable for the positional information of two eyes obtaining user;
Positive sight line acquiring unit, is suitable for obtaining left eye to the horizontal line of right eye according to the positional information of two eyes and is projected to positive sight line on the screen of mobile terminal;
Angle acquiring unit, is suitable for calculating the first angle between described positive sight line and the horizontal axis of mobile terminal and the second angle between described positive sight line and the vertical coordinate axle of described mobile terminal;
Screen rotation unit, is suitable for the sense of rotation according to described second angle determination screen, and the anglec of rotation of preset range determination screen residing for described first angle.
Optionally, described location information acquiring unit comprises:
Image acquisition units, is suitable for the image of the user obtaining viewing screen;
Eyes, to determining unit, are suitable for obtaining the human eye area of user from the image of described user and determine multiple candidate's eyes pair;
First storage unit, is suitable for the template photo storing user;
Matching unit, connects described eyes to determining unit and the first storage unit, is suitable for the positional information mating the multiple candidate's eyes determined pair to obtain with the template photo of the described user prestored two eyes of user.
Optionally, described matching unit comprises:
Call unit, connects described first storage unit, is suitable for the template photo of invoke user from described first storage unit;
Computing unit, connects described eyes to determining unit and described call unit, is suitable for calculating respectively the similarity between each candidate's eyes pair and the template photo of described user;
Determining unit, using candidate's eyes the highest for similarity to the positional information of the positional information of correspondence as two eyes of described user.
Optionally, described location information acquiring unit also comprises: typical ratio acquiring unit, connect described first storage unit, be suitable for obtaining the two intraocular lateral extents of user and the typical ratio of two outer lateral extents according to the template photo of described user and described typical ratio being stored to described first storage unit;
Described matching unit comprises:
Call unit, connects described first storage unit, is suitable for the template photo of invoke user from described first storage unit;
Computing unit, connect described eyes to determining unit and described call unit, be suitable for calculating respectively the similarity between each candidate's eyes pair and the template photo of described user, and calculate the ratio of each candidate's eyes centering two intraocular lateral extent and two outer lateral extents;
Judging unit, connects described computing unit, and whether the similarity being suitable for judging to calculate meets pre-conditioned;
Determining unit, connect described judging unit, computing unit and typical ratio acquiring unit, be suitable for when at least one similarity meets pre-conditioned, using candidate's eyes the highest for similarity to the positional information of the positional information of correspondence as two eyes of described user; Or, when whole similarities does not all meet pre-conditioned, the ratio of two intraocular lateral extents and two outer lateral extents is equaled candidate's eyes of typical ratio to the positional information of two eyes as described user.
Optionally, described screen rotation unit comprises: the first comparing unit, connects described angle acquiring unit, is suitable for, when described second angle is less than 90 degree, determining that the sense of rotation of screen is for turning clockwise; When described second angle is greater than 90 degree, determine that the sense of rotation of screen is for being rotated counterclockwise.
Optionally, described screen rotation unit also comprises:
Second storage unit, is suitable for the corresponding relation storing preset range and the anglec of rotation;
Second comparing unit, connects described angle acquiring unit and the second storage unit, is suitable for judging the current preset scope residing for described first angle, to determine the anglec of rotation of corresponding screen;
Display adjustment unit, connects described first comparing unit and the second comparing unit, is suitable for, according to the sense of rotation of the screen determined and the anglec of rotation of screen, screen is carried out display adjustment.
The present invention also provides a kind of mobile terminal, comprises the screen adjustment device described in above-mentioned any one.
Compared with prior art, technical scheme of the present invention has the following advantages:
In technical solution of the present invention, determine to join in the positive sight line on mobile terminal by the positional information of two eyes obtaining user, and determine the sense of rotation of screen and the anglec of rotation of screen by the angle calculated between positive sight line and the coordinate axis of mobile terminal.Screen adjustment method of the present invention can carry out the display frame of adjusting screen effectively according to the positional information of human eye, thus under making display frame be in the optimum visual state of human eye all the time, avoids the injury to eyes.
Further, in technical solution of the present invention, the multiple candidate's eyes determined pair can be mated to obtain real candidate's eyes pair with the template photo of the user prestored, thus improve the accuracy that human eye is positioned.
Further, in technical solution of the present invention, the anglec of rotation of screen can be kept within the specific limits constant, namely when the eye position change of user is little, the display frame of screen keeps static, thus the human eye injury that the rotation avoiding screen too frequently causes.
Accompanying drawing explanation
Fig. 1 is the schematic flow sheet of the screen adjustment method of mobile terminal of the present invention;
Fig. 2 is the schematic flow sheet of a kind of implementation of step S1 in Fig. 1;
Fig. 3 is the schematic flow sheet of a kind of implementation of step S13 in Fig. 2;
Fig. 4 is a kind of using state schematic diagram of mobile terminal of the present invention;
Fig. 5 is the structural representation of screen adjustment device of the present invention;
Fig. 6 is the structural representation of a kind of implementation of positional information acquisition device in Fig. 5;
The structural representation of Fig. 7 to be Fig. 5 be another kind of implementation of positional information acquisition device.
Embodiment
As described in the background art, existing mobile terminal can only provide the switching between horizontal/vertical screen mostly when adjusting the direction of display frame in screen, and rely on gravity sensor cannot realize the rotation of screen in most cases, thus human eye is damaged.
In technical solution of the present invention, by obtaining the positional information of human eye, and realize the localization and tracking to human eye according to the human eye angle joined between positive sight line on screen and mobile terminal coordinate axis, thus realize the function adjusting the display frame of screen according to the positional information of human eye in real time.
For enabling above-mentioned purpose of the present invention, feature and advantage more become apparent, and are described in detail specific embodiments of the invention below in conjunction with accompanying drawing.
Fig. 1 is the schematic flow sheet of the screen adjustment method of mobile terminal of the present invention.With reference to figure 1, the screen adjustment method of described mobile terminal, comprising:
Step S1, obtains the positional information of two eyes of user;
Step S2, obtains left eye to the horizontal line of right eye according to the positional information of two eyes and is projected to positive sight line on the screen of mobile terminal;
Step S3, calculates the first angle between described positive sight line and the horizontal axis of mobile terminal and the second angle between described positive sight line and the vertical coordinate axle of described mobile terminal;
Step S4, according to the sense of rotation of described second angle determination screen, and the anglec of rotation of preset range determination screen residing for described first angle.
Particularly, with reference to figure 2, the positional information obtaining two eyes of user described in step S1 comprises:
Step S11, obtains the image of the user of viewing screen;
In a particular embodiment, the image of the user of current viewing screen can be obtained by the first-class device of shooting.Such as, can be taken pictures to user by the camera in mobile terminal, thus get the head portrait of user, this is well known to those skilled in the art, and does not repeat them here.
Step S12, obtains the human eye area of user and determines multiple candidate's eyes pair from the image of described user;
In embody rule, because the gray feature of human eye area exists obviously different from other region of face, therefore, can from the image of described user, obtain the human eye area of user based on integral projection method (Gray Projection method) and determine multiple candidate's eyes pair.
After drawing the human eye area of user, the gray scale of comprehensive eyes and the intensity variation of around eyes, can obtain some eyes pair to candidate; And become candidate's eyes to meeting two conditions below:
Distance between (1) two will be suitable for; That is, the distance between 2 can not be excessive; According to the image analyzing the user got, the distance that can estimate between 2 should not be greater than 1/2 of human eye area picture traverse; Correspondingly, the distance between two can not be too small, such as, is generally not less than 1/4 of picture traverse.
Line between (2) two and the angle of horizontal direction are no more than 30 degree usually.
Only have meet above two conditions simultaneously just can be confirmed as real candidate's eyes pair.Certainly, one skilled in the art will appreciate that due to individual difference, above-mentionedly can carry out accommodation according to actual conditions about right the satisfying condition of candidate's eyes, be not limited to above-mentioned explanation.
It should be noted that, can also after the image getting user, first carry out the process such as denoising and adjustment gray scale spacing to image, thus reduce the harmful effect that noise brings to greatest extent, ensure the gray scale quality of image simultaneously.Concrete disposal route can adopt existing technology to realize, and the present invention does not limit this.
The multiple candidate's eyes determined pair are mated to obtain the positional information of two eyes of user by step S13 with the template photo of the described user prestored.
Concrete, the step of above-mentioned coupling can realize by the following method:
First, obtain the full face of described user in advance and store using the template photo as described user;
Such as, in advance by the full face of the filming apparatus shooting user of mobile terminal, and full face is carried out store the template photo using as described user.Certainly, alternate manner also can be adopted to obtain the full face of user, such as, by bluetooth, WIFI or additive method, the full face of the user prestored can also be transferred in mobile terminal using the template photo as user.
Secondly, the similarity between each candidate's eyes pair and the template photo of described user is calculated respectively.That is, using the template photo of user that prestores as sample, candidate's eyes of getting in above-mentioned steps S12 pair and sample are carried out Similarity Measure.Method about Similarity Measure can adopt prior art to realize, and does not repeat them here.
Finally, the similarity calculated is sorted, using candidate's eyes the highest for similarity to the positional information of the positional information of correspondence as two eyes of described user.
Inventor is through research: directly calculate candidate's eyes that similarity draws to may not being position of human eye the most accurately in actual applications, this is because in actual use, the possibility that eyes tilt may be there is in user, also may there are eyes to open and closed possibility, if it is very inaccurate directly to calculate similarity.For addressing these problems, the present inventor provides a kind of method of more accurate eyes location, particularly with reference to figure 3:
Perform step S131, obtain the full face of described user in advance and store using the template photo as described user.This step can be realized by any one mode aforementioned, does not repeat them here.
Perform step S132, obtain according to the template photo of described user and store the two intraocular lateral extents of user and the typical ratio of two outer lateral extents.
Particularly, after getting the template photo of user, by the ratio between the two intraocular lateral extents of user in the existing disposal route calculation template photo width of the wing of nose (namely between two) and two outer lateral extents (width between namely outside two canthus), can will calculate ratio and store as typical ratio.
Perform step S133, calculate the similarity between each candidate's eyes pair and the template photo of described user respectively.
That is, using the template photo of user that prestores as sample, candidate's eyes of getting in above-mentioned steps S12 pair and sample are carried out Similarity Measure.Method about Similarity Measure can adopt prior art to realize, and does not repeat them here.
Then perform step S134, judge whether the similarity calculated meets pre-conditioned.
When at least one similarity meets pre-conditioned, perform step S135, using candidate's eyes the highest for similarity to the positional information of the positional information of correspondence as two eyes of described user;
When whole similarities does not all meet pre-conditioned, perform step S136, calculate the ratio of each candidate's eyes centering two intraocular lateral extent and two outer lateral extents; Finally perform step S137, the ratio of two intraocular lateral extents and two outer lateral extents is equaled candidate's eyes of typical ratio to the positional information of two eyes as described user.
In conjunction with a concrete example, the step shown in Fig. 3 is described in detail again below.
First, obtain the full face of user by the front-facing camera of mobile terminal and store, the full face of this user is as the template photo of user;
Then, the template photo of the user got is processed, and the typical ratio calculated between the two intraocular lateral extents of user and two outer lateral extents preserving.For convenience of describing, described typical ratio is designated as D0, and such as, described typical ratio D0 is 0.3.
Then, get current viewing screen user image and get multiple candidate's eyes to rear, perform step S133.Suppose, the candidate's eyes got, to being 3, are respectively first candidate's eyes pair, second candidate's eyes to the 3rd candidate's eyes pair.Calculate by performing step S133, the similarity between described first candidate's eyes pair and the template photo of user is 80%; Similarity between second candidate's eyes pair and the template photo of user is 98%; Similarity between 3rd candidate's eyes pair and the template photo of user is 90%.
So, when performing step S134, if pre-conditioned be: the similarity before the template photo of candidate's eyes pair and user is greater than 95%, similarity then between second candidate's eyes pair and the template photo of user meets condition in advance, therefore step S135 is performed, using second candidate's eyes to the positional information of the positional information of correspondence as two eyes of described user.
Should be understood that: if exist multiple when meeting pre-conditioned, so then using candidate's eyes the highest for similarity to the positional information of the positional information of correspondence as two eyes of user.
In another scenario, if pre-conditioned in step S134 is: the similarity before the template photo of candidate's eyes pair and user is greater than 99%, so, all similarities all do not meet pre-conditioned, at this moment will perform step S136, namely calculate the ratio of each candidate's eyes centering two intraocular lateral extent and two outer lateral extents more respectively.Suppose, the ratio D1 of first candidate's eyes centering two intraocular lateral extent and two outer lateral extents is 0.2 again; The ratio D2 of second candidate's eyes centering two intraocular lateral extent and two outer lateral extents is 0.4; The ratio D3 of the 3rd candidate's eyes centering two intraocular lateral extent and two outer lateral extents is 0.3.
Because the 3rd candidate's eyes centering two intraocular lateral extent is equal with typical ratio D0 with the ratio D3 of two outer lateral extents, after therefore performing step S137, using the 3rd candidate's eyes to the positional information of the positional information of correspondence as two eyes of user.
When the similarity of the template photo of calculated candidate eyes pair and user can not locate eyes accurately, the inner distance of calculating two and the ratio of outer lateral extent can be passed through, by the candidate eyes identical with typical ratio to determining, to realize more accurate eyes location, thus substantially increase the accuracy of eyes location.
Continue with reference to figure 1, after the positional information (namely performing step S1) of two eyes getting user, execution step S2 can get human eye and join in the positive sight line on the screen of mobile terminal.In the present invention, using the left eye of user to the line of right eye as positive sight line, described positive sight line has direction, and be namely forward from left eye to the direction of right eye, right eye is reverse to the direction of left eye.
After the positive sight line of acquisition, perform step S3, calculate the first angle between described positive sight line and the horizontal axis of mobile terminal and the second angle between described positive sight line and the vertical coordinate axle of described mobile terminal.The one that Fig. 4 shows mobile terminal of the present invention uses situation schematic diagram, and with reference to figure 4, the horizontal axis X of mobile terminal there occurs corresponding change to vertical coordinate axle Y along with the inclination of mobile terminal.The left eye positional information of what in Fig. 4, L represented is user, the right eye positional information of what R represented is user, the first angle between left eye to the line of vector LR and horizontal axis X of right eye is α; The second angle between left eye to the line of vector LR and vertical coordinate axle Y of right eye is β.
After calculating the first angle α and the second angle β, perform step S4, namely determine the sense of rotation of screen according to described second angle β, and the anglec of rotation of preset range determination screen residing for described first angle α.
Concrete, describedly determine that the sense of rotation step of screen can comprise according to described second angle β: when described second angle β is less than 90 degree, determine that the sense of rotation of screen is for turning clockwise; When described second angle β is greater than 90 degree, determine that the sense of rotation of screen is for being rotated counterclockwise.
The step of the anglec of rotation of described preset range determination screen residing for described first angle α can comprise:
Judge the current preset scope residing for described first angle α;
The anglec of rotation of corresponding screen is determined based on described current preset scope;
When described first angle α is within the scope of current preset, described screen keeps static.
Optionally, when described first angle α exceeds current preset scope, rejudge the preset range residing for described first angle α, and screen is rotated by the anglec of rotation corresponding according to the preset range redefined.
Composition graphs 4, the described preset range of the first angle α and the anglec of rotation of correspondence can do following setting:
When the first angle α be greater than 0 degree be less than 20 degree time, the anglec of rotation be 0 degree (i.e. the state of perpendicular screen);
When the first angle α is greater than or equal to 20 degree and is less than 40 degree, the anglec of rotation is 30 degree;
When the first angle α is greater than or equal to 40 degree and is less than 60 degree, the anglec of rotation is 50 degree;
When the first angle α is greater than or equal to 60 degree and is less than 80 degree, the anglec of rotation is 70 degree;
When the first angle α is greater than or equal to 80 degree and is less than or equal to 90 degree, the anglec of rotation is 90 degree (i.e. states of horizontal screen);
When the first angle α is greater than 90 degree (mobile terminal is in the state of falling screen), it is constant that the anglec of rotation maintains Last status.
Based on above-mentioned setting, be 60 degree when calculating the second angle β, and when the first angle α is 30 degree, the screen of mobile terminal will rotate 30 degree according to clockwise direction; And the first angle α between the positive sight line and the horizontal axis of mobile terminal of eyes is when being greater than or equal to 20 degree and be less than 40 degree (i.e. current preset scope), the screen of mobile terminal is by constant for the state remaining on rotation 30 degree, until the first angle α between the positive sight line of eyes and the horizontal axis of mobile terminal exceeds current preset scope, and fall into other preset range, so, then need to redefine preset range and rotate according to the anglec of rotation determined.Such as, when the first angle α between the positive sight line of eyes and the horizontal axis of mobile terminal becomes 65 degree, so, then the anglec of rotation redefining screen is 70 degree, therefore, and the rotation that screen will carry out 70 degree.
Certainly, the setting of the above-mentioned preset range about the first angle is only one and illustrates, invention technician can also do other according to embody rule and arrange, and this should not limit the scope of the invention.
The screen adjustment method of mobile terminal of the present invention; by positioning two eyes of user; then according to the anglec of rotation and the sense of rotation of the positional information determination screen of the eyes determined; thus the display frame of mobile terminal can be consistent with the positive apparent direction of user, thus effectively protect the eyes of user.
Further, compared with typical ratio by the inner distance of calculating two and the ratio of outer lateral extent in the present invention, the positional information of two eyes of user can be determined more accurately, improve the accuracy of human eye location.
On the other hand, technical solution of the present invention is provided with the preset range of multiple first angle, thus effectively ensure that in certain scope, can not Rotation screen frequently, but within the scope of certain angle, keep the state of screen constant, thus avoid and that human eye caused huge injury fixing due to screen.
Accordingly, present invention also offers a kind of screen adjustment device, with reference to figure 5, described screen adjustment device comprises: location information acquiring unit 10, positive sight line acquiring unit 20, angle acquiring unit 30 and screen rotation unit 40.
Described location information acquiring unit 10 is suitable for the positional information of two eyes obtaining user;
Described positive sight line acquiring unit 20 connects described location information acquiring unit 10, is suitable for obtaining left eye to the horizontal line of right eye according to the positional information of two eyes and is projected to positive sight line on the screen of mobile terminal;
Described angle acquiring unit 30 connects described positive sight line acquiring unit 20, is suitable for calculating the first angle between described positive sight line and the horizontal axis of mobile terminal and the second angle between described positive sight line and the vertical coordinate axle of described mobile terminal;
Described screen rotation unit 40 connects described angle acquiring unit 30, is suitable for the sense of rotation according to described second angle determination screen, and the anglec of rotation of preset range determination screen residing for described first angle.
Fig. 6 shows the structural representation of a kind of implementation of location information acquiring unit; With reference to figure 6, described location information acquiring unit comprises:
Image acquisition units 101, is suitable for the image of the user obtaining viewing screen; Described image acquisition units can be the filming apparatus in existing mobile terminal, and such as front-facing camera, can certainly be other device, the present invention limit this.
Eyes, to determining unit 102, connect described image acquisition units 101, and described eyes are suitable for obtaining the human eye area of user from the image of described user to determining unit 102 and determine multiple candidate's eyes pair;
First storage unit 103, is suitable for the template photo storing user; Described first storage unit 103 can adopt existing memory storage, as FLASH memory etc. realizes.
Matching unit 104, connect described eyes to determining unit 102 and the first storage unit 103, described matching unit 104 is suitable for the positional information mating the multiple candidate's eyes determined pair to obtain with the template photo of the described user prestored two eyes of user.
Continue with reference to figure 6, described matching unit 104 can comprise:
Call unit 1041, connects described first storage unit 103, is suitable for the template photo of invoke user from described first storage unit 103;
Computing unit 1042, connects described eyes to determining unit 102 and described call unit 1041, is suitable for calculating respectively the similarity between each candidate's eyes pair and the template photo of described user;
Determining unit 1043, connects described computing unit 1042, is suitable for candidate's eyes the highest for similarity the positional information of the positional information of correspondence as two eyes of described user.
Fig. 7 shows the structural representation of the another kind of implementation of location information acquiring unit; With reference to figure 7, described location information acquiring unit comprises: image acquisition units 101, eyes are to determining unit 102, first storage unit 103, matching unit 104 and typical ratio acquiring unit 105.Described image acquisition units 101, eyes are similar to the corresponding unit shown in determining unit 102 and the first storage unit 103 and Fig. 6, do not repeat them here.
Concrete, described typical ratio acquiring unit 105 connects described first storage unit 103, is suitable for obtaining the two intraocular lateral extents of user and the typical ratio of two outer lateral extents according to the template photo of described user and described typical ratio being stored to described first storage unit 103.
In addition, described matching unit 104 comprises:
Call unit 1041, connects described first storage unit 103, is suitable for the template photo of invoke user from described first storage unit;
Computing unit 1042, connect described eyes to determining unit 102 and described call unit 1041, be suitable for calculating respectively the similarity between each candidate's eyes pair and the template photo of described user, and calculate the ratio of each candidate's eyes centering two intraocular lateral extent and two outer lateral extents;
Judging unit 1044, connects described computing unit 1042, and whether the similarity being suitable for judging to calculate meets pre-conditioned;
Determining unit 1045, connect described judging unit 1044, computing unit 1042 and typical ratio acquiring unit 105, be suitable for when at least one similarity meets pre-conditioned, using candidate's eyes the highest for similarity to the positional information of the positional information of correspondence as two eyes of described user; Or, when whole similarities does not all meet pre-conditioned, the ratio of two intraocular lateral extents and two outer lateral extents is equaled candidate's eyes of typical ratio to the positional information of two eyes as described user.
Continue with reference to figure 5, described screen rotation unit 40 can comprise: the first comparing unit, connects described angle acquiring unit, is suitable for, when described second angle is less than 90 degree, determining that the sense of rotation of screen is for turning clockwise; When described second angle is greater than 90 degree, determine that the sense of rotation of screen is for being rotated counterclockwise.
In addition, described screen rotation unit 40 can also comprise:
Second storage unit, is suitable for the corresponding relation storing preset range and the anglec of rotation;
Second comparing unit, connects described angle acquiring unit and the second storage unit, is suitable for judging the current preset scope residing for described first angle, to determine the anglec of rotation of corresponding screen;
Display adjustment unit, connects described first comparing unit and the second comparing unit, is suitable for, according to the sense of rotation of the screen determined and the anglec of rotation of screen, screen is carried out display adjustment.
With reference to the related description in preceding method, can not repeat them here about the principle of work of above-mentioned screen adjustment device and the course of work.
Screen adjustment device of the present invention can carry out the anglec of rotation of adjusting screen timely according to the positional information of human eye, thus effectively reduces the injury to human eye;
In addition, screen adjustment device of the present invention is when detecting that the first angle is in certain preset range, and by keeping, the anglec of rotation of screen is constant, thus reduce further owing to frequently rotating the human eye injury caused;
Further, screen adjustment device of the present invention is when positioning the eyes of user, by calculating the ratio between the inner distance of two and outer lateral extent, using the positional information of the candidate eyes equal with typical ratio to two eyes as user, thus the problem that cannot obtain the positional information of eyes accurately solved because the reasons such as eyes inclination or eye closing cause, effectively improve the accuracy of eyes location.
The present invention also provides a kind of mobile terminal, comprises the screen adjustment device described in above-mentioned any one.
Although the present invention discloses as above, the present invention is not defined in this.Any those skilled in the art, without departing from the spirit and scope of the present invention, all can make various changes or modifications, and therefore protection scope of the present invention should be as the criterion with claim limited range.
Claims (15)
1. a screen adjustment method for mobile terminal, is characterized in that, comprising:
Obtain the positional information of two eyes of user;
Obtain left eye to the horizontal line of right eye according to the positional information of two eyes and be projected to positive sight line on the screen of mobile terminal;
Calculate the first angle between described positive sight line and the horizontal axis of mobile terminal and the second angle between described positive sight line and the vertical coordinate axle of described mobile terminal;
According to the sense of rotation of described second angle determination screen, and the anglec of rotation of preset range determination screen residing for described first angle.
2. the screen adjustment method of mobile terminal as claimed in claim 1, is characterized in that, the positional information of two eyes of described acquisition user comprises:
Obtain the image of the user of viewing screen;
From the image of described user, obtain the human eye area of user and determine multiple candidate's eyes pair;
The multiple candidate's eyes determined pair are mated to obtain the positional information of two eyes of user with the template photo of the described user prestored.
3. the screen adjustment method of mobile terminal as claimed in claim 2, is characterized in that, obtain the human eye area of user and determine multiple candidate's eyes pair based on integral projection method from the image of described user.
4. the screen adjustment method of mobile terminal as claimed in claim 2, is characterized in that, describedly the multiple candidate's eyes the determined pair step of mating with the template photo of the described user prestored is comprised:
Obtain the full face of described user in advance and store using the template photo as described user;
Calculate the similarity between each candidate's eyes pair and the template photo of described user respectively;
Using candidate's eyes the highest for similarity to the positional information of the positional information of correspondence as two eyes of described user.
5. the screen adjustment method of mobile terminal as claimed in claim 2, is characterized in that, describedly the multiple candidate's eyes the determined pair step of mating with the template photo of the described user prestored is comprised:
Obtain the full face of described user in advance and store using the template photo as described user;
Obtain according to the template photo of described user and store the two intraocular lateral extents of user and the typical ratio of two outer lateral extents;
Calculate the similarity between each candidate's eyes pair and the template photo of described user respectively;
Judge whether the similarity calculated meets pre-conditioned;
When at least one similarity meets pre-conditioned, using candidate's eyes the highest for similarity to the positional information of the positional information of correspondence as two eyes of described user;
When whole similarities does not all meet pre-conditioned, calculate the ratio of each candidate's eyes centering two intraocular lateral extent and two outer lateral extents; The ratio of two intraocular lateral extents and two outer lateral extents is equaled candidate's eyes of typical ratio to the positional information of two eyes as described user.
6. the screen adjustment method of mobile terminal as claimed in claim 1, it is characterized in that, the described sense of rotation step according to described second angle determination screen comprises: when described second angle is less than 90 degree, determine that the sense of rotation of screen is for turning clockwise; When described second angle is greater than 90 degree, determine that the sense of rotation of screen is for being rotated counterclockwise.
7. the screen adjustment method of mobile terminal as claimed in claim 1, it is characterized in that, the step of the anglec of rotation of described preset range determination screen residing for described first angle comprises:
Judge the current preset scope residing for described first angle;
The anglec of rotation of corresponding screen is determined based on described current preset scope;
When described first angle is within the scope of current preset, described screen keeps static.
8. the screen adjustment method of mobile terminal as claimed in claim 7, it is characterized in that, when described first angle exceeds current preset scope, rejudge the preset range residing for described first angle, and screen is rotated by the anglec of rotation corresponding according to the preset range redefined.
9. a screen adjustment device, is characterized in that, comprising:
Location information acquiring unit, is suitable for the positional information of two eyes obtaining user;
Positive sight line acquiring unit, is suitable for obtaining left eye to the horizontal line of right eye according to the positional information of two eyes and is projected to positive sight line on the screen of mobile terminal;
Angle acquiring unit, is suitable for calculating the first angle between described positive sight line and the horizontal axis of mobile terminal and the second angle between described positive sight line and the vertical coordinate axle of described mobile terminal;
Screen rotation unit, is suitable for the sense of rotation according to described second angle determination screen, and the anglec of rotation of preset range determination screen residing for described first angle.
10. screen adjustment device as claimed in claim 9, it is characterized in that, described location information acquiring unit comprises:
Image acquisition units, is suitable for the image of the user obtaining viewing screen;
Eyes, to determining unit, are suitable for obtaining the human eye area of user from the image of described user and determine multiple candidate's eyes pair;
First storage unit, is suitable for the template photo storing user;
Matching unit, connects described eyes to determining unit and the first storage unit, is suitable for the positional information mating the multiple candidate's eyes determined pair to obtain with the template photo of the described user prestored two eyes of user.
11. screen adjustment devices as claimed in claim 10, it is characterized in that, described matching unit comprises:
Call unit, connects described first storage unit, is suitable for the template photo of invoke user from described first storage unit;
Computing unit, connects described eyes to determining unit and described call unit, is suitable for calculating respectively the similarity between each candidate's eyes pair and the template photo of described user;
Determining unit, using candidate's eyes the highest for similarity to the positional information of the positional information of correspondence as two eyes of described user.
12. screen adjustment devices as claimed in claim 10, it is characterized in that, described location information acquiring unit also comprises: typical ratio acquiring unit, connect described first storage unit, be suitable for obtaining the two intraocular lateral extents of user and the typical ratio of two outer lateral extents according to the template photo of described user and described typical ratio being stored to described first storage unit;
Described matching unit comprises:
Call unit, connects described first storage unit, is suitable for the template photo of invoke user from described first storage unit;
Computing unit, connect described eyes to determining unit and described call unit, be suitable for calculating respectively the similarity between each candidate's eyes pair and the template photo of described user, and calculate the ratio of each candidate's eyes centering two intraocular lateral extent and two outer lateral extents;
Judging unit, connects described computing unit, and whether the similarity being suitable for judging to calculate meets pre-conditioned;
Determining unit, connect described judging unit, computing unit and typical ratio acquiring unit, be suitable for when at least one similarity meets pre-conditioned, using candidate's eyes the highest for similarity to the positional information of the positional information of correspondence as two eyes of described user; Or, when whole similarities does not all meet pre-conditioned, the ratio of two intraocular lateral extents and two outer lateral extents is equaled candidate's eyes of typical ratio to the positional information of two eyes as described user.
13. screen adjustment devices as claimed in claim 9, it is characterized in that, described screen rotation unit comprises: the first comparing unit, connects described angle acquiring unit, be suitable for, when described second angle is less than 90 degree, determining that the sense of rotation of screen is for turning clockwise; When described second angle is greater than 90 degree, determine that the sense of rotation of screen is for being rotated counterclockwise.
14. screen adjustment devices as claimed in claim 13, it is characterized in that, described screen rotation unit also comprises:
Second storage unit, is suitable for the corresponding relation storing preset range and the anglec of rotation;
Second comparing unit, connects described angle acquiring unit and the second storage unit, is suitable for judging the current preset scope residing for described first angle, to determine the anglec of rotation of corresponding screen;
Display adjustment unit, connects described first comparing unit and the second comparing unit, is suitable for, according to the sense of rotation of the screen determined and the anglec of rotation of screen, screen is carried out display adjustment.
15. 1 kinds of mobile terminals, is characterized in that, comprise the screen adjustment device as described in any one of claim 9 ~ 14.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310625751.8A CN104679225B (en) | 2013-11-28 | 2013-11-28 | Screen adjustment method, screen adjustment device and the mobile terminal of mobile terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310625751.8A CN104679225B (en) | 2013-11-28 | 2013-11-28 | Screen adjustment method, screen adjustment device and the mobile terminal of mobile terminal |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104679225A true CN104679225A (en) | 2015-06-03 |
| CN104679225B CN104679225B (en) | 2018-02-02 |
Family
ID=53314424
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310625751.8A Expired - Fee Related CN104679225B (en) | 2013-11-28 | 2013-11-28 | Screen adjustment method, screen adjustment device and the mobile terminal of mobile terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104679225B (en) |
Cited By (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105045395A (en) * | 2015-08-28 | 2015-11-11 | 京东方科技集团股份有限公司 | Display device and image display method |
| CN105760795A (en) * | 2016-01-28 | 2016-07-13 | 宇龙计算机通信科技(深圳)有限公司 | Method and terminal for displaying information |
| CN106598209A (en) * | 2015-10-20 | 2017-04-26 | 中兴通讯股份有限公司 | Terminal screen display control method, device and terminal |
| CN107155099A (en) * | 2017-06-06 | 2017-09-12 | 苏州佳世达电通有限公司 | Display device and its control method |
| CN108388849A (en) * | 2018-02-07 | 2018-08-10 | 广东欧珀移动通信有限公司 | The method and apparatus of the display image of adjustment terminal, electronic equipment, storage medium |
| CN108614634A (en) * | 2016-12-09 | 2018-10-02 | 北京视联动力国际信息技术有限公司 | A kind of mobile device shows the method and mobile device of screen rotation |
| US10170074B2 (en) | 2016-03-23 | 2019-01-01 | Boe Technology Group Co., Ltd. | Display screen adjusting method, display screen adjusting apparatus, as well as display device |
| CN109445735A (en) * | 2018-10-22 | 2019-03-08 | 奇酷互联网络科技（深圳）有限公司 | Control method, mobile terminal and the computer storage medium of display direction |
| CN109696201A (en) * | 2018-12-29 | 2019-04-30 | 维沃移动通信有限公司 | A kind of SOT state of termination determines method and terminal |
| CN111443772A (en) * | 2020-03-26 | 2020-07-24 | 合肥联宝信息技术有限公司 | Method for adjusting electronic equipment |
| CN111857910A (en) * | 2020-06-28 | 2020-10-30 | 维沃移动通信有限公司 | Information display method and device and electronic equipment |
| CN112445342A (en) * | 2020-11-26 | 2021-03-05 | 维沃移动通信有限公司 | Display screen control method and device and electronic equipment |
| CN113867535A (en) * | 2021-10-11 | 2021-12-31 | 展讯通信（深圳）有限公司 | Screen display method, screen display device, terminal equipment and storage medium |
| CN114071231A (en) * | 2021-10-25 | 2022-02-18 | 中国航空无线电电子研究所 | Eye position self-adaptive display system and implementation method thereof |
| WO2024027169A1 (en) * | 2022-08-03 | 2024-02-08 | 中兴通讯股份有限公司 | Adjustable human-computer interaction apparatus, control method, and storage medium |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101465116A (en) * | 2009-01-07 | 2009-06-24 | 北京中星微电子有限公司 | Display equipment and control method thereof |
| US20090239579A1 (en) * | 2008-03-24 | 2009-09-24 | Samsung Electronics Co. Ltd. | Mobile device capable of suitably displaying information through recognition of user's face and related method |
| CN101840509A (en) * | 2010-04-30 | 2010-09-22 | 深圳华昌视数字移动电视有限公司 | Measuring method for eye-observation visual angle and device thereof |
| CN101950550A (en) * | 2010-09-28 | 2011-01-19 | 冠捷显示科技（厦门）有限公司 | Display device for displaying pictures at different angles based on visual angle of viewer |
| CN101984453A (en) * | 2010-11-02 | 2011-03-09 | 中国科学技术大学 | Human eye recognition system and method |
| CN101989126A (en) * | 2009-08-07 | 2011-03-23 | 深圳富泰宏精密工业有限公司 | Handheld electronic device and automatic screen picture rotating method thereof |
| CN102662476A (en) * | 2012-04-20 | 2012-09-12 | 天津大学 | Gaze estimation method |
| CN102760024A (en) * | 2011-04-26 | 2012-10-31 | 鸿富锦精密工业（深圳）有限公司 | Screen picture rotating method and system |
| CN103024191A (en) * | 2012-12-21 | 2013-04-03 | 广东欧珀移动通信有限公司 | Screen rotating method, screen rotating device and mobile terminal |
| WO2013071826A1 (en) * | 2011-11-14 | 2013-05-23 | 华为技术有限公司 | Method and terminal for switching horizontal and vertical display modes of screen |
-
2013
- 2013-11-28 CN CN201310625751.8A patent/CN104679225B/en not_active Expired - Fee Related
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090239579A1 (en) * | 2008-03-24 | 2009-09-24 | Samsung Electronics Co. Ltd. | Mobile device capable of suitably displaying information through recognition of user's face and related method |
| CN101465116A (en) * | 2009-01-07 | 2009-06-24 | 北京中星微电子有限公司 | Display equipment and control method thereof |
| CN101989126A (en) * | 2009-08-07 | 2011-03-23 | 深圳富泰宏精密工业有限公司 | Handheld electronic device and automatic screen picture rotating method thereof |
| CN101840509A (en) * | 2010-04-30 | 2010-09-22 | 深圳华昌视数字移动电视有限公司 | Measuring method for eye-observation visual angle and device thereof |
| CN101950550A (en) * | 2010-09-28 | 2011-01-19 | 冠捷显示科技（厦门）有限公司 | Display device for displaying pictures at different angles based on visual angle of viewer |
| CN101984453A (en) * | 2010-11-02 | 2011-03-09 | 中国科学技术大学 | Human eye recognition system and method |
| CN102760024A (en) * | 2011-04-26 | 2012-10-31 | 鸿富锦精密工业（深圳）有限公司 | Screen picture rotating method and system |
| WO2013071826A1 (en) * | 2011-11-14 | 2013-05-23 | 华为技术有限公司 | Method and terminal for switching horizontal and vertical display modes of screen |
| CN102662476A (en) * | 2012-04-20 | 2012-09-12 | 天津大学 | Gaze estimation method |
| CN103024191A (en) * | 2012-12-21 | 2013-04-03 | 广东欧珀移动通信有限公司 | Screen rotating method, screen rotating device and mobile terminal |
Cited By (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105045395A (en) * | 2015-08-28 | 2015-11-11 | 京东方科技集团股份有限公司 | Display device and image display method |
| CN106598209A (en) * | 2015-10-20 | 2017-04-26 | 中兴通讯股份有限公司 | Terminal screen display control method, device and terminal |
| CN105760795A (en) * | 2016-01-28 | 2016-07-13 | 宇龙计算机通信科技(深圳)有限公司 | Method and terminal for displaying information |
| US10170074B2 (en) | 2016-03-23 | 2019-01-01 | Boe Technology Group Co., Ltd. | Display screen adjusting method, display screen adjusting apparatus, as well as display device |
| CN108614634A (en) * | 2016-12-09 | 2018-10-02 | 北京视联动力国际信息技术有限公司 | A kind of mobile device shows the method and mobile device of screen rotation |
| CN107155099A (en) * | 2017-06-06 | 2017-09-12 | 苏州佳世达电通有限公司 | Display device and its control method |
| CN108388849A (en) * | 2018-02-07 | 2018-08-10 | 广东欧珀移动通信有限公司 | The method and apparatus of the display image of adjustment terminal, electronic equipment, storage medium |
| CN109445735A (en) * | 2018-10-22 | 2019-03-08 | 奇酷互联网络科技（深圳）有限公司 | Control method, mobile terminal and the computer storage medium of display direction |
| CN109696201A (en) * | 2018-12-29 | 2019-04-30 | 维沃移动通信有限公司 | A kind of SOT state of termination determines method and terminal |
| CN111443772A (en) * | 2020-03-26 | 2020-07-24 | 合肥联宝信息技术有限公司 | Method for adjusting electronic equipment |
| CN111857910A (en) * | 2020-06-28 | 2020-10-30 | 维沃移动通信有限公司 | Information display method and device and electronic equipment |
| CN112445342A (en) * | 2020-11-26 | 2021-03-05 | 维沃移动通信有限公司 | Display screen control method and device and electronic equipment |
| CN113867535A (en) * | 2021-10-11 | 2021-12-31 | 展讯通信（深圳）有限公司 | Screen display method, screen display device, terminal equipment and storage medium |
| CN113867535B (en) * | 2021-10-11 | 2023-09-05 | 展讯通信（深圳）有限公司 | Picture display method, device, terminal equipment and storage medium |
| CN114071231A (en) * | 2021-10-25 | 2022-02-18 | 中国航空无线电电子研究所 | Eye position self-adaptive display system and implementation method thereof |
| WO2024027169A1 (en) * | 2022-08-03 | 2024-02-08 | 中兴通讯股份有限公司 | Adjustable human-computer interaction apparatus, control method, and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104679225B (en) | 2018-02-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104679225A (en) | Method and device for adjusting screen of mobile terminal and mobile terminal | |
| US10871258B2 (en) | Method and system for controlling gimbal | |
| CN107835935B (en) | Device, system and method for determining one or more optical parameters of an ophthalmic lens | |
| EP2802966B1 (en) | Device and method for controlling rotation of displayed image | |
| US9373156B2 (en) | Method for controlling rotation of screen picture of terminal, and terminal | |
| EP3805845A1 (en) | Smart glasses, eyeball trajectory tracking method and apparatus, and storage medium | |
| CN107847128B (en) | Device, system and method for determining pupil distance | |
| WO2023071884A1 (en) | Gaze detection method, control method for electronic device, and related devices | |
| CN105787884A (en) | Image processing method and electronic device | |
| KR102532486B1 (en) | Method and system for testing wearable devices | |
| CN107038722A (en) | Equipment positioning method and device | |
| CN103279260A (en) | Direction self-adaptation display system and adjusting method thereof | |
| CN111163303B (en) | Image display method, device, terminal and storage medium | |
| CN103517060A (en) | Method and device for display control of terminal device | |
| AU2019360254B2 (en) | Fixtureless lensmeter system | |
| CN105721739B (en) | Anti-shaking system and method for screen image | |
| CN103543835B (en) | The control method of a kind of LCD display view angle, device and system | |
| CN105787435A (en) | Indication method and apparatus for iris acquisition | |
| US20190318504A1 (en) | Determination program, determination method, and information processing apparatus | |
| US20180053490A1 (en) | Display device and method of displaying image on display device | |
| CN105635582A (en) | Photographing control method and photographing control terminal based on eye feature recognition | |
| EP3518521A1 (en) | Method for realizing effect of photo being taken by others through selfie, and photographing device | |
| US20240013439A1 (en) | Automated calibration method of a system comprising an external eye-tracking device and a computing device | |
| TW202020622A (en) | Vision vector detecting method and device | |
| US20230342976A1 (en) | Interpupillary distance estimation method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| EXSB | Decision made by sipo to initiate substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20180202 Termination date: 20181128 |