CN103064520A - Mobile terminal and method for controlling page to roll by same - Google Patents
Mobile terminal and method for controlling page to roll by same Download PDFInfo
- Publication number
- CN103064520A CN103064520A CN2013100391208A CN201310039120A CN103064520A CN 103064520 A CN103064520 A CN 103064520A CN 2013100391208 A CN2013100391208 A CN 2013100391208A CN 201310039120 A CN201310039120 A CN 201310039120A CN 103064520 A CN103064520 A CN 103064520A
- Authority
- CN
- China
- Prior art keywords
- user
- position coordinates
- face image
- canthus
- pupil
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Abstract
The invention relates to a mobile terminal and a method for controlling a page to roll by the same. The method for controlling the page to roll by the mobile terminal comprises the following steps of: S1, scanning a user face image frame by frame through a camera; S2, receiving the user face image which is scanned by the camera, and determining current position coordinates of pupils on the user face image and current position coordinates of eye corners of the user face image based on a pre-set standard coordinate system; and S3, when the current position coordinates of the pupils on the user face image and the current position coordinates of the eye corners of the user face image accord with respective pre-set rules, controlling a display screen of the mobile terminal to execute corresponding page rolling operations. By implementing the technical scheme disclosed by the invention, a user can accurately control the screen page of the mobile terminal to move by rolling eyeballs or moving head, and thus the user experience is improved.
Description
Technical field
The present invention relates to portable terminal display technique field, relate in particular to the method that a kind of portable terminal and the control page thereof roll.
Background technology
Along with the development of intelligent mobile terminal, the screen of portable terminal is increasing, and the user is difficult to the content of whole screen is had a panoramic view in its limited gathering within sweep of the eye usually, often needs mobile sight line the content of whole screen could to be run through.And it is also generally all larger to be presented at now the content capacity such as webpage on the portable terminal, e-book, document, short message, can't disposable all the elements such as web page contents be presented on the screen in most of situation, content need to make the content of pages scroll-up/down of screen, so that can show fully.
The method that existing control page scroll-up/down shows mainly is to drag at screen by finger, thereby makes the direction that screen display content drags along with finger and move.For example, when needs were checked or read the content that does not show below the screen, the screen that need to press...with one's finger upwards dragged the content that does not show with the display screen below; Maybe in the time need to checking or read the content that screen top do not show, the content that the screen drag down that need to press...with one's finger does not show with the display screen top.
Yet, when the user reads long document for a long time, need frequent manually slip screen so that page scroll-up/down, complex operation, and cause easily finger tired.
Summary of the invention
The technical problem to be solved in the present invention is, for the screen that can only manually slide of prior art so that the defective of page scroll-up/down, a kind of portable terminal and control page scrolling method thereof are provided, the screen page that can control exactly by rotating eyeball or moving-head portable terminal rolls, and has improved user's experience.
The technical solution adopted for the present invention to solve the technical problems is: the method that provides a kind of portable terminal control page to roll, it is characterized in that, and said method comprising the steps of:
S1, scan frame by frame the image of user face by camera;
S2, receive user's face image that described camera scans, and determine the current position coordinates at canthus on the current position coordinates of pupil on user's face image and the user's face image based on a default frame of reference;
S3, when the current position coordinates at canthus on the current position coordinates of pupil on user's face image and the user's face image all meets separately preset rules, the display screen of control portable terminal is carried out corresponding page rolling operation.
Preferably, described step S3 further comprises:
S3a, on user's face image the current ordinate value of pupil more than or equal to first a default ordinate reference value, and holding time more than or equal to a default time threshold of the current ordinate value of this pupil, when the current position coordinates at canthus was within a canthus position coordinates scope of presetting on user's face image simultaneously, the control page scrolled up;
S3b, the current ordinate value of pupil is less than or equal to second a default ordinate reference value on user's face image, and holding time more than or equal to above-mentioned time threshold of the current ordinate value of this pupil, when the current position coordinates at canthus was within above-mentioned canthus position coordinates scope on user's face image simultaneously, the control page rolled downwards.
Preferably, described method is further comprising the steps of:
S0a, before described step S1, behind the relative position of adjusting portable terminal and user, catch piece image by camera, and this image carried out coordinatograph process, to set up the described frame of reference;
S0b, described the first ordinate reference value, described the second ordinate reference value and described canthus position coordinates scope are set.
Preferably, in described step S2, the operation of the current position coordinates of pupil comprises on described definite user's face image:
S2a, in user's face image that described camera scans, catch the front profile of working as of eyes of user iris;
S2b, in the taking up an official post and select three discrete points when front profile of this iris, and determine these three somes position coordinates separately based on the default frame of reference;
S2c, determine the position coordinates when the central point of front profile of this iris according to these three somes position coordinates separately, with the current position coordinates as pupil on user's face image;
The operation of the current position coordinates at canthus comprises on described definite user's face image:
S2d, in user's face image that described camera scans, catch the front profile of working as of eyes of user;
S2e, determine the canthus position of this eyes of user in the front profile, and determine the current position coordinates at canthus on user's face image based on the described default frame of reference.
Preferably, described method is further comprising the steps of:
According to the enabled instruction of eyeball control page rolling function, start eyeball control page rolling function, to carry out described step S1 to S3.
The present invention also provides a kind of portable terminal, comprises camera, central processing unit and display screen, and wherein, described central processing unit comprises pupil position determination module, canthus position determination module and rolling control module, wherein:
Camera, be used for scanning frame by frame portable terminal towards the image of user face;
The pupil position determination module is used for receiving user's face image that described camera scans, and determines the current position coordinates of pupil on user's face image based on a default frame of reference;
The canthus position determination module is used for receiving user's face image that described camera scans, and determines the current position coordinates at canthus on user's face image based on a default frame of reference;
The rolling control module, when being used for current position coordinates when canthus on the current position coordinates of pupil on user's face image and the user's face image and all meeting separately preset rules, the corresponding page rolling operation of control display screen execution.
Preferably, described rolling control module is further used for:
The current ordinate value of pupil is more than or equal to first a default ordinate reference value on user's face image, and holding time more than or equal to a default time threshold of the current ordinate value of this pupil, when the current position coordinates at canthus was within a canthus position coordinates scope of presetting on user's face image simultaneously, the control page scrolled up;
The current ordinate value of pupil is less than or equal to second a default ordinate reference value on user's face image, and holding time more than or equal to above-mentioned time threshold of the current ordinate value of this pupil, when the current position coordinates at canthus was within above-mentioned canthus position coordinates scope on user's face image simultaneously, the control page rolled downwards.
Preferably, described central processing unit comprises that also calibration arranges module and coordinatograph processing module, and wherein, described calibration arranges module and is used for:
Call described coordinatograph processing module the piece image of catching by described camera is carried out the coordinatograph processing, to set up the described frame of reference;
Call described pupil position determination module described the first ordinate reference value and described the second ordinate reference value are set, and call described canthus position determination module described canthus position coordinates scope is set.
Preferably, described pupil position determination module is further used for:
In user's face image that described camera scans, catch the front profile of working as of eyes of user iris;
Select three discrete points in taking up an official post when front profile of this iris, and determine these three somes position coordinates separately based on the default frame of reference;
Determine the position coordinates when the central point of front profile of this iris according to these three somes position coordinates separately, with the current position coordinates as pupil on user's face image;
Described canthus position determination module is further used for:
In user's face image that described camera scans, catch the front profile of working as of eyes of user;
Determine the canthus position of this eyes of user in front profile, and determine the current position coordinates at canthus on user's face image based on the described default frame of reference.
Preferably, described central processing unit also comprises the startup module, described startup module is used for the enabled instruction according to eyeball control page rolling function, start eyeball control page rolling function, carry out corresponding operation to start described camera, described pupil position determination module, described canthus position determination module and described rolling control module.
Implement technical scheme of the present invention, have following technique effect: need not to point the screen page that drags portable terminal it is rolled, the screen page that only just can control exactly portable terminal by rotating eyeball or moving-head rolls, and is easy to use.And the present invention can preferably avoid the unconscious eye rotation of user or head to move and cause the page to miss the situation of rolling, and has improved user's experience.Simultaneously, the present invention does not need special sensor to follow the tracks of user's eye motion, realizes that cost is lower.
In addition, can calibrate setting to the judgment rule of scroll up/down whenever and wherever possible according to the situation of self for the user, to obtain better more accurately page rolling operation.
Description of drawings
The invention will be further described below in conjunction with drawings and Examples, in the accompanying drawing:
Fig. 1 is the functional module block scheme of portable terminal the first embodiment of the present invention;
Fig. 2 is the functional module block scheme of portable terminal the second embodiment of the present invention;
Fig. 3 is that portable terminal shown in Figure 1 is in order to determine the synoptic diagram of the current position coordinates of eye pupil on the user face present image;
Fig. 4 is the operational flowchart of rolling control module in the portable terminal shown in Figure 1;
Fig. 5 is the process flow diagram of method first embodiment of the portable terminal control page of the present invention rolling;
Fig. 6 is the process flow diagram of method second embodiment of the portable terminal control page of the present invention rolling.
Embodiment
In order to make purpose of the present invention, technical scheme and advantage clearer, below in conjunction with drawings and Examples, the present invention is further elaborated.Should be appreciated that specific embodiment described herein only in order to explain the present invention, is not intended to limit the present invention.
In technical scheme of the present invention, control screen page scroll-up/down according to the positional information of eyes of user, when the user when reading long document, scan the present image of user face by the front-facing camera of portable terminal, with the pupil that obtains eyes of user and the positional information at canthus, judge whether that according to the current location information at user's pupil and canthus needs are with screen page scroll-up/down.Thereby do not need user's screen that manually goes to slide to check, solved the user and when reading than lengthy document, need frequently stretch out one's hand slip screen or do not want during at cold weather and stretch out one's hand the problem of slip screen.For example, when the user browses the screen content of pages of portable terminal, if the current screen middle part that faces of user's eyes, so when the user wishes to read the content of screen top or bottom, can be by rotating up or down eyes, or come back a little or bow, control screen page scroll-up/down is so that the content of screen top or bottom enters within the user visual field.Especially, portable terminal described here can be mobile phone, panel computer, PDA etc.
Fig. 1 is the building-block of logic of portable terminal the first embodiment of the present invention.As shown in Figure 1, in the present embodiment, portable terminal comprises camera 100, central processing unit 200 and display screen 300.Central processing unit 200 comprises pupil position determination module 201, canthus position determination module 202 and rolling control module 203.Wherein, camera 100 be used for scanning frame by frame portable terminal towards the present image of user face; User's face image that pupil position determination module 201 scans, and determine the current position coordinates of pupil on user's face image based on a default frame of reference; Canthus position determination module 202 is used for receiving user's face image that camera 100 scans, and determines the current position coordinates at canthus on user's face image based on a default frame of reference; When rolling control module 203 is used for current position coordinates when canthus on the current position coordinates of pupil on user's face image and the user's face image and all meets separately preset rules, the corresponding page rolling operation of control display screen 300 execution.
In the present embodiment, camera 100 can be the front-facing camera that is built in the portable terminal, is positioned at the front of portable terminal.When starting eyeball control page rolling function, camera 100 starts, at running background, scan frame by frame the user's in portable terminal the place ahead present image, and the present image that it is caught is sent to central processing unit 200 to catch the current location information of eyes of user.Preferably, central processing unit 200 can comprise that also one starts the module (not shown), be used for the enabled instruction according to eyeball control page rolling function, start eyeball control page rolling function, carry out corresponding operation to start camera 100, pupil position determination module 201, canthus position determination module 202 and rolling control module 203.Especially, the startup of eyeball control page rolling function described here, can be that system is automatically actuated, also can be that the user initiatively starts, for example the user can be by a kind of strategy as starting by a functional switch (secondary or physical bond and/or virtual key) or closing eyeball and control page rolling function.
When user's reading content, the pupil of eyes faces the content of reading, therefore, can be considered as the position of eyes focusing in the position that pupil is current, thereby mate accordingly to control corresponding page rolling according to the difference of pupil position.In the present embodiment, receive user's face image that camera 100 scans by pupil position determination module 201, and determine the current position coordinates of pupil on user's face image based on the default frame of reference.Especially, the default frame of reference is processed rear foundation by piece image being carried out coordinatograph here, and the definite of follow-up position coordinates is benchmark with this reference coordinate.In addition, because the color of pupil is very close with the color of iris (being black part in the eyeball), the position that is difficult to capture eye pupil by front-facing camera, so can be by navigating to first the profile of iris portion, the iris portion of eyes and the white of the eye partly contrast comparatively strong, therefore confirm easily.And the iris portion of eyes can be thought a border circular areas, and pupil is positioned at the center of iris portion, thereby can determine according to certain algorithm the position of eye pupil.
Therefore, with reference to figure 3, pupil position determination module 201 determines that the operation of the current position coordinates of pupil on user's face image is implemented as follows:
1, in user's face image that camera 100 scans, catch the eyes of user iris when front profile 3, because the color contrast of iris and white of the eye part is strong, therefore, can utilize existing associated picture algorithm capture iris when front profile 3, do not repeat them here;
2, choose three discrete points wantonly in the front profile 3 of working as of this iris, suppose to be made as respectively A, B, C, and based on the default frame of reference, determine respectively the position coordinates of three points in the coordinate system that the default frame of reference is established, suppose that the position coordinates of A is (x1, y1), the position coordinates of B is (x2, y2), the position coordinates of C is (x3, y3);
3, make the perpendicular bisector of any two line segments that formed by any two points, such as the perpendicular bisector L1 of line segment AB between A and the B, the perpendicular bisector L2 of line segment BC between B and the C.The joining D(x4 of L1 and L2, y4) be the central point of the profile 3 of iris, just can determine central point D(x4, y4 according to the position coordinates of 3 of A, B, C) position coordinates, and with central point D(x4, y4) position coordinates as the current position coordinates of pupil on user's face image.
In the present embodiment, on determining user's face image the current position coordinates of pupil, also receive user's face image that camera 100 scans by canthus position determination module 202, and determine the current position coordinates at canthus on user's face image based on the default frame of reference.Consider when user face integral body moves downward or upward, pupil also can be relative to moving downward or upward, if user's this moment is unconscious in a big way integrated moving face, pupil also can move in a big way, can cause content that the user will read not within scope, impact is used, and this is that the user does not wish to occur.Whether the present invention selects scope that position judgment whole face in canthus moves within allowed band, thereby avoids the generation of above-mentioned situation, rolls to avoid the mobile terminal screen page that mistake occurs.Preferably, canthus position determination module 202 determines that the operation of the current position coordinates at canthus on user's face image is implemented as follows:
1, in user's face image that camera 100 scans, catches the front profile of working as of eyes of user, because the color contrast of eyes and facial skin part is strong, therefore, can utilize existing associated picture algorithm to capture the profile of eyes, do not repeat them here;
2, determine the canthus position of this eyes of user in front profile, and determine the current position coordinates at canthus on user's face image based on the default frame of reference.Because the canthus is fixed with respect to face location, it moves the movement that can represent face, and the canthus is positioned at the corner of eye contour, easily identification, can utilize equally the definite position to the canthus of existing associated picture algorithm, the canthus here can be inboard canthus, also can be canthus, the outside, can determine according to specific implementation.After determining the position, canthus, based on the default frame of reference, determine the position coordinates of this position, canthus in the default frame of reference.
In the present embodiment, determine respectively the current position coordinates at canthus on the current position coordinates of pupil on user's face image and the user's face image in pupil position determination module 201 and canthus position determination module 202 after, the current position coordinates with canthus on the current position coordinates of pupil on user's face image and the user's face image sends to rolling control module 203 respectively.The current position coordinates at canthus on the current position coordinates of pupil and the user's face image on the rolling control module 203 reception user face images, and respectively it is judged, when whether the current position coordinates at canthus on the current position coordinates of pupil on user's face image and the user's face image all met separately preset rules, the display screen 300 of control portable terminal was carried out corresponding page rolling operation.For example, when the current position coordinates at canthus on the current position coordinates of pupil on user's face image and the user's face image all meets scroll up regular, then control the demonstration 300 of portable terminal and carry out the operation that the pages scroll up; When the current position coordinates at canthus on the current position coordinates of pupil on user's face image and the user's face image all meets downward rolling regular, then control the demonstration 300 of portable terminal and carry out the operations that the pages roll downwards; If on user's face image on the current position coordinates of pupil and the user's face image current position coordinates at canthus all do not meet or one when not meeting preset rules, then control display screen 300 is not carried out page rolling operations.
Step 401: receive the current position coordinates of pupil on user's face image, continue execution in step 402;
Step 402: current position coordinates and the first default ordinate reference value of pupil on user's face image are compared, judge that whether the ordinate value of the current position coordinates of pupil on user's face image is more than or equal to the first ordinate reference value, and holding time more than or equal to a default time threshold of the current ordinate value of this pupil, if, then execution in step 403, if not, execution in step 406 then.Wherein, the first ordinate reference value here is the default ordinate reference value that scrolls up.In addition, holding time of the current ordinate value of pupil refers to that more than or equal to a default time threshold user's pupil has stopped a period of time during more than or equal to the first ordinate reference value at its ordinate value on user's face image here.For example, can be according to practical application, this time threshold is set to 300ms, 400ms, 500ms etc.
Step 403: receive the current position coordinates at canthus on user's face image, continue execution in step 404;
Step 404: whether the current position coordinates of judging canthus on user's face image within default canthus position coordinates scope, if then execution in step 405, if not, does not then carry out page rolling operation.Wherein, preferably, this canthus position coordinates scope can be the scope of its ordinate value, and for example ordinate value can be expressed as [Y1, Y2] between Y1 and Y2.Whether the ordinate value that therefore, can judge the current position coordinates at canthus on user's face image is more than or equal to Y1 and be less than or equal to Y2.
Step 405: the control screen page scrolls up;
Step 406: ordinate value and the second default ordinate reference value of the current position coordinates of pupil on user's face image are compared, whether the ordinate value of judging the current position coordinates of pupil on user's face image is less than or equal to the second ordinate reference value, and holding time more than or equal to above-mentioned time threshold of the current ordinate value of this pupil, if, then execution in step 407, if not, then do not carry out page rolling operation.Wherein, the second ordinate reference value here is the ordinate reference value of default downward rolling.In addition, the holding time of current ordinate value of pupil refers to that more than or equal to above-mentioned time threshold user's pupil has stopped a period of time on user's face image here when its ordinate value is less than or equal to the second ordinate reference value.
Step 407: receive the current position coordinates at canthus on user's face image, continue execution in step 408;
Step 408: whether the current position coordinates of judging canthus on user's face image within above-mentioned canthus position coordinates scope, if then execution in step 409, if not, does not then carry out page rolling operation.
Step 409: the control screen page rolls downwards.
In this operation, when the ordinate value of user's pupil satisfies reference value, need judge also whether it has stopped a period of time, mainly be in order to prevent in reading process the situation that unconscious pupil movement causes mistake to roll.Because in reading process, eyeball may unintentional motion, and may satisfy the condition of rolling in moment, but this kind situation time is very short.Roll in order to prevent mistake, can when satisfying the condition of ordinate reference value at pupil position, judge eyes whether resident time enough (the resident time can draw according to practice repeatedly, so that the impact that both can avoid unconscious eye movement to cause, can avoid again the user to feel overlong time and do not react not sensitive), difference is that initiatively mobile eyeball rolls, or the situation of unconscious mobile eyeball.In addition, if camera 100 can't obtain current required coordinate figure, according to not satisfying rule treatments, the screen page does not roll.
Fig. 2 is the building-block of logic of portable terminal the second embodiment of the present invention.As shown in Figure 2, in the present embodiment, portable terminal comprises camera 100, central processing unit 200 and display screen 300.Central processing unit 200 comprises that also calibration arranges module 204 and coordinatograph processing module 205 except comprising pupil position determination module 201, canthus position determination module 202 and rolling control module 203.Calibration arranges module 204 and carries out the coordinatograph processing for calling 205 pairs of piece images of catching by camera 100 of described coordinatograph processing module, to set up a frame of reference; Also be used for calling described pupil position determination module 201 the first ordinate reference value and the second ordinate reference value are set, and call the preset range that canthus position determination module 202 arranges the position, canthus.
In the present embodiment, the user can arrange function as start calibration by a functional switch (secondary or physical bond and/or virtual key) by a kind of strategy.In the practical operation, at first, determine the frame of reference.Particularly, the user adjusts the relative position of itself and mobile phone, start calibration function is set, camera 100 is caught a width of cloth present image as benchmark image, calibration arranges module 204 and calls 205 pairs of these width of cloth benchmark images of catching by camera 100 of coordinatograph processing module and carry out coordinatograph and process, to set up a frame of reference.The coordinatograph is here processed and is referred to, as by obtaining the resolution of image, set up a plane coordinate system, the upper left corner of image is as true origin, to the positive dirction of right as horizontal ordinate, downward direction is as the positive dirction of ordinate, take the current pixel of image of catching as unit, to cutting apart along horizontal ordinate positive dirction and ordinate positive dirction of image, for example, if image resolution ratio is 1024 * 768, then image is carried out 1024 five equilibriums at horizontal ordinate, ordinate carries out 768 five equilibriums, has so just set up horizontal ordinate 1024 five equilibriums, the frame of reference of ordinate 768 five equilibriums.The definite of follow-up position coordinates is benchmark with this reference coordinate.Secondly, the first ordinate reference value and the second ordinate reference value are set.Particularly, eyes of user is seen to the screen bottom, rotate or bow a little such as eyeball, catch user's face image of this moment by camera 100, and call pupil position determination module 201 and determine the position coordinates of user's pupil in the frame of reference and preservation, and its ordinate value is set to the first ordinate reference value, i.e. the page screen ordinate reference value of rolling facing up; Simultaneously, calling canthus position determination module 202 determines the position coordinates of user canthus in the frame of reference (such as (x2 ', y2 ')) and preserves.In like manner, eyes of user is seen to screen top, for example eyeball upwards rotates or comes back a little, catch user's face image of this moment by camera 100, and call pupil position determination module 201 and determine the position coordinates of user's pupil in the frame of reference and preservation, and its ordinate value is set to the second ordinate reference value, i.e. the page screen ordinate reference value that faces down and roll; Simultaneously, calling canthus position determination module 202 determines the position coordinates of user canthus in the frame of reference (such as (x1 ', y1 ')) and preserves.At last, canthus position coordinates scope is set.When the user saw to screen top, the ordinate value at canthus was y1 ', and when the user saw to the screen bottom, the ordinate value at canthus was y2 '.Preferably, the preset range of position, canthus be set to [y1 '-i, y2 '+i] and preserve, wherein, the i here is nonnegative integer, can get according to specific implementation the value of i.If establish Y1=y1 '-i, Y2=y2 '+i, then position coordinates scope in canthus can be expressed as [Y1, Y2], and namely ordinate value is between Y1 and Y2.Therefore, can judge that the ordinate value of current position coordinates at user canthus is whether more than or equal to Y1 and be less than or equal to Y2.Main like this is to avoid following situation: if the user is when arranging reference value, only be that eyeball rolls and face is not moving, the ordinate value at the canthus of twice acquisition may be the same or indifference almost so.If the user when reading, adopts the mode that comes back a little or bow to change the position of pupil, the position at canthus probably exceeded preset range and can not carry out the rolling of the screen page this moment, and this is not that the user is desirable.Therefore can avoid this situation by the scope of choosing suitable i value expansion effective coverage, canthus, nor can cause in a big way erroneous judgement during integrated moving in user face.
In the present embodiment, all the other situations are identical with the logical organization of portable terminal the first embodiment of the present invention, do not repeat them here.
In portable terminal the first and second embodiment of the present invention, portable terminal also can comprise the storer (not shown) that is connected with central processing unit 200.Storer is used for the required programmed algorithm of storage computing and the first ordinate reference value, the second ordinate reference value and the canthus position coordinates scope of above-mentioned setting.
Fig. 5 is the process flow diagram of method first embodiment of control page rolling of the present invention.As shown in Figure 5, in the present embodiment, may further comprise the steps:
S1, scan frame by frame the image of user face by camera;
S2, receive user's face image that described camera scans, and determine the current position coordinates at canthus on the current position coordinates of pupil on user's face image and the user's face image based on a default frame of reference;
S3, when the current position coordinates at canthus on the current position coordinates of pupil on user's face image and the user's face image all meets separately preset rules, the display screen of control portable terminal is carried out corresponding page rolling operation.
In the step S1 of present embodiment, camera can be the front-facing camera that is built in the portable terminal, is positioned at the front of portable terminal.When starting eyeball control page rolling function, camera starts, at running background, scan frame by frame the user's in portable terminal the place ahead present image, and the present image that it is caught is sent to the central processing unit of portable terminal with the current location information of seizure eyes of user.Preferably, before step S1, according to the enabled instruction of eyeball control page rolling function, start eyeball control page rolling function, with execution in step S1 to S3.Especially, the startup of eyeball control page rolling function described here, can be that system is automatically actuated, also can be that the user initiatively starts, for example the user can be by a kind of strategy as starting by a functional switch (secondary or physical bond and/or virtual key) or closing eyeball and control page rolling function.
When user's reading content, the pupil of eyes faces the content of reading, therefore, the position of eye focus can be changed into the current position of pupil, rolls thereby mate accordingly to control the corresponding page according to the difference of pupil position.In the step S2 of present embodiment, for example, receive user's face image that camera 100 scans by above-mentioned pupil position determination module 201, and determine the current position coordinates of pupil on user's face image based on the default frame of reference.Especially, the default frame of reference is processed rear foundation by piece image being carried out coordinatograph here, and the definite of follow-up position coordinates is benchmark with this reference coordinate.In addition, because the color of pupil is very close with the color of iris (being black part in the eyeball), the position that is difficult to capture eye pupil by front-facing camera, so can be by navigating to first the profile of iris portion, the iris portion of eyes and the white of the eye partly contrast comparatively strong, therefore confirm easily.And the iris portion of eyes can be thought a border circular areas, and pupil is positioned at the center of iris portion, thereby can determine according to certain algorithm the position of eye pupil.
Therefore, with reference to figure 3, preferably, determine that the operation of the current position coordinates of pupil on user's face image may further comprise the steps:
S2a, in user's face image that camera scans, catch the eyes of user iris when front profile 3, because the color contrast of iris and white of the eye part is strong, therefore, can utilize existing associated picture algorithm capture iris when front profile 3, do not repeat them here;
S2b, at optional three the non-conterminous points of the profile 3 of this iris, suppose to be made as respectively A, B, C, and based on the default frame of reference, determine respectively the position coordinates of three points in the coordinate system that the default frame of reference is established, suppose that the position coordinates of A is (x1, y1), the position coordinates of B is (x2, y2), the position coordinates of C is (x3, y3);
S2c, make the perpendicular bisector of any two line segments that formed by any two points, such as the perpendicular bisector L1 of line segment AB between A and the B, the perpendicular bisector L2 of line segment BC between B and the C.The joining D(x4 of L1 and L2, y4) be the central point of the profile 3 of iris, just can determine central point D(x4, y4 according to the position coordinates of 3 of A, B, C) position coordinates, and with central point D(x4, y4) position coordinates as the current position coordinates of pupil on user's face image.
In addition, consider when user face integral body moves downward or upward, pupil also can be relative to moving downward or upward, if user's this moment is unconscious in a big way integrated moving face, pupil also can move in a big way, can cause content that the user will read not within scope, impact is used, and this is that the user does not wish to occur.Whether the present invention selects scope that position judgment whole face in canthus moves within allowed band, thereby avoids the generation of above-mentioned situation, rolls to avoid the mobile terminal screen page that mistake occurs.For example, receive user's face image that camera 100 scans by above-mentioned canthus position determination module 202, and determine the current position coordinates at canthus on user's face image based on the default frame of reference.Preferably, the operation of determining the current position coordinates at canthus on user's face image may further comprise the steps:
S2d, in user's face image that camera scans, catch the front profile of work as of eyes of user, because eyes and facial skin color contrast partly is strong, therefore, can utilize existing associated picture algorithm to capture the profile of eyes, do not repeat them here;
S2e, determine the canthus position of this eyes of user in the front profile, and determine the current position coordinates at canthus on user's face image based on the default frame of reference.Because the canthus is fixed with respect to face location, it moves the movement that can represent face, and the canthus is positioned at the corner of eye contour, easily identification, can utilize equally the definite position to the canthus of existing associated picture algorithm, the canthus here can be inboard canthus, also can be canthus, the outside, can determine according to specific implementation.After determining the position, canthus, based on the default frame of reference, determine the position coordinates of this position, canthus in the default frame of reference.
In the present embodiment, behind the current position coordinates at canthus on the current position coordinates of determining pupil on user's face image and the user's face image, enter step S3.In step S3, the current position coordinates at canthus on the current position coordinates of pupil and the user's face image on the rolling control module 203 reception user face images, and respectively the current position coordinates at canthus on the current position coordinates of pupil on user's face image and the user's face image is judged, when whether the current position coordinates at canthus on the current position coordinates of pupil on user's face image and the user's face image all met separately preset rules, the display screen of control portable terminal was carried out corresponding page rolling operation.For example, when the current position coordinates at canthus on the current position coordinates of pupil on user's face image and the user's face image all meets scroll up regular, then control the demonstration of portable terminal and carry out the operation that the page scrolls up; When the current position coordinates at canthus on the current position coordinates of pupil on user's face image and the user's face image all meets downward rolling regular, then control the demonstration of portable terminal and carry out the operation that the page rolls downwards; If on user's face image on the current position coordinates of pupil and the user's face image current position coordinates at canthus all do not meet or one when not meeting preset rules, then the control display screen is not carried out page rolling operation.
Preferably, as shown in Figure 4, step S3 specifically may further comprise the steps:
Step 401: receive the current position coordinates of pupil on user's face image, continue execution in step 402;
Step 402: current position coordinates and the first default ordinate reference value of pupil on user's face image are compared, judge that whether the ordinate value of the current position coordinates of pupil on user's face image is more than or equal to the first ordinate reference value, and holding time more than or equal to a default time threshold of the current ordinate value of this pupil, if, then execution in step 403, if not, execution in step 406 then.Wherein, the first ordinate reference value here is the default ordinate reference value that scrolls up.In addition, holding time of the current ordinate value of pupil refers to that more than or equal to a default time threshold user's pupil has stopped a period of time during more than or equal to the first ordinate reference value at its ordinate value on user's face image.For example, can be according to practical application, this time threshold is set to 300ms, 400ms, 500ms etc.
Step 403: receive the current position coordinates at canthus on user's face image, continue execution in step 404;
Step 404: whether the current position coordinates of judging canthus on user's face image within default canthus position coordinates scope, if then execution in step 405, if not, does not then carry out page rolling operation.Wherein, preferably, this canthus position coordinates scope can be the scope of its ordinate value, and for example ordinate value can be expressed as [Y1, Y2] between Y1 and Y2.Whether the ordinate value that therefore, can judge the current position coordinates at canthus on user's face image is more than or equal to Y1 and be less than or equal to Y2.
Step 405: the control screen page scrolls up;
Step 406: ordinate value and the second default ordinate reference value of the current position coordinates of pupil on user's face image are compared, whether the ordinate value of judging the current position coordinates of pupil on user's face image is less than or equal to the second ordinate reference value, and holding time more than or equal to above-mentioned time threshold of the current ordinate value of this pupil, if, then execution in step 407, if not, then do not carry out page rolling operation.Wherein, the second ordinate reference value here is the ordinate reference value of default downward rolling.In addition, the holding time of current ordinate value of pupil refers to that more than or equal to above-mentioned time threshold user's pupil has stopped a period of time on user's face image here when its ordinate value is less than or equal to the second ordinate reference value.
Step 407: receive the current position coordinates at canthus on user's face image, continue execution in step 408;
Step 408: whether the current position coordinates of judging canthus on user's face image within above-mentioned canthus position coordinates scope, if then execution in step 409, if not, does not then carry out page rolling operation.
Step 409: the control screen page rolls downwards.
In this operation, when the ordinate value of user's pupil satisfies reference value, need judge also whether it has stopped a period of time, mainly be in order to prevent in reading process the situation that unconscious pupil movement causes mistake to roll.Because in reading process, eyeball may unintentional motion, and may satisfy the condition of rolling in moment, but this kind situation time is very short.Roll in order to prevent mistake, can when satisfying the condition of ordinate reference value at pupil position, judge eyes whether resident time enough (the resident time can draw according to practice repeatedly, so that the impact that both can avoid unconscious eye movement to cause, can avoid again the user to feel overlong time and do not react not sensitive), difference is that initiatively mobile eyeball rolls, or the situation of unconscious mobile eyeball.In addition, if camera 100 can't obtain current required coordinate figure, according to not satisfying rule treatments, the screen page does not roll.
Fig. 6 is the process flow diagram of method second embodiment of the portable terminal control page of the present invention rolling.As shown in Figure 6, in the present embodiment, except step S1 to S3, further comprising the steps of:
S0a, before step S1, behind the relative position of adjusting portable terminal and user, catch piece image by camera, and this image carried out coordinatograph process, to set up the frame of reference;
S0b, the first ordinate reference value, the second ordinate reference value and canthus position coordinates scope are set.
In the present embodiment, the user can arrange function as start calibration by a functional switch (secondary or physical bond and/or virtual key) by a kind of strategy.In step S0a, determine to set up the frame of reference.Particularly, the user adjusts the relative position of itself and mobile phone, starts calibration function is set, and camera is caught a width of cloth present image as benchmark image, and this width of cloth benchmark image of catching by camera is carried out coordinatograph process, to set up a frame of reference.The coordinatograph is here processed and is referred to, as by obtaining the resolution of image, set up a plane coordinate system, the upper left corner of image is as true origin, to the positive dirction of right as horizontal ordinate, downward direction is as the positive dirction of ordinate, take the current pixel of image of catching as unit, to cutting apart along horizontal ordinate positive dirction and ordinate positive dirction of image, for example, if image resolution ratio is 1024 * 768, then image is carried out 1024 five equilibriums at horizontal ordinate, ordinate carries out 768 five equilibriums, has so just set up horizontal ordinate 1024 five equilibriums, the frame of reference of ordinate 768 five equilibriums.The definite of follow-up position coordinates is benchmark with this reference coordinate.In step S0b, the preset range of the first ordinate reference value, the second ordinate reference value and position, canthus is set.Particularly, eyes of user is seen to the screen bottom, rotate or bow a little such as eyeball, catch user's face image of this moment by camera, and the definite position coordinates of current pupil in the frame of reference and preservation, and its ordinate value is set to the first ordinate reference value, i.e. the page screen ordinate reference value of rolling facing up; Simultaneously, determine the position coordinates of current canthus in the frame of reference (such as (x2 ', y2 ')) and preserving.In like manner, eyes of user is seen to screen top, for example eyeball upwards rotates or comes back a little, catch user's face image of this moment by camera, and the position coordinates of definite user's pupil in the frame of reference and preservation, and its ordinate value is set to the second ordinate reference value, i.e. the page screen ordinate reference value that faces down and roll; Simultaneously, determine the position coordinates of user canthus in the frame of reference (such as (x1 ', y1 ')) and preserving.And for the setting of canthus position coordinates scope, when the user saw to screen top, the ordinate value at canthus was y1 ', and when the user saw to the screen bottom, the ordinate value at canthus was y2 '.Preferably, canthus position coordinates scope be set to [y1 '-i, y2 '+i] and preserve, wherein, the i here is nonnegative integer, can get according to specific implementation the value of i.If establish Y1=y1 '-i, Y2=y2 '+i, then this canthus position coordinates scope can be expressed as [Y1, Y2], and namely ordinate value is between Y1 and Y2.Therefore, can judge that the ordinate value of current position coordinates at user canthus is whether more than or equal to Y1 and be less than or equal to Y2.Main like this is to avoid following situation: if the user is when arranging reference value, only be that eyeball rolls and face is not moving, the ordinate value at the canthus of twice acquisition may be the same or indifference almost so.If the user when reading, adopts the mode that comes back a little or bow to change the position of pupil, the position at canthus probably exceeded preset range and can not carry out the rolling of the screen page this moment, and this is not that the user is desirable.Therefore can avoid this situation by the scope of choosing suitable i value expansion effective coverage, canthus, nor can cause in a big way erroneous judgement during integrated moving in user face.
In the present embodiment, all the other situations are identical with method the first embodiment that the control page of the present invention rolls, and do not repeat them here.
Although the present invention describes by specific embodiment, it will be appreciated by those skilled in the art that, without departing from the present invention, can also carry out various conversion and be equal to alternative the present invention.In addition, for particular condition or material, can make various modifications to the present invention, and not depart from the scope of the present invention.Therefore, the present invention is not limited to disclosed specific embodiment, and should comprise the whole embodiments that fall in the claim scope of the present invention.
Claims (10)
1. the method that the portable terminal control page rolls is characterized in that, said method comprising the steps of:
S1, scan frame by frame the image of user face by camera;
S2, receive user's face image that described camera scans, and determine the current position coordinates at canthus on the current position coordinates of pupil on user's face image and the user's face image based on a default frame of reference;
S3, when the current position coordinates at canthus on the current position coordinates of pupil on user's face image and the user's face image all meets separately preset rules, the display screen of control portable terminal is carried out corresponding page rolling operation.
2. portable terminal according to claim 1 is controlled the method that the page rolls, and it is characterized in that described step S3 further comprises:
S3a, on user's face image the current ordinate value of pupil more than or equal to first a default ordinate reference value, and holding time more than or equal to a default time threshold of the current ordinate value of this pupil, when the current position coordinates at canthus was within a canthus position coordinates scope of presetting on user's face image simultaneously, the control page scrolled up;
S3b, the current ordinate value of pupil is less than or equal to second a default ordinate reference value on user's face image, and holding time more than or equal to above-mentioned time threshold of the current ordinate value of this pupil, when the current position coordinates at canthus was within above-mentioned canthus position coordinates scope on user's face image simultaneously, the control page rolled downwards.
3. portable terminal according to claim 2 is controlled the method that the page rolls, and it is characterized in that described method is further comprising the steps of:
S0a, before described step S1, behind the relative position of adjusting portable terminal and user, catch piece image by camera, and this image carried out coordinatograph process, to set up the described frame of reference;
S0b, described the first ordinate reference value, described the second ordinate reference value and described canthus position coordinates scope are set.
4. portable terminal according to claim 1 is controlled the method that the page rolls, and it is characterized in that in described step S2, the operation of the current position coordinates of pupil comprises on described definite user's face image:
S2a, in user's face image that described camera scans, catch the front profile of working as of eyes of user iris;
S2b, in the taking up an official post and select three discrete points when front profile of this iris, and determine these three somes position coordinates separately based on the default frame of reference;
S2c, determine the position coordinates when the central point of front profile of this iris according to these three somes position coordinates separately, with the current position coordinates as pupil on user's face image;
The operation of the current position coordinates at canthus comprises on described definite user's face image:
S2d, in user's face image that described camera scans, catch the front profile of working as of eyes of user;
S2e, determine the canthus position of this eyes of user in the front profile, and determine the current position coordinates at canthus on user's face image based on the described default frame of reference.
5. portable terminal according to claim 1 is controlled the method that the page rolls, and it is characterized in that described method is further comprising the steps of:
According to the enabled instruction of eyeball control page rolling function, start eyeball control page rolling function, to carry out described step S1 to S3.
6. portable terminal, comprise camera (100), central processing unit (200) and display screen (300), it is characterized in that described central processing unit (200) comprises pupil position determination module (201), canthus position determination module (202) and rolling control module (203), wherein:
Camera (100), be used for scanning frame by frame portable terminal towards the image of user face;
Pupil position determination module (201) is used for receiving user's face image that described camera (100) scans, and determines the current position coordinates of pupil on user's face image based on a default frame of reference;
Canthus position determination module (202) is used for receiving user's face image that described camera (100) scans, and determines the current position coordinates at canthus on user's face image based on a default frame of reference;
Rolling control module (203), when being used for current position coordinates when canthus on the current position coordinates of pupil on user's face image and the user's face image and all meeting separately preset rules, the corresponding page rolling operation of control display screen (300) execution.
7. portable terminal according to claim 6 is characterized in that, described rolling control module (203) is further used for:
The current ordinate value of pupil is more than or equal to first a default ordinate reference value on user's face image, and holding time more than or equal to a default time threshold of the current ordinate value of this pupil, when the current position coordinates at canthus was within a canthus position coordinates scope of presetting on user's face image simultaneously, the control page scrolled up;
The current ordinate value of pupil is less than or equal to second a default ordinate reference value on user's face image, and holding time more than or equal to above-mentioned time threshold of the current ordinate value of this pupil, when the current position coordinates at canthus was within above-mentioned canthus position coordinates scope on user's face image simultaneously, the control page rolled downwards.
8. portable terminal according to claim 7 is characterized in that, described central processing unit (200) comprises that also calibration arranges module (204) and coordinatograph processing module (205), and wherein, described calibration arranges module (204) and is used for:
Call described coordinatograph processing module (205) piece image of catching by described camera (100) is carried out the coordinatograph processing, to set up the described frame of reference;
Call described pupil position determination module (201) described the first ordinate reference value and described the second ordinate reference value are set, and call described canthus position determination module (202) described canthus position coordinates scope is set.
9. portable terminal according to claim 6 is characterized in that, described pupil position determination module (201) is further used for:
In user's face image that described camera (100) scans, catch the front profile of working as of eyes of user iris;
Select three discrete points in taking up an official post when front profile of this iris, and determine these three somes position coordinates separately based on the default frame of reference;
Determine the position coordinates when the central point of front profile of this iris according to these three somes position coordinates separately, with the current position coordinates as pupil on user's face image;
Described canthus position determination module (202) is further used for:
In user's face image that described camera (100) scans, catch the front profile of working as of eyes of user;
Determine the canthus position of this eyes of user in front profile, and determine the current position coordinates at canthus on user's face image based on the described default frame of reference.
10. portable terminal according to claim 6, it is characterized in that, described central processing unit (200) also comprises the startup module, described startup module is used for the enabled instruction according to eyeball control page rolling function, start eyeball control page rolling function, carry out accordingly operation to start described camera (100), described pupil position determination module (201), described canthus position determination module (202) and described rolling control module (203).
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310039120.8A CN103064520B (en) | 2013-01-31 | 2013-01-31 | The method of mobile terminal and control page scroll thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310039120.8A CN103064520B (en) | 2013-01-31 | 2013-01-31 | The method of mobile terminal and control page scroll thereof |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103064520A true CN103064520A (en) | 2013-04-24 |
| CN103064520B CN103064520B (en) | 2016-03-09 |
Family
ID=48107171
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310039120.8A Active CN103064520B (en) | 2013-01-31 | 2013-01-31 | The method of mobile terminal and control page scroll thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103064520B (en) |
Cited By (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103268152A (en) * | 2013-05-30 | 2013-08-28 | 苏州福丰科技有限公司 | Reading method |
| CN104346056A (en) * | 2013-08-01 | 2015-02-11 | 腾讯科技（深圳）有限公司 | Selection implementing method and device for intelligent terminals |
| CN104765441A (en) * | 2014-01-07 | 2015-07-08 | 腾讯科技（深圳）有限公司 | Method and device for realizing page updating based on eye movement |
| CN104765442A (en) * | 2014-01-08 | 2015-07-08 | 腾讯科技（深圳）有限公司 | Automatic browsing method and device |
| CN104869237A (en) * | 2015-04-30 | 2015-08-26 | 闻泰通讯股份有限公司 | Method for controlling mobile phone through recognition of pupil and method for acquiring user preferences |
| CN105046283A (en) * | 2015-08-31 | 2015-11-11 | 宇龙计算机通信科技(深圳)有限公司 | Terminal operation method and terminal operation device |
| CN105320264A (en) * | 2015-05-25 | 2016-02-10 | 维沃移动通信有限公司 | Mobile terminal display method and mobile terminal |
| CN105487782A (en) * | 2015-11-27 | 2016-04-13 | 惠州Tcl移动通信有限公司 | Method and system for automatically adjusting scroll speed based on eye identification |
| CN106293086A (en) * | 2016-08-08 | 2017-01-04 | 广东小天才科技有限公司 | The display control method of information and device |
| CN103412643B (en) * | 2013-07-22 | 2017-07-25 | 深圳Tcl新技术有限公司 | Terminal and its method for remote control |
| CN107358078A (en) * | 2017-06-13 | 2017-11-17 | 广东欧珀移动通信有限公司 | Input method and device, the terminal and computer-readable recording medium of terminal |
| CN108524121A (en) * | 2018-04-04 | 2018-09-14 | 西安电子科技大学 | The intelligent wheel chair of screen is controlled based on eyeball |
| CN110787006A (en) * | 2019-10-22 | 2020-02-14 | 南京航空航天大学 | Novel electric sickbed based on eyeball driving and adjusting |
| CN112416126A (en) * | 2020-11-18 | 2021-02-26 | 青岛海尔科技有限公司 | Page rolling control method and device, storage medium and electronic equipment |
| CN112732080A (en) * | 2020-12-30 | 2021-04-30 | 宇龙计算机通信科技(深圳)有限公司 | Operation instruction generation method and device, storage medium and electronic equipment |
| US11537696B2 (en) | 2018-04-12 | 2022-12-27 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Method and apparatus for turning on screen, mobile terminal and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6603491B2 (en) * | 2000-05-26 | 2003-08-05 | Jerome H. Lemelson | System and methods for controlling automatic scrolling of information on a display or screen |
| CN102081503A (en) * | 2011-01-25 | 2011-06-01 | 汉王科技股份有限公司 | Electronic reader capable of automatically turning pages based on eye tracking and method thereof |
| CN102087582A (en) * | 2011-01-27 | 2011-06-08 | 广东威创视讯科技股份有限公司 | Automatic scrolling method and device |
| CN102662476A (en) * | 2012-04-20 | 2012-09-12 | 天津大学 | Gaze estimation method |
-
2013
- 2013-01-31 CN CN201310039120.8A patent/CN103064520B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6603491B2 (en) * | 2000-05-26 | 2003-08-05 | Jerome H. Lemelson | System and methods for controlling automatic scrolling of information on a display or screen |
| CN102081503A (en) * | 2011-01-25 | 2011-06-01 | 汉王科技股份有限公司 | Electronic reader capable of automatically turning pages based on eye tracking and method thereof |
| CN102087582A (en) * | 2011-01-27 | 2011-06-08 | 广东威创视讯科技股份有限公司 | Automatic scrolling method and device |
| CN102662476A (en) * | 2012-04-20 | 2012-09-12 | 天津大学 | Gaze estimation method |
Cited By (21)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103268152A (en) * | 2013-05-30 | 2013-08-28 | 苏州福丰科技有限公司 | Reading method |
| CN103412643B (en) * | 2013-07-22 | 2017-07-25 | 深圳Tcl新技术有限公司 | Terminal and its method for remote control |
| CN104346056A (en) * | 2013-08-01 | 2015-02-11 | 腾讯科技（深圳）有限公司 | Selection implementing method and device for intelligent terminals |
| CN104765441A (en) * | 2014-01-07 | 2015-07-08 | 腾讯科技（深圳）有限公司 | Method and device for realizing page updating based on eye movement |
| CN104765441B (en) * | 2014-01-07 | 2019-03-15 | 腾讯科技（深圳）有限公司 | A kind of method and apparatus that renewal of the page is realized based on eye movement |
| CN104765442B (en) * | 2014-01-08 | 2018-04-20 | 腾讯科技（深圳）有限公司 | Auto-browsing method and auto-browsing device |
| CN104765442A (en) * | 2014-01-08 | 2015-07-08 | 腾讯科技（深圳）有限公司 | Automatic browsing method and device |
| CN104869237A (en) * | 2015-04-30 | 2015-08-26 | 闻泰通讯股份有限公司 | Method for controlling mobile phone through recognition of pupil and method for acquiring user preferences |
| CN105320264A (en) * | 2015-05-25 | 2016-02-10 | 维沃移动通信有限公司 | Mobile terminal display method and mobile terminal |
| CN105320264B (en) * | 2015-05-25 | 2019-10-15 | 维沃移动通信有限公司 | A kind of display methods and mobile terminal of mobile terminal |
| CN105046283A (en) * | 2015-08-31 | 2015-11-11 | 宇龙计算机通信科技(深圳)有限公司 | Terminal operation method and terminal operation device |
| CN105487782B (en) * | 2015-11-27 | 2019-07-09 | 惠州Tcl移动通信有限公司 | A kind of method and system of the adjust automatically roll screen speed based on eye recognition |
| CN105487782A (en) * | 2015-11-27 | 2016-04-13 | 惠州Tcl移动通信有限公司 | Method and system for automatically adjusting scroll speed based on eye identification |
| CN106293086B (en) * | 2016-08-08 | 2019-01-29 | 广东小天才科技有限公司 | The display control method and device of information |
| CN106293086A (en) * | 2016-08-08 | 2017-01-04 | 广东小天才科技有限公司 | The display control method of information and device |
| CN107358078A (en) * | 2017-06-13 | 2017-11-17 | 广东欧珀移动通信有限公司 | Input method and device, the terminal and computer-readable recording medium of terminal |
| CN108524121A (en) * | 2018-04-04 | 2018-09-14 | 西安电子科技大学 | The intelligent wheel chair of screen is controlled based on eyeball |
| US11537696B2 (en) | 2018-04-12 | 2022-12-27 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Method and apparatus for turning on screen, mobile terminal and storage medium |
| CN110787006A (en) * | 2019-10-22 | 2020-02-14 | 南京航空航天大学 | Novel electric sickbed based on eyeball driving and adjusting |
| CN112416126A (en) * | 2020-11-18 | 2021-02-26 | 青岛海尔科技有限公司 | Page rolling control method and device, storage medium and electronic equipment |
| CN112732080A (en) * | 2020-12-30 | 2021-04-30 | 宇龙计算机通信科技(深圳)有限公司 | Operation instruction generation method and device, storage medium and electronic equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103064520B (en) | 2016-03-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103064520B (en) | The method of mobile terminal and control page scroll thereof | |
| EP2664131B1 (en) | Apparatus and method for compositing image in a portable terminal | |
| US10506170B2 (en) | Electronic device having pivotably connected sides with selectable displays | |
| KR102121592B1 (en) | Method and apparatus for protecting eyesight | |
| KR100556856B1 (en) | Screen control method and apparatus in mobile telecommunication terminal equipment | |
| US20180181272A1 (en) | Automatic scrolling based on gaze detection | |
| US8319804B2 (en) | Electronic devices with automatic brightness adjustment and the method thereof | |
| KR101663452B1 (en) | Screen Operation Apparatus and Screen Operation Method | |
| CN109257484B (en) | Display screen brightness processing method, terminal device and readable storage medium | |
| EP2634727B1 (en) | Method and portable terminal for correcting gaze direction of user in image | |
| US8379059B2 (en) | Portable electronic device and method for adjusting display orientation of the portable electronic device | |
| CN102402368B (en) | Display control method and device | |
| EP2753070A1 (en) | Apparatus and method for processing image in a device having camera | |
| US20110069215A1 (en) | Apparatus and method for controlling picture using image recognition | |
| WO2014054249A1 (en) | Information processing apparatus, information processing method, and program | |
| WO2020082275A1 (en) | Method and device for processing drawn content on terminal apparatus, and terminal apparatus | |
| US10635892B2 (en) | Display control method and apparatus | |
| CN102193287A (en) | Projection method and system | |
| WO2015130417A1 (en) | Electronic device having multiple sides | |
| US10921923B2 (en) | Information processing apparatus and non-transitory recording medium storing program for controlling information processing apparatus | |
| CN103376893A (en) | Display picture presenting method and terminal | |
| US10824237B2 (en) | Screen display control method and screen display control system | |
| JP3796019B2 (en) | Gaze detection device | |
| US20240129621A1 (en) | Video recording method and electronic device | |
| JP5952766B2 (en) | Imaging apparatus and imaging method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |