CN106265006A

CN106265006A - The antidote of a kind of dominant eye and mobile terminal

Info

Publication number: CN106265006A
Application number: CN201610624931.8A
Authority: CN
Inventors: 谢莲花
Original assignee: Vivo Mobile Communication Co Ltd
Current assignee: Vivo Mobile Communication Co Ltd
Priority date: 2016-07-29
Filing date: 2016-07-29
Publication date: 2017-01-04
Anticipated expiration: 2036-07-29
Also published as: CN106265006B

Abstract

The invention provides antidote and the mobile terminal of a kind of dominant eye, wherein, described method includes: obtain the facial image of the mobile phone users of described camera collection；Extract the eyes area image in described facial image；Based on described eyes area image, determine that the dominant eye of described mobile phone users and pair regard eye；Based on described dominant eye and the secondary eye that regards, the display mode of adjustment mobile terminal screen displayed content.Such that it is able to solve to need user actively to judge, major-minor regards the problem that eye is not accurate enough；Avoid owing to correcting the problem that user's major-minor affects user's macroscopic features depending on eye.

Description

The antidote of a kind of dominant eye and mobile terminal

Technical field

The present invention relates to technical field of mobile terminals, particularly relate to antidote and the mobile terminal of a kind of dominant eye.

Background technology

Along with developing rapidly of terminal unit technology, user can use terminal unit to carry out reading, watching very easily Video etc., and much user's faulty posture when use mobile terminal can indirectly affect one's power of vision, and causes and uses ocular imbalance, Such as during user right sleeping use mobile phone, right eye is perpendicular to mobile terminal display screen, and left eye can be formed with mobile terminal screen One angle, the most so, can cause user's binocular vision inharmonious, in the above example, right eye can be taken as dominant eye or Person's dominant eye, and left eye can be taken as secondary regarding eye.Moreover, in daily life, people also tend to be partial to use with eye Unilateral eyes, this also brain habituation with the mankind utilize side eyes to carry out imaging to position and analyze relevant, so conduct The eyes of dominant eye often vision is better than the secondary eye that regards, and secondary regarding eye often dysplasia, not only result in the growth of eyes not Balance, the most also can affect the growth of facial muscle, causes eyes outward appearance and facial muscle around there is also the poorest Different, go to detect whether to there is the inharmonic situation of eyes eye so generally requiring people during human eye is grown, and add To correct.

At present, the method for dominant eye is distinguished in detection, is mainly identified by user oneself, and such as user selects a vision Target, can be cuvette water or an one-pen, then both hands intersect tiger's jaw triangularity, through this triangle it can be seen that The target object in advance chosen.Cover eyes respectively, simple eye through this delta-shaped region, see and can see this Target object, if can see, these eyes are exactly dominant eye, are otherwise secondary regarding eye.Or, user flattened any one The arm of hands also holds up a finger, sees that the object beyond two meters is (just as aiming at, only with two by this finger for two Eyes), then close eyes, if the position that user feels the finger holded up there occurs change, these eyes are exactly secondary Depending on eye, it it is exactly otherwise dominant eye.By above-mentioned example it will be seen that the detection that major-minor regards eye judges mainly by user oneself, past Toward not accurate enough.

In addition, rectification major-minor mainly has, depending on the method for eye, the method for covering, and i.e. uses object dominant eye to be covered, forces people Body uses secondary eye.So, pair is forced to have born the responsibility of master, ceaselessly observation analysis things depending on eye, and health is foster Dividing and supplement the most continuously, so, the accumulation in elapsed time, the secondary hypogenetic situation of eye just has been resolved.First, above-mentioned Detection major-minor is depending on method user the to be passed through subjective judgment of eye, the most not accurate enough.Secondly, antidote not only can make user not Suitable, make user not adhere to, but also affect the macroscopic features of user.

Summary of the invention

The embodiment of the present invention provides antidote and the mobile terminal of a kind of dominant eye, to solve existing major-minor regarding eye inspection Survey method, the problem that there is error owing to needing user independently to judge, and correct outside the impact that user's major-minor regards eye existence The problem seen.

First aspect, embodiments provides the antidote of a kind of dominant eye, is applied to the shifting with photographic head Dynamic terminal, the method includes:

Obtain the facial image of the mobile phone users of described camera collection；

Extract the eyes area image in described facial image；

Based on described eyes area image, determine that the dominant eye of described mobile phone users and pair regard eye；

Based on described dominant eye and the secondary eye that regards, the display mode of adjustment mobile terminal screen displayed content.

Second aspect, the embodiment of the present invention additionally provides a kind of mobile terminal, including front-facing camera, including:

Man face image acquiring module, for obtaining the facial image of the mobile phone users of described camera collection；

Eyes area image extraction module, for extracting the eyes area image in described facial image；

Major-minor determines module depending on eye, for based on described eyes area image, determines that the master of described mobile phone users regards Eye and pair regard eye；

Screen adjusting module, for regarding eye based on described dominant eye and pair, adjusts mobile terminal screen displayed content Display mode.

So, in the embodiment of the present invention, by obtaining the facial image of the mobile phone users of described camera collection, carry Take the eyes area image in described facial image, based on described eyes area image, determine the master of described mobile phone users Regard eye depending on eye with secondary, based on described dominant eye with secondary regarding eye, adjust the display mode of mobile terminal screen displayed content, permissible The most automatically identify that the major-minor of user regards eye, the unbalanced with eye of user can be corrected again in the way of user is difficult to discover.

Accompanying drawing explanation

In order to be illustrated more clearly that the technical scheme of the embodiment of the present invention, below by institute in the description to the embodiment of the present invention The accompanying drawing used is needed to be briefly described, it should be apparent that, the accompanying drawing in describing below is only some enforcements of the present invention Example, for those of ordinary skill in the art, on the premise of not paying creative work, it is also possible to according to these accompanying drawings Obtain other accompanying drawing.

Fig. 1 shows the flow chart of the antidote of the dominant eye in the embodiment of the present invention one；

Fig. 2 shows the flow chart of the antidote of the dominant eye in the embodiment of the present invention two；

Fig. 2 A is that the major-minor in the embodiment of the present invention two regards an eye line focusing schematic diagram；

Fig. 3 shows the flow chart of the antidote of the dominant eye in the embodiment of the present invention three；

Fig. 3 A is the schematic diagram that the major-minor in the embodiment of the present invention three regards the antidote of eye；

Fig. 4 shows the flow chart of the antidote of the dominant eye in the embodiment of the present invention four；

Fig. 5 shows the flow chart of the antidote of the dominant eye in the embodiment of the present invention five；

Fig. 6 shows the flow chart of the antidote of the dominant eye in the embodiment of the present invention six；

Fig. 6 A is the schematic diagram of the antidote of the Rotation screen of the dominant eye in the embodiment of the present invention six；

The structured flowchart of a kind of mobile terminal that Fig. 7 shows according to embodiments of the present invention in seven；

The structured flowchart of a kind of mobile terminal that Fig. 8 shows according to embodiments of the present invention in seven；

The structured flowchart of a kind of mobile terminal that Fig. 9 shows according to embodiments of the present invention in seven；

The structured flowchart of a kind of mobile terminal that Figure 10 shows according to embodiments of the present invention in seven；

The structured flowchart of a kind of mobile terminal that Figure 11 shows according to embodiments of the present invention in eight；

Figure 12 shows the structural representation of a kind of mobile terminal of according to embodiments of the present invention nine.

Detailed description of the invention

It is more fully described the exemplary embodiment of the disclosure below with reference to accompanying drawings.Although accompanying drawing shows the disclosure Exemplary embodiment, it being understood, however, that may be realized in various forms the disclosure and should be by embodiments set forth here Limited.On the contrary, it is provided that these embodiments are able to be best understood from the disclosure, and can be by the scope of the present disclosure Complete conveys to those skilled in the art.

Embodiment one

With reference to Fig. 1, it is shown that the flow chart of the antidote of the dominant eye of the embodiment of the present invention one, specifically can include as Lower step:

Step 110, obtains the facial image of the mobile phone users of described camera collection.

In actual applications, when mobile terminal uses and browses webpage, reading electronic book or viewing video, in order to identify The dominant eye of user and pair regard eye, will catch user's eyes image by mobile terminal camera.First, use at mobile terminal Time, mobile terminal acquiescence is opened photographic head, is used face identification functions to focus on face on backstage, after capturing facial image, It is buffered in mobile terminal memory, waits next step process.

Step 120, extracts the eyes area image in described facial image.

In embodiments of the present invention, when mobile terminal camera starts on backstage and shoots face, by mobile whole Face light-metering, some light-metering, the photometric system surrounding light-metering and 5 points, the focusing system of 9 sections that the camera of end is equipped with, identifies shooting The characteristic informations such as eyes in preview screen, face, can with the face location in lock preview picture, so, capture Facial image can quickly extract the eyes area image in facial image, for mobile terminal by image processing algorithm Further process.

Step 130, based on described eyes area image, determines that the dominant eye of described mobile phone users and pair regard eye.

In embodiments of the present invention, after mobile terminal extracts binocular images region by facial image, further Edge and the eyes contour edge of pupil of both eyes is extracted by image procossing, then by calculating pupil of both eyes in eyes profile Position, it is judged that dominant eye and the secondary eye that regards, or can be by extracting double circumocular muscular definition, meters in binocular images region The methods such as the area that calculation eyes contour edge surrounds, it is thus achieved that judge that major-minor regards the foundation of eye, and then judge the dominant eye in eyes Regarding eye with pair, dominant eye and pair in conjunction with user regard eye, and mobile terminal can be made and adjust operation accordingly, be used for correcting user Major-minor regard eye.

Step 140, based on described dominant eye and the secondary eye that regards, the display mode of adjustment mobile terminal screen displayed content.

In embodiments of the present invention, after the dominant eye and pair determining described mobile phone users regards eye, moved by adjustment The display content of dynamic terminal screen, or the display mode of mobile terminal screen to reach to correct user's eyes eye inharmonic Purpose.Such as, being dominant eye at the right eye learning user, left eye is secondary after eye, can focus on shifting by catching user's right eye The position of dynamic terminal display screen, adjusts the display content on this position so that it is obfuscation, and makes the screen that user's left eye focuses on The content sharpening of display on position, thus can force user more use left eye viewing and focus on, after Long-term correction, Can be internally formed left eye at user's brain is main vision inertia, and after the rectification phase, user uses right and left eyes to compare before More balance.

In embodiments of the present invention, catch facial image by mobile terminal camera, and then extract in facial image Eyes region, and the features such as pupil of both eyes contour area and eyes contour curve are extracted by image processing method, it is judged that when The major-minor of front user regards eye, and reaches to correct user's use depending on eye adjustment screen display content or display mode according to major-minor The unbalanced problem of eye, i.e. can identify that the major-minor of user regards eye the most automatically, again can be in the way of user is difficult to discover Correct the unbalanced with eye of user.

Embodiment two

With reference to Fig. 2, it is shown that the flow chart of the antidote of the dominant eye of the embodiment of the present invention two, specifically can include as Lower step:

Step 210, obtains the facial image of the mobile phone users of described camera collection.

In actual applications, in order to the dominant eye and pair identifying active user regards eye, first can be to the face of active user Take pictures, from this photo, then extract the eyes area image of active user, so when user uses mobile terminal, being System can point out user, the face-image of user to be obtained, if user agrees to, then opens the shooting of current mobile terminal Head, now, user can use the photographic head that dominant eye alignment is currently shooting automatically, and the secondary sight line depending on eye will be with Mobile phone screen In an angle, as shown in Figure 2 A, C is mobile terminal camera to curtain shape, and Z is dominant eye, and F is secondary regarding eye, the sight line of dominant eye It is perpendicular to photographic head, and secondary depending on there being an angle between sight line and the photographic head of eye, it is possible to by detection face image Binocular images region major-minor is judged depending on eye.

Step 220, extracts the eyes area image in described facial image.

In embodiments of the present invention, when, after the face-image of acquisition for mobile terminal user, image buffer storage is deposited at mobile terminal In reservoir, it is possible to use the human eye area image of face is extracted by image processing algorithm.Such as, eye recognition model is utilized Foundation, identify facial image human eye area.First, setting up one and identify model, with the face of standard, how image is as base Plinth, according to the 3 d structure model of face at the model set by the projection of two dimensional surface, then carries out pre-place to shooting image Reason, the method for pretreatment includes regulating picture contrast, Gauss noise reduction, binaryzation etc., the image after binaryzation, it is seen that eyes district Profile in territory is continuous, finally the left eye angle in face image each to the image tagged carrying out pretreatment, right eye angle, eyes Peak, the minimum point of eyes, four marginal points up and down of pupil, the peak of eyes is generally proximate to the position of face axis of symmetry Put, after being positioned by these eight feature point pairs human eyes, by identifying that eye contour and pupil are redrawn by data, eye The profile of the upper lower eyelid of eyeball can be fitted with conic section, as a example by upper eyelid, find respectively left and right two canthus and The coordinate of eyes peak, then take a point of pupil upper eyelid profile, it is bent that these four points are once constituted secondary with every three points Line, the contour line of upper eyelid just carrys out matching with two ends conic section, and the curve of pupil redraws and still utilizes this method, so may be used To obtain eyes area image in facial image.If two eyes differ in size, determine certain eyes characteristic point it After, the characteristic point of other eyes can be found by same method.

Step 230, according to position in two eye contour curves, the pupil of both eyes position in described eyes area image, Determine dominant eye and secondary regarding eye.

In embodiments of the present invention, after mobile terminal extracts binocular images region by facial image, further Extracted edge and the eyes contour edge of pupil of both eyes by image procossing, the central point of each eye pupil can be calculated, Extract eyelid profile again, and calculate the central point of the elliptical shape that eyelid contour curve surrounds, calculate the pupil of right and left eyes respectively The distance of the central point of the elliptical shape that central point surrounds with calculation eyelid contour curve, it may be determined that going out those eyes in eyes is Dominant eye, which eyes are secondary regarding eye.

Step 240, based on described dominant eye and the secondary eye that regards, the display mode of adjustment mobile terminal screen displayed content.

In embodiments of the present invention, after the dominant eye and pair determining described mobile phone users regards eye, moved by adjustment The display content of dynamic terminal screen, or the display mode of mobile terminal screen to reach to correct user's eyes eye inharmonic Purpose.Such as, being dominant eye at the right eye learning user, left eye is secondary after eye, can focus on shifting by catching user's right eye The position of dynamic terminal display screen, adjusts the display content on this position so that it is obfuscation, and makes the screen that user's left eye focuses on The content sharpening of display on position, thus can force user more use left eye viewing and focus on.It is of course also possible to The mode that prompting user actively adjusts mobile terminal is uneven, such as, when the right side learning user to the vision correcting user Eye is dominant eye, and user's terminal screen in rotary moving can be pointed out to be partial to left eye, to reach the purpose corrected.Real to this present invention Execute example not to be any limitation as.

In embodiments of the present invention, catch facial image by mobile terminal camera, and then extract in facial image Eyes region, and extract pupil of both eyes contour area and eyes eyelid contour curve feature by image processing method, enter one Step calculating pupil of both eyes, in the position of eyes profile, to judge that the major-minor of active user regards eye, and regards eye adjustment according to major-minor Screen display content or display mode reach correct user by the unbalanced effect of eye, i.e. can the most automatically identify use The major-minor at family regards eye, can correct again the unbalanced with eye of user by the way of user is difficult to discover.

Embodiment three

With reference to Fig. 3, it is shown that the flow chart of the antidote of the dominant eye of the embodiment of the present invention three, specifically can include as Lower step:

Step 301, obtains the facial image of the mobile phone users of described camera collection.

This step is identical with the step 210 in embodiment two, is not described in detail in this.

Step 302, extracts the eyes area image in described facial image.

This step is identical with the step 220 in embodiment two, is not described in detail in this.

Step 303, chooses the wherein eyes in described eyes area image, as with reference to eyes.

In embodiments of the present invention, the eyelid contour line of eyes and pupil are included at the eyes area image extracted Contour line, afterwards, the image of selected wherein eyes as with reference to eye image, such as, can select right eye as with reference to eye Eyeball, right eye region image is as reference picture.

Step 304, determines the described pupil position with reference to eyes.

In embodiments of the present invention, integrating step 303, after determining the area image with reference to eyes, reference to be determined The position of eye image pupil.Such as, selected right eye is with reference to eyes, includes the eye contour of right eye in right eye region image Line and the contour line of pupil, further utilize such as random Hough transformation principle, utilizes the duality of point and line, by original The curve negotiating curve representation form that image space is given becomes a point of parameter space, thus given in original image Curve detection problem is converted to find the spike problem in parameter space, such as round, oval, according to three on the most same straight line Point can be accurately determined position and the size of a circle, so by this algorithm, first, utilizing thresholding method pupil Pupil out, then is separately separated out by substantial separation by corrosion and the morphological method expanded, and pupil image is carried out limit Edge extracts, by each pixel and the pixel value thereof of pupil edge being stored to scan mode from all directions, use fixing away from From method selected element group, fixed range be the first and second points in indication group, second and thirdly between sequence interval equal, The central coordinate of circle of the circle that each some group determines and radius calculation out, compare, and by the often group center of circle abscissa of gained, vertical sit Mark and radius seek mathematic expectaion, will obtain the radius of pupil center location coordinate and pupil.

Step 305, determines the described contour curve with reference to eyes.

In embodiments of the present invention, integrating step 304, utilize Hough transform principle according on the eye contour extracted Pixel, by each pixel and the pixel value thereof at eyes edge being stored to scan mode from all directions, use fixing away from The oval central coordinate of circle each some group determined from method selected element calculates.

Step 306, it is judged that whether the described pupil position with reference to eyes is the described center with reference to eyes.

In embodiments of the present invention, integrating step 304 and step 305, when determining the circle that pupil contour curve surrounds The center of circle and the oval center of circle that surrounds of eye contour curve after, be appreciated that pupil position by the distance comparing two centers of circle Whether in the center of this eye contour.Such as, being right eye with reference to eyes, if two centers of circle overlap, then this pupil is at this The center of right eye, otherwise can calculate pupil position in these eyes by calculating the vector distance in two centers of circle.

Step 307, if the described pupil position with reference to eyes is the described center with reference to eyes, then by described reference Eyes are defined as dominant eye, are defined as by another eyes secondary regarding eye.

In embodiments of the present invention, integrating step 306, if the center of circle of calculated pupil and being enclosed with reference to eyes The oval center of circle become overlaps, then show that the position of this pupil is in the center of these reference eyes, and in conjunction with the embodiments two In step 210 in description, when user uses mobile terminal shooting face, can automatically use dominant eye to watch taking the photograph of taking pictures attentively As head, so the sight line of dominant eye and photographic head or mobile terminal screen present a right angle, it is embodied in eye image, then The position of pupil is the center in dominant eye, so when determining that this pupil position is on the center of these reference eyes Time, then it can be concluded that these reference eyes are the dominant eye of active user.

Step 308, if the described pupil with reference to eyes is not in the described center with reference to eyes, then by described with reference to eye Eyeball is defined as secondary regarding eye, and another eyes are defined as dominant eye.

In embodiments of the present invention, integrating step 307 is it is known that work as and determine that this pupil position is not at these reference eyes Time on center, according to the description in the step 210 in embodiment two, when user uses mobile terminal shooting face, meeting Automatically dominant eye is used to watch the photographic head taken pictures attentively, so the sight line of dominant eye presents one with photographic head or mobile terminal screen Individual right angle, the secondary sight line depending on eye then presents the angle of an on-right angle with photographic head or mobile terminal screen, is embodied in eye In eyeball image, then the position of pupil is not in the center of dominant eye, so when determining that the position of pupil is not in dominant eye Heart position, then it can be concluded that the pair that these reference eyes are active user regards eye.Certainly, it is judged that whether the pupil of reference eyes It is not can only be by comparing the ellipse whether center of circle of pupil surrounds with eye contour curve in the center with reference to eyes The center of circle overlap and judge, it is also possible to by pupil is slavered over and eye contour curve surrounds oval in slaver over and sentence Disconnected, this is not any limitation as by the embodiment of the present invention.

Step 309, based on described dominant eye with secondary regard eye, determine respectively described dominant eye and secondary focused on depending on eye first Screen area and the second screen area.

In embodiments of the present invention, after the dominant eye and pair determining active user regards eye, eye can be regarded according to major-minor Position above mobile terminal screen, determines the first screen area of the mobile terminal that dominant eye focuses on and secondary regards what eye focused on Mobile terminal the second screen area.Such as, after the right eye determining active user is dominant eye, when user uses viewing mobile eventually During the screen held, the mobile terminal camera opened by backstage, can be identified which eyes in the eyes of user and more connect Nearly photographic head, thus may determine that the region of the screen of the dominant eye viewing mobile terminal of user, with mobile terminal display screen Center line be demarcation line, right for screen one side of something is defined as dominant eye focus on the first screen area, the left one side of something of screen is defined as pair The second screen area focused on depending on eye.Certainly, two eyes of active user are moving to utilize mobile terminal camera to detect Position above dynamic terminal, if be detected that user only uses always at eye gaze current mobile terminal screen, such as user When lateral position viewing mobile terminal display screen, the mobile terminal camera opened on backstage may can not detect simultaneously in detection To the eyes of mobile terminal, if only detecting eyes, and these eyes are dominant eye words, then by current mobile terminal Whole display screen area is defined as the first screen area.This is not any limitation as by the embodiment of the present invention.

Step 310, carries out Fuzzy processing to the display content of described first screen area.

In embodiments of the present invention, when determining dominant eye and secondary the first screen area focused on depending on eye and the second screen Behind region, in order to correct the use ocular imbalance of user, the first screen area that dominant eye can be focused on by current mobile terminal display screen Territory carries out Fuzzy processing, then relate to show the Fuzzy processing technology of image, this technology include still image dimmedization and Dynamic image Fuzzy processing, as shown in Figure 3A, Q is Sharp processing of image, and M is that image blurringization processes, and Z is dominant eye, F Eye is regarded for pair, in the drawings it will be seen that dominant eye and the secondary region depending on eye focusing screen are demarcated with the center line of screen, and The screen area focusing on dominant eye has carried out Fuzzy processing, and the screen area focused on pair depending on eye has been carried out at sharpening Reason.If active user uses mobile terminal reading electronic book or browses webpage, then use still image dimmedization, if worked as Front user use mobile terminal watch video, then use dynamic image Fuzzy processing, both approaches be all by image at The content that current mobile terminal screen is shown by reason method processes, and such as, uses the conventional image moulds such as Gaussian Blur algorithm Gelatinizing processes current first screen area, and dynamic fuzzy is that each frame in current video is all carried out Fuzzy processing, for Still image, carries out new Fuzzy processing after current screen content alteration being detected, and certainly, the method for Fuzzy processing is also A transparent window can be added on current first screen area, utilize different image blurring algorithms to process, this Bright this is not any limitation as.

Step 311, carries out sharpening process to the display content of described second screen area.

In embodiments of the present invention, integrating step 309, when determine secondary depending on second screen area watched attentively of eye after, for Correct user with ocular imbalance, the second screen area that dominant eye focuses on can be carried out clearly by current mobile terminal display screen Change processes, and the content shown current mobile terminal screen by image processing method is processed, as shown in Figure 3A.Such as, Use Method of Noise, the regulation image processing method such as contrast, make the image sharpening of the second screen area, and in step 310 Describing similar, sharpening processes and also includes dynamic and static two kinds, and the process of dynamic sharpening is to each frame in current video All carry out sharpening process, for still image, after current screen content alteration being detected, carry out new sharpening process, when So, the method that sharpening processes can also add a transparent window on current first screen area, utilizes different images Algorithm for image clearness processes, and this is not any limitation as by the present invention.

In embodiments of the present invention, catch facial image by mobile terminal camera, and then extract in facial image Eyes region, and extract pupil of both eyes contour area and eyes eyelid contour curve feature by image processing method, enter one Step calculating pupil of both eyes, in the position of eyes profile, to judge that the major-minor of active user regards eye, and regards eye in shifting according to major-minor The position that dynamic terminal screen focuses on, determines the first screen area and the second screen area, subsequently by sharpening the first screen area Territory, sharpening the second screen area reach correct user by the unbalanced effect of eye, in the daily eye of user, involuntary Help user to correct major-minor and regard eye.

Embodiment four

With reference to Fig. 4, it is shown that the flow chart of the antidote of the dominant eye of the embodiment of the present invention four, specifically can include as Lower step:

Step 410, obtains the facial image of the mobile phone users of described camera collection.

Step 420, extracts the eyes area image in described facial image.

In embodiments of the present invention, when, after the face-image of acquisition for mobile terminal user, image buffer storage is deposited at mobile terminal In reservoir, it is possible to use the human eye area image of face is extracted by image processing algorithm.Such as, eye recognition model is utilized Foundation, identify facial image human eye area.First, setting up one and identify model, with the face of standard, how image is as base Plinth, according to the 3 d structure model of face at the model set by the projection of two dimensional surface, then carries out pre-place to shooting image Reason, the method for pretreatment includes regulating the methods such as picture contrast, Gauss noise reduction, binaryzation, the image after binaryzation, it is seen that eye Profile in eyeball region is continuous, the finally left eye angle in face image each to the image tagged carrying out pretreatment, right eye angle, eye The peak of eyeball, the minimum point of eyes, four marginal points up and down of pupil, the peak of eyes is generally proximate to face axis of symmetry Position, after being positioned by these eight feature point pairs human eyes, by identifying that data carry out weight to eye contour and pupil Painting, the profile of the upper lower eyelid of eyes can be fitted with conic section, as a example by upper eyelid, finds two canthus, left and right respectively And the coordinate of eyes peak, then taking a point of pupil upper eyelid profile, these four points are once constituted two with every three points Secondary curve, the contour line of upper eyelid just carrys out matching with two ends conic section, and the curve of pupil redraws and still utilizes this method, as This can obtain eyes area image in facial image.If two eyes differ in size, determining the feature of certain eyes After Dian, the characteristic point of other eyes can be found by same method.

In addition, when processing facial image, more than extraction eyes area image, indulging in facial image to be passed through Across grain builds a static three-dimensional face model, and to use Phong illumination to render 3-D view and render be a two dimension Facial image, utilizes two-dimension human face Feature Points Extraction afterwards, extracts the multiple spies in the above-mentioned two-dimension human face picture rendered Levy a little, utilize and projected by the opposite direction of two dimensional image to three-dimensional grid, multiple two dimensional character points of said extracted are projected three On dimension face grid, thus realize automatically identifying the face part in threedimensional model, and extract the substantially position of three-dimensional feature point Put；Utilize three-dimensional face mesh shape and the method analyzed by rate, according to the shape facility that each human face characteristic point is intrinsic, The three-dimensional feature point approximate location of said extracted is refined further, and the three-dimensional feature point position after refinement is projected to again On two-dimension human face picture, the most repeatedly, the position result of the multiple human face characteristic points defined before can be restrained.

The characteristic point extracted by said method is available for setting up a face muscle identification model, wherein, finds 25 not Extracting face characteristic sample with the people at age and different facial characteristics, the size to these three-dimensional faces, form makes system One adjusts, and utilizes the technology of art designing that these 25 three-dimensional faces carry out characteristic point mark and muscle model structure, then profit afterwards By the technology such as regression analysis and support vector machine between training sample learning three-dimensional face features point and facial muscle Mapping relations, thus train a three-dimensional face muscle model predictor.The feature of this model prediction device is with three-dimensional face Characteristic point position is input, with corresponding three-dimensional face muscle model for output, so far, can set up a face muscle identification Model, the construction method step of certain face muscle identification model is not limited to this, and this is not any limitation as by the embodiment of the present invention.

Step 430, according to the characteristic information of user's eyes in described eyes area image, determines dominant eye and the pair of user Depending on eye.

In embodiments of the present invention, after mobile terminal extracts binocular images region by facial image, further Extract eyes contour edge by image procossing, the area of the elliptical shape that eyelid contour curve surrounds can be calculated, pass through The relatively size of the elliptical shape that right and left eyes eyelid contour curve surrounds, it may be determined that going out those eyes in eyes is main regarding Eye, which eyes are secondary regarding eye.

In addition, by the face muscle identification model described in step 420, it is also possible to identify double circumocular muscle Linear feature, by the feature of right and left eyes Surrounding muscles lines, it is also possible to determine that in eyes, those eyes are dominant eye, and which is only Eyes are secondary regarding eye.

Step 440, based on described dominant eye and the secondary eye that regards, the display mode of adjustment mobile terminal screen displayed content.

In embodiments of the present invention, after the dominant eye and pair determining described mobile phone users regards eye, moved by adjustment The display content of dynamic terminal screen, or the display mode of mobile terminal screen to reach to correct user's eyes eye inharmonic Purpose.Such as, being dominant eye at the right eye learning user, left eye is secondary after eye, can focus on shifting by catching user's right eye The position of dynamic terminal display screen, adjusts the display content on this position so that it is obfuscation, and makes the screen that user's left eye focuses on The content sharpening of display on position, thus can force user more use left eye viewing and focus on.It is of course also possible to The mode that prompting user actively adjusts mobile terminal is uneven to the vision correcting user, because there are some researches show, if If sight line is turned more than 20 degree to secondary eye direction by dominant eye user, the major-minor eye of the user of 80 percent can be exchanged with each other. So, when the right eye learning user is dominant eye, user's terminal screen in rotary moving can be pointed out to be partial to left eye, to reach to correct Purpose.This embodiment of the present invention is not any limitation as.

In embodiments of the present invention, catch facial image by mobile terminal camera, and then extract in facial image Eyes region, and extract pupil of both eyes contour area and eyes area image feature by image processing method, to judge to work as The major-minor of front user regards eye, and reaches to correct user's use depending on eye adjustment screen display content or display mode according to major-minor The unbalanced problem of eye, i.e. can the most automatically identify that the major-minor of user regards eye, can be difficult to, by user, the side discovered again Formula corrects the unbalanced with eye of user.

Embodiment five

With reference to Fig. 5, it is shown that the flow chart of the antidote of the dominant eye of the embodiment of the present invention five, specifically can include as Lower step:

Step 501, obtains the facial image of the mobile phone users of described camera collection.

Step 502, extracts the eyes area image in described facial image.

This step is identical with the step 420 in embodiment four, is not described in detail in this.

Step 503, chooses the wherein eyes in described eyes area image, as the first contrast eyes.

In embodiments of the present invention, after being extracted eyes area image, select eyes therein right as first Ratio eyes, same, select the area image of these contrast eyes as the first contrast images.For example, it is possible to select right eye conduct First contrast eyes, then the area image of right eye is as the first contrast images.

Step 504, chooses the another eyes in described eyes area image, as the second contrast eyes.

In embodiments of the present invention, integrating step 503, after having chosen the first contrast eyes, other eyes Be determined as the second contrast eyes, such as, when have selected right eye as the first contrast eyes after, that just selects left eye as second Contrast eyes.

Step 505, obtains the contour curve of described first contrast eyes.

In embodiments of the present invention, after determining the first contrast eyes, image can be carried out pretreatment, based on the colour of skin Human eye profile automatically extracts new method.The method is divided into four steps: first, extracts face coloured image and by it from rgb color sky Between transform to YCbCr color space；Secondly, it is mapped into pedestrian's face zone location by colour of skin non-linear space to process；Then, adopt Human eye area segmentation is realized with Da-Jin algorithm；Finally, eye contour is extracted by chrominance information and Morphological scale-space method.

Step 506, adds up the area that the contour curve of described first contrast eyes surrounds, obtains the first area.

In embodiments of the present invention, according to step 505, after having extracted the first eye contour contrasting eyes, according to The ellipse that eye contour surrounds, calculates its area.Even if oval area formula is as follows:

S=∏ a b

Wherein S is ellipse area, and ∏ is pi, and it is long that a is respectively oval semi-major axis, and the semi-minor axis that b is oval is long, half Major axis can be tried to achieve according to the distance between eye contour Far Left and rightmost point, and the length of semi-minor axis can be taken turns according to eyes Distance between profile top edge peak and lower limb minimum point is tried to achieve.

Step 507, obtains the contour curve of described second contrast eyes.

In embodiments of the present invention, the method described in integrating step 505, then the profile extracting the second contrast eyes is bent Line.

Step 508, adds up the area that the contour curve of described second contrast eyes surrounds, obtains second area.

In embodiments of the present invention, equally, the method described in integrating step 506, calculate the area of the second contrast eyes.

Step 509, relatively described first area and the size of second area.

In embodiments of the present invention, integrating step 506 and step 508 calculate the area and of the first contrast eyes respectively The area of two contrast eyes, compares the size of two eyes areas.

Described first contrast eyes if described first area is more than second area, are then defined as dominant eye by step 510, It is secondary regarding eye by described second contrast eyes.

In embodiments of the present invention, the comparing result of integrating step 509, if the first area is more than second area, then by the One contrast eyes are defined as dominant eye, are secondary regarding eye by the second contrast eyes.Such as, if the first contrast eyes are right eye, right The area that the ellipse area that the profile of eye surrounds surrounds more than the contour curve of left eye, then right eye is exactly dominant eye, and left eye is Secondary regarding eye.

Described first contrast eyes if described first area is less than second area, are then defined as secondary regarding eye by step 511, Described second contrast eyes are defined as dominant eye.

In embodiments of the present invention, integrating step 509, same, if as the first area less than second area, then by the One contrast eyes are defined as dominant eye, are secondary regarding eye by the second contrast eyes.Such as, if the first contrast eyes are right eye, right The area that the ellipse area that the profile of eye surrounds surrounds less than the contour curve of left eye, then right eye is exactly secondary regarding eye, and left eye is Dominant eye.

Step 512, based on described dominant eye and the secondary eye that regards, the display mode of adjustment mobile terminal screen displayed content.

This step is identical with the step 440 in embodiment four, is not described in detail in this.

In embodiments of the present invention, catch facial image by mobile terminal camera, and then extract in facial image Eyes region, and extract pupil of both eyes contour area and eyes eyelid contour curve by image processing method, and calculate double The oval area that eye contour curve surrounds, compares the size of two areas, and the eyes that area is big are defined as dominant eye, otherwise It is defined as the secondary eye that regards, and reaches to correct user with eye not depending on eye adjustment screen display content or display mode according to major-minor The problem of equilibrium, i.e. can the most automatically identify that the major-minor of user regards eye, can rectify again by the way of user is difficult to discover Positive user's is unbalanced with eye.

Embodiment six

With reference to Fig. 6, it is shown that the flow chart of the antidote of the dominant eye of the embodiment of the present invention six, specifically can include as Lower step:

Step 601, obtains the facial image of the mobile phone users of described camera collection.

This step is identical with the step 410 in embodiment four, is not described in detail in this.

Step 602, extracts the eyes area image in described facial image.

Step 603, chooses the wherein eyes in described eyes area image, as the 3rd contrast eyes.

In embodiments of the present invention, after being extracted eyes area image, select eyes therein right as the 3rd Ratio eyes, same, select the area image of these contrast eyes as the 3rd contrast images.For example, it is possible to select right eye conduct First contrast eyes, then the area image of right eye is as the 3rd contrast images.

Step 604, chooses the another eyes in described eyes area image, as the 4th contrast eyes.

In embodiments of the present invention, integrating step 603, after having chosen the first contrast eyes, other eyes Be determined as the 4th contrast eyes, such as, when have selected right eye as the first contrast eyes after, that just selects left eye as the 4th Contrast eyes.

Step 605, obtains the muscular definition around described 3rd contrast eyes.

In embodiments of the present invention, facial muscle identification model is set up, when determining the 3rd described in integrating step 430 After contrast eyes and the 4th contrast eyes, use facial muscle identification model extraction the 3rd contrast eyes and the 4th contrast eye respectively Facial muscle lines around eyeball.

Step 606, determines the statistical distance between the proximal muscles lines around described 3rd contrast eyes, obtains first Statistical distance.

In embodiments of the present invention, the use eye long-term due to user is unbalanced, causes the imbalance that eyes are grown, long-term shape There is notable difference in the double circumocular muscular definition become, research shows, because excessively using dominant eye for a long time so that dominant eye Muscular definition around is more secondary has wider spacing depending on circumocular muscular definition, so, can pass through to calculate two respectively Statistical distance between muscles around eyes lines judges dominant eye and secondary regarding eye.Such as, according to determined in step 605 Three contrast eyes after extracting the muscular definition image of its circumference of eyes, based on longitudinal muscular definition, calculate every two muscle Average distance between lines, can get rid of the ultimate range between two muscular definition and minimum range, respectively at two fleshes Take ten point of symmetry on meat lines, and calculate the distance between each two point of symmetry, divided by ten, obtain these two muscular definition it Between average distance, after the average distance between calculating all of for this circumference of eyes muscular definition in aforementioned manners, summation, and Divided by the sum of this circumference of eyes muscular definition, obtain the statistical distance of a muscular definition, it is simply that around the 3rd contrast eyes Proximal muscles lines between the first statistical distance.

Certainly, in actual applications, can be the system between host computer muscular definition by longitudinal muscular definition incessantly Meter distance, it is also possible to combine horizontal muscular definition counting statistics distance, and statistical distance is not only limited in mentioned above Method, can adjust according to real needs, such as, increase a weight according to the distance of muscular definition distance reference eyes, This is not any limitation as by the embodiment of the present invention.

Step 607, obtains the muscular definition around the 4th contrast eyes.

In embodiments of the present invention, facial muscle identification model is set up, when determining the 4th described in integrating step 430 After contrast eyes, use the facial muscle lines around facial muscle identification model extraction the 4th contrast eyes.

Step 608, determines the statistical distance between the proximal muscles lines around the 4th contrast eyes, obtains the second statistics Distance.

In embodiments of the present invention, the method that integrating step 606 describes, the phase around the 4th contrast eyes can be calculated The second statistical distance between adjacent muscular definition.

Step 609, relatively described first statistical distance and the size of described second statistical distance.

In embodiments of the present invention, the first statistical distance and the second statistical distance are calculated by step 606 and step 608 After, compare the size between two distances.

3rd contrast eyes if described first statistical distance is more than described second statistical distance, are then defined as by step 610 Described 4th contrast eyes are secondary regarding eye by dominant eye.

In embodiments of the present invention, if the first statistical distance is more than the second statistical distance, then explanation the 3rd contrast eyes week The muscular definition enclosed has relatively wide distance, it is possible to determine that the 3rd contrast eyes are dominant eye, and the 4th contrast eyes are Secondary regarding eye.

3rd contrast eyes if described first statistical distance is less than described second statistical distance, are then defined as by step 611 Secondary regarding eye, described 4th contrast eyes are defined as dominant eye.

In embodiments of the present invention, by the comparative result of step 610, if the first statistical distance less than second statistics away from From, then the distance of the muscular definition around explanation the 3rd contrast eyes is narrower, it is possible to determine that the 3rd contrast eyes are that pair regards Eye, and the 4th contrast eyes are dominant eye.

Step 612, based on described dominant eye with secondary regard eye, determine respectively described dominant eye and secondary focused on depending on eye first Screen area and the second screen area.

This step is identical with the step 309 in embodiment three, is not described in detail in this.

Step 613, carries out Fuzzy processing to the display content of described first screen area.

This step is identical with the step 310 in embodiment three, is not described in detail in this.

Step 614, carries out sharpening process to the display content of described second screen area.

This step is identical with the step 311 in embodiment three, is not described in detail in this.

Preferably, when the display screen of described mobile terminal be naked eye three-dimensional screen and play video time, described based on described Dominant eye and the secondary eye that regards, the step of the display mode of adjustment mobile terminal screen displayed content, including:

The figure that dominant eye described in described naked eye three-dimensional screen receives is blocked by the first parallax barrier of described mobile terminal Picture.

In embodiments of the present invention, when user uses the mobile terminal of configuration bore hole 3D screen, taken the photograph by mobile terminal Regard after eye as the image of head collection determines user's major-minor, and determine user's major-minor when user uses mobile terminal and regard After eye focuses on the first screen area and second screen area of current mobile terminal, it is possible to use the parallax barrier of bore hole 3D screen Method blocks the image that user's dominant eye receives, and reaches to correct the effect of user's ocular imbalance.Parallax barrier be utilize naked A kind of visual occlusion technology that eye 3D screen can provide, wherein, the implementation method of optical barrier type 3D technology is to use a switch Liquid crystal display screen, polarizing coating and high molecule liquid crystal layer, utilize liquid crystal layer and polarizing coating to produce vertical bar that a series of direction is 90 ° Stricture of vagina.These stripeds are wide tens microns, are the formation of vertical slice grid pattern by their light, referred to as " parallax barrier ", This technology make use of the parallax barrier being placed between backlight module and LCD just, under stereoscopic display mode, it should by a left side Soon to image show on liquid crystal display screen time, opaque striped can block right eye；In like manner, it should the image seen by right eye When display is on liquid crystal display screen, opaque striped can block left eye, by by the viewable pictures of left eye and right eye separately, making onlooker See 3D image, so, after the major-minor determining active user regards eye, then can control the output of bore hole 3D screen, block The part parallax obstacle in dominant eye direction, open pair regards the parallax obstacle of eye portion, and allowing secondary is to undertake main duty depending on screen soon Energy.

Secondary the second parallax barrier regarding the image that eye receives described in naked eye three-dimensional screen described in occlusion removal.

In embodiments of the present invention, when user uses the mobile terminal of configuration bore hole 3D screen, taken the photograph by mobile terminal Regard after eye as the image of head collection determines user's major-minor, and determine user's major-minor when user uses mobile terminal and regard After eye focuses on the first screen area and second screen area of current mobile terminal, then can control the output of bore hole 3D screen, Namely removing and block the secondary part parallax obstacle regarding eye direction, allowing secondary is to undertake Major Function depending on screen soon, to reach real Now correct major-minor eye and grow unbalanced purpose.

Preferably, described based on described eyes area image, determine that the dominant eye of described mobile phone users and pair regard eye Step after, described method also includes:

Point out described mobile phone users that depending on eye direction, described mobile terminal is rotated the first adjustment angle to pair；Wherein, Described first adjusts angle more than predetermined angle threshold value.

In embodiments of the present invention, the image gathered by mobile terminal camera determine user's major-minor regard eye it After, it is also possible to by the way of actively pointing out user, make user adjust the angle of current mobile terminal screen, because there being research table Bright, if if sight line is turned more than 20 degree to secondary eye direction by dominant eye user, the major-minor eye of the user of 80 percent can phase Interchangeable.So can preset adjustment angle is 20 degree, when the dominant eye of user is right eye when, mobile terminal prompting user " healthy in order to ensure with eye, please screen to deflect 20 degree to the left ", as shown in Figure 6A, P is mobile terminal screen, when user will move After dynamic terminal screen have rotated an angle in the horizontal direction, if less than 20 degree, then the further of mobile terminal can be received Prompting, if rotated to 20 degree, then mobile terminal prompting user keeps current state, and dominant eye can be the most mutual depending on eye with pair Changing, pair originally serves as main visual performance depending on eye left eye, and in figure, Z-F represents that dominant eye is converted to pair and regards eye, and F-Z represents Pair is converted to dominant eye depending on eye.

In embodiments of the present invention, catch facial image by mobile terminal camera, and then extract in facial image Eyes region, and by setting up face facial muscle identification model in advance, extract the muscle around face eyes area image Lines image, and calculate the statistical distance between eyes muscular definition respectively, compare the size of two statistical distance, statistical distance Big eyes are defined as dominant eye, are otherwise defined as the secondary eye that regards, and regard eye adjustment screen display content according to major-minor or show The mode of showing reaches to correct user by the unbalanced problem of eye, i.e. can the most automatically identify that the major-minor of user regards eye, again may be used The unbalanced with eye of user is corrected by user in the way of being difficult to discover.In the embodiment of the present invention, also describe and pass through bore hole Parallax obstacle in the imaging technique of 3D video blocks the sight line of dominant eye, to reach to correct the unbalanced purpose of user power utilization, And also the secondary use regarding eye can be strengthened by prompting user's active rotation mobile terminal screen, reach major-minor and regard eye phase The purpose of conversion mutually.

Embodiment seven

With reference to Fig. 7, it is shown that the structured flowchart of a kind of mobile terminal of the embodiment of the present invention seven.

Described mobile terminal 700 includes: man face image acquiring module 701, eyes area image extraction module 702, major-minor Determine that module 703, screen adjusting module 704, screen adjust reminding module 705 depending on eye.

Interactive relation function and each module of each module between is discussed in detail separately below.

Man face image acquiring module 701, for obtaining the facial image of the mobile phone users of described camera collection；

Eyes area image extraction module 702, for extracting the eyes area image in described facial image；

Major-minor determines module 703 depending on eye, for based on described eyes area image, determines the master of described mobile phone users Eye is regarded depending on eye and pair；Optionally, depending on eye, major-minor determines that module 703 may include that pupil position determines submodule 7031, for root According to position in two eye contour curves, the pupil of both eyes position in described eyes area image, determine that dominant eye and pair regard Eye.Optionally, pupil position determines that submodule 7031 may include that reference eye chooses unit 70311, is used for choosing described eyes Wherein eyes in area image, as with reference to eyes；Determine unit 70312 with reference to eye pupil hole site, be used for determining institute State the pupil position with reference to eyes；Unit 70313 is determined, for determining that the described profile with reference to eyes is bent with reference to eye contour curve Line；Judging unit 70314, for judging whether the described pupil position with reference to eyes is the described center with reference to eyes； Dominant eye determines unit 70315, if being the described center with reference to eyes for the described pupil position with reference to eyes, then will Described reference eyes are defined as dominant eye, are defined as by another eyes secondary regarding eye.Pair determines unit 70316 depending on eye, if for Described reference eyes not in the described center with reference to eyes, are then defined as secondary regarding eye by the described pupil with reference to eyes, will Another eyes are defined as dominant eye.

With reference to shown in Fig. 8, optionally, depending on eye, major-minor determines that module 703 may include that characteristic information judges submodule 7131, for according to the characteristic information of user's eyes in described eyes area image, determine that the dominant eye of user and pair regard eye.Can Choosing, characteristic information judges that submodule 7131 may include that the first contrast eyes choose unit 71311, is used for choosing described pair Wherein eyes in eye area image, as the first contrast eyes；Second contrast eyes choose unit 71312, are used for selecting Take the another eyes in described eyes area image, as the second contrast eyes；First contrast eye contour curve acquisition list Unit 71313, for obtaining the contour curve of described first contrast eyes；First area statistics unit 71314, is used for adding up described The area that the contour curve of the first contrast eyes surrounds, obtains the first area；Second contrast eye contour curve acquisition unit 71315, for obtaining the contour curve of described second contrast eyes；Second area statistic unit 71316, is used for adding up described The area that the contour curve of two contrast eyes surrounds, obtains second area；Area comparison unit 71317, for relatively more described the One area and the size of second area；Dominant eye determines unit 71318, if for described first area more than second area, then Described first contrast eyes are defined as dominant eye, are secondary regarding eye by described second contrast eyes.Pair determines unit depending on eye 71319, if for described first area less than second area, then described first contrast eyes are defined as secondary regarding eye, by described Second contrast eyes are defined as dominant eye.

With reference to shown in Fig. 9, optionally, characteristic information judges that submodule 7131 may include that the 3rd contrast eyes choose list Unit 72311, for choosing the wherein eyes in described eyes area image, as the 3rd contrast eyes；4th contrast eye Eyeball chooses unit 72312, for choosing the another eyes in described eyes area image, as the 4th contrast eyes；3rd Contrast muscles around eyes lines acquiring unit 72313, for obtaining the muscular definition around described 3rd contrast eyes；First Statistical distance determines unit 72314, for determine described 3rd contrast eyes around proximal muscles lines between statistics away from From, obtain the first statistical distance；4th contrast muscles around eyes lines acquiring unit 72315, for obtaining the 4th contrast eye Muscular definition around eyeball；Second statistical distance determines unit 72316, for determining the proximal muscles around the 4th contrast eyes Statistical distance between lines, obtains the second statistical distance；Statistical distance comparing unit 72317, for the most described first system Meter distance and the size of described second statistical distance；Dominant eye determines unit 72318, if being more than for described first statistical distance Described second statistical distance, then be defined as dominant eye by the 3rd contrast eyes, is secondary regarding eye by described 4th contrast eyes.Pair regards Eye determines unit 72319, if for described first statistical distance less than described second statistical distance, then by true for the 3rd contrast eyes It is set to secondary regarding eye, described 4th contrast eyes are defined as dominant eye.

Screen adjusting module 704, for based on described dominant eye and the secondary eye that regards, adjustment mobile terminal screen displayed content Display mode.Optionally, screen adjusting module 704 may include that screen area determines submodule 7041, for based on described Dominant eye and pair regard eye, determine described dominant eye and secondary the first screen area focused on depending on eye and the second screen area respectively； Fuzzy processing submodule 7042, for carrying out Fuzzy processing to the display content of described first screen area；At sharpening Reason submodule 7043, for carrying out sharpening process to the display content of described second screen area.

Optionally, screen adjusting module 704, it is also possible to including:

Parallax barrier blocks submodule 7044, for blocking described bore hole by the first parallax barrier of described mobile terminal The image that described in three-dimensional screen, dominant eye receives；Parallax barrier is blocked and is removed submodule 7045, for bore hole described in occlusion removal Secondary the second parallax barrier regarding the image that eye receives described in three-dimensional screen.

Screen adjusts reminding module 705, is used for pointing out described mobile phone users that to pair, described mobile terminal is regarded eye side To rotating the first adjustment angle；Wherein, described first angle is adjusted more than predetermined angle threshold value.

In embodiments of the present invention, catch facial image by mobile terminal camera, and then extract in facial image Eyes region, and by pupil of both eyes center in eyes area image and two eye contour center of curve positions away from From, and the characteristic information of user's eyes in eyes area image, determine the dominant eye of active user and the secondary eye that regards, and according to Major-minor adjusts screen display content or display mode depending on eye and reaches to correct user by the unbalanced problem of eye, i.e. can be accurate The major-minor automatically identifying user regard eye, the unbalanced with eye of user can be corrected again by the way of user is difficult to discover.This In inventive embodiments, also describe the parallax obstacle in the imaging technique by bore hole 3D video and block the sight line of dominant eye, with Reach to correct the unbalanced purpose of user power utilization, and also can be added by prompting user's active rotation mobile terminal screen The strong secondary use regarding eye, reaches the purpose that major-minor is mutually changed depending on eye, automatically detects user's by mobile terminal the most accurately Major-minor regards eye, and the display mode further through mobile terminal screen changes being accustomed to eye of user, reaches to correct user uneven with eye Weighing apparatus purpose.

Embodiment ten

With reference to Figure 11, it is shown that the structured flowchart of a kind of mobile terminal in the embodiment of the present invention eight.

Mobile terminal 800 shown in Figure 11 includes: at least one processor 801, memorizer 802, at least one network connect Mouthfuls 804 and user interface 803 and assembly 806 of taking pictures.Each assembly in mobile terminal 800 is coupled by bus system 805 Together.It is understood that bus system 805 is for realizing the connection communication between these assemblies.Bus system 805 is except including data Outside bus, also include power bus, control bus and status signal bus in addition.But for the sake of understanding explanation, in Fig. 10 Various buses are all designated as bus system 805, and assembly 806 of taking pictures includes photographic head.

Wherein, user interface 803 can include display, keyboard or pointing device (such as, mouse, trace ball (trackball), touch-sensitive plate or touch screen etc..

The memorizer 802 being appreciated that in the embodiment of the present invention can be volatile memory or nonvolatile memory, Maybe can include volatibility and nonvolatile memory.Wherein, nonvolatile memory can be read only memory (Read- OnlyMemory, ROM), programmable read only memory (ProgrammableROM, PROM), Erasable Programmable Read Only Memory EPROM (ErasablePROM, EPROM), Electrically Erasable Read Only Memory (ElectricallyEPROM, EEPROM) or sudden strain of a muscle Deposit.Volatile memory can be random access memory (RandomAccessMemory, RAM), and it is used as outside the most slow Deposit.By exemplary but be not restricted explanation, the RAM of many forms can use, such as static RAM (StaticRAM, SRAM), dynamic random access memory (DynamicRAM, DRAM), Synchronous Dynamic Random Access Memory (SynchronousDRAM, SDRAM), double data speed synchronous dynamic RAM (DoubleDataRate SDRAM, DDRSDRAM), enhancement mode Synchronous Dynamic Random Access Memory (Enhanced SDRAM, ESDRAM), synchronized links Dynamic random access memory (SynchlinkDRAM, SLDRAM) and direct rambus random access memory (DirectRambusRAM, DRRAM).The memorizer 802 of the system and method that the embodiment of the present invention describes is intended to include but does not limits In these and the memorizer of any other applicable type.

In some embodiments, memorizer 802 stores following element, executable module or data structure, or Their subset of person, or their superset: operating system 8021 and application program 8022.

Wherein, operating system 8021, comprise various system program, such as ccf layer, core library layer, driving layer etc., be used for Realize various basic business and process hardware based task.Application program 8022, comprises various application program, such as media Player (MediaPlayer), browser (Browser) etc., be used for realizing various applied business.Realize embodiment of the present invention side The program of method may be embodied in application program 8022.

In embodiments of the present invention, by calling program or the instruction of memorizer 802 storage, concrete, can be application The program stored in program 8022 or instruction, processor 801 is for obtaining the people of the mobile phone users of described camera collection Face image；Extract the eyes area image in described facial image；Based on described eyes area image, determine described mobile terminal The dominant eye of user and pair regard eye；Based on described dominant eye and the secondary eye that regards, the display of adjustment mobile terminal screen displayed content Mode.

The method that the invention described above embodiment discloses can apply in processor 801, or is realized by processor 801. Processor 801 is probably a kind of IC chip, has the disposal ability of signal.During realizing, said method each Step can be completed by the instruction of the integrated logic circuit of the hardware in processor 801 or software form.Above-mentioned process Device 801 can be general processor, digital signal processor (DigitalSignalProcessor, DSP), special IC (ApplicationSpecificIntegratedCircuit, ASIC), ready-made programmable gate array (FieldProgrammableGateArray, FPGA) or other PLDs, discrete gate or transistor logic Device, discrete hardware components.Can realize or perform disclosed each method, step and the box in the embodiment of the present invention Figure.The processor etc. that general processor can be microprocessor or this processor can also be any routine.In conjunction with the present invention The step of the method disclosed in embodiment can be embodied directly in hardware decoding processor and perform, or uses decoding processor In hardware and software module combination execution complete.Software module may be located at random access memory, and flash memory, read only memory can In the storage medium that this areas such as program read-only memory or electrically erasable programmable memorizer, depositor are ripe.This storage Medium is positioned at memorizer 802, and processor 801 reads the information in memorizer 802, completes the step of said method in conjunction with its hardware Suddenly.

It is understood that the embodiment of the present invention describe these embodiments can use hardware, software, firmware, middleware, Microcode or a combination thereof realize.Realizing for hardware, processing unit can be implemented in one or more special IC (ApplicationSpecificIntegratedCircuits, ASIC), digital signal processor (DigitalSignalProcessing, DSP), digital signal processing appts (DSPDevice, DSPD), programmable logic device (ProgrammableLogicDevice, PLD), field programmable gate array (Field-ProgrammableGateArray, FPGA), general processor, controller, microcontroller, microprocessor, for performing other electronics list of herein described function In unit or a combination thereof.

Software is realized, can come by performing the module (such as process, function etc.) of function described in the embodiment of the present invention Realize the technology described in the embodiment of the present invention.Software code is storable in performing in memorizer and by processor.Memorizer can Within a processor or to realize outside processor.

Alternatively, processor 801 based on described eyes area image, determines that the master of described mobile phone users regards described Eye and pair regard at the moment, are additionally operable to: according to pupil of both eyes position in described eyes area image in two eye contour curves Position, determines dominant eye and secondary regarding eye.

Alternatively, processor 801 described according to pupil of both eyes center in described eyes area image and each eyes The distance of contour curve center, determines dominant eye and secondary regards at the moment, being additionally operable to: choose in described eyes area image its In eyes, as with reference to eyes；Determine the described pupil position with reference to eyes；Determine that the described profile with reference to eyes is bent Line；Judge whether the described pupil position with reference to eyes is the described center with reference to eyes；If the described pupil with reference to eyes Hole site is the described center with reference to eyes, then be defined as dominant eye by described with reference to eyes, determined by another eyes Eye is regarded for pair.

Alternatively, described, processor 801 judges whether the described center with reference to the pupil of eyes is described reference After the center of the contour curve of eyes, it is additionally operable to: if the described pupil with reference to eyes is not in described reference eyes Heart position, then be defined as secondary regarding eye by described reference eyes, another eyes be defined as dominant eye.

Alternatively, processor 801 described according to pupil of both eyes center in described eyes area image and each eyes The distance of contour curve center, determines dominant eye and secondary regarding at the moment, is additionally operable to: according to user in described eyes area image The characteristic information of eyes, determines that the dominant eye of user and pair regard eye.

Alternatively, processor 801 according to the characteristic information of user's eyes in described eyes area image, determines use described The dominant eye at family and pair regard at the moment, are additionally operable to: the wherein eyes choosing in described eyes area image, as the first contrast Eyes；Choose the another eyes in described eyes area image, as the second contrast eyes；Obtain described first contrast eyes Contour curve；Add up the area that the contour curve of described first contrast eyes surrounds, obtain the first area；Obtain described second The contour curve of contrast eyes；Add up the area that the contour curve of described second contrast eyes surrounds, obtain second area；Relatively Described first area and the size of second area；If described first area is more than second area, then by described first contrast eyes It is defined as dominant eye, is secondary regarding eye by described second contrast eyes.

Alternatively, processor 801, after the size of described first area of described comparison and second area, is additionally operable to: if Described first area is less than second area, then be defined as by described first contrast eyes secondary regarding eye, by described second contrast eyes It is defined as dominant eye.

Alternatively, processor 801 according to the characteristic information of user's eyes in described eyes area image, determines use described The dominant eye at family and pair regard at the moment, are additionally operable to: the wherein eyes choosing in described eyes area image, as the 3rd contrast Eyes；Choose the another eyes in described eyes area image, as the 4th contrast eyes；Obtain described 3rd contrast eyes Muscular definition around；Determine the statistical distance between the proximal muscles lines around described 3rd contrast eyes, obtain first Statistical distance；Obtain the muscular definition around the 4th contrast eyes；Determine the 4th contrast eyes around proximal muscles lines it Between statistical distance, obtain the second statistical distance；Relatively described first statistical distance and the size of described second statistical distance；If Described first statistical distance is more than described second statistical distance, then the 3rd contrast eyes are defined as dominant eye, by the described 4th Contrast eyes are secondary regarding eye.

Alternatively, processor 801 described first statistical distance of described comparison and described second statistical distance size it After, it is additionally operable to: if described first statistical distance is less than described second statistical distance, then the 3rd contrast eyes is defined as pair and regards Described 4th contrast eyes are defined as dominant eye by eye.

Alternatively, processor 801 is described based on described dominant eye and secondary regarding eye, in adjusting shown by mobile terminal screen During the display mode held, it is additionally operable to: regard eye based on described dominant eye and pair, determines that described dominant eye is focused on depending on eye with secondary respectively The first screen area and the second screen area；The display content of described first screen area is carried out Fuzzy processing；To institute The display content stating the second screen area carries out sharpening process.

Alternatively, processor 801 is naked eye three-dimensional screen and when playing video at the display screen of described mobile terminal, described Regard eye based on described dominant eye and pair, when adjusting the display mode of mobile terminal screen displayed content, be additionally operable to: by described First parallax barrier of mobile terminal blocks the image that dominant eye described in described naked eye three-dimensional screen receives；Described in occlusion removal naked Secondary the second parallax barrier regarding the image that eye receives described in the three-dimensional screen of eye.

Alternatively, processor 801 based on described eyes area image, determines that the master of described mobile phone users regards described After eye and pair regard eye, it is additionally operable to: point out described mobile phone users that depending on eye direction, described mobile terminal is rotated first to pair Adjust angle；Wherein, described first angle is adjusted more than predetermined angle threshold value.

Visible, in embodiments of the present invention, can receive and connect the first electric current that earphone on mobile terminals is sent Change information and the second curent change information；Based on described first curent change information and the second curent change information, regulation moves The broadcast state of target audio file in dynamic terminal.Such that it is able to avoid owing to frequently pressing key, reduce key and use The problem in life-span；Avoid, due to frequent operation button, reducing the service life of earphone cord；Avoid owing to frequently ear is extracted in insertion Machine, the problem reducing headset plug sensitivity.

Embodiment 11

Figure 12 shows the structural representation of the mobile terminal of the embodiment of the present invention nine.

The mobile terminal of the embodiment of the present invention can be mobile phone, panel computer, personal digital assistant (PersonalDigital Assistant, PDA) or vehicle-mounted computer etc..

Mobile terminal in Figure 12 includes radio frequency (RadioFrequency, RF) circuit 910, memorizer 920, input block 930, display unit 940, processor 960, voicefrequency circuit 970, WiFi (WirelessFidelity) module 980, power supply 990 and Taking pictures assembly 950, assembly 950 of taking pictures includes photographic head.

Wherein, input block 930 can be used for receiving numeral or the character information of user's input, and produces and mobile terminal The user setup of 900 and function control relevant signal input.Specifically, in the embodiment of the present invention, this input block 930 can To include contact panel 931.Contact panel 931, also referred to as touch screen, can collect user thereon or neighbouring touch operation (such as user uses any applicable object such as finger, stylus or adnexa operation on contact panel 931), and according in advance The formula set drives corresponding attachment means.Optionally, contact panel 931 can include touch detecting apparatus and touch controller Two parts.Wherein, the touch orientation of touch detecting apparatus detection user, and detect the signal that touch operation brings, by signal Send touch controller to；Touch controller receives touch information from touch detecting apparatus, and is converted into contact coordinate, Give this processor 960 again, and order that processor 960 sends can be received and performed.Furthermore, it is possible to employing resistance-type, The polytypes such as condenser type, infrared ray and surface acoustic wave realize contact panel 931.Except contact panel 931, input block 930 can also include other input equipments 932, and other input equipments 932 can include but not limited to physical keyboard, function key One or more in (such as volume control button, switch key etc.), trace ball, mouse, action bars etc..

Wherein, display unit 940 can be used for showing the information inputted by user or the information being supplied to user and movement The various menu interfaces of terminal 900.Display unit 940 can include display floater 941, optionally, can use LCD or organic The forms such as optical diode (OrganicLight-EmittingDiode, OLED) configure display floater 941.

It should be noted that contact panel 931 can cover display floater 941, formed and touch display screen, when this touch display screen is examined Measure thereon or after neighbouring touch operation, send processor 960 to determine the type of touch event, with preprocessor 960 provide corresponding visual output according to the type of touch event on touch display screen.

Touch display screen and include Application Program Interface viewing area and conventional control viewing area.This Application Program Interface viewing area And the arrangement mode of this conventional control viewing area does not limit, can be arranged above and below, left-right situs etc. can be distinguished two and show Show the arrangement mode in district.This Application Program Interface viewing area is displayed for the interface of application program.Each interface is permissible The interface elements such as the icon and/or the widget desktop control that comprise at least one application program.This Application Program Interface viewing area It can also be the empty interface not comprising any content.This conventional control viewing area is for showing the control that utilization rate is higher, such as, The application icons etc. such as settings button, interface numbering, scroll bar, phone directory icon.

Assembly 9110 of taking pictures may be used to receive the preview image of photographic head acquisition and show in mobile terminal display interface, And complete to take pictures or camera operation according to the operation of user.

Wherein processor 960 is the control centre of mobile terminal 900, utilizes various interface and the whole mobile phone of connection Various piece, is stored in the software program in first memory 921 and/or module by running or performing, and calls storage Data in second memory 922, perform the various functions of mobile terminal 900 and process data, thus to mobile terminal 900 Carry out integral monitoring.Optionally, processor 960 can include one or more processing unit.

In embodiments of the present invention, by call the software program and/or module stored in this first memory 921 and/ Or the data in this second memory 922, processor 960 is for obtaining the face of the mobile phone users of described camera collection Image；Extract the eyes area image in described facial image；Based on described eyes area image, determine described used for mobile terminal The dominant eye at family and pair regard eye；Based on described dominant eye and the secondary eye that regards, the display side of adjustment mobile terminal screen displayed content Formula.

Alternatively, processor 901 based on described eyes area image, determines that the master of described mobile phone users regards described Eye and pair regard at the moment, are additionally operable to: according to pupil of both eyes center in described eyes area image and two eye contour curves The distance of center, determines dominant eye and secondary regarding eye.

Alternatively, processor 901 described according to pupil of both eyes center in described eyes area image and each eyes The distance of contour curve center, determines dominant eye and secondary regards at the moment, being additionally operable to: choose in described eyes area image its In eyes, as with reference to eyes；Determine the described pupil position with reference to eyes；Determine that the described profile with reference to eyes is bent Line；Judge whether the described pupil position with reference to eyes is the described center with reference to eyes；If the described pupil with reference to eyes Hole site is the described center with reference to eyes, then be defined as dominant eye by described with reference to eyes, determined by another eyes Eye is regarded for pair.

Alternatively, described, processor 901 judges whether the described center with reference to the pupil of eyes is described reference After the center of the contour curve of eyes, it is additionally operable to: if the described pupil with reference to eyes is not in described reference eyes Heart position, then be defined as secondary regarding eye by described reference eyes, another eyes be defined as dominant eye.

Alternatively, processor 901 described according to pupil of both eyes center in described eyes area image and each eyes The distance of contour curve center, determines dominant eye and secondary regarding at the moment, is additionally operable to: according to user in described eyes area image The characteristic information of eyes, determines that the dominant eye of user and pair regard eye.

Alternatively, processor 901 according to the characteristic information of user's eyes in described eyes area image, determines use described The dominant eye at family and pair regard at the moment, are additionally operable to: the wherein eyes choosing in described eyes area image, as the first contrast Eyes；Choose the another eyes in described eyes area image, as the second contrast eyes；Obtain described first contrast eyes Contour curve；Add up the area that the contour curve of described first contrast eyes surrounds, obtain the first area；Obtain described second The contour curve of contrast eyes；Add up the area that the contour curve of described second contrast eyes surrounds, obtain second area；Relatively Described first area and the size of second area；If described first area is more than second area, then by described first contrast eyes It is defined as dominant eye, is secondary regarding eye by described second contrast eyes.

Alternatively, processor 901, after the size of described first area of described comparison and second area, is additionally operable to: if Described first area is less than second area, then be defined as by described first contrast eyes secondary regarding eye, by described second contrast eyes It is defined as dominant eye.

Alternatively, processor 901 according to the characteristic information of user's eyes in described eyes area image, determines use described The dominant eye at family and pair regard at the moment, are additionally operable to: the wherein eyes choosing in described eyes area image, as the 3rd contrast Eyes；Choose the another eyes in described eyes area image, as the 4th contrast eyes；Obtain described 3rd contrast eyes Muscular definition around；Determine the statistical distance between the proximal muscles lines around described 3rd contrast eyes, obtain first Statistical distance；Obtain the muscular definition around the 4th contrast eyes；Determine the 4th contrast eyes around proximal muscles lines it Between statistical distance, obtain the second statistical distance；Relatively described first statistical distance and the size of described second statistical distance；If Described first statistical distance is more than described second statistical distance, then the 3rd contrast eyes are defined as dominant eye, by the described 4th Contrast eyes are secondary regarding eye.

Alternatively, processor 901 described first statistical distance of described comparison and described second statistical distance size it After, it is additionally operable to: if described first statistical distance is less than described second statistical distance, then the 3rd contrast eyes is defined as pair and regards Described 4th contrast eyes are defined as dominant eye by eye.

Alternatively, processor 901 is described based on described dominant eye and secondary regarding eye, in adjusting shown by mobile terminal screen During the display mode held, it is additionally operable to: regard eye based on described dominant eye and pair, determines that described dominant eye is focused on depending on eye with secondary respectively The first screen area and the second screen area；The display content of described first screen area is carried out Fuzzy processing；To institute The display content stating the second screen area carries out sharpening process.

Alternatively, processor 901 is naked eye three-dimensional screen and when playing video at the display screen of described mobile terminal, described Regard eye based on described dominant eye and pair, when adjusting the display mode of mobile terminal screen displayed content, be additionally operable to: by described First parallax barrier of mobile terminal blocks the image that dominant eye described in described naked eye three-dimensional screen receives；Described in occlusion removal naked Secondary the second parallax barrier regarding the image that eye receives described in the three-dimensional screen of eye.

Alternatively, processor 901 based on described eyes area image, determines that the master of described mobile phone users regards described After eye and pair regard eye, it is additionally operable to: point out described mobile phone users that depending on eye direction, described mobile terminal is rotated first to pair Adjust angle；Wherein, described first angle is adjusted more than predetermined angle threshold value.

Visible, in embodiments of the present invention, the hidden bat pattern of mobile terminal camera can be triggered, by described photographic head Original preview image picture is processed as thumbnail image, and is shown by described thumbnail image in the display interface of described mobile terminal, with Time close the shooting miscellaneous function of described photographic head place mobile terminal, described shooting miscellaneous function includes flash lamp, shutter sound, And then receive the operational order that user inputs, and perform shooting operation according to operational order.Thus reduce user mobile in use Terminal carries out the shooting behavior that shooting etc. is not intended to be found and is identified as the probability of shooting uncivil behavior, and then can subtract The trouble caused because taking pictures of few user and loss.

For device embodiment, due to itself and embodiment of the method basic simlarity, so describe is fairly simple, relevant Part sees the part of embodiment of the method and illustrates.

Each embodiment in this specification all uses the mode gone forward one by one to describe, what each embodiment stressed is with The difference of other embodiments, between each embodiment, identical similar part sees mutually.

Algorithm and display are not intrinsic to any certain computer, virtual system or miscellaneous equipment relevant provided herein. Various general-purpose systems can also be used together with based on teaching in this.As described above, construct required by this kind of system Structure be apparent from.Additionally, the present invention is also not for any certain programmed language.It is understood that, it is possible to use various Programming language realizes the content of invention described herein, and the description done language-specific above is to disclose this Bright preferred forms.

In description mentioned herein, illustrate a large amount of detail.It is to be appreciated, however, that the enforcement of the present invention Example can be put into practice in the case of not having these details.In some instances, it is not shown specifically known method, structure And technology, in order to do not obscure the understanding of this description.

Similarly, it will be appreciated that one or more in order to simplify that the disclosure helping understands in each inventive aspect, exist Above in the description of the exemplary embodiment of the present invention, each feature of the present invention is grouped together into single enforcement sometimes In example, figure or descriptions thereof.But, the method for the disclosure should not be construed to reflect an intention that i.e. required guarantor The application claims feature more more than the feature being expressly recited in each claim protected.More precisely, as following Claims reflected as, inventive aspect is all features less than single embodiment disclosed above.Therefore, The claims following detailed description of the invention are thus expressly incorporated in this detailed description of the invention, the most each claim itself All as the independent embodiment of the present invention.

Those skilled in the art are appreciated that and can carry out the module in the equipment in embodiment adaptively Change and they are arranged in one or more equipment different from this embodiment.Can be the module in embodiment or list Unit or assembly are combined into a module or unit or assembly, and can put them in addition multiple submodule or subelement or Sub-component.In addition at least some in such feature and/or process or unit excludes each other, can use any Combine all features disclosed in this specification (including adjoint claim, summary and accompanying drawing) and so disclosed appoint Where method or all processes of equipment or unit are combined.Unless expressly stated otherwise, this specification (includes adjoint power Profit requires, summary and accompanying drawing) disclosed in each feature can be carried out generation by providing identical, equivalent or the alternative features of similar purpose Replace.

Although additionally, it will be appreciated by those of skill in the art that embodiments more described herein include other embodiments Some feature included by rather than further feature, but the combination of the feature of different embodiment means to be in the present invention's Within the scope of and form different embodiments.Such as, in the following claims, embodiment required for protection appoint One of meaning can mode use in any combination.

The all parts embodiment of the present invention can realize with hardware, or to run on one or more processor Software module realize, or with combinations thereof realize.It will be understood by those of skill in the art that and can use in practice Microprocessor or digital signal processor (DSP) realize according to embodiments of the present inventionShootingIn equipment some or complete The some or all functions of portion's parts.The present invention be also implemented as the part for performing method as described herein or Equipment that person is whole or device program (such as, computer program and computer program).Such realize the present invention's Program can store on a computer-readable medium, or can be to have the form of one or more signal.Such signal Can download from internet website and obtain, or provide on carrier signal, or provide with any other form.

The present invention will be described rather than limits the invention to it should be noted above-described embodiment, and ability Field technique personnel can design alternative embodiment without departing from the scope of the appended claims.In the claims, Any reference marks that should not will be located between bracket is configured to limitations on claims.Word " comprises " and does not excludes the presence of not Arrange element in the claims or step.Word "a" or "an" before being positioned at element does not excludes the presence of multiple such Element.The present invention and can come real by means of including the hardware of some different elements by means of properly programmed computer Existing.If in the unit claim listing equipment for drying, several in these devices can be by same hardware branch Specifically embody.Word first, second and third use do not indicate that any order.These word explanations can be run after fame Claim.

Those of ordinary skill in the art are it is to be appreciated that combine that the disclosed embodiments in the embodiment of the present invention describe is each The unit of example and algorithm steps, it is possible to being implemented in combination in of electronic hardware or computer software and electronic hardware.These Function performs with hardware or software mode actually, depends on application-specific and the design constraint of technical scheme.Specialty Technical staff specifically should can be used for using different methods to realize described function to each, but this realization should not Think beyond the scope of this invention.

Those skilled in the art is it can be understood that arrive, for convenience and simplicity of description, the system of foregoing description, The specific works process of device and unit, is referred to the corresponding process in preceding method embodiment, does not repeats them here.

In embodiment provided herein, it should be understood that disclosed apparatus and method, can be passed through other Mode realizes.Such as, device embodiment described above is only schematically, such as, the division of described unit, it is only A kind of logic function divides, actual can have when realizing other dividing mode, the most multiple unit or assembly can in conjunction with or Person is desirably integrated into another system, or some features can be ignored, or does not performs.Another point, shown or discussed is mutual Between coupling direct-coupling or communication connection can be the INDIRECT COUPLING by some interfaces, device or unit or communication link Connect, can be electrical, machinery or other form.

The described unit illustrated as separating component can be or may not be physically separate, shows as unit The parts shown can be or may not be physical location, i.e. may be located at a place, or can also be distributed to multiple On NE.Some or all of unit therein can be selected according to the actual needs to realize the mesh of the present embodiment scheme 's.

It addition, each functional unit in each embodiment of the present invention can be integrated in a processing unit, it is also possible to It is that unit is individually physically present, it is also possible to two or more unit are integrated in a unit.

If described function is using the form realization of SFU software functional unit and as independent production marketing or use, permissible It is stored in a computer read/write memory medium.Based on such understanding, technical scheme is the most in other words The part contributing prior art or the part of this technical scheme can embody with the form of software product, this meter Calculation machine software product is stored in a storage medium, including some instructions with so that a computer equipment (can be individual People's computer, server, or the network equipment etc.) perform all or part of step of method described in each embodiment of the present invention. And aforesaid storage medium includes: USB flash disk, portable hard drive, ROM, RAM, magnetic disc or CD etc. are various can store program code Medium.

The above, the only detailed description of the invention of the present invention, but protection scope of the present invention is not limited thereto, and any Those familiar with the art, in the technical scope that the invention discloses, can readily occur in change or replace, should contain Cover within protection scope of the present invention.Therefore, protection scope of the present invention should be as the criterion with scope of the claims.

Claims

1. an antidote for dominant eye, is applied to the mobile terminal with photographic head, it is characterised in that described method bag Include:

Extract the eyes area image in described facial image；

Method the most according to claim 1, it is characterised in that described based on described eyes area image, determines described shifting The dominant eye of dynamic terminal use and the secondary step regarding eye, including:

According to position in two eye contour curves, the pupil of both eyes position in described eyes area image, determine dominant eye and Secondary regarding eye.

Method the most according to claim 2, it is characterised in that described according to pupil of both eyes position in described eyes area image Put the position in two eye contour curves, determine dominant eye and the secondary step regarding eye, including:

Choose the wherein eyes in described eyes area image, as with reference to eyes；

Determine the described pupil position with reference to eyes；

Determine the described contour curve with reference to eyes；

Judge whether the described pupil position with reference to eyes is the described center with reference to eyes；

If the described pupil position with reference to eyes is the described center with reference to eyes, then it is defined as master by described with reference to eyes Depending on eye, another eyes are defined as secondary regarding eye.

Method the most according to claim 3, it is characterised in that described judge that whether the described pupil position with reference to eyes is After the step of the center of described reference eyes, described method also includes:

If the described pupil with reference to eyes is not in the described center with reference to eyes, then described reference eyes is defined as pair and regards Another eyes are defined as dominant eye by eye.

According to the characteristic information of user's eyes in described eyes area image, determine that the dominant eye of user and pair regard eye.

Method the most according to claim 5, it is characterised in that described according to user's eyes in described eyes area image Characteristic information, determines the dominant eye of user and the secondary step regarding eye, including:

Choose the wherein eyes in described eyes area image, as the first contrast eyes；

Choose the another eyes in described eyes area image, as the second contrast eyes；

Obtain the contour curve of described first contrast eyes；

Add up the area that the contour curve of described first contrast eyes surrounds, obtain the first area；

Obtain the contour curve of described second contrast eyes；

Add up the area that the contour curve of described second contrast eyes surrounds, obtain second area；

Relatively described first area and the size of second area；

If described first area is more than second area, then described first contrast eyes are defined as dominant eye, by described second right It is more secondary regarding eye than eyes are.

Method the most according to claim 6, it is characterised in that described first area of described comparison and the size of second area Step after, described method also includes:

If described first area is less than second area, then it is defined as described first contrast eyes secondary regarding eye, by described second right It is defined as dominant eye than eyes.

Choose the wherein eyes in described eyes area image, as the 3rd contrast eyes；

Choose the another eyes in described eyes area image, as the 4th contrast eyes；

Obtain the muscular definition around described 3rd contrast eyes；

Determine the statistical distance between the proximal muscles lines around described 3rd contrast eyes, obtain the first statistical distance；

Obtain the muscular definition around the 4th contrast eyes；

Determine the statistical distance between the proximal muscles lines around the 4th contrast eyes, obtain the second statistical distance；

Relatively described first statistical distance and the size of described second statistical distance；

If described first statistical distance is more than described second statistical distance, then the 3rd contrast eyes are defined as dominant eye, by institute State the 4th contrast eyes and regard eye for pair.

Method the most according to claim 8, it is characterised in that in described first statistical distance of described comparison and described second After the step of the size of statistical distance, also include:

If described first statistical distance is less than described second statistical distance, then the 3rd contrast eyes are defined as secondary regarding eye, by institute State the 4th contrast eyes and be defined as dominant eye.

Method the most according to claim 1, it is characterised in that described based on described dominant eye and secondary regarding eye, adjusts mobile The step of the display mode of terminal screen displayed content, including:

Based on described dominant eye with secondary regard eye, determine described dominant eye and secondary the first screen area focused on depending on eye and the respectively Two screen areas；

The display content of described first screen area is carried out Fuzzy processing；

The display content of described second screen area is carried out sharpening process.

11. methods according to claim 1, it is characterised in that when the display screen of described mobile terminal is naked eye three-dimensional screen And when playing video, described based on described dominant eye and secondary regarding eye, adjust the display side of mobile terminal screen displayed content The step of formula, including:

The image that dominant eye described in described naked eye three-dimensional screen receives is blocked by the first parallax barrier of described mobile terminal；

12. methods according to claim 1, it is characterised in that described based on described eyes area image, determine described shifting After the dominant eye of dynamic terminal use and the secondary step regarding eye, described method also includes:

Point out described mobile phone users that depending on eye direction, described mobile terminal is rotated the first adjustment angle to pair；

Wherein, described first angle is adjusted more than predetermined angle threshold value.

13. 1 kinds of mobile terminals, it is characterised in that described mobile terminal includes:

Major-minor determines module depending on eye, for based on described eyes area image, determine described mobile phone users dominant eye and Secondary regarding eye；

Screen adjusting module, for based on described dominant eye and the secondary eye that regards, the display of adjustment mobile terminal screen displayed content Mode.

14. mobile terminals according to claim 13, it is characterised in that depending on eye, described major-minor determines that module includes:

Pupil position determines submodule, is used for according to pupil of both eyes position in described eyes area image at two eye contour songs Position in line, determines dominant eye and secondary regarding eye.

15. mobile terminals according to claim 14, it is characterised in that described pupil position determines that submodule includes:

Unit is chosen, for choosing the wherein eyes in described eyes area image, as with reference to eyes with reference to eye；

Unit is determined, for determining the described pupil position with reference to eyes with reference to eye pupil hole site；

Unit is determined, for determining the described contour curve with reference to eyes with reference to eye contour curve；

Judging unit, for judging whether the described pupil position with reference to eyes is the described center with reference to eyes；

Dominant eye determines unit, if being the described center with reference to eyes for the described pupil position with reference to eyes, then will Described reference eyes are defined as dominant eye, are defined as by another eyes secondary regarding eye.

16. mobile terminals according to claim 15, it is characterised in that after described judging unit, described mobile terminal Also include:

Pair determines unit depending on eye, if for the described pupil with reference to eyes not in the described center with reference to eyes, then by institute State reference eyes and be defined as secondary regarding eye, another eyes are defined as dominant eye.

17. mobile terminals according to claim 13, it is characterised in that depending on eye, described major-minor determines that module includes:

Characteristic information judges submodule, for according to the characteristic information of user's eyes in described eyes area image, determines user Dominant eye and secondary regard eye.

18. mobile terminals according to claim 17, it is characterised in that described characteristic information judges that submodule includes:

First contrast eyes choose unit, for choosing the wherein eyes in described eyes area image, right as first Compare eyes；

Second contrast eyes choose unit, for choosing the another eyes in described eyes area image, as the second contrast Eyes；

First contrast eye contour curve acquisition unit, for obtaining the contour curve of described first contrast eyes；

First area statistics unit, for adding up the area that the contour curve of described first contrast eyes surrounds, obtains first Long-pending；

Second contrast eye contour curve acquisition unit, for obtaining the contour curve of described second contrast eyes；

Second area statistic unit, for adding up the area that the contour curve of described second contrast eyes surrounds, obtains second Long-pending；

Area comparison unit, for relatively described first area and the size of second area；

Dominant eye determines unit, if for described first area more than second area, is then defined as by described first contrast eyes Described second contrast eyes are secondary regarding eye by dominant eye.

19. mobile terminals according to claim 18, it is characterised in that after described Area comparison unit, described movement Terminal also includes:

Pair determines unit depending on eye, if for described first area less than second area, is then defined as by described first contrast eyes Secondary regarding eye, described second contrast eyes are defined as dominant eye.

20. mobile terminals according to claim 17, it is characterised in that described characteristic information judges that submodule includes:

3rd contrast eyes choose unit, for choosing the wherein eyes in described eyes area image, right as the 3rd Compare eyes；

4th contrast eyes choose unit, for choosing the another eyes in described eyes area image, as the 4th contrast Eyes；

3rd contrast muscles around eyes lines acquiring unit, for obtaining the muscular definition around described 3rd contrast eyes；

First statistical distance determines unit, for determining the statistics between the proximal muscles lines around described 3rd contrast eyes Distance, obtains the first statistical distance；

4th contrast muscles around eyes lines acquiring unit, for obtaining the muscular definition around the 4th contrast eyes；

Second statistical distance determines unit, for determine the 4th contrast eyes around proximal muscles lines between statistics away from From, obtain the second statistical distance；

Statistical distance comparing unit, for relatively described first statistical distance and the size of described second statistical distance；

Dominant eye determines unit, if for described first statistical distance more than described second statistical distance, then by the 3rd contrast eye Eyeball is defined as dominant eye, is secondary regarding eye by described 4th contrast eyes.

21. mobile terminals according to claim 20, it is characterised in that after described statistical distance comparing unit, also Including:

Pair determines unit depending on eye, if for described first statistical distance less than described second statistical distance, then by the 3rd contrast eye Eyeball is defined as secondary regarding eye, and described 4th contrast eyes are defined as dominant eye.

22. mobile terminals according to claim 13, it is characterised in that described screen adjusting module, including:

Screen area determines submodule, for regarding eye based on described dominant eye and pair, determines that described dominant eye regards eye with secondary respectively The first screen area focused on and the second screen area；

Fuzzy processing submodule, for carrying out Fuzzy processing to the display content of described first screen area；

Sharpening processes submodule, for the display content of described second screen area is carried out sharpening process.

23. mobile terminals according to claim 13, it is characterised in that when the display screen of described mobile terminal is bore hole three Dimension is shielded and when playing video, described screen adjusting module includes:

Parallax barrier blocks submodule, for being blocked in described naked eye three-dimensional screen by the first parallax barrier of described mobile terminal The image that described dominant eye receives；

Parallax barrier is blocked and is removed submodule, for the secondary image regarding eye reception described in naked eye three-dimensional screen described in occlusion removal Second parallax barrier.

24. mobile terminals according to claim 13, it is characterised in that after described major-minor determines module depending on eye, described Mobile terminal also includes:

Screen adjusts reminding module, is used for pointing out described mobile phone users to be rotated depending on eye direction to pair by described mobile terminal First adjusts angle；