CN106527693A

CN106527693A - Application control method and mobile terminal

Info

Publication number: CN106527693A
Application number: CN201610931807.6A
Authority: CN
Inventors: 袁文龙
Original assignee: Vivo Mobile Communication Co Ltd
Current assignee: Vivo Mobile Communication Co Ltd
Priority date: 2016-10-31
Filing date: 2016-10-31
Publication date: 2017-03-22

Abstract

The invention provides an application control method and a mobile terminal, and relates to the technical field of computers. The method comprises the steps of tracing the sight line of a mobile terminal user; obtaining position coordinates, in a display screen of the mobile terminal, of the sight line of the mobile terminal user; determining a target application object corresponding to the position coordinates; adjusting the target application object to be in a preset highlighted display mode; and displaying a control interface, wherein the control interface is used for receiving a control instruction used for the target application object and input by the mobile terminal user. The problem of influence on user operation due to zoom-out of the target application object caused by the fact that an existing large-screen mobile terminal is in a small-screen mode is solved. The user can conveniently control applications of the mobile terminal without zooming out the target application object through the sight line and single-hand operation.

Description

A kind of application control method and mobile terminal

Technical field

The present invention relates to communication technical field, more particularly to a kind of application control method and mobile terminal.

Background technology

With the progress of technology, mobile communication equipment is more and more flourishing, and the mobile terminal such as mobile phone becomes in human lives not The necessary that can or lack.By taking mobile phone as an example, it is born till now from mobile phone, mobile phone experienced to be changed many times, from the beginning of just Photos and sending messages can only be made a phone call to the mobile phone with broadcast music function, then integrate the big of online amusement video/audio function till now Screen mobile phone.

And, with the development of touch screen technology, present people increasingly tend to using Touch screen manipulate movement Application program in terminal, but as the screen of mobile terminal is increasing, people manipulate mobile terminal by one hand It is more and more inconvenient.The existing scheme smaller screen pattern for solving the above problems, i.e., in one-handed performance by display screen is suitably contracted It is little facilitating one-handed performance.

But for such scheme, while its shortcoming is to reduce display screen again, the target in display screen should Also can accordingly be reduced with program object, and between smaller screen and mobile terminal screen itself, also have dark border, be compared impact and use Family operates.

The content of the invention

The embodiment of the present invention provides a kind of application control method and mobile terminal, to solve existing large-size screen monitors movement eventually End smaller screen pattern causes destination application object to reduce, so as to affect the problem of user operation.

On the one hand, the invention provides a kind of application control method, including：

Follow the trail of the sight line of mobile phone users；

Obtain position coordinateses of the sight line of mobile phone users in the display screen of mobile terminal；

Determine the corresponding destination application object of the position coordinateses；

The destination application object is adjusted to into default and highlights mode；

Show an operation and control interface；

Wherein, the operation and control interface be used to receiving mobile phone users input for the destination application pair The manipulation instruction of elephant.

On the other hand, present invention also offers a kind of mobile terminal, including：

Eye-controlling focus module, for following the trail of the sight line of mobile phone users；

Eye position coordinate obtaining module, for obtaining the sight line of mobile phone users in the display screen of mobile terminal Position coordinateses；

Destination object determining module, for determining the corresponding destination application object of the position coordinateses；

Display mode adjusting module, highlights mode for the destination application object is adjusted to default；

Operation and control interface display module, for showing an operation and control interface；

So, in the embodiment of the present invention, by the sight line for following the trail of mobile phone users；Obtain the sight line of mobile phone users Position coordinateses in the display screen of mobile terminal；Determine the corresponding destination application object of the position coordinateses；Will be described Destination application object is adjusted to default and highlights mode；Show an operation and control interface；Wherein, the operation and control interface is used to connect Receive the manipulation instruction for the destination application object of the mobile phone users input.So as to facilitate user by regarding Line and one-handed performance control the application program of mobile terminal.

Described above is only the general introduction of technical solution of the present invention, in order to better understand the technological means of the present invention, And can be practiced according to the content of description, and in order to allow the above and other objects of the present invention, feature and advantage can Become apparent, below especially exemplified by the specific embodiment of the present invention.

Description of the drawings

In order to be illustrated more clearly that the technical scheme of the embodiment of the present invention, below by institute in the description to the embodiment of the present invention The accompanying drawing that needs are used is briefly described, it should be apparent that, drawings in the following description are only some enforcements of the present invention Example, for those of ordinary skill in the art, without having to pay creative labor, can be with according to these accompanying drawings Obtain other accompanying drawings.

Fig. 1 is a kind of flow chart of the application control method in the embodiment of the present invention one；

The schematic diagram in a kind of singlehanded controllable region in Figure 1A embodiment of the present invention one；

It is a kind of when the sight line of user falls into mobile terminal display screen destination application in Figure 1B embodiment of the present invention one When in object, the schematic diagram of corresponding operation and control interface is shown；

Fig. 2 is a kind of flow chart of the application control method in the embodiment of the present invention two；

Fig. 3 is a kind of structural representation of the mobile terminal in the embodiment of the present invention three；

Fig. 3 A are the structural representations of a kind of preferred mobile terminal in the embodiment of the present invention three；

Fig. 3 B are a kind of structural representations of the operation and control interface display module in the embodiment of the present invention three；

Fig. 3 C are the structural representations that a kind of target area in the embodiment of the present invention three confirms submodule；

Fig. 3 D are a kind of structural representations of the display mode adjusting module in the embodiment of the present invention three；

Fig. 3 E are a kind of structural representations of the eye position coordinate obtaining module in the embodiment of the present invention three；

Fig. 4 is a kind of structural representation of the mobile terminal in the embodiment of the present invention four；

Fig. 5 is a kind of block diagram of the mobile terminal in the embodiment of the present invention five.

Specific embodiment

Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete Site preparation is described, it is clear that described embodiment is a part of embodiment of the invention, rather than the embodiment of whole.Based on this Embodiment in bright, the every other enforcement obtained under the premise of creative work is not made by those of ordinary skill in the art Example, belongs to the scope of protection of the invention.

A kind of application control method that the present invention is provided is discussed in detail below by several specific embodiments are enumerated And mobile terminal.

Embodiment one

A kind of application control method provided in an embodiment of the present invention is discussed in detail.

With reference to Fig. 1, a kind of flow chart of application control method in the embodiment of the present invention is shown.

Step 101, follows the trail of the sight line of mobile phone users.

Eye Tracking Technique is to obtain user currently " direction of gaze " using the various detection meanss such as machinery, electronics, optics Technology, its can by the use of user eyeball rotate when some constant eye structures of relative position and feature as reference, in place Put the sight line that user is extracted between variation characteristic and these invariant features.The detection method for constituting according to system and adopting can be thick Two kinds of intrusive mood and non-intrusion type are divided into slightly. as digitizing technique, computer vision, the rapid of artificial intelligence technology are sent out Exhibition, becomes current hotspot based on the non-intrusion type Eye Tracking Technique of digital video analysis (Video Oculographic, VOG) Research direction. visual line characteristics parameter extraction is divided into based on the Eye Tracking Technique of VOG and sight line estimates that model sets up two compositions Part.As system hardware and sight line estimate that model is different, following several classes can be divided into based on the Eye-controlling focus method of VOG：

(1) pupil-corneal reflection method (the pupil center cornea reflection technique, PCCR)：Corneal reflex is produced using infrared light supply, sight line is estimated by calculating the vector between pupil center and corneal reflex Direction.Sight line estimates that model can adopt mapping model (usually nonlinear polynomial model), it would however also be possible to employ geometric model.

(2) corneal reflex matrix method (cross-ratios method)：Many infrared light supplies produce multiple corneas on cornea Reflect to form corneal reflex matrix.By the position feature estimation direction of visual lines for calculating corneal reflex and pupil center, sight line is estimated Meter model is using constant double ratio (cross-ratios) value of projection plane.

(3) elliptically symmetric response medium direction method (" one-circle " algorithm)：By recording high-resolution eye image, meter The normal direction for calculating iris boundary circle estimates direction of visual lines.High-resolution eye image is followed the trail of under visible light and by basic Perspective geometry relation calculate the normal direction of oval iris circle and regard it as direction of visual lines.

In embodiments of the present invention, it is possible to use follow the trail of the sight line of user including above-mentioned any methods availalbe, and Position coordinateses of the sight line of user in mobile terminal display screen are obtained, this embodiment of the present invention is not limited.

Step 102, obtains position coordinateses of the sight line of mobile phone users in the display screen of mobile terminal.

For example, the facial image comprising eyes can be taken first with the front-facing camera of mobile terminal, what is shot Face is identified by face recognition algorithms in facial image, and eyes position is recognized in face；And then estimate eye Eyeball pupil position and the pupil center of circle；Iris boundary is determined by the pupil center of circle again, it is true according to iris boundary and human eye feature Determine the normal direction of sight line；It is last that mobile terminal display screen is projected to by normal direction so that it is determined that the sight line of user is mobile whole Coordinate position in the display screen of end.

It should be noted that in embodiments of the present invention, can only follow the trail of the sight line of any one eye of user, and obtain Position coordinateses of the sight line of one eye in mobile terminal display screen；The sight line of user two eyes is followed the trail of simultaneously can also, Using the sight line of two eyes mobile terminal display screen intersection point as the user sight line it is final in mobile terminal display screen In position coordinateses, this embodiment of the present invention is not limited.Wherein, the sight line of two eyes of user is followed the trail of relative to tracking The sight line of one eye of user is more accurate.

Step 103, determines the corresponding destination application object of the position coordinateses.

In actual applications, various destination application objects, Yong Huke can be shown in the display screen of mobile terminal To trigger the corresponding application program of startup by clicking on or touching destination application object etc. mode.And starting the application After program, the mode such as again may be by touching or click on and control in the application program display screen is operated accordingly.Its In, destination application object can be illustrated in any position in dynamic terminal display screen, and the application program after starting is aobvious Display screen can also be completely covered mobile terminal display screen.So, user is selecting a certain application program, or in application program Display screen in when being operated, it may be necessary to touch any region of mobile terminal display screen.But it is larger for display screen Mobile terminal, if user controls mobile terminal by one-handed performance, now it is difficult to by one-handed performance touch it is mobile eventually The Zone Full at end.And it is this difficult as the increase of mobile terminal display screen size is constantly to strengthen.As shown in Figure 1A For typically with larger display screen mobile terminal, if the user while mobile terminal is held in the lower right corner of mobile terminal, then use The schematic diagram of the singlehanded controllable scope in family and the not singlehanded controllable scope of user.Wherein, nicking region 1 is that user is singlehanded not Controllable scope, is the singlehanded controllable scope of user without fringe area 2.

Therefore, in embodiments of the present invention, user controls whole applications of mobile terminal by one-handed performance for convenience According to position coordinateses of the sight line of mobile phone users in the display screen of mobile terminal are obtained, program, can determine that position is sat Mark corresponding destination application object.Destination application object therein can be destination application object, it is also possible to For application program control etc., this embodiment of the present invention is not limited.

The destination application object is adjusted to default and highlights mode by step 104.

In embodiments of the present invention, if position coordinateses of the sight line of user in display screen are located at the target in display screen When in application object, show that user currently wants to select the destination application object.So user is directly perceived for convenience Understand whether which selectes its own desired destination application object, the destination application object selected can be adjusted to It is default to highlight mode.Wherein, presetting prominent mode can according to demand before this step, or before this step Set before either step.For example, can be answered with arranging the default mode that highlights by the target that regulation sight line is watched attentively With the background color of program object, or adjust sight line it is watched attentively to destination application object in font color, or tune Section sight line it is watched attentively to the size of destination application object etc., or sight line it is watched attentively to destination application Object exhibit high brilliance frame etc., is not limited to this embodiment of the present invention.So user is it is known that now operate Position whether be the position oneself wanted.

For example, when mobile phone users use large-screen mobile phone with the right hand, now need to start certain answering by the upper left corner When using program object, sharp right-handed one-handed performance cannot be realized, then now user can watch this application object attentively, User can be detected through above-mentioned Eye-controlling focus and be just look at this application icon object, then regulation that will be appropriate should The background color of application object adjusts application tile font color etc., and user may know that and currently chosen this Application object, then mobile phone users i.e. can by should application program operation and control interface input journey is applied to this The operational order of sequence, improves user experience.

Step 105, shows an operation and control interface.

In embodiments of the present invention, user controls whole application programs of mobile terminal by one-handed performance for convenience, The destination application object in display screen can be located in the position coordinateses when the sight line of user in mobile terminal display screen When middle, the one hand of display screen can show in touch area to should destination application object operation and control interface, behaviour therein Control interface can be used for the manipulation instruction for the application program of receiving user's input, such as enabled instruction, out code, open Instruction of next level application program etc. is moved, this embodiment of the present invention is not limited.Wherein, operation and control interface can also have Part can not manipulate region positioned at one hand, partly positioned at singlehanded controllable region, then now user can be by can in one hand Manipulation instruction of the operation and control interface input pin in manipulation region to the application program, is not limited to this embodiment of the present invention. In addition, singlehanded controllable region is to use mobile terminal holding mode relevant relative to mobile phone users, for example, if mobile Terminal use grips mobile terminal by the right hand, then now singlehanded controllable region on the right side of mobile terminal, and if move Dynamic terminal use passes through left-handed mobile terminal, then now singlehanded controllable region is on the left of mobile terminal.At this In bright embodiment, can pre-set according to different holding modes, the display location of operation and control interface, to this embodiment of the present invention not It is limited.

If Figure 1B is a kind of when the sight line of user is fallen in mobile terminal display screen destination application object, phase is shown Answer the schematic diagram of operation and control interface.Rectangular box therein is destination application object, and arc square frame 3 is operation and control interface.At this In inventive embodiments, concrete shape and size of operation and control interface etc. parameter can default settings according to demand, to this Inventive embodiments are not limited.

Wherein, the corresponding operational order of various operations of the arbitrary application program of correspondence can before this step, or Set before either step before this step according to demand, this embodiment of the present invention is not limited.For example, for A certain music application program, when may be set in the sight line for determining user in the icon of the music application program, If user clicks on its corresponding operation and control interface, you can to start the music application program, then in the aobvious of mobile terminal The homepage of the music application program is shown in display screen, then user can also be set stroke pair is touched in operation and control interface Touches of the Ying Yu in the display screen of mobile terminal is slided, and user understands active user in time by manipulating boundary for convenience The position of the mobile terminal display screen that face correspondence is touched, can be in the display screen of mobile terminal by modes such as cursor, arrows The position of the current touch-control of mark user, is not limited to this embodiment of the present invention.

Furthermore it is also possible to click operation and control interface be set to start corresponding application program, double-click manipulation in Preset Time To close corresponding application program, it is to start under the application program that continuous touching operation and control interface reaches the first Preset Time at interface The first subapplication of one-level, it is the next stage for starting the application program that continuous touching operation and control interface reaches the second Preset Time Two subapplications, etc., are not limited to this embodiment of the present invention.

It should be noted that in embodiments of the present invention, if control icons are shown in mobile terminal display screen, and use Position coordinateses of the sight line at family in display screen are in the control icons, then can also generate pin in singlehanded controllable region Operation and control interface to the control icons, then user can manipulate the corresponding control of the control icons by operation and control interface.And such as Fruit mobile terminal has been turned on a certain application program, and a certain page of the application program having been turned on is shown in mobile terminal display screen, The operation and control interface for the application program is shown in addition in display screen.In embodiments of the present invention, user is led to for convenience Operation and control interface input instruction is crossed, the superiors of the operation and control interface all the time in mobile terminal display screen are set.Now still can be after It is continuous that Eye-controlling focus are carried out to user, when arbitrary icon in the position coordinateses current display page of the sight line of user, then can lead to Control instruction of the operation and control interface input pin to the icon is crossed, this embodiment of the present invention is not limited.

For example, it is assumed that the coordinate position of the sight line of user is in the camera icon of mobile terminal display screen, then then can be with The operation and control interface for camera can be shown in touch area in the one hand of mobile terminal.Further, if user is by manipulation Interface input enabled instruction starts camera, and the startup page of camera is now shown in the display screen of mobile terminal, while manipulating boundary Face can be displayed on the startup page of camera.If that now the coordinate position of the sight line of user is moved to the startup page Shoot control, then now user for example be able to can be led to by operational order of the operation and control interface input pin to the shooting control Cross click operation and control interface input photographing instruction etc..

In addition, in embodiments of the present invention, if the coordinate position of the sight line of user can be set from an intended application Program object A is switched in another destination application object B, then will can also show in display screen should for target Switched to corresponding to destination application object B with the operation and control interface of program object A；Or user is set in closing application journey Its corresponding operation and control interface can be correspondingly simultaneously closed off during sequence A, and the position coordinateses for working as the sight line of user are again positioned at target and answer During with program object A, then can again in display screen show for application program A operation and control interface.And, in order to avoid User is easily made user show successively and is fallen in multiple destination application objects in mobile sight line, and part mesh therein Mark application object user need not simultaneously select, then if can set within Preset Time, the user's for tracking Sight line is all located in same destination application object, then show that now user needs to select the destination application object, this When operation and control interface for the application program can be shown in the display screen of mobile terminal.

And, in embodiments of the present invention, step 105 simultaneously can be performed with step 104, it is also possible to step 105 it Front execution, is not limited to this embodiment of the present invention.

The application control method of the embodiment of the present invention, by the sight line for following the trail of mobile phone users；Obtain mobile whole Position coordinateses of the sight line of end subscriber in the display screen of mobile terminal；Determine the corresponding destination application of the position coordinateses Object；The destination application object is adjusted to into default and highlights mode；Show an operation and control interface；Wherein, the behaviour Control interface is used for the manipulation instruction for the destination application object for receiving the mobile phone users input.So as to can To facilitate user that the application program of mobile terminal is controlled by sight line and one-handed performance.

Embodiment two

With reference to Fig. 2, a kind of flow chart of application control method in the embodiment of the present invention is shown.

Step 201, gathers at least one sight line information.

In embodiments of the present invention, in order to filter out invalid or unrelated sight line information, can first gather at least one and regard Line information.Specifically, it is possible to use front-facing camera shoots the picture for including eyes pattern, and extracts from the picture of collection Sight line information.Sight line information can certainly be gathered using any other available mode, to this embodiment of the present invention not in addition Limit.

Step 202, by each corresponding eyeprint of sight line information and the eye for prestoring at least one sight line information Stricture of vagina is compared.

Eyeprint in the embodiment of the present invention can be understood as iris, and iris is a part for eye structure, and iris center has One circular open, referred to as pupil, just as the aperture of adjusting in the middle of camera, include pigment and determine eye color.The mankind The iris of eyes, as finger stricture of vagina, is unique.Therefore authentication can be carried out using iris.In present invention enforcement In example, the iris of mobile terminal corresponding secured user can be entered into into mobile terminal in advance, the eyeprint for as prestoring, Eyeprint can certainly be stored to network storage spaces such as cloud servers, when needing to carry out authentication, can in advance It is local that the eyeprint for first storing is downloaded to mobile terminal from cloud server, it is also possible to first obtains the iris of active user, then will The iris is uploaded to cloud server and is verified, this embodiment of the present invention is not limited.

Sight line information corresponding with the eyeprint of the eyeprint matching for prestoring is defined as mobile phone users by step 203 Sight line information.

If the corresponding eyeprint of a certain sight line information is matched with the eyeprint for prestoring, can by with prestore The corresponding sight line information of eyeprint of eyeprint matching is defined as the sight line information of mobile phone users, and continues executing with follow-up behaviour Make.And if the corresponding eyeprint of sight line information is mismatched with the eyeprint for prestoring, then show that the sight line information is not mobile whole The sight line information of end subscriber, now can directly filter out the sight line information.In embodiments of the present invention, if can also set The corresponding eyeprint of whole sight line information is mismatched with the eyeprint for prestoring, then suspending carries out Eye-controlling focus, if follow-up need Continue to start Eye-controlling focus, then user can be input into Eye-controlling focus enabled instruction by predetermined manner, to control mobile terminal Proceed Eye-controlling focus.Predetermined manner therein can be preset according to demand, and this embodiment of the present invention is not added with To limit.

Step 204, follows the trail of the sight line of mobile phone users.

Step 205, obtains position coordinateses of the sight line of mobile phone users in the display screen of mobile terminal.

Preferably, in embodiments of the present invention, step 205 can specifically include：

(1) control the facial image that the front-facing camera gathers the mobile phone users.

In embodiments of the present invention, it is possible to use aforesaid elliptically symmetric response medium direction method carries out Eye-controlling focus.First can be with profit The face pattern of mobile phone users is gathered with the front-facing camera of mobile terminal.Wherein, face pattern can also be not comprising complete The face pattern in portion, and include people's eye pattern.And according to the setting of user can only eyes comprising user, or Person is two eyes that must include user.And, collect face pattern and the form storage such as can cache, it is also possible to direct guarantor Deposit local etc. to mobile terminal, this embodiment of the present invention is not limited.In embodiments of the present invention, in order to entering in real time Row Eye-controlling focus, can pre-set a prefixed time interval before this step, every prefixed time interval then using shifting The front-facing camera of dynamic terminal gathers the face pattern of mobile phone users, and this embodiment of the present invention is not limited.

(2) determine the pupil center of circle of the eyes of mobile phone users in the facial image.

After face pattern is got, then the pupil circle of the eyes of mobile phone users in facial image is can confirm that The heart.Face recognition algorithms can be specifically utilized, or according to any methods availalbe of face feature, etc. in face pattern The pupil center of circle of positioning eyes, is not limited to this embodiment of the present invention.

(3) based on the pupil center of circle, determine iris boundary.

After the pupil center of circle is determined, you can based on the pupil center of circle, to determine iris boundary.In embodiments of the present invention, Iris boundary can be determined using any methods availalbe, this embodiment of the present invention is not limited.

(4) based on the iris boundary, determine the normal of sight line.

After iris boundary is determined, you can based on iris boundary, to determine the normal of sight line.In the embodiment of the present invention In, it is possible to use any methods availalbe determines the normal of sight line, and this embodiment of the present invention is not limited.

(5) normal is projected to the position on mobile terminal display screen and is defined as the sight line in the aobvious of mobile terminal Position coordinateses in display screen.

The method that conventional Visual Trace Technology is all based on Computer Vision at present, ultimate principle is first with shooting Machine obtains eye image, and then eye position exactly in positioning and tracing figure picture, estimates finally according to Planar Mapping technology Go out user and watch position attentively on screen.Its core is how to be accurately positioned out pupil center, the direct shadow of order of accuarcy of positioning Ring the precision to eye tracking.

The algorithm of Pupil diameter is many at present, such as circumference difference algorithm, radial symmetric algorithm, Hough transform fitting circle Algorithm, gray-level projection algorithm etc..These algorithms are mostly only for the undeformed situation of pupil, once there is deformation in pupil Just become no longer to be suitable for.Although gray-level projection algorithm is not limited by pupil shape, its positioning precision is too low, and easily receives To the impact of illumination, therefore the required precision of eye tracking can not be met.Positioning for deforming pupil, it is possible to use Hough The algorithm of conversion fitted ellipse is positioning pupil, but as oval parameter has 5, parameter space is excessively huge, therefore is fitted Efficiency is very low, can not meet requirement of real time.The ellipse fitting method of method of least square, as pupil holds in edge detection process It is vulnerable to the impact of noise spot, is fitted ellipse out and often there is compared with legitimate reading relatively large deviation.

Based on the Pupil diameter algorithm of 5 points of stochastical sampling concordance (RANSAC_5) thought, the algorithm first by On pupil edge, 5 points of stochastical sampling calculate corresponding elliptic parameter, then calculate the corresponding consistent collection of this parameter space. If the scale of consistent collection is less than certain threshold value, 5 points of resampling to be proceeded as described above and meet the one of condition until finding Till causing collection, final oval positioning is completed finally by concordance is gone.The algorithm substantially increases the fitting speed of ellipse, but Due to remain a need for every time sample 5 points, cause invalid sampling is readily incorporated in the image for disturbing so that amount of calculation and Memory requirements increases, and also can result in algorithm failure is positioned in the case of acceptable time or internal memory are occupied.

For the deficiency of above-mentioned algorithm, the shade of gray directional characteristic of pupil edge pixel is may be incorporated into, it is proposed that Based on 3 points of stochastical sampling concordance Pupil diameter algorithm (RANSAC_3), (include theirs using 2 points that stochastical sampling is arrived Gradient direction) and search obtain the 3rd point determining elliptic parameter, finally carry out consistent collection using method of least square and process. The algorithm effectively can reduce sampling the probability of noise spot, simultaneously effective solve the problems, such as invalid sampling and error accumulation, from And improve the efficiency and precision for realizing following the trail of.

In embodiments of the present invention, can set according to demand carries out eye pupil calmly using any one above-mentioned algorithm Position, then estimates user based on Planar Mapping technology again and watches position attentively on screen, to this embodiment of the present invention not in addition Limit.

Step 206, determines the corresponding destination application object of the position coordinateses.

Step 207, if the destination application object is destination application icon, by the destination application Icon is adjusted to default iconic format.

In actual applications, the destination application object of mobile terminal can be destination application icon, apply journey Control in sequence interface etc..So, in embodiments of the present invention, it is for different types of destination application object, prominent The mode of display can be with otherwise varied.

If destination application object is destination application icon, destination application icon can be adjusted to pre- If iconic format.Wherein, default iconic format can be target setting application program image target shape or size, color, Etc., specifically before this step, or can be set before the either step before this step according to demand, to this The embodiment of the present invention is not limited.

Step 208, if the destination application object is the control in Application Program Interface, adjusts the control Font in background to pre-set color or the adjustment control is to pre-set color.

And if destination application object is the control in Application Program Interface, the background of control can be adjusted to default Font in color or adjustment control is to pre-set color.Pre-set color therein can according to demand before this step, or Person be this step before either step before set according to demand, this embodiment of the present invention is not limited.

Step 209, obtains the number information of the touch point on the first side and second side of the mobile terminal.

In embodiments of the present invention, in order to confirm the hand-held of mobile terminal, the first of mobile terminal can first be obtained The number information of the touch point on side and second side.In actual applications, if the holding mode of mobile terminal is left hand Grip, then the keep left touch point quantity of side of mobile terminal can be significantly more than the touch point quantity of right edge, and if mobile The holding mode of terminal be the right hand grip, then mobile terminal keep left side touch point quantity can be considerably less than right edge touch Control point quantity.In embodiments of the present invention, the display screen of mobile terminal can be divided into into according to left and right orientation according to demand One side and second side, for example, be divided into two regions of identical or so by mobile terminal display screen, and set left side area Domain is first side, and right side area is first side.The subregion conduct in mobile terminal display screen can certainly only be taken First side and second side, are not limited to this embodiment of the present invention.In known first side and the situation of second side Under, the number information of the touch point on the first side and second side of mobile terminal can be obtained.

Step 210, based on the number information of the first side and the touch point on second side, determines mobile terminal Holding mode.

After the number information of the touch point on first side and second side is obtained, you can with based on first side and The number information of the touch point on second side, determines the holding mode of mobile terminal.For example, above-mentioned first side is movement The left field of terminal display screen, right side area of the second side for mobile terminal display screen, then if on first side Number of the number of touch point more than the touch point on second side, then illustrate that now mobile terminal is left-handed, and if The number of the individual touch point less than on second side of the touch point on first side, then illustrate that now mobile terminal is held for the right hand Hold.

Step 211, based on the holding mode, determines operation and control interface mesh to be shown described in the display screen of mobile terminal Mark region.

It has been observed that need for operation and control interface to be shown in the current singlehanded controllable region of mobile phone users, and holding mode Difference, singlehanded controllable region are also different.So in embodiments of the present invention, holding mode can be based on, determines mobile terminal Display screen in operation and control interface target area to be shown.

Preferably, in embodiments of the present invention, the step 211 can further include：

If the holding mode is left-handed mode, by display screen apart from the of mobile phone users left hand thumb The region of one preset range is defined as the target area.If the holding mode is right hand holding mode, by display screen The region of the second preset range from mobile phone users hand thumb be defined as the target area.

In embodiments of the present invention, if the holding mode is left-handed mode, by distance movement in display screen eventually The region of the first preset range of end subscriber left hand thumb is defined as target area.First preset range therein can be in this step Before rapid, or set before the either step before this step according to demand, to this embodiment of the present invention not in addition Limit.Certainly, in embodiments of the present invention, it is also possible to by first preset range in display screen apart from the mobile terminal lower left corner Region is defined as the target area, and this embodiment of the present invention is not limited.

In embodiments of the present invention, if the holding mode is right hand holding mode, by distance movement in display screen eventually The region of the second preset range of end subscriber hand thumb is defined as target area.Second preset range therein can be in this step Before rapid, or set before the either step before this step according to demand, to this embodiment of the present invention not in addition Limit.Certainly, in embodiments of the present invention, it is also possible to by second preset range in display screen apart from the mobile terminal lower right corner Region is defined as the target area, and this embodiment of the present invention is not limited.

Step 212, shows the operation and control interface in the target area；Wherein, the operation and control interface is used to receive described The manipulation instruction for the destination application object of mobile phone users input.

Step 213, detects touch control operation of the mobile phone users in the operation and control interface.

When user selectes a certain destination application object by sight line, and the user is when passing through iris verification, then can be with Various instructions are input into by the touch control operation in operation and control interface.Accordingly, it would be desirable to detect mobile phone users in operation and control interface Touch control operation.

Step 214, when touch control operation is detected, performs and the touch control operation pair to the destination application object The manipulation instruction answered.

In embodiments of the present invention, the different manipulation instruction of different touch control operation correspondences can be set, then work as detection During to touch control operation, then manipulation instruction corresponding with the touch control operation for detecting can be performed to destination application object.

For example, when mobile terminal receives the user by grasping the touch control operation corresponding with enabled instruction of interface input When, then can control mobile terminal and start the corresponding application program of destination application object.Wherein, enabled instruction is corresponding Touch control operation before this step, or can be set before the either step before this step according to demand, to this The embodiment of the present invention is not limited.For example, can be set by clicking operation and control interface input enabled instruction etc..

Alternatively, in embodiments of the present invention, after step 212, can also include：Detect the mobile phone users Change in location information of the sight line in the display screen of mobile terminal.According to the change in location information, manipulation circle is adjusted Position of the face in the display screen.

Destination application object being have selected according to sight line, and show correspondence destination application pair in target area After the operation and control interface of elephant, then can continue to detect that position of the sight line of mobile phone users in the display screen of mobile terminal becomes Change information.Any available means can be specifically utilized to detect the sight line of mobile phone users in the display screen of mobile terminal Change in location information, is not limited to this embodiment of the present invention.

At this point it is possible to the change in location information and manipulation by the sight line of mobile phone users in the display screen of mobile terminal Corresponding relation is set up in position of the interface in the display screen, and according to change in location information, adjusts corresponding operation and control interface Position in display screen.Specifically, the corresponding ratio of change in location information and operation and control interface between the position in display screen Relation before this step, or can be set before the either step before this step according to demand, and this is sent out Bright embodiment is not limited.

In embodiments of the present invention, user's one-handed performance for convenience, real-time detection can also be moved at a time interval The incline direction of dynamic terminal, and then display location of the operation and control interface in display screen is adjusted according to the incline direction of mobile terminal.

In embodiments of the present invention, it is possible to use the detection movement of the equipment such as gyroscope, gravity sensor, acceleration transducer The incline direction of terminal, is not limited to this embodiment of the present invention.In embodiments of the present invention, incline to detect mobile terminal The equipment of ramp-like state can be integrated with mobile terminal, it is also possible to independently of mobile terminal and by the mode such as wired or wireless with Mobile terminal sets up connection, and this embodiment of the present invention is not also limited.For example, inclined using gyroscope detection mobile terminal The concrete mode in direction can be arrange gyroscope default gravity direction relative to gyroscope be it is fixed, and, work as movement When terminal is in poised state, default gravity direction is identical with the earth's core gravity direction, when mobile terminal run-off the straight, gyroscope Also can corresponding run-off the straight therewith, then now gyroscope can detect default gravity direction relative to the earth's core gravity direction Direction of rotation, if default gravity direction turns clockwise relative to the earth's core gravity direction, shows that mobile terminal is tilted to the right, and If relative to the earth's core gravity direction rotate counterclockwise, default gravity direction shows that mobile terminal is tilted to the left.In practical application In, user normally using mobile terminal during, need to ensure the face-up of mobile terminal, therefore mobile terminal incline Rake angle will be generally less than 90 degree.Therefore, in embodiments of the present invention, mobile terminal is tilted to the right and can be understood as mobile terminal Incline to the right side of user；Mobile terminal is tilted to the left and can be understood as left side of the mobile terminal to user.

In embodiments of the present invention, the incline direction that other any available means detect mobile terminal is possible with certainly, This embodiment of the present invention is not limited.

In embodiments of the present invention, it is tilted to the right if mobile terminal can be arranged, controls the operation and control interface to the right It is mobile, and if mobile terminal is tilted to the left, then controlling the operation and control interface is moved to the left, naturally it is also possible to conversely, to this Inventive embodiments are not limited.

The specific rules that control operation and control interface is moved left and right can also be set, for example, operation and control interface at the uniform velocity left and right can be set It is mobile, then when mobile terminal is tilted to the right, then control operation and control interface and at the uniform velocity move to the right the right edge until operation and control interface Boundary overlaps with the right side boundary of mobile terminal display screen or mobile terminal is no longer tilted to the right；When mobile terminal is tilted to the left When, then control operation and control interface and at the uniform velocity moved until the left border of the left border and mobile terminal display screen of operation and control interface to the right Overlap or mobile terminal is no longer tilted to the left.Certainly, in embodiments of the present invention, it is left that operation and control interface speed change can also be set Move right etc., specific rule can default settings according to demand, this embodiment of the present invention is not limited.

Alternatively, in embodiments of the present invention, after step 212, also include：Receive the mobile phone users input The size adjusting of the operation and control interface is instructed.Instruct according to the size adjusting, adjust the size of the operation and control interface.

In embodiments of the present invention, user is input into various instructions by operation interface for convenience, meets user individual Demand, user can adjust the size of operation and control interface according to demand.Specifically, user can be set and is appointed by touching operation interface One drift angle is slided to zoom in or out to operation and control interface to inside or outside operation and control interface after reaching the first Preset Time again, Can be set by touching inside operation interface after the second Preset Time, using at least two fingers inside the operation and control interface to Touching outside operation and control interface slip is slided or touch towards inside touch interface to zoom in or out to operation and control interface Deng not being limited to this embodiment of the present invention.In embodiments of the present invention, user distinguishes the operation of active user for convenience Be whether input size adjusting instruction, can be to reach the first Preset Time in the arbitrary drift angle of user's touching operation interface after, Or inside touching operation interface after the second Preset Time, the mode such as adjustment operation and control interface border color points out user currently may be used To adjust the size of operation and control interface, this embodiment of the present invention is not limited.

It has been observed that when user is instructed according to predetermined manner input size adjusting, then can adjust according to size adjusting instruction The size of whole operation and control interface.Wherein, mobile terminal display screen can not possibly be exceeded to the size adjusting of operation and control interface.

The application control method of the embodiment of the present invention, by the sight line for following the trail of mobile phone users；Obtain mobile whole Position coordinateses of the sight line of end subscriber in the display screen of mobile terminal；Determine the corresponding destination application of the position coordinateses Object；The destination application object is adjusted to into default and highlights mode；Show an operation and control interface；Wherein, the behaviour Control interface is used for the manipulation instruction for the destination application object for receiving the mobile phone users input.So as to can To facilitate user that the application program of mobile terminal is controlled by sight line and one-handed performance.And, in embodiments of the present invention, also Iris verification can be carried out to user, so as to improve safety.In addition, in embodiments of the present invention, can be according to mobile whole The holding mode at end determines the target area at user's display and operation interface, so as to improve the accurate of operation and control interface exhibition method Property.Further, in embodiments of the present invention, user can also adjust the size of operation and control interface, and according to mobile terminal Incline direction adjusts the position of operation and control interface, such that it is able to further improve the experience of user.

Embodiment three

A kind of mobile terminal provided in an embodiment of the present invention is discussed in detail.

With reference to Fig. 3, a kind of structural representation of mobile terminal in the embodiment of the present invention is shown, mobile terminal 300 can be real A kind of details of the application control method in existing the above embodiments one to embodiment two, and reach identical effect.

The mobile terminal 300 of the embodiment of the present invention includes：Eye-controlling focus module 301, eye position coordinate obtaining module 302nd, destination object determining module 303, display mode adjusting module 304, operation and control interface display module 305.

The interactive relation between the function and each module of each module is discussed in detail separately below.

Eye-controlling focus module 301, for following the trail of the sight line of mobile phone users.

Eye position coordinate obtaining module 302, for obtaining the display screen of the sight line in mobile terminal of mobile phone users In position coordinateses.

Destination object determining module 303, for determining the corresponding destination application object of the position coordinateses.

Display mode adjusting module 304, highlights mode for the destination application object is adjusted to default.

Operation and control interface display module 305, for showing an operation and control interface；Wherein, the operation and control interface is used to receive described The manipulation instruction for the destination application object of mobile phone users input.

Reference picture 3A, on the basis of Fig. 3, in another embodiment of the embodiment of the present invention, mobile terminal.Also include：

Sight line information acquisition module 306, for gathering at least one sight line information.

Eyeprint comparing module 307, at least one sight line obtained by the sight line information acquisition module is believed In breath, each corresponding eyeprint of sight line information is compared with the eyeprint for prestoring.

Sight line validation of information module 308, for being obtained by the eyeprint comparing module and the eyeprint for prestoring The corresponding sight line information of eyeprint matched somebody with somebody is defined as the sight line information of mobile phone users.

Touch control operation detection module 309, for detecting touch control operation of the mobile phone users in the operation and control interface.

Manipulation instruction performing module 310, for when touch control operation is detected, performing to the destination application object Manipulation instruction corresponding with the touch control operation.

Sight line change detection module 311, for detecting the display screen of the sight line in mobile terminal of the mobile phone users In change in location information.

Operation and control interface position adjusting type modules 312, for the position that basis is obtained by the sight line change detection module Change information, adjusts position of the operation and control interface in the display screen.

Size adjusting command reception module 313, for receive mobile phone users input to the operation and control interface Size adjusting instruction.

Size adjustment module 314, for according to the size adjusting obtained by the size adjusting command reception module Instruction, adjusts the size of the operation and control interface.

Preferably, reference picture 3B, in another embodiment of the embodiment of the present invention, above-mentioned operation and control interface display module 305, Including：

Touch point number acquisition of information submodule 3051, for obtaining the first side and second side of the mobile terminal On touch point number information.

Holding mode confirms submodule 3052, for based on the institute obtained by the touch point number acquisition of information submodule The number information of the touch point on first side and second side is stated, the holding mode of mobile terminal is determined.

Target area confirms submodule 3053, for based on the gripping determined by holding mode confirmation submodule Mode, determines operation and control interface target area to be shown described in the display screen of mobile terminal.

Operation and control interface display sub-module 3054, in the target area determined by target area confirmation submodule Domain shows the operation and control interface.

Preferably, reference picture 3C, in another embodiment of the embodiment of the present invention, above-mentioned target area confirms submodule 3053, including：

First object region confirmation unit 30531, if being left-handed mode for the holding mode, by display screen The region of middle the first preset range apart from mobile phone users left hand thumb is defined as the target area.

Second target area confirmation unit 30532, if being right hand holding mode for the holding mode, by display screen In the region of the second preset range from mobile phone users hand thumb be defined as the target area.

Preferably, reference picture 3D, in another embodiment of the embodiment of the present invention, above-mentioned display mode adjusting module 304, Including：

First display mode adjusts submodule 3041, if being destination application figure for the destination application object Mark, then adjust the destination application icon to default iconic format.

Second display mode adjusts submodule 3042, if in being Application Program Interface for the destination application object Control, then adjust the background of the control to pre-set color or adjust font on the control to pre-set color.

Preferably, reference picture 3E, in another embodiment of the embodiment of the present invention, above-mentioned eye position coordinate obtaining module 302, including：

Man face image acquiring submodule 3021, gathers the people of the mobile phone users for controlling the front-facing camera Face image.

Pupil center of circle determination sub-module 3022, for determining the face obtained by the man face image acquiring submodule The pupil center of circle of the eyes of mobile phone users in image.

Iris boundary determination sub-module 3023, for based on the pupil obtained by pupil center of circle determination sub-module The center of circle, determines iris boundary.

Normal determination sub-module 3024, for based on the iris side obtained by the iris boundary determination sub-module Boundary, determines the normal of sight line.

Eye position coordinate acquisition submodule 3025, for being thrown described by the normal that the normal determination sub-module is obtained Shadow is defined as position coordinateses of the sight line in the display screen of mobile terminal to the position on mobile terminal display screen.

The mobile terminal of the embodiment of the present invention, follows the trail of the sight line of mobile phone users by above-mentioned module；Obtain mobile whole Position coordinateses of the sight line of end subscriber in the display screen of mobile terminal；Determine the corresponding destination application of the position coordinateses Object；The destination application object is adjusted to into default and highlights mode；Show an operation and control interface；Wherein, the behaviour Control interface is used for the manipulation instruction for the destination application object for receiving the mobile phone users input.So as to can To facilitate user that the application program of mobile terminal is controlled by sight line and one-handed performance.And, in embodiments of the present invention, also Iris verification can be carried out to user, so as to improve safety.In addition, in embodiments of the present invention, can be according to mobile whole The holding mode at end determines the target area at user's display and operation interface, so as to improve the accurate of operation and control interface exhibition method Property.Further, in embodiments of the present invention, user can also adjust the size of operation and control interface, and according to mobile terminal Incline direction adjusts the position of operation and control interface, such that it is able to further improve the experience of user.

Example IV

With reference to Fig. 4, a kind of block diagram of mobile terminal in the embodiment of the present invention is shown.

Mobile terminal 400 shown in Fig. 4 includes：At least one processor 401, memorizer 402, at least one network interface 404th, user interface 403 and front-facing camera 406.Each component in mobile terminal 400 is coupling in one by bus system 405 Rise.It is understood that bus system 405 is used to realize the connection communication between these components.Bus system 405 is removed includes data/address bus Outside, also including power bus, controlling bus and status signal bus in addition.But for the sake of for clear explanation, in the diagram will be various Bus is all designated as bus system 405.

Wherein, user interface 403 can include display, keyboard or pointing device (for example, mouse, trace ball (trackball), touch-sensitive plate or touch screen etc..

It is appreciated that the memorizer 402 in the embodiment of the present invention can be volatile memory or nonvolatile memory, Or may include both volatibility and nonvolatile memory.Wherein, nonvolatile memory can be read only memory (Read- Only Memory, ROM), programmable read only memory (Programmable ROM, PROM), the read-only storage of erasable programmable Device (Erasable PROM, EPROM), Electrically Erasable Read Only Memory (Electrically EPROM, EEPROM) or Flash memory.Volatile memory can be random access memory (Random Access Memory, RAM), and which is used as outside height Speed caching.By exemplary but be not restricted explanation, the RAM of many forms can use, such as static RAM (Static RAM, SRAM), dynamic random access memory (Dynamic RAM, DRAM), Synchronous Dynamic Random Access Memory (Synchronous DRAM, SDRAM), double data speed synchronous dynamic RAM (Double Data Rate SDRAM, DDRSDRAM), enhancement mode Synchronous Dynamic Random Access Memory (Enhanced SDRAM, ESDRAM), synchronized links Dynamic random access memory (Synchlink DRAM, SLDRAM) and direct rambus random access memory (Direct Rambus RAM, DRRAM).The embodiment of the present invention description system and method memorizer 402 be intended to including but not limited to these With the memorizer of any other suitable type.

In some embodiments, memorizer 402 stores following element, can perform module or data structure, or Person their subset, or their superset：Operating system 4021 and application program 4022.

Wherein, operating system 4021, comprising various system programs, such as ccf layer, core library layer, driving layer etc., are used for Realize various basic businesses and process hardware based task.Application program 4022, comprising various application programs, such as media Player (Media Player), browser (Browser) etc., for realizing various applied business.Realize the embodiment of the present invention The program of method is may be embodied in application program 4022.

In embodiments of the present invention, by call memorizer 402 storage program or instruction, specifically, can be application The program stored in program 4022 or instruction, processor 401 are used for the sight line for following the trail of mobile phone users；Obtain mobile terminal to use Position coordinateses of the sight line at family in the display screen of mobile terminal；Determine the corresponding destination application pair of the position coordinateses As；The destination application object is adjusted to into default and highlights mode；Show an operation and control interface；Wherein, the manipulation Interface is used for the manipulation instruction for the destination application object for receiving the mobile phone users input.

The method that the embodiments of the present invention are disclosed is can apply in processor 401, or is realized by processor 401. A kind of possibly IC chip of processor 401, the disposal ability with signal.During realization, said method it is each Step can be completed by the instruction of the integrated logic circuit of the hardware in processor 401 or software form.Above-mentioned process Device 401 can be general processor, digital signal processor (Digital Signal Processor, DSP), special integrated electricity Road (Application Specific Integrated Circuit, ASIC), ready-made programmable gate array (Field Programmable Gate Array, FPGA) or other PLDs, discrete gate or transistor logic, Discrete hardware components.Can realize or perform disclosed each method in the embodiment of the present invention, step and logic diagram.It is general Processor can be microprocessor or the processor can also be any conventional processor etc..With reference to embodiment of the present invention institute The step of disclosed method, can be embodied directly in hardware decoding processor and perform and complete, or with the hardware in decoding processor And software module combination execution is completed.Software module may be located at random access memory, and flash memory, read only memory may be programmed read-only In the ripe storage medium in this area such as memorizer or electrically erasable programmable memory, depositor.The storage medium is located at Memorizer 402, processor 401 read the information in memorizer 402, the step of complete said method with reference to its hardware.

It is understood that the embodiment of the present invention description these embodiments can with hardware, software, firmware, middleware, Microcode or its combination are realizing.For hardware is realized, processing unit can be realized in one or more special ICs (Application Specific Integrated Circuits, ASIC), digital signal processor (Digital Signal Processing, DSP), digital signal processing appts (DSP Device, DSPD), programmable logic device (Programmable Logic Device, PLD), field programmable gate array (Field-Programmable Gate Array, FPGA), general place In reason device, controller, microcontroller, microprocessor, other electronic units for performing herein described function or its combination.

For software realize, can pass through perform the embodiment of the present invention described in function module (such as process, function etc.) come Realize the technology described in the embodiment of the present invention.During software code is storable in memorizer and by computing device.Memorizer can To realize within a processor or outside the processor.

Alternatively, as another embodiment, processor 401 is additionally operable to：Gather at least one sight line information；By described in extremely In few sight line information, each corresponding eyeprint of sight line information is compared with the eyeprint for prestoring；By with prestore The corresponding sight line information of eyeprint of eyeprint matching is defined as the sight line information of mobile phone users.

Alternatively, as another embodiment, processor 401 is additionally operable to：Obtain the mobile terminal first side and The number information of the touch point on second side；Based on the number information of the first side and the touch point on second side, Determine the holding mode of mobile terminal；Based on the holding mode, determine that operation and control interface is treated described in the display screen of mobile terminal The target area of display；The operation and control interface is shown in the target area.

Alternatively, processor 401 is additionally operable to：If the holding mode is left-handed mode, by distance in display screen The region of the first preset range of mobile phone users left hand thumb is defined as the target area；If the holding mode is the right side Handss holding mode, then be defined as the region of the second preset range from mobile phone users hand thumb in display screen described Target area.

Alternatively, processor 401 is additionally operable to：Detection touch control operation of the mobile phone users in the operation and control interface；When When detecting touch control operation, manipulation instruction corresponding with the touch control operation is performed to the destination application object.

Alternatively, processor 401 is additionally operable to：If the destination application object is destination application icon, will The destination application icon is adjusted to default iconic format；If the destination application object is Application Program Interface In control, then adjust the background of the control to pre-set color or adjust font on the control to pre-set color.

Alternatively, processor 401 is additionally operable to：Detect the sight line of the mobile phone users in the display screen of mobile terminal Change in location information；According to the change in location information, position of the operation and control interface in the display screen is adjusted.

Alternatively, processor 401 is additionally operable to：Receive the size to the operation and control interface of the mobile phone users input Adjust instruction；Instruct according to the size adjusting, adjust the size of the operation and control interface.

Alternatively, processor 401 is additionally operable to：Control the face figure that the front-facing camera gathers the mobile phone users Picture；Determine the pupil center of circle of the eyes of mobile phone users in the facial image；Based on the pupil center of circle, iris side is determined Boundary；Based on the iris boundary, the normal of sight line is determined；The position normal projected on mobile terminal display screen determines For position coordinateses of the sight line in the display screen of mobile terminal.

Mobile terminal 400 can realize each process of mobile terminal realization in previous embodiment, to avoid repeating, here Repeat no more.

Embodiment five

Fig. 5 is the structural representation of the mobile terminal of another embodiment of the present invention.Specifically, the mobile terminal in Fig. 5 Can be mobile phone, panel computer, personal digital assistant (Personal Digital Assistant, PDA), or vehicle-mounted computer Deng.

Mobile terminal in Fig. 5 includes radio frequency (Radio Frequency, RF) circuit 510, memorizer 520, input block 530th, display unit 540, processor 560, voicefrequency circuit 570, WiFi (Wireless Fidelity) module 580, power supply 590 With front-facing camera 550.

Wherein, input block 530 can be used for the numeral or character information of receiving user's input, and produce and mobile terminal User arrange and the relevant signal input of function control.Specifically, in the embodiment of the present invention, the input block 530 can be with Including contact panel 531.Contact panel 531, also referred to as touch screen, can collect user thereon or neighbouring touch operation (ratio Such as user is using the operation of any suitable object or adnexa on contact panel 531 such as finger, stylus), and according to setting in advance Fixed formula drives corresponding attachment means.Optionally, contact panel 531 may include touch detecting apparatus and touch controller two Individual part.Wherein, the touch orientation of touch detecting apparatus detection user, and the signal that touch operation brings is detected, signal is passed Give touch controller；Touch controller receives touch information from touch detecting apparatus, and is converted into contact coordinate, then Give the processor 560, and the order sent of receiving processor 560 can be performed.Furthermore, it is possible to adopt resistance-type, electricity The polytypes such as appearance formula, infrared ray and surface acoustic wave realize contact panel 531.Except contact panel 531, input block 530 Other input equipments 532 can also be included, other input equipments 532 can include but is not limited to physical keyboard, function key (such as Volume control button, switch key etc.), trace ball, mouse, one or more in action bars etc..

Wherein, display unit 540 can be used for display by the information of user input or be supplied to information and the movement of user The various menu interfaces of terminal.Display unit 540 may include display floater 541, optionally, can adopt LCD or organic light emission The forms such as diode (Organic Light-Emitting Diode, OLED) are configuring display floater 541.

It should be noted that contact panel 531 can cover display floater 541, touch display screen is formed, when the touch display screen is examined Measure thereon or after neighbouring touch operation, processor 560 is sent to determine the type of touch event, with preprocessor 560 provide corresponding visual output in touch display screen according to the type of touch event.

Touch display screen includes Application Program Interface viewing area and conventional control viewing area.The Application Program Interface viewing area And the arrangement mode of the conventional control viewing area is not limited, can be arranged above and below, left-right situs etc. can be distinguished two and show Show the arrangement mode in area.The Application Program Interface viewing area is displayed for the interface of application program.Each interface can be with The interface element such as the icon comprising at least one application program and/or widget desktop controls.The Application Program Interface viewing area It can also be the empty interface not comprising any content.The conventional control viewing area be used for show the higher control of utilization rate, for example, Destination application objects such as settings button, interface numbering, scroll bar, phone directory icon etc..

Wherein, processor 560 is the control centre of mobile terminal, using each of various interfaces and connection whole mobile phone Individual part, is stored in software program and/or module in first memory 521 by running or performing, and calls and be stored in Data in second memory 522, perform the various functions and processing data of mobile terminal, so as to carry out entirety to mobile terminal Monitoring.Optionally, processor 560 may include one or more processing units.

In embodiments of the present invention, by call store the first memory 521 in software program and/or module and/ Or the data in the second memory 522, processor 560 is used to follow the trail of the sight line of mobile phone users；Obtain mobile terminal to use Position coordinateses of the sight line at family in the display screen of mobile terminal；Determine the corresponding destination application pair of the position coordinateses As；The destination application object is adjusted to into default and highlights mode；Show an operation and control interface；Wherein, the manipulation Interface is used for the manipulation instruction for the destination application object for receiving the mobile phone users input.

Alternatively, as another embodiment, processor 560 is additionally operable to：Gather at least one sight line information；By described in extremely In few sight line information, each corresponding eyeprint of sight line information is compared with the eyeprint for prestoring；By with prestore The corresponding sight line information of eyeprint of eyeprint matching is defined as the sight line information of mobile phone users.

Alternatively, as another embodiment, processor 560 is additionally operable to：Obtain the mobile terminal first side and The number information of the touch point on second side；Based on the number information of the first side and the touch point on second side, Determine the holding mode of mobile terminal；Based on the holding mode, determine that operation and control interface is treated described in the display screen of mobile terminal The target area of display；The operation and control interface is shown in the target area.

Alternatively, processor 560 is additionally operable to：If the holding mode is left-handed mode, by distance in display screen The region of the first preset range of mobile phone users left hand thumb is defined as the target area；If the holding mode is the right side Handss holding mode, then be defined as the region of the second preset range from mobile phone users hand thumb in display screen described Target area.

Alternatively, processor 560 is additionally operable to：Detection touch control operation of the mobile phone users in the operation and control interface；When When detecting touch control operation, manipulation instruction corresponding with the touch control operation is performed to the destination application object.

Alternatively, processor 560 is additionally operable to：If the destination application object is destination application icon, will The destination application icon is adjusted to default iconic format；If the destination application object is Application Program Interface In control, then adjust the background of the control to pre-set color or adjust font on the control to pre-set color.

Alternatively, processor 560 is additionally operable to：Detect the sight line of the mobile phone users in the display screen of mobile terminal Change in location information；According to the change in location information, position of the operation and control interface in the display screen is adjusted.

Alternatively, processor 560 is additionally operable to：Receive the size to the operation and control interface of the mobile phone users input Adjust instruction；Instruct according to the size adjusting, adjust the size of the operation and control interface.

Alternatively, processor 560 is additionally operable to：Control the face figure that the front-facing camera gathers the mobile phone users Picture；Determine the pupil center of circle of the eyes of mobile phone users in the facial image；Based on the pupil center of circle, iris side is determined Boundary；Based on the iris boundary, the normal of sight line is determined；The position normal projected on mobile terminal display screen determines For position coordinateses of the sight line in the display screen of mobile terminal.

It can be seen that, the mobile terminal of the embodiment of the present invention follows the trail of the sight line of mobile phone users by above-mentioned module；Obtain and move Position coordinateses of the sight line of dynamic terminal use in the display screen of mobile terminal；Determine the corresponding intended application of the position coordinateses Program object；The destination application object is adjusted to into default and highlights mode；Show an operation and control interface；Wherein, institute Operation and control interface is stated for receiving the manipulation instruction for the destination application object of the mobile phone users input.From And can facilitate user that the application program of mobile terminal is controlled by sight line and one-handed performance.And, in the embodiment of the present invention In, iris verification can also be carried out to user, so as to improve safety.In addition, in embodiments of the present invention, can be according to shifting The holding mode of dynamic terminal determines the target area at user's display and operation interface, so as to improve the standard of operation and control interface exhibition method True property.Further, in embodiments of the present invention, user can also adjust the size of operation and control interface, and according to mobile terminal Incline direction adjust operation and control interface position, such that it is able to further improve the experience of user.

Those of ordinary skill in the art it is to be appreciated that with reference to disclosed in the embodiment of the present invention embodiment description it is each The unit and algorithm steps of example, being capable of being implemented in combination in electronic hardware or computer software and electronic hardware.These Function actually with hardware or software mode performing, depending on the application-specific and design constraint of technical scheme.Specialty Technical staff can use different methods to realize described function to each specific application, but this realization should not Think beyond the scope of this invention.

Those skilled in the art can be understood that, for convenience and simplicity of description, the system of foregoing description, The specific work process of device and unit, may be referred to the corresponding process in preceding method embodiment, will not be described here.

In embodiment provided herein, it should be understood that disclosed apparatus and method, can pass through other Mode is realized.For example, device embodiment described above is only schematic, and for example, the division of the unit is only A kind of division of logic function, can have when actually realizing other dividing mode, such as multiple units or component can with reference to or Person is desirably integrated into another system, or some features can be ignored, or does not perform.Another, shown or discussed is mutual Between coupling or direct-coupling or communication connection can be INDIRECT COUPLING or communication link by some interfaces, device or unit Connect, can be electrical, mechanical or other forms.

The unit as separating component explanation can be or may not be it is physically separate, it is aobvious as unit The part for showing can be or may not be physical location, you can local to be located at one, or can also be distributed to multiple On NE.Some or all of unit therein can be selected according to the actual needs to realize the mesh of this embodiment scheme 's.

In addition, each functional unit in each embodiment of the invention can be integrated in a processing unit, it is also possible to It is that unit is individually physically present, it is also possible to which two or more units are integrated in a unit.

If the function is realized using in the form of SFU software functional unit and as independent production marketing or when using, can be with It is stored in a computer read/write memory medium.Based on such understanding, technical scheme is substantially in other words The part contributed to prior art or the part of the technical scheme can be embodied in the form of software product, the meter Calculation machine software product is stored in a storage medium, is used including some instructions so that a computer equipment (can be individual People's computer, server, or network equipment etc.) perform all or part of step of each embodiment methods described of the invention. And aforesaid storage medium includes：USB flash disk, portable hard drive, ROM, RAM, magnetic disc or CD etc. are various can be with store program codes Medium.

The above, the only specific embodiment of the present invention, but protection scope of the present invention is not limited thereto, any Those familiar with the art the invention discloses technical scope in, change or replacement can be readily occurred in, should all be contained Cover within protection scope of the present invention.Therefore, protection scope of the present invention should be defined by scope of the claims.

Claims

1. a kind of application control method, is applied to include the mobile terminal of front-facing camera, it is characterised in that methods described Including：

Follow the trail of the sight line of mobile phone users；

Show an operation and control interface；

Wherein, the operation and control interface be used to receiving mobile phone users input for the destination application object Manipulation instruction.

2. method according to claim 1, it is characterised in that the step of the sight line of the tracking mobile phone users it Before, methods described also includes：

Gather at least one sight line information；

Each corresponding eyeprint of sight line information at least one sight line information is compared with the eyeprint for prestoring；

Sight line information corresponding with the eyeprint of the eyeprint matching for prestoring is defined as into the sight line information of mobile phone users.

3. method according to claim 1, it is characterised in that the step of one operation and control interface of display, including：

Obtain the number information of the touch point on the first side and second side of the mobile terminal；

Based on the number information of the first side and the touch point on second side, the holding mode of mobile terminal is determined；

Based on the holding mode, operation and control interface target area to be shown described in the display screen of mobile terminal is determined；

The operation and control interface is shown in the target area.

4. method according to claim 3, it is characterised in that described based on the holding mode, determines mobile terminal The step of target area to be shown of operation and control interface described in display screen, including：

If the holding mode is left-handed mode, by display screen apart from the first pre- of mobile phone users left hand thumb If the region of scope is defined as the target area；

If the holding mode is right hand holding mode, by display screen from the second pre- of mobile phone users hand thumb If the region of scope is defined as the target area.

5. method according to claim 1, it is characterised in that after the step of one operation and control interface of display, the side Method also includes：

Detection touch control operation of the mobile phone users in the operation and control interface；

When touch control operation is detected, manipulation corresponding with the touch control operation is performed to the destination application object and is referred to Order.

6. method according to claim 1, it is characterised in that described that the destination application object is adjusted to into default The step of highlighting mode, including：

If the destination application object is destination application icon, the destination application icon is adjusted to pre- If iconic format；

If the destination application object is the control in Application Program Interface, the background of the control is adjusted to default face Font on color or the adjustment control is to pre-set color.

7. method according to claim 1, it is characterised in that after the step of one operation and control interface of display, the side Method also includes：

Detect change in location information of the sight line of the mobile phone users in the display screen of mobile terminal；

According to the change in location information, position of the operation and control interface in the display screen is adjusted.

8. method according to claim 1, it is characterised in that after the step of one operation and control interface of display, the side Method also includes：

The size adjusting to the operation and control interface for receiving the mobile phone users input is instructed；

Instruct according to the size adjusting, adjust the size of the operation and control interface.

9. method according to claim 1, it is characterised in that the sight line of the acquisition mobile phone users is in mobile terminal Display screen in position coordinateses the step of, including：

Control the facial image that the front-facing camera gathers the mobile phone users；

Determine the pupil center of circle of the eyes of mobile phone users in the facial image；

Based on the pupil center of circle, iris boundary is determined；

Based on the iris boundary, the normal of sight line is determined；

The normal is projected to the position on mobile terminal display screen and is defined as the sight line in the display screen of mobile terminal Position coordinateses.

10. a kind of mobile terminal, including front-facing camera, it is characterised in that the mobile terminal also includes：

Eye position coordinate obtaining module, for obtaining position of the sight line of mobile phone users in the display screen of mobile terminal Coordinate；

11. mobile terminals according to claim 10, it is characterised in that also include：

Sight line information acquisition module, for gathering at least one sight line information；

Eyeprint comparing module, at least one sight line information that will be obtained by the sight line information acquisition module each The corresponding eyeprint of sight line information is compared with the eyeprint for prestoring；

Sight line validation of information module, for the eyeprint matched with the eyeprint for prestoring that will be obtained by the eyeprint comparing module Corresponding sight line information is defined as the sight line information of mobile phone users.

12. mobile terminals according to claim 10, it is characterised in that the operation and control interface display module, including：

Touch point number acquisition of information submodule, for obtaining the touch-control on the first side and second side of the mobile terminal The number information of point；

Holding mode confirms submodule, for based on first side obtained by the touch point number acquisition of information submodule The number information of the touch point on side and second side, determines the holding mode of mobile terminal；

Target area confirms submodule, for confirming the holding mode that determines of submodule based on by the holding mode, really Determine operation and control interface target area to be shown described in the display screen of mobile terminal；

Operation and control interface display sub-module, for confirming that the target area that submodule determines shows institute by the target area State operation and control interface.

13. mobile terminals according to claim 12, it is characterised in that the target area confirms submodule, including：

First object region confirmation unit, if being left-handed mode for the holding mode, distance in display screen is moved The region of the first preset range of dynamic terminal use's left hand thumb is defined as the target area；

Second target area confirmation unit, if for the holding mode be right hand holding mode, by display screen from shifting The region of the second preset range of dynamic terminal use's hand thumb is defined as the target area.

14. mobile terminals according to claim 10, it is characterised in that also include：

Touch control operation detection module, for detecting touch control operation of the mobile phone users in the operation and control interface；

Manipulation instruction performing module, for when touch control operation is detected, the destination application object is performed with it is described The corresponding manipulation instruction of touch control operation.

15. mobile terminals according to claim 10, it is characterised in that the display mode adjusting module, including：

First display mode adjusts submodule, if being destination application icon for the destination application object, will The destination application icon is adjusted to default iconic format；

Second display mode adjusts submodule, if being the control in Application Program Interface for the destination application object, Font in the background to pre-set color or the adjustment control of the control is adjusted then to pre-set color.

16. mobile terminals according to claim 10, it is characterised in that also include：

Sight line change detection module, for detecting position of the sight line of the mobile phone users in the display screen of mobile terminal Change information；

Operation and control interface position adjusting type modules, for the change in location letter that basis is obtained by the sight line change detection module Breath, adjusts position of the operation and control interface in the display screen.

17. mobile terminals according to claim 10, it is characterised in that also include：

Size adjusting command reception module, the size to the operation and control interface for receiving the mobile phone users input are adjusted Whole instruction；

Size adjustment module, for according to the size adjusting instruction obtained by the size adjusting command reception module, adjusting The size of the whole operation and control interface.

18. mobile terminals according to claim 10, it is characterised in that the eye position coordinate obtaining module, including：

Man face image acquiring submodule, gathers the facial image of the mobile phone users for controlling the front-facing camera；

Pupil center of circle determination sub-module, moves for determining in the facial image obtained by the man face image acquiring submodule The pupil center of circle of the eyes of dynamic terminal use；

Iris boundary determination sub-module, for based on the pupil center of circle obtained by pupil center of circle determination sub-module, really Determine iris boundary；

Normal determination sub-module, for based on the iris boundary obtained by the iris boundary determination sub-module, it is determined that regarding The normal of line；

Eye position coordinate acquisition submodule, for the normal obtained by the normal determination sub-module is projected to movement Position on terminal display screen is defined as position coordinateses of the sight line in the display screen of mobile terminal.