CN103581423A - Method and device for turning over screen and mobile terminal - Google Patents

Method and device for turning over screen and mobile terminal Download PDF

Info

Publication number
CN103581423A
CN103581423A CN201210282293.8A CN201210282293A CN103581423A CN 103581423 A CN103581423 A CN 103581423A CN 201210282293 A CN201210282293 A CN 201210282293A CN 103581423 A CN103581423 A CN 103581423A
Authority
CN
China
Prior art keywords
axis
screen
angle
mobile terminal
default
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201210282293.8A
Other languages
Chinese (zh)
Inventor
于福根
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
ZTE Corp
Original Assignee
ZTE Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ZTE Corp filed Critical ZTE Corp
Priority to CN201210282293.8A priority Critical patent/CN103581423A/en
Priority to PCT/CN2013/079741 priority patent/WO2013178151A1/en
Publication of CN103581423A publication Critical patent/CN103581423A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/0304Detection arrangements using opto-electronic means
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/002Specific input/output arrangements not covered by G06F3/01 - G06F3/16
    • G06F3/005Input arrangements through a video camera
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2200/00Indexing scheme relating to G06F1/04 - G06F1/32
    • G06F2200/16Indexing scheme relating to G06F1/16 - G06F1/18
    • G06F2200/161Indexing scheme relating to constructional details of the monitor
    • G06F2200/1614Image rotation following screen orientation, e.g. switching from landscape to portrait mode

Abstract

The invention discloses a method and device for turning over a screen and a mobile terminal. The method comprises the steps of collecting the first preset axis of a human face image, determining the included angle between the first preset axis and the second preset axis of a plane where the screen of the mobile terminal is located, judging the angle threshold value of the included angle capable of triggering the mobile terminal to rotate and triggering the screen of the mobile terminal to rotate. Through the method and device for turning over the screen and the mobile terminal, the user experience of screen turnover of a user is improved.

Description

Screen turning shifting method and device, mobile terminal
Technical field
The present invention relates to the communications field, in particular to a kind of screen turning shifting method and device, mobile terminal.
Background technology
At present, mobile terminal, such as smart mobile phone, panel computer etc., has generally all installed gravity sensing device or system, use gravity sensing device or system not only can realize the game of gravity sensing class, make end-user experience to can enjoy happy that game brings without finger manipulation; The more important thing is and use gravity sensing device or system no matter can guarantee how rotating mobile fuselage of user, it is consistent with vertical direction that the screen display of mobile phone display screen remains, increased to a certain extent user's experience.
But in the use procedure of mobile terminal, using gravity sensing to realize screen rotation has certain limitation, cause screen to realize the angle that upset is correct or cannot overturn according to user's demand, make user experience lower.For example:
(1) mobile terminal is when horizontal table top is placed, and user is rotating mobile fuselage in any case, all cannot realize the rotation of full-screen panel, and gravity sensing realizes screen rotation and lost efficacy in the case.
(2) if user's operating handset under the state of couching, because causing mobile terminal display screen curtain also can rotate, the intrinsic mode of operation of gravity sensing remains consistent with vertical direction, this just causes the user under the state of couching cannot normal running mobile phone and browse mobile phone display screen, unless user turns off gravity sensing systemic-function, not only operation is more loaded down with trivial details, and can cause some to use the game of gravity sensing principle to use.
For screen turning shifting method user experience in correlation technique, relatively spend lower problem, not yet propose at present effective solution.
Summary of the invention
For screen turning shifting method user experience in correlation technique, relatively spend lower problem, the invention provides a kind of screen turning shifting method, device and mobile terminal, at least to address this problem.
According to an aspect of the present invention, provide a kind of screen turning shifting method, having comprised: the first default axis that gathers facial image; Determine the second angle of presetting between axis of the screen place plane of the described first default axis and mobile terminal; Judge described angle and meet the angle threshold that triggering mobile terminals is rotated, the screen that triggers described mobile terminal is rotated.
Preferably, the described first default axis comprises one of following: first axle, the second axis;
Wherein, described first axle comprises: the axis at two corners of the mouth places in the axis at two pupil places and described facial image in described facial image, described the second axis comprises: the place between the eyebrows in described facial image is to the axis at chin center.
Preferably, before determining the angle between the second default axis of the described first default axis and the screen place plane of mobile terminal, also comprise: obtain described second and preset axis;
Wherein, the described second default axis comprises the 3rd axis or four axistyle, described the 3rd axis comprises: the first side of described mobile terminal is at the axis of the projection of described screen place plane, described four axistyle comprises: the Second Edge of described mobile terminal is at the axis of the projection of described screen place plane, wherein, described first side and described Second Edge are adjacent.
Preferably, according to following formula, determine described angle:
Cos θ=(LY)/(| L||Y|), wherein, LY represents the inner product of the vectorial Y at the described first default axis place vector L and the described second default axis place, | L||Y| represents the product of the mould of described vectorial L and the mould of described vectorial Y, the scope of θ is [0 °, 180 °].
Preferably, judge described angle and meet the angle threshold that triggering mobile terminals is rotated, the screen that triggers described mobile terminal is rotated and comprises: according to default described angle and the corresponding relation of the anglec of rotation, trigger the anglec of rotation corresponding to angle described in described rotation of mobile terminal.
According to a further aspect in the invention, provide a kind of screen turning rotary device, having comprised: acquisition module, for gathering the first default axis of facial image; Determination module, for determining the second angle of presetting between axis of the screen place plane of the described first default axis and mobile terminal;
Rotary module, for when judging described angle and meet the angle threshold that triggering mobile terminals is rotated, the screen that triggers described mobile terminal is rotated.
Preferably, the described first default axis comprises one of following: first axle, the second axis;
Wherein, described first axle comprises: the axis at two corners of the mouth places in the axis at two pupil places and described facial image in described facial image, described the second axis comprises: the place between the eyebrows in described facial image is to the axis at chin center.
Preferably, said apparatus also comprises: acquisition module, for obtaining the described second default axis;
Wherein, the described second default axis comprises the 3rd axis or four axistyle, described the 3rd axis comprises: the first side of described mobile terminal is at the axis of the projection of described screen place plane, described four axistyle comprises: the Second Edge of described mobile terminal is at the axis of the projection of described screen place plane, wherein, described first side and described Second Edge are adjacent.
Preferably, described determination module is determined described angle theta according to following formula:
Cos θ=(LY)/(| L||Y|), wherein, LY represents the inner product of the vectorial L of the described first default axis and the vectorial Y of the described second default axis, | L||Y| represents the product of the mould of described vectorial L and the mould of described vectorial Y, the scope of θ is [0 °, 180 °].
Preferably, described rotary module is for according to default described angle and the corresponding relation of the anglec of rotation, triggers the anglec of rotation corresponding to angle described in described rotation of mobile terminal.
According to another aspect of the invention, also provide a kind of mobile terminal, having comprised: above-mentioned screen turning rotary device.
By the present invention, adopt the angle of determining between the first default axis of facial image and the second default axis of the screen place plane of mobile terminal, judge this angle and meet the angle threshold that this mobile terminal of triggering is rotated, the screen that triggers this mobile terminal is rotated, can realize mobile terminal and according to the position of the user's of mobile terminal facial image and mobile terminal, carry out the upset of screen, make screen upset and mobile terminal user's use scenes obtain better combination, improved user's experience.
Accompanying drawing explanation
Accompanying drawing described herein is used to provide a further understanding of the present invention, forms the application's a part, and schematic description and description of the present invention is used for explaining the present invention, does not form inappropriate limitation of the present invention.In the accompanying drawings:
Fig. 1 is according to the flow chart of the screen turning shifting method of the embodiment of the present invention;
Fig. 2 is according to the structured flowchart of the screen turning rotary device of the embodiment of the present invention;
Fig. 3 is according to the preferred structured flowchart of the screen turning rotary device of the embodiment of the present invention;
Fig. 4 is according to the structured flowchart of the mobile terminal of the embodiment of the present invention;
Fig. 5 realizes the flow chart of screen rotation method according to the recognition of face that utilizes of the embodiment of the present invention;
Fig. 6 realizes the structured flowchart of screen rotating device according to the recognition of face of the embodiment of the present invention; And
Fig. 7 realizes according to the recognition of face of the embodiment of the present invention schematic diagram that screen rotating device obtains the mobile terminal screen anglec of rotation.
Embodiment
Hereinafter with reference to accompanying drawing, also describe the present invention in detail in conjunction with the embodiments.It should be noted that, in the situation that not conflicting, embodiment and the feature in embodiment in the application can combine mutually.
Fig. 1 is according to the flow chart of the screen turning shifting method of the embodiment of the present invention, and as shown in Figure 1, the method comprises the steps that S102 is to step S104.
Step S102: the first default axis that gathers facial image.
Step S104: the second angle of presetting between axis of determining the screen place plane of the first default axis and mobile terminal.
Step S106: judge this angle and meet the angle threshold that triggering mobile terminals is rotated, the screen of triggering mobile terminals is rotated.
Pass through above-mentioned steps, determine the angle between the first default axis of facial image and the second default axis of the screen place plane of mobile terminal, judge this angle and meet the angle threshold that this mobile terminal of triggering is rotated, the screen that triggers this mobile terminal is rotated, can realize mobile terminal and according to the position of the user's of mobile terminal facial image and mobile terminal, carry out the upset of screen, make screen upset and mobile terminal user's use scenes obtain better combination, improved user's experience.
When implementing, the first default axis can be the multiple directions axis of facial image, and in order to reduce the complexity of realization, it is one of following that this first default axis comprises: first axle, the second axis.This first axle comprises: the axis at two corners of the mouth places in the axis at two pupil places and facial image in facial image, the second axis comprises: the place between the eyebrows in facial image is to the axis at chin center.
As an execution mode preferably, before step S104, obtain the second default axis.With determine that the first default axis is similar, the second default axis can adopt mobile terminal institute arbitrary line planar as this second default axis, in order to reduce the complexity of realization, this second is preset axis and comprises the 3rd axis or four axistyle.Wherein, the 3rd axis comprises: the first side of mobile terminal is at the axis of the projection of screen place plane, and four axistyle comprises: the Second Edge of mobile terminal is at the axis of the projection of screen place plane, and wherein, first side and Second Edge are adjacent.
When implementing, can adopt various ways to determine the angle between the first default axis and the second default axis, this preferred embodiment provides following implementation: according to following formula, determine angle:
Cos θ=(LY)/(| L||Y|), wherein, LY represents the inner product of the vectorial Y at the first default axis place vector L and the second default axis place, | L||Y| represents the product of the mould of vectorial L and the mould of vectorial Y, and the scope of θ is [0 °, 180 °].It should be noted that, the preferred embodiment only schematically illustrates, and in actual implementation process, can adopt the method for definite angle of the prior art.
When implementing, in order to improve user, experience, can be according to default angle and the corresponding relation of the anglec of rotation, the anglec of rotation corresponding to triggering mobile terminals rotation angle.For example: the corresponding relations of the much more default group anglecs of rotation and angle, judging meet trigger condition in the situation that, rotate the angle that this angle is corresponding, can realize the upset of the accurate angle of screen.
It should be noted that, in the step shown in the flow chart of accompanying drawing, can in the computer system such as one group of computer executable instructions, carry out, and, although there is shown logical order in flow process, but in some cases, can carry out shown or described step with the order being different from herein.
In another embodiment, also provide a kind of screen upset software, the technical scheme that this software is described for carrying out above-described embodiment and preferred embodiment.
In another embodiment, also provide a kind of storage medium, stored above-mentioned screen upset software in this storage medium, this storage medium includes but not limited to: CD, floppy disk, hard disk, scratch pad memory etc.
The embodiment of the present invention also provides a kind of screen turning rotary device, this screen turning rotary device can be for realizing above-mentioned screen turning shifting method and preferred implementation, carried out explanation, repeated no more, below the module relating in this screen turning rotary device had been described.As used below, the combination of software and/or the hardware of predetermined function can be realized in term " module ".Although the described system and method for following examples is preferably realized with software, hardware, or the realization of the combination of software and hardware also may and be conceived.
Fig. 2 is according to the structured flowchart of the screen turning rotary device of the embodiment of the present invention, and as shown in Figure 2, this device comprises: acquisition module 22, and determination module 24, rotary module 26, is elaborated to this structure below.
Acquisition module 22, for gathering the first default axis of facial image; Determination module 24, is connected to acquisition module 22, the angle between the first default axis collecting for definite acquisition module 22 and the second default axis of the screen place plane of mobile terminal; Rotary module 26, is connected to determination module 24, and for when judging the definite angle of determination module 24 and meet the angle threshold that triggering mobile terminals is rotated, the screen of triggering mobile terminals is rotated.
Preferably, determination module 24 is determined angle according to following formula:
Cos θ=(LY)/(L||Y|), wherein, LY represents the inner product of the vectorial L of the first default axis and the vectorial Y of the second default axis, | L||Y| represents the product of the mould of vectorial L and the mould of vectorial Y, and the scope of θ is [0 °, 180 °].
Preferably, rotary module 26 is for according to default angle and the corresponding relation of the anglec of rotation, the anglec of rotation corresponding to triggering mobile terminals rotation angle.
Preferably, the first default axis comprises one of following: first axle, the second axis.Preferably, first axle comprises ratio: the axis at two corners of the mouth places in the axis at two pupil places and facial image in facial image, the second axis comprises: the place between the eyebrows in facial image is to the axis at chin center.
Fig. 3 is according to the preferred structured flowchart of the screen turning rotary device of the embodiment of the present invention, and as shown in Figure 3, this device also comprises: acquisition module 32, is elaborated to this structure below.
Acquisition module 32, for obtaining the second default axis; Wherein, the second default axis comprises the 3rd axis or four axistyle, the 3rd axis comprises: the first side of mobile terminal is at the axis of the projection of screen place plane, four axistyle comprises: the Second Edge of mobile terminal is at the axis of the projection of screen place plane, wherein, first side and Second Edge are adjacent.
This preferred embodiment provides a kind of mobile terminal, Fig. 4 is according to the structured flowchart of the mobile terminal of the embodiment of the present invention, and as shown in Figure 4, this screen turning rotary device comprises screen turning rotary device 2, the structure of this screen turning rotary device 2, as shown in Fig. 2 or 3, does not repeat them here.
Below in conjunction with preferred embodiment, describe, following preferred embodiment combines above-described embodiment and preferred implementation.
Preferred embodiment one
This preferred embodiment provides the method that realizes mobile communication terminal screen rotation by recognition of face, and the method comprises:
Step S2: gather facial image;
Step S4: the preposition image capture device of use mobile phone regularly gathers cellie's facial image.
As an execution mode preferably, facial image comprises sampling information, and this sampling information is at the appointed time the cycle samples and gathers the information of obtaining cellie's facial image.
In implementation process, the initial pictures of sampling information for gathering, process and export effective image information through image.This image processing and effective image information refer to initial pictures to process and extract the vertical axis of people's face in facial image, and intuitivism apprehension is the straight line from place between the eyebrows to chin.
Step S6: through effective image information and the vertical Y-axis of mobile phone are contrasted, and judge that angle between effective image information and the vertical Y-axis of mobile phone is as the threshold value that whether triggers screen rotation.
It should be noted that, when the vertical Y-axis of this mobile phone refers to that user normally uses mobile phone, the vertical axes of mobile phone attitude of living in, i.e. Y-axis in mobile phone three-axis reference X-axis, Y-axis, Z axis.
Preferably, when being more than or equal to, the angle between effective image information and Y-axis triggers the rotation of mobile phone display screen curtain while stating threshold value; When being less than threshold value, do not trigger the angle between effective image information and Y-axis the rotation of mobile phone display screen curtain.
Preferably, preposition image capture device includes but not limited to camera, the image capture device such as infrared.Other equipment that can realize collection cellie facial image also can be for realizing IMAQ.
Preferably, mobile communication terminal comprises the mobile terminals such as mobile phone, panel computer.
Preferred embodiment two
This preferred embodiment also provides a kind of system that realizes mobile communication terminal screen rotation by recognition of face, and this system comprises man face image acquiring module, image processing module, Data Comparison module, trigger module.
Man face image acquiring module, for timing acquiring cellie human face image information.
Image processing module, for the treatment of the initial pictures of above-mentioned man face image acquiring module output, the vertical axis of initial pictures being processed and being extracted people's face in facial image.
Comparing module, for contrasting the vertical Y-axis of effective image information and mobile phone, and judges the angle between effective image information and the vertical Y-axis of mobile phone and triggers the relation between screen rotation threshold value.
In this preferred embodiment, when the vertical Y-axis of mobile phone refers to that user normally uses mobile phone, the vertical axes of mobile phone attitude of living in, i.e. Y-axis in mobile phone three axle X-axis, Y-axis, Z axis.It should be noted that, for actual calculating needs, X-axis, Y-axis, Z axis can arrange as required.
Trigger module, when the vertical axis of facial image and the angle between Y-axis are more than or equal to while stating threshold value trigger module for triggering the rotation of mobile phone display screen curtain; When the vertical axis of facial image and the angle between Y-axis are less than threshold value, trigger module does not trigger the rotation of mobile phone display screen curtain.
Preferably, mobile communication terminal (mobile terminal) comprises the mobile communication terminals such as mobile phone, panel computer.
By the preferred embodiment, can be so that make mobile communication terminal user no matter under what state, mobile communication terminal can be according to the actual rotation with realizing mobile communication terminal screen of user in various attitudes.Evaded gravity sensing and realized the limitation of screen rotation, what make that screen rotation is combined with mobile communication terminal user's actual use scenes is better, has improved operability and the application of screen rotation.
Preferred embodiment three
This preferred embodiment provides a kind of screen rotation method, by recognition of face, realize mobile communication terminal screen rotation, make mobile communication terminal user no matter under what state, mobile communication terminal can be according to the actual rotation with realizing display screen of mobile communication terminal of user in various attitudes.Fig. 5 realizes the flow chart of screen rotation method according to the recognition of face that utilizes of the embodiment of the present invention, and as shown in Figure 5, the method comprises the steps that S502 is to step S508.
Step S502: the facial image that gathers mobile terminal (mobile phone) user.
Step S504: effective image information is processed and exported to the initial pictures gathering through image.Image processing and effective image information refer to initial pictures to process and extract the vertical axis of people's face in facial image, and intuitivism apprehension is the straight line from place between the eyebrows to chin.
Step S506: the vertical axis of people's face and the vertical Y-axis of mobile phone are contrasted, and judge vertical axis and the angle between the vertical Y-axis of mobile phone and the relation between preset angles reference threshold of people's face.
Step S508: trigger the rotation of mobile phone display screen curtain while stating preset angles reference threshold when the vertical axis of people's face and the angle between Y-axis are more than or equal to; When being less than preset angles reference threshold, do not trigger the angle between the vertical axis of facial image and Y-axis the rotation of mobile phone display screen curtain.
In this preferred embodiment, facial image comprises sampling information, sampling information was sampled and is gathered the information of obtaining intelligent mobile terminal user's facial image for cycle at the appointed time, and cycle fixed time can be the set time, also can arrange voluntarily by user.
Preferably, the initial pictures of sampling information for gathering, process and export effective image information through image.This image processing and effective image information refer to initial pictures to process and extract the vertical axis of people's face, and intuitivism apprehension is the straight line from place between the eyebrows to chin.
As another execution mode preferably, through vertical axis and the vertical Y-axis of mobile phone are contrasted, and judge angle between vertical axis and the vertical Y-axis of mobile phone and the relation between preset angles reference threshold.
In this preferred embodiment, when the vertical Y-axis of mobile phone refers to that user normally uses mobile phone, the vertical axes of mobile phone attitude of living in, i.e. Y-axis in mobile phone three axle X-axis, Y-axis, Z axis.It should be noted that, for actual calculating needs, X-axis, Y-axis, Z axis can arrange as required.
Preferably, when being more than or equal to, the angle between the vertical axis of facial image and Y-axis triggers the rotation of mobile phone display screen curtain while stating preset angles reference threshold; When being less than preset angles reference threshold, do not trigger the angle between the vertical axis of facial image and Y-axis the rotation of mobile phone display screen curtain.
Describe each step in this preferred embodiment below in detail and by recognition of face, realize the operation principle of mobile communication terminal screen rotation method.
In step S502, cellie's facial image adopts the method for sampling to obtain, and for example, take and gathers a cellie's facial image as the cycle in every 2 seconds.
It should be noted that, sampling period and time can be set in modular program, also can be designed to according to mobile terminal user's use habit by the self-defining mode of mobile terminal user, as 2 seconds, 3 seconds, 5 seconds etc.
Obtain after cellie people's face initial pictures, need to process initial pictures, the method of processing will be extracted the vertical axis of people's face in facial image exactly, is directly interpreted as the vectorial straight line L at the line place from place between the eyebrows to chin, and definition is positive direction from chin to place between the eyebrows direction.
In force, the image processing method that obtains vectorial straight line L direction includes but not limited to following method: utilize iterative threshold value selection algorithm to carry out thresholding processing in second region of people's face, without manual intervention, just can obtain the regions such as face nose; With corrosion expansion algorithm, remove less noise spot, by the shape of minimum each connected region of boundary rectangle approximate representation, according to the priori of face shape size, determine the connected region at face place; With the barycenter of face connected region, represent face center, utilize Harris Corner Detection Algorithm in the face region of former gray level image, to find two corners of the mouths, utilize 2 definite straight lines to obtain the linear equation of two corners of the mouth lines, and obtain the inverse of slope, be the straight slope parallel with place, people's face axis direction vector straight line L; And then can obtain the position of two corners of the mouth line mid point M.Use similar approach can obtain the position that two eye center are pupil, and then can obtain the position of two interpupillary line mid point N, the direction of definable from a M to a N is the positive direction of facial image axis straight line L vector.It should be noted that, aforesaid way is only for schematically illustrating, and in prior art, in image processing method, the method for definite vectorial straight line all can be used for determining vectorial straight line L direction.
In this preferred embodiment, mobile phone three-axis reference X-axis, Y-axis, Z axis are realized according to right-hand rule coordinate system, and wherein Y-axis place straight line is defined as vectorial straight line Y, and Y-axis positive direction is defined as the positive direction of vectorial Y.It should be noted that, above-mentioned coordinate system can arrange as required.
Fig. 7 realizes according to the recognition of face of the embodiment of the present invention schematic diagram that screen rotating device obtains the mobile terminal screen anglec of rotation, as shown in Figure 7, in Fig. 7, marking angle θ is the angle between vectorial Y and vectorial L, angle θ can try to achieve according to vector angle formula: cos θ=(LY)/(| L||Y|), wherein, LY represents the inner product of vectorial L and vectorial Y, | L||Y| represents the product of the mould of vectorial L and the mould of vectorial Y, between vector, the scope of angle theta is [0 °, 180 °].
In this preferred embodiment, in order to improve the accuracy of Rotation screen and to reduce the time delay of calculating, several groups of original correction datas that can prestore in contrast module, are used for contrasting with the angle θ trying to achieve, and several groups of initial data are respectively 45 °, 135 °.
Preferably, angle θ and original angle data that collection is calculated are compared one by one, and using contrast result afterwards as triggering signal, control the rotation of mobile phone screen.When angle θ is less than 45 °, mobile phone screen image does not deflect; When angle θ is more than or equal to 45 ° and while being less than 135 °, mobile phone screen is toward the positive direction half-twist of vectorial L; When angle θ is more than or equal to 135 °, mobile phone screen is toward the positive direction Rotate 180 ° of vectorial L;
It should be noted that, in reality is implemented, can, according to the direction of axis and user's demand, the quick upset that corresponding angle realizes screen be set.
Preferred embodiment four
This preferred embodiment provides a kind of device 50 of realizing mobile communication terminal screen rotation by recognition of face, and this device comprises acquisition module 62, processing module 64, contrast module 66, trigger module 68.
Acquisition module 62, for gathering mobile communication terminal user's facial image.
Processing module 64, processes and exports effective image information to the initial pictures gathering through image.This image is processed and effective image information refers to initial pictures to process and extract the vertical axis in facial image, and intuitivism apprehension is the straight line from place between the eyebrows to chin.
Contrast module 66, contrasts the vertical axis of facial image and the vertical Y-axis of mobile phone, and judges angle between the vertical axis of facial image and the vertical Y-axis of mobile phone and the relation between preset angles reference threshold.
Trigger module 68, triggers the rotation of mobile phone display screen curtain while stating preset angles reference threshold when the angle between the vertical axis of facial image and Y-axis is more than or equal to; When being less than preset angles reference threshold, do not trigger the angle between the vertical axis of facial image and Y-axis the rotation of mobile phone display screen curtain.
Describe this below in detail and by recognition of face, realize the workflow of the device 50 of mobile communication terminal screen rotation.
Step S20: the facial image that acquisition module 62 regularly gathers mobile communication terminal user adopts the method for sampling to obtain, as, 2 seconds.It should be noted that sampling period and time can set in modular program, also can be designed to according to mobile terminal user's use habit by the self-defining mode of mobile terminal user, as 2 seconds, 3 seconds, 5 seconds etc.
Step S40: obtain after mobile communication terminal user people face initial pictures, by image transmitting to processing module 20, by 20 pairs of initial pictures of processing module, processed, the method of processing will be extracted the vertical axis of people's face in facial image exactly, directly be interpreted as the vectorial straight line L at the line place from place between the eyebrows to chin, and to define chin be positive direction to place between the eyebrows direction; And define mobile phone three-axis reference X-axis, Y-axis, Z axis according to the realization of right-hand rule coordinate system, and wherein Y-axis place straight line is defined as vectorial straight line Y, and Y-axis positive direction is defined as the positive direction of vectorial Y.
Step S60: the image processing method in processing module 64 includes but not limited to following method: utilize iterative threshold value selection algorithm to carry out thresholding processing in second region of people's face, just can obtain the regions such as face nose without manual intervention; With corrosion expansion algorithm, remove less noise spot, by the shape of minimum each connected region of boundary rectangle approximate representation, according to the priori of face shape size, determine the connected region at face place; With the barycenter of face connected region, represent face center, utilize Harris Corner Detection Algorithm in the face region of former gray level image, to find two corners of the mouths, utilize 2 definite straight lines to obtain the linear equation of two corners of the mouth lines, and obtain the inverse of slope, be the straight slope parallel with place, people's face axis direction vector straight line L; And then can obtain the position of two corners of the mouth line mid point M.Use similar approach can obtain the position that two eye center are pupil, and then can obtain the position of two interpupillary line mid point N, the direction of definable from a M to a N is the positive direction of facial image axis straight line L vector.
Fig. 7 realizes according to the recognition of face of the embodiment of the present invention schematic diagram that screen rotating device obtains the mobile terminal screen anglec of rotation, as shown in Figure 7, in Fig. 7, marking angle θ is the angle between vectorial Y and vectorial L, angle θ can try to achieve according to vector angle formula: cos θ=(LY)/(L||Y|), wherein, LY represents the inner product of vectorial L and vectorial Y, | L||Y| represents the product of the mould of vectorial L and the mould of vectorial Y, between vector, the scope of angle theta is [0 °, 180 °].
In the present embodiment, several groups of original correction datas that can prestore in contrast module, are used for contrasting with the angle θ trying to achieve, and several groups of initial data are respectively 45 °, 135 °.
The angle θ that processing module 64 is calculated is transferred to contrast module 30, and the original angle data that contrast storage in module 30 are compared, and contrast result is afterwards transferred to trigger module 40 as triggering signal, by the output command of trigger module 40, controlled the rotation of mobile phone screen.When angle θ is less than 45 °, mobile phone screen image does not deflect; When angle θ is more than or equal to 45 ° and while being less than 135 °, mobile phone screen is toward the positive direction half-twist of vectorial L; When angle θ is more than or equal to 135 °, mobile phone screen is toward the positive direction Rotate 180 ° of vectorial L.
It should be noted that, in reality is implemented, can, according to the direction of axis and user's demand, the quick upset that corresponding angle realizes screen be set.
Pass through above-described embodiment, a kind of screen turning shifting method and device, mobile terminal are provided, make mobile communication terminal user no matter under what state, mobile communication terminal can be according to the actual rotation with realizing mobile communication terminal screen of user in various attitudes.Evade gravity sensing and realized the limitation of screen rotation, what make that screen rotation is combined with mobile communication terminal user's actual use scenes is better, the operability and the application that have improved screen rotation it should be noted that, these technique effects are not that above-mentioned all execution modes have, and some technique effect is that some preferred implementation just can obtain.
Obviously, those skilled in the art should be understood that, above-mentioned each module of the present invention or each step can realize with general calculation element, they can concentrate on single calculation element, or be distributed on the network that a plurality of calculation elements form, alternatively, they can be realized with the executable program code of calculation element, thereby they can be stored in storage device and be carried out by calculation element, or they are made into respectively to each integrated circuit modules, or a plurality of modules in them or step are made into single integrated circuit module to be realized.Like this, the present invention is not restricted to any specific hardware and software combination.
The foregoing is only the preferred embodiments of the present invention, be not limited to the present invention, for a person skilled in the art, the present invention can have various modifications and variations.Within the spirit and principles in the present invention all, any modification of doing, be equal to replacement, improvement etc., within all should being included in protection scope of the present invention.

Claims (11)

1. a screen turning shifting method, is characterized in that comprising:
Gather the first default axis of facial image;
Determine the second angle of presetting between axis of the screen place plane of the described first default axis and mobile terminal;
Judge described angle and meet the angle threshold that triggering mobile terminals is rotated, the screen that triggers described mobile terminal is rotated.
2. method according to claim 1, is characterized in that, it is one of following that the described first default axis comprises:
First axle, the second axis;
Wherein, described first axle comprises: the axis at two corners of the mouth places in the axis at two pupil places and described facial image in described facial image, described the second axis comprises: the place between the eyebrows in described facial image is to the axis at chin center.
3. method according to claim 2, is characterized in that, before determining the second angle of presetting between axis of the described first default axis and the screen place plane of mobile terminal, also comprises:
Obtain the described second default axis;
Wherein, the described second default axis comprises the 3rd axis or four axistyle, described the 3rd axis comprises: the first side of described mobile terminal is at the axis of the projection of described screen place plane, described four axistyle comprises: the Second Edge of described mobile terminal is at the axis of the projection of described screen place plane, wherein, described first side and described Second Edge are adjacent.
4. according to the method in any one of claims 1 to 3, it is characterized in that,
According to following formula, determine described angle theta:
Cos θ=(LY)/(| L||Y|), wherein, LY represents the inner product of the vectorial Y at the described first default axis place vector L and the described second default axis place, | L||Y| represents the product of the mould of described vectorial L and the mould of described vectorial Y, the scope of θ is [0 °, 180 °].
5. according to the method described in any one in claim 1 to 4, it is characterized in that, judge described angle and meet the angle threshold that triggering mobile terminals is rotated, the screen that triggers described mobile terminal is rotated and comprises:
According to default described angle and the corresponding relation of the anglec of rotation, trigger the anglec of rotation corresponding to angle described in described rotation of mobile terminal.
6. a screen turning rotary device, is characterized in that comprising:
Acquisition module, for gathering the first default axis of facial image;
Determination module, for determining the second angle of presetting between axis of the screen place plane of the described first default axis and mobile terminal;
Rotary module, for when judging described angle and meet the angle threshold that triggering mobile terminals is rotated, the screen that triggers described mobile terminal is rotated.
7. device according to claim 6, is characterized in that, it is one of following that the described first default axis comprises:
First axle, the second axis;
Wherein, described first axle comprises: the axis at two corners of the mouth places in the axis at two pupil places and described facial image in described facial image, described the second axis comprises: the place between the eyebrows in described facial image is to the axis at chin center.
8. device according to claim 7, is characterized in that, also comprises:
Acquisition module, for obtaining the described second default axis;
Wherein, the described second default axis comprises the 3rd axis or four axistyle, described the 3rd axis comprises: the first side of described mobile terminal is at the axis of the projection of described screen place plane, described four axistyle comprises: the Second Edge of described mobile terminal is at the axis of the projection of described screen place plane, wherein, described first side and described Second Edge are adjacent.
9. according to the device described in any one in claim 6 to 8, it is characterized in that,
Described determination module is determined described angle theta according to following formula:
Cos θ=(LY)/(| L||Y|), wherein, LY represents the inner product of the vectorial L of the described first default axis and the vectorial Y of the described second default axis, | L||Y| represents the product of the mould of described vectorial L and the mould of described vectorial Y, the scope of θ is [0 °, 180 °].
10. according to the device described in any one in claim 6 to 8, it is characterized in that, described rotary module is for according to default described angle and the corresponding relation of the anglec of rotation, triggers the anglec of rotation corresponding to angle described in described rotation of mobile terminal.
11. 1 kinds of mobile terminals, is characterized in that comprising: according to the screen turning rotary device described in any one in claim 6 to 10.
CN201210282293.8A 2012-08-09 2012-08-09 Method and device for turning over screen and mobile terminal Pending CN103581423A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201210282293.8A CN103581423A (en) 2012-08-09 2012-08-09 Method and device for turning over screen and mobile terminal
PCT/CN2013/079741 WO2013178151A1 (en) 2012-08-09 2013-07-19 Screen turnover method and device, and mobile terminal

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201210282293.8A CN103581423A (en) 2012-08-09 2012-08-09 Method and device for turning over screen and mobile terminal

Publications (1)

Publication Number Publication Date
CN103581423A true CN103581423A (en) 2014-02-12

Family

ID=49672468

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201210282293.8A Pending CN103581423A (en) 2012-08-09 2012-08-09 Method and device for turning over screen and mobile terminal

Country Status (2)

Country Link
CN (1) CN103581423A (en)
WO (1) WO2013178151A1 (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104866809A (en) * 2014-02-25 2015-08-26 腾讯科技(深圳)有限公司 Picture playing method and device thereof
CN105630140A (en) * 2014-10-30 2016-06-01 深圳富泰宏精密工业有限公司 Interface rotating system and method
CN105912103A (en) * 2016-03-31 2016-08-31 乐视控股(北京)有限公司 Display processing method, device of application desktop of mobile terminal and mobile terminal
CN111131598A (en) * 2018-10-31 2020-05-08 阿里巴巴集团控股有限公司 Method and device for adjusting running state of electronic equipment and electronic equipment
CN111649865A (en) * 2020-05-12 2020-09-11 北京大熊座科技有限公司 Wind power and wind direction detection method based on image processing technology
CN111880711A (en) * 2020-07-31 2020-11-03 Oppo广东移动通信有限公司 Display control method, display control device, electronic equipment and storage medium

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106094882A (en) * 2016-06-20 2016-11-09 南京巨鲨显示科技有限公司 The adaptive intelligent display in a kind of locus
CN106201201B (en) * 2016-07-07 2019-08-13 广州视睿电子科技有限公司 View method of adjustment and system

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101794193A (en) * 2010-02-23 2010-08-04 华为终端有限公司 Picture control method and electronic apparatus
US20110032220A1 (en) * 2009-08-07 2011-02-10 Foxconn Communication Technology Corp. Portable electronic device and method for adjusting display orientation of the portable electronic device
CN102436304A (en) * 2011-11-14 2012-05-02 华为技术有限公司 Method and terminal for switching horizontal and vertical display modes of screen

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101226407B (en) * 2008-01-24 2010-08-11 北京中星微电子有限公司 System and method for automatically adjusting display device angle
CN102063887A (en) * 2010-11-19 2011-05-18 天津三星电子显示器有限公司 Method for automatically adjusting visual range of display and display thereof
CN102163081A (en) * 2011-05-13 2011-08-24 北京新岸线软件科技有限公司 Method, electronic equipment and device for screen interaction

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110032220A1 (en) * 2009-08-07 2011-02-10 Foxconn Communication Technology Corp. Portable electronic device and method for adjusting display orientation of the portable electronic device
CN101794193A (en) * 2010-02-23 2010-08-04 华为终端有限公司 Picture control method and electronic apparatus
CN102436304A (en) * 2011-11-14 2012-05-02 华为技术有限公司 Method and terminal for switching horizontal and vertical display modes of screen

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104866809A (en) * 2014-02-25 2015-08-26 腾讯科技(深圳)有限公司 Picture playing method and device thereof
CN105630140A (en) * 2014-10-30 2016-06-01 深圳富泰宏精密工业有限公司 Interface rotating system and method
CN105912103A (en) * 2016-03-31 2016-08-31 乐视控股(北京)有限公司 Display processing method, device of application desktop of mobile terminal and mobile terminal
CN111131598A (en) * 2018-10-31 2020-05-08 阿里巴巴集团控股有限公司 Method and device for adjusting running state of electronic equipment and electronic equipment
CN111649865A (en) * 2020-05-12 2020-09-11 北京大熊座科技有限公司 Wind power and wind direction detection method based on image processing technology
CN111880711A (en) * 2020-07-31 2020-11-03 Oppo广东移动通信有限公司 Display control method, display control device, electronic equipment and storage medium
CN111880711B (en) * 2020-07-31 2022-02-01 Oppo广东移动通信有限公司 Display control method, display control device, electronic equipment and storage medium

Also Published As

Publication number Publication date
WO2013178151A1 (en) 2013-12-05

Similar Documents

Publication Publication Date Title
CN103581423A (en) Method and device for turning over screen and mobile terminal
CN111880657B (en) Control method and device of virtual object, electronic equipment and storage medium
CN110517319B (en) Method for determining camera attitude information and related device
CN110610453B (en) Image processing method and device and computer readable storage medium
CN112070015B (en) Face recognition method, system, device and medium fusing occlusion scene
CN107395958B (en) Image processing method and device, electronic equipment and storage medium
CN107589963B (en) A kind of image processing method, mobile terminal and computer readable storage medium
CN107248169B (en) Image positioning method and device
WO2014164236A1 (en) Local image enhancement for text recognition
CN102902943A (en) Two-dimension code scanning method, processing device and terminal
WO2012051747A1 (en) Method and apparatus for providing hand detection
CN110738078A (en) face recognition method and terminal equipment
CN111046825A (en) Human body posture recognition method, device and system and computer readable storage medium
CN107797648B (en) Virtual touch system, image recognition positioning method and computer-readable storage medium
CN113470112A (en) Image processing method, image processing device, storage medium and terminal
CN111199169A (en) Image processing method and device
CN105183538B (en) A kind of information processing method and electronic equipment
CN109756621A (en) A kind of two-dimensional code display method and terminal device
CN112183200B (en) Eye movement tracking method and system based on video image
CN112416126A (en) Page rolling control method and device, storage medium and electronic equipment
CN110069126B (en) Virtual object control method and device
CN110087235B (en) Identity authentication method and device, and identity authentication method and device adjustment method and device
Scargill et al. Demo abstract: Catch my eye: Gaze-based activity recognition in an augmented reality art gallery
CN114708641A (en) Sleep detection method and device, computer readable storage medium and terminal equipment
CN102902468A (en) Map browsing method and device of mobile terminal

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20140212