WO2015149498A1 - 用于屏幕模式切换的方法、装置、计算机存储介质和设备 - Google Patents

用于屏幕模式切换的方法、装置、计算机存储介质和设备 Download PDF

Info

Publication number
WO2015149498A1
WO2015149498A1 PCT/CN2014/088196 CN2014088196W WO2015149498A1 WO 2015149498 A1 WO2015149498 A1 WO 2015149498A1 CN 2014088196 W CN2014088196 W CN 2014088196W WO 2015149498 A1 WO2015149498 A1 WO 2015149498A1
Authority
WO
WIPO (PCT)
Prior art keywords
screen
user
mobile terminal
screen mode
face image
Prior art date
Application number
PCT/CN2014/088196
Other languages
English (en)
French (fr)
Inventor
朱振广
Original Assignee
百度在线网络技术（北京）有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 百度在线网络技术（北京）有限公司 filed Critical 百度在线网络技术（北京）有限公司
Publication of WO2015149498A1 publication Critical patent/WO2015149498A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range

Definitions

  • the present invention relates to a screen control technique for a mobile terminal, and more particularly to a method, apparatus, computer storage medium and device for screen mode switching.
  • mobile terminals such as smart phones, tablets, etc.
  • mobile terminals have become a necessity in people's daily lives.
  • most mobile terminals have the function of controlling the switching between the horizontal and vertical screens of their screens.
  • the method for controlling the horizontal and vertical screen switching of the mobile terminal includes: (1) manually controlling the switching of the horizontal and vertical screens; (2) the horizontal and vertical screen switching based on the gravity sensing technology; and (3) the horizontal and vertical screen switching functions of the naked eye 3D mobile terminal.
  • the user For the method of manually controlling the horizontal and vertical screen switching, the user needs to manually change the display mode of the screen every time, which is not intelligent or convenient; for the method of switching between the horizontal and vertical screens based on the gravity sensing technology, when the user is lying or at an angle When the mobile terminal is used obliquely, the result is switched to the horizontal screen according to the gravity sensing result, but in fact, the way the human eye views the screen is still the vertical screen, which causes serious switching errors, causing inconvenience to the user; for the naked eye 3D mobile terminal The method of switching functions of the horizontal and vertical screens needs to be implemented by adding additional equipment on the existing mobile terminal, and the cost is high.
  • An aspect of the present invention is to provide a method, apparatus, computer storage medium and apparatus for screen mode switching, which are based on a change in gravity direction to determine whether to perform horizontal and vertical screen switching, according to a mobile terminal
  • the rotation relationship between the user's face image and the screen taken by the front camera finally determines whether to perform the horizontal and vertical screen switching, so that when the function of automatically switching the horizontal and vertical screen according to the scene is needed, the screen of the mobile terminal can be accurately switched. Go to the screen mode that the user needs.
  • Another aspect of the present invention is to provide a method, apparatus, computer storage medium and apparatus for screen mode switching, the method and apparatus only need to use an existing mobile terminal commonly configured gravity sensor and camera to assist the screen Switch functions without adding additional hardware devices.
  • a method for screen mode switching comprising: obtaining, by turning on a front camera, if a gravity sensor of the mobile terminal determines that the mobile terminal needs to perform screen mode switching a facial image of the user; calculating a rotation relationship between the facial image of the user and the screen; and if the rotation relationship satisfies a preset condition, performing screen mode switching on the mobile terminal.
  • the calculating the rotation relationship between the face image of the user and the screen may specifically include: identifying a reference element in the face image of the user; obtaining a reference of the face image of the user according to the reference element Line; calculates an angle between a reference line of the user's face image and a reference line of the screen.
  • the reference element may comprise one of the following elements: eyes, glasses, nose, mouth, eyebrows, ears.
  • the reference line of the screen may be a line parallel to the upper edge or the lower edge of the screen frame in the screen mode or may be preset to form a predetermined angle with the upper or lower line of the screen frame in the screen mode. straight line.
  • the preset condition may include the angle exceeding a preset range.
  • an apparatus for screen mode switching comprising: an image acquisition unit that is turned on if a gravity sensor of the mobile terminal determines that the mobile terminal needs to perform screen mode switching a front camera to acquire a facial image of the user; a rotation computing unit that calculates a rotation relationship between the facial image of the user and the screen; and a screen switching unit that moves the movement if the rotation relationship satisfies a preset condition The terminal performs screen mode switching.
  • the rotation calculation unit may identify a reference element in the face image of the user; obtain a reference line of the face image of the user according to the reference element; calculate a reference line of the face image of the user and a reference line of the screen The angle between the two.
  • the reference element may comprise one of the following elements: eyes, glasses, nose, mouth, eyebrows, ears.
  • the reference line of the screen may be a line parallel to the upper edge or the lower edge of the screen frame in the screen mode or may be preset to form a predetermined angle with the upper or lower line of the screen frame in the screen mode. straight line.
  • the preset condition may include the angle exceeding a preset range.
  • a computer storage medium is encoded, the computer storage medium being encoded with a computer program that, when executed by one or more computers, causes the one or more computers to perform the following operations :
  • an apparatus comprising at least one processor, a memory, and at least one computer program; the at least one computer program being stored in the memory and executed by the at least one processor;
  • the computer program includes instructions to perform the following operations:
  • the gravity sensor of the mobile terminal determines that the mobile terminal needs to perform screen mode switching, acquiring a facial image of the user by turning on the front camera;
  • the method, device, computer storage medium and device for screen mode switching according to the present invention can accurately switch the screen execution of the mobile terminal to the screen mode required by the user, which is convenient for the user to use and improve the user experience.
  • the existing hardware devices of the mobile terminal can be used only, thereby effectively saving costs.
  • FIG. 1 is a flowchart illustrating a method for screen mode switching according to an exemplary embodiment of the present invention
  • FIGS. 2a to 3c are diagrams showing a reference line of a screen according to an exemplary embodiment of the present invention An illustration of an example
  • 4a to 5b are diagrams illustrating another example of a reference line of a screen according to an exemplary embodiment of the present invention.
  • 6a to 6c are diagrams illustrating an example of calculating an included angle according to an exemplary embodiment of the present invention.
  • FIG. 7 is a block diagram showing the structure of an apparatus for screen mode switching according to an exemplary embodiment of the present invention.
  • FIG. 1 is a flowchart illustrating a method for screen mode switching, according to an exemplary embodiment of the present invention.
  • the gravity sensor of the mobile terminal determines that the mobile terminal needs to perform screen mode switching, then at 101, the user's facial image can be acquired by turning on the front camera.
  • the gravity sensor in the mobile terminal may be a gravity sensor that is usually configured by an existing mobile terminal
  • the front camera may be a camera that is usually configured by an existing mobile terminal.
  • the gravity sensor of the mobile terminal may sense the gravity direction of the mobile terminal according to an existing gravity sensing technology, and determine whether the mobile terminal needs to perform screen mode switching according to the sensed gravity direction.
  • the screen mode may include a landscape mode and a portrait mode. If the gravity sensor of the mobile terminal determines that the mobile terminal needs to perform screen mode switching, the method acquires a facial image of the user by turning on the front camera.
  • a rotational relationship between the user's face image and the screen can be calculated.
  • the method may identify a reference element in a face image of a user.
  • the reference element may include one of the following elements: eyes, glasses, nose, mouth, eyebrows, ears, and the like.
  • the method may obtain a baseline of the user's facial image from the reference element.
  • a method of obtaining a reference line of a user's face image will be described below by taking an eye in a user's face image as an example.
  • the center coordinate point of the two eyes can be acquired by using the image recognition technology to recognize the position of the user's eyes in the user's face image (for example, the left eye center coordinate point A (x1, y1), the right eye center coordinate Point B (x2, y2)), and a straight line L AB is formed by the central coordinate points of both eyes to obtain a straight line connecting the eyes, and the obtained straight line connecting the two eyes is used as a reference line of the user's face image.
  • reference elements e.g., glasses, nose, mouth, eyebrows, ears, etc.
  • the method can calculate an angle between a reference line of the user's facial image and a reference line of the screen.
  • a reference line of a screen according to an exemplary embodiment of the present invention will be described with reference to FIGS. 2a to 5b.
  • the reference line of the screen may be defaulted to be a straight line parallel to the upper or lower side of the screen border in the screen mode in which it is located.
  • FIGS. 2a to 3c are diagrams illustrating examples of reference lines of a screen according to an exemplary embodiment of the present invention.
  • the reference line L base may be defaulted to be a line parallel to the upper or lower line of the screen frame in the portrait mode.
  • the reference line L base may be defaulted to be a line parallel to the upper or lower line of the screen border in the landscape mode.
  • the reference line of the screen may be a straight line that is set in advance to form a predetermined angle with an upper side line or a lower side line of the screen frame in the screen mode in which it is located.
  • the user may preliminarily set the reference line of the screen to a predetermined angle with the upper or lower line of the screen frame in the screen mode in consideration of factors such as habits or structural characteristics of the mobile terminal (for example, +a degrees or -a) Degree, a is a straight line of a positive number.
  • FIGS. 4a to 5b are diagrams showing another example of a reference line of a screen according to an exemplary embodiment of the present invention.
  • the reference line L base is previously set to be + a degrees from the upper or lower side of the screen border in the current screen mode.
  • the reference line L base is previously set to be -a degrees from the upper or lower side of the screen border in the current screen mode.
  • the specific step of calculating the angle between the reference line of the user's face image and the reference line of the screen of the present method may include: passing the direction of the reference line of the user's face image and the reference of the screen While the direction of the line is unchanged, the reference line of the user's face image and the reference line of the screen are translated together to form an angle to calculate an angle between the reference line of the user's face image and the reference line of the screen.
  • the included angle may be an acute angle between a reference line of the user's face image and a reference line of the screen.
  • FIGS. 6a to 6c are diagrams illustrating an example of calculating an included angle according to an exemplary embodiment of the present invention.
  • a reference line of a user's face image (for example, a line connecting the two eyes L AB ) is obtained according to a reference element (for example, a user's eyes), and in FIG.
  • a reference line L base of the screen is obtained, in the figure
  • the direction of the reference line L AB of the user's face image and the reference line L base of the screen are kept unchanged, and L AB and L base are translated together to form an included angle ⁇ , which is the user's The angle between the baseline of the face image and the baseline of the screen.
  • the angle between the baseline of the user's facial image and the baseline of the screen can also be calculated by other available means.
  • the screen mode switching can be performed on the mobile terminal.
  • the screen mode switching may be performed on the mobile terminal. Specifically, after calculating the angle between the reference line of the user's face image and the reference line of the screen, the included angle is compared with the preset range. If the clip corner is within the preset range, the current screen mode of the mobile terminal can be maintained, that is, the screen mode switching of the current screen of the mobile terminal is not performed. If the angle is outside the preset range, the screen mode switching can be performed on the current screen mode of the mobile terminal.
  • the user can preset the preset range according to experience or user habits. For example, the preset range may be preferably set to 0 to 50 degrees.
  • FIG. 7 is a block diagram showing the structure of an apparatus for screen mode switching according to an exemplary embodiment of the present invention.
  • an apparatus 700 for screen mode switching may include an image acquisition unit 701, a rotation calculation unit 702, and a screen switching unit 703.
  • the image acquisition unit 701 can acquire the facial image of the user by turning on the front camera.
  • the gravity sensor in the mobile terminal may be a gravity sensor that is usually configured by an existing mobile terminal
  • the front camera may be a camera that is usually configured by an existing mobile terminal.
  • the gravity sensor of the mobile terminal may sense the gravity direction of the mobile terminal according to an existing gravity sensing technology, and determine whether the mobile terminal needs to perform screen mode switching according to the sensed gravity direction.
  • the screen mode may include a landscape mode and a portrait mode. If the gravity sensor of the mobile terminal determines that the mobile terminal needs to perform screen mode switching, the image acquisition unit 701 can acquire the facial image of the user by turning on the front camera.
  • the rotation calculation unit 702 can calculate a rotation relationship between the face image of the user acquired by the image acquisition unit 701 and the screen.
  • the rotation calculation unit 702 can recognize the reference element in the face image of the user acquired by the image acquisition unit 701.
  • the reference element may include one of the following elements: eyes, glasses, nose, mouth, eyebrows, ears, and the like.
  • the rotation calculation unit 702 can obtain a reference line of the user's face image from the reference element.
  • a method of obtaining a reference line of a user's face image will be described below by taking an eye in a user's face image as an example.
  • the center coordinate point of the two eyes can be acquired by using the image recognition technology to recognize the position of the user's eyes in the user's face image (for example, the left eye center coordinate point A (x1, y1), the right eye center coordinate Point B (x2, y2)), and a straight line L AB is formed by the central coordinate points of both eyes to obtain a straight line connecting the eyes, and the obtained straight line connecting the two eyes is used as a reference line of the user's face image.
  • reference elements e.g., glasses, nose, mouth, eyebrows, ears, etc.
  • the rotation calculation unit 702 can calculate an angle between the reference line of the user's face image and the reference line of the screen. Specifically, the rotation calculation unit 702 can shift the reference line of the user's face image and the reference line of the screen to the same while maintaining the direction of the reference line of the user's face image and the direction of the reference line of the screen. Together, an angle is formed to calculate an angle between a reference line of the user's face image and a reference line of the screen.
  • the included angle may be an acute angle between a reference line of the user's face image and a reference line of the screen.
  • the reference line of the screen may be defaulted to be a straight line parallel to the upper or lower side of the screen border in the screen mode in which it is located.
  • the reference line of the screen may be a straight line that is set in advance to form a predetermined angle with an upper side line or a lower side line of the screen frame in the screen mode in which it is located.
  • the user may preliminarily set the reference line of the screen to a predetermined angle with the upper or lower line of the screen frame in the screen mode in consideration of factors such as habits or structural characteristics of the mobile terminal (for example, +a degrees or -a) Degree, a is a straight line of a positive number.
  • the rotation calculation unit 702 calculates the rotation relationship between the face image of the user and the screen, if the rotation relationship between the face image of the user calculated by the rotation calculation unit 702 and the screen satisfies the preset condition, the screen switching The unit 703 can perform screen mode switching on the mobile terminal.
  • the screen switching unit 503 can perform screen mode switching on the mobile terminal. Specifically, after the angle between the reference line of the user's face image and the reference line of the screen is calculated by the rotation calculation unit 702, the included angle is compared with the preset range. If the clip corner is within the preset range, the screen switching unit 703 can maintain the current screen mode of the mobile terminal, that is, not perform screen mode switching on the current screen of the mobile terminal. If the included angle is out of the preset range, the screen switching unit 703 may perform screen mode switching on the current screen mode of the mobile terminal.
  • the user can preset the preset range according to experience or user habits. For example, the preset range may be preferably set to 0 to 50 degrees.
  • the present invention provides a method and apparatus for screen mode switching, based on a change in the direction of gravity to determine whether to perform screen mode switching, based on a user's face photographed at a front camera of the mobile terminal
  • the rotation relationship between the image and the screen finally determines whether to perform switching of the screen mode, so that when the function of automatically switching the horizontal and vertical screens according to the scene is needed, the screen mode of the mobile terminal can be accurately switched to the screen mode required by the user.
  • User-friendly and user experience the method and apparatus only need to use the gravity sensor and the camera of the conventional configuration of the existing mobile terminal without adding additional hardware devices, thereby being able to effectively save costs while accurately switching the screen mode.
  • a computer, processor or programmable hardware includes a storage device that can store or receive software or computer code that is accessed by a computer, processor or hardware. The method described in the present invention is implemented and executed.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)
  • Image Analysis (AREA)
  • Telephone Function (AREA)
  • Studio Devices (AREA)

Abstract

提供了一种用于屏幕模式切换的方法、装置、计算机存储介质和设备，所述方法包括：如果移动终端的重力感应器确定所述移动终端需要进行屏幕模式切换，则通过开启前置摄像头来获取用户的脸部图像；计算所述用户的脸部图像与屏幕之间的旋转关系；如果所述旋转关系满足预设条件，则对所述移动终端进行屏幕模式切换。所述方法和装置能够准确地将移动终端的屏幕执行切换到用户需要的屏幕模式，提高了用户的体验，并且仅使用移动终端现有的硬件设备，从而有效地节省成本。

Description

用于屏幕模式切换的方法、装置、计算机存储介质和设备
本申请要求了申请日为2014年04月02日，申请号为201410131104.6发明名称为“用于屏幕模式切换的方法和装置”的中国专利申请的优先权。
技术领域
本发明涉及一种移动终端的屏幕控制技术，具体地说，涉及一种用于屏幕模式切换的方法、装置、计算机存储介质和设备。
背景技术
随着移动终端(诸如智能手机、平板电脑等)技术的迅速发展，移动终端已成为人们日常生活中的必需品。为了方便用户的使用，大多数移动终端都具有控制其屏幕的横屏和竖屏之间的切换的功能。
目前，控制移动终端的横竖屏切换的方法包括：(1)手动控制横竖屏的切换；(2)基于重力感应技术的横竖屏切换；(3)裸眼3D移动终端的横竖屏切换功能。
对于手动控制横竖屏切换的方法，每次都需要用户手动去操作改变屏幕的显示模式，不智能也不方便；对于基于重力感应技术的横竖屏切换的方法，当用户躺着或是以一定角度倾斜地使用移动终端时，根据重力感应结果切换到横屏，但实际上人眼观看屏幕的方式仍然是竖屏，这样就产生了严重的切换失误，给用户造成了不便；对于裸眼3D移动终端的横竖屏切换功能的方法，需要在现有移动终端上添加额外设备来实现，成本较高。
因此，需要一种针对移动终端的屏幕的方便的、准确性高的、成本低的横竖屏切换技术。
发明内容
本发明的目的在于至少克服上述缺点，并至少提供下述优点。
本发明的一方面在于提供一种用于屏幕模式切换的方法、装置、计算机存储介质和设备，所述方法和装置在使用重力方向的改变判断是否执行横竖屏切换的基础上，根据在移动终端的前置摄像头拍摄的用户脸部图像与屏幕之间的旋转关系，最终判断是否执行横竖屏切换，从而在需要使用根据场景自动切换横竖屏的功能时，能够准确地将移动终端的屏幕执行切换到用户需要的屏幕模式。
本发明的另一方面在于提供一种用于屏幕模式切换的方法、装置、计算机存储介质和设备，所述方法和装置仅需要使用现有的移动终端普通配置的重力感应器和摄像头来辅助屏幕切换功能，而无需增加额外的硬件设备。
根据本发明的一方面，提供了一种用于屏幕模式切换的方法，所述方法包括：如果移动终端的重力感应器确定所述移动终端需要进行屏幕模式切换，则通过开启前置摄像头来获取用户的脸部图像；计算所述用户的脸部图像与屏幕之间的旋转关系；如果所述旋转关系满足预设条件，则对所述移动终端进行屏幕模式切换。
所述计算所述用户的脸部图像与屏幕之间的旋转关系的步骤可具体包括：在所述用户的脸部图像中识别出基准元素；根据基准元素获得所述用户的脸部图像的基准线；计算所述用户的脸部图像的基准线与屏幕的基准线之间的夹角。
所述基准元素可包括如下元素中的一种：眼睛、眼镜、鼻子、嘴巴、眉毛、耳朵。
所述屏幕的基准线可以是与所在屏幕模式下的屏幕边框的上边线或下边线平行的直线或者可以是被预先设置为与所在屏幕模式下的屏幕边框的上边线或下边线形成预定角度的直线。
所述预设条件可包括所述夹角超出预设范围。
根据本发明的另一方面，提供了一种用于屏幕模式切换的装置，所述装置包括：图像获取单元，如果移动终端的重力感应器确定所述移动终端需要进行屏幕模式切换，则通过开启前置摄像头来获取用户的脸部图像；旋转计算单元，计算所述用户的脸部图像与屏幕之间的旋转关系；屏幕切换单元，如果所述旋转关系满足预设条件，则对所述移动终端进行屏幕模式切换。
旋转计算单元可在所述用户的脸部图像中识别出基准元素；根据基准元素获得所述用户的脸部图像的基准线；计算所述用户的脸部图像的基准线与屏幕的基准线之间的夹角。
所述基准元素可包括如下元素中的一种：眼睛、眼镜、鼻子、嘴巴、眉毛、耳朵。
所述屏幕的基准线可以是与所在屏幕模式下的屏幕边框的上边线或下边线平行的直线或者可以是被预先设置为与所在屏幕模式下的屏幕边框的上边线或下边线形成预定角度的直线。
所述预设条件可包括所述夹角超出预设范围。
根据本发明的另一方面，提供了一种计算机存储介质，所述计算机存储介质被编码有计算机程序，所述程序在被一个或多个计算机执行时使得所述一个或多个计算机执行如下操作：
如果移动终端的重力感应器确定所述移动终端需要进行屏幕模式切 换，则通过开启前置摄像头来获取用户的脸部图像；
计算所述用户的脸部图像与屏幕之间的旋转关系；
如果所述旋转关系满足预设条件，则对所述移动终端进行屏幕模式切换。
根据本发明的另一方面，提供了一种设备，包括至少一个处理器、存储器以及至少一个计算机程序；所述至少一个计算机程序存储于所述存储器并被所述至少一个处理器执行；所述计算机程序包括执行以下操作的指令：
如果移动终端的重力感应器确定所述移动终端需要进行屏幕模式切换，则通过开启前置摄像头来获取用户的脸部图像；
计算所述用户的脸部图像与屏幕之间的旋转关系；
如果所述旋转关系满足预设条件，则对所述移动终端进行屏幕模式切换。
根据本发明的用于屏幕模式切换的方法、装置、计算机存储介质和设备，一方面可准确地将移动终端的屏幕执行切换到用户需要的屏幕模式，方便用户使用，提高用户体验，另一方面可仅使用移动终端现有的硬件设备，从而有效地节省成本。
附图说明
通过结合附图，从实施例的下面描述中，本发明这些和/或其它方面及优点将会变得清楚，并且更易于理解，其中：
图1是示出根据本发明的示例性实施例的用于屏幕模式切换的方法的流程图；
图2a至图3c是示出根据本发明的示例性实施例的屏幕的基准线的 示例的示图；
图4a至图5b是示出根据本发明的示例性实施例的屏幕的基准线的另一示例的示图；
图6a至图6c是示出根据本发明的示例性实施例的计算夹角的示例的示图；
图7是示出根据本发明的示例性实施例的用于屏幕模式切换的装置的结构框图。
具体实施方式
提供参照附图的以下描述以帮助对由权利要求及其等同物限定的本发明的实施例的全面理解。包括各种特定细节以帮助理解，但这些细节仅被视为是示例性的。因此，本领域的普通技术人员将认识到在不脱离本发明的范围和精神的情况下，可对描述于此的实施例进行各种改变和修改。此外，为了清楚和简洁，省略对公知的功能和结构的描述。
图1是示出根据本发明的示例性实施例的用于屏幕模式切换的方法的流程图。参照图1，如果移动终端的重力感应器确定移动终端需要进行屏幕模式切换，则在101，可通过开启前置摄像头来获取用户的脸部图像。这里，移动终端中的重力感应器可以是现有的移动终端通常配置的重力感应器，前置摄像头可以是现有的移动终端通常配置的摄像头。
根据本发明的示例性实施例，移动终端的重力感应器可根据现有的重力感应技术感测移动终端的重力方向，并根据感测到的重力方向来确定移动终端是否需要进行屏幕模式切换。这里，屏幕模式可包括横屏模式和竖屏模式。如果移动终端的重力感应器确定移动终端需要进行屏幕模式切换，则本方法通过开启前置摄像头来获取用户的脸部图像。
在102，可计算用户的脸部图像与屏幕之间的旋转关系。
根据本发明的示例性实施例，首先，所述方法可在用户的脸部图像中识别出基准元素。这里，基准元素可包括如下元素中的一种：眼睛、眼镜、鼻子、嘴巴、眉毛、耳朵等。
随后，所述方法可根据基准元素获得用户的脸部图像的基准线。为了便于描述，下面以用户的脸部图像中的眼睛为例来说明获得用户的脸部图像的基准线的方法。
具体地说，可通过利用图像识别技术识别出用户的双眼在用户的脸部图像中的位置，获取双眼的中心坐标点(例如，左眼中心坐标点A(x1,y1)，右眼中心坐标点B(x2,y2))，并由双眼的中心坐标点构成一条直线LAB，来获得连接双眼的直线，并将获得的连接双眼的直线作为用户的脸部图像的基准线。本领域的普通技术人员应该理解，还可以根据类似的方法，利用其它基准元素(例如，眼镜、鼻子、嘴巴、眉毛、耳朵等)来获得用户的脸部图像的基准线。
随后，所述方法可计算用户的脸部图像的基准线与屏幕的基准线之间的夹角。下面，参照图2a至图5b来描述根据本发明的示例性实施例的屏幕的基准线的示例。
根据本发明的示例性实施例，屏幕的基准线可被默认为是与所在屏幕模式下的屏幕边框的上边线或下边线平行的直线。例如，如图2a至图3c所示，图2a至图3c是示出根据本发明的示例性实施例的屏幕的基准线的示例的示图。如果所在屏幕模式是竖屏模式，则如图2a，图2b和图2c所示，基准线Lbase可被默认为是与竖屏模式下的屏幕边框的上边线或下边线平行的直线。如果所在屏幕模式是横屏模式，则如图3a，图 3b和图3c，基准线Lbase可被默认为是与横屏模式下的屏幕边框的上边线或下边线平行的直线。
根据本发明的另一示例性实施例，所述屏幕的基准线可以是被预先设置为与所在屏幕模式下的屏幕边框的上边线或下边线形成预定角度的直线。这里，用户可考虑使用习惯或移动终端的结构特性等因素，预先将屏幕的基准线设置为与所在屏幕模式下的屏幕边框的上边线或下边线形成预定角度(例如，+a度或-a度，a是正数)的直线。这里，“+”表示屏幕的基准线在所在屏幕模式下的屏幕边框的上边线或下边线的逆时针旋转方向上，“-”表示基准线在所在屏幕模式下的屏幕边框的上边线或下边线的顺时针旋转方向上。
例如，如图4a至图5b所示，图4a至图5b是示出根据本发明的示例性实施例的屏幕的基准线的另一示例的示图。在图4a和图4b中，基准线Lbase被预先设置为与当前屏幕模式下的屏幕边框的上边线或下边线成+a度。在图5a和图5b中，基准线Lbase被预先设置为与当前屏幕模式下的屏幕边框的上边线或下边线成-a度。
本领域的技术人员容易理解，屏幕的基准线的设置不限于上述方式，还可以以任何其它可用方式来设置屏幕的基准线。
返回参照图1，本方法的计算用户的脸部图像的基准线与屏幕的基准线之间的夹角的具体步骤可包括：通过在保持用户的脸部图像的基准线的方向和屏幕的基准线的方向不变的同时，将用户的脸部图像的基准线和屏幕的基准线平移到一起以形成夹角，来计算用户的脸部图像的基准线与屏幕的基准线之间的夹角。这里，所述夹角可以是用户的脸部图像的基准线与屏幕的基准线之间的锐角夹角。
例如，如图6a至图6c所示，图6a至图6c是示出根据本发明的示例性实施例的计算夹角的示例的示图。在图6a中，根据基准元素(例如，用户的双眼)获得用户的脸部图像的基准线(例如，连接双眼的直线LAB)，在图6b中，获得屏幕的基准线Lbase，在图6c中，保持用户的脸部图像的基准线LAB和屏幕的基准线Lbase的方向不变，并将LAB和Lbase平移到一起，形成夹角θ，该夹角θ即为用户的脸部图像的基准线与屏幕的基准线之间的夹角。本领域的技术人员能够理解，还可通过其它可用的方式来计算用户的脸部图像的基准线与屏幕的基准线之间的夹角。
返回参照图1，如果计算出的用户的脸部图像与屏幕之间的旋转关系满足预设条件，则在103，可对移动终端进行屏幕模式切换。
根据本发明的示例性实施例，如果计算出的用户的脸部图像的基准线与屏幕的基准线之间的夹角超出预设范围，则可对移动终端进行屏幕模式切换。具体地说，在计算出用户的脸部图像的基准线与屏幕的基准线之间的夹角之后，将所述夹角与预设范围进行比较。如果所述夹角落入预设范围内，则可保持移动终端的当前屏幕模式，即，不对移动终端的当前屏幕进行屏幕模式切换。如果所述夹角超出预设范围，则可对移动终端的当前屏幕模式进行屏幕模式切换。这里，用户可根据经验或用户习惯预先设置预设范围。例如，预设范围可被优选地设置为0度至50度。
图7是示出根据本发明的示例性实施例的用于屏幕模式切换的装置的结构框图。
参照图7，根据本发明的示例性实施例的用于屏幕模式切换的装置700可包括图像获取单元701、旋转计算单元702和屏幕切换单元703。
具体地说，如果移动终端的重力感应器确定移动终端需要进行屏幕模式切换，则图像获取单元701可通过开启前置摄像头来获取用户的脸部图像。这里，移动终端中的重力感应器可以是现有的移动终端通常配置的重力感应器，前置摄像头可以是现有的移动终端通常配置的摄像头。
根据本发明的示例性实施例，移动终端的重力感应器可根据现有的重力感应技术感测移动终端的重力方向，并根据感测到的重力方向来确定移动终端是否需要进行屏幕模式切换。这里，屏幕模式可包括横屏模式和竖屏模式。如果移动终端的重力感应器确定移动终端需要进行屏幕模式切换，则图像获取单元701可通过开启前置摄像头来获取用户的脸部图像。
旋转计算单元702可计算由图像获取单元701获取的用户的脸部图像与屏幕之间的旋转关系。
根据本发明的示例性实施例，首先，旋转计算单元702可在由图像获取单元701获取的用户的脸部图像中识别出基准元素。这里，基准元素可包括如下元素中的一种：眼睛、眼镜、鼻子、嘴巴、眉毛、耳朵等。
随后，旋转计算单元702可根据基准元素获得用户的脸部图像的基准线。为了便于描述，下面以用户的脸部图像中的眼睛为例来说明获得用户的脸部图像的基准线的方法。具体地说，可通过利用图像识别技术识别出用户的双眼在用户的脸部图像中的位置，获取双眼的中心坐标点(例如，左眼中心坐标点A(x1,y1)，右眼中心坐标点B(x2,y2))，并由双眼的中心坐标点构成一条直线LAB，来获得连接双眼的直线，并将获得的连接双眼的直线作为用户的脸部图像的基准线。本领域的普通技术人员应该理解，还可以根据类似的方法，利用其它基准元素(例如， 眼镜、鼻子、嘴巴、眉毛、耳朵等)来获得用户的脸部图像的基准线。
随后，旋转计算单元702可计算用户的脸部图像的基准线与屏幕的基准线之间的夹角。具体地说，旋转计算单元702可通过在保持用户的脸部图像的基准线的方向和屏幕的基准线的方向不变的同时，将用户的脸部图像的基准线和屏幕的基准线平移到一起以形成夹角，来计算用户的脸部图像的基准线与屏幕的基准线之间的夹角。这里，所述夹角可以是用户的脸部图像的基准线与屏幕的基准线之间的锐角夹角。
根据本发明的示例性实施例，屏幕的基准线可被默认为是与所在屏幕模式下的屏幕边框的上边线或下边线平行的直线。根据本发明的另一示例性实施例，所述屏幕的基准线可以是被预先设置为与所在屏幕模式下的屏幕边框的上边线或下边线形成预定角度的直线。这里，用户可考虑使用习惯或移动终端的结构特性等因素，预先将屏幕的基准线设置为与所在屏幕模式下的屏幕边框的上边线或下边线形成预定角度(例如，+a度或-a度，a是正数)的直线。这里，“+”表示屏幕的基准线在所在屏幕模式下的屏幕边框的上边线或下边线的逆时针旋转方向上，“-”表示基准线在所在屏幕模式下的屏幕边框的上边线或下边线的顺时针旋转方向上。本领域的技术人员容易理解，屏幕的基准线的设置不限于上述方式，还可以以任何其它可用方式来设置屏幕的基准线。
在旋转计算单元702计算出用户的脸部图像与屏幕之间的旋转关系之后，如果由旋转计算单元702计算出的用户的脸部图像与屏幕之间的旋转关系满足预设条件，则屏幕切换单元703可对移动终端进行屏幕模式切换。
根据本发明的示例性实施例，如果由旋转计算单元702计算出的用 户的脸部图像的基准线与屏幕的基准线之间的夹角超出预设范围，则屏幕切换单元503可对移动终端进行屏幕模式切换。具体地说，在由旋转计算单元702计算出用户的脸部图像的基准线与屏幕的基准线之间的夹角之后，将所述夹角与预设范围进行比较。如果所述夹角落入预设范围内，则屏幕切换单元703可保持移动终端的当前屏幕模式，即，不对移动终端的当前屏幕进行屏幕模式切换。如果所述夹角超出预设范围，则屏幕切换单元703可对移动终端的当前屏幕模式进行屏幕模式切换。这里，用户可根据经验或用户习惯预先设置预设范围。例如，预设范围可被优选地设置为0度至50度。
本发明提供了一种用于屏幕模式切换的方法和装置，所述方法和装置在使用重力方向的改变判断是否执行屏幕模式切换的基础上，根据在移动终端的前置摄像头拍摄的用户脸部图像与屏幕之间的旋转关系，最终判断是否执行对屏幕模式进行切换，从而在需要使用根据场景自动切换横竖屏的功能时，能够准确地将移动终端的屏幕模式切换到用户需要的屏幕模式，方便用户使用，提高用户体验。此外，所述方法和装置仅需要使用现有的移动终端普通配置的重力感应器和摄像头，而无需增加额外的硬件设备，因此能够在准确地切换屏幕模式的同时有效地节省成本。
可根据计算机程序指令来执行根据本发明的上述方法。由于这些程序指令可被包括在计算机、专用处理器或可编程或专用硬件中，因此在其中执行的指令可有利于上述的功能的执行。如本领域的技术人员所理解的，计算机、处理器或可编程硬件包括可存储或接收软件或计算机代码的存储器件，所述软件或计算机代码在被计算机、处理器或硬件访问 和执行时实现在本发明中描述的方法。
虽然本发明是参照其示例性的实施例被显示和描述的，但是本领域的技术人员应该理解，在不脱离由权利要求及其等同物限定的本发明的精神和范围的情况下，可以对其形式和细节进行各种改变。

Claims (12)

  1. 一种用于屏幕模式切换的方法，所述方法包括：
    如果移动终端的重力感应器确定所述移动终端需要进行屏幕模式切换，则通过开启前置摄像头来获取用户的脸部图像；
    计算所述用户的脸部图像与屏幕之间的旋转关系；
    如果所述旋转关系满足预设条件，则对所述移动终端进行屏幕模式切换。
  2. 如权利要求1所述的方法，其特征在于，所述计算所述用户的脸部图像与屏幕之间的旋转关系的步骤，具体包括：
    在所述用户的脸部图像中识别出基准元素；
    根据基准元素获得所述用户的脸部图像的基准线；
    计算所述用户的脸部图像的基准线与屏幕的基准线之间的夹角。
  3. 如权利要求2所述的方法，其特征在于，所述基准元素包括如下元素中的一种：眼睛、眼镜、鼻子、嘴巴、眉毛、耳朵。
  4. 如权利要求2所述的方法，其特征在于，所述屏幕的基准线是与所在屏幕模式下的屏幕边框的上边线或下边线平行的直线或者是被预先设置为与所在屏幕模式下的屏幕边框的上边线或下边线形成预定角度的直线。
  5. 如权利要求2至4中任一项所述的方法，其特征在于，所述预设条件包括：所述夹角超出预设范围。
  6. 一种用于屏幕模式切换的装置，所述装置包括：
    图像获取单元，如果移动终端的重力感应器确定所述移动终端需要进行屏幕模式切换，则通过开启前置摄像头来获取用户的脸部图像；
    旋转计算单元，计算所述用户的脸部图像与屏幕之间的旋转关系；
    屏幕切换单元，如果所述旋转关系满足预设条件，则对所述移动终端进行屏幕模式切换。
  7. 如权利要求6所述的装置，其特征在于，旋转计算单元在所述用户的脸部图像中识别出基准元素；根据基准元素获得所述用户的脸部图像的基准线；计算所述用户的脸部图像的基准线与屏幕的基准线之间的夹角。
  8. 如权利要求6所述的装置，其特征在于，所述基准元素包括如下元素中的一种：眼睛、眼镜、鼻子、嘴巴、眉毛、耳朵。
  9. 如权利要求6所述的装置，其特征在于，所述屏幕的基准线是与所在屏幕模式下的屏幕边框的上边线或下边线平行的直线或者是被预先设置为与所在屏幕模式下的屏幕边框的上边线或下边线形成预定角度的直线。
  10. 如权利要求6至9中任一项所述的装置，其特征在于，所述预设条件包括：所述夹角超出预设范围。
  11. 一种计算机存储介质，所述计算机存储介质被编码有计算机程序，其特征在于，所述程序在被一个或多个计算机执行时使得所述一个或多个计算机执行如下操作：
    如果移动终端的重力感应器确定所述移动终端需要进行屏幕模式切换，则通过开启前置摄像头来获取用户的脸部图像；
    计算所述用户的脸部图像与屏幕之间的旋转关系；
    如果所述旋转关系满足预设条件，则对所述移动终端进行屏幕模式切换。
  12. 一种设备，包括至少一个处理器、存储器以及至少一个计算机程序；所述至少一个计算机程序存储于所述存储器并被所述至少一个处理器执行；其特征在于，所述计算机程序包括执行以下操作的指令：
    如果移动终端的重力感应器确定所述移动终端需要进行屏幕模式切换，则通过开启前置摄像头来获取用户的脸部图像；
    计算所述用户的脸部图像与屏幕之间的旋转关系；
    如果所述旋转关系满足预设条件，则对所述移动终端进行屏幕模式切换。
PCT/CN2014/088196 2014-04-02 2014-10-09 用于屏幕模式切换的方法、装置、计算机存储介质和设备 WO2015149498A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201410131104.6A CN103941985A (zh) 2014-04-02 2014-04-02 用于屏幕模式切换的方法和装置
CN201410131104.6 2014-04-02

Publications (1)

Publication Number Publication Date
WO2015149498A1 true WO2015149498A1 (zh) 2015-10-08

Family

ID=51189671

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2014/088196 WO2015149498A1 (zh) 2014-04-02 2014-10-09 用于屏幕模式切换的方法、装置、计算机存储介质和设备

Country Status (2)

Country Link
CN (1) CN103941985A (zh)
WO (1) WO2015149498A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107015745A (zh) * 2017-05-19 2017-08-04 广东小天才科技有限公司 屏幕操作方法、装置、终端设备及计算机可读存储介质

Families Citing this family (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103941985A (zh) * 2014-04-02 2014-07-23 百度在线网络技术（北京）有限公司 用于屏幕模式切换的方法和装置
WO2016011649A1 (zh) * 2014-07-24 2016-01-28 华为技术有限公司 终端设备屏幕显示模式的切换方法、装置及终端设备
CN105867780A (zh) * 2015-01-23 2016-08-17 中兴通讯股份有限公司 一种显示方法及其装置
CN106293303A (zh) * 2015-05-12 2017-01-04 中兴通讯股份有限公司 终端屏幕显示画面的旋转方法及装置
KR102400900B1 (ko) * 2015-10-26 2022-05-23 엘지전자 주식회사 시스템
CN105912103A (zh) * 2016-03-31 2016-08-31 乐视控股（北京）有限公司 移动终端应用桌面的显示处理方法、装置及移动终端
CN107450716A (zh) * 2016-05-31 2017-12-08 北京京东尚科信息技术有限公司 屏幕显示控制方法以及控制装置
CN107124569B (zh) * 2016-09-12 2018-05-22 平安科技（深圳）有限公司 视频通话调节方法和装置
CN106648056A (zh) * 2016-09-30 2017-05-10 宇龙计算机通信科技(深圳)有限公司 一种切换移动终端横竖屏显示的方法及装置
CN107340958B (zh) * 2017-06-23 2020-10-30 努比亚技术有限公司 横竖屏切换方法及移动终端
CN108447159B (zh) * 2018-03-28 2020-12-18 百度在线网络技术（北京）有限公司 人脸图像采集方法、装置和出入口管理系统
CN111092989A (zh) * 2019-10-29 2020-05-01 浙江杭佳科技发展有限公司 基于人脸特征的手机姿态实时估计方法

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101989126A (zh) * 2009-08-07 2011-03-23 深圳富泰宏精密工业有限公司 手持式电子装置及其屏幕画面自动旋转方法
CN102520842A (zh) * 2011-11-18 2012-06-27 广东欧珀移动通信有限公司 一种手持设备的横竖屏切换旋转控制方法
CN103941985A (zh) * 2014-04-02 2014-07-23 百度在线网络技术（北京）有限公司 用于屏幕模式切换的方法和装置
CN104125327A (zh) * 2013-04-29 2014-10-29 深圳富泰宏精密工业有限公司 屏幕旋转控制方法及系统

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105718088A (zh) * 2010-07-08 2016-06-29 唐建宁 一种计算机系统
CN102436304B (zh) * 2011-11-14 2015-04-08 华为技术有限公司 一种屏幕横竖显示模式切换的方法和终端
CN103376893A (zh) * 2012-04-25 2013-10-30 华为终端有限公司 显示画面的呈现方法及终端

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101989126A (zh) * 2009-08-07 2011-03-23 深圳富泰宏精密工业有限公司 手持式电子装置及其屏幕画面自动旋转方法
CN102520842A (zh) * 2011-11-18 2012-06-27 广东欧珀移动通信有限公司 一种手持设备的横竖屏切换旋转控制方法
CN104125327A (zh) * 2013-04-29 2014-10-29 深圳富泰宏精密工业有限公司 屏幕旋转控制方法及系统
CN103941985A (zh) * 2014-04-02 2014-07-23 百度在线网络技术（北京）有限公司 用于屏幕模式切换的方法和装置

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107015745A (zh) * 2017-05-19 2017-08-04 广东小天才科技有限公司 屏幕操作方法、装置、终端设备及计算机可读存储介质
CN107015745B (zh) * 2017-05-19 2020-03-24 广东小天才科技有限公司 屏幕操作方法、装置、终端设备及计算机可读存储介质

Also Published As

Publication number Publication date
CN103941985A (zh) 2014-07-23

Similar Documents

Publication Publication Date Title
WO2015149498A1 (zh) 用于屏幕模式切换的方法、装置、计算机存储介质和设备
US10701273B1 (en) User terminal apparatus and control method thereof
CN107357540B (zh) 一种显示方向的调整方法及移动终端
US9075429B1 (en) Distortion correction for device display
US9696859B1 (en) Detecting tap-based user input on a mobile device based on motion sensor data
US9589325B2 (en) Method for determining display mode of screen, and terminal device
ES2670699T3 (es) Terminal de comunicación móvil, procedimiento de ajuste de pantalla y medio de almacenamiento
US20200005522A1 (en) Reducing computational complexity in three-dimensional modeling based on two-dimensional images
US10126937B2 (en) Input techniques for virtual reality headset devices with front touch screens
WO2020001014A1 (zh) 图像美化方法、装置及电子设备
WO2012120799A1 (ja) 表示装置及び表示方向切替方法
TW201243823A (en) Screen image rotation method and system
CN103116400B (zh) 一种屏幕显示状态的控制方法及电子设备
TWI631506B (zh) 螢幕旋轉控制方法及系統
US20140160019A1 (en) Methods for enhancing user interaction with mobile devices
KR20040107890A (ko) 휴대폰의 영상 기울기 제어 방법
WO2016065706A1 (zh) 智能终端的控制方法、装置和计算机存储介质
CN104754216A (zh) 一种拍照方法及装置
WO2016054945A1 (zh) 终端显示界面的显示方法及装置
US9582169B2 (en) Display device, display method, and program
WO2015195623A1 (en) Dynamic template selection for object detection and tracking
WO2016011649A1 (zh) 终端设备屏幕显示模式的切换方法、装置及终端设备
WO2020073967A1 (zh) 一种横竖屏切换方法、可穿戴设备和具有存储功能的装置
EP3349095A1 (en) Method, device, and terminal for displaying panoramic visual content
US20170161914A1 (en) Photographing control methods, photographing control apparatuses, and photographing devices

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14888200

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase
122 Ep: pct application non-entry in european phase

Ref document number: 14888200

Country of ref document: EP

Kind code of ref document: A1