WO2014107982A1 - 一种控制终端屏幕画面旋转的方法及终端 - Google Patents
一种控制终端屏幕画面旋转的方法及终端 Download PDFInfo
- Publication number
- WO2014107982A1 WO2014107982A1 PCT/CN2013/085799 CN2013085799W WO2014107982A1 WO 2014107982 A1 WO2014107982 A1 WO 2014107982A1 CN 2013085799 W CN2013085799 W CN 2013085799W WO 2014107982 A1 WO2014107982 A1 WO 2014107982A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- terminal
- screen
- face
- user
- image data
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 47
- 238000012545 processing Methods 0.000 claims abstract description 12
- 230000001815 facial effect Effects 0.000 claims description 10
- 230000000007 visual effect Effects 0.000 abstract description 11
- 230000005484 gravity Effects 0.000 description 22
- 230000001133 acceleration Effects 0.000 description 7
- 238000006073 displacement reaction Methods 0.000 description 7
- 230000005291 magnetic effect Effects 0.000 description 7
- 238000010586 diagram Methods 0.000 description 6
- 238000005516 engineering process Methods 0.000 description 6
- 238000003909 pattern recognition Methods 0.000 description 4
- 238000004458 analytical method Methods 0.000 description 2
- 230000001174 ascending effect Effects 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 2
- 230000005294 ferromagnetic effect Effects 0.000 description 2
- 238000005259 measurement Methods 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 238000004590 computer program Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000037406 food intake Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/60—Rotation of whole images or parts thereof
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/012—Head tracking input arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
- G06V40/162—Detection; Localisation; Normalisation using pixel segmentation or colour matching
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
- G06V40/165—Detection; Localisation; Normalisation using facial parts and geometric relationships
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2200/00—Indexing scheme relating to G06F1/04 - G06F1/32
- G06F2200/16—Indexing scheme relating to G06F1/16 - G06F1/18
- G06F2200/163—Indexing scheme relating to constructional details of the computer
- G06F2200/1637—Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30196—Human being; Person
- G06T2207/30201—Face
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2340/00—Aspects of display data processing
- G09G2340/04—Changes in size, position or resolution of an image
- G09G2340/0492—Change of orientation of the displayed image, e.g. upside-down, mirrored
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2354/00—Aspects of interface with display user
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
Definitions
- the present invention relates to the field of electronic technologies, and in particular, to a method and a terminal for controlling rotation of a screen of a terminal. Background technique
- the screen as the carrier of vision is the most important means of information acquisition. How to make users get better user experience when using terminal equipment is the direction of many manufacturers. Improving the user experience through a beautiful screen display is the most direct and effective method.
- the screen rotation display technology improves the user experience by rotating the screen to make the screen image more in line with the user's operation.
- the existing screen rotation technology currently uses the gravity sensor built in the terminal to sense the direction of the gravity acceleration of the terminal to determine the direction of the screen, and then rotates, for example: When the user is in a standing state, the user holds the mobile phone from the longitudinal direction, the gravity sensor The direction of the screen is judged as a vertical screen. When the user is in the standing state and the user is holding the mobile phone laterally, the gravity sensor determines that the direction of the screen is a horizontal screen. However, this does not take into account the fact that the user's face posture actually changes.
- the gravity sensor determines that the direction of the screen is still the vertical screen, but according to the user's The direction of the screen of the eye should be the horizontal screen. According to the gravity sensor, the direction of the screen and the actual situation are judged to be wrong. The screen cannot be switched according to the change of the face posture, resulting in the user not being able to go smoothly.
- the use of the terminal the visual effect is poor, and the user experience is reduced.
- the image may be blurred, or even the picture that cannot be viewed, which brings a lot of inconvenience to the user in using the terminal. Summary of the invention
- Embodiments of the present invention provide a method and a terminal for controlling rotation of a screen of a terminal. Can enhance users The visual experience makes the terminal more intelligent.
- An embodiment of the present invention provides a method for controlling a screen rotation of a terminal, including: collecting user face image data;
- an embodiment of the present invention further provides a terminal, including:
- a first collecting unit configured to collect user face image data
- a first processing unit configured to process the user face image data to obtain face pose information
- a rotation unit configured to rotate the screen image according to the face pose information to adjust a screen orientation of the terminal.
- the method for obtaining the face pose information by collecting the user face image data, and rotating the screen image according to the face pose information to adjust the direction of the screen of the terminal screen can keep the screen image of the terminal in the front view direction of the user.
- the user's visual experience is enhanced, and the terminal is more intelligent.
- FIG. 1 is a schematic flow chart of a first embodiment of a method for controlling rotation of a screen of a terminal according to the present invention
- FIG. 2 is a schematic diagram of a "ten" word vector of a human face according to an embodiment of the present invention
- FIG. 3 is a schematic diagram of a plane coordinate system defined by a terminal according to an embodiment of the present invention.
- FIG. 4 is a schematic diagram showing an angular change amount of a face posture direction with respect to a reference direction according to an embodiment of the present invention
- FIG. 5 is a schematic flow chart of a second embodiment of a method for controlling rotation of a screen of a terminal according to the present invention.
- FIG. 6 is a flow chart showing a third embodiment of a method for controlling screen rotation of a terminal according to the present invention.
- FIG. 7 is a schematic structural view of a first embodiment of a terminal according to the present invention.
- FIG. 8 is a schematic structural view of a second embodiment of a terminal according to the present invention.
- FIG. 9 is a schematic structural view of a third embodiment of a terminal of the present invention. detailed description
- the terminal in the embodiment of the present invention may be a mobile terminal, such as a mobile phone, a tablet computer, a music player, or the like, having a screen display.
- a flow chart of a first embodiment of a method for controlling a screen rotation of a terminal according to the present invention is shown. As shown in FIG. 1 , a method for controlling screen rotation of a terminal according to this embodiment includes the following steps:
- the face image data of the user is collected, and the face image data of the user is taken by the front camera of the terminal.
- the face image data may include: facial features of the user such as facial features, skin color, hair, and the like.
- S101 Process the user face image data to obtain face pose information.
- the user face image data is parsed by using a pattern recognition technology to obtain face gesture information of the user.
- pattern recognition is a technique for classifying and describing images or various physical objects. It has a wide range of applications in machine vision, involving the recognition of graphics, images and texts, as well as the measurement, classification and description of tangible objects. .
- the face pose information includes an angular change amount of the face pose direction that is clockwise offset with respect to the reference direction set by the terminal.
- the face gesture direction is the "ten" word vector of the current face.
- the straight direction in which the eyes are connected is taken as the lateral direction 001 of the "ten" word vector of the face posture direction, and the direction from the left eye to the right eye is the horizontal axis square according to the obtained face image data.
- the straight direction in which the nose and the mouth are connected as the vertical direction of the "ten" word vector of the face posture direction
- the direction from the mouth to the nose is the positive direction of the vertical axis.
- the reference direction is a direction specified by the terminal in a predetermined plane coordinate system. The following is a detailed description in conjunction with Figure 3.
- the plane coordinate defined by the terminal is a plane coordinate system formed by the horizontal axis X axis 003 and the vertical axis Y axis 004 shown in FIG. 2.
- the horizontal axis X axis 003 and the vertical axis Y axis 004 The horizontal reference direction and vertical reference direction specified for the terminal.
- the reference direction is fixed with respect to the direction of the display screen of the terminal, that is, the reference direction is opposite to the direction of the display screen of the terminal, as shown by 005, and in the case of the vertical screen of the terminal, the X-axis 003 of the horizontal axis is through the midpoint of the terminal and parallel to the horizontal plane.
- the straight line direction is from the left end of the terminal to the right side of the terminal
- the vertical axis Y axis 004 is a straight line passing through the midpoint of the terminal and perpendicular to the horizontal plane, the straight line direction is from the bottom of the terminal to the upper end of the terminal direction.
- the amount of change in angle is an angle at which the direction of the face pose is clockwise offset with respect to the reference direction set by the terminal.
- the angle change amount 006 is the vertical direction of the "ten" word vector in the face posture direction, and the angular change amount of the vertical reference direction vertical axis Y axis 008 in the plane coordinate system defined by the terminal coordinate system in the terminal coordinate system.
- the angle change amount 007 is the angular change amount of the horizontal reference direction horizontal axis X-axis 009 in the horizontal coordinate direction of the "ten" word vector in the face posture direction.
- the change amount of the angle change amount 006 and the angle change amount 007 are equal.
- the vertical direction in the "ten" word vector of the face pose direction is clockwise offset from the vertical reference direction in the plane coordinate system defined by the terminal and the horizontal direction in the "ten” word vector in the face pose direction.
- the amount of angular change in the lateral reference direction in the plane coordinate system defined by the hour hand offset terminal is equal.
- the screen orientation of the terminal is adjusted according to the amount of change in the angle of the face posture information, so that the direction after the adjustment of the screen image conforms to the front view angle of the user.
- the vertical direction in the "ten" word vector of the face pose direction is clockwise offset from the vertical reference direction in the plane coordinate system specified by the terminal or the horizontal direction in the "ten" word vector in the face pose direction.
- the amount of change in the angle of the lateral reference direction in the plane coordinate system defined by the hour hand offset terminal is greater than or equal to 0° and less than 45.
- the vertical direction clockwise offsets the vertical reference direction in the plane coordinate system specified by the terminal or the lateral direction in the "ten" word vector in the face pose direction clockwise offset from the horizontal reference direction in the plane coordinate system specified by the terminal
- the amount of angular change is greater than or equal to 45. And less than 135.
- Rotating the screen to the vertical direction of the screen is clockwise offset by 90° with respect to the vertical reference direction and the lateral direction of the screen magic is clockwise offset with respect to the lateral reference direction by 90 ° ;
- the vertical direction in the "Ten" word vector of the face pose direction is clockwise offset from the vertical direction in the plane coordinate system specified by the terminal or the horizontal direction in the "Ten” word vector in the face pose direction
- the amount of change in the angle of the lateral reference direction in the plane coordinate system specified by the hour hand offset terminal is greater than or equal to 135° and less than 225°
- rotating the screen to the vertical direction of the screen relative to the vertical reference The direction is offset clockwise by 180.
- the lateral direction of the screen picture is offset clockwise by 180° with respect to the lateral reference direction;
- the vertical direction in the "ten" word vector of the face pose direction is clockwise offset in the plane coordinate system specified by the terminal
- the horizontal direction of the "ten" word vector in the vertical reference direction or the face posture direction is clockwise offset.
- the angular change amount of the lateral reference direction in the plane coordinate system specified by the terminal is greater than or equal to 225. And less than 315.
- the lateral direction of the screen picture is shifted clockwise by 270° with respect to the lateral reference direction; when the vertical direction in the "ten" word vector of the face pose direction is clockwise offset in the plane coordinate system specified by the terminal
- the horizontal direction of the "ten" word vector in the vertical reference direction or the face posture direction is clockwise offset.
- the angular change amount of the lateral reference direction in the plane coordinate system defined by the terminal is greater than or equal to 315. And less than 360. And rotating the screen to the vertical direction of the exhibition screen in the same direction as the vertical reference direction and the lateral direction of the exhibition screen in the same direction as the horizontal reference direction.
- the vertical direction in the "ten" word vector of the face pose direction is clockwise offset from the vertical reference direction in the plane coordinate system of the terminal, the vertical axis Y axis 008 or the face pose direction"
- the horizontal direction in the ten" word vector is clockwise offset.
- the angle of the angle change 006 of the horizontal axis X axis 009 is 60°.
- the amount of change in the angle of the lateral reference direction in the coordinate system is greater than or equal to 45° and small At 135.
- the vertical direction of the screen is shifted clockwise by 90 relative to the vertical reference direction.
- the lateral direction of the screen is offset clockwise by 90 relative to the lateral reference direction.
- the vertical direction of the screen screen rotated to the screen screen is shifted clockwise by 90° with respect to the vertical reference direction and the lateral direction of the screen screen is clockwise shifted by 90 with respect to the horizontal reference direction. . , so that the screen is always in the user's front view.
- no rotation is performed.
- the terminal processing background sends a rotating screen command to the display screen, and the display screen receives the rotating screen command to perform screen screen rotation.
- the rotation mode includes clockwise rotation and counterclockwise rotation.
- the terminal system analyzes and adjusts the adjusted screen orientation and the current screen orientation to obtain a minimum rotation angle, and rotates according to the minimum rotation angle.
- the method for obtaining the face pose information by collecting the user face image data, and rotating the screen image according to the face pose information to adjust the direction of the screen of the terminal screen can keep the screen image of the terminal in the front view direction of the user.
- the user's visual experience is enhanced, and the terminal is more intelligent.
- a flow chart of a second embodiment of a method for controlling a screen rotation of a terminal according to the present invention includes the following steps:
- S200 Receive data collected by the terminal sensor.
- the senor may include a built-in or external sensor (Gravure-sensor, G-sensor), a gyroscope, a geomagnetic sensor, and the like.
- the gravity sensor can perform real-time monitoring and collect the gravity information received by the terminal, and the gravity information includes an acceleration force, which is a force acting on the object during the acceleration process, for example, causing the object to sway and fall. , the force of movement of various objects such as ascending and descending.
- the gravitational information may further include an acceleration;
- the gyroscope is an angular motion detecting device that utilizes a momentum moment sensitive housing of the high speed revolving body to rotate around one or two axes orthogonal to the rotation axis with respect to the inertia space, and the gyroscope may
- the terminal performs the rotary motion
- the motion of the Austrian force shifts to the ⁇ , ⁇ , ⁇ directions of the space, and collects the displacement.
- the displacement data the movement direction of the terminal can be measured, and then the mobile phone is obtained.
- the geomagnetic sensor collects the amount of change in the magnetic field strength of the earth magnetic field when the ferromagnetic object passes, and detects the change of the terminal posture according to the change amount, and can determine the posture posture of the terminal when the terminal posture changes greatly Towards.
- step S201 Determine, according to the data, whether the posture of the terminal changes.
- step S202 perform step S202.
- the data to be collected by the sensor may include: the gravity information collected by the gravity sensor, the displacement data collected by the gyro sensor, or the magnetic field intensity change data collected by the geomagnetic sensor is sent to the terminal.
- the microprocessor performs analysis and calculation to obtain the attitude of the terminal relative to the horizontal plane, and obtains the placement posture of the terminal through the data. For example, the user's vertical handheld terminal is changed to a horizontal handheld terminal, and the gravity information is collected according to the gravity sensor to obtain the positioning posture of the terminal from the vertical direction to the horizontal direction.
- step S202 Determine whether the terminal posture change value is greater than or equal to a preset threshold.
- step S203 When the terminal posture change value is greater than or equal to a preset threshold, perform step S203.
- the threshold may be stored in the terminal system by a technician setting an optimal threshold.
- the posture change value may include a posture center of gravity change value, a posture direction change value, or a posture orientation change value, and the like.
- the terminal placement position is only slightly shifted from the original position, and does not affect the user's front view angle. For example: The terminal of the portrait is moved clockwise by an angle of 5. At this time, the position of the terminal is only slightly offset, and the user's use is not affected even if the screen orientation is not changed.
- S204 Processing the user face image data to obtain face pose information.
- the method for obtaining the face pose information by collecting the user face image data, and rotating the screen image according to the face pose information to adjust the direction of the screen of the terminal screen can keep the screen image of the terminal in the front view direction of the user.
- the user's visual experience is enhanced, and the terminal is more intelligent.
- FIG. 6 is a flowchart of a third embodiment of a method for controlling a screen rotation of a terminal according to the present invention.
- a method for controlling a screen rotation of a terminal according to this embodiment includes the following steps: 5300, Set the period for collecting face image data.
- the period for collecting face image data can be set on the built-in timer of the terminal.
- the image collector when the timer counts the period of the set face image data that is set, the image collector is started to collect the user face image data.
- the image collector may be a front camera of the terminal, and the face image data may include: facial features of the user's facial features, skin color, hair, and the like.
- the method of collecting the user face image data according to the set period may solve the problem that the user face image data cannot be solved according to the data collected by the sensor, for example: the terminal posture does not change and the face position can be observed. The changes that occur in turn adjust the orientation of the screen.
- the method for obtaining the face pose information by collecting the user face image data, and rotating the screen image according to the face pose information to adjust the direction of the screen of the terminal screen can keep the screen image of the terminal in the front view direction of the user.
- the user's visual experience is enhanced, and the terminal is more intelligent.
- FIG. 7 is a schematic structural diagram of a first embodiment of a terminal according to the present invention.
- a terminal according to this embodiment includes:
- the first collecting unit 100 is configured to collect user face image data.
- the first collection unit 100 may be a front camera of the terminal, and the front camera performs the ingestion of the face image data of the user.
- the face image data may include facial features of the user such as facial features, skin color, hair, and the like.
- the first processing unit 200 is configured to process the user face image data to obtain face pose information.
- the first processing unit 200 uses the pattern recognition technology to parse the user face image data to obtain the face gesture information of the user.
- pattern recognition is for images or various physical objects.
- the techniques for classification and description have a wide range of applications in machine vision, involving the recognition of graphics, images and text, as well as the measurement, classification and description of tangible objects.
- the face pose information includes an angular change amount of the face pose direction that is clockwise offset with respect to the reference direction set by the terminal.
- the face gesture direction is the "ten" word vector of the current face.
- the straight line direction in which the eyes are connected is taken as the lateral direction 001 of the "ten" word vector of the face posture direction, and the direction from the left eye to the right eye is the horizontal axis according to the obtained face image data.
- the straight direction in which the nose and the mouth are connected is taken as the vertical direction 002 of the "ten" word vector of the face posture direction, and the direction from the mouth to the nose is the positive direction of the vertical axis according to the obtained face image data.
- the reference direction is a direction specified by the terminal in a predetermined plane coordinate system. The following is a detailed description in conjunction with Figure 3.
- the plane coordinate defined by the terminal is a plane coordinate system formed by the horizontal axis X axis 003 and the vertical axis Y axis 004 shown in FIG. 2.
- the horizontal axis X axis 003 and the vertical axis Y axis 004 The horizontal reference direction and vertical reference direction specified for the terminal.
- the reference direction is fixed with respect to the direction of the display screen of the terminal, that is, the reference direction is opposite to the direction of the display screen of the terminal, as shown by 005, and in the case of the vertical screen of the terminal, the X-axis 003 of the horizontal axis is through the midpoint of the terminal and parallel to the horizontal plane.
- the straight line direction is from the left end of the terminal to the right side of the terminal
- the vertical axis Y axis 004 is a straight line passing through the midpoint of the terminal and perpendicular to the horizontal plane, the straight line direction is from the bottom of the terminal to the upper end of the terminal direction.
- the amount of change in angle is an angle at which the direction of the face pose is clockwise offset with respect to the reference direction set by the terminal.
- the angle change amount 006 is the vertical direction of the "ten" word vector in the face posture direction, and the angular change amount of the vertical reference direction vertical axis Y axis 008 in the plane coordinate system defined by the terminal coordinate system in the terminal coordinate system.
- the angle change amount 007 is the angular change amount of the horizontal reference direction horizontal axis X-axis 009 in the horizontal coordinate direction of the "ten" word vector in the face posture direction.
- the change amount of the angle change amount 006 and the angle change amount 007 are equal.
- the vertical direction in the "ten" word vector of the face pose direction is clockwise offset from the vertical reference direction in the plane coordinate system specified by the terminal and the horizontal direction in the "ten” word vector in the face pose direction.
- the amount of angular change in the lateral reference direction in the plane coordinate system defined by the hour hand offset terminal is equal.
- the rotating unit 300 is configured to rotate the screen according to the face posture information to adjust the terminal The direction of the exhibition screen.
- the rotation unit 300 adjusts the screen orientation of the terminal according to the amount of change in the angle of the face posture information, so that the adjusted direction of the screen image conforms to the front view angle of the user.
- the vertical direction in the "ten" word vector of the face pose direction is clockwise offset from the vertical reference direction in the plane coordinate system specified by the terminal or the horizontal direction in the "ten” word vector in the face pose direction
- the amount of change in the angle of the lateral reference direction in the plane coordinate system defined by the hour hand offset terminal is greater than or equal to 0° and less than 45.
- rotating the screen to the vertical direction of the screen is the same direction as the vertical reference direction and the lateral direction of the screen is in the same direction as the horizontal reference direction.
- the vertical direction in the "Ten” word vector of the face pose direction is clockwise offset
- the vertical direction in the plane coordinate system specified by the terminal or the horizontal direction in the "Ten” word direction in the face pose direction is clockwise
- the angular change amount of the lateral reference direction in the plane coordinate system defined by the shift terminal is greater than or equal to 45.
- the vertical direction of rotating the screen to the screen is shifted clockwise by 90° with respect to the vertical reference direction and the lateral direction of the screen magic is relatively smooth with respect to the horizontal reference direction
- the hour hand is offset by 90°; when the vertical direction in the "ten" word vector of the face pose direction is clockwise offset in the "ten” word vector in the vertical reference direction or the face pose direction in the plane coordinate system specified by the terminal
- the horizontal direction clockwise offsets the angular change amount of the lateral reference direction in the plane coordinate system specified by the terminal to be greater than or equal to 135° and less than 225.
- the vertical direction of the screen is shifted clockwise by 180 relative to the vertical reference direction.
- the lateral direction of the screen picture is offset clockwise by 180° with respect to the lateral reference direction;
- the vertical direction in the "ten" word vector of the face pose direction is clockwise offset in the plane coordinate system specified by the terminal
- the horizontal direction of the "ten" word vector in the vertical reference direction or the face posture direction is clockwise offset.
- the angular change amount of the lateral reference direction in the plane coordinate system specified by the terminal is greater than or equal to 225. And less than 315.
- the amount of angular change in the lateral reference direction in the coordinate system is greater than or equal to 45° and less than 135.
- the vertical direction of the screen is shifted clockwise by 90 relative to the vertical reference direction.
- the lateral direction of the screen is offset clockwise by 90 relative to the lateral reference direction.
- the vertical direction of the screen screen rotated to the screen screen is shifted clockwise by 90° with respect to the vertical reference direction and the lateral direction of the screen screen is clockwise shifted by 90 with respect to the horizontal reference direction. . , so that the screen is always in the user's front view.
- no rotation is performed.
- the terminal processing background sends a rotating screen command to the display screen, and the display screen receives the rotating screen command to perform screen screen rotation.
- the rotation mode includes clockwise rotation and counterclockwise rotation.
- the terminal system analyzes and adjusts the adjusted screen orientation and the current screen orientation to obtain a minimum rotation angle, and rotates according to the minimum rotation angle.
- the rotation unit 300 may further include:
- the first rotating unit 301 is configured to when the amount of change in the angle is greater than or equal to 0° and less than 45. And rotating the screen to the screen in the same direction as the reference direction.
- the first rotation unit 301 is configured to shift the vertical direction in the "ten" word vector of the face posture direction clockwise by the vertical reference direction or the face posture direction in the plane coordinate system defined by the terminal.
- the horizontal direction in the "ten" word vector is clockwise offset.
- the angular change amount of the lateral reference direction in the plane coordinate system specified by the terminal is greater than or equal to zero. And less than 45. And rotating the screen to the vertical direction of the exhibition screen in the same direction as the vertical reference direction and the lateral direction of the exhibition screen in the same direction as the horizontal reference direction.
- the second rotating unit 302 is configured to when the angle change amount is greater than or equal to 45. And when it is less than 135°, the direction in which the screen picture is rotated to the screen picture is shifted clockwise by 90 with respect to the reference direction. .
- the second rotation unit 302 is configured to shift the vertical direction in the "ten" word vector of the face posture direction clockwise by the vertical reference direction or the face posture direction in the plane coordinate system defined by the terminal.
- the horizontal direction in the "ten" word vector is clockwise offset.
- the third rotation unit 303 is configured to when the angle change amount is greater than or equal to 135. And less than 225.
- the direction in which the screen is rotated to the screen is clockwise offset 180 with respect to the reference direction. .
- the third rotation unit 303 is configured to shift the vertical direction in the "ten" word vector of the face posture direction clockwise by the vertical reference direction or the face posture direction in the plane coordinate system defined by the terminal.
- the horizontal direction in the "ten" word vector is clockwise offset.
- the angular change amount of the lateral reference direction in the plane coordinate system specified by the terminal is greater than or equal to 135. And less than 225.
- the vertical direction of the screen is shifted clockwise by 180 with respect to the vertical reference direction.
- the lateral direction of the screen picture is offset clockwise 180 with respect to the lateral reference direction. .
- the fourth rotating unit 304 is configured to when the amount of change in the angle is greater than or equal to 225. And less than 315.
- the direction in which the screen is rotated to the screen is clockwise offset 270 with respect to the reference direction. .
- the fourth rotation unit 304 is configured to shift the vertical direction in the "ten" word vector of the face posture direction clockwise to the vertical reference direction or the face posture direction in the plane coordinate system defined by the terminal.
- the horizontal direction in the "ten" word vector is clockwise offset.
- the angular change amount of the lateral reference direction in the plane coordinate system specified by the terminal is greater than or equal to 225. And less than 315.
- the fifth rotating unit 305 is configured to when the amount of change in the angle is greater than or equal to 315. And less than 360. And rotating the screen to the screen in the same direction as the reference direction.
- the fifth rotation unit 305 is configured to shift the vertical direction in the "ten" word vector of the face posture direction clockwise by the vertical reference direction or the face posture direction in the plane coordinate system specified by the terminal.
- the horizontal direction in the "ten" word vector is clockwise offset from the horizontal plane defined by the terminal.
- the amount of change in angle to the reference direction is greater than or equal to 315. And less than 360. And rotating the screen to the vertical direction of the exhibition screen in the same direction as the vertical reference direction and the lateral direction of the exhibition screen in the same direction as the horizontal reference direction.
- the method for obtaining the face pose information by collecting the user face image data, and rotating the screen image according to the face pose information to adjust the direction of the screen of the terminal screen can keep the screen image of the terminal in the front view direction of the user.
- the user's visual experience is enhanced, and the terminal is more intelligent.
- FIG. 8 is a schematic structural diagram of a second embodiment of a terminal according to the present invention.
- a terminal according to this embodiment includes:
- the first acquisition unit 100 the first processing unit 200, and the rotation unit 300.
- the terminal further includes:
- the receiving unit 101 is configured to receive data collected by the terminal sensor.
- the receiving unit 101 receives data collected by the sensor.
- the sensor may include a built-in or externally-mounted sensor (Gravity-sensor, G-sensor), a gyroscope, and a geomagnetic sensor.
- the gravity sensor can perform real-time monitoring and collect the gravity information received by the terminal, and the gravity information includes an acceleration force, which is a force acting on the object during the acceleration process, for example, causing the object to sway and fall. , the force of movement of various objects such as ascending and descending.
- the gravitational information may further include an acceleration;
- the gyroscope is an angular motion detecting device that utilizes a momentum moment sensitive housing of the high speed revolving body relative to the inertial space about one or two axes orthogonal to the rotation axis, and the gyroscope may In the X, Y, and ⁇ directions of the space generated by the rotation of the terminal, the displacement is shifted in three directions, and the displacement data is collected. According to the displacement data, the movement direction of the terminal can be measured, and then the mobile phone is obtained.
- the geomagnetic sensor collects the amount of change in the magnetic field strength of the earth magnetic field when the ferromagnetic object passes, and detects the change of the terminal posture according to the change amount, and can determine the posture direction of the terminal when the terminal posture changes greatly. .
- the first determining unit 102 is configured to determine, according to the data, whether the terminal posture changes.
- the data collected by the sensor may include gravity information collected by the gravity sensor, displacement data collected by the gyro sensor, or magnetic field intensity change data collected by the geomagnetic sensor, and sent to the microprocessor of the terminal for analysis and calculation. Obtaining the attitude of the terminal relative to the horizontal plane, and obtaining the placement posture of the terminal through the data. For example: user vertical handheld terminal changed to horizontal handheld terminal, root According to the gravity sensor, the gravity information is acquired to obtain the position of the terminal from the vertical direction to the horizontal direction.
- the first determining unit 102 notifies the second determining unit 103 whether the terminal posture change value is greater than or equal to a preset threshold.
- the second determining unit 103 is configured to determine, when the terminal posture changes, whether the terminal posture change value is greater than or equal to a preset threshold.
- the threshold may be stored in the terminal system by a technician setting an optimal threshold.
- the posture change value may include a posture center of gravity change value, a posture direction change value, or a posture orientation change value, and the like.
- the terminal placement position is only slightly shifted from the original position, and does not affect the user's front view angle. For example: The terminal of the portrait is moved clockwise by an angle of 5. At this time, the position of the terminal is only slightly offset, and the user's use is not affected even if the screen orientation is not changed.
- the second determining unit 103 notifies the first collecting unit 100 to collect the user face image data when the terminal posture change value is greater than or equal to the preset threshold.
- the method for obtaining the face pose information by collecting the user face image data, and rotating the screen image according to the face pose information to adjust the direction of the screen of the terminal screen can keep the screen image of the terminal in the front view direction of the user.
- the user's visual experience is enhanced, and the terminal is more intelligent.
- FIG. 9 is a schematic structural diagram of a third embodiment of a terminal according to the present invention.
- a terminal according to this embodiment includes:
- the first acquisition unit 100 the first processing unit 200, and the rotation unit 300.
- the collection period unit 201 is configured to set a period for collecting face image data.
- the period for collecting face image data can be set on the built-in timer of the terminal.
- the second collecting unit 202 is configured to collect user face image data according to the set period.
- the second collection unit 202 starts the image collector to collect the user face image data.
- the image collector may be a front camera of the terminal, and the face image data may include: facial features of the user such as facial features, skin color, hair, and the like. Among them, according to the settings
- the collecting the user face image data in the cycle can solve the problem that the user face image data cannot be solved according to the data collected by the sensor, for example: the terminal posture does not change, but the user changes to the face position and then changes Adjust the orientation of the screen.
- the screen screen of the terminal can always be kept in the front view of the user. In the direction, the user's visual experience is enhanced, and the terminal is more intelligent.
- the module or unit in the embodiment of the present invention may be implemented by a general-purpose integrated circuit, such as a CPU (Central Processing Unit), or an ASIC (Application Specific Integrated Circuit).
- a general-purpose integrated circuit such as a CPU (Central Processing Unit), or an ASIC (Application Specific Integrated Circuit).
- Modules or units in the apparatus of the embodiments of the present invention may be combined, divided, and deleted according to actual needs.
- the method for obtaining the face position by collecting the user face image data and adjusting the direction of the terminal screen image according to the face position can keep the screen of the terminal in the front view direction of the user, thereby improving the user's
- the visual experience makes the terminal more intelligent.
- the storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM), or a random access memory (RAM).
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Health & Medical Sciences (AREA)
- Oral & Maxillofacial Surgery (AREA)
- General Engineering & Computer Science (AREA)
- General Health & Medical Sciences (AREA)
- Multimedia (AREA)
- Geometry (AREA)
- User Interface Of Digital Computer (AREA)
- Image Analysis (AREA)
- Image Processing (AREA)
Abstract
Description
Claims
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US14/381,093 US9373156B2 (en) | 2013-01-11 | 2013-10-23 | Method for controlling rotation of screen picture of terminal, and terminal |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN2013100102227A CN103092344A (zh) | 2013-01-11 | 2013-01-11 | 一种控制终端屏幕画面旋转的方法及终端 |
CN201310010222.7 | 2013-01-11 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2014107982A1 true WO2014107982A1 (zh) | 2014-07-17 |
Family
ID=48205016
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2013/085799 WO2014107982A1 (zh) | 2013-01-11 | 2013-10-23 | 一种控制终端屏幕画面旋转的方法及终端 |
Country Status (3)
Country | Link |
---|---|
US (1) | US9373156B2 (zh) |
CN (1) | CN103092344A (zh) |
WO (1) | WO2014107982A1 (zh) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113535051A (zh) * | 2020-04-14 | 2021-10-22 | 深圳市万普拉斯科技有限公司 | 移动终端屏幕旋转控制方法、装置及计算机设备 |
Families Citing this family (41)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE102009037835B4 (de) | 2009-08-18 | 2012-12-06 | Metaio Gmbh | Verfahren zur Darstellung von virtueller Information in einer realen Umgebung |
CN103092344A (zh) * | 2013-01-11 | 2013-05-08 | 深圳市金立通信设备有限公司 | 一种控制终端屏幕画面旋转的方法及终端 |
TWI631506B (zh) * | 2013-04-29 | 2018-08-01 | 群邁通訊股份有限公司 | 螢幕旋轉控制方法及系統 |
CN104346030A (zh) * | 2013-08-01 | 2015-02-11 | 腾讯科技(深圳)有限公司 | 显示方向切换方法、装置及电子设备 |
CN103455256B (zh) * | 2013-08-21 | 2017-09-15 | 小米科技有限责任公司 | 旋转屏幕显示画面的方法和终端 |
CN104423546A (zh) * | 2013-08-28 | 2015-03-18 | 联芯科技有限公司 | 一种方向传感实现方法及终端设备 |
CN103472976B (zh) * | 2013-09-17 | 2017-04-12 | 百度在线网络技术(北京)有限公司 | 一种街景图片的显示方法及系统 |
CN103489155B (zh) * | 2013-09-18 | 2016-10-05 | 厦门美图网科技有限公司 | 一种基于传感器的水平自动矫正的拍照方法 |
US9646422B2 (en) * | 2013-09-24 | 2017-05-09 | Apple Inc. | Method for representing points of interest in a view of a real environment on a mobile device and mobile device therefor |
CN104598136B (zh) * | 2013-10-31 | 2018-07-31 | 纬创资通(昆山)有限公司 | 移动装置及移动装置的显示画面旋转方法 |
JPWO2015098190A1 (ja) * | 2013-12-27 | 2017-03-23 | ソニー株式会社 | 制御装置、制御方法及びコンピュータプログラム |
CN103760975B (zh) * | 2014-01-02 | 2017-01-04 | 深圳宝龙达信息技术股份有限公司 | 一种追踪定位人脸的方法及显示系统 |
CN103760978B (zh) * | 2014-01-13 | 2017-11-28 | 联想(北京)有限公司 | 一种信息处理方法与电子设备 |
CN104866809B (zh) * | 2014-02-25 | 2021-05-11 | 腾讯科技(深圳)有限公司 | 画面播放方法和装置 |
CN104932949A (zh) * | 2014-03-17 | 2015-09-23 | 中兴通讯股份有限公司 | 一种基于标志捕捉的用户界面过渡效果的测量方法和装置 |
CN105630140A (zh) * | 2014-10-30 | 2016-06-01 | 深圳富泰宏精密工业有限公司 | 界面旋转系统及方法 |
CN105721739B (zh) * | 2014-12-04 | 2020-04-10 | 富泰华工业(深圳)有限公司 | 屏幕影像画面防抖系统及方法 |
CN105812648A (zh) * | 2014-12-30 | 2016-07-27 | 深圳富泰宏精密工业有限公司 | 照片方位校正系统及方法 |
CN104636036A (zh) * | 2015-01-12 | 2015-05-20 | 青岛海信电器股份有限公司 | 一种画面显示控制方法及装置 |
TW201630413A (zh) * | 2015-02-03 | 2016-08-16 | 鴻海精密工業股份有限公司 | 電視機高度自動調節系統及方法 |
CN106161916B (zh) * | 2015-04-08 | 2019-10-29 | 联想(北京)有限公司 | 一种图像采集方法及电子设备 |
CN104898920B (zh) * | 2015-04-29 | 2018-08-07 | 深圳市万普拉斯科技有限公司 | 旋转移动终端屏幕画面的方法和装置 |
CN104796619B (zh) * | 2015-05-05 | 2018-01-16 | 广东欧珀移动通信有限公司 | 拍照的方法、装置及移动终端 |
CN105653018B (zh) * | 2015-05-28 | 2018-09-07 | 宇龙计算机通信科技(深圳)有限公司 | 一种界面方向调整方法及装置 |
CN105468149B (zh) * | 2015-11-19 | 2019-02-22 | 广东小天才科技有限公司 | 一种控制摄像头进行旋转拍摄的方法、系统及智能手表 |
CN105975172A (zh) * | 2015-12-11 | 2016-09-28 | 乐视网信息技术(北京)股份有限公司 | 全景视频的调整方法、装置及移动终端 |
CN105867619B (zh) * | 2016-03-28 | 2019-02-05 | 联想(北京)有限公司 | 一种信息处理方法及电子设备 |
CN107450716A (zh) * | 2016-05-31 | 2017-12-08 | 北京京东尚科信息技术有限公司 | 屏幕显示控制方法以及控制装置 |
CN106550131A (zh) * | 2016-10-25 | 2017-03-29 | 惠州Tcl移动通信有限公司 | 一种实现移动终端界面内容旋转显示的方法及系统 |
CN108614634A (zh) * | 2016-12-09 | 2018-10-02 | 北京视联动力国际信息技术有限公司 | 一种移动设备显示屏幕旋转的方法和移动设备 |
CN107300973A (zh) * | 2017-06-21 | 2017-10-27 | 深圳传音通讯有限公司 | 屏幕旋转控制方法、系统以及装置 |
CN108153423A (zh) * | 2018-01-10 | 2018-06-12 | 重庆大学 | 一种面向人机交互的视觉姿态自适应系统 |
CN109254710B (zh) * | 2018-08-28 | 2021-01-19 | Oppo广东移动通信有限公司 | 屏幕旋转方法、装置、终端设备及计算机可读取存储介质 |
CN110045753A (zh) * | 2019-03-28 | 2019-07-23 | 南京巨鲨显示科技有限公司 | 一种控制显示器屏幕跟随显示器横纵状态自动旋转的方法 |
CN110581910A (zh) | 2019-09-17 | 2019-12-17 | Oppo广东移动通信有限公司 | 图像采集方法、装置、终端及存储介质 |
CN111092989A (zh) * | 2019-10-29 | 2020-05-01 | 浙江杭佳科技发展有限公司 | 基于人脸特征的手机姿态实时估计方法 |
WO2021107687A1 (ko) * | 2019-11-27 | 2021-06-03 | 주식회사 도트힐 | 자세 교정용 디스플레이 거치 장치 및 이를 이용한 디스플레이 거치 제어 시스템 |
CN111078093A (zh) * | 2019-12-20 | 2020-04-28 | 深圳创维-Rgb电子有限公司 | 屏幕画面的旋转控制方法、装置、电子产品及存储介质 |
CN111885314B (zh) * | 2020-08-26 | 2024-04-02 | 深圳市雷鸟网络传媒有限公司 | 屏幕调整方法、装置、终端及计算机可读存储介质 |
CN114205553A (zh) * | 2021-10-18 | 2022-03-18 | 深圳市酷客智能科技有限公司 | 一种婴儿监护装置及其控制方法 |
CN113918023B (zh) * | 2021-10-29 | 2023-12-05 | 深圳Tcl数字技术有限公司 | 屏保显示方法、装置及显示设备 |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101483719A (zh) * | 2008-01-10 | 2009-07-15 | 株式会社尼康 | 信息显示装置 |
CN201986038U (zh) * | 2011-02-12 | 2011-09-21 | 福建捷联电子有限公司 | 具有头像识别功能的自动旋转显示装置 |
CN102760024A (zh) * | 2011-04-26 | 2012-10-31 | 鸿富锦精密工业(深圳)有限公司 | 屏幕图像旋转方法及系统 |
CN103092344A (zh) * | 2013-01-11 | 2013-05-08 | 深圳市金立通信设备有限公司 | 一种控制终端屏幕画面旋转的方法及终端 |
Family Cites Families (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7565183B2 (en) * | 2004-11-15 | 2009-07-21 | Sony Ericsson Mobile Communications Ab | Mobile device with selectable camera position |
CN101800816B (zh) * | 2010-04-08 | 2012-10-17 | 华为终端有限公司 | 移动终端的触摸屏的横竖屏切换方法及移动终端 |
CN102436304B (zh) * | 2011-11-14 | 2015-04-08 | 华为技术有限公司 | 一种屏幕横竖显示模式切换的方法和终端 |
-
2013
- 2013-01-11 CN CN2013100102227A patent/CN103092344A/zh active Pending
- 2013-10-23 US US14/381,093 patent/US9373156B2/en active Active
- 2013-10-23 WO PCT/CN2013/085799 patent/WO2014107982A1/zh active Application Filing
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101483719A (zh) * | 2008-01-10 | 2009-07-15 | 株式会社尼康 | 信息显示装置 |
CN201986038U (zh) * | 2011-02-12 | 2011-09-21 | 福建捷联电子有限公司 | 具有头像识别功能的自动旋转显示装置 |
CN102760024A (zh) * | 2011-04-26 | 2012-10-31 | 鸿富锦精密工业(深圳)有限公司 | 屏幕图像旋转方法及系统 |
CN103092344A (zh) * | 2013-01-11 | 2013-05-08 | 深圳市金立通信设备有限公司 | 一种控制终端屏幕画面旋转的方法及终端 |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113535051A (zh) * | 2020-04-14 | 2021-10-22 | 深圳市万普拉斯科技有限公司 | 移动终端屏幕旋转控制方法、装置及计算机设备 |
Also Published As
Publication number | Publication date |
---|---|
CN103092344A (zh) | 2013-05-08 |
US20150042556A1 (en) | 2015-02-12 |
US9373156B2 (en) | 2016-06-21 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2014107982A1 (zh) | 一种控制终端屏幕画面旋转的方法及终端 | |
JP5857257B2 (ja) | 表示装置及び表示方向切替方法 | |
WO2023071884A1 (zh) | 注视检测方法、电子设备的控制方法及相关设备 | |
US8896533B2 (en) | Display directional sensing | |
US9696859B1 (en) | Detecting tap-based user input on a mobile device based on motion sensor data | |
US8179449B2 (en) | Portable electronic apparatus including a display and method for controlling display content based on movement of the display and user position | |
CN103118168B (zh) | 一种未处理信息的显示控制方法及终端 | |
US9459698B2 (en) | Gesture based power management system and method | |
TWI543019B (zh) | 自動化裝置顯示器的定向偵測技術 | |
JP6171615B2 (ja) | 情報処理装置及びプログラム | |
KR102612988B1 (ko) | 디스플레이 장치 및 디스플레이 장치의 영상 처리 방법 | |
US20130046505A1 (en) | Methods and apparatuses for use in classifying a motion state of a mobile device | |
US10659595B2 (en) | Determining orientation of a mobile device | |
TWI631506B (zh) | 螢幕旋轉控制方法及系統 | |
EP3193240B1 (en) | Interface interaction apparatus and method | |
WO2015149498A1 (zh) | 用于屏幕模式切换的方法、装置、计算机存储介质和设备 | |
WO2023071882A1 (zh) | 人眼注视检测方法、控制方法及相关设备 | |
WO2014169658A1 (zh) | 一种告警方法及装置 | |
WO2017005070A1 (zh) | 显示控制方法及装置 | |
CN105718232A (zh) | 一种任意角平面旋转显示方法及显示装置 | |
KR101685388B1 (ko) | 복수의 센서를 이용한 동작 인식 방법 및 장치 | |
CN110337624A (zh) | 姿态转换方法、姿态显示方法及云台系统 | |
US10551195B2 (en) | Portable device with improved sensor position change detection | |
US20180053490A1 (en) | Display device and method of displaying image on display device | |
TWI556156B (zh) | 調整畫面顯示方向的方法及其相關裝置 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
WWE | Wipo information: entry into national phase |
Ref document number: 14381093 Country of ref document: US |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 13871142 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 13871142 Country of ref document: EP Kind code of ref document: A1 |
|
32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 05.02.2016) |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 13871142 Country of ref document: EP Kind code of ref document: A1 |