TW201506812A - Method and device for switching display direction, electronic device and machine-readable storage medium - Google Patents

Abstract

A method and a device for switching a display direction, an electronic device and a machine-readable storage medium are disclosed. The method for switching the display direction includes: determining a direction of display content on a screen of the electronic device to be switched after the electronic device is rotated; capturing a facial image for determining a facial position with a preset camera; detecting whether the direction to be switched matches the facial position; and switching a current display direction of the display content on the screen according to the direction to be switched if the detected result represents that the direction to be switched matches the facial position. The present invention can adaptively adjust the current display direction of the display content on the screen according to the facial position.

Description

Display direction switching method and device, electronic device and machine readable storage medium

The present invention relates to the field of Internet terminals, and more particularly to a display direction switching method, apparatus, and electronic device.

At present, horizontal and vertical screen switching technology has been widely used in electronic devices such as smart phones, tablets, e-book readers or electronic notebooks. The horizontal and vertical screen switching technology refers to a technology in which the current display direction of the display content on the screen of the electronic device is switched correspondingly to adapt to the line of sight direction of the user when the electronic device rotates, and the essence is a display direction self-adjusting switching technology.

The common display direction switching method includes: the electronic device detects the direction of the gravity acceleration through the built-in gravity acceleration sensor; and the electronic device detects whether the current display direction of the displayed content on the screen is consistent with the detected direction of the gravitational acceleration; if the detection result If the current display direction is inconsistent with the direction of gravity acceleration, the current display direction of the displayed content on the screen is switched such that the display direction is consistent with the direction of gravity acceleration. In addition, the electronic device generally provides an option to enable or disable the display direction switching function, that is, when the switching function is turned on, the current display direction of the displayed content on the screen is switched following the gravity acceleration direction, in the switching function. When turned off, the current display orientation of the content displayed on the screen remains the same, instead of following the direction of gravity acceleration.

However, the prior art has the following problem: when the user is lying in bed using a mobile phone or a tablet computer, the display direction of the displayed content on the screen is inconsistent with the actual line of sight direction of the user after automatically following the direction of gravity acceleration. At this time, after the user needs to rotate the electronic device back, the switching function is turned off to be able to view normally. Therefore, it is necessary to propose a solution to the problem that the current display direction of the displayed content on the screen may be inconsistent with the actual line of sight direction of the user after automatically following the direction of the gravitational acceleration.

In order to solve the problem that the current display direction of the display content on the screen is inconsistent with the actual line of sight direction of the user after the direction of the gravity acceleration is automatically switched, the embodiment of the present invention provides a display direction switching method, device, and electronic device. The technical solution is as follows: the display direction switching method of the present invention is used for an electronic device, the electronic device includes a front camera, and the display direction switching method includes: after the electronic device is rotated, determining the electronic device Displaying a direction of the content to be switched on one of the screens; capturing a face image through the front camera to determine a face position; detecting whether the to-be-switched direction matches the face position to enable the display on the screen The content is a forward image with respect to the user; and if the detection result is that the to-be-switched direction matches the face position, the current display direction of the content displayed on the screen is switched according to the to-be-switched direction.

The display direction switching device of the present invention is used for an electronic device, the electronic device includes a front camera, and the display direction switching device includes: a direction determining module, configured to: After the electronic device is rotated, determining a direction to be switched of the content displayed on one of the electronic devices; a face determining module configured to determine a face position by capturing a face image through the front camera; a direction detecting module, configured to detect whether the direction to be switched determined by the direction determining module matches the face position determined by the face determining module, so that the displayed content on the screen is relative to the use And a direction switching module, configured to: if the detection result of the direction detecting module is that the to-be-switched direction matches the face position, the screen is to be switched according to the to-be-switched direction The current display direction of the displayed content is switched.

The electronic device of the present invention includes the display direction switching device as described above.

The technical solution provided by the embodiment of the present invention has the beneficial effects that the face image captured by the front camera determines the face position, detects whether the to-be-switched direction matches the face position, and switches the display content according to the detection result. The display direction is used to solve the problem that when the electronic device rotates, the display direction of the display content on the screen is automatically inconsistent with the direction of gravity acceleration, and the actual line of sight direction of the user is inconsistent. After the user needs to rotate the electronic device back, The problem that the switching function can be normally viewed is turned off, and the effect of switching the display direction of the displayed content on the screen is only achieved when the direction to be switched matches the position of the face.

400‧‧‧ Direction Determination Module

402‧‧‧Signal Detection Unit

404‧‧‧Signal detection unit

406‧‧‧ Direction Determination Unit

420‧‧‧Face determination module

422‧‧‧Image capture unit

422a‧‧‧Light Acquisition Subunit

422b‧‧‧Exposure Analysis Subunit

422c‧‧‧Image capture subunit

424‧‧‧Image detection unit

426‧‧‧Line Determination Unit

440‧‧‧ Direction Detection Module

460‧‧‧ Direction Switching Module

480‧‧‧ Directional Judgment Module

490‧‧‧ Directional Holder Module

a, d, e, f‧‧‧ directions

b, c‧‧‧ straight line

X‧‧‧right angle

S100-S106, S200-S206, S300-S312‧‧‧ steps

FIG. 1 is a flowchart of a display direction switching method according to an embodiment of the present invention.

FIG. 2A is a flowchart of a display direction switching method according to another embodiment of the present invention.

FIG. 2B is a schematic diagram of an implementation of a line to be switched and a line where two eyes are located according to another embodiment of the present invention.

FIG. 2C is a diagram showing a direction to be switched and a line matching the eyes according to another embodiment of the present invention. Schematic diagram of the implementation.

FIG. 2D is a schematic diagram of an implementation of matching a direction of a to-be-switched line with a line of both eyes according to another embodiment of the present invention.

FIG. 3A is a flowchart of a display direction switching method according to another embodiment of the present invention.

FIG. 3B is a schematic diagram of an implementation of a direction to be switched and a direction of a line of sight according to another embodiment of the present invention.

FIG. 3C is a schematic diagram of an implementation of a direction to be switched that is consistent with a line of sight direction according to another embodiment of the present invention.

FIG. 3D is a schematic diagram of an implementation of the current display direction and the line of sight direction according to another embodiment of the present invention.

FIG. 3E is a schematic diagram of an implementation in which the current display direction and the line of sight direction are inconsistent according to another embodiment of the present invention.

FIG. 4 is a block diagram of a display direction switching device according to an embodiment of the present invention.

FIG. 5 is a block diagram of a display direction switching device according to another embodiment of the present invention.

FIG. 6 is a block diagram of a display direction switching device according to another embodiment of the present invention.

The present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

The "electronic device" described herein is typically an electronic device that includes a front camera. Specifically, the electronic device can be a smart phone, a tablet, an e-book reader, and an MP3 (Moving Picture Experts Group Audio Layer III) compression standard. Audio level 3) Player, MP4 (Moving Picture Experts Group Audio Layer IV) player, laptop portable computer and desktop computer, etc. It should be noted that the "front camera" in this article may be a front camera built in an electronic device, or an external camera connected to an electronic device for capturing an image of the front of the screen of the electronic device.

Please refer to FIG. 1 , which is a flowchart of a display direction switching method according to an embodiment of the present invention. This embodiment is mainly illustrated by using the display direction switching method in an electronic device including a front camera. The display direction switching method includes: in step S100, after the electronic device rotates, determining a to-be-switched direction of content displayed on one of the electronic devices.

Step S102, determining a face position by capturing a face image from the front camera.

Step S104: It is detected whether the to-be-switched direction matches the face position to make the display content on the screen be a forward image with respect to the user.

Step S106: If the detection result is that the to-be-switched direction matches the face position, the current display direction of the content displayed on the screen is switched according to the to-be-switched direction.

In summary, the display direction switching method provided by the embodiment of the present invention determines a face position through a face image captured by the front camera, and detects whether the to-be-switched direction matches the face position, according to The detection result switches the display direction of the displayed content on the screen, thereby solving the fact that when the electronic device rotates, the current display direction of the displayed content on the screen is automatically followed by the gravity acceleration direction, and the user actually Inconsistent line of sight When the user needs to rotate the electronic device back, the problem that the switching function can be normally viewed is turned off, so that the display content on the screen is switched only when the to-be-switched direction matches the face position. The effect of the current display orientation.

Since the face position can be represented by at least one of the following features: 1. a straight line where the eyes are located; and 2, a line of sight direction, that is, a direction perpendicular to the line connecting the eyes and pointing to the mouth in the face, so the following The invention is illustrated in detail by two different embodiments.

Please refer to FIG. 2A , which is a flowchart of a display direction switching method according to another embodiment of the present invention. In this embodiment, the display direction switching method is mainly applied to an electronic device including a front camera, and the position of the face is characterized by a straight line of both eyes. The display direction switching method includes: Step S200: After the electronic device rotates, determine a to-be-switched direction of the content displayed on one of the electronic devices.

More specifically, after the electronic device is rotated, the direction to be switched of the displayed content on the screen is generally determined according to a direction of gravity acceleration. Specifically, this step includes but is not limited to the following three sub-steps:

1. The electronic device detects a direction of gravitational acceleration of the electronic device through a built-in sensor at a predetermined time interval. The built-in sensor may be a gravity acceleration sensor, and the predetermined time interval may be a preset sampling time interval of the gravity acceleration sensor.

2. The electronic device detects whether the direction of gravity acceleration is consistent with the current display direction of the displayed content on the screen.

3. If the detection result is the direction of gravity acceleration and the content displayed on the screen If the current display directions are inconsistent, the electronic device determines the direction of gravity acceleration as the direction to be switched of the content displayed on the screen. For example, after the electronic device is rotated from the straight direction to the lateral direction, the direction to be switched is as shown by the direction a in FIG. 2B.

Step S202, capturing one of the face images through the front camera to determine a face position.

More specifically, the electronic device further determines the face position through the face image captured by the front camera. In this embodiment, the face position is the line where the eyes are located. Specifically, this step includes but is not limited to the following three sub-steps:

1. The electronic device captures at least one image through the front camera. The electronic device can capture only one image through the front camera, or can continuously capture multiple images, and can continuously capture multiple images and combine them into one image.

In addition, since the scene in which the user is lying on the bed using the electronic device is mostly night, and the light intensity at night is poor, affecting the sharpness and brightness of the captured image, in an embodiment, the electronic device further Included as a light sensor, the electronic device can obtain the light intensity of the current environment through the light sensor, and then the electronic device determines the exposure time through the light intensity, and the exposure time is negatively correlated with the light intensity, that is, The lower the light intensity, the longer the exposure time required; the higher the light intensity, the shorter the exposure time required, and then the front camera captures at least one image based on the determined exposure time, thereby obtaining satisfaction Analyze the image of the demand.

2. The electronic device detects whether a face area exists in at least one of the captured images.

3. If the detection result is that there is a face area in the at least one image, then The electronic device determines the straight line of the eyes according to the binocular area on the face area.

The analysis of the face and the analysis of the features of the eyes in the face of the present invention are well known to those of ordinary skill in the art, and will not be described herein. The electronic device uses the determined straight line of the eyes as the face position. For example, the face position is as shown by the straight line b in Fig. 2B.

Of course, if the detection result is that there is no face area in all the images, the execution of the subsequent steps is stopped; or, after waiting for the predetermined time, step S200 is re-executed.

Step S204: It is detected whether the angle between the to-be-switched direction and the line where the two eyes are located is a vertical relationship.

More specifically, the electronic device detects whether the angle between the direction to be switched and the line of the two eyes is a vertical relationship, and the vertical relationship refers to whether the angle between the direction to be switched and the line where the eyes are located belongs to [90 °-α, 90°+α], α is a predetermined critical value.

Step S206: If the detection result is that the angle between the to-be-switched direction and the straight line of the two eyes is perpendicular, the current display direction of the content displayed on the screen is switched according to the to-be-switched direction.

More specifically, if the detection result is that the angle between the to-be-switched direction and the line of the two eyes is perpendicular, that is, the to-be-switched direction matches the face position, the electronic device according to the to-be-switched direction The current display direction of the displayed content on the screen is switched. For example, in FIG. 2C, the angle between the direction a indicating the direction to be switched and the line b indicating the position of the face (ie, the line where the eyes are located) is a right angle x, and the electronic device will be on the screen. The display direction of the displayed content is switched as shown by the direction a.

Of course, if the detection result is that the angle between the to-be-switched direction and the straight line of the two eyes is not perpendicular, the electronic device may maintain the current content displayed on the screen. The display direction is unchanged. For example, in the 2D diagram, the direction a indicating the direction to be switched and the line c indicating the position of the face (ie, the line where the eyes are located) are not perpendicular, but are nearly parallel, and the electronic device remains on the screen. The current display orientation of the displayed content does not change.

In summary, the display direction switching method provided by the embodiment of the present invention determines the face position through the face image captured by the front camera, and detects whether the to-be-switched direction matches the face position. Switching the current display direction of the displayed content on the screen according to the detection result, thereby solving the problem that when the electronic device rotates, the current display direction of the displayed content on the screen is automatically followed by the gravity acceleration direction, and the user If the actual line of sight direction is inconsistent and the user needs to rotate the electronic device back, the problem that the switching function can be normally viewed is closed, so that the switch is only performed when the to-be-switched direction matches the face position. The effect of displaying the current display orientation of the content on the screen.

In addition, in this embodiment, since only the line where the eyes are located needs to be recognized, the main calculation work can be completed, so the calculation amount is very small, which is very suitable for the mobile terminal with low calculation performance.

Please refer to FIG. 3A , which is a flowchart of a display direction switching method provided by another embodiment. In this embodiment, the display direction switching method is mainly applied to an electronic device including a front camera. The position of the face is characterized by a line of sight direction. The line of sight direction refers to a line perpendicular to the line connecting the eyes and pointing to the mouth. The direction. The display direction switching method includes:

Step S300, after the electronic device rotates, determine a to-be-switched direction of the content displayed on one of the electronic devices.

More specifically, after the electronic device is rotated, the direction to be switched of the display content on the screen is generally determined according to the direction of gravity acceleration. Specifically, this step includes but Not limited to the following three sub-steps:

1. The electronic device detects a direction of gravitational acceleration of the electronic device through a built-in sensor at a predetermined time interval. The built-in sensor may be a gravity acceleration sensor, and the predetermined time interval may be a preset sampling time interval of the gravity acceleration sensor.

2. The electronic device detects whether the direction of gravity acceleration is consistent with the current display direction of the displayed content on the screen.

3. If the detection result is that the direction of the gravitational acceleration is inconsistent with the current display direction of the content displayed on the screen, the electronic device determines the direction of the gravitational acceleration as the direction to be switched of the content displayed on the screen. For example, after the electronic device is rotated from the straight direction to the lateral direction, the direction to be switched is as shown by the direction a in FIG. 3B.

Step S302, capturing a face image through the front camera to determine a face position.

More specifically, the electronic device further determines the face position through the face image captured by the front camera. In the embodiment, the face position is the position of the line of sight direction. Specifically, this step includes but is not limited to the following three sub-steps:

1. The electronic device captures at least one image through the front camera. The electronic device can capture only one image through the front camera, or can continuously capture multiple images, and can continuously capture multiple images and combine them into one image.

In addition, since the scene in which the user is lying on the bed using the electronic device is mostly night, the light intensity at night is poor, which affects the sharpness and brightness of the captured image. In an embodiment, the electronic device further includes a light sensor, wherein the electronic device can obtain the light intensity of the current environment through the light sensor, and then the electronic device transmits the light The exposure time is determined, and the exposure time is negatively correlated with the light intensity, that is, the lower the light intensity, the longer the exposure time required; the higher the light intensity, the shorter the exposure time required, and then the front camera is based on The determined exposure time captures at least one image, thereby obtaining an image that satisfies the analysis needs.

2. The electronic device detects whether a face area exists in at least one of the captured images.

3. If the detection result is that there is a face region in at least one image, the electronic device determines a line of sight direction of the user according to the feature region on the face region, and the feature region includes an eye region, an eyebrow region, a nose region, At least one of the mouth area and the ear area, as described above, the user's line of sight direction refers to a direction in the face that is perpendicular to the line of the eyes and points to the mouth.

The face analysis and the feature region analysis on the face region are well known to those of ordinary skill in the art, and will not be described herein. The electronic device uses the determined line of sight direction as a face position. For example, the line of sight direction is as indicated by the direction d in FIG. 3B.

Of course, if the detection result is that there is no face area in all the images, the execution of the subsequent steps is stopped; or, after waiting for the predetermined time, step S300 is re-executed.

Step S304, detecting whether the to-be-switched direction is consistent with the line-of-sight direction. If yes, step S306 is performed, and if no, step S308 is performed. Whether the electronic device detects whether the switching direction is consistent with the line of sight direction refers to whether an angle between the direction to be switched and the direction of the line of sight belongs to [0°-β, 0°+β], and β is a predetermined threshold.

Step S306, if the detection result is that the to-be-switched direction is consistent with the line-of-sight direction, the display direction of the content displayed on the screen is switched according to the to-be-switched direction.

More specifically, if the detection result is that the to-be-switched direction is consistent with the line-of-sight direction, that is, the to-be-switched direction matches the face position, the electronic device according to the to-be-switched direction The display direction of the displayed content on the screen is switched. For example, in FIG. 3C, the direction a indicating the direction to be switched coincides with the direction d indicating the direction of the line of sight, the electronic device switches the display direction of the content displayed on the screen to as indicated by the direction a.

In step S308, if the detection result is that the to-be-switched direction does not match the line-of-sight direction, it is determined whether the current display direction of the content displayed on the screen is consistent with the line of sight direction. If yes, step S310 is performed, and if no, steps are performed. S312.

Step S310, if the result of the determination is that the current display direction is consistent with the line of sight direction, the current display direction of the displayed content on the screen is kept unchanged. For example, in the 3D figure, the direction f indicating the current display direction and the direction d indicating the direction of the line of sight are the same, the electronic device keeps the current display direction of the displayed content on the screen unchanged, that is, as the direction f Shown.

Step S312, if the result of the determination is that the current display direction does not coincide with the line of sight direction, the current display direction of the display content on the screen is switched to be consistent with the line of sight direction. For example, in FIG. 3E, the direction e indicating the current display direction and the direction d indicating the direction of the line of sight do not coincide, and the electronic device switches the current display direction of the content displayed on the screen to the direction e.

In summary, the display direction switching method provided by the embodiment of the present invention determines the face position through the face image captured by the front camera, and detects whether the to-be-switched direction matches the face position. Switching the current display direction of the displayed content on the screen according to the detection result, thereby solving the current display content on the screen when the electronic device rotates After the automatic direction of the gravitational acceleration direction is switched, the display direction may be inconsistent with the actual line of sight direction of the user, and the user needs to turn the electronic device back after rotating the electronic device to turn off the switching function to be able to view normally. When the switching direction matches the face position, the effect of the current display direction of the content displayed on the screen is switched.

In addition, in the present embodiment, since the direction of the face position is further accurately corrected by confirming at least one of the eye region, the eyebrow region, the nose region, the mouth region, and the ear region, the accuracy of the display direction switching is improved.

The following is an embodiment of the device of the present invention. For details that are not described in detail, reference may be made to the corresponding method embodiments described above.

Please refer to FIG. 4, which is a block diagram of a display direction switching device according to an embodiment of the present invention. The display direction switching device can be implemented as all or part of the electronic device through a combination of software, hardware, or both. The display direction switching device may include: a direction determining module 400, a face determining module 420, a direction detecting module 440, and a direction switching module 460.

The direction determining module 400 is configured to determine, after the electronic device is rotated, a to-be-switched direction of content displayed on one of the electronic devices.

The face determination module 420 is configured to capture a face image through a front camera to determine a face position.

The direction detecting module 440 is configured to detect whether the to-be-switched direction determined by the direction determining module 420 matches the face position determined by the face determining module 440 to enable the screen to be on the screen. The display content is a positive image with respect to the user.

The direction switching module 460 is configured to detect the direction detecting module 440. As a result, if the to-be-switched direction matches the face position, the current display direction of the content displayed on the screen is switched according to the to-be-switched direction.

In summary, the display direction switching device provided by the embodiment of the present invention determines the face position through the face image captured by the front camera, and detects whether the to-be-switched direction matches the face position. Switching the display direction of the displayed content on the screen according to the detection result, and resolving that when the electronic device rotates, the current display direction of the displayed content on the screen is automatically followed by the gravity acceleration direction, and the user's actual line of sight is The direction is inconsistent, and the user needs to turn the electronic device back to turn off the switching function to be able to view normally, so that the screen display is switched only when the to-be-switched direction matches the face position. The effect of the current display orientation of the content.

Since the face position can be represented by at least one of the following features: 1. a straight line where the eyes are located; and 2, a line of sight direction, that is, a direction perpendicular to the line connecting the eyes and pointing to the mouth in the face, below The above two features are elaborated in two different embodiments.

Please refer to FIG. 5, which is a block diagram of a display direction switching device according to another embodiment of the present invention. In this embodiment, the display direction switching device is mainly applied to an electronic device including a front camera, and the position of the face is characterized by a straight line of both eyes. The display direction switching device includes a direction determining module 400, a face determining module 420, a direction detecting module 440, and a direction switching module 460.

The direction determining module 400 is configured to determine, after the electronic device is rotated, a to-be-switched direction of content displayed on one of the electronic devices.

More specifically, after the electronic device is rotated, usually according to the acceleration of gravity The direction is to determine the direction of the display to be switched on the screen. Specifically, the direction determining module 400 includes a signal detecting unit 402, a signal detecting unit 404, and a direction determining unit 406.

The signal detecting unit 402 is configured to detect a direction of gravity acceleration of the electronic device through a built-in sensor at every predetermined time interval.

The signal detecting unit 404 is configured to detect whether the direction of the gravitational acceleration detected by the signal detecting unit 402 is consistent with the current display direction of the content displayed on the screen.

The direction determining unit 406 is configured to determine, when the detection result of the signal detecting unit 404 is that the direction of the gravity acceleration is inconsistent with the current display direction of the content displayed on the screen, determine the direction of the gravity acceleration as the content to be switched on the screen. direction.

The face determination module 420 is configured to capture a face image through the front camera to determine a face position. More specifically, the electronic device determines the face position through the face image captured by the front camera. In the embodiment, the face position is a straight line where the eyes are located. Specifically, the face determination module 420 includes an image capture unit 422, an image detection unit 424, and a line determination unit 426.

The image capturing unit 422 is configured to capture at least one image through the front camera. The image capturing unit 422 may capture only one image, or may continuously capture multiple images, or may continuously capture multiple images and merge them into one image.

In addition, since the scene in which the user is lying on the bed using the electronic device is mostly night, the light intensity at night is poor, which affects the sharpness and brightness of the detected image. In an embodiment, the image capturing unit 422 includes a light acquiring subunit 422a and an exposure analyzer. Unit 422b and an image capture sub-unit 422c. The electronic device may obtain the light intensity of the current environment through the light acquiring sub-unit 422a, and then the exposure analyzing sub-unit 422b may determine the exposure time according to the light intensity of the current environment acquired by the light acquiring sub-unit 441a, and the exposure time. A negative correlation with the light intensity, that is, the lower the light intensity, the longer the exposure time; the higher the light intensity, the shorter the exposure time, and then the image capturing sub-unit 422c determines according to the exposure analysis sub-unit 422b. The exposure time captures at least one image, thereby capturing an image that satisfies the analysis needs.

The image detecting unit 424 is configured to detect whether a face region exists in at least one image captured by the image capturing unit 422.

The line determining unit 426 is configured to determine a line where the eyes are located according to the binocular area on the face area if the detection result of the image detecting unit 424 is that there is a face area in at least one image.

Of course, if the detection result of the image detecting unit 424 is that there is no face area in all the images, the execution of the subsequent steps is stopped; or, after waiting for the exposure time determined by the exposure analysis sub-unit 422b, the figure The capture sub-unit 422c retrieves at least one image.

The direction detecting module 440 is configured to detect whether the angle between the direction to be switched determined by the direction determining module 400 and the line of the eyes determined by the line determining unit 426 is a vertical relationship.

More specifically, the direction detecting module 440 detects whether the angle between the direction to be switched and the line of the two eyes is a vertical relationship, and the direction to be switched determined by the direction determining module 400 is determined by the line determining unit 426. Whether the angle of the line where the eyes are located belongs to [90°-α, 90°+α], α is a predetermined threshold.

The direction switching module 460 is configured to: if the detection result of the direction detecting module 440 is that the angle between the to-be-switched direction and the line of the two eyes is perpendicular, the current display of the content displayed on the screen according to the direction to be switched Switch directions.

Of course, if the detection result of the direction detecting module 440 is that the angle between the direction to be switched and the line of the two eyes is not perpendicular, the direction switching module 460 can maintain the current display direction of the display content on the screen. constant.

Please refer to FIG. 6 , which is a block diagram of a display direction switching device according to another embodiment of the present invention. In this embodiment, the display direction switching device is mainly applied to an electronic device including a front camera, and the face position is characterized by a line of sight direction, and the line of sight direction refers to a line perpendicular to the line connecting the eyes and pointing to the mouth. The direction. The display direction switching device includes a direction determining module 400, a face determining module 420, a direction detecting module 440, and a direction switching module 460.

The direction determining module 400 is configured to determine, after the electronic device is rotated, a to-be-switched direction of content displayed on one of the electronic devices.

After the electronic device is rotated, the direction to be switched of the displayed content on the screen is generally determined according to the direction of gravity acceleration. Specifically, the direction determining module 400 includes a signal detecting unit 402, a signal detecting unit 404, and a direction determining unit 406.

The signal detecting unit 402 is configured to detect the direction of gravity acceleration of the electronic device through a built-in sensor at every predetermined time interval.

The signal detecting unit 404 is configured to detect whether the direction of the gravitational acceleration detected by the signal detecting unit 402 is the same as the current display direction of the content displayed on the screen. To.

The direction determining unit 406 is configured to determine the direction of the gravitational acceleration as the content displayed on the screen if the detection result of the signal detecting unit 404 is that the direction of the gravitational acceleration is inconsistent with the current display direction of the content displayed on the screen. Switch direction.

The face determination module 440 is configured to capture a face image through the front camera to determine a face position. More specifically, the electronic device determines the face position through the face image captured by the front camera. In the embodiment, the face position is the line of sight direction. Specifically, the face determining module 420 includes an image capturing unit 422, an image detecting unit 424, and a line of sight determining unit 428.

The image capturing unit 422 is configured to capture at least one image through the front camera. The image capturing unit 441 may capture only one image, or may continuously capture multiple images, or may continuously capture multiple images and merge them into one image.

In addition, since the scene in which the user is lying on the bed using the electronic device is mostly night, the light intensity at night is poor, which affects the sharpness and brightness of the detected image. In an embodiment, the image capturing unit 422 includes a light acquiring subunit 422a, an exposure analyzing subunit 422b, and an image capturing subunit 422c. The electronic device may obtain the light intensity of the current environment through the light acquiring sub-unit 422a, and then the exposure analyzing sub-unit 422b may determine the exposure time according to the light intensity of the current environment acquired by the light acquiring sub-unit 422a, and the exposure time. Negative correlation with light intensity, that is, the lower the light intensity, the longer the exposure time; the higher the light intensity, the shorter the exposure time; then the image capturing sub-unit 422c determines according to the exposure analysis sub-unit 422b The exposure time captures at least one image, thereby obtaining an image that satisfies the analysis needs.

The image detecting unit 424 is configured to detect whether a face region exists in at least one image captured by the image capturing unit 422.

The line of sight determining unit 428 is configured to determine a line of sight direction of the user according to the feature area on the face area if the detection result of the image detecting unit 424 is that there is a face area in the at least one image. The feature area includes at least one of an eye area, an eyebrow area, a nose area, a mouth area, and an ear area, and the user's line of sight direction refers to a direction in the face that is perpendicular to the line of the eyes and points to the mouth.

Of course, if the detection result of the image detecting unit 424 is that there is no face area in all the images, the execution of the subsequent steps is stopped; or, after waiting for the exposure time determined by the exposure analysis sub-unit 422b, the figure The capture sub-unit 422c retrieves at least one image.

The direction detecting module 440 is configured to detect whether the direction to be switched determined by the direction determining module 400 is consistent with the direction of the line of sight determined by the line of sight determining unit 428.

More specifically, whether the direction of the switching direction of the direction detecting module 440 is consistent with the direction of the line of sight refers to whether the angle between the direction to be switched and the direction of the line of sight belongs to [0°-β, 0°+β], and β is a predetermined threshold.

The direction switching module 460 is configured to switch the current display direction of the content displayed on the screen according to the direction to be switched if the detection result of the direction detecting module 440 is that the direction to be switched is consistent with the direction of the line of sight.

Of course, if the detection result of the direction detecting module 440 is that the direction to be switched is inconsistent with the direction of the line of sight, the display direction switching device may further include a direction determining module 480 and a direction maintaining module 490.

The direction determining module 480 is configured to determine, if the detection result of the direction detecting module 440 is that the direction to be switched is inconsistent with the direction of the line of sight, determine the current display direction of the content displayed on the screen and the line of sight determining unit 428 Whether the line of sight is the same.

The direction maintaining module 490 is configured to keep the current display direction of the displayed content on the screen unchanged if the direction determining module 480 determines that the current display direction is consistent with the line of sight direction.

The direction switching module 460 is configured to switch the current display direction of the display content on the screen to be determined by the line of sight determining unit 428 if the direction determining module 480 determines that the current display direction is inconsistent with the line of sight direction. The line of sight is the same.

It is also understood by those skilled in the art that all or part of the steps of the above embodiments may be implemented by a program to instruct related hardware, the program including a set of instructions and stored in a machine. Reading the storage medium, when the set of instructions is executed, causing the machine to perform the above display direction switching method. The storage medium includes a read only memory (ROM), a random access memory (RAM), a magnetic disk, a compact disk, and the like.

While the invention has been described above by way of a preferred embodiment, the invention is not intended to be limited thereto, and the invention may be modified and modified without departing from the spirit and scope of the invention. Therefore, the scope of the invention is defined by the scope of the appended claims.

S100-S106‧‧‧Steps

Claims (14)

A display direction switching method is provided for an electronic device, the electronic device includes a front camera, and the display direction switching method includes: after the electronic device is rotated, determining that the display content of one of the electronic devices is displayed on the screen a direction to be switched; capturing a face image through the front camera to determine a face position; detecting whether the to-be-switched direction matches the face position to make the display content on the screen positive with respect to the user And to the image; and if the detection result is that the to-be-switched direction matches the face position, the current display direction of the content displayed on the screen is switched according to the to-be-switched direction. The display direction switching method according to claim 1, wherein the face position is characterized by a line of a pair of eyes, and the face image is captured by the front camera to determine the face. The step of locating includes: capturing at least one image through the front camera; detecting whether a face region exists in the captured at least one image; and if the detection result is the at least one image The presence of the face region is determined according to a binocular region on the face region, and the step of detecting whether the to-be-switched direction matches the face position includes: detecting the location It is stated whether the angle between the switching direction and the straight line of the eyes is a vertical relationship. The display direction switching method according to claim 1, wherein the face position is characterized by a line of sight direction, which is a direction perpendicular to the line connecting the eyes and pointing to the mouth of the face, The front camera captures the face image to determine the face position The step of: capturing the at least one image through the front camera; detecting whether a face region exists in the captured at least one image; and if the detection result is the at least one image Determining the face region according to the feature region of the face region, wherein the feature region includes at least at least an eye region, an eyebrow region, a nose region, a mouth region, and an ear region. The step of detecting whether the to-be-switched direction matches the face position includes: detecting whether the to-be-switched direction is consistent with the line-of-sight direction. The display direction switching method according to any one of claims 1 to 3, wherein, after the electronic device is rotated, the step of determining a direction to be switched displayed on the screen of the electronic device includes: Detecting a direction of gravitational acceleration of one of the electronic devices through a built-in sensor at a predetermined time interval; detecting whether the direction of gravitational acceleration is consistent with a current display direction of the displayed content on the screen; and if the detection result is The direction of the gravitational acceleration is inconsistent with the current display direction of the content displayed on the screen, and the direction of the gravitational acceleration is determined as the direction to be switched of the content displayed on the screen. According to the display direction switching method of claim 2 or 3, the electronic device further includes a light sensor, wherein the step of capturing the at least one image through the front camera comprises: transmitting The light sensor acquires one of the light intensity of the current environment; Determining an exposure time by the intensity of the light; and the front camera capturing the at least one image according to the determined exposure time. According to the display direction switching method of claim 3, the step of detecting whether the to-be-switched direction is consistent with the line-of-sight direction includes: if the detection result is that the to-be-switched direction is inconsistent with the line-of-sight direction, And determining whether the current display direction of the displayed content on the screen is consistent with the line of sight direction; if the determination result is that the current display direction is consistent with the line of sight direction, maintaining the current display direction of the displayed content on the screen unchanged And if the result of the determination is that the current display direction does not coincide with the line of sight direction, the current display direction of the display content on the screen is switched to be consistent with the line of sight direction. A display direction switching device is used for an electronic device, the electronic device includes a front camera, and the display direction switching device includes: a direction determining module, configured to determine the electronic device after the electronic device rotates One of the devices displays a direction of the content to be switched on the screen; a face determining module is configured to capture a face image through the front camera to determine a face position; and a direction detecting module for detecting the Whether the direction to be switched determined by the direction determining module matches the face position determined by the face determination module to make the display content on the screen be a forward image with respect to the user; and a direction switching mode And a group, if the detection result of the direction detecting module is that the to-be-switched direction matches the face position, the current display direction of the content displayed on the screen is switched according to the to-be-switched direction. The display direction switching device according to the seventh aspect of the invention, wherein the face position is characterized by a line of a pair of eyes, the face determination module comprising: an image capture unit for transmitting The front camera captures at least one image; an image detecting unit is configured to detect whether a face area exists in the at least one image captured by the image capturing unit; a line determining unit, And if the detection result of the image detecting unit is that the face area exists in the at least one image, determining a line where the two eyes are located according to one of the binocular areas on the face area; And a direction detecting module, configured to detect whether an angle between the to-be-switched direction and a line of the two eyes detected by the line determining unit is a vertical relationship. The display direction switching device according to claim 7, wherein the face position is characterized by a line of sight direction, wherein the line of sight direction refers to a direction in the face that is perpendicular to the line of the eyes and points to the mouth. The face determining module includes: an image capturing unit configured to capture at least one image through the front camera; and an image detecting unit configured to detect the image capturing unit Whether there is a face area in the at least one image; a line of sight determining unit, configured to: if the detection result is that the face area exists in the at least one image, according to one of the face areas Determining the line of sight direction, the feature area including at least one of an eye area, an eyebrow area, a nose area, a mouth area, and an ear area; and a direction detecting module configured to detect the direction and location to be switched Whether the direction of the line of sight determined by the line of sight determining unit is consistent. The display direction switching device according to any one of claims 7 to 9, wherein the direction determining module comprises: a signal detecting unit for transmitting a built-in sensor every predetermined time interval. Detecting a direction of gravitational acceleration of the electronic device; a signal detecting unit, configured to detect whether the direction of the gravitational acceleration detected by the signal detecting unit is consistent with a current display direction of the content displayed on the screen; a direction determining unit, configured to determine the gravity acceleration direction as the display content on the screen if the detection result of the signal detecting unit is that the gravity acceleration direction is inconsistent with the current display direction of the display content on the screen The direction to be switched. According to the display direction switching device of claim 8 or 9, the electronic device further includes a light sensor, wherein the image capturing unit comprises: a light acquiring subunit for acquiring the current environment Light intensity; an exposure analysis subunit for determining an exposure time by the light intensity obtained by the light acquisition subunit; and an image capture subunit for transmitting the front camera according to the The exposure time determined by the exposure analysis subunit captures the at least one image. The display direction switching device according to claim 9, further comprising: a direction determining module, configured to: if the detection result of the direction detecting module is that the to-be-switched direction is inconsistent with the line of sight direction, Determining whether the current display direction of the display content on the screen is consistent with the line of sight direction; and a direction maintaining module, configured to: if the direction determining module determines that the current display direction is consistent with the line of sight direction To maintain the current display orientation of the content displayed on the screen If the determination result of the direction determining module is that the current display direction is inconsistent with the line of sight direction, the direction switching module switches the current display direction of the display content on the screen to the line of sight direction. Consistent. An electronic device comprising the display direction switching device according to any one of claims 7 to 12. A machine readable storage medium having stored thereon a set of instructions that, when executed, causes the machine to perform the display direction switching method of any one of claims 1 to 6.