CN112099717B

CN112099717B - Folding screen state detection method and device, electronic equipment and display system

Info

Publication number: CN112099717B
Application number: CN202010969691.1A
Authority: CN
Inventors: 彭聪
Original assignee: Beijing Xiaomi Mobile Software Co Ltd
Current assignee: Beijing Xiaomi Mobile Software Co Ltd
Priority date: 2020-09-15
Filing date: 2020-09-15
Publication date: 2022-02-15
Anticipated expiration: 2040-09-15
Also published as: CN112099717A

Abstract

The disclosure provides a method and a device for detecting the state of a folding screen, electronic equipment and a display system, and belongs to the technical field of folding screens. The method for detecting the state of the folding screen is applied to a processor of a display system, and the display system further comprises the folding screen and an acceleration sensor; the folding screen comprises a first screen and a second screen which are positioned on two sides of a folding axis, and the acceleration sensor comprises a first sensor arranged corresponding to the first screen and a second sensor arranged corresponding to the second screen; the method comprises the following steps: acquiring detection data of a first sensor and a second sensor; determining an equivalent plane of the folding screen according to detection data of the first sensor and the second sensor; and acquiring equivalent data of the detection data of the first sensor and the second sensor relative to the equivalent plane, and determining the rotating state of the folding screen according to the equivalent data.

Description

Folding screen state detection method and device, electronic equipment and display system

Technical Field

The present disclosure relates to the field of foldable screen electronic devices, and in particular, to a method and an apparatus for detecting a state of a foldable screen, an electronic device, and a display system.

Background

The folding screen has the characteristic of being bendable, and can realize various use forms. The use forms of the folding screen are divided into an unfolding state, a half-folding state and a full-folding state according to the mode that the folding angle of the folding screen is reduced from large to small. In the display system adopting the folding screen, the space rotation state of the folding screen is detected through the acceleration sensor, and then the display of the folding screen is controlled. However, in the case where the folding screen is in the half-folded state, the spatial rotation state of the folding screen is complicated, and therefore it is necessary to provide a method for detecting the spatial rotation state of the folding screen in the half-folded state.

Disclosure of Invention

In view of the above, the present disclosure provides a method and an apparatus for detecting a state of a foldable screen, an electronic device, and a display system, so as to detect a spatial rotation state of the foldable screen in a semi-folded state.

In a first aspect, the disclosed embodiment provides a method for detecting a state of a folding screen, where the method is applied to a processor of a display system, and the display system further includes a folding screen and an acceleration sensor; the folding screen comprises a first screen and a second screen which are positioned on two sides of a folding axis, and the acceleration sensor comprises a first sensor arranged corresponding to the first screen and a second sensor arranged corresponding to the second screen; the method comprises the following steps:

acquiring detection data of a first sensor and a second sensor;

determining an equivalent plane of the folding screen according to detection data of the first sensor and the second sensor;

and acquiring equivalent data of the detection data of the first sensor and the second sensor relative to the equivalent plane, and determining the rotation state of the folding screen according to the equivalent data.

In one embodiment, the determining an equivalent plane from the detection data of the first sensor and the second sensor includes:

determining that the folding screen is in a moving state according to the detection data of the first sensor and the second sensor;

acquiring a moving direction and determining a plane perpendicular to the moving direction as the equivalent plane.

determining that the folding screen is in an upright standing state according to the detection data of the first sensor and the second sensor;

and determining a plane of a plane where two side edges parallel to the folding axis are located as the equivalent plane in response to the electronic equipment being in the upright standing state.

determining that the folding screen is in a flat standing state according to the detection data of the first sensor and the second sensor;

responding to the electronic equipment in the flat standing state, and determining a first included angle formed by the horizontal plane of the first screen and a second included angle formed by the horizontal plane of the second screen;

and determining the horizontal plane as the equivalent plane in response to the first included angle being larger than a first set angle and the second included angle being larger than a second set angle.

In one embodiment, the acquiring equivalent data of the detection data of the first sensor and the second sensor relative to an equivalent plane includes:

determining an equivalent coordinate system of the first sensor and the second sensor based on the equivalent plane;

and merging the detection data of the first sensor and the second sensor into the equivalent coordinate system to obtain the equivalent data.

In one embodiment, said determining an equivalent coordinate system of said first sensor and said second sensor based on said equivalent plane comprises:

determining the position of the midpoint of a connecting line of the first sensor and the second sensor;

determining a projection point of the midpoint position on the equivalent plane as an origin position of the equivalent coordinate system;

and determining the equivalent coordinate system according to the equivalent plane and the direction perpendicular to the equivalent plane based on the origin position.

In one embodiment, the method further comprises: and determining the rotation state of the folding screen according to the detection data of the second sensor in response to the first included angle being smaller than or equal to the first set angle and the second included angle being larger than or equal to the second set angle.

In one embodiment, the method further comprises: the angle between the first screen and the second screen is obtained, and the first sensor and the second sensor are controlled to work in response to the fact that the angle between the first screen and the second screen is within a set angle range.

In a second aspect, the disclosed embodiment provides a device for detecting a state of a folding screen, where the device is applied to a processor of a display system, and the display system further includes the folding screen and an acceleration sensor; the folding screen comprises a first screen and a second screen which are positioned on two sides of a folding axis, and the acceleration sensor comprises a first sensor arranged corresponding to the first screen and a second sensor arranged corresponding to the second screen; the device comprises:

the acquisition module is used for acquiring detection data of the first sensor and the second sensor;

the first determining module is used for determining an equivalent plane according to the detection data of the first sensor and the second sensor;

and the second determining module is used for acquiring equivalent data of the detection data of the first sensor and the second sensor relative to the equivalent plane and determining the rotating state of the folding screen according to the equivalent data.

In one embodiment, the first determining module comprises:

the first determining unit is used for determining that the folding screen is in a moving state according to the detection data of the first sensor and the second sensor; and

and the second determining unit is used for acquiring the moving direction and determining a plane perpendicular to the moving direction as the equivalent plane.

In one embodiment, the first determining module comprises:

the third determining unit is used for determining that the folding screen is in an upright standing state according to the detection data of the first sensor and the second sensor; and

a fourth determination unit configured to determine, as the equivalent plane, a plane of a plane on which both side edges parallel to the folding axis are located, in response to the folded screen being in the upright standing state.

In one embodiment, the first determining module comprises:

the fifth determining unit is used for determining that the folding screen is in a flat standing state according to the detection data of the first sensor and the second sensor;

the sixth determining unit is used for determining a first included angle formed by the horizontal plane of the first screen and a second included angle formed by the horizontal plane of the second screen in response to the electronic equipment being in the flat-laying and standing state; and

and the seventh determining unit is used for determining the horizontal plane as the equivalent plane in response to the fact that the first included angle is larger than a first set angle and the second included angle is larger than a second set angle.

In one embodiment, the second determining module includes:

an eighth determining unit configured to determine an equivalent coordinate system of the first sensor and the second sensor based on the equivalent plane; and

and the acquisition unit is used for merging the detection data of the first sensor and the second sensor into the equivalent coordinate system so as to acquire the equivalent data.

In one embodiment, the eighth determining unit includes:

the first determining subunit is used for determining the midpoint position of a connecting line of the first sensor and the second sensor;

a second determining subunit, configured to determine a projection point of the midpoint position on the equivalent plane as an origin position of the equivalent coordinate system; and

and the third determining subunit is used for determining the equivalent coordinate system according to the equivalent plane and the direction perpendicular to the equivalent plane based on the origin position.

In one embodiment, the seventh determining unit is further configured to: and determining the rotation state of the folding screen according to the detection data of the second sensor in response to the first included angle being smaller than or equal to the first set angle and the second included angle being larger than or equal to the second set angle.

In one embodiment, the apparatus further comprises: and the control module is used for acquiring the angle between the first screen and the second screen and controlling the first sensor and the second sensor to work in response to the fact that the angle between the first screen and the second screen is within a set angle range.

In a third aspect, an embodiment of the present disclosure further provides an electronic device, where the electronic device includes:

a memory storing the processor-executable instructions; and

a processor configured to execute the executable instructions in the memory to implement the method provided by the first aspect.

In a fourth aspect, an embodiment of the present disclosure further provides a display system, where the display system includes:

folding the screen;

the acceleration sensor comprises a first sensor and a second sensor which are respectively arranged at two sides of the folding axis of the folding screen; and

the third aspect provides an electronic device.

In a fifth aspect, the disclosed embodiments also provide a readable storage medium, on which executable instructions are stored, and when executed by a processor, the executable instructions implement the method provided in the first aspect.

The folding screen state detection method, the folding screen state detection device, the electronic equipment and the display system provided by the embodiment of the disclosure have at least the following beneficial effects:

by adopting the method for detecting the state of the folding screen, an equivalent plane equivalent to the folding screen is determined according to the motion state of the folding screen. And fusing the detection data of the first sensor and the second sensor based on the equivalent plane to acquire equivalent data. And then, determining the rotation state of the folding screen according to the equivalent data. By adopting the detection method provided by the embodiment of the disclosure, the overall detection accuracy is improved.

Drawings

1-1, 1-2, and 1-3 are schematic diagrams illustrating different states of a display system according to an exemplary embodiment;

FIGS. 2-1 and 2-2 are schematic views of different states of detection using an acceleration sensor on one side of the fold axis;

FIG. 3 is a schematic flow diagram illustrating a folded screen state detection method in accordance with an exemplary embodiment;

FIG. 4 is a state diagram of step S302, shown in accordance with an exemplary embodiment;

5-1, 5-2, 5-3 are flowcharts illustrating step S302 according to various exemplary embodiments;

6-1 and 6-2 are schematic diagrams illustrating a folded screen state according to various exemplary embodiments;

FIG. 7 is a flowchart illustrating step S303, according to an exemplary embodiment;

fig. 8 is a flowchart illustrating step S303 according to another exemplary embodiment;

FIG. 9 is a block diagram illustrating a detection device according to an exemplary embodiment;

FIG. 10 is a block diagram illustrating a detection device according to another exemplary embodiment;

FIG. 11 is a block diagram illustrating a detection device according to another exemplary embodiment;

FIG. 12 is a block diagram illustrating a detection device according to another exemplary embodiment;

FIG. 13 is a block diagram illustrating a detection device according to another exemplary embodiment;

FIG. 14 is a block diagram illustrating a detection device according to another exemplary embodiment;

FIG. 15 is a block diagram illustrating a display system according to an exemplary embodiment.

Detailed Description

Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the exemplary embodiments below are not intended to represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.

The terminology used in the present disclosure is for the purpose of describing particular embodiments only and is not intended to be limiting of the disclosure. As used in this disclosure and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items.

The method for detecting the state of the folding screen is realized based on a display system with the folding screen. Before describing the embodiments of the present disclosure, a hardware architecture of the display system is first received.

Fig. 1-1, 1-2, and 1-3 are schematic diagrams illustrating different states of a display system according to an exemplary embodiment. The folded screen 100 is foldable along a folding axis 100 x. In which a portion of the folded screen 100 on one side of the folding axis 100x is a first screen 110 and a portion on the other side of the folding axis 100x is a second screen 120. The use configuration of the folding screen 100 includes:

as shown in fig. 1-1, the folded screen 100 is in the unfolded state when the first screen 110 and the second screen 120 are at an angle greater than or equal to a first critical angle (e.g., 170 °).

As shown in fig. 1-2, the folded screen 100 is in a fully folded state when the first screen 110 and the second screen 120 are at an angle less than or equal to a second critical angle (e.g., 10 °). And

as shown in fig. 1-3, the folded screen 100 is in a half-folded state with the first screen 110 and the second screen 120 angled at an angle greater than the second critical angle and less than the first critical angle (e.g., greater than 10 ° and less than 170 °).

The display system also includes an acceleration sensor. As shown in fig. 1 to 3, the acceleration sensor includes a first sensor 210 provided corresponding to the first screen 110, and a second sensor 220 provided corresponding to the second screen 120. In this manner, first sensor 210 is able to detect motion data of first screen 110 and second sensor 220 is able to detect motion data of second screen 120.

In some embodiments, the spatial rotation state of the folding screen is detected using an acceleration sensor located on one side of the folding axis 100 x. However, such a method does not consider the fact that the folding screen has a folding angle, which causes an error in the control of the display system based on the spatial rotation state of the folding screen, and affects the user experience.

Fig. 2-1 and 2-2 are schematic views showing different states of detection using an acceleration sensor on one side of the folding axis. With reference to fig. 2-1 and 2-2, the operation of the first sensor 210 corresponding to the first screen 110 is taken as an example for explanation.

In the state shown in fig. 2-1, the folding screen 100 is in a landscape display state. However, when the entire folding screen is rotated by a certain angle in the first direction X1, the angle α formed by the first screen 110 and the horizontal plane increases. At this time, the first sensor 210 outputs a detection signal in response to the included angle α being greater than the set threshold, and the processor in the display system controls the foldable screen 100 to switch from the horizontal screen display state to the vertical screen display state based on the detection signal. However, in connection with the scenarios shown in fig. 1-2, the viewing direction of the user is not changed at this time. Therefore, at this time, the display state of the foldable screen 100 switched to the vertical screen cannot meet the actual application requirement, and inconvenience is brought to the user.

Based on the above problems, embodiments of the present disclosure provide a method and an apparatus for detecting a state of a folding screen, an electronic device, and a display system, so as to solve a defect that detection of a state of a folding screen is inaccurate in the above embodiments.

Fig. 3 is a schematic flow chart diagram illustrating a folded screen state detection method according to an exemplary embodiment. As shown in fig. 3, the method includes:

and S301, acquiring detection data of the first sensor and the second sensor.

Optionally, the first sensor and the second sensor are both triaxial acceleration sensors. The first sensor detects the motion data of the first screen based on the first sensor coordinate system, and the second sensor detects the motion data of the second screen based on the second sensor coordinate system.

Through the simultaneous working of the first sensor and the second sensor, the accuracy of the subsequent state detection of the folding screen can be guaranteed, and the condition of inaccurate detection caused by the working of only one sensor is avoided.

In one embodiment, before step S301, the method further includes: and acquiring the angle between the first screen and the second screen, and controlling the first sensor and the second sensor to work in response to the fact that the angle between the first screen and the second screen is within a set angle range. Alternatively, the set angle ranges from 10 ° to 170 °, or from 20 ° to 160 °. When the angle formed by the first screen and the second screen is within the set angle range, the folding screen is in a half-folding state.

By adopting the mode, when the folding screen is in a half-folding state, the first sensor and the second sensor are controlled to work, so that the accuracy of state detection of the folding screen is guaranteed. And, because the motion (including moving, turning, rotating, etc.) of the first screen and the second screen of the folding screen is the same in the fully folded state and the unfolded state, when the folding screen is in the fully folded state or the unfolded state, one of the first sensor and the second sensor is controlled to work. In this way, the energy consumption of the acceleration sensor is reduced, and the endurance time of the display system is prolonged.

The display system further comprises an angle detection assembly, and the angle between the first screen and the second screen is obtained through the angle detection assembly.

Optionally, the angle detection assembly includes a detection light emitter, a detection light receiver, and a processor, one of the detection light emitter and the detection light receiver corresponding to the first screen setting, and the other corresponding to the second screen setting. The detection light emitter emits detection light (e.g., infrared light), the detection light receiver receives the detection light, and the distance to the detection light emitter is determined based on the light intensity of the received detection light. And then, the processor determines the included angle formed by the first screen and the second screen according to the distance from the detection light emitter to the folding screen rotating shaft, the distance from the detection light receiver to the detection light receiver and the distance from the detection light emitter to the detection light receiver.

Optionally, the angle detection assembly includes a hall sensor and a magnet, one of the hall sensor and the magnet corresponds to the first screen, and the other corresponds to the second screen. The distance from the hall sensor to the magnet can also be detected by the hall sensor and the magnet. And then, the processor determines the included angle formed by the first screen and the second screen according to the distance from the Hall sensor and the magnet to the rotating shaft.

In addition, the angle detection component may also be implemented in other manners, which are not specifically limited in the embodiments of the present disclosure.

And step S302, determining the equivalent plane of the folding screen according to the detection data of the first sensor and the second sensor.

Fig. 4 is a state diagram of step S302 shown in accordance with an exemplary embodiment. As shown in fig. 4, the equivalent plane 300 faces the angle formed by the first screen 110 and the second screen 120. The equivalent plane 300 is: the folded screen is a projection plane of the display contents of the first screen 110 and the second screen 120 in the half-folded state. Therefore, determining the equivalent plane through step S302 is equivalent to equivalent of the folding screen to the straight screen.

In the embodiment of the present disclosure, step S302 is performed in the following three cases based on the difference of the motion states of the folding screen.

As a first case, fig. 5-1 is a flowchart illustrating step S302 according to an exemplary embodiment, and as shown in fig. 5-1, step S302 includes:

and step S3021, determining that the folding screen is in the moving state according to the detection data of the first sensor and the second sensor.

And by combining a specific application scene, when the folding screen is checked in the walking process of the user, the folding screen is in a moving state of moving along the walking direction of the user. At this time, the first screen and the second screen have the same moving direction.

Alternatively, a movement parameter (e.g., a movement speed) of the first screen is determined by detection data acquired by the first sensor, and a movement parameter of the second screen is determined by detection data acquired by the second sensor. And when the difference value of the movement parameters of the first screen and the second screen is smaller than a preset threshold value, determining that the folding screen is in a movement state.

Step S3022, a moving direction is acquired and a plane perpendicular to the moving direction is determined as an equivalent plane.

The moving direction of the folding screen can be obtained according to data analysis of the first sensor and the second sensor. Because the moving direction of the folding screen is the same as the advancing direction of the user, the plane perpendicular to the moving direction of the folding screen is taken as an equivalent plane, so that the equivalent plane can accurately feed back the observation direction of the user, and the accuracy of the subsequent state detection of the folding screen is improved.

As a second case, fig. 5-2 is a flowchart illustrating step S302 according to another exemplary embodiment, and as shown in fig. 5-2, step S302 includes:

and step S3023, determining that the electronic equipment is in the standing state according to the detection data of the first sensor and the second sensor.

And combining a specific application scene, wherein the folding screen is in an upright standing state in the application scene that a user holds the folding screen in a mode that the folding axis points to the ground in the standing state.

Optionally, the x-axes of the first sensor coordinate system and the second sensor coordinate system are both distributed along the fold axis. In the case where the detection data of the x-axis in the first sensor is approximated to the gravitational accelerator and the detection data of the x-axis in the second sensor is also approximated to the gravitational acceleration, it is indicated that the folding screen is in the upright state. Here, "approximately" means that the difference between the detected data and the gravitational acceleration is smaller than a set threshold. Also, "approximately" hereinafter both indicate that the difference between the two values of the relative ratio is smaller than the set threshold value.

Based on the above, the folding screen is further determined to be in the standing state according to the detection data of the first sensor and the detection data of the second sensor, and then the folding screen is indicated to be in the standing state.

Optionally, the motion data of the first screen detected by the first sensor and the motion data of the second screen detected by the second sensor are uniformly converted into a terrestrial coordinate system, so as to obtain fused motion data. In the terrestrial coordinate system, the x-axis and the y-axis are orthogonal horizontal directions, and the z-axis is a gravitational acceleration direction. When the x-axis data in the fused motion data is approximately 0, the y-axis data is approximately 0, and the z-axis data is approximately the acceleration of gravity, the folded screen is indicated to be in a static state.

Step S3024, in response to the electronic apparatus being in the upright standing state, determining a plane of a plane on which the two sides parallel to the folding axis are located as an equivalent plane. The equivalent plane determined in this way enables accurate feedback of the viewing direction of the user.

As a third case, fig. 5-3 is a flowchart illustrating step S302 according to another exemplary embodiment, and as shown in fig. 5-3, step S302 includes:

and step S3025, determining that the electronic equipment is in a flat standing state according to the detection data of the first sensor and the second sensor.

And in combination with a specific application scene, the folding screen is in a flat standing state when being horizontally placed on the supporting surface. Fig. 6-1 and 6-2 are schematic diagrams illustrating a folded screen state according to various exemplary embodiments. For example, as shown in fig. 6-1, the folded screen 100 is placed on a support surface where the first screen 110 and the second screen 120 meet. Alternatively, as shown in fig. 6-2, first panel 110 of foldable panel 100 lies flat on a support surface. Alternatively, the second screen 120 of the folded screen 100 lies flat on a support surface.

As shown in fig. 6-1 and 6-2, the x-axis is parallel to the fold axis, the y-axis is parallel to and perpendicular to the first screen, and the z-axis is perpendicular to the first screen in the first sensor coordinate system. The second sensor coordinate system has an x-axis parallel to the fold axis, a y-axis parallel to the second screen and perpendicular to the x-axis, and a z-axis perpendicular to the second screen. The first detection data includes detection values of an x-axis, a y-axis, and a z-axis in the first sensor coordinate system. The second detection data includes detection values of an x-axis, a y-axis, and a z-axis in the second sensor coordinate system.

Under the condition that the folding screen is determined to be in the standing state, if the detection values of the x axis, the y axis and the z axis in the detection data of the first sensor are not 0 and the detection values of the x axis, the y axis and the z axis in the detection data of the second sensor are not 0, it is indicated that the joint of the first screen and the second screen in the folding screen is flatly placed on the supporting surface (as shown in fig. 6-1).

In the case that the foldable screen is determined to be in the standing state, if the detected values of the x-axis and the y-axis in the detection data of the first sensor are approximately 0, and the detected value of the z-axis is approximately equal to the acceleration sensor, it indicates that the first screen of the foldable screen is flatly placed on the supporting surface (as shown in fig. 6-2). Of course, if the detected values of the x axis and the y axis in the detection data of the second sensor are approximate to 0, and the detected value of the z axis is approximate to the acceleration sensor, it indicates that the second screen of the folding screen is flatly placed on the supporting surface.

Step S3026, in response to the electronic device being in a flat standing state, determining a first included angle formed by the first screen and the horizontal plane, and a second included angle formed by the second screen and the horizontal plane.

Taking fig. 6-2 as an example, a first included angle α formed by the first screen 110 and the horizontal plane is an included angle formed by the y-axis and the horizontal plane in the first sensor coordinate system. The value of the first included angle alpha can be determined through the y-axis detection value and the z-axis detection value in the first sensor detection number. Similarly, a second angle β formed by the second screen 120 and the horizontal plane is an angle formed by the y-axis and the horizontal plane in the second sensor coordinate system. The value of the second included angle β can be determined by detecting the y-axis detection value and the z-axis detection value in the data by the second sensor.

And S3027, determining the horizontal plane as an equivalent plane in response to the first included angle being larger than the first set angle and the second included angles being larger than the second set angle.

With reference to fig. 6-1, when the first included angle α is greater than the first set angle and the second included angle β is greater than the second set angle, the entire folding screen 100 is in a book-like state similar to the unfolded state. In such a case, the user's viewing plane is approximately parallel to the horizontal plane, thus treating the horizontal plane as the equivalent plane of the folding screen. Optionally, the first setting angle and the second setting angle are: 10 °, 15 °, 20 °, etc., and the first set angle and the second set angle may be the same.

In addition, in the embodiment of the disclosure, in response to that the first included angle is smaller than or equal to the first set angle and the second included angle is larger than or equal to the second set angle, the rotation state of the folding screen is determined according to the detection data of the second sensor.

When the first included angle is smaller than or equal to the first set angle and the second included angle is larger than or equal to the second set angle, the first screen of the folding screen is close to the horizontal plane. The folded screen now assumes the configuration shown in fig. 6-2. In such a case, optionally, the first screen 110 is used to display an operation interface such as a virtual keyboard, and the second screen 120 is used to display an application program interface. At this time, the folding screen can be used as a notebook computer.

In such a usage scenario, the first screen 110 is placed relatively stably on the supporting surface, and the second screen 120 is the main display screen and rotates relative to the first screen 110. Therefore, in order to reduce power consumption, the first sensor provided corresponding to the first screen 110 is turned off, and the second sensor corresponding to the second screen 120 is kept operated. And then, the rotating state of the folding screen is determined according to the detection data of the second sensor.

With continued reference to fig. 3, after step S302, step S303 is performed.

And step S303, acquiring equivalent data of the detection data of the first sensor and the second sensor relative to the equivalent plane, and determining the rotation state of the folding screen according to the equivalent data.

The equivalent plane is equivalent to the folding screen to be a straight screen, and the equivalent data obtained in step S303 is equivalent to the detection data of the acceleration sensor provided based on the straight screen. Therefore, the special state of the folding screen in the semi-folding state is considered in determining the rotating state of the folding screen according to the equivalent data, and the detection data of the first sensor and the second sensor are specifically fused to accurately reflect the current rotating state of the folding screen.

In one example, fig. 7 is a flowchart illustrating step S303 according to an exemplary embodiment, and as shown in fig. 7, step S303 includes the following steps.

Step 3031, determining an equivalent coordinate system of the first sensor and the second sensor based on the equivalent plane.

Step S3032, merging the detection data of the first sensor and the second sensor into the equivalent coordinate system to obtain equivalent data.

Fig. 8 is a flowchart illustrating step S303 according to another exemplary embodiment. As shown in fig. 8, step S3031 specifically includes:

and step S801, determining the midpoint position of a connecting line of the first sensor and the second sensor.

The position of the first sensor on the first screen and the position of the second sensor on the second screen are stored in the display system in advance. And determining the midpoint position of a connecting line between the first sensor and the second sensor according to the position of the first sensor on the first screen, the position of the second sensor on the second screen and the included angle between the first screen and the second screen.

And step S802, determining a projection point of the midpoint position on the equivalent plane as an origin position of the equivalent coordinate system. And taking the orthographic projection point of the midpoint position on the equivalent plane as the origin of the equivalent coordinate system. That is, the line connecting the midpoint and the origin is perpendicular to the equivalent plane.

Step S803, an equivalent coordinate system is determined from the equivalent plane and a direction perpendicular to the equivalent plane based on the origin position. In the equivalent coordinate system, the x-axis and the y-axis are orthogonal and lie within an equivalent plane, and the z-axis is perpendicular to the equivalent plane. Optionally, the x-axis is parallel to the fold axis and the y-axis is orthogonal to the fold axis in the equivalent coordinate system.

By adopting the mode, the included angle between the first screen and the second screen in the folding screen is different, so that the component of the first sensor detection data and the component of the second sensor detection data in the equivalent coordinate system are different. In other words, the equivalent data reflects the influence of the included angle formed by the first screen and the second screen. Therefore, the equivalent data can accurately feed back the rotation state of the folding screen in the semi-folding state.

In summary, by using the method for detecting the state of the folding screen provided by the embodiment of the present disclosure, an equivalent plane equivalent to the folding screen is determined according to the motion state of the folding screen. And fusing the detection data of the first sensor and the second sensor based on the equivalent plane to acquire equivalent data. And then, determining the rotation state of the folding screen according to the equivalent data. By adopting the detection method provided by the embodiment of the disclosure, the overall detection accuracy is improved, and the defect of inaccurate detection caused by the fact that the folding angle of the folding screen cannot be considered in the related technology is effectively overcome.

Based on the folding screen state detection method, the embodiment of the disclosure further provides a folding screen state detection device. The device is applied to a processor of a display system, and the display system also comprises a folding screen and an acceleration sensor; folding screen is including the first screen and the second screen that are located folding axis both sides, and acceleration sensor is including the first sensor that corresponds first screen setting and the second sensor that corresponds the second screen setting.

FIG. 9 is a block diagram illustrating a detection device according to an exemplary embodiment. As shown in fig. 9, the detection apparatus includes:

an obtaining module 910, configured to obtain detection data of a first sensor and a second sensor;

a first determining module 920, configured to determine an equivalent plane according to detection data of the first sensor and the second sensor; and

the second determining module 930 is configured to obtain equivalent data of the detection data of the first sensor and the second sensor with respect to the equivalent plane, and determine the rotation state of the folding screen according to the equivalent data.

In one embodiment, FIG. 10 is a block diagram illustrating a detection device according to another exemplary embodiment. As shown in fig. 10, the first determining module 920 includes:

the first determining unit 921, configured to determine that the folding screen is in a moving state according to detection data of the first sensor and the second sensor; and

a second determining unit 922 for acquiring the moving direction and determining a plane perpendicular to the moving direction as an equivalent plane.

In one embodiment, FIG. 11 is a block diagram illustrating a detection device according to another exemplary embodiment. As shown in fig. 11, the first determining module 920 includes:

a third determining unit 923, configured to determine that the foldable screen is in an upright standing state according to the detection data of the first sensor and the second sensor; and

a fourth determining unit 924 for determining, as an equivalent plane, a plane of a plane on which both side edges parallel to the folding axis lie, in response to the folded screen being in the upright standing state.

In one embodiment, FIG. 12 is a block diagram illustrating a detection device according to another exemplary embodiment. As shown in fig. 12, the first determining module 920 includes:

a fifth determining unit 925, configured to determine that the folding screen is in a flat-laying and standing state according to the detection data of the first sensor and the second sensor;

the sixth determining unit 926, in response to the electronic device being in a flat standing state, determines a first included angle formed by the horizontal plane of the first screen and a second included angle formed by the horizontal plane of the second screen; and

a seventh determining unit 927, configured to determine the horizontal plane as an equivalent plane in response to the first included angle being greater than the first set angle and the second included angle being greater than the second set angle.

In one embodiment, the seventh determining unit 927 is further configured to: and determining the rotation state of the folding screen according to the detection data of the second sensor in response to the first included angle being smaller than or equal to a first set angle and the second included angle being larger than or equal to a second set angle.

In one embodiment, FIG. 13 is a block diagram illustrating a detection device according to another exemplary embodiment. As shown in fig. 13, the second determining module 930 includes:

an eighth determining unit 931 for determining an equivalent coordinate system of the first sensor and the second sensor based on the equivalent plane; and

an obtaining unit 932, configured to combine the detection data of the first sensor and the second sensor into an equivalent coordinate system to obtain equivalent data.

In one embodiment, FIG. 14 is a block diagram illustrating a detection device according to another exemplary embodiment. As shown in fig. 14, the eighth determining unit 931 includes:

a first determining subunit 9311, configured to determine a midpoint position of a connecting line between the first sensor and the second sensor;

a second determining subunit 9312, configured to determine a projection point of the midpoint position on the equivalent plane as an origin position of the equivalent coordinate system; and

a third determining subunit 9313 for determining an equivalent coordinate system based on the origin position and according to the equivalent plane and a direction perpendicular to the equivalent plane.

In one embodiment, the apparatus further comprises a control module. The control module is used for responding to the angle formed by the first screen and the second screen to be within a set angle range, and controlling the first sensor and the second sensor to work.

Based on the folding screen state detection method, the embodiment of the disclosure further provides electronic equipment. The electronic device includes: a memory and a processor.

Wherein the memory stores processor-executable instructions. The processor is configured to execute the executable instructions in the memory to implement the folded screen rotation state detection method provided above.

Based on the electronic equipment, the embodiment of the disclosure also provides a display system. The display system includes: folding screen, acceleration sensor to and above-mentioned electronic equipment. The acceleration sensor comprises a first sensor and a second sensor which are respectively arranged on two sides of a folding axis of the folding screen.

FIG. 15 is a block diagram of a display system provided in accordance with an exemplary embodiment. Optionally, the display system includes, but is not limited to: smart phones, tablet computers, desktop/laptop/handheld computers, notebook computers, ultra-mobile personal computers (UMPCs), Personal Digital Assistants (PDAs), Augmented Reality (AR)/Virtual Reality (VR) devices.

As shown in fig. 15, display system 1500 may include one or more of the following components: processing component 1502, memory 1504, power component 1506, multimedia component 1508, document component 1150, input/output (I/O) interface 1512, sensor component 1514, communications component 1516, and image capture component.

The processing component 1502 generally provides for overall operation of the terminal device 1500, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. Processing components 1502 may include one or more processors 1520 to execute instructions. Further, processing component 1502 may include one or more modules that facilitate interaction between processing component 1502 and other components. For example, processing component 1502 may include a multimedia module to facilitate interaction between multimedia component 1508 and processing component 1502.

Memory 1504 is configured to store various types of data to support operations at terminal device 1500. Examples of such data include instructions for any application or method operating on terminal device 1500, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 1504 may be implemented by any type or combination of volatile or non-volatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.

The power supply component 1506 provides power to the various components of the terminal device 1500. The power components 1506 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the terminal device 1500.

The multimedia component 1508 includes a display screen that provides an output interface between the terminal device 1500 and the target object. In some embodiments, the display may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the display screen includes a touch panel, the display screen may be implemented as a touch screen to receive an input signal from a target object. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation.

The audio component 1150 is configured to output and/or input audio signals. For example, audio component 1150 may include a Microphone (MIC) configured to receive external audio signals when terminal device 1500 is in an operational mode, such as call mode, recording mode, and voice recognition mode. The received audio signals may further be stored in the memory 1504 or transmitted via the communication component 1516. In some embodiments, audio assembly 1150 also includes a speaker for outputting audio signals.

The I/O interface 1512 provides an interface between the processing component 1502 and peripheral interface modules, which can be keyboards, click wheels, buttons, etc.

The sensor component 1514 includes one or more sensors for providing status assessment of various aspects to the terminal device 1500. For example, sensor component 1514 can detect an open/closed state of terminal device 1500, the relative positioning of components, such as a display screen and keypad of terminal device 1500, sensor component 1514 can also detect a change in position of terminal device 1500 or a component, the presence or absence of a target object in contact with terminal device 1500, orientation or acceleration/deceleration of terminal device 1500, and a change in temperature of terminal device 1500. As another example, the sensor assembly 1514 also includes a light sensor disposed beneath the OLED display screen.

The communication component 1516 is configured to facilitate wired or wireless communication between the terminal device 1500 and other devices. The terminal device 1500 may access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 1516 receives broadcast signals or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 1516 further includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

In an exemplary embodiment, terminal device 1500 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors, or other electronic components.

In an exemplary embodiment, the disclosed embodiment also provides a readable storage medium, and the readable storage medium stores executable instructions. The executable instructions can be executed by a processor of the terminal equipment to realize the steps of the motion monitoring method. The readable storage medium may be, among others, ROM, Random Access Memory (RAM), CD-ROM, magnetic tape, floppy disk, optical data storage device, and the like.

The above description is only exemplary of the present disclosure and should not be taken as limiting the disclosure, as any modification, equivalent replacement, or improvement made within the spirit and principle of the present disclosure should be included in the scope of the present disclosure.

Claims

1. The method is characterized by being applied to a processor of a display system, wherein the display system further comprises a folding screen and an acceleration sensor; the folding screen comprises a first screen and a second screen which are positioned on two sides of a folding axis, and the acceleration sensor comprises a first sensor arranged corresponding to the first screen and a second sensor arranged corresponding to the second screen; the method comprises the following steps:

acquiring detection data of a first sensor and a second sensor;

2. The method of claim 1, wherein determining an equivalent plane from the sensed data of the first and second sensors comprises:

3. The method of claim 1, wherein determining an equivalent plane from the sensed data of the first and second sensors comprises:

and determining a plane of a plane on which two side edges parallel to the folding axis are located as the equivalent plane in response to the folding screen being in the upright standing state.

4. The method of claim 1, wherein determining an equivalent plane from the sensed data of the first and second sensors comprises:

responding to the condition that the folding screen is in the flat standing state, and determining a first included angle formed by the first screen and a horizontal plane and a second included angle formed by the second screen and the horizontal plane;

5. The method of claim 1, wherein the obtaining equivalent data of the detection data of the first sensor and the second sensor with respect to an equivalent plane comprises:

6. The method of claim 5, wherein said determining an equivalent coordinate system of the first sensor and the second sensor based on the equivalent plane comprises:

7. The method of claim 4, further comprising:

and determining the rotation state of the folding screen according to the detection data of the second sensor in response to the first included angle being smaller than or equal to the first set angle and the second included angle being larger than or equal to the second set angle.

8. The method of claim 1, further comprising:

the angle between the first screen and the second screen is obtained, and the first sensor and the second sensor are controlled to work in response to the fact that the angle between the first screen and the second screen is within a set angle range.

9. The folding screen state detection device is applied to a processor of a display system, and the display system further comprises a folding screen and an acceleration sensor; the folding screen comprises a first screen and a second screen which are positioned on two sides of a folding axis, and the acceleration sensor comprises a first sensor arranged corresponding to the first screen and a second sensor arranged corresponding to the second screen; the device comprises:

10. The apparatus of claim 9, wherein the first determining module comprises:

11. The apparatus of claim 9, wherein the first determining module comprises:

12. The apparatus of claim 9, wherein the first determining module comprises:

the sixth determining unit is used for determining a first included angle formed by the first screen and the horizontal plane and a second included angle formed by the second screen and the horizontal plane in response to the folding screen being in the flat-laying and standing state; and

13. The apparatus of claim 9, wherein the second determining module comprises:

14. The apparatus according to claim 13, wherein the eighth determining unit comprises:

15. The apparatus of claim 12, wherein the seventh determining unit is further configured to:

16. The apparatus of claim 12, further comprising:

and the control module is used for acquiring the angle between the first screen and the second screen and controlling the first sensor and the second sensor to work in response to the fact that the angle between the first screen and the second screen is within a set angle range.

17. An electronic device, characterized in that the electronic device comprises:

a memory storing the processor-executable instructions; and

a processor configured to execute the executable instructions in the memory to implement the method of any of claims 1-8.

18. A display system, characterized in that the display system comprises:

folding the screen;

the electronic device of claim 17.

19. A readable storage medium having stored thereon executable instructions, wherein the executable instructions when executed by a processor implement the method of any one of claims 1-8.