WO2020135701A1

WO2020135701A1 - Display control method and apparatus, and electronic device

Info

Publication number: WO2020135701A1
Application number: PCT/CN2019/129137
Authority: WO
Inventors: 苏阳
Original assignee: 中兴通讯股份有限公司
Priority date: 2018-12-29
Filing date: 2019-12-27
Publication date: 2020-07-02
Also published as: CN109710161A

Abstract

Disclosed are a display control method and apparatus, and an electronic device. The method comprises: when a screen is bent, detecting a bending parameter corresponding to at least one bending area; determining the sizes of at least two display areas needing to be rearranged and a bending angle of the screen based on the bending parameter corresponding to the at least one bending area; and rearranging and displaying a display effect of the target content on the screen based on the sizes of the at least two display areas and the bending angle of the screen. Abstract drawing: figure 2

Description

Display control method and device, electronic equipment

Technical field

The present application relates to screen display technology, in particular to a display control technology based on a flexible screen.

Background technique

A flexible screen generally refers to a flexible organic light-emitting diode (OLED, Organic Light-Emitting Diode). At present, some companies have successfully developed flexible screens that can be mass-produced. This not only brings major changes to the production of new-generation high-end smart phones, but also brings far-reaching applications to wearable devices because of their low power consumption and flexible characteristics. In the future, flexible screens will be widely used with the continuous penetration of personal intelligent terminals. The flexible screen is flexible, and users can bend, fold, or rotate the screen according to their own preferences, and the content displayed on the screen also exhibits effects such as bending. However, this bending effect has a greater impact on the display of multimedia resources such as text and pictures. When reading text and pictures, users will have reading difficulties due to the bending effect and affect the reading experience. Therefore, how to re-display the affected area in the screen and other secondary layouts when the screen is bent to re-display the visual experience acceptable to the user is an urgent problem to be solved.

Summary of the invention

To solve the above technical problems, embodiments of the present application provide a display control method and device, and electronic equipment.

The display control method provided by an embodiment of the present application includes: when a screen is bent, detecting a bending parameter corresponding to at least one bending area; based on the bending parameter corresponding to the at least one bending area, determining at least two display areas that need to be rearranged The size of the screen and the bending angle of the screen; based on the size of the at least two display areas and the bending angle of the screen, the display effect of the target content in the screen is rearranged and displayed.

The display control device provided by an embodiment of the present application includes: a detection unit configured to detect a bending parameter corresponding to at least one bending region; a first determining unit configured to determine that a re-layout is required based on the bending parameter corresponding to the at least one bending region The size of the at least two display areas and the bending angle of the screen; the second determining unit is configured to rearrange the display effect of the target content on the screen based on the size of the at least two display areas and the bending angle of the screen.

An electronic device provided by an embodiment of the present application includes: a screen configured to display target content; a sensor configured to detect bending parameters corresponding to at least one bending area; a processor and a memory, the memory stores a computer program, and the processor is configured To call and run the computer program stored in the memory, the above method is executed.

The computer-readable storage medium provided by the embodiments of the present application stores a computer program, and the computer program enables the computer to execute the above method.

BRIEF DESCRIPTION

The drawings generally illustrate various embodiments discussed herein by way of example and not limitation.

1 is a schematic diagram of a hardware structure of a terminal provided by an embodiment of this application;

2 is a first schematic flowchart of a display control method provided by an embodiment of the present application;

3 is a schematic structural composition diagram of an electronic device provided by an embodiment of this application;

4 is a second schematic flowchart of a display control method provided by an embodiment of this application;

5 is a schematic flowchart 3 of a display control method provided by an embodiment of this application;

6 is a schematic diagram of a flexible bending sensor provided by an embodiment of the present application;

FIG. 7-1 is a schematic diagram of the screen bending outwards according to an embodiment of the present application;

7-2 is a schematic diagram of a screen bent inwardly provided by an embodiment of the present application;

8-1 is a schematic diagram of an interface layout provided by an embodiment of the present application where the screen is bent inward and the screen bending angle is greater than 90°;

8-2 is a schematic diagram of an interface layout provided by an embodiment of the present application where the screen is bent inward and the screen bending angle is less than 90°;

8-3 is a schematic diagram of an interface layout provided by an embodiment of the present application where the screen is bent outward and the screen bending angle is less than 270°;

8-4 is a schematic diagram of an interface layout provided by an embodiment of the present application where the screen is bent outward and the screen bending angle is greater than 270°;

9-1 is a schematic diagram of loading text before re-layout provided by an embodiment of the present application;

9-2 is a schematic diagram of the re-layout of loading text provided by an embodiment of the present application;

10-1 is a schematic diagram 1 before loading multimedia resources and re-laying text provided by an embodiment of the present application;

10-2 is a schematic diagram 1 after loading multimedia resources and text re-layout provided by an embodiment of the present application;

11-1 is a schematic diagram of loading multimedia resources before redistribution provided by an embodiment of the present application;

FIG. 11-2 is a schematic diagram of a multimedia resource re-layout provided by an embodiment of the present application;

FIG. 12-1 is a schematic diagram 2 before loading multimedia resources and text re-layout provided by an embodiment of the present application;

12-2 is a schematic diagram 2 after loading multimedia resources and re-laying text provided by an embodiment of the present application;

13 is a schematic structural diagram of a display control device provided by an embodiment of the present application.

detailed description

It should be understood that the specific embodiments described herein are only used to explain the present application, and are not used to limit the present application.

In the subsequent description, the use of suffixes such as “module”, “part” or “unit” used to represent elements is only for the benefit of the description of the present application, and has no specific meaning in itself. Therefore, "module", "component" or "unit" can be used in a mixed manner.

The terminal can be implemented in various forms. For example, the terminals described in this application may include mobile phones, tablets, laptops, PDAs, personal digital assistants (Personal Digital Assistant (PDA), portable media players (Portable Media Player, PMP), navigation devices, Wearable devices, smart bracelets, pedometers and other mobile terminals, as well as fixed terminals such as digital TVs and desktop computers.

In the subsequent description, a mobile terminal will be used as an example for illustration. Those skilled in the art will understand that, in addition to elements specifically used for mobile purposes, the configuration according to the embodiments of the present application can also be applied to fixed-type terminals.

Referring to FIG. 1, FIG. 1 is a schematic diagram of a hardware structure of a terminal provided by an embodiment of the present application. The terminal 100 may include: an RF (Radio Frequency) unit 101, a WiFi module 102, an audio output unit 103, and A/V ( Audio/video) input unit 104, sensor 105, display unit 106, user input unit 107, interface unit 108, memory 109, processor 110, power supply 111 and other components. Those skilled in the art may understand that the structure of the mobile terminal shown in FIG. 1 does not constitute a limitation on the mobile terminal, and the mobile terminal may include more or fewer components than those illustrated, or combine certain components, or different components Layout.

It should be noted that the screen of the mobile terminal according to the embodiment of the present application can be bent or folded, such as a flexible screen, and the flexible screen is, for example, but not limited to a flexible organic light-emitting diode screen. The terminal can be loaded with a variety of sensors, such as flexible bending sensors, pressure sensors, light-sensitive sensors, etc., and the sensors can generate feedback on various external influences received by the mobile phone. For example, when the user bends the mobile phone, the sensor feeds the bending parameters back to the system. The system redraws the bent screen according to the bending parameters returned by the sensor, and controls the software system to re-layout and render according to the bending mode, and displays the previous Content is re-formatted and scaled. This curved screen can adaptively display the content, enhancing the user experience.

FIG. 2 is a first schematic flowchart of a display control method provided by an embodiment of the present application. As shown in FIG. 2, the display control method may include the following steps 201 to 203:

Step 201: When the screen is bent, detect bending parameters corresponding to at least one bending area.

In the embodiment of the present application, the detection of the bending parameter corresponding to the at least one bending area may be implemented in at least one of the following manner 1 and manner 2:

Method 1: Detect the angle of light incident on the screen.

In this way, the terminal includes a light-sensitive sensor, which uses the light-sensitive sensor to detect the angle of light incident on the screen. When the screen does not bend, the angle of light incident on the entire screen is the same; when the screen is curved, the angle of light incident on the entire screen is inconsistent. It should be noted that the photosensitive sensor can detect the incident angle of light at various positions on the screen. Alternatively, the photosensitive sensor may detect the angle of incidence of light at predetermined positions on the screen.

Further, the photosensitive sensor simultaneously detects the light intensity on the screen; based on the light intensity on the screen, the screen brightness corresponding to the at least two display areas is determined. It should be noted that the light sensor can detect the light intensity at various positions on the screen. Alternatively, the photosensitive sensor may detect the light intensity at predetermined positions on the screen.

Manner 2: detecting the bending parameters of the flexible bending sensor covered under the screen, the bending parameters including the coordinates of at least one bending area in the screen and the bending angle of the screen.

It should be noted that the screen can be bent into at least two display areas, and two adjacent display areas are connected by a curved area, that is, one side of the curved area is connected to one display area, and the other side of the curved area is connected to another Display area; ideally, the curved area is a straight line, and in reality, the curved area is mostly a curved surface.

Step 202: Based on the bending parameters corresponding to the at least one bending area, determine the size of the at least two display areas that need to be rearranged and the bending angle of the screen.

In the case of adopting the above method one to detect the bending parameter corresponding to at least one bending area, based on the light incident angle on the screen, determine the coordinates of the at least one bending area in the screen and the bending angle of the screen; The coordinates of the curved area determine the size of each display area in the screen.

In the case of adopting the above manner two to detect the bending parameter corresponding to at least one bending area, the bending angle of the screen is directly obtained from the bending parameter, and each display area in the screen is determined based on the coordinates of the bending area size of.

Step 203: Based on the size of the at least two display areas and the bending angle of the screen, rearrange the display effect of the target content on the screen.

When there is only one curved area on the screen, determine the first display area and the second display area that need to be rearranged. The following uses the curved area to divide the screen into the first display area and the second display area as an example. Note that the same applies to a larger number of display areas.

In the embodiment of the present application, based on the size of the at least two display areas and the bending angle of the screen, the display effect of rearranging and displaying the target content on the screen may be implemented by the following first and second aspects:

The first aspect: the relocation of the display position

Determine the angle between the first display area and the second display area based on the bending angle of the screen; if the angle between the first display area and the second display area is less than the first threshold, then Display target content at a first position in the first display area and/or the second display area away from the curved area; if the angle between the first display area and the second display area is greater than the second The threshold value is to display the target content at a second position near the curved area in the first display area and/or the second display area.

Here, the distance between the first position and the curved area is determined based on the size of the first display area, the size of the second display area, and the angle between the first display area and the second display area Determine the distance between the second position and the edge of the screen based on the size of the first display area, the size of the second display area, and the angle between the first display area and the second display area .

For example: suppose the angle between the first display area and the second display area is A; when A is greater than 180°, if the screen content before bending is affected by the bending area at this time, the screen away from the bending area The edge side is used as a reference, and the redistributed target content is first laid out to the screen edge side. Further, according to A, the distance of the target content from the bending area on both sides of the bending area can be calculated. When A is less than 180°, if the screen content before bending is affected by the bending area at this time, the redistributed target content is preferentially laid out on both sides of the bending area with reference to the bending area as a reference. Further, according to A, the distance between the target content and the edge of the screen on both sides of the curved area is calculated.

Further, assume that the lengths of the display areas on both sides of the bending area after bending are x1 and x2, respectively;

If the screen is curved inward, then the range of A is 0°-180°. In order to enhance the display effect, when A is greater than 90°, the layout target content should be close to the curved area; when A is less than 90°, the layout target content is far from the curved area, and the distance between the target content of the display areas on both sides and the curved area is d1, respectively d2, then the values of d1 and d2 can be calculated according to the included angle A: d1=(|90°—A|/90°)*x1, d2=(|90°—A|/90°)*x2, according to d1 , D2 distance to design the layout.

If the screen is curved outward, then the range of A is 180°-360°. To enhance the display effect, when A is less than 270°, the layout target content should be close to the edges of both sides of the curved screen; when A is greater than 270°, the layout target content is far from the screen edge, and the distance between the target content of the display area on both sides and the screen edge D3, d4, then the values of d3 and d4 can be calculated according to the angle A of light incidence: d3=(|270°—A|/270°)*x1, d4=(|270°—A|/270°) *x2, design the layout according to the distance between d3 and d4.

Referring to Fig. 8-1, the screen is bent inward, the screen bending angle is greater than 90°, and the target content is relocated away from the edge of the screen.

Referring to Figure 8-2, the screen is bent inward, the screen bending angle is less than 90°, and the target content is re-layed near the edge of the screen.

Referring to FIG. 8-3, the screen is bent outward, the screen bending angle is less than 270°, and the target content is rearranged away from the bending area.

Referring to Figure 8-4, the screen is bent outward, the screen bending angle is greater than 270°, and the target content is rearranged near the bending area.

Second aspect: Redistribute display data in each display area

Specifically, according to the size of the at least two display areas and the content characteristics of the target content, the target content is rearranged and displayed on the at least two display areas, and the content characteristics include at least one of the following One or more: text, multimedia content, controls.

1) When the target content includes text content, the text content is displayed on the at least two display areas according to the size of the at least two display areas and the number of the text content, wherein the The number of text contents displayed in each of the at least two display areas is proportional to the size of the display area.

Specifically, if the screen interface contains text content, and the text content part is partitioned by the curved area, it is redistributed according to the size of each display area and the number of text content after bending, so that the amount of text on each display area is proportional to the size of the display area .

2) When the target content includes multimedia content, the multimedia content is displayed on the target display area according to the size of the multimedia content and the size of the at least two display areas, wherein the target display area The size is greater than or equal to the size of the multimedia content.

Wherein 2.1) If the size of the multimedia content is larger than the size of each display area in the at least two display areas, the size of the multimedia content is reduced to the size of the target display area, and the size of the target display area Is the largest of the sizes of the at least two display areas, displaying the reduced multimedia content on the target display area; if the size of the multimedia content is smaller than each of the at least two display areas The size of the display area, the multimedia content is displayed in a target display area, and the target display area is any one of the at least two display areas; if the size of the multimedia content is smaller than the at least two If the size of a partial display area in the display area is to display the multimedia content in a target display area, the target display area is a display area in the at least two display areas whose size is larger than the size of the multimedia content.

For example, assuming that the size of the multimedia content is S1 and the sizes of the two display areas obtained after the screen is bent are S2 and S3, then:

If S1>MAX(S2, S3), the size of the multimedia content is reduced to the maximum value of S2 and S3, and the multimedia content is laid out on the display area on the side of the maximum value;

If S1<MIN(S2, S3), move the multimedia content to the display area on either side;

If S2<=S1<=S3, the multimedia content is moved to a larger size display area and displayed.

In addition, the target content further includes text content, and the text content is displayed on the at least two display areas according to the size of the at least two display areas and the number of the text content, wherein the at least two The number of text contents displayed in each display area of each display area is proportional to the size of the display area.

Further, 2.2) determine the proportion of the multimedia content according to the size of the multimedia content and the size of the screen; for each display area of the at least two display areas, according to the proportion of the multimedia content The coefficient and the size of the display area determine the zoom size of the multimedia content corresponding to the display area, and the multimedia content is scaled according to the zoom size and displayed in the display area.

For example, assuming that the size of the original multimedia content is S4 and the size of the original screen is S5, the ratio of the multimedia content is k=S4/S5, and the size of the display area on both sides after the screen is bent is S6 and S7, so heavy The laid-out multimedia content is reduced (expanded) in proportion to k times, that is, the size of the multimedia content on the display area on both sides after bending is k*S6, k*S7, and then the multimedia content is laid out according to this size.

With the technical solutions of the embodiments of the present application, when a user bends a flexible screen, the user can dynamically rearrange the screen content according to the bending angle of the screen in real time to obtain the best user experience. Text, pictures, videos and other resources on the screen will also be re-zoomed and typeset according to the folding degree of the screen to achieve the most suitable viewing angle for users. On the other hand, according to the intensity of the light received on the curved screen, dynamically adjust the screen brightness, reduce the screen brightness for the weak light, increase the screen brightness for the strong light, and dynamically allocate background lighting resources to reduce Power consumption. In addition, when the user bends the flexible screen, the bending method of the screen is more flexible, and the user can bend the screen at any position.

FIG. 3 is a schematic structural diagram of an electronic device provided by an embodiment of the present application. The electronic device may be any type of terminal. As shown in FIG. 3, the electronic device includes:

Screen 301, configured to display target content;

The sensor 302 is configured to detect bending parameters corresponding to at least one bending area;

The processor 303 is configured to determine the size of the at least two display areas to be rearranged and the bending angle of the screen based on the bending parameters corresponding to the at least one bending area;

A memory 304, which is used to store a computer program, which is used to realize the display effect of rearranging and displaying the target content on the screen based on the size of the at least two display areas and the bending angle of the screen when the computer program is executed . The following embodiments of the present application refer to the memory 304 as a software module.

In the embodiment of the present application, the screen 301 may be a flexible screen. The screen 301 provides a user interface (UI, User Interface) function and is responsible for interaction with user operations, including display of text, pictures, and the like.

In the embodiment of the present application, the sensor 302 may be a pressure sensor configured to sense the bending force received by the screen; it may also be a light-sensitive sensor configured to sense changes in the light irradiated on the screen (light direction, light intensity); or The flexible bending sensor is configured to sense the bending angle of the screen. The sensor 302 feeds back the data to the processor 303.

In the embodiment of the present application, the processor 303 calculates the coordinates of the bending area and the size of each display area after bending the screen, and provides screen related data to the software module.

In the embodiment of the present application, the software module realizes to redraw the interface according to the coordinates of the bending area and the size of each display area, load resources such as text and pictures, redisplay these resources on the screen 301, and adjust the brightness of the screen.

FIG. 4 is a second schematic flowchart of a display control method provided by an embodiment of the present application. As shown in FIG. 4, the display control method includes the following steps 401 to 408:

Step 401: The user operates the screen, and the sensor senses that light enters the screen.

Here, the sensor monitors the user's operation on the screen in real time, and obtains the change in the angle of light incident on the screen, and feeds back the change to the processor.

Step 402: If there is a difference in the angle of light incident on the screen, it indicates that the user has performed a bending operation on the screen.

Here, the sensor transmits the data of the angle of light incident on the screen to the processor, and the processor determines whether the light angle change is caused by the user's operation of bending the screen. If the angle of light incidence varies within a certain area, the processor assumes that the user has bent the screen.

Step 403: After bending the screen, the sensor senses the change in the angle formed by the light incident perpendicular to the screen, and based on this, it is determined whether the screen bending mode is to bend inward or outward.

Here, referring to FIGS. 7-1 and 7-2, wherein FIG. 7-1 is a schematic diagram of the screen bending outward, and FIG. 7-2 is a schematic diagram of the screen bending inward. Here, the curved area is a straight line, and the curved area divides the entire screen into a left display area and a right display area, where the angle of light incident between the left display area and the right display area is greater than 180°, the screen is considered to be The outer side is curved; the angle of light incident on the left display area and the right display area is less than 180°, it is considered that the screen is curved inward.

Step 404: The sensor sends the coordinates of the bending area and the bending angle of the screen to the processor, and the processor calculates the width and length of all display areas after bending, and dynamically controls the display effect.

Here, the sensor sends the coordinates of the bending area to the processor. The processor calculates the width and length of all display areas after the screen is bent. Taking the screen bending once as an example, after bending the screen, the processor can obtain the coordinates of the bending area, and then Combining the length and width of the screen itself before bending, the size of the display area in two directions bounded by the bending area can be calculated, and then the screen is divided into areas for display. If the user bends the screen twice, the calculation method is similar.

Step 405: The processor rearranges the display area according to the bending angle of the screen.

Specifically, the display area can be rearranged as follows:

The processor sends instructions to the software module to clear all the content displayed on the screen before bending. Assuming that the bending angle sensed by the sensor is A, that is, the angle between the two display areas obtained after the screen is bent is A, and A represents the bending angle of the screen, then: when A is greater than 180°, the processor recognizes that the screen is bent The method is to bend to the outside. At this time, if the screen content before the bending is affected by the bending area, the processor takes the screen edge side away from the bending area as a reference, and prioritizes the redistributed data to the screen edge side, according to the angle A The distance of the data from the bending area; when A is less than 180°, the processor recognizes that the screen bending method is to bend inward. At this time, if the screen content is affected by the bending area before bending, the processor refers to the bending area as a reference. The redistributed data is preferentially laid out on both sides of the curved area, and the distance between the data and the edge of the screen is calculated according to the angle A.

The calculation method of the above distance is as follows: Assuming that the lengths of the display areas on both sides of the curved area in the screen are x1, x2, then:

If the screen is curved inward, then the range of A is 0°-180°. In order to enhance the display effect, when A is greater than 90°, the re-layout display content should be close to the curved area. When A is less than 90°, the layout display content should be far from the curved area. The display content on the display areas on both sides is at a distance from the curved area d1, d2, then the value of d1, d2 can be calculated according to the angle A of light incidence: d1=(|90°—A|/90°)*x1, d2=(|90°—A|/90°)* x2, the processor designs the layout based on the distances of d1 and d2.

If the screen is curved outward, then the range of A is 180°-360°. In order to enhance the display effect, when A is less than 270°, the re-layout display content should be close to the edges of both sides of the curved screen. When A is greater than 270°, the layout display content is far away from the edges of the screen, and the display content on the display areas on both sides is away from the screen The distance between the edges is d3, d4, then the values of d3 and d4 can be calculated according to the angle A of light incidence: d3=(|270°—A|/270°)*x1, d4=(|270°—A|/ 270°)*x2, the processor designs the layout according to the distance between d3 and d4.

Referring to FIG. 8-4, the screen is bent outward, the screen bending angle is greater than 270°, and the target content is re-layed near the bending area.

Step 406: The processor calculates the display content to be allocated to each display area after bending according to the display content before the screen is bent and the size of each display area after bending.

After obtaining the size and bending mode (determined based on the bending angle of the screen) of each display area after the screen is bent, the processor needs to redesign the originally displayed interface. Consider the situation where the screen contains multimedia resource layouts (hereinafter referred to as multimedia, including video, audio, pictures, etc.) or the text layout is partitioned by curved surfaces. The following exemplary section lists several situations and corresponding layout schemes:

1. If the interface contains text information, and the text part is separated by the curved area, as shown in Figure 9-1, the processor redistributes the text information according to the screen size and the amount of text information after bending, so that the text on each display area The amount is proportional to the size of the display area. Suppose the original text volume is N1, the original screen size is S1, the size of the first display area and the second display area obtained after the screen is bent is S2, S3, then the text size on the first display area is N1*S2/S1 , The amount of characters on the second display area is N1*S3/S1. The text is re-layed out as shown in Figure 9-2.

2. If the interface contains multimedia and text, and the multimedia is separated by the curved area, as shown in Figure 10-1, the processor calculates the multimedia size S1, the first display area and the second display obtained after the screen is bent The size of the area is S2 and S3, respectively, if S1>MAX (S2, S3), the multimedia size is reduced to the maximum value of S2 and S3, and the multimedia is laid out on the display area on the side of the maximum value; If the size S1<MIN(S2, S3), the multimedia is moved to the display area on either side; if the multimedia size S2<=S1<=S3, the multimedia is moved to the larger size display area.

In the above case, text is displayed on the remaining screen space. The multimedia and text are re-layed out as shown in Figure 10-2.

3. If the interface contains only multimedia and the multimedia is separated by the curved area, as shown in Figure 11-1, the processor will re-layout the multimedia to the two display areas after the screen is bent, and the display areas on both sides of the curved area The multimedia is displayed. Suppose the original multimedia size is S4 and the original screen size is S5, then the ratio of multimedia is k=S4/S5, the size of the first display area and the second display area obtained after the screen is bent is S6, S7, so heavy The laid-out multimedia is reduced (expanded) proportionally k times, that is, the multimedia sizes on the first display area and the second display area are k*S6 and k*S7, respectively, and the post-processor lays out multimedia according to this size. Figure 11-2 shows the multimedia after re-layout.

4. If the interface contains multimedia and text, and the text part is separated by a curved area, as shown in Figure 12-1, the processor first lays out the multimedia on the side of the screen where the multimedia is located, and then lays out the text according to the remaining space of the two display areas, each displayed The amount of text on the area is proportional to the amount of space left in the display area. Figure 12-2 shows the multimedia and text after re-layout.

The above methods are to scale the multimedia size according to the previous size, and the corresponding text will be redesigned so that the curved screen can display a matching layout, and the influence of the curved area on the interface is minimized.

Step 407: The processor instructs the software module to draw the interface according to the display content allocated in each display area, reload and adjust the layout, and display the content.

After the processor redesigns the interface, the designed layout data will be passed to the software system, and then the secondary layout of the interface will be carried out according to the layout and data at all levels of the software to complete the display of visual effects, and the display module will present the new interface.

Step 408: The display module dynamically adjusts the brightness of the screen after the curved screen according to the intensity of the light received by the screen light sensor.

After the curved and re-arranged screen, the light intensity received by the photosensors on the screen is different. The display module quantifies the intensity of the light received throughout the screen, adjusts the brightness of the screen according to the quantized value, increases the screen brightness display where the light is strong, and decreases the screen brightness display where the light is weak.

According to the technical solution of the embodiment of the present application, when the user bends the screen, due to the difference in the angles of light incident perpendicular to the screen, the sensor under the screen will sense the angle difference and feedback the area affected by the difference in light angle To the processor, the processor judges that the reason for the difference in light angle is that the user bends the screen instead of the user touching the screen. When the screen is bent to the outside or to the inside, the sensor will judge the corresponding bending mode according to the difference in light received at the bending area. The processor will redraw the curved screen according to the data returned by the sensor, and control the software module to re-layout and render according to the bending mode, and re-typeset and zoom the previously displayed content. This curved screen can adaptively display the content, enhancing the user experience.

The advantage of this application in identifying the bending area is that the photosensitive sensor is a must-have sensor for each terminal. There is no need to add an additional sensor to the terminal. Using the photosensitive sensor to obtain data directly, you can identify the bending area, and can also be based on The light incidence angle identifies the bending angle of the screen, and the bending angle of the screen is used to re-layout the interface, which achieves the purpose of solving multiple problems with one component, saves costs, materials, and has high efficiency.

FIG. 5 is a third schematic flowchart of a display control method provided by an embodiment of the present application. As shown in FIG. 5, the display control method includes the following steps 501 to 506:

Step 501: The user operates the screen, and the sensor senses the change in screen bending.

Referring to FIG. 6, a flexible bending sensor is provided below the screen. The bending of the screen will cause the flexible bending sensor to bend, and the bending parameter of the flexible bending sensor can be detected by the controller.

Step 502: The sensor monitors the user's operation on the screen in real time, and the processor determines whether the bending mode of the screen is bending inward or outward through the bending change felt by the sensor, and calculates the bending angle.

Referring to FIGS. 7-1 and 7-2, FIG. 7-1 is a schematic diagram of the screen bending outward, and FIG. 7-2 is a schematic diagram of the screen bending inward. Here, the curved area is a straight line, and the curved area divides the entire screen into a left display area and a right display area, where the angle of light incident between the left display area and the right display area is greater than 180°, the screen is considered to be The outer side is curved; the angle of light incident on the left display area and the right display area is less than 180°, it is considered that the screen is curved inward.

Step 503: The sensor sends the coordinates of the bending area to the processor, and the processor calculates the width and length of all display areas obtained after the screen is bent, and dynamically controls the display mode of the screen.

Step 504: The processor rearranges the display area according to the bending angle of the screen.

Specifically, the display area can be rearranged as follows:

If the screen is curved outward, then the range of A is 180°-360°. In order to enhance the display effect, when A is less than 270°, the re-layout display content should be close to the edges of both sides of the curved screen. When A is greater than 270°, the layout display content is far from the edges of the screen, and the display content on the display areas on both sides is away from the screen The distance between the edges is d3, d4, then the values of d3 and d4 can be calculated according to the angle A of light incidence: d3=(|270°—A|/270°)*x1, d4=(|270°—A|/ 270°)*x2, the processor designs the layout according to the distance between d3 and d4.

Step 505: The processor calculates the display content to be allocated to each display area after bending according to the corresponding display content before the screen bending and the size of each display area after bending.

2. If the interface contains multimedia and text, and the multimedia is separated by the curved area, as shown in Figure 10-1, the processor calculates the multimedia size S1, the first display area and the second display obtained after the screen is bent The size of the area is S2, S3,

If S1>MAX(S2, S3), the multimedia size is reduced to the maximum value among S2 and S3, and the multimedia is laid out on the display area on the side of the maximum value;

If the multimedia size S1<MIN(S2, S3), move the multimedia to the display area on either side;

If the multimedia size S2<=S1<=S3, the multimedia is moved to a larger size display area.

In the above case, text is displayed on the remaining screen space. Figure 10-2 shows the multimedia and text after re-layout.

3. If the interface contains only multimedia and the multimedia is separated by the curved area, as shown in Figure 11-1, the processor will re-layout the multimedia to the two display areas after the screen is bent, and the display areas on both sides of the curved area The multimedia is displayed. Suppose the original multimedia size is S4 and the original screen size is S5, then the ratio of multimedia is k=S4/S5, and the sizes of the first display area and the second display area obtained after the screen is bent are S6 and S7, so heavy The laid-out multimedia is reduced (expanded) proportionally k times, that is, the multimedia sizes on the first display area and the second display area are k*S6 and k*S7, respectively, and the post-processor lays out multimedia according to this size. Figure 11-2 shows the multimedia after re-layout.

Step 506: The processor instructs the software module to draw the interface according to the display content allocated in each display area, reload and adjust the layout, and display the content.

According to the technical solution of the embodiment of the present application, when the user bends the screen, the sensor will also bend, and the sensor under the screen will feel the angle difference, and feed back the area affected by the angle difference to the processor, and the processor will judge that the angle difference occurs The reason is that the user bends the screen instead of the user touching the screen. When the screen is bent to the outside or the inside, the sensor will judge the corresponding bending method according to the angle of the bending area. The processor redraws the curved screen according to the data returned by the sensor, and controls the software module to re-layout and render according to the bending mode, and re-typesets and zooms the previously displayed content. This curved screen can adaptively display the content, enhancing the user experience.

13 is a schematic structural composition diagram of a display control device provided by an embodiment of the present application. As shown in FIG. 13, the device may include a detection unit 1301, a first determination unit 1302, and a second determination unit 1303.

The detection unit 1301 is configured to detect bending parameters corresponding to at least one bending area.

The first determining unit 1302 is configured to determine the size of the at least two display areas that need to be rearranged and the bending angle of the screen based on the bending parameters corresponding to the at least one bending area.

The second determining unit 1303 is configured to rearrange the display effect of the target content in the screen based on the sizes of the at least two display areas and the bending angle of the screen.

In one embodiment, the detection unit 1301 is configured to detect the angle of light incident on the screen; the first determination unit 1302 is configured to determine the screen based on the angle of light incident on the screen The coordinates of at least one bending area and the bending angle of the screen; determining the size of each display area on the screen based on the coordinates of the bending area.

In an embodiment, the detection unit 1301 is further configured to detect the light intensity on the screen; the first determination unit 1302 is further configured to determine the at least two based on the light intensity on the screen The brightness of the screen corresponding to the display area.

In an embodiment, the detection unit 1301 is configured to detect a bending parameter of a flexible bending sensor covered under the screen, the bending parameter including coordinates of at least one bending area in the screen and bending of the screen Angle; the first determining unit 1302 is configured to determine the size of each display area in the screen based on the coordinates of the bending area.

In an embodiment, when there is only one curved area on the screen, the curved area divides the screen into a first display area and a second display area; the second determination unit 1303 is configured to: The bending angle of the screen determines the angle between the first display area and the second display area; if the angle between the first display area and the second display area is less than the first threshold, the A display area and/or the second display area displays the target content at a first position away from the curved area; if the angle between the first display area and the second display area is greater than a second threshold, then Target content is displayed at a second position in the first display area and/or the second display area near the curved area.

In one embodiment, the distance between the first position and the curved area is based on the size of the first display area, the size of the second display area, and the first display area and the second display area The angle between is determined; the distance between the second position and the edge of the screen is based on the size of the first display area, the size of the second display area, and the first display area and the second display area The angle is determined.

In an embodiment, the second determining unit 1303 is configured to re-layout and display the target content on the at least two displays according to the sizes of the at least two display areas and the content characteristics of the target content Regionally, the content features include at least one or more of the following: text, multimedia content, controls, and other content that can be displayed on the screen.

In one embodiment, the second determining unit 1303 is configured to: when the target content includes text content, according to the size of the at least two display areas and the number of the text content, the text content Displayed on the at least two display areas, wherein the number of text content displayed in each of the at least two display areas is proportional to the size of the display area.

In an embodiment, the second determining unit 1303 is configured to: when the target content includes multimedia content, according to the size of the multimedia content and the size of the at least two display areas, the multimedia content Displayed in a target display area, wherein the size of the target display area is greater than or equal to the size of the multimedia content.

In an embodiment, the second determining unit 1303 is configured to: if the size of the multimedia content is larger than the size of each display area of the at least two display areas, reduce the size of the multimedia content to a target A size of a display area, the size of the target display area is a maximum value among the sizes of the at least two display areas, and the multimedia content after the size reduction is displayed on the target display area;

If the size of the multimedia content is smaller than the size of each display area in the at least two display areas, the multimedia content is displayed in a target display area, the target display area being of the at least two display areas Any display area;

If the size of the multimedia content is smaller than the size of part of the display area in the at least two display areas, the multimedia content is displayed in the target display area, the target display area being that the size of the at least two display areas is larger than The display area of the size of the multimedia content.

In an embodiment, the second determining unit 1303 is configured to: determine the proportion factor of the multimedia content according to the size of the multimedia content and the size of the screen; for each of the at least two display areas Display area, according to the ratio of the multimedia content and the size of the display area, determine the zoom size of the multimedia content corresponding to the display area, the multimedia content is scaled according to the zoom size and displayed in the In the display area.

Those skilled in the art should understand that the functions realized by the units in the display control device shown in FIG. 13 can be understood by referring to the related description of the foregoing display control method. The functions of each unit in the display control device shown in FIG. 13 can be realized by a program running on a processor, or by a specific logic circuit.

In practical applications, the detection unit 1301 in the display control device shown in FIG. 13 can be implemented by a sensor, such as a photosensor or a flexible bending sensor; the first determination unit 1302 in the display control device shown in FIG. 13 can be implemented by a processor ; The second determining unit 1303 in the display control device shown in FIG. 13 may be implemented by a computer program in the memory.

An embodiment of the present application also provides an electronic device. The electronic device includes a processor, and the processor can call and run a computer program from the memory to implement the method in the embodiments of the present application.

In an embodiment, the electronic device may further include a memory. The processor may call and run the computer program from the memory to implement the method in the embodiments of the present application.

Among them, the memory may be a separate device independent of the processor, or may be integrated in the processor.

In an embodiment, the electronic device may further include a transceiver, and the processor may control the transceiver to communicate with other devices, specifically, may send information or data to other devices, or receive information or data sent by other devices.

Among them, the transceiver may include a transmitter and a receiver. The transceiver may further include antennas, and the number of antennas may be one or more.

An embodiment of the present application also provides a computer-readable storage medium, which stores a computer program.

In an embodiment, the computer-readable storage medium may be applied to the network device in the embodiments of the present application, and the computer program causes the computer to execute the corresponding processes implemented by the network device in the methods of the embodiments of the present application. I will not repeat them here.

In an embodiment, the computer-readable storage medium can be applied to the mobile terminal/terminal device in the embodiments of the present application, and the computer program enables the computer to execute various methods of the embodiments of the present application implemented by the mobile terminal/terminal device The corresponding process will not be repeated here for brevity.

An embodiment of the present application also provides a computer program product, including computer program instructions.

In one embodiment, the computer program product can be applied to the network device in the embodiments of the present application, and the computer program instructions cause the computer to execute the corresponding process implemented by the network device in each method of the embodiment of the present application. This will not be repeated here.

In one embodiment, the computer program product can be applied to the mobile terminal/terminal device in the embodiments of the present application, and the computer program instructions cause the computer to execute the corresponding implementation of the mobile terminal/terminal device in each method of the embodiments of the present application For the sake of brevity, I will not repeat them here.

An embodiment of the present application also provides a computer program.

In an embodiment, the computer program can be applied to the network device in the embodiment of the present application. When the computer program runs on the computer, the computer is allowed to execute the corresponding process implemented by the network device in each method of the embodiment of the present application. For brevity, I will not repeat them here.

In an embodiment, the computer program can be applied to the mobile terminal/terminal device in the embodiments of the present application. When the computer program runs on the computer, the computer is executed by the mobile terminal/terminal in each method of the embodiments of the present application. The corresponding process implemented by the device will not be repeated here for simplicity.

Persons of ordinary skill in the art may realize that the units and algorithm steps of the examples described in conjunction with the embodiments disclosed herein can be implemented by electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are executed in hardware or software depends on the specific application of the technical solution and design constraints. Professional technicians can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

Those skilled in the art can clearly understand that for the convenience and conciseness of the description, the specific working process of the system, device and unit described above can refer to the corresponding process in the foregoing method embodiments, which will not be repeated here.

In the several embodiments provided in this application, it should be understood that the disclosed system, device, and method may be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division, and there may be other divisions in actual implementation, for example, multiple units or components may be combined or Can be integrated into another system, or some features can be ignored, or not implemented. In addition, the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, and may be in electrical, mechanical, or other forms.

The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit.

If the function is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on such an understanding, the technical solution of the present application essentially or part of the contribution to the existing technology or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including Several instructions are used to enable a computer device (which may be a personal computer, server, or network device, etc.) to perform all or part of the steps of the methods described in the embodiments of the present application. The aforementioned storage media include: U disk, mobile hard disk, read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic disk or optical disk and other media that can store program code .

The above is only the specific implementation of this application, but the scope of protection of this application is not limited to this, any person skilled in the art can easily think of changes or replacements within the technical scope disclosed in this application. It should be covered by the scope of protection of this application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

A display control method, including:

When the screen bends, detect the bending parameters corresponding to at least one bending area;

Based on the bending parameters corresponding to the at least one bending area, determining the size of the at least two display areas to be rearranged and the bending angle of the screen;

Based on the size of the at least two display areas and the bending angle of the screen, the display effect of the target content in the screen is rearranged and displayed.
The method according to claim 1, wherein the detecting a bending parameter corresponding to at least one bending area comprises:

Detecting the angle of incidence of light on the screen; and,

The determining, based on the bending parameters corresponding to the at least one bending area, the size of the at least two display areas that need to be rearranged and the bending angle of the screen include:

The coordinates of at least one bending area in the screen and the bending angle of the screen are determined based on the angle of incidence of light on the screen; and the size of each display area in the screen is determined based on the coordinates of the bending area.
The method according to claim 1 or 2, further comprising:

Detect the light intensity on the screen;

Based on the light intensity on the screen, determine the screen brightness corresponding to the at least two display areas respectively.
The method according to claim 1, wherein the detecting a bending parameter corresponding to at least one bending area comprises:

Detecting a bending parameter of a flexible bending sensor covered under the screen, the bending parameter including coordinates of at least one bending area in the screen and a bending angle of the screen; and,

The determining, based on the bending parameters corresponding to the at least one bending area, the sizes of at least two display areas that need to be rearranged includes:

The size of each display area in the screen is determined based on the coordinates of the curved area.
The method according to claim 1, 2 or 4, wherein, when there is only one curved area on the screen, the method includes: determining a first display area and a second display area that need to be re-layed;

Based on the size of the at least two display areas and the bending angle of the screen, the display effect of rearranging and displaying the target content on the screen includes:

Determine the angle between the first display area and the second display area based on the bending angle of the screen;

If the included angle between the first display area and the second display area is less than the first threshold, at a first position away from the curved area in the first display area and/or the second display area Display target content;

If the included angle between the first display area and the second display area is greater than a second threshold, at a second position near the curved area in the first display area and/or the second display area Display target content.
The method of claim 5, further comprising:

Determine the distance between the first position and the curved area based on the size of the first display area, the size of the second display area, and the angle between the first display area and the second display area;

The distance between the second position and the edge of the screen is determined based on the size of the first display area, the size of the second display area, and the angle between the first display area and the second display area.
The method according to claim 1, 2 or 4, wherein the re-layout displaying the display effect of the target content in the screen based on the size of the at least two display areas and the bending angle of the screen includes:

Re-layout the target content on the at least two display areas according to the size of the at least two display areas and the content characteristics of the target content, the content characteristics including at least one or more of the following Species: text, multimedia content, controls.
The method according to claim 7, wherein when the target content includes text content, the method includes: according to the size of the at least two display areas and the number of the text content, the text content Displayed on the at least two display areas, wherein the number of text content displayed in each of the at least two display areas is proportional to the size of the display area.
The method according to claim 7, wherein when the target content includes multimedia content, the method includes: according to the size of the multimedia content and the size of the at least two display areas, the multimedia content Displayed in a target display area, wherein the size of the target display area is greater than or equal to the size of the multimedia content.
The method according to claim 9, wherein the displaying the multimedia content on the target display area according to the size of the multimedia content and the size of the at least two display areas includes:

If the size of the multimedia content is larger than the size of each of the at least two display areas, the size of the multimedia content is reduced to the size of the target display area, and the size of the target display area is the at least The maximum value of the sizes of the two display areas, displaying the reduced multimedia content on the target display area;

If the size of the multimedia content is smaller than the size of each display area in the at least two display areas, the multimedia content is displayed in a target display area, the target display area being of the at least two display areas Any display area;

If the size of the multimedia content is smaller than the size of part of the display area in the at least two display areas, the multimedia content is displayed in the target display area, the target display area being that the size of the at least two display areas is larger than The display area of the size of the multimedia content.
The method according to claim 9, wherein the displaying the multimedia content on the target display area according to the size of the multimedia content and the size of the at least two display areas includes:

Determine the proportion factor of the multimedia content according to the size of the multimedia content and the size of the screen;

For each display area of the at least two display areas, according to the proportion factor of the multimedia content and the size of the display area, determine a zoom size corresponding to the multimedia content in the display area, according to the zoom size pair The multimedia content is displayed in the display area after zooming.
A display control device, including:

A detection unit configured to detect a bending parameter corresponding to at least one bending area;

The first determining unit is configured to determine the size of the at least two display areas to be rearranged and the bending angle of the screen based on the bending parameters corresponding to the at least one bending area;

The second determining unit is configured to rearrange the display effect of the target content on the screen based on the size of the at least two display areas and the bending angle of the screen.
The apparatus according to claim 12, wherein the detection unit is configured to detect an angle of incidence of light on the screen; and

The first determining unit is configured to: determine the coordinates of at least one bending area in the screen and the bending angle of the screen based on the angle of incidence of light on the screen; determine the screen based on the coordinates of the bending area The size of each display area in.
The apparatus according to claim 12, wherein the detection unit is configured to detect a bending parameter of a flexible bending sensor covered under the screen, the bending parameter including coordinates of at least one bending area in the screen and all Describe the bending angle of the screen; and

The first determining unit is configured to determine the size of each display area on the screen based on the coordinates of the curved area.
An electronic device, including:

Screen, configured to display target content;

A sensor configured to detect bending parameters corresponding to at least one bending area;

A processor and a memory, the memory storing a computer program, the processor being configured to call and run the computer program stored in the memory to perform the method according to any one of claims 1 to 11.
A computer-readable storage medium storing a computer program that causes a computer to execute the method according to any one of claims 1 to 11.