WO2021232961A1

WO2021232961A1 - Display control method and apparatus, storage medium, and electronic device

Info

Publication number: WO2021232961A1
Application number: PCT/CN2021/085084
Authority: WO
Inventors: 陈彪
Original assignee: Oppo广东移动通信有限公司
Priority date: 2020-05-18
Filing date: 2021-04-01
Publication date: 2021-11-25
Also published as: CN113687743A

Abstract

Disclosed in embodiments of the present application is a display control method, comprising: during extension and contraction of a flexible display screen, measuring the extension and contraction length and determining an effective display size of the screen; determining an application program running in the foreground, and adjusting window size parameters of the application program in a window management service according to the effective display size; reconfiguring a window of the application program according to the adjusted window size parameters; and redrawing and displaying a display interface of the application program on the screen.

Description

Display control method, device, storage medium and electronic equipment

This application claims the priority of a Chinese patent application filed with the Chinese Patent Office on May 18, 2020, the application number is 202010421710.7, and the application name is "display control method, device, storage medium and electronic equipment", the entire content of which is incorporated by reference In this application.

Technical field

This application relates to the technical field of electronic equipment, and in particular to a display control method, device, storage medium and electronic equipment.

Background technique

With the development of electronic device technology, the display screens of smart terminals such as smartphones and tablet computers are becoming larger, because larger display screens can present richer content, making human-computer interaction more realistic and efficient. Bringing a better user experience; at the same time, in order to make it easier to carry smart terminals, foldable terminals and flexible screen terminals were born, which greatly met the portability requirements of smart terminals with large displays.

Summary of the invention

The embodiments of the present application provide a display control method, device, storage medium, and electronic equipment, which can adaptively adjust the application layout along with the expansion and contraction of the display screen.

In a first aspect, an embodiment of the present application provides a display control method, which is applied to an electronic device including a retractable flexible display screen, and the method includes:

During the expansion and contraction of the flexible display screen, detecting the expansion length and determining the effective display size of the screen according to the expansion length;

Determine the application program running in the foreground, and adjust the window size parameters of the application program in the window management service according to the effective display size;

Re-layout the windows of the application program according to the adjusted window size parameters;

According to the re-layout window, the display interface of the application program is redrawn and displayed on the screen.

In a second aspect, an embodiment of the present application also provides a display control device, which is applied to an electronic device including a retractable flexible display screen, and the device includes:

The telescopic detection module is configured to detect the telescopic length during the telescopic process of the flexible display screen and determine the effective display size of the screen according to the telescopic length;

The parameter adjustment module is used to determine the application program running in the foreground, and adjust the window size parameter of the application program in the window management service according to the effective display size;

A window layout module, configured to rearrange the windows of the application program according to the adjusted window size parameters;

The interface drawing module is used to redraw and display the display interface of the application program on the screen according to the re-layout window.

In a third aspect, an embodiment of the present application also provides a storage medium on which a computer program is stored, and when the computer program runs on a computer, the computer is caused to execute:

According to the re-layout window, the display interface of the application program is redrawn and displayed on the screen. .

In a fourth aspect, an embodiment of the present application also provides an electronic device, including a processor and a memory, the memory has a computer program, and the processor is configured to execute:

Description of the drawings

In order to more clearly describe the technical solutions in the embodiments of the present application, the following will briefly introduce the drawings that need to be used in the description of the embodiments. Obviously, the drawings in the following description are only some embodiments of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.

FIG. 1 is a schematic diagram of the structure of an electronic device according to an embodiment of the present application;

FIG. 2 is another schematic diagram of the structure of the electronic device according to the embodiment of the present application;

FIG. 3 is a three-dimensional exploded schematic diagram of an electronic device according to an embodiment of the present application;

Figure 4 is a cross-sectional view of the electronic device in Figure 1 along V1-V1;

Figure 5 is a cross-sectional view of the electronic device in Figure 2 along V2-V2;

FIG. 6 is a schematic diagram of an application scenario of a display control method provided by an embodiment of the application;

FIG. 7 is a schematic diagram of a window of an application program in the display control method provided by an embodiment of the application; FIG.

FIG. 8 is a schematic diagram of the window layout in the display control method provided by the embodiment of the application; FIG.

FIG. 9 is another schematic diagram of the window layout in the display control method provided by the embodiment of the application; FIG.

FIG. 10 is another schematic diagram of the window layout in the display control method provided by the embodiment of the application; FIG.

FIG. 11 is another schematic diagram of the window layout in the display control method provided by the embodiment of the application; FIG.

FIG. 12 is another schematic diagram of the window layout in the display control method provided by the embodiment of the application; FIG.

FIG. 13 is a schematic structural diagram of a display control device provided by an embodiment of the application;

FIG. 14 is a schematic diagram of another structure of an electronic device provided by an embodiment of the application;

FIG. 15 is a schematic diagram of another structure of an electronic device provided by an embodiment of the application.

Detailed ways

The technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in this application, all other embodiments obtained by those skilled in the art without creative work shall fall within the protection scope of this application.

The reference to "embodiments" herein means that a specific feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present application. The appearance of the phrase in various places in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment mutually exclusive with other embodiments. Those skilled in the art clearly and implicitly understand that the embodiments described herein can be combined with other embodiments.

The embodiment of the present application provides a display control method. The execution subject of the display control method may be the display control device provided in the embodiment of the present application, or an electronic device integrated with the display control device, wherein the display control device may use hardware or Realized by software.

The embodiment of the present application provides a display control method, the method is applied to an electronic device including a retractable flexible display screen, and the method includes:

In some embodiments, the determining the application program running in the foreground and adjusting the window size parameter of the application program in the window management service according to the effective display size includes:

Determine the applications running in the foreground;

Determining the window state data corresponding to the application program according to the window management service;

Modify the variables related to the screen display size in the window state data to be consistent with the effective display size.

In some embodiments, the re-layout of the windows of the application program according to the adjusted window size parameters includes:

Adjust the display size of the root view of the application according to the adjusted window size parameter;

According to the adjusted display size of the root view and the layout attributes of the display elements in the window, the display elements in the window of the application are re-layout.

In some embodiments, after the re-layout of the display elements in the window of the application program, the method further includes:

When the content display area of the re-layout display element changes, the display content corresponding to the content display area is acquired, and the display content is loaded in the corresponding display element.

In some embodiments, the electronic device includes a position detection sensor; the detecting the telescopic length and determining the effective display size of the screen according to the telescopic length includes:

Detecting the telescopic direction and the telescopic length of the flexible display screen according to the position sensor;

Acquiring the recorded historical display size, and calculating the effective display size after expansion and contraction according to the telescopic length, the telescopic direction, and the historical display size;

Update the recorded historical display size according to the effective display size.

In some embodiments, the flexible display screen includes a reel, and the position detection sensor is an angular velocity sensor connected with the reel; the detection of the telescopic direction and the telescopic length of the flexible display screen according to the position sensor includes :

Detecting the rotation angle and the rotation direction of the reel according to the angular velocity sensor;

The expansion and contraction length of the flexible display screen is calculated according to the rotation angle, and the expansion and contraction direction of the flexible display screen is determined according to the rotation direction.

In some embodiments, after detecting the telescopic length and determining the effective display size of the screen according to the telescopic length, the method further includes:

Determine whether the difference between the effective display size and the historical display size is within a preset range;

If not, execute to determine the application program running in the foreground, and adjust the window size parameter of the application program in the window management service according to the effective display size.

The embodiment of the present application provides a display control method, which is applied to an electronic device including a retractable flexible display screen. Please refer to FIG. 1. FIG. 1 is a schematic diagram of a first structure of an electronic device provided by an embodiment of this application. Among them, the electronic device can be a smart phone, a tablet computer, a palmtop computer, a notebook computer, or a desktop computer and other devices. In the example of FIG. 1, the electronic device has a flexible display screen, one end of the flexible display screen is set on a reel, so that part of the flexible display screen can be wound on the reel, and the reel can be used to wind the flexible display screen and release the flexible display screen , Thereby expanding the display part of the flexible display assembly. The flexible display screen can be stretched or retracted in a direction perpendicular to the reel. For example, please refer to FIG. 2, which is a schematic diagram of a second structure of an electronic device provided by an embodiment of this application. The electronic device shown in Fig. 2 has a flexible display screen in a stretched state. When a user needs a large screen, the display part of the flexible display screen can be expanded to improve the user's operating experience. At the same time, when the large screen is not needed, the display part may not be expanded, thereby making the whole machine smaller in size and convenient to carry.

It should be noted that the expansion and contraction direction of the flexible display screen shown in Figure 1 is only an example. In other embodiments, the flexible display screen may also be set to expand and contract along the vertical direction when the user holds the device vertically.

When the display screen of the electronic device is in the display state, if the flexible display screen is stretched or retracted, the display interface is re-layouted and drawn according to the display control method provided in the embodiment of the present application, so that the display interface can be Adapt to the expanded screen. For example, during the expansion and contraction process of the flexible display screen, the expansion length is detected and the effective display size of the screen is determined according to the expansion length; the application running in the foreground is determined, and the window size parameters of the application in the window management service are adjusted according to the effective display size; The adjusted window size parameters re-layout the windows of the application program; according to the re-layout window, the display interface of the application program is redrawn and displayed on the screen. In this way, with the expansion and contraction of the flexible display screen, the window size parameters are continuously adjusted, so that applications running in the foreground can adaptively and dynamically adjust the layout of the display interface to adapt to the expanded display area. .

Referring to FIGS. 1 to 3, the electronic device 100 of this embodiment includes a housing assembly 10, a flexible display 30, a driving member 50 and a driving mechanism 70.

The housing assembly 10 is a hollow structure; components such as the driving member 50, the driving mechanism 70, and the camera 60 can all be arranged in the housing assembly 10. It is understandable that the electronic device 100 in the embodiment of the present application includes but is not limited to mobile terminals such as mobile phones and tablet computers or other portable electronic devices. In this document, the electronic device 100 is a mobile phone as an example for description.

In this embodiment, the housing assembly 10 includes a first housing 12 and a second housing 14, and the first housing 12 and the second housing 14 can move relative to each other. Specifically, in this embodiment, the first housing 12 and the second housing 14 are slidably connected, that is, the second housing 14 can slide relative to the first housing 12.

Specifically, referring to FIGS. 4 and 5, the first housing 12 and the second housing 14 jointly form an accommodating space 16. The accommodating space 16 can be used to place components such as the driving member 50, the camera 60, and the driving mechanism 70. The housing assembly 10 may further include a back cover 18, and the back cover 18 and the first housing 12 and the second housing 14 together form an accommodating space 16.

The driving member 50 is disposed in the second casing 14, one end of the flexible display screen 30 is disposed in the first casing 12, the flexible display screen 30 bypasses the driving member 50, and the other end of the flexible display screen is disposed in the accommodating space 16. In this way, part of the flexible display screen is hidden in the accommodating space 16, and part of the flexible display screen 30 hidden in the accommodating space 16 may not be lit. When the first housing 12 and the second housing 14 are relatively far apart, the driving member 50 can be used to drive the flexible display screen 30 to unfold, so that more flexible display screens 30 are exposed outside the accommodating space 16. The portion of the flexible display screen 30 exposed to the outside of the accommodating space 16 is lighted up, so that the display area presented by the electronic device 100 becomes larger.

The driving member 50 may specifically be a rotating shaft structure with teeth 52 on the outside. The flexible display screen 30 is linked with the driving member 50 by means of engagement or the like. When the first housing 12 and the second housing 14 are relatively far away, the driving member 50 is driven The part of the flexible display screen 30 engaged on the driving member 50 moves and unfolds.

It can be understood that the driving member 50 can also be a round shaft without teeth 52. When the first housing 12 and the second housing 14 are relatively far away, the driving member 50 is wound (wound) on the part of the driving member 50. The flexible display screen 30 is stretched so that more flexible display screens are exposed outside the accommodating space 16 and are in a flat state. Specifically, the driving member 50 is rotatably disposed on the second housing 14, and when the flexible display screen 30 is gradually expanded, the driving member 50 can rotate with the movement of the flexible display screen 30. In other embodiments, the driving member 50 may also be fixed on the second housing 14, and the driving member 50 has a smooth surface. When the flexible display screen 30 is expanded, the driving member 50 can slidably contact with the flexible display screen 30 through its smooth surface.

When the first housing 12 and the second housing 14 are relatively close, the flexible display screen can be retracted by the driving member 50. Alternatively, the electronic device 100 further includes a resetting member (not shown). One end of the flexible display screen housed in the accommodating space 16 is linked with the resetting member. When the first housing 12 and the second housing 14 are relatively close, the resetting member drives The flexible display screen 30 is reset, so that part of the flexible display screen is retracted into the accommodating space 16.

In this embodiment, the driving mechanism 70 can be arranged in the accommodating space 16, the driving mechanism 70 can be linked with the second housing 14, and the driving mechanism 70 is used to drive the second housing 14 to be relative to the first housing 12. The separation movement drives the flexible display screen assembly 30 to stretch. It can be understood that the driving mechanism 70 can also be omitted, and the user can directly move the first housing and the second housing relative to one another manually.

Please refer to FIG. 6, which is a schematic flowchart of the first display control method provided by an embodiment of the application. The specific process of the display control method provided by the embodiment of the present application may be as follows:

In 101, during the expansion and contraction of the flexible display screen, the expansion length is detected and the effective display size of the screen is determined according to the expansion length.

In the embodiments of this application, the operating system of the electronic device may be an Android operating system or an ios operating system, etc. This application does not impose specific restrictions on the operating system of the electronic device. Regardless of which operation, it has a corresponding window management service. It is displayed in the management window. In the following, in order to facilitate readers to understand the implementation of the solution of the present application, the Android operating system is taken as an example for description.

The Android system is divided into four layers, from top to bottom, they are the application layer, the application framework layer, the system runtime layer, and the kernel layer. Among them, the kernel layer provides low-level drivers for various hardware of electronic devices, such as display, audio, camera, Bluetooth, WI-FI, power management, and so on. The system runtime library layer includes the system library and runtime, and mainly provides feature support for the Android system through some c/c++ libraries. The application framework layer mainly provides various APIs (Application Programming Interface) that may be used when building applications. The activity management service (ActivityManagerService) and window management service (WindowManagerService) involved in the following are all provided by the application The framework layer is provided. All applications installed on electronic devices are in the application layer, including the applications that come with the mobile phone and the user's own Android applications, such as WeChat, games, etc.

For the Android system, Window is an abstract concept, which is used to draw user interfaces and respond to user input events. From the perspective of the application framework layer, the interface of the Android system is composed of one or more windows, and these windows are managed by the window management service.

It should be noted that the windows involved in the following include both application windows, such as WeChat dialogs, browser search interfaces, etc., as well as some system-level windows, such as recently run dialogs, shutdown dialogs, and status bar drop-downs. Bar, lock screen interface, etc.

In addition, in the Android system, Activity is an application component that provides an interface that users can interact with. An Activity corresponds to an application window, which can display some interface elements, such as controls, etc., and can listen to user processing events. An application can have multiple activities. The activity corresponding to the interface of the application program below can be understood as the Activity corresponding to the interface. For example, the activity corresponding to the dialogue interface of WeChat can be understood as the activity corresponding to the dialogue interface in the application of WeChat. The life cycle of Activity is managed by the activity management service (ActivityManagerService) in the Android system. In the life cycle of an Activity, it can have the following states: running: the activity currently displayed on the screen (located at the top of the task stack), visible to the user ; Poused: It is still visible to the user, but the interface focus has been lost. This Activity cannot interact with the user; Stopped: The user cannot see the current interface and cannot interact with the user. It is completely covered; Killed: The interface is destroyed.

Based on the above-mentioned Android architecture and the window management service provided by the Android system, the solution of the embodiment of the present application will be described next. In related technical solutions, when parameters such as the height or width of the display screen change, the physical size and resolution of the display screen change. The mainstream technology generally adapts to this change from the application itself, which requires software engineers. Spend a lot of time and effort on application layout adaptation. Each application in the terminal product needs to be adapted, and the workload is very large.

This application does not need to adapt and develop the application itself, but optimizes the display of the window from the system framework layer based on the window management service, so that the application can adapt the display interface as the flexible display screen expands and contracts. The layout of the application program can be adapted to the flexible display screen after expansion.

When the flexible display screen is stretched, the size of the screen will change, that is, the size of the display area of the display screen will change accordingly. Therefore, once it is detected that the flexible display screen starts to perform a telescopic operation, the telescopic operation is monitored in real time, the telescopic length is obtained, and the effective display size of the screen is determined according to the telescopic length. Taking the stretch operation performed by the flexible display screen as an example, if the flexible display screen performs the stretch operation, the screen becomes larger, and the window of the application currently displayed in the foreground and the display elements in the adaptive adjustment window need to be enlarged accordingly.

In order to realize that the display content of the screen can adapt to the screen in real time during the expansion and contraction process of the display screen, it is necessary to continuously lay out and draw the interface as the flexible screen is extended or retracted. Therefore, when it is detected that the telescopic length is an effective telescopic length, the determination of the effective display size of the screen according to the telescopic length in 101 is executed. Wherein, the effective stretch length is a threshold value at which human eyes can perceive the change in the length or width of the screen, and the threshold value may be an empirical value. When the telescopic length is less than the threshold, the human eye may not feel the change in the length or width of the screen. When the telescopic length is greater than or equal to the threshold, the human eye can feel the change in the length or width of the screen. During the expansion and contraction process, the display content of the screen can be adapted to change with the screen in real time, and the displayed window needs to be adjusted adaptively.

Or, in another embodiment, after detecting the telescopic length and determining the effective display size of the screen according to the telescopic length, the method further includes: determining whether the difference between the effective display size and the historical display size is within a preset range; if not, execute 102 .

In this embodiment, every time the window layout is adjusted, the current effective display size is recorded as the historical display size. When the layout is adjusted next time, according to whether the difference between the effective display size and the historical display size is greater than the preset range, if it is, it is considered that the human eye can perceive the change in the length or width of the screen, in order to achieve the expansion and contraction of the display screen. In the process, the display content of the screen can be adapted to change with the screen in real time, and the displayed window needs to be adjusted adaptively.

For example, when the user controls the screen to stretch from 1080 pixels to 1280 pixels along the length direction, every time 4 pixels are detected to stretch, the layout and drawing are performed once, so that during the entire stretch operation , The window layout of the foreground application also changes dynamically, corresponding to the user, you can intuitively see that the length of the screen is getting longer as the display screen stretches.

Among them, the effective display size is the length of the display screen in the telescopic direction. For example, if the expansion and contraction direction of the flexible display screen is horizontal expansion and contraction as shown in FIG. 2, the effective display size is the width of the screen, and if the flexible display screen is expansion and contraction in the vertical direction, the effective display size is the length of the screen. In addition, the stretch length can be a positive value or a negative value. When the flexible display screen is retracted inward, the expansion length is a negative value, and when the flexible display screen is extended outward, the expansion length is a positive value.

Among them, the detection of the expansion length and the calculation of the effective display size can be implemented in multiple ways. For example, in one embodiment, the electronic device is provided with a position sensor, which detects the expansion and contraction direction and length of the flexible display screen according to the position sensor; obtains the recorded historical display size, and calculates it according to the expansion length, the expansion direction, and the historical display size. The effective display size after expansion and contraction; the historical display size of the record is updated according to the effective display size.

For example, the position sensor is an angular velocity sensor, and the flexible display screen reel is connected with the angular velocity sensor, and the flexible display screen is scrolled and stretched by external force. The angular velocity sensor detects the rotation angle and rotation direction of the reel; calculates the telescopic length of the flexible display screen according to the rotation angle, and determines the telescopic direction of the flexible display screen according to the rotation direction.

In this embodiment, every time the window layout is adjusted, the current effective display size is recorded as the historical display size. When the layout is adjusted next time, the effective display size is calculated according to the historical display size, expansion length, and expansion direction. Among them, during the scrolling process of the flexible display screen, the angular velocity sensor will record the number of turns of the flexible display screen and the degree of rotation, according to the known diameter of the flexible display screen reel. Based on the formula S=N*π*D/360, the expansion and contraction length can be calculated. N is the angle of rotation of the flexible display. If the degree of rotation is 390°, it means that the reel has rotated 30° after one revolution. D is the diameter of the reel, and S is the telescopic length. The angular velocity sensor can identify the direction of rotation of the reel, for example, whether it is rotating clockwise or counterclockwise, so that the direction of expansion and contraction of the flexible display screen can be known. After determining the expansion and contraction length, the effective display size after expansion and contraction is calculated according to the historical display size and the expansion length before the expansion and contraction of the flexible display screen. Among them, the unit of telescopic length can be expressed in inches or pixels.

Or, in another embodiment, the electronic device is provided with a light-sensitive detector, and marks are arranged on the scrollable part of the flexible display screen, and the light-sensitive detector determines the telescopic length of the flexible display screen by identifying these marks.

In 102, the application program running in the foreground is determined, and the window size parameter of the application program in the window management service is adjusted according to the effective display size.

For a running application, the window state data (windowstate) of the application is available in the window management service. The window state data represents all the properties of a window, including window size parameters, such as the length and width of the window. Wait.

For example, in one embodiment, determining the application program running in the foreground and adjusting the window size parameters of the application program in the window management service according to the effective display size includes: determining the application program running in the foreground; determining the corresponding application program according to the window management service Window status data; the variables related to the screen display size in the window status data are modified to be consistent with the effective display size.

In the embodiments of the present application, the window adopts a relative layout (RelativeLayout) rule, that is, a fixed length is not used to represent the height or length of the layout, but attributes such as match_parent and wrap_content are used to represent the height or length of a specific display element. match_parent represents the same size as its parent node, and wrap_content represents the same length as its own content. For example, if the height of the root node of an application's layout file is defined as match_parent, the height of the root view of the application is the height of the system's screen.

The system framework layer adjusts the window size parameters of the application in the window management service according to the effective display size, and does not need to be adjusted by the application itself. For example, before the flexible display screen performs the telescopic operation, the window size parameter parent=[0,0],[720,1320] of the application in the window management service. Among them, 70 is the width of the screen, and 1320 is the length of the screen. If the flexible display is extended by 10 pixels in the length direction. Modify the variables related to the screen display size in the window state data to be consistent with the effective display size, for example, modify the parent parameter to parent=[0,0],[720,1330].

In 103, according to the adjusted window size parameter, the windows of the application program are re-layout.

In 104, the display interface of the application program is redrawn and displayed on the screen according to the re-layout of the window.

Wherein, in one embodiment, the re-layout of the windows of the application program according to the adjusted window size parameters includes: adjusting the display size of the root view of the application program according to the adjusted window size parameters; The display size of the view and the layout attributes of the display elements in the window re-layout the display elements in the application window.

After adjusting the window size parameters of the application in the management service, the system framework layer sends a notification message to the activity of the application running in the foreground. After the activity of the application receives the notification information, the activity management service re-lays out and draws the window. Because window management services and activity management services work at the system framework layer, this solution can optimize the display of windows from the system framework layer, without requiring software engineers to spend a lot of time and energy on application layout adaptation. superior.

Please refer to Figure 7, which is a schematic diagram of a window of a certain application. The window is laid out in a tree structure. The window includes a root view. The root view corresponds to the root container. The layout attribute of the root container can be match_parent, that is, when the root container determines the display size, it will determine the size of the root view according to the parent parameter in the windowstate data of the window management service, for example , Parent=[0,0],[720,1330], the root view size is 720×1330.

Among them, the function bar 1, function bar 2, content data, buttons 1, and button 2 in the interface shown in Figure 7 are brother components, and the root container is the parent container of these components, and each component has a corresponding display element. Such as pictures, buttons, text, etc. These components also use relative layout rules, that is, the position and attributes of each component are not written as fixed values, but the position is set according to the relative layout rules. For example, set the layout attribute of function bar 1 to align with the top of the parent container; set the layout attribute of function bar 2 to align with the bottom of the parent container. For another example, the size of button 1 is set to 150dp×60dp, and its position is set to be 200dp from the bottom of the parent container and 180dp from the left edge of the parent container. If the size of the parent container changes, the position of the button 1 on the interface will also change adaptively based on the above-mentioned relative position constraint. For another example, button 2 is laid out according to the position of its sibling component button 1, the size of button 2 is set to 50dp×30dp, its position is set to be 180dp from the right edge of button 1 and 200dp from the bottom of the parent container. Then when the layout of button 1 and the parent container changes, the layout of button 2 will also change as the layout of button 1 and the parent container changes.

Among them, dp (density independent pixels, device-independent pixels) is the length unit for development, and 1dp represents the length of 1px (pixel, pixel) when the screen pixel density is 160ppi. Specifically, when the screen has 160 pixels per inch, 1dp and 1px are equivalent. Therefore, dp can be used to determine the number of pixels corresponding to a component in screens of different sizes (different screen dpi). For example, if the length of any component is 1dp, then on a screen with a dpi of 160, the length of the component is 1px; if on a screen with a 240dpi, the length of the component is 1×240/160=1.5 pixels point. In other words, the length of dp is not a fixed value, but will change as the screen resolution changes.

Please refer to FIG. 8. FIG. 8 is a schematic diagram of the window layout in the display control method provided by an embodiment of the application. The flexible display screen in the figure can be expanded and contracted in the vertical direction, a floating window is displayed on the window, and the layout attribute of the floating window is centered display, that is, displayed in the middle of the window. When the flexible display screen stretches and the length becomes longer, the position of the floating window on the entire screen will also be adjusted accordingly, and it will always stay in the middle of the window.

In addition, it should be noted that although the other window under the floating window has been out of focus and is in the Poused state, the window is still visible to the user in the foreground, so the size of the window will also be adjusted corresponding to the length of the screen. .

Please refer to FIG. 9, which is another schematic diagram of the window layout in the display control method provided by an embodiment of the application. The flexible display screen in the figure can be expanded and contracted in the vertical direction, an image is displayed in the window, and the layout of the components corresponding to the image is set to fill the components according to the displayed content. Therefore, before the flexible display is stretched, since the aspect ratio of the image itself is much larger than the aspect ratio of the screen, the image does not cover the screen in the width direction, and as the flexible display stretches, the length and width of the screen The ratio increases, in order to fill the entire screen, the image will also be enlarged proportionally, gradually filling the screen in the width direction.

In some embodiments, after re-layouting each display element in the window of the application program, it further includes: when the content display area in the re-layout display element changes, obtaining the display content corresponding to the content display area, and adding The display content is loaded in the corresponding display element.

Please refer to FIG. 10, which is another schematic diagram of the window layout in the display control method provided by the embodiment of the application. This window is the browser search interface. Among them, the function bar 1 is the search bar, the function bar 2 is the function space bar of the browser, the content data is the search result page, and the search result page can be displayed on the page in the form of waterfall or information list. show. The layout attribute of function bar 1 is aligned with the top of the parent container, and the layout attribute of function bar 2 is aligned with the bottom of the parent container. Therefore, with the expansion of the flexible display screen, the position of the function bar 1 does not change, and the position of the function bar 2 moves down accordingly, and is always aligned with the bottom of the root view.

Among them, due to the stretching of the screen, the content display area where the content data displayed in the form of waterfall or information list is located, the displayable length in the length direction of the screen becomes longer, and the content that can be displayed in it also becomes larger. In this area, more content that is not displayed on the current page is displayed. In other words, as the screen stretches, the content data will be pulled out like a drawer to display more content on the interface.

The solution shown in FIG. 10 can be applied to a scene in which a variety of windows contain function bars and content data, and the content data is displayed in the form of a waterfall or an information list.

Please refer to FIG. 11. FIG. 11 is another schematic diagram of the window layout in the display control method provided by an embodiment of the application. The flexible display shown in the figure can be extended and retracted in the horizontal direction. Similar to the principle of the window shown in FIG. 8, as the flexible display screen expands horizontally and the width becomes wider, the position of the floating window on the entire screen will also be adjusted accordingly, and it will always be in the middle of the window.

Please refer to FIG. 12, which is another schematic diagram of the window layout in the display control method provided by the embodiment of the application. The flexible display shown in the figure can be extended and retracted in the horizontal direction. The principle is similar to the window shown in FIG. 10. The difference is that the layout attribute of the function bar 1 is aligned with the top, left and right borders of the parent container, and the size of the function bar 1 has a fixed dp value in the vertical direction. The layout attribute of the function bar 2 is aligned with the bottom, left and right borders of the parent container, and the size of the function bar 2 has a fixed dp value in the vertical direction. As the flexible display screen expands horizontally, when the width of the screen becomes wider, the widths of the function bar 1 and the function bar 2 will be adaptively adjusted to be consistent with the width of the screen. However, the displayable width of the content display area where the content data displayed in the form of waterfall or information list is located in the screen width direction becomes wider, and the display mode of each piece of information or data in the area on the screen is adjusted accordingly. As shown in Figure 12, if the content data is text data, more text can be displayed in each line.

It should be noted that the layout attributes and illustrations listed in the foregoing embodiments are only examples. In other embodiments, as long as the relative layout rules are complied with, the layout scheme can be included in the scope of the embodiments of the present application. In addition, the above-mentioned embodiment is illustrated by taking the screen stretch as an example. When the flexible display screen is retracted and the screen becomes smaller, it is based on the same principle, except that the value of the relevant parameter is reduced, which will not be repeated here.

After re-arranging the windows of the application program based on the above-mentioned method according to the adjusted window size parameters, the display interface of the application program is redrawn and displayed on the screen according to the re-layout window to adapt to the scaled screen. If the scaling operation still continues, return to execution 101 to 104, and so on to achieve dynamic adjustment of the window layout until the scaling operation is terminated.

In addition, in order to quickly realize the dynamic adjustment of the display interface layout in this application, only the window layout of the foreground application is adjusted. For the applications in the background, when they are switched to the foreground, the activity management service will detect Their status has changed, and they will be re-layed out and drawn.

During specific implementation, the present application is not limited by the execution order of the described processes, and certain processes may also be performed in other order or at the same time if there is no conflict.

It can be seen from the above that the display control method provided by the embodiments of the present application is applied to an electronic device that includes a retractable flexible display screen. During the process of the flexible display screen being stretched, the electronic device detects the stretched length and detects The expansion length determines the effective display size of the screen after expansion, that is, the new size of the display area after the display expansion, based on the window management service, according to the effective display size to adjust the window size parameters of the foreground application, based on the adjusted Window size parameter, re-layout the application window, and redraw and display the display interface of the application program on the screen. Through this solution, with the expansion and contraction of the flexible display screen, the window size parameters are continuously adjusted to make The application program running in the foreground can adaptively and dynamically adjust the layout of the display interface to adapt to the expanded display area.

In one embodiment, a display control device is also provided. Please refer to FIG. 13, which is a schematic structural diagram of a display control device 300 according to an embodiment of the application. The display control device 300 is applied to electronic equipment. The display control device 300 includes a telescopic detection module 301, a parameter adjustment module 302, a window layout module 303, and an interface drawing module 304, as follows:

The telescopic detection module 301 is configured to detect the telescopic length during the telescopic process of the flexible display screen and determine the effective display size of the screen according to the telescopic length;

The parameter adjustment module 302 is configured to determine the application program running in the foreground, and adjust the window size parameter of the application program in the window management service according to the effective display size;

The window layout module 303 is configured to rearrange the windows of the application program according to the adjusted window size parameters;

The interface drawing module 304 is configured to redraw and display the display interface of the application program on the screen according to the re-layout window.

In some embodiments, the parameter adjustment module 302 is further used to: determine the application program running in the foreground; determine the window state data corresponding to the application program according to the window management service; Modified to be consistent with the effective display size.

In some embodiments, the window layout module 303 is further configured to: adjust the display size of the root view of the application according to the adjusted window size parameter; according to the adjusted display size of the root view, and the window The layout attribute of each display element in the application program re-layouts each display element in the window of the application program.

In some embodiments, the interface drawing module 304 is further configured to: when the content display area in the re-layout display element changes, obtain the display content corresponding to the content display area, and load the display content in the corresponding display element. In the display element.

In some embodiments, the electronic device includes a position detection sensor; the expansion detection module 301 is further used to: detect the expansion direction and expansion length of the flexible display screen according to the position sensor; The expansion and contraction length, the expansion and contraction direction, and the historical display size are calculated to obtain an effective display size after expansion and contraction; and the recorded historical display size is updated according to the effective display size.

In some embodiments, the flexible display screen includes a reel, and the position detection sensor is an angular velocity sensor connected to the reel; the telescopic detection module 301 is further configured to: detect the rotation angle of the reel according to the angular velocity sensor and Rotation direction; calculate the expansion and contraction length of the flexible display screen according to the rotation angle, and determine the expansion and contraction direction of the flexible display screen according to the rotation direction.

In some embodiments, the parameter adjustment module 302 is further used to determine whether the difference between the effective display size and the historical display size is within a preset range; The effective display size adjusts the window size parameter of the application program in the window management service.

It should be noted that the display control device provided in this embodiment of the application belongs to the same concept as the display control method in the above embodiment, and any method provided in the display control method embodiment can be implemented by the display control device, and its specific implementation For details of the process, refer to the embodiment of the display control method, which will not be repeated here.

It can be seen from the above that the display control device proposed in the embodiment of the present application includes a telescopic detection module 301, a parameter adjustment module 302, a window layout module 303, and an interface drawing module 304. During the expansion and contraction of the flexible display screen, the expansion detection module 301 detects the expansion length, and determines the effective display size of the screen after expansion and contraction according to the detected expansion and contraction length, that is, the new size of the display area after the display screen has been expanded and contracted. The parameter adjustment module 302 is based on the window management service, according to the effective display size. Adjust the window size parameters of the foreground application. The window layout module 303 re-lays out the windows of the application based on the adjusted window size parameters. The interface drawing module 304 redraws and displays the display interface of the application on the screen. In this solution, with the expansion and contraction of the flexible display screen, the window size parameters are continuously adjusted, so that the application program running in the foreground can adaptively and dynamically adjust the layout of the display interface to adapt to the expanded display area.

The embodiment of the present application also provides an electronic device. The electronic device may be a smart phone, a tablet computer, or other devices. Please refer to FIG. 14, which is a schematic diagram of the first structure of an electronic device provided by an embodiment of this application. The electronic device 400 includes a processor 401 and a memory 402. Wherein, the processor 401 and the memory 402 are electrically connected.

The processor 401 is the control center of the electronic device 400. It uses various interfaces and lines to connect various parts of the entire electronic device. Various functions and processing data of the equipment, so as to monitor the electronic equipment as a whole.

The memory 402 can be used to store computer programs and data. The computer program stored in the memory 402 contains instructions that can be executed in the processor. Computer programs can be composed of various functional modules. The processor 401 executes various functional applications and data processing by calling a computer program stored in the memory 402.

In this embodiment, the processor 401 in the electronic device 400 loads the instructions corresponding to the process of one or more computer programs into the memory 402 according to the following process, and the processor 401 runs the instructions and stores them in the memory 402. In order to realize various functions:

In some embodiments, please refer to FIG. 15, which is a schematic diagram of a second structure of an electronic device provided by an embodiment of this application. The electronic device 400 further includes: a radio frequency circuit 403, a display screen 404, a control circuit 405, an input unit 406, an audio circuit 407, a sensor 408, and a power supply 409. The processor 401 is electrically connected to the radio frequency circuit 403, the display screen 404, the control circuit 405, the input unit 406, the audio circuit 407, the sensor 408, and the power supply 409, respectively.

The radio frequency circuit 403 is used to transmit and receive radio frequency signals to communicate with network equipment or other electronic equipment through wireless communication.

The flexible display screen 404 can be used to display information input by the user or information provided to the user and various graphical user interfaces of the electronic device. These graphical user interfaces can be composed of images, text, icons, videos, and any combination thereof.

The control circuit 405 is electrically connected to the display screen 404 for controlling the display screen 404 to display information.

The input unit 406 can be used to receive inputted numbers, character information, or user characteristic information (such as fingerprints), and generate keyboard, mouse, joystick, optical or trackball signal input related to user settings and function control. Wherein, the input unit 406 may include a fingerprint recognition module.

The audio circuit 407 can provide an audio interface between the user and the electronic device through a speaker and a microphone. Among them, the audio circuit 407 includes a microphone. The microphone is electrically connected to the processor 401. The microphone is used to receive voice information input by the user.

The sensor 408 is used to collect external environmental information. The sensor 408 may include one or more of sensors such as an environmental brightness sensor, an acceleration sensor, and a gyroscope.

The power supply 409 is used to supply power to various components of the electronic device 400. In some embodiments, the power supply 409 may be logically connected to the processor 401 through a power management system, so that functions such as charging, discharging, and power consumption management can be managed through the power management system.

Although not shown in the figure, the electronic device 400 may also include a camera, a Bluetooth module, etc., which will not be repeated here.

It can be seen from the above that an embodiment of the present application provides an electronic device that detects the telescopic length during the expansion and contraction of the flexible display screen, and determines the effective display of the screen after the expansion and contraction according to the detected expansion and contraction length. Size, that is, the new size of the display area after the display screen is stretched. Based on the window management service, the window size parameters of the foreground application are adjusted according to the effective display size. Based on the adjusted window size parameters, the application window is renewed. Layout, and redraw and display the display interface of the application on the screen. Through this solution, with the expansion and contraction of the flexible display screen, the window size parameters are constantly adjusted, so that the application running in the foreground can adapt, Dynamically adjust the layout of the display interface to adapt to the expanded display area.

An embodiment of the present application also provides a storage medium in which a computer program is stored, and when the computer program is run on a computer, the computer executes the display control method described in any of the foregoing embodiments.

It should be noted that those of ordinary skill in the art can understand that all or part of the processes in the various methods of the foregoing embodiments can be completed by instructing relevant hardware through a computer program, which can be stored in a computer-readable storage medium. Here, the storage medium may include, but is not limited to: read only memory (ROM, Read Only Memory), random access memory (RAM, Random Access Memory), magnetic disk or optical disk, etc.

In addition, the terms "first", "second" and "third" in this application are used to distinguish different objects, rather than to describe a specific order. In addition, the terms "including" and "having" and any variations of them are intended to cover non-exclusive inclusions. For example, a process, method, system, product, or device that includes a series of processes or modules is not limited to the listed processes or modules, but some embodiments also include unlisted processes or modules, or some embodiments It also includes other processes or modules inherent to these processes, methods, products, or equipment.

The above describes in detail the display control method, device, storage medium, and electronic equipment provided by the embodiments of the present application. Specific examples are used in this article to illustrate the principles and implementation of the application. The descriptions of the above examples are only used to help understand the methods and core ideas of the application; at the same time, for those skilled in the art, according to the principles of the application There will be changes in the thinking, specific implementation and application scope. In summary, the content of this specification should not be construed as a limitation to this application.

Claims

A display control method, wherein the method is applied to an electronic device including a retractable flexible display screen, and the method includes:

During the expansion and contraction of the flexible display screen, detecting the expansion length and determining the effective display size of the screen according to the expansion length;

Determine the application program running in the foreground, and adjust the window size parameters of the application program in the window management service according to the effective display size;

Re-layout the windows of the application program according to the adjusted window size parameters;

According to the re-layout window, the display interface of the application program is redrawn and displayed on the screen.
The display control method according to claim 1, wherein the determining the application program running in the foreground and adjusting the window size parameter of the application program in the window management service according to the effective display size comprises:

Determine the applications running in the foreground;

Determining the window state data corresponding to the application program according to the window management service;

Modify the variables related to the screen display size in the window state data to be consistent with the effective display size.
3. The display control method according to claim 2, wherein the re-layout of the windows of the application program according to the adjusted window size parameters comprises:

Adjust the display size of the root view of the application according to the adjusted window size parameter;

According to the adjusted display size of the root view and the layout attributes of the display elements in the window, the display elements in the window of the application are re-layout.
5. The display control method according to claim 3, wherein, after the re-layout of the display elements in the window of the application program, the method further comprises:

When the content display area of the re-layout display element changes, the display content corresponding to the content display area is acquired, and the display content is loaded in the corresponding display element.
The display control method according to any one of claims 1 to 4, wherein the electronic device includes a position detection sensor; the detecting the telescopic length and determining the effective display size of the screen according to the telescopic length includes:

Detecting the telescopic direction and the telescopic length of the flexible display screen according to the position sensor;

Acquiring the recorded historical display size, and calculating the effective display size after expansion and contraction according to the telescopic length, the telescopic direction, and the historical display size;

Update the recorded historical display size according to the effective display size.
The display control method according to claim 5, wherein the flexible display screen comprises a reel, and the position detection sensor is an angular velocity sensor connected to the reel; and the position sensor detects the position of the flexible display Extension direction and extension length, including:

Detecting the rotation angle and the rotation direction of the reel according to the angular velocity sensor;

The expansion and contraction length of the flexible display screen is calculated according to the rotation angle, and the expansion and contraction direction of the flexible display screen is determined according to the rotation direction.
5. The display control method according to claim 5, wherein after detecting the telescopic length and determining the effective display size of the screen according to the telescopic length, the method further comprises:

Determine whether the difference between the effective display size and the historical display size is within a preset range;

If not, execute to determine the application program running in the foreground, and adjust the window size parameter of the application program in the window management service according to the effective display size.
A display control device, wherein the device is applied to an electronic device including a retractable flexible display screen, and the device includes:

The telescopic detection module is configured to detect the telescopic length during the telescopic process of the flexible display screen and determine the effective display size of the screen according to the telescopic length;

The parameter adjustment module is used to determine the application program running in the foreground, and adjust the window size parameter of the application program in the window management service according to the effective display size;

A window layout module, configured to rearrange the windows of the application program according to the adjusted window size parameters;

The interface drawing module is used to redraw and display the display interface of the application program on the screen according to the re-layout window.
8. The display control device according to claim 8, wherein the parameter adjustment module is also used to determine the application program running in the foreground;

Determine the window state data corresponding to the application program according to the window management service; and

Modify the variables related to the screen display size in the window state data to be consistent with the effective display size.
9. The display control device according to claim 9, wherein the window layout module is further configured to adjust the display size of the root view of the application according to the adjusted window size parameter; and

According to the adjusted display size of the root view and the layout attributes of the display elements in the window, the display elements in the window of the application are re-layout.
The display control device according to claim 10, wherein the interface drawing module is further configured to obtain the display content corresponding to the content display area when the content display area in the display element after the rearrangement changes, and Load the display content in the corresponding display element.
The display control device according to claims 8 to 11, wherein the electronic device includes a position detection sensor; the expansion detection module is further configured to detect the expansion direction and expansion length of the flexible display screen according to the position sensor ；

Obtain the recorded historical display size, and calculate the effective display size after expansion and contraction according to the telescopic length, the telescopic direction, and the historical display size; and

Update the recorded historical display size according to the effective display size.
The display control device according to claim 12, wherein the flexible display screen comprises a reel, and the position detection sensor is an angular velocity sensor connected to the reel; and the telescopic detection module is further used to: according to the angular velocity sensor Detecting the rotation angle and rotation direction of the reel; and

The expansion and contraction length of the flexible display screen is calculated according to the rotation angle, and the expansion and contraction direction of the flexible display screen is determined according to the rotation direction.
11. The display control device of claim 12, wherein the parameter adjustment module is further configured to: determine whether the difference between the effective display size and the historical display size is within a preset range;

If not, execute to determine the application program running in the foreground, and adjust the window size parameter of the application program in the window management service according to the effective display size.
A storage medium on which a computer program is stored, wherein when the computer program runs on a computer, the computer is caused to execute:

During the expansion and contraction of the flexible display screen, detecting the expansion length and determining the effective display size of the screen according to the expansion length;

Determine the application program running in the foreground, and adjust the window size parameters of the application program in the window management service according to the effective display size;

Re-layout the windows of the application program according to the adjusted window size parameters;

According to the re-layout window, the display interface of the application program is redrawn and displayed on the screen.
An electronic device includes a processor and a memory, the memory stores a computer program, wherein the processor is configured to execute:

During the expansion and contraction of the flexible display screen, detecting the expansion length and determining the effective display size of the screen according to the expansion length;

Determine the application program running in the foreground, and adjust the window size parameters of the application program in the window management service according to the effective display size;

Re-layout the windows of the application program according to the adjusted window size parameters;

According to the re-layout window, the display interface of the application program is redrawn and displayed on the screen.
The electronic device according to claim 16, wherein the processor is further configured to execute:

Determine the applications running in the foreground;

Determining the window state data corresponding to the application program according to the window management service;

Modify the variables related to the screen display size in the window state data to be consistent with the effective display size.
The electronic device according to claim 16, wherein the processor is further configured to execute:

Adjust the display size of the root view of the application according to the adjusted window size parameter;

According to the adjusted display size of the root view and the layout attributes of the display elements in the window, the display elements in the window of the application are re-layout.
The electronic device according to claim 16, wherein the processor is further configured to execute:

When the content display area of the re-layout display element changes, the display content corresponding to the content display area is acquired, and the display content is loaded in the corresponding display element.
The electronic device according to claim 16, wherein the processor is further configured to execute:

Detecting the telescopic direction and the telescopic length of the flexible display screen according to the position sensor;

Acquiring the recorded historical display size, and calculating the effective display size after expansion and contraction according to the telescopic length, the telescopic direction, and the historical display size;

Update the recorded historical display size according to the effective display size.