CN110661917A - Display method and electronic equipment - Google Patents

Abstract

Embodiments of the present application provide a display method and an electronic device, the method is applied to the electronic device, and the method is used to solve the problem that the window of a split-screen interface in an existing application cannot be adjusted. The method includes: the electronic device receives a user's screen operation, in response to the split screen operation, the first display area of the display screen of the electronic device is controlled to display the first interface, and the second display area of the display screen is controlled to display the second interface; wherein the second display area and the first display area are Do not overlap or partially overlap; both the first interface and the second interface are different interfaces of the first application, and then receive a second operation from the user, and the second operation is used to trigger adjustment of at least one of the first display area and the second display area The size of the display area; in response to the second operation, the first display area is controlled to be adjusted to the third display area, and the second display area is controlled to be adjusted to the fourth display area; the third display area displays the first interface, and the fourth display area displays the Second interface.

Description

A display method and electronic device

technical field

The present application relates to the field of terminal technologies, and in particular, to a display method and an electronic device.

Background technique

With the continuous development of electronic devices, more and more electronic devices with display screens are widely used in people's daily life and work, such as mobile phones with display screens. And it is not difficult to find that, with the development of screen technology, the display screen of an electronic device is also becoming larger and larger, so as to provide users with richer information and better user experience.

At present, some widescreen smart devices support multi-window mode. The so-called multi-window mode means that different interfaces in the application can be displayed in different windows of the same display screen, but the windows of different interfaces in the multi-window mode do not support window size adjustment. , which affects the user experience.

SUMMARY OF THE INVENTION

The present application provides a display method and an electronic device, which are used to solve the problem that the window of the existing split-screen interface in an application cannot be adjusted.

In a first aspect, an embodiment of the present application provides a display method, which is applicable to an electronic device. The method includes: the electronic device receives a user's split-screen operation, and in response to the split-screen operation, controlling a first display of the display screen of the electronic device. A display area displays the first interface, and controls the second display area of the display screen to display the second interface; wherein, the second display area does not overlap or partially overlaps with the first display area; the first interface and the second interface are both the first interface The different interfaces of the application then receive a second operation from the user, where the second operation is used to trigger the adjustment of the size of at least one display area in the first display area and the second display area; in response to the second operation, the first display area is controlled to be adjusted to The third display area, and controlling the second display area to be adjusted into the fourth display area; wherein, the third display area displays the first interface, and the fourth display area displays the second interface.

In the embodiment of the present application, the above method can realize the adjustment of the windows of different interfaces in the application, which can improve the user experience.

In a possible design, the right border of the first interface and the left border of the second interface may be provided with a window adjustment control; the second operation is a drag operation acting on the window adjustment control, and the drag operation includes the drag direction, Operation start point coordinates and operation end point coordinates. Before the electronic device controls the first display area to be adjusted to the third display area, and controls the second display area to be adjusted to the fourth display area, the method further includes: adjusting the first display area according to the drag direction, the coordinates of the start point of the operation and the coordinates of the end point of the operation The ratio between the width of the second display area and the width of the second display area; according to the ratio, the third display area and the fourth display area are determined.

In the embodiment of the present application, the above method can enrich the display forms of the display screen, improve the utilization rate of the display screen, and improve the visual experience of the user.

In a possible design, when the ratio between the width of the first display area and the width of the second display area is smaller than a first threshold, the second interface may be controlled to display in full screen; or, when the first display When the ratio between the width of the area and the width of the second display area is greater than a second threshold, the first interface can be controlled to display in full screen; wherein the first threshold is much smaller than the second threshold.

In the embodiment of the present application, the above method can switch the display screen from the multi-window mode to the single-window mode, and the display mode is more flexible and changeable.

In a possible design, the second interface may be an interface at an upper level of the first interface; or, the second interface may also be an interface at a lower level of the first interface.

In a possible design, the first display area and the second display area may be pre-configured in the electronic device; alternatively, the first display area and the second display area may also be configured by a user Set in the electronic device as required. Alternatively, when the display screen of the electronic device is a foldable screen, the first display area may be a display area corresponding to the first screen, and the second display area may be a display area corresponding to the second screen, wherein all the The folding screen may be folded to form at least two screens, the at least two screens including the first screen and the second screen. In addition, the above-mentioned window adjustment controls may be arranged at the folding area of the folding screen.

In the embodiment of the present application, the display content of the folding screen can be enriched, the utilization rate of the folding screen can be improved, and the user's visual experience can be improved.

In a second aspect, the embodiments of the present application provide an electronic device, including a sensor, a touch screen, a processor, and a memory, wherein the memory is used to store one or more computer programs; when the one or more computer programs stored in the memory are processed by the processor When executed, the method for enabling the electronic device to implement any one of the possible designs in any of the foregoing aspects.

In a third aspect, an embodiment of the present application further provides an apparatus, where the apparatus includes a module/unit for performing any one of the possible design methods in any of the foregoing aspects. These modules/units can be implemented by hardware or by executing corresponding software by hardware.

In a fourth aspect, the embodiments of the present application further provide a computer-readable storage medium, where the computer-readable storage medium includes a computer program, and when the computer program runs on an electronic device, the electronic device is made to perform any of the above aspects any of the possible design methods.

In a fifth aspect, the embodiments of the present application further provide a method including a computer program product that enables the electronic device to execute any one of the possible designs in any of the foregoing aspects when the computer program product runs on a terminal.

These and other aspects of the present application will be more clearly understood in the description of the following embodiments.

Description of drawings

1 is a schematic structural diagram of a mobile phone according to an embodiment of the present application;

2 is a schematic structural diagram of an Android operating system provided by an embodiment of the present application;

3 is a schematic diagram of a split screen mode provided by an embodiment of the present application;

4A is a schematic diagram of another split-screen mode provided by an embodiment of the present application;

4B is a schematic diagram of another split-screen mode provided by an embodiment of the present application;

5 is an interactive schematic diagram of another software implementation method of a split-screen mode provided by an embodiment of the present application;

FIG. 6 is a schematic diagram of a split-screen operation provided by an embodiment of the present application;

7A to 7E are schematic interface diagrams of a split-screen display method according to an embodiment of the present application;

8A to 8D are schematic diagrams of another split-screen display interface provided by an embodiment of the present application;

9 is a schematic diagram of an example of a setting interface of a display area provided by an embodiment of the present application;

10 is a schematic diagram of an example of a setting interface of a display area provided by an embodiment of the present application;

11 is a schematic diagram of an example of a setting interface of a display area provided by an embodiment of the present application;

FIG. 12 is a schematic structural diagram of another electronic device provided by an embodiment of the present application.

Detailed ways

或者其它操作系统的便携式设备。上述便携式设备也可以是其它便携式设备，只要具备触摸屏和算法运算能力(能够运行本申请实施例提供的显示方法)即可。还应当理解的是，在本申请其他一些实施例中，上述电子设备也可以不是便携式设备，而是具备触摸屏和算法运算能力(能够运行本申请实施例提供的显示方法)的台式计算机。The embodiments of the present application can be applied to any electronic device with a touch screen, and the electronic device can be a portable device, such as a mobile phone, a tablet computer, a wearable device (such as a smart watch) with a wireless communication function, and the like. The portable terminal has a touch screen and an algorithm computing capability (which can run the display method provided by the embodiment of the present application). Exemplary embodiments of portable devices include, but are not limited to, carry-on

Or portable devices with other operating systems. The above-mentioned portable device may also be other portable devices, as long as it has a touch screen and an algorithm computing capability (which can run the display method provided by the embodiment of the present application). It should also be understood that, in some other embodiments of the present application, the above electronic device may not be a portable device, but a desktop computer with a touch screen and algorithm computing capability (capable of running the display method provided by the embodiment of the present application).

Taking the electronic device as a mobile phone as an example, FIG. 1 shows a schematic structural diagram of a mobile phone 100 .

The mobile phone 100 may include a processor 110, an external memory interface 120, an internal memory 121, a USB interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 151, a wireless communication module 152, Audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, sensor module 180, buttons 190, motor 191, indicator 192, camera 193, display screen 194, SIM card interface 195 and so on. The sensor module 180 may include a gyroscope sensor 180A, an acceleration sensor 180B, a proximity light sensor 180G, a fingerprint sensor 180H, a touch sensor 180K, and a rotating shaft sensor 180M (of course, the mobile phone 100 may also include other sensors, such as temperature sensors, pressure sensors, distance sensors, etc. sensor, magnetic sensor, ambient light sensor, air pressure sensor, bone conduction sensor, etc., not shown in the figure).

It can be understood that the structures illustrated in the embodiments of the present invention do not constitute a specific limitation on the mobile phone 100 . In other embodiments of the present application, the mobile phone 100 may include more or less components than shown, or some components may be combined, or some components may be separated, or different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor ( image signal processor, ISP), controller, memory, video codec, digital signal processor (DSP), baseband processor, and/or neural-network processing unit (NPU), etc. . Wherein, different processing units may be independent devices, or may be integrated in one or more processors. The controller may be the nerve center and command center of the mobile phone 100 . The controller can generate an operation control signal according to the instruction operation code and timing signal, and complete the control of fetching and executing instructions.

A memory may also be provided in the processor 110 for storing instructions and data. In some embodiments, the memory in processor 110 is cache memory. This memory may hold instructions or data that have just been used or recycled by the processor 110 . If the processor 110 needs to use the instruction or data again, it can be called directly from the memory. Repeated accesses are avoided and the latency of the processor 110 is reduced, thereby increasing the efficiency of the system.

The processor 110 may execute the display method provided by the embodiment of the present application, so that the user can adjust the size of the windows of different interfaces of the same application displayed on the display screen, so as to improve the user experience. When the processor 110 can integrate different devices, such as integrating a CPU and a GPU, the CPU and the GPU can cooperate to execute the touch screen display method provided by the embodiments of the present application. For example, in the touch screen display method, some algorithms are executed by the CPU, and another part of the algorithms are executed by GPU execution for faster processing efficiency.

Display screen 194 is used to display images, videos, and the like. Display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (active-matrix organic light-emitting diode). , AMOLED), flexible light-emitting diode (flex light-emitting diode, FLED), Miniled, MicroLed, Micro-oLed, quantum dot light-emitting diodes (quantum dot light emitting diodes, QLED) and so on. In some embodiments, cell phone 100 may include 1 or N display screens 194 , where N is a positive integer greater than 1.

In this embodiment of the present application, the display screen 194 may be an integrated flexible display screen, or a spliced display screen composed of two rigid screens and a flexible screen located on the two rigid screens. After the processor 110 executes the display method provided by the embodiment of the present application, the processor 110 may control the window sizes of different interfaces of the same application on the display screen 194 .

Camera 193 (front camera or rear camera, or one camera can be both front camera and rear camera) is used to capture still images or video. Generally, the camera 193 may include a photosensitive element such as a lens group and an image sensor, wherein the lens group includes a plurality of lenses (convex or concave) for collecting light signals reflected by the object to be photographed, and transmitting the collected light signals to the image sensor . The image sensor generates an original image of the object to be photographed according to the light signal.

Internal memory 121 may be used to store computer executable program code, which includes instructions. The processor 110 executes various functional applications and data processing of the mobile phone 100 by executing the instructions stored in the internal memory 121 . The internal memory 121 may include a storage program area and a storage data area. The storage program area may store operating system, code of application programs (such as camera application, WeChat application, etc.), and the like. The storage data area may store data created during the use of the mobile phone 100 (such as images, videos, etc. collected by the camera application) and the like.

The internal memory 121 may also store the codes of the display area adjustment algorithms provided by the embodiments of the present application. When the code of the display area adjustment algorithm stored in the internal memory 121 is executed by the processor 110 , the processor 110 can control the display position of the message in the notification bar on the display screen 194 .

In addition, the internal memory 121 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, universal flash storage (UFS), and the like.

Certainly, the code of the display area adjustment algorithm provided by the embodiment of the present application may also be stored in an external memory. In this case, the processor 110 can run the code of the display area adjustment algorithm stored in the external memory through the external memory interface 120 , and the processor 110 can control the window size of different interfaces of the same application on the display screen 194 .

The function of the sensor module 180 is described below.

The gyro sensor 180A can be used to determine the movement posture of the mobile phone 100 . In some embodiments, the angular velocity of cell phone 100 about three axes (ie, x, y, and z axes) may be determined by gyro sensor 180A. That is, the gyro sensor 180A can be used to detect the current motion state of the mobile phone 100, such as shaking or stillness.

In the embodiment of the present application, the gyro sensor 180A is used to detect the folding or unfolding operation acting on the display screen 194 . The gyroscope sensor 180A may report the detected folding operation or unfolding operation to the processor 110 as an event to determine the folding state or unfolding state of the display screen 194 .

The acceleration sensor 180B can detect the magnitude of the acceleration of the mobile phone 100 in various directions (generally three axes). That is, the gyro sensor 180A can be used to detect the current motion state of the mobile phone 100, such as shaking or stillness. In the embodiment of the present application, the acceleration sensor 180B is used to detect the folding or unfolding operation acting on the display screen 194 . The acceleration sensor 180B may report the detected folding operation or unfolding operation to the processor 110 as an event to determine the folding state or unfolding state of the display screen 194 .

Proximity light sensor 180G may include, for example, light emitting diodes (LEDs) and light detectors, such as photodiodes. The light emitting diodes may be infrared light emitting diodes. The mobile phone emits infrared light outward through light-emitting diodes. Phones use photodiodes to detect reflected infrared light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the phone. When insufficient reflected light is detected, the phone can determine that there are no objects near the phone. The proximity light sensor 180G may be disposed on the first screen of the foldable display screen 194, and the proximity light sensor 180G detects the size of the folding angle or the unfolding angle of the first screen and the second screen according to the optical path difference of the infrared signal.

The gyro sensor 180A (or the acceleration sensor 180B) may send the detected motion state information (such as angular velocity) to the processor 110 . The processor 110 determines, based on the motion state information, whether the current state is the hand-held state or the tripod state (for example, when the angular velocity is not 0, it means that the mobile phone 100 is in the hand-held state).

The fingerprint sensor 180H is used to collect fingerprints. The mobile phone 100 can use the collected fingerprint characteristics to realize fingerprint unlocking, accessing application locks, taking pictures with fingerprints, answering incoming calls with fingerprints, and the like.

Touch sensor 180K, also called "touch panel". The touch sensor 180K may be disposed on the display screen 194 , and the touch sensor 180K and the display screen 194 form a touch screen, also called a “touch screen”. The touch sensor 180K is used to detect a touch operation on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to touch operations may be provided through display screen 194 . In other embodiments, the touch sensor 180K may also be disposed on the surface of the mobile phone 100 , which is different from the position where the display screen 194 is located.

Exemplarily, the display screen 194 of the mobile phone 100 displays a main interface, and the main interface includes icons of multiple applications (such as a camera application, a WeChat application, etc.). The user clicks the icon of the camera application in the main interface through the touch sensor 180K, and triggers the processor 110 to start the camera application and turn on the camera 193 . Display screen 194 displays an interface of a camera application, such as a viewfinder interface. In this embodiment of the present application, when the display screen 194 receives a drag acting on the window adjustment control, the processor 110 may control the window sizes of different interfaces of the same application on the display screen 194 .

The wireless communication function of the mobile phone 100 can be realized by the antenna 1, the antenna 2, the mobile communication module 151, the wireless communication module 152, the modulation and demodulation processor, the baseband processor, and the like.

Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in handset 100 may be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, the antenna 1 can be multiplexed into a diversity antenna of the wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.

The mobile communication module 151 can provide a wireless communication solution including 2G/3G/4G/5G, etc. applied on the mobile phone 100 . The mobile communication module 151 may include at least one filter, switch, power amplifier, low noise amplifier (LNA) and the like. The mobile communication module 151 can receive electromagnetic waves from the antenna 1, filter and amplify the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 151 can also amplify the signal modulated by the modulation and demodulation processor, and then turn it into an electromagnetic wave for radiation through the antenna 1 . In some embodiments, at least part of the functional modules of the mobile communication module 151 may be provided in the processor 110 . In some embodiments, at least part of the functional modules of the mobile communication module 151 may be provided in the same device as at least part of the modules of the processor 110 .

The modem processor may include a modulator and a demodulator. Wherein, the modulator is used to modulate the low frequency baseband signal to be sent into a medium and high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low frequency baseband signal. Then the demodulator transmits the demodulated low-frequency baseband signal to the baseband processor for processing. The low frequency baseband signal is processed by the baseband processor and passed to the application processor. The application processor outputs sound signals through audio devices (not limited to the speaker 170A, the receiver 170B, etc.), or displays images or videos through the display screen 194 . In some embodiments, the modem processor may be a stand-alone device. In other embodiments, the modem processor may be independent of the processor 110, and may be provided in the same device as the mobile communication module 151 or other functional modules.

The wireless communication module 152 can provide applications on the mobile phone 100 including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellite system ( global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field communication technology (near field communication, NFC), infrared technology (infrared, IR) and other wireless communication solutions. The wireless communication module 152 may be one or more devices integrating at least one communication processing module. The wireless communication module 152 receives electromagnetic waves via the antenna 2 , frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110 . The wireless communication module 152 can also receive the signal to be sent from the processor 110 , perform frequency modulation on it, amplify the signal, and then convert it into electromagnetic waves for radiation through the antenna 2 .

In addition, the mobile phone 100 may implement audio functions through an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, and an application processor. Such as music playback, recording, etc. The mobile phone 100 can receive the key 190 input and generate the key signal input related to the user setting and function control of the mobile phone 100 . The mobile phone 100 can use the motor 191 to generate vibration alerts (eg, vibration alerts for incoming calls). The indicator 192 in the mobile phone 100 can be an indicator light, which can be used to indicate the charging state, the change of the power, and can also be used to indicate a message, a missed call, a notification, and the like. The SIM card interface 195 in the mobile phone 100 is used to connect the SIM card. The SIM card can be contacted and separated from the mobile phone 100 by being inserted into the SIM card interface 195 or pulled out from the SIM card interface 195 .

It should be understood that, in practical applications, the mobile phone 100 may include more or less components than those shown in FIG. 1 , which are not limited in this embodiment of the present application.

FIG. 2 is a block diagram of a software structure of an electronic device provided by an embodiment of the present application. The layered architecture can divide the software into several layers, and each layer has a clear role and division of labor. Layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into three layers, which are an application layer (referred to as application layer), an application framework layer (referred to as framework layer), and a kernel layer (also referred to as driver layer) from top to bottom.

Among them, the application layer may include a series of application packages. As shown in FIG. 2 , the application layer may include multiple application packages such as application 1 and application 2 . For example, the application package can be applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, SMS, and desktop launcher (Launcher).

The framework layer provides an application programming interface (application programming interface, API) and a programming framework for the applications of the application layer. The application framework layer includes some predefined functions. As shown in FIG. 2 , the framework layer may include a window manager (window manager service, WMS), an activity manager (activity manager service, AMS), and the like. Optionally, the framework layer may further include a content provider, a view system, a phone manager, a resource manager, a notification manager, etc. (not shown in the drawings).

Among them, the window manager WMS is used to manage window programs. The window manager can get the size of the display screen, determine whether there is a status bar, lock the screen, take screenshots, etc. The activity manager AMS is used to manage activities, and is responsible for starting, switching, scheduling, and application management and scheduling of various components in the system.

The kernel layer is the layer between hardware and software. The kernel layer at least includes display drivers, camera drivers, audio drivers, sensor drivers, input/output device drivers (eg, keyboard, touch screen, earphone, speaker, microphone, etc.).

The electronic device receives an input operation (such as a split-screen operation) performed by the user on the display screen, and the kernel layer can generate a corresponding input event according to the input operation, and report the event to the application framework layer. The window mode (eg, multi-window mode), window position and size, etc. corresponding to the input operation are set by the activity management server AMS of the application framework layer. The window management server WMS of the application framework layer draws the window according to the settings of the AMS, and then sends the drawn window data to the display driver of the kernel layer, and the display driver displays the corresponding application interface in different display areas of the display screen.

Wherein, the display method provided by the embodiment of the present application may be implemented based on the freeform feature of google (Google) and a multi-window and multi-task infrastructure. For the display method provided by the embodiment of the present application, reference may be made to the following FIG. 3 . As shown in FIG. 2 , in this embodiment of the present application, the activity manager AMS may include an Activity (activity) native management module and an Activity (activity) extension module. Among them, the Activity native management module is used to manage the Activity, and is responsible for the startup, switching, scheduling of each component in the system, and the management and scheduling of the application program. The Activity extension module is used to set the window mode and the properties of the window according to the folded or unfolded state of the foldable screen.

The properties of the window may include the position and size of the Activity window, and the visible properties of the Activity window (ie, the state of the Activity window). The position of the activity window is when the folding screen displays the activity window, the position of the activity window on the folding screen, and the size of the activity window may be information such as width and height in the application startup config (configuration). The visible property of the Activity window can be true (yes) or false (no). When the visible property of the Activity window is true, it means that the Activity window is visible to the user, that is, the display driver will display the content of the Activity window. When the visible attribute of the Activity of the Activity window is false, it means that the Activity window is invisible to the user, that is, the display driver does not display the content of the Activity window.

Exemplarily, an application (eg, application 1 ) can call the start Activity interface to start the corresponding Activity. In response to the invocation of the application, the activity manager AMS may request the window manager WMS to draw the window corresponding to the Activity, and invoke the display driver to display the interface.

It can be understood that, in the process of displaying the application interface on the electronic device, the input/output device driver of the driver layer can detect the user's drag event (onTouchEvent). The input/output device driver can report the drag event to the window manager WMS of the framework layer (ie, the application framework layer). After the window manager WMS listens to the drag event, the window manager WMS sends a display (display area) change event to the activity manager AMS, that is, the operation in the drag event is changed through the AIDL (android interface definition language, interface definition language) interface. The endpoint coordinates are sent from the application process to the AMS of the Android Open-Source Project (AOSP) process, and the AMS adjusts the width of the two windows according to the operation endpoint coordinates. The activity manager AMS sets the window mode and properties of the window, such as determining the display area (display) size. After the activity manager AMS sets the activity window mode and properties, it can request the window manager WMS to redraw the window, and then call the display driver to display the redrawn window content, so as to present different interfaces of the application to the user in new and different display areas.

At present, existing terminal devices (such as mobile phones, tablet devices, etc.) usually have a split-screen function. The so-called split-screen function is to divide the physical screen of a terminal into multiple display windows for display, and each display window can display different interface for user convenience. Specifically, the window adjustment in the existing split-screen mode is realized through the corresponding split-screen application or the System UI (system interface) process, etc. However, in the process of realizing the split-screen through the above method, it is necessary to pass the AIDL cross-process The communication mechanism is used to notify the System Server (system service) process to realize the processing of the window adjustment operation, so the processing delay is long and the picture may not be smooth enough.

Exemplarily, the terminal device shown in FIG. 3 supports the split-screen function. When the user performs split-screen display on the gallery application 31 and the WeChat application 32 in the terminal device shown in FIG. 3 , the process of the gallery application 31 needs to be started first. and the process of the WeChat application 32, and then receive the user's split-screen operation to determine the size of the two windows to achieve split-screen display. If the terminal device receives the user's moving operation on the window adjustment control 33, the terminal's gallery application 31 process and the WeChat application 32 process need to send the coordinates of the moving operation to the System Server process for processing. The process of application 32 does not belong to the same process as the System Server process itself, and the communication between processes needs to be realized through the corresponding cross-process communication mechanism, so it is necessary to call the corresponding cross-process communication mechanism to adjust the user's mobile operation (window adjustment control). The moved coordinates) are sent to the System Server process for processing, so as to move the window adjustment control 33 to the corresponding position indicated by the coordinates to realize the adjustment of the size of the split-screen window. After the System Server process adjusts the window size, it is also necessary to trigger the System UI process to redraw the interface of each window. Because the System UI process and the System Server process also belong to different processes, the cross-process communication mechanism also needs to be invoked to redraw the interface of the gallery application 31 and the interface of the WeChat application 32 .

Obviously, the invocation of the above-mentioned cross-process communication mechanism in the prior art will affect the response speed and fluency of window adjustment. To this end, referring to FIG. 4A , in the embodiment of the present application, in the multi-window mode, before rendering different windows, AMS may insert a window adjustment control 41 at the right border of the Activity root layout on the left side of the display screen , and similarly insert the same window adjustment control 41 into the left interface of the right Activity root layout. It should be noted that the window adjustment control 41 may also be a virtual control, that is, invisible to the user, or in a scenario where the display screen displays two left and right windows, there is one window adjustment control 41 at the border between the left and right windows. The embodiment of the present application does not specifically limit the specific expression form of the window adjustment control 41 .

As shown in FIG. 4B , because the window adjustment control 41 overloads the drag event (onTouchEvent), in step 401, the user can apply a drag operation on the display screen; in step 402, the kernel layer listens to the drag event , send the drag direction, operation start coordinates and operation end coordinates from the application process to the AMS module of the AOSP process through the AIDL interface; Step 403, the AMS module calculates the width of the left and right windows according to the operation end coordinates, and sets the Activity window Mode and properties; Step 404, then request the window manager WMS to redraw the window according to the set window properties. During the entire window adjustment process, the application layer application can realize the window adjustment function without any adaptation development.

Based on the above window adjustment implementation mechanism, an embodiment of the present application provides a display method, and the technical solutions in the embodiments of the present application will be described below with reference to the accompanying drawings in the embodiments of the present application. Among them, in the description of the embodiments of the present application, the terms "first" and "second" are only used for description purposes, and should not be understood as indicating or implying relative importance or indicating the number of technical features indicated. . Thus, a feature defined as "first" or "second" may expressly or implicitly include one or more of that feature. In the description of the embodiments of the present application, unless otherwise specified, "plurality" means two or more. As shown in FIG. 5 , the display method provided by the embodiment of the present application may be executed by an electronic device.

In step 501, the processor 110 in the electronic device receives a user's screen splitting operation.

The split-screen operation is used to trigger different interfaces of the first application to be displayed on the same display screen 194 at the same time. The split-screen operation may be a split-screen gesture or a voice command as shown in FIG. 6 .

For example, the standby interface 700 of the mobile phone shown in FIG. 7A is provided with the Huawei Mall application 701. When the mobile phone detects the user's click operation on the Huawei Mall application 701, the interface 710 shown in FIG. 7B is displayed. The user enters the keyword "hat" in the search box of the interface 710, and when the mobile phone detects the user's operation on the search control 711 of the interface 710, the interface 720 as shown in FIG. 7C is displayed. The user may apply a split screen gesture on the interface 720 as shown in FIG. 6 .

Step 502, in response to the split screen operation, the processor 110 controls the first display area of the display screen 194 of the electronic device to display the first interface, and controls the second display area of the display screen to display the second interface.

Wherein, the second display area and the first display area may partially overlap, or may not overlap at all; the first interface and the second interface are both different interfaces of the first application.

Exemplarily, when the mobile phone detects the split-screen gesture applied by the user on the interface 720 shown in FIG. 7C , the electronic device displays the interface 730 shown in FIG. 7D . The first interface displayed in the first display area 731 of the interface 730 is the content of the interface 710 shown in FIG. 7B , and the second interface displayed in the second display area 732 of the interface 730 is the content of the interface 720 shown in FIG. 7C . content.

Step 503, the processor 110 in the electronic device receives the second operation of the user.

The second operation is used to trigger adjustment of the size of at least one display area in the first display area and the second display area. The second operation may be a drag operation acting on the window adjustment control, or a drag gesture or the like.

Step 504, in response to the second operation, the processor 110 controls the first display area to be adjusted to a third display area, and controls the second display area to be adjusted to a fourth display area, wherein the third display area displays the first interface, and the fourth display area displays the first interface. The display area displays the second interface.

In the embodiment of the present application, the electronic device adds a window adjustment control to facilitate the user to adjust the window size, realizes the effect of adjusting the window size at the system level, reduces the processing delay, increases the fluency of the interface display, and also improves the user experience.

Exemplarily, when the mobile phone displays the interface 730 shown in FIG. 7D , and the mobile phone can receive the user's rightward drag operation on the window adjustment control 733 , the mobile phone displays the interface 740 shown in FIG. 7E . The first interface displayed in the fourth display area 741 of the interface 740 is the content of the interface 710 shown in FIG. 7B , and the second interface displayed in the third display area 742 of the interface 740 is the content of the interface 720 shown in FIG. 7C . content.

In a possible embodiment, the third-party application can also configure which interfaces can support split-screen display by configuring static configuration parameters, so that the third-party application is unaware of split-screen when running on the electronic device. When the above electronic device runs a third-party application that supports split-screen display, in response to a user's split-screen operation, the AMS on the operating system can perform split-screen display on the interface of the third-party application according to static configuration parameters.

In a possible embodiment, the drag operation may include the drag direction, the coordinates of the start point of the operation and the coordinates of the end point of the operation; the electronic device adjusts the width of the first display area according to the direction of the drag, the coordinates of the start point of the operation and the coordinates of the end point of the operation The ratio between the width of the second display area and the second display area, and according to the ratio, the third display area and the fourth display area are determined. Exemplarily, as shown in FIG. 8A , the width of the first display area is X1, the width of the second display area is Y1, X1 is equal to Y1, and the electronic device detects that the user acts on the rightward drag operation on the window adjustment control L1. , the electronic device displays the interface shown in FIG. 8B , the width of the third display area is X2, and the width of the fourth display area is Y2, where X2 is greater than Y2. Further, when the ratio between X2/Y2 is greater than a set threshold (for example, 19/1), the electronic device can control the first interface in the first display area to be displayed in full screen. Further, the electronic device can also hide or remove the window adjustment control.

In some embodiments, as shown in FIG. 8C , the width of the first display area is X1, the width of the second display area is Y1, X1 is equal to Y1, and the mobile phone detects that the user acts on the leftward drag on the window adjustment control L1 During operation, the mobile phone displays the interface shown in FIG. 8D , the width of the third display area is X3, and the width of the fourth display area is Y3, where X3 is smaller than Y3. Further, when the ratio between X3/Y3 is smaller than a set threshold (for example, 1/19), the electronic device can control the second interface in the second display area to be displayed in full screen. Further, the electronic device can also hide or remove the window adjustment control.

In some possible embodiments, when the display screen of the electronic device is a folding screen, the boundary line L1 between the first display area and the second display area in FIG. 8A may coincide with the folding edge of the folding screen. When the folding screen is fully unfolded, in this embodiment, the first display area corresponds to the first screen of the folding screen, and the second display area corresponds to the second screen of the folding screen.

In this embodiment of the present application, the second interface may be an interface at an upper level of the first interface; or, the second interface is an interface at a lower level of the first interface, and the second interface is different from the first interface. In this embodiment, the mobile phone may determine the second interface in the following manner.

First, a plurality of display areas included in a display screen (including a foldable screen or a non-foldable screen) of the electronic device may be preset in the electronic device, or may be manually set by the user. That is to say, the dimensions (including width and height) of the first display area and the second display area can be pre-configured in the mobile phone. Alternatively, the width and height of the first display area and the second display area can be manually set by the user in the mobile phone. In this embodiment, the size of the first display area and the size of the second display area may be the same or different.

For example, as shown in FIG. 9 , the setting interface 901 of the electronic device displays setting controls for the display area, and the user can set the aspect ratio (ie, the aspect ratio) of the first display area and the aspect ratio of the second display area by themselves, or The user can select the aspect ratio of the first display area and the aspect ratio of the second display area from the setting interface.

For another example, as shown in (a) of FIG. 10 , the setting interface 1001 of the mobile phone displays a display area quantity setting control 1002 and a display area range setting control 1003 in a landscape state. After the user sets the number of display areas to 2, and clicks the control 1003, as shown in (b) of FIG. 10, the mobile phone can prompt the user to set the range of the first display area, and the user can drag on the display screen to set the first display area. The extent of a display area. After the user stops dragging, as shown in (c) of FIG. 10 , the mobile phone can display a control 1004 for determining the range of the first display area and a control 1005 for canceling the setting. After the user clicks the control 1004, referring to FIG. 10(d) and FIG. 10(e), the mobile phone can determine the range of the first display area and the second display area set by the user, wherein (d) in FIG. 10 ) is a schematic diagram that the first display area and the second display area do not overlap at all, and (e) in FIG. 10 is a schematic diagram that the first display area and the second display area partially overlap. Optionally, the user can also move the position of the first display area.

For another example, after the user sets the number of display areas to 2 on the setting interface 1001, and clicks the control 1003, as shown in FIG. 11, a dividing line 1101 is displayed on the setting interface of the mobile phone, and the user can drag the dividing line 1101 to set Determine the size and aspect ratio of the first display area and the second display area.

Of course, in addition to the above-mentioned setting methods, the user can also set the display area included in the display screen of the mobile phone by other methods, which are not limited in the embodiments of the present application.

In other embodiments of the present application, an electronic device is also disclosed. As shown in FIG. 12, the electronic device may include: a touch screen 1201, wherein the touch screen 1201 includes a touch panel 1206 and a display screen 1207; one or A plurality of processors 1202; memory 1203; one or more application programs (not shown); Wherein the one or more computer programs 1204 are stored in the aforementioned memory 1203 and configured to be executed by the one or more processors 1202, the one or more computer programs 1204 include instructions that can be used to perform the execution as shown in FIG. 5 Each step in the corresponding embodiment.

Embodiments of the present application further provide a computer storage medium, where computer instructions are stored in the computer storage medium, and when the computer instructions are executed on an electronic device, the electronic device executes the above-mentioned relevant method steps to implement the display method in the above-mentioned embodiments.

Embodiments of the present application further provide a computer program product, which, when the computer program product runs on a computer, causes the computer to execute the above-mentioned relevant steps, so as to realize the display method in the above-mentioned embodiment.

In addition, the embodiments of the present application also provide an apparatus, which may specifically be a chip, a component or a module, and the apparatus may include a connected processor and a memory; wherein, the memory is used for storing computer execution instructions, and when the apparatus is running, The processor can execute the computer execution instructions stored in the memory, so that the chip executes the display method of the touch screen in the above method embodiments.

The electronic devices, computer storage media, computer program products or chips provided in the embodiments of the present application are all used to execute the corresponding methods provided above. Therefore, for the beneficial effects that can be achieved, reference may be made to the corresponding methods provided above. The beneficial effects of the method are not repeated here.

From the description of the above embodiments, those skilled in the art can understand that for the convenience and brevity of the description, only the division of the above functional modules is used as an example for illustration. In practical applications, the above functions can be allocated by different The function module is completed, that is, the internal structure of the device is divided into different function modules, so as to complete all or part of the functions described above.

In the several embodiments provided in this application, it should be understood that the disclosed apparatus and method may be implemented in other manners. For example, the apparatus embodiments described above are only illustrative. For example, the division of modules or units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components may be combined or May be integrated into another device, or some features may be omitted, or not implemented. Another point, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces, indirect coupling or communication connection of devices or units, which may be in electrical, mechanical or other forms.

Units described as separate components may or may not be physically separated, and components shown as units may be one physical unit or multiple physical units, that is, may be located in one place, or may be distributed in multiple different places. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution in this embodiment.

In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically alone, or two or more units may be integrated into one unit. The above-mentioned integrated units may be implemented in the form of hardware, or may be implemented in the form of software functional units.

The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a readable storage medium. Based on such understanding, the technical solutions of the embodiments of the present application can be embodied in the form of software products in essence, or the parts that contribute to the prior art, or all or part of the technical solutions, which are stored in a storage medium , including several instructions to make a device (which may be a single chip microcomputer, a chip, etc.) or a processor (processor) to execute all or part of the steps of the methods in the various embodiments of the present application. The aforementioned storage medium includes: a U disk, a removable hard disk, a read only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk and other media that can store program codes.

The above content is only a specific embodiment of the present application, but the protection scope of the present application is not limited to this. Covered within the scope of protection of this application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims (12)

1. A display method, applied to an electronic device, wherein the method comprises: Receive user's split screen operation; In response to the split screen operation, the first display area of the display screen of the electronic device is controlled to display the first interface, and the second display area of the display screen is controlled to display the second interface; wherein the second display area is the same as the The first display area partially overlaps or does not overlap at all; the first interface and the second interface are different interfaces of the first application; receiving a second operation from the user, where the second operation is used to trigger adjustment of the size of at least one display area in the first display area and the second display area; In response to the second operation, the first display area is controlled to be adjusted to a third display area, and the second display area is controlled to be adjusted to a fourth display area; wherein the third display area displays the first display area interface, and the fourth display area displays the second interface. 2. The method according to claim 1, wherein a window adjustment control is provided on the right border of the first interface and the left border of the second interface; the second operation is to act on the window adjustment The drag operation of the control, the drag operation includes the drag direction, the coordinates of the start point of the operation and the coordinates of the end point of the operation; Before controlling the first display area to be adjusted to the third display area and the second display area to be adjusted to the fourth display area, the method further includes: adjusting the ratio between the width of the first display area and the width of the second display area according to the drag direction, the coordinates of the operation start point and the coordinates of the operation end point; According to the ratio, the third display area and the fourth display area are determined. 3. The method of claim 2, further comprising: When the ratio between the width of the first display area and the width of the second display area is less than a first threshold, controlling the second interface to be displayed in full screen; Or, when the ratio between the width of the first display area and the width of the second display area is greater than a second threshold, controlling the first interface to display in full screen; Wherein, the first threshold is much smaller than the second threshold. 4. The method according to any one of claims 1 to 3, wherein the second interface is an interface at an upper level of the first interface; or, the second interface is the first interface The interface at the next level of the interface. 5. The method according to any one of claims 1 to 3, wherein the first display area and the second display area are preconfigured in the electronic device; or, the first display area and the second display area is set by the user in the electronic device; Or, when the display screen of the electronic device is a folding screen, the first display area is a display area corresponding to the first screen, and the second display area is a display area corresponding to the second screen, wherein the folding The screen may be folded to form at least two screens including the first screen and the second screen. 6. An electronic device, comprising a display screen, a processor and a memory; the memory for storing one or more computer programs; When executed by the processor, one or more computer programs stored in the memory cause the electronic device to execute: In response to the split-screen operation, the first display area of the display screen is controlled to display the first interface, and the second display area of the display screen is controlled to display the second interface; wherein the second display area is connected to the first interface. A display area partially overlaps or does not overlap at all; the first interface and the second interface are different interfaces of the first application; receiving a second operation from the user, where the second operation is used to trigger adjustment of the size of at least one display area in the first display area and the second display area; In response to the second operation, the first display area is controlled to be adjusted to a third display area, and the second display area is controlled to be adjusted to a fourth display area; wherein the third display area displays the first display area interface, and the fourth display area displays the second interface. 7 . The electronic device according to claim 6 , wherein a window adjustment control is provided on the boundary of the first interface and the boundary of the second interface; and the second operation is to act on the window adjustment control. 8 . The drag operation includes the drag direction, the coordinates of the start point of the operation and the coordinates of the end point of the operation; When executed by the processor, one or more computer programs stored in the memory cause the electronic device to also execute: Before controlling the first display area to be adjusted to the third display area and the second display area to be adjusted to the fourth display area, according to the drag direction, the coordinates of the operation start point and the coordinates of the operation end point, adjusting the ratio between the width of the first display area and the width of the second display area; According to the ratio, the third display area and the fourth display area are determined. 8. The electronic device according to claim 7, wherein when one or more computer programs stored in the memory are executed by the processor, the electronic device is caused to further execute: When the ratio between the width of the first display area and the width of the second display area is less than a first threshold, controlling the second interface to display in full screen; Or, when the ratio between the width of the first display area and the width of the second display area is greater than a second threshold, controlling the first interface to display in full screen; Wherein, the first threshold is much smaller than the second threshold. 9 . The electronic device according to claim 6 , wherein the second interface is an interface at an upper level of the first interface; or, the second interface is the first interface. 10 . The interface at the next level of an interface. 10. The electronic device according to any one of claims 6 to 8, wherein the first display area and the second display area are preconfigured in the electronic device; or, the first display area the area and the second display area are set by the user in the electronic device; Or, when the display screen of the electronic device is a folding screen, the first display area is a display area corresponding to the first screen, and the second display area is a display area corresponding to the second screen, wherein the folding The screen may be folded to form at least two screens including the first screen and the second screen. 11. A computer-readable storage medium, characterized in that the computer-readable storage medium comprises a computer program, which, when the computer program is run on an electronic device, causes the electronic device to perform any one of claims 1 to 5 the display method. 12 . A chip, characterized in that, the chip is coupled with a memory for executing a computer program stored in the memory, so as to execute the display method according to any one of claims 1 to 5 .

Images