WO2023138024A1 - Display device, split-screen display method and split-screen application switching method - Google Patents

Abstract

The present application relates to the technical field of display, and in particular to a display device, a split-screen display method and a split-screen application switching method. The display device comprises: a user input interface, which is configured to receive an input of a user; a display, which is configured to display an image and/or an interface; and a controller, which is configured to draw, in response to a starting input and according to the size of a full-screen window during full-screen display, an interface of a first application that supports split-screen display, and control the display to display the interface of the first application in a full-screen manner; control the display to display a split-screen control on the interface of the first application; and in response to receiving a first input for the split-screen control by means of the user input interface, determine the size of a first split-screen window of a first split-screen area, re-draw the interface of the first application according to the size of the first split-screen window, determine the size of a second split-screen window of a second split-screen area, draw an application selection interface according to the size of the second split-screen window, and control the display to display the interface of the first application in the first split-screen area and display the application selection interface in the second split-screen area.

Description

A display device, split-screen display, and split-screen application switching method

Cross References to Related Applications

This application claims the priority of the Chinese patent application submitted on January 20, 2022, with application number 202210068176.5; and submitted on January 20, 2022, with application number 202210067411.7, the entire contents of which are incorporated in this application by reference.

technical field

The present application relates to the field of display technology, and in particular to a display device, split-screen display and split-screen application switching method.

Background technique

At present, in smart devices, the application program (also referred to as application) in the foreground is limited to one. When the user needs to operate two application programs in the foreground at the same time, this scenario causes some inconvenience to the user. In order to facilitate the operation of two applications at the foreground at the same time, the software system of the smart device currently supports split-screen display, but some applications installed on the smart device do not support split-screen display, and the software system of the smart device cannot know whether the application supports split-screen display, so when the application is directly displayed in split-screen, the interface of the application may not be displayed normally.

Contents of the invention

The embodiment of this application provides a display device, including: user input interface, configured to receive the user's input; the display, configure: display image and/or interface; the controller is configured to respond to the startup input of the first application through the user input interface, draw the interface of the first application according to the full -screen window size when the full screen display, and control the full display of the display. The interface of the first application described in the screen is controlled; controlling the displayed screen control in the upper layer of the display interface in the first application, where the first application supports the division of the screen; in response to the first input of the first -screen screen by receiving the first input of the dividing screen control through the user input interface, determine the corresponding first -screen window size corresponding to the first sub -screen area. The interface of the application, and determining the size of the second -point screen window corresponding to the second -point screen area, draws the application selection interface according to the size of the second -sub -screen window, and controls the interface of the first application in the first sub -screen area, and the application selection interface displayed in the second -sub -screen area; where the application selection interface includes at least one logo, which is said to it until There is less logo for identification applications that support at least one -screen display.

An embodiment of the present application provides a split-screen display method for a display device, including: in response to a start input for a first application, drawing an interface of the first application according to a full-screen window size when a display of the display device is displayed in full screen, and displaying the interface of the first application in full screen; displaying a split-screen control on an upper layer of the interface of the first application, wherein the first application supports split-screen display; in response to a first input for the split-screen control, determining a size of a first split-screen window corresponding to a first split-screen area, and redrawing the interface of the first application according to the size of the first split-screen window, And determining the size of the second split-screen window corresponding to the second split-screen area, drawing an application selection interface according to the size of the second split-screen window, displaying the interface of the first application in the first split-screen area, and displaying the application selection interface in the second split-screen area; wherein, the application selection interface includes at least one logo, and the at least one logo is used to identify at least one application that supports split-screen display.

An embodiment of the present application provides a split-screen application switching method for a display device, including: responding to a first instruction, and acquiring a split-screen application combination list; wherein, the first instruction is an instruction for switching split-screen applications received by the display device under split-screen display on the display, and the split-screen application combination list includes all multiple candidate split-screen application combinations, and each candidate split-screen application combination includes a main screen application and a secondary screen application; presenting the split-screen application combination list on the display; The main screen application is presented in the main screen area of the display, and the secondary screen application in the selected split-screen application combination is presented in the display secondary screen area, wherein the selected split-screen application combination is one of the candidate split-screen application combinations, and the main screen area does not overlap with the secondary screen area.

Description of drawings

FIG. 1 is a schematic diagram of a scene according to some embodiments of the present application;

FIG. 2 is a configuration block diagram of a control device 100 according to some embodiments of the present application;

FIG. 3 is a block diagram of a hardware configuration of a display device 200 according to some embodiments of the present application;

FIG. 4 is a schematic diagram of software configuration in the display device 200 according to some embodiments of the present application;

FIG. 5 is a schematic diagram of displaying an icon control interface of an application program in the display device 200 according to some embodiments of the present application;

FIG. 6 is a schematic flowchart of a split-screen display method according to some embodiments of the present application;

FIG. 7 is a first schematic diagram of an interface of a display device according to some embodiments of the present application;

FIG. 8 is a second schematic diagram of an interface of a display device according to some embodiments of the present application;

FIG. 9 is a third schematic diagram of an interface of a display device according to some embodiments of the present application;

Fig. 10 is a flowchart of a method for implementing switching from full-screen display to split-screen display according to some embodiments of the present application;

FIG. 11 is a fourth schematic diagram of an interface of a display device according to some embodiments of the present application;

FIG. 12 is a fifth schematic diagram of an interface of a display device according to some embodiments of the present application;

Fig. 13 is a flow chart of a method for switching from split-screen display to full-screen display according to some embodiments of the present application;

FIG. 14 is a flowchart of a split-screen application switching method according to some embodiments of the present application;

Fig. 15 is a schematic diagram of an interactive interface of a display in a split-screen mode according to some embodiments of the present application;

Fig. 16 is a flowchart of a method for a controller to establish a split-screen application combination list according to some embodiments of the present application;

Fig. 17 is a flow chart of a method for executing split-screen application switching by a controller according to some embodiments of the present application;

Fig. 18 is a flowchart of a method for a controller to perform split-screen application switching according to some embodiments of the present application;

Fig. 19 is a schematic diagram of an interactive interface in a display split-screen mode according to some embodiments of the present application;

Fig. 20 is a schematic diagram of an application page change interactive interface in a display split-screen mode according to some embodiments of the present application;

Fig. 21 is a schematic diagram of a split-screen application list interactive interface before the display application page is changed according to some embodiments of the present application;

Fig. 22 is a schematic diagram of an interactive interface of a split-screen application list after a display application page change according to some embodiments of the present application;

Fig. 23 is a schematic diagram of an interactive interface before a display application jumps according to some embodiments of the present application;

Fig. 24 is a schematic diagram of an interactive interface after a display application jumps according to some embodiments of the present application;

Fig. 25 is a schematic diagram of an interactive interface of a split-screen application list after a display application transition according to some embodiments of the present application;

Fig. 26 is a schematic diagram of an interactive interface before a display application page is changed according to some embodiments of the present application;

Fig. 27 is a schematic diagram of an interactive interface for exiting the split-screen mode of the display according to some embodiments of the present application.

Detailed ways

In order to better understand the above purpose, features and advantages of the present application, the solution of the present application will be further described below. It should be noted that, in the case of no conflict, the embodiments of the present application and the features in the embodiments can be combined with each other.

In the following description, many specific details are set forth in order to fully understand the present application, but the present application can also be implemented in other ways than described here; obviously, the embodiments in the description are only some of the embodiments of the present application, not all of them.

The term "remote controller" used in various embodiments of the present application refers to a component of an electronic device (such as the display device disclosed in this application), which can usually control the electronic device wirelessly within a relatively short distance. The component can generally use infrared and/or radio frequency (Radio Frequency, RF) signals and/or Bluetooth to connect with electronic devices, and can also include functional modules such as WiFi, wireless Universal Serial Bus (Universal Serial Bus, USB), Bluetooth, and motion sensors. For example: a hand-held touch remote controller replaces most of the physical built-in hard keys in a general remote control device with a user interface in a touch screen.

In this embodiment of the present application, the application referred to refers to an application program, and the application program may refer to a system application program or a third-party application program. The application and application program in the following text can be understood in the same way.

Fig. 1 is a schematic diagram of a scene in some embodiments. As shown in FIG. 1 , the user can operate the display device 200 through the smart device 300 or the control device 100 , and the display device 200 performs data communication with the server 400 .

In some embodiments, the control device 100 may be a remote controller, and the communication between the remote controller and the display device includes infrared protocol communication, Bluetooth protocol communication, and other short-distance communication methods, and the display device 200 is controlled wirelessly or wiredly. The user can control the display device 200 by inputting user commands through buttons on the remote control, voice input, control panel input, and the like.

In some embodiments, a smart device 300 (such as a mobile terminal, tablet computer, computer, notebook computer, augmented reality (Augmented Reality, AR)/virtual reality (Virtual Reality, VR) device, etc.) can also be used to control the display device 200. For example, the display device 200 is controlled using an application program running on the smart device 300 .

In some embodiments, the smart device 300 and the display device 200 may also be used for data communication.

In some embodiments, the display device 200 may not use the above-mentioned smart device 300 or the control device 100 to receive instructions, but receive user control through touch or gesture.

In some embodiments, the display device 200 can also be controlled in a manner other than the control device 100 and the smart device 300. For example, the user's voice command control can be directly received through the module for acquiring voice commands configured inside the display device 200, or the user's voice command control can be received through the voice control device installed outside the display device 200.

In some embodiments, the display device 200 may be allowed to communicate via a local area network (Local Area Network, LAN), a wireless local area network (Wireless Local Area Network, WLAN) and other networks. The server 400 may provide various contents and interactions to the display device 200 . The server 400 may be one cluster, or multiple clusters, and may include one or more types of servers.

Fig. 2 is a configuration block diagram of the control device 100 according to some embodiments. As shown in FIG. 2 , the control device 100 includes a controller 110 , a communication interface 130 , a user input/output interface 140 , a memory, and a power supply. The control device 100 can receive the user's input operation instruction, and convert the operation instruction into an instruction that the display device 200 can recognize and respond to, and play an intermediary role between the user and the display device 200 . The communication interface 130 is used for communicating with the outside, and includes at least one of a WIFI chip, a Bluetooth module, NFC or an alternative module. The user input/output interface 140 includes at least one of a microphone, a touch pad, a sensor, a key or an alternative module.

As shown in FIG. 3 , it is a hardware configuration block diagram of a display device 200 in some embodiments. The display device 200 includes a tuner and demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a user input interface 280, and at least one of a memory and a power supply, wherein the display 260 and the audio output interface 270 belong to the output interface.

In some embodiments, the tuner demodulator 210 receives broadcast TV signals through wired or wireless reception, and demodulates audio and video signals, such as EPG data signals, from multiple wireless or cable broadcast TV signals.

The communicator 220 is a component for communicating with external devices or servers according to various types of communication protocols. For example: the communicator 220 may include at least one of a Wifi module, a Bluetooth module, a wired Ethernet module and other network communication protocol chips or near field communication protocol chips, and an infrared receiver. The display device 200 may establish transmission and reception of control signals and data signals with the external control device 100 or the server 400 through the communicator 220 .

The detector 230 is configured to collect signals of the external environment or interaction with the outside. For example, the detector 230 includes a light receiver, which is a sensor for collecting ambient light intensity; or, the detector 230 includes an image collector, such as a camera, which can be used to collect external environmental scenes, user attributes, or user interaction gestures; or, the detector 230 includes a sound collector, such as a microphone, for receiving external sound.

The external device interface 240 may include, but is not limited to, the following: any one or more interfaces such as a high-definition multimedia interface (High Definition Multimedia Interface, HDMI), an analog or data high-definition component input interface (component), a composite video input interface (Composite Video Broadcast Signal, CVBS), a USB input interface (USB), and a red green blue (red green blue, RGB) port. It may also be a composite input/output interface formed by the above-mentioned multiple interfaces.

In some embodiments, the controller 250 includes a processor, a video processor, an audio processor, a graphics processor, a random access memory (Random Access Memory, RAM), a read-only memory (Read-Only Memory, ROM), and a first interface to an nth interface for input/output.

In some embodiments, the controller 250 and the tuner-demodulator 210 may be located in different split devices, that is, the tuner-demodulator 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

The controller 250 controls the work of the display device and responds to user operations through various software control programs stored in the memory. The controller 250 controls the overall operations of the display device 200 . For example, in response to receiving a user command for selecting a UI object to be displayed on the display 260, the controller 250 may perform an operation related to the object selected by the user command.

In some embodiments, the controller includes at least one of a central processing unit (Central Processing Unit, CPU), a video processor, an audio processor, a graphics processing unit (Graphics Processing Unit, GPU), a RAM, a ROM, a first interface to an nth interface for input/output, a communication bus (Bus), etc., wherein,

The CPU processor is used to execute the operating system and application program instructions stored in the memory, and to execute various application programs, data and content according to various interactive instructions received from the outside, so as to finally display and play various audio and video content. A CPU processor may include multiple processors. For example, including a main processor and one or more sub-processors;

The display 260 includes a display screen component for displaying images, and a drive component for driving image display, for receiving image signals output from the controller, components for displaying video content, image content, menu control interface, and user control UI interface. The display 260 can be a liquid crystal display, an OLED display, and a projection display, and can also be a projection device and a projection screen.

The user can input a user command on a graphical user interface (Graphic User Interface, GUI) displayed on the display 260, and the user input interface receives the user input command through the graphical user interface (GUI). Alternatively, the user may input a user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through a sensor to receive the user input command.

The user input interface 280 can be used to receive control signals input by the user through the control device 100 (such as: physical buttons on the display device body, infrared remote controller, or others) or touch or gestures.

In some embodiments, the above-mentioned display device 200 may be: a television, a mobile phone, a computer, a learning machine, and the like.

As shown in Figure 4, Figure 4 is a schematic diagram of the software configuration in the display device 200 according to one or more embodiments of the present application. As shown in Figure 4, the system is divided into four layers, from top to bottom are the Applications (Applications) layer (referred to as "the application layer"), the application framework (Application Framework) layer (referred to as the "framework layer"), the Android runtime (Android runtime) and the system library layer (referred to as the "system runtime layer"), and the kernel layer. The kernel layer includes at least one of the following drivers: audio driver, display driver, bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver.

In some embodiments, as shown in FIG. 5 , the application layer includes at least one application that can display corresponding icon controls on the display, such as: live TV application icon controls, video-on-demand application icon controls, media center application icon controls, application center icon controls, game application icon controls, and the like.

The method for split-screen display and split-screen application switching provided in the embodiments of the present application may be implemented based on the above display device, or based on a functional module or functional entity in the display device that can implement the method for split-screen display and split-screen application switching.

The following firstly introduces a display device and a split-screen display method provided in the embodiments of the present application.

Since currently in the display device, the application program in the foreground is limited to one, when the user needs to operate two application programs in the foreground at the same time, such a scenario causes some inconvenience to the user.

In order to facilitate simultaneous operations on two application programs in the foreground, in some embodiments, the software system of the display device supports split-screen display. However, in some cases, some applications installed on the display device do not support split-screen display, and the software system of the display device cannot know whether the application supports split-screen display. Triggered by user operations, when the software system of the display device directly controls the split-screen display of the application program, the interface of the application program may not be displayed normally.

In some embodiments, the split-screen display method provided in the embodiment of the present application can be applied to display devices such as mobile phones and televisions. The split-screen display method provided in the embodiment of the present application is different from the split-screen display method currently used on smart devices. For example, the split-screen display method provided in the embodiment of the present application is different from the current mobile phone that displays two different application interfaces in a split-screen display. Half of the content of each application interface is displayed up and down, mainly including but not limited to the following aspects:

(1) At present, when triggering the split-screen display function in the mobile phone, the user uses the split-screen application of the mobile phone to trigger the split-screen display usually through gestures, but usually the user does not touch the screen directly on devices such as TVs. Therefore, in the embodiment of the present application, based on the user's usage habits of using display devices such as TVs, a split-screen control for triggering split-screen display and a full-screen control for triggering full-screen display are set to be presented through the split-screen application. It should be noted that the split-screen application mentioned in the embodiment of the present application refers to a functional service in the display device software system, not an application program. The split-screen application can be set in the application framework layer in the software system, and the corresponding interface of the split-screen application can be set in the application layer to present interface display controls such as frequency division controls and full-screen controls.

(2) At present, in the process of switching an interface from full-screen display to split-screen display in mobile phones, only the screen area is displayed in partitions, but there is no need to redraw the interface, only part of the content of the interface is displayed. Taking the average split screen as two display areas as an example, in the process of switching an interface from full-screen display to split-screen display, half of the interface can be displayed in one of the display areas. However, in the embodiment of the present application, in the process of switching an interface from full-screen display to split-screen display, it is necessary to redraw the interface based on the size of the split-screen window corresponding to the split-screen area before displaying the interface in the corresponding split-screen area.

(3) At present, in the process of switching from the split-screen mode in which the interfaces of two different applications are displayed on a split screen to the full-screen mode in which one of the application interfaces is displayed in full screen, the mobile phone needs to exit one application before triggering another application to switch to full-screen display. However, in the embodiment of the present application, the full-screen control of the corresponding application interface in the display area can be controlled to directly display in full screen in the display area. The interaction method is more concise and convenient, and the human-computer interaction performance is better.

(4) Since the split-screen display method provided in the embodiment of the present application involves redrawing of the display interface, it is necessary to judge whether the entire application program supports split-screen before performing split-screen display. However, for the current split-screen display supported by mobile phones, there is no need to judge the application. When split-screen display is performed, only the activity (activity) is judged, that is to say, only whether the current interface supports split-screen can be supported.

It should be noted that the above-mentioned mobile phones and televisions are exemplary descriptions, and the split-screen display method provided in the embodiment of the present application can be applied to any display device.

An embodiment of the present application provides a display device. As shown in FIG. 3 , the display device 200 includes: a user input interface 280 configured to: receive user input; a display 260 configured to: display an image and/or interface; a controller 250 configured to: respond to receiving a start input for the first application through the user input interface, draw the interface of the first application according to the full-screen window size during full-screen display, and control the display 260 to display the interface of the first application in full screen; Split-screen display; in response to receiving the first input for the split-screen control through the user input interface 208, determine the size of the first split-screen window corresponding to the first split-screen area, redraw the interface of the first application according to the size of the first split-screen window, and determine the size of the second split-screen window corresponding to the second split-screen area, draw the application selection interface according to the size of the second split-screen window, and control the display 260 to display the interface of the first application in the first split-screen area, and display the application selection interface in the second split-screen area; Apps displayed.

An embodiment of the present application provides a split-screen display method for a display device. After the interface of the first application is displayed in full screen, when it is detected that the first application supports split-screen display, the split-screen control will be displayed on the upper layer of the interface of the first application. In this way, when the user triggers the split-screen display of the first application through the first input for the split-screen control, since it has been detected in advance that the first application supports split-screen display, the display device can redraw the interface of the first application in the split-screen display state according to the window size corresponding to the split-screen area during the split-screen display during the split-screen display, and The application selection interface can ensure that the interface of the first application is normally displayed.

As shown in FIG. 6, it is a schematic flowchart of a split-screen display method for a display device provided in an embodiment of the present application, and the method includes:

501. Receive a start input for a first application.

In this embodiment of the present application, various inputs involved (for example, startup input, first input, second input, third input, etc.) may be the user's click input on the first application's logo, or the user's voice input.

Wherein, the identifier of the first application may be an icon of the first application, or other controls that may represent the first application. The identification of the application involved in the following can also be understood similarly.

In the embodiment of the present application, the click input may include a single click input or a double click input, and the click input may be a finger click input, a mouse click input, or a click input sent by a remote control or a mobile phone.

502. In response to the start input, draw the interface of the first application according to the full-screen window size when the display of the display device is in full-screen display, and display the interface of the first application in full screen.

Exemplarily, as shown in FIG. 7 , it is a schematic diagram of an interface of a display device provided in the embodiment of the present application. After the user activates the application 1 by starting the input, an interface 61 of the application 1 is displayed. In FIG. 7 , the interface 61 of the application 1 is displayed in a full-screen display mode.

503. When it is detected that the first application supports split-screen display, display a split-screen control on the upper layer of the interface of the first application.

It can be understood that the split-screen control may be an interface display control in the interface of the split-screen application, and the interface of the first application and the interface display of the split-screen application are in different layers, wherein the layer where the interface of the split-screen application is located is above the layer where the interface of the first application is located.

In some embodiments, when the interface of the first application is currently displayed in a full-screen manner, the split-screen control in the interface of the split-screen application can respond to input, and the full-screen control cannot respond to input. Exemplarily, in this case, the split-screen control can be highlighted, and the full-screen control can be grayed out.

In some embodiments, when the interface of the first application is currently displayed in full-screen mode, only the split-screen control may be displayed in the interface of the split-screen application, and the full-screen control may not be displayed, so that in this case, only the split-screen function corresponding to the split-screen control may be responded.

Exemplarily, with reference to FIG. 7 , as shown in FIG. 8 , it is a second schematic diagram of an interface of a display device provided by the embodiment of the present application. When it is detected that the application 1 supports split-screen display, as shown in FIG. 8 , start the interface 60 of the split-screen application. In this embodiment of the application, detecting whether an application supports split-screen display may include multiple methods:

Method 1, if the target whitelist includes the identifier of the first application, then determine that the first application supports split-screen display, and control the display to display a split-screen control on the upper layer of the interface of the first application, wherein the target whitelist is used to store the identifiers of all applications that support split-screen display.

In this embodiment, the identifiers of all applications that support split-screen can be added to the target whitelist. When the first application is started, the list of application identifiers in the target whitelist is traversed to determine whether the identifier of the started first application is in the target whitelist. If the identifier of the first application is in the target whitelist, it can be determined that the first application supports split-screen display; if the identifier of the first application is not in the target whitelist, it can be determined that the first application does not support split-screen display.

Method 2: Obtain the attribute information of the first application; if the attribute information of the first application includes a target attribute value, then determine that the first application supports split-screen display, and control the display to display a split-screen control on the upper layer of the interface of the first application, wherein the target attribute value is used to indicate that the first application supports split-screen display.

In this embodiment, a target attribute may be added to each application, and the target attribute is used to describe whether the application supports split-screen display. By adding an attribute value of the target attribute to each application, and setting the attribute value of the target attribute to the above-mentioned target attribute value, it is used to indicate that the first application supports split-screen display, wherein the target attribute value may be a true value.

504. Receive a first input, where the first input is an input for a split-screen control.

505. In response to the first input, determine the size of the first split-screen window corresponding to the first split-screen area, redraw the interface of the first application according to the size of the first split-screen window, and determine the size of the second split-screen window corresponding to the second split-screen area, draw an application selection interface according to the size of the second split-screen window, display the interface of the first application in the first split-screen area, and display the application selection interface in the second split-screen area, wherein the application selection interface includes at least one identifier, and the at least one identifier is used to identify at least one application that supports split-screen display.

In this embodiment of the present application, after responding to the first input, the interface of the first application originally displayed in full screen needs to be narrowed down and displayed in the first split-screen area. At this time, the interface of the first application will be redrawn according to the size of the first split-screen window corresponding to the first split-screen area, and the redrawn interface of the first application will be displayed in the first split-screen area. Correspondingly, the application selection interface can be drawn based on the size of the second split-screen window corresponding to the second split-screen area, so that the interface of the first application can be displayed in the first split-screen area, and the application selection interface can be displayed in the second split-screen area. , so as to achieve split-screen display.

As shown in Figure 9, an interface diagram of the display device provided by the embodiments of this application. After clicking the input on the division control 62, the two division areas shown in Figure 9 will be displayed. The first sub -screen area 63 and the second sub -screen area 64. Among them, the interface 61 of the original full screen display application 1 is displayed in the first sub -screen area 63, and the application selection interface 65 is displayed in the second sub -screen area. This The interface includes the logo of 3 applications, which are "Application 2", "Application 3" and "Application 4" in Figure 9.

In this embodiment of the application, after the interface of the first application is displayed in full screen, when it is detected that the first application supports split-screen display, the split-screen control will be displayed on the upper layer of the interface of the first application. In this way, when the user triggers the split-screen display of the first application through the first input for the split-screen control, since the first application has been detected in advance to support split-screen display, the display device can redraw the interface of the first application in the split-screen display state and the application selection interface according to the window size corresponding to the split-screen area during split-screen display during split-screen display, so as to ensure normal display. The interface of the first application.

In some embodiments, after the interface of the first application is displayed in full screen, the split-screen control will be displayed on the interface of the first application only when it is detected that the first application supports split-screen display, and there are other applications that support split-screen display. In this way, when the user triggers the split-screen display of the first application through the first input, the interface of the first application can be displayed in a split-screen area, and other applications that support split-screen display can be selected for display in another area, so as to avoid the situation where only the first application supports split-screen display in the display device. The interface of other applications may not be displayed in the screen area, further improving the performance of human-computer interaction.

In some embodiments, a border control may be displayed between the first split-screen area and the second split-screen area, and when a drag input for the border control is received, in response to the drag input, re-determine the size of the first split-screen window, and re-determine the size of the second split-screen window.

The above-mentioned boundary control can be displayed in the form of a dividing line. The user can control and drag the dividing line to move by dragging the above-mentioned dividing line to change the size distribution of the first split-screen area and the second split-screen area. After dragging the dividing line each time, it is necessary to re-determine the window size corresponding to the split-screen area and redraw the interface. Exemplarily, as shown by the dividing line 81 in FIG. 9 , dragging the dividing line 81 may trigger changing the sizes of the first split screen area 61 and the second split screen area 65 .

The above-mentioned setting method of the border control can facilitate the user to randomly adjust the size of the two split-screen regions during the split-screen display, making the split-screen display method more flexible.

In the embodiment of the present application, as shown in FIG. 10 , it is a flow chart of an implementation method for switching from full-screen display to split-screen display provided in the embodiment of the present application. In response to the first input, the interface of the first application is displayed in the first split-screen area, and the implementation process of displaying the application selection interface in the second split-screen area may include steps 901 to 905:

901. In response to a first input, switch a full-screen stack to a split-screen stack.

In the case of responding to the first input, it is first necessary to switch the full-screen stack (full-screen Stack) to the split-screen stack (Docked Stack), and call the delay screen layout function in the software system to notify the window management service (WindowManagerService) to suspend the layout.

902. Acquire the size of the first split-screen window and the size of the second split-screen window correspondingly set by the split-screen stack.

903. Acquire interface data corresponding to the first input, and store it in an activity stack corresponding to the split-screen stack, where the interface data includes: data of the interface of the first application and data of the application selection interface.

In the embodiment of the present application, the task record (TaskRecord) to be split-screen can be put into the activity stack (ActivityStack) where the split-screen stack identifier (DOCKED_STACK_ID) is located through the activity management service (ActvivityManagerService) in the software system, that is, the interface data is stored in the corresponding activity stack of the split-screen stack. They are all arranged in the frame layer as shown in FIG. 4 .

904. Read interface data from the activity stack, draw the interface of the first application according to the size of the first split-screen window, and draw an application selection interface according to the size of the second split-screen window.

After obtaining the size of the first split-screen area and the second split-screen window of the split-screen display, the interface boundary of the interface in the first split-screen area and the second split-screen area can be determined, and the interface of the first application is redrawn corresponding to the first split-screen area, and the application selection interface is drawn corresponding to the second split-screen area.

905. Display the interface of the first application in the first split-screen area, and display the application selection interface in the second split-screen area.

506. Receive a second input, where the second input is an input for the identification of the second application.

507. In response to the second input, update and display the application selection interface as an interface of a second application, where the second application is one of at least one application that supports split-screen display.

Exemplarily, as shown in FIG. 11 , there are two split-screen areas on the display screen, a first split-screen area 63 and a second split-screen area 64, wherein the first split-screen area 63 displays an interface 61 of application 1, and the second split-screen area displays an application selection interface 65, which includes 3 application identifiers, namely "application 2", "application 3" and "application 4" in Fig. 9 . After receiving a click input for application 2 , the application selection interface 65 may be updated and displayed as an interface 66 of application 2 .

In the embodiment of the present application, when an application interface is displayed in a split-screen area, the identifiers of one or more applications that support split-screen display can be further displayed in another split-screen area, so that the user can select other applications that can support split-screen display to be displayed in the other split-screen area, thereby improving the performance of human-computer interaction.

508. Display the full-screen control on the upper layer of the target split-screen area, where the target split-screen area is the first split-screen area or the second split-screen area.

509. Receive a third input.

In the embodiment of the present application, the above third input is used to instruct the display device to display the target interface in full screen.

510. In response to the third input, redraw the target interface according to the size of the full-screen window, and display the redrawn target interface in full screen, wherein the third input is an input for the full-screen control, and the target interface is an interface displayed in the target split-screen area.

In the embodiment of the present application, when step 510 is executed, in response to the third input, the target interface is displayed in full screen, wherein the interface of the split-screen application may include a split-screen control and a full-screen control.

In some embodiments, when currently displayed in a split-screen display mode, the split-screen control in the interface of the split-screen application displayed on the upper layer of each split-screen area cannot respond to input, but the full-screen control can respond to input.

In some other embodiments, in the case of current display in a split-screen display mode, the interface of the split-screen application displayed on the upper layer of each split-screen area only includes full-screen controls, and does not display the split-screen controls, so that in this case, only the full-screen display function corresponding to the full-screen controls is responded.

During split-screen display, there are two split-screen areas. When an input for the full-screen control displayed on the first split-screen area is received, the content displayed in the second split-screen area can be canceled, and the interface displayed in the first split-screen area can be redrawn based on the window size in full-screen display, and the redrawn interface can be displayed in full screen.

In the split-screen display interface as shown in FIG. 9 , it is assumed that after receiving the input of the split-screen control on the upper layer of the interface 61 of the first application, the display 65 can be canceled, and after the interface of the first application is redrawn based on the window size of the full-screen display, the interface of the first application can be displayed in full screen.

As shown in FIG. 11 , when the first application and the second application are displayed on a split screen, it is assumed that after receiving the input of the split-screen control on the upper layer of the interface 61 of the first application, the display 66 can be canceled, the application 2 can be switched from the foreground to the background, the second application is run in the background, and the interface of the first application is redrawn based on the window size of the full-screen display, and the interface of the first application is displayed in full screen.

As shown in FIG. 12 , a split-screen interface 60 is displayed on the interface 61 of the application 1, and there is a full-screen control 67 in the split-screen interface 60, and a split-screen interface 60 is also displayed on the interface 66 of the application 2, and there is a full-screen control 67 in the split-screen interface 60. Then, after clicking and inputting the full-screen control 67 displayed on the interface 61 of the application 1, the interface 61 of the application 1 can be switched to a full-screen display.

In some embodiments, if there are full-screen controls in both the first split-screen area and the second split-screen area, if a click input for the full-screen control is received in the first split-screen area, then trigger full-screen display of the interface of the first application displayed in the first split-screen area;

In the embodiment of the present application, by displaying the full-screen control and the split-screen control, the interface can be quickly and conveniently switched between full-screen display and split-screen display, thereby improving the performance of human-computer interaction.

In the embodiment of the present application, as shown in FIG. 13 , it is a flow chart of an implementation method for switching from split-screen display to full-screen display provided in the embodiment of the present application. In response to the third input, the implementation process of displaying the target interface in full screen may include the following steps 1201 to 1204:

1201. In response to a third input, switch the split-screen stack to a full-screen stack, so as to obtain a full-screen window size set corresponding to the full-screen stack.

1202. Store the data of the target interface corresponding to the third input into the activity stack corresponding to the full screen stack.

1203. Read the data of the target interface from the activity stack, and draw the target interface according to the size of the full-screen window.

1204. Display the target interface in full screen.

When the software system of the display device needs to switch to full-screen display during the split-screen display process, it will first send a broadcast message carrying the maximum parameter (primary_maximize) to the platform module through the application layer. When the platform module learns that it needs to switch to full-screen display, the platform module will determine which interface displayed in the split-screen area is to be maximized for full-screen display according to the carried maximize parameter, and start the corresponding application through method calls, and re-determine the window size for the current activity (activity), and redraw the full-screen interface. When the software system is an Android operating system, the platform module is set in the frame layer as shown in FIG. 4 .

After the above split-screen display method is introduced, the display device provided in the embodiment of the present application may also execute a split-screen application switching method. In some embodiments, in order to facilitate operations on two application programs in the foreground at the same time, the display device can present split-screen images of multiple applications, so as to achieve the purpose of simultaneously displaying and processing multiple tasks. The user can sequentially start different applications to be displayed in different areas of the display device, and the method of split-screen display is referred to as entering the split-screen mode for short.

The present application relates to a display device controller, which is further configured to: in response to receiving a startup input instruction for the first application through the user input interface, draw the interface of the first application according to the size of the full-screen window in full-screen display, and control the display to display the interface of the first application in full screen; and control the display to display a split-screen control on the upper layer of the interface of the first application, wherein the first application supports split-screen display; in response to receiving a first input for the split-screen control through the user input interface, determine the size of the first split-screen window corresponding to the first split-screen area, and redraw the first application according to the size of the first split-screen window The interface, and determining the size of the second split-screen window corresponding to the second split-screen area, drawing an application selection interface according to the size of the second split-screen window, and controlling the display to display the interface of the first application in the first split-screen area, and display the application selection interface in the second split-screen area; wherein, the application selection interface includes at least one logo, and the at least one logo is used to identify at least one application that supports split-screen display.

When it is necessary to switch the split-screen application in the split-screen mode, the application displayed in the area is usually retreated to the background, enter the application list and select an application again, so that the re-selected application is displayed in the corresponding area, and the split-screen application switching is completed, but the whole process is relatively cumbersome. In some embodiments, the convenience of operation is improved by configuring a function of quickly switching split-screen applications in the display device.

After the function of quickly switching split-screen applications in the display device is activated, in the split-screen mode, if the user wants to switch the split-screen applications in one or more display areas in the split-screen mode, the user only needs to call up the pre-established split-screen application list, select the split-screen application to be switched in the split-screen application list, and then quickly switch the split-screen application. Through the above means, the user can complete the switching of the split-screen application without returning the application in the split-screen mode to the background and entering the application list to select the application to be switched, which improves the convenience of operation and improves the user experience.

As shown in FIG. 3 , in order to facilitate users to quickly switch split-screen applications, a display device 200 provided in an embodiment of the present application includes a display 260 and a controller 250, wherein the controller 250 is connected to the display 260 and is configured to perform a process of switching split-screen applications. The display is also configured to: present a display interface. When the user interacts with the display device, the generated interactive interfaces are all displayed on the display; the display includes different areas, and after entering the split-screen mode, different display interfaces can be presented in different areas.

In some embodiments, the display includes a main screen area and a secondary screen area, and the user can present the screen of application A on the main screen area and the screen of application B on the secondary screen area, wherein the primary screen area and the secondary screen area do not overlap. Unless otherwise specified, the steps performed by the display device in the following embodiments can be understood as being performed by the controller 250 or by the controller 250 or by the controller 250 in cooperation with other components of the display device 200 .

In some embodiments, in the split-screen mode of the display device, that is, in the split-screen display state of the display, the user can use the function of quickly switching split-screen applications to perform split-screen application switching operations.

In a display device provided by an embodiment of the present application, a controller connected to the display and a control device executes a split-screen application switching method. FIG. 14 is a flowchart of a split-screen application switching method in some embodiments; FIG. 15 is a schematic diagram of an interactive interface of a display in a split-screen mode in some embodiments. As shown in Figures 6 and 7, specifically, the controller is further configured to perform the following steps:

1401. Respond to a first instruction, and acquire a split-screen application combination list.

The controller 250 may receive the first instruction sent by the user, wherein the first instruction is an instruction to switch the split-screen application received by the display device under split-screen display on the display, and the controller 250 may directly accept the instruction to switch the split-screen application input by the user through the user input/output interface of the display device 200, or may accept the instruction to switch the split-screen application sent by the user through other devices (such as a mobile phone or a remote controller).

The present application does not limit the manner or approach for the controller 250 to obtain the instruction to switch the split-screen application. For example, the user may press a key designated by the remote control, and the remote control may send a corresponding command to switch the split-screen application to the display device; or, the user may output a voice command to switch the split-screen application to the display device, for example, the user may output the voice "switch the split-screen application" to the display device.

When the user needs to switch the split-screen application in the split-screen mode, the user must first start the quick switching split-screen application function. The quick switching split-screen application function is configured in the system setting menu of the display device and supports two control methods: manual setting and intelligent automatic setting.

The user triggers the confirmation start entry through the remote control, and a confirmation command will be generated, indicating that the user wants to start the fast switching split-screen application function. At this time, the controller cancels the display function effect display interface on the display according to the confirmation instruction, and enables the fast switching split-screen application function of the display device.

In some embodiments, the user can search for the function of quickly switching split-screen applications in the system setting menu by triggering the selection button in the control device, and call the entry interface of quickly switching split-screen applications through the system setting menu presented on the system interface.

In some embodiments, a one-key start button can be set on the control device, and the key value of the one-key start button can be mapped and associated with the entry of the fast switching split-screen application in the system setting menu, so that when the user triggers the one-key start button once, the interface for quickly switching the entry of the split-screen application can be directly called out.

In some embodiments, the user can set the quick switching split-screen application function in the system setting menu to start automatically when the display device is turned on by triggering the selection button in the control device, so that the user does not need to call out and start the function through the button, realizing the smart start of the quick switching split-screen application function and improving user experience.

When the fast switching split-screen application function is activated, an entry interface for calling the fast switching split-screen application is presented on the display interface of the display. Then the controller obtains a split-screen application combination list, wherein the split-screen application combination list includes all multiple candidate split-screen application combinations, and each candidate split-screen application combination includes a main-screen application and a secondary-screen application.

In some embodiments, if the user uses the function of quickly switching split-screen applications for the first time, the controller needs to first create a split-screen application combination list. FIG. 16 is a flowchart of a method for the controller to create a split-screen application combination list in some embodiments. As shown in FIG. 16 , the controller is further configured to perform the following steps during the process of obtaining a combined list of split-screen applications in response to the request for switching split-screen applications:

1601. Obtain all applications that support split screen, and obtain the package name and startup page of each application that supports split screen.

1602. Combine all split-screen applications in pairs to obtain a plurality of candidate split-screen application combinations with package names and startup pages recorded.

1603. Combine multiple candidate split-screen application combinations combined in pairs into a split-screen application combination list.

In some embodiments, the controller first obtains all split-screen applications in the system, records the package name package and the startup page launcher of each split-screen application, and combines all the split-screen applications in pairs to obtain multiple candidate split-screen application combinations. Each candidate split-screen application combination includes a main screen application and a secondary screen application.

For example, suppose a device split screen application composition is as follows:

Alternative split-screen application combination 1{(package ₁ ,launcher ₁ ),(package ₂ ,launcher ₂ )};

Alternative split-screen application combination 2{(package ₁ ,launcher ₁ ),(package ₃ ,launcher ₃ )};

…

Alternative split-screen app combinations n{(package _x ,launcher _x ),(package _y ,launcher _y )}.

The first application in each candidate split-screen application combination is recorded as the main screen application, and the last application is recorded as the secondary screen application. The main screen application is presented in the main screen area of the display, and the secondary screen application is presented in the secondary screen area of the display.

In some embodiments, the candidate split-screen application combination includes a main-screen application and a secondary-screen application. Since the combination is random, the candidate split-screen application combination may appear as follows:

Alternative split-screen application combination 35 {(package ₂₁ , launcher ₂₁ ), (package ₁₅ , launcher ₁₅ )};

Alternative split-screen application combination 46 {(package ₁₅ , launcher ₁₅ , (package ₂₁ , launcher ₂₁ )};

That is, there are application (APP) 21 and application (APP) 15 in the alternative split-screen application combinations 35 and 46, but since the main screen application of the alternative split-screen application combination 35 is APP 21 and the secondary screen application is APP 15, and the main screen application of the alternative split-screen application combination 46 is APP 15, and the secondary screen application is APP 21; Not the same as 46, independent of each other.

Save all obtained candidate split-screen application combinations, and use the two package names in each combination as the unique identifier C of the combination. Record the combination names, package names, page names, screenshots, and split-screen ratios of all candidate split-screen application combinations to obtain a split-screen application combination list. Since the list of split-screen application combinations is created for the first time, there are no screenshots for the time being, and the application icons are used instead of screenshots, which will be replaced after subsequent use. Since the split-screen application combination list is established for the first time, the split-screen ratio ratio is recorded as a default value (for example, 0.5), and the two applications in each candidate split-screen application combination occupy 1/2 screen space respectively. Table 1 is a list of split-screen application combinations established in some embodiments.

Table 1

In some embodiments, if the user initiates the display device's request to switch split-screen applications for the second or subsequent times, the controller directly acquires the stored split-screen application combination list.

In the embodiment of the present application, the controller further executes the next step after calling out the split-screen application combination list in response to the first instruction:

1402. Present the split-screen application combination list on the display.

In the embodiment of the present application, after the function of quickly switching split-screen applications of the display device is enabled, a list of split-screen application combinations is displayed on the display, that is, after the controller responds to the request for switching split-screen applications, the list of split-screen application combinations is called out and displayed on the display. The user can select an alternative split-screen application combination to switch from the list of split-screen application combinations according to his own needs.

In some embodiments, the candidate split-screen application combinations in the split-screen application combination list are sorted according to usage time and generation time, wherein the usage time has priority over generation time.

For example, assume that the obtained combination list of split-screen applications is as follows:

Combination C1 (APP 12, APP 5) is {(package ₁₂ , launcher ₁₂ ), (package ₅ , launcher ₅ )}, and the generation time is December 1, 2020;

Combination C2 (APP 21, APP 25) is {(package ₂₁ , launcher ₂₁ ), (package ₂₅ , launcher ₂₅ )}, and the generation time is November 10, 2020;

Combination C3 (APP 1, APP 5) is {(package ₁ , launcher ₁ ), (package ₅ , launcher ₅ )}, and the generation time is December 1, 2020;

The combination C4 (APP 11, APP 7) is {(package ₁₁ , launcher ₁₁ ), (package ₇ , launcher ₇ )}, and the generation time is November 10, 2020;

The use time of combination C1 is 1 hour, the use time of combination C2 is 0 hours, the use time of combination C3 is 10 hours, and the use time of combination C4 is 1 hour.

Then, based on the length of use and time ordering, the order of combination C3 is higher than that of C1, C2 and C4. Since the use time of combination C4 and combination C1 is the same, but the generation time of combination C4 is earlier than that of combination C1, the final order is: C3, C4, C1, C2.

It should be noted that, in practical applications, the split-screen application combinations in the split-screen combination list may be sorted according to the user's preference, so as to improve user experience.

In the embodiment of the present application, the controller executes the next step after performing step 1402 to present the split-screen application combination list on the display:

1403. In response to the first split-screen application combination selection instruction, present the main-screen application in the selected split-screen application combination on the main screen area of the display, and present the secondary-screen application in the selected split-screen application combination in the secondary screen area of the display.

In this embodiment of the application, after the user selects a split-screen application combination through the remote controller, the remote controller sends a first split-screen application combination selection command, wherein the selected split-screen application combination is any one of the candidate split-screen application combinations in the split-screen application combination list.

In response to the split-screen application combination selection instruction, the controller presents the selected split-screen application combination in a corresponding area of the display, that is, the main-screen application in the selected split-screen application combination is presented in the main screen area of the display, and the secondary-screen application in the selected split-screen application combination is presented in the secondary screen area of the display.

In order for the display device to present selected split-screen application combinations in the corresponding area of the display, as shown in FIG. 17 , in a display device provided by an embodiment of the present application, when executing the split-screen application switching method, when step 1403 is executed, its controller is configured to execute the following steps:

1701. Determine whether the main-screen application and the secondary-screen application in the selected split-screen application combination are started.

1702. If both the main screen application and the secondary screen application have been started, start the main screen application in the main screen area and the secondary screen application in the secondary screen area, adjust the occupied space of the main screen and the secondary screen in the split screen according to the split screen ratio in the split screen application combination list; and present the main screen and the secondary screen in the form of split screens on the display.

In the embodiment of the present application, after the controller responds to the split-screen application combination selection instruction, it first retreats the main-screen application and the secondary-screen application corresponding to the current main-screen area and the secondary-screen area to the background, and then, the controller needs to determine whether the main-screen application and the secondary-screen application in the split-screen application combination selected by the user are activated. If the main screen application and the secondary screen application in the selected split-screen application combination have been started, the main screen application is started in the main screen area, and the secondary screen application is started in the secondary screen area; the controller adjusts the occupied space of the main screen and the secondary screen according to the split screen ratio recorded in the split-screen application combination list, and regains the display space of the two applications to be started. Finally, the main screen interface and the secondary screen interface are presented on the display in the form of split screens.

In some embodiments, in the split-screen mode of the display device, the main screen area and the secondary screen area of the display respectively occupy 1/2 area of the whole screen by default. When the screen is in the horizontal direction (that is, when the split-screen mode is displayed in a horizontal screen), the left and right 1/2 of the main and auxiliary screens are arranged; In practical applications, the space occupied by the main and secondary screens can also be calculated according to the screen size.

1703. If the main screen application and/or the secondary screen application have been started, according to the package name and startup page corresponding to the main screen application and/or the secondary screen application, the main screen application is brought back to the foreground display, and the display space of the main screen application is obtained.

1704. If the main screen application and/or the secondary screen application are not started, use the Activity Manager to cold start the main screen application and/or the secondary screen application and display them in the foreground, and obtain the display space of the main screen application and/or the secondary screen application.

In the embodiment of the present application, when step 1703 is executed, the controller first determines whether the main screen application is activated in the process of determining whether the main screen application and the secondary screen application in the selected application combination are activated.

For example: the user selects a combination of split-screen applications as C7 (APP 25, APP 16), where APP 25 is the main screen application and APP 16 is the secondary screen application.

Then, the controller first judges whether APP 25 is started. If APP 25 has been started, then the Activity Manager pulls APP 25 back to the foreground and displays it in the current main screen area according to the package name package corresponding to APP 25 and the startup page launcher; then, the controller continues to judge whether APP 16 is started. If APP 16 is not started, the controller cold starts APP 16 through the Activity Manager and displays it in the secondary screen area.

After the main screen application and the secondary screen application in the selected application combination are displayed in the main screen area and the secondary screen area respectively, the controller calculates the display space of the main screen area and the secondary screen area.

In the embodiment of this application, the display space of the main screen area and the secondary screen area can be calculated as follows:

1) When the split-screen mode is displayed in horizontal screen, main screen width = screen width * ratio, secondary screen width = screen width * (1-ratio), main screen height = secondary screen height = screen height;

2) When the split screen mode is displayed in portrait mode, main screen height = screen height * ratio, secondary screen height = screen height * (1-ratio), main screen width = secondary screen width = screen width.

Wherein, the split-screen ratio ratio can be a default value (for example, 0.5), and can also be modified according to the actual needs of the user, and when the ratio in a candidate split-screen application combination is modified, the controller will update the modified ratio in real time, and when the candidate split-screen application combination is selected again, the updated ratio shall prevail to facilitate user experience.

After calculating the display space of the main screen area and the auxiliary screen area, the controller adjusts the occupied space of the main screen and the auxiliary screen in the split screen, presents the main screen interface and the auxiliary screen interface on the display in the form of split screens, and completes the rapid switching of split screen applications.

In some embodiments, the controller can obtain the application that supports split-screen in the following two ways:

Method 1, obtain it through the configuration items in the split-screen application's own configuration file:

All applications that support split-screen have a configuration item metadata attached to their configuration file manifest. When the controller filters all applications, the configuration item metadata can be used to filter the applications that support split-screen.

Method 2, filter according to the whitelist of applications that support split screen preset by the controller:

The controller itself presets a white list of applications that support split screens. When obtaining applications that support split screens, the controller reads the preset white list, sequentially determines whether the corresponding applications on the list are installed, and filters out applications that support split screens.

In the specific implementation, the controller filters and screens the applications that support split screen, obtains the package name package that supports the split screen application, and obtains the corresponding application startup page launcher through the PackageManager, records the package name package that supports the split screen application and the startup page launcher, and creates a split screen application combination list based on the screenshot and the split screen ratio.

In the display device in the embodiment of the present application, after the function of quickly switching split-screen applications is enabled, the controller monitors whether there is a page change in the display interface of the split-screen mode displayed in the foreground, as shown in FIG.

1801. Monitor whether there is page switching or jumping in the main screen application and/or secondary screen application of the display interface;

1802. When there is page switching or jumping in the main screen application and/or the secondary screen application, judge whether the new page to be switched or jumped supports split screen, if so, perform step 1803, otherwise, perform step 1804;

1803. If the switched or redirected new page application supports split screens, take a screenshot of the changed display screen to generate a screenshot image, and obtain the first split-screen application combination according to the package name of the main-screen application and/or the secondary-screen application after the page change; compare the first split-screen application combination with all alternative split-screen application combinations in the split-screen application list; The screen picture is updated to the split-screen application combination list; if the first split-screen application combination is inconsistent with all the alternative split-screen application combinations in the split-screen application combination list, save the first split-screen application combination to the split-screen application combination list.

In some embodiments, after the function of quickly switching split-screen applications is enabled, the controller starts to monitor through the ActivityManager whether the pages of the display interface displayed in the split-screen mode in the foreground have changed, wherein the page changes include page switching, page jumping, and jumping between applications.

In practical applications, whether the page of the display interface in split-screen mode changes can be the page change of the main screen application, the page change of the secondary screen application, or the page change of both the main screen application and the secondary screen application. When any of the above page changes occurs, it is necessary to determine whether the new page to be switched or jumped supports split screen.

In some embodiments, if the new page to be switched or jumped supports split-screen, take a screenshot of the display screen after the page change to generate a screenshot picture screencap _n+1 , wherein the screenshot picture will be displayed in the split-screen record, which is convenient for the user to identify the current split-screen application. At the same time, record the current split screen ratio ratio _n+1 . The changed main screen package _i+1 and secondary screen package _j+1 in the split-screen mode are used as an identifier c _n+1 to obtain the first split-screen application combination c _n+1 {(package _i+1 , launcher _i+1 ), (package _j+1 , launcher _j+1 )}.

Then, compare the newly generated first split-screen application combination c _n+1 with all candidate split-screen application combinations in the split-screen application combination list.

In some embodiments, if the first split-screen application combination is consistent with a certain split-screen application combination in the split-screen application combination list, it is considered to be a page update in the original candidate split-screen application combination, and the main screen application changed page launcher _i+1Update to the original logo (such as C _{twenty two}) in the corresponding combination information, and the page launcher that changes the application of the secondary screen _j+1Update to the original logo (such as C _{twenty two}) in the corresponding combination information; change and synchronously update the candidate split-screen application combination in the split-screen application combination list, and the changed combination C _{twenty two}for {(package ₁₀, launcher _i+1), (package ₂₀, launcher _j+1)}, the updated split-screen application combination list is shown in Table 2.

Table 2

In some other embodiments, if the first split-screen application combination is inconsistent with all the split-screen application combinations in the split-screen application combination list, that is, the first split-screen application combination does not match all the candidate split-screen application combinations in the split-screen application list, then the first split-screen application combination is considered to be a new split-screen combination, and the first split-screen application combination is saved in the combination record to generate a new candidate split-screen application combination C _n+1 {(package _i+1 , launcher _i+1 ), (package _j+1 , launcher _j+1 )}, and record the newly generated candidate split-screen application combination C _n+1 in the split-screen application list. The updated split-screen application list is shown in Table 3.

table 3

1804. If the new page to be switched or jumped to does not support split-screen, the controller turns off the split-screen mode, uses the entire screen as the display space of the switched or jumped page through the ActivityManager, and retreats another split-screen application to the background.

In the state shown in Figure 19, the display enters the split-screen mode, a browser application A is displayed in the main screen area, and an office software B is displayed in the secondary screen area. The user browses webpages in the main screen area and consults documents in the secondary screen area.

For example, in the state shown in FIG. 20 , when the browser application A browses a new webpage in the main screen area, page switching occurs.

Since the changed page of the main screen application A also supports the split-screen mode, the controller takes a screenshot of the changed entire screen (the main screen area and the secondary screen area) to obtain a picture m, and constructs the combination of the first split-screen application according to the package names of the application A and application B.

Then, compare the combination with the split-screen application combination list.

Since the candidate split-screen application combination C3 in the split-screen application list is the same as the first split-screen application combination, the controller only updates the page of application A and the screenshot of the application. The split-screen list before the update is shown in FIG. 21 , and the updated split-screen application list is shown in FIG. 22 .

For another example, in the state shown in FIG. 23 , when browser application A browses a new web page in the main screen area, an application jump occurs. As shown in FIG. 24 , application A jumps to application C.

Since the application C after the change of the main screen application A also supports the split-screen mode, the controller takes a screenshot of the changed entire screen (the main screen area and the secondary screen area) to obtain the picture n, and constructs the first split-screen application combination according to the package names of the application C and the application B.

Then, compare the combination with the split-screen application combination list.

Since none of the candidate split-screen application combinations in the split-screen application list completely matches the first split-screen application combination, the first split-screen application combination is a new split-screen combination that is not recorded in the split-screen application list, and is updated in the split-screen application list, as shown in Figure 25.

In some embodiments, the display device creates a list of split-screen application combinations only when the function of quickly switching split-screen applications is used for the first time. As the user's needs increase, the user may add many applications in the subsequent use of the display device. Using the above means, the list of split-screen applications can be updated, and the combination of newly added applications that support split-screen and existing split-screen applications is recorded in the list of split-screen applications. After the user uses it once, he can directly find and use it in the list of split-screen applications, which makes the operation more convenient and improves user experience.

For another example, in the state shown in Figure 26, when the browser application A in the main screen area browses a new webpage and page switching occurs, but the changed page does not support the split-screen mode, the controller will exit the split-screen mode, use the ActivityManager to specify the display space for the newly launched non-split-screen application A as the entire screen, and return the application B in the secondary screen area to the background, as shown in Figure 27.

In some embodiments, in the full-screen mode of the display device, that is, in the full-screen display state of the display, the user can use the quick switch split-screen application function to perform a split-screen application switching operation, and switch the A application displayed on the full screen of the display to the B application and the C application displayed on the display split screen.

In a display device provided in an embodiment of the present application, a controller connected to the display and a control device executes a split-screen application switching method. Specifically, the controller is further configured to perform the following operations:

Operation 1. Respond to the second instruction, and acquire a split-screen application combination list; wherein, the second instruction is an instruction for selecting a split-screen application received by the display device under full-screen display on the display, and the split-screen application combination list includes all multiple candidate split-screen application combinations, and each candidate split-screen application combination includes a main-screen application and a secondary-screen application.

Operation 2, presenting a split-screen application combination list on the display.

Operation 3. In response to the second split-screen application combination selection instruction, present the main-screen application in the selected split-screen application combination on the main screen area of the display, and present the secondary-screen application in the selected split-screen application combination in the secondary screen area of the display, wherein the selected split-screen application combination is one of the candidate split-screen application combinations, and the main screen area and the secondary screen area do not overlap.

For example, application A is displayed in the full screen mode of the display device.

When the user needs to perform multitasking operations on the display device, that is, to display application B and application C in the split-screen mode of the display device, the user does not need to exit the main screen mode at this time, but only needs to start the function of quickly switching split-screen applications, and call out and present the list of split-screen application combinations on the display through the controller.

Among them, according to the settings of the B application and the C application in the split-screen application combination list, the main screen application is presented in the main screen area, and the secondary screen application is presented in the secondary screen area.

In practical applications, it is also possible to switch the application A displayed on the full screen of the monitor to the application A and application C displayed on the split screen of the monitor, so that it can be changed to the split screen mode without exiting the full screen mode, thereby realizing multitasking operations in the split screen mode and improving user experience.

As can be seen from the above, the display device, split-screen display, and split-screen application switching method provided by this application ensure that the user can trigger split-screen display only for applications that support split-screen, and provide the realization logic from full-screen display to split-screen display, and from split-screen display to full-screen display, which can ensure the realization of the interface conversion process during the split-screen display process and improve the performance of human-computer interaction. , to perform quick switching without entering the application list again to select, which improves the convenience and experience of operation; when there is a page switch or jump in the split-screen application, the first split-screen application combination of the main screen and secondary screen after the page change can be obtained, and compared with the existing split-screen application combinations in the split-screen application combination list, and the split-screen application combinations that do not exist in the split-screen application combination list are saved to achieve real-time updates;

An embodiment of the present application provides a computer-readable non-volatile storage medium, on which a computer program is stored. When the computer program is executed by a processor, each process of the split-screen display method in the above-mentioned method embodiment can be achieved, and the same technical effect can be achieved. To avoid repetition, details are not repeated here. Wherein, the computer-readable storage medium may be ROM, RAM, magnetic disk or optical disk, and the like.

Claims (17)

1. A display device comprising:

   The user input interface is configured to: receive user input;

   a display configured to: display images and/or interfaces;

   The controller is configured to: in response to receiving a startup input for the first application through the user input interface, draw the interface of the first application according to the full-screen window size in full-screen display, and control the display to display the interface of the first application in full screen;

   controlling the display to display a split-screen control on an upper layer of the interface of the first application, wherein the first application supports split-screen display;

   In response to receiving a first input for the split-screen control through the user input interface, determine the size of the first split-screen window corresponding to the first split-screen area, redraw the interface of the first application according to the size of the first split-screen window, and determine the size of the second split-screen window corresponding to the second split-screen area, draw an application selection interface according to the size of the second split-screen window, and control the display to display the interface of the first application in the first split-screen area, and display the application selection interface in the second split-screen area;

   Wherein, the application selection interface includes at least one identifier, and the at least one identifier is used to identify at least one application that supports split-screen display.
2. The display device according to claim 1, wherein the controller is configured to: when detecting that the first application supports split-screen display and there are other applications supporting split-screen display, control the display to display the split-screen control on the interface of the first application.
3. The display device according to claim 1, the controller is further configured to: control the display to display a boundary control between the first split screen area and the second split screen area;

   Resizing the first split-screen window and the second split-screen window in response to receiving a drag input for the border control through the user input interface.
4. The display device according to claim 1, the controller is further configured to:

   After the application selection interface is displayed in the second split-screen area, in response to a second input received through the user input interface, control the display to update and display the application selection interface as an interface of a second application;

   Wherein, the second input is an input for the identification of the second application, and the second application is one of the at least one application that supports split-screen display.
5. The display device according to claim 4, the controller is further configured to:

   After the display is controlled to update and display the application selection interface as the interface of the second application, the display is controlled to display a full-screen control on an upper layer of a target split-screen area, and the target split-screen area is the first split-screen area or the second split-screen area;

   In response to receiving a third input for the full-screen control through the user input interface, according to the size of the full-screen window, redraw the target interface, and control the display to display the redrawn target interface in full screen;

   Wherein, the target interface is an interface displayed in the target split-screen area.
6. The display device according to claim 1, the controller is configured to:

   If the target whitelist includes the identifier of the first application, then determine that the first application supports split-screen display, and control the display to display the split-screen control on the upper layer of the interface of the first application;

   Wherein, the target white list is used to store identifiers of all applications supporting split-screen display.
7. The display device according to claim 1, the controller is configured to:

   acquiring attribute information of the first application;

   If the attribute information of the first application includes a target attribute value, then determine that the first application supports split-screen display, and control the display to display the split-screen control on the upper layer of the interface of the first application;

   Wherein, the target attribute value is used to indicate that the first application supports split-screen display.
8. The display device according to claim 1, the controller is configured to:

   switching a full-screen stack to a split-screen stack in response to the first input;

   Obtaining the size of the first split-screen window and the size of the second split-screen window correspondingly set by the split-screen stack;

   Obtaining interface data corresponding to the first input, and storing it in an activity stack corresponding to the split-screen stack, wherein the interface data includes: data of the interface of the first application, and data of the application selection interface;

   Reading the interface data from the activity stack corresponding to the split-screen stack, drawing the interface of the first application according to the size of the first split-screen window, and drawing the application selection interface according to the size of the second split-screen window.
9. The display device according to claim 5, the controller is configured to:

   In response to the third input, switch the split-screen stack to a full-screen stack, so as to obtain the full-screen window size correspondingly set by the full-screen stack;

   storing the data of the target interface corresponding to the third input into the active stack corresponding to the full-screen stack;

   Reading the data of the target interface from the activity stack corresponding to the full screen stack, and redrawing the target interface according to the size of the full screen window.
10. The display device according to any one of claims 1-9, comprising:

    The controller is further configured to: respond to the first instruction, and acquire a split-screen application combination list; wherein, the first instruction is an instruction to switch split-screen applications received by the display device under split-screen display on the display, and the split-screen application combination list includes all multiple candidate split-screen application combinations, and each candidate split-screen application combination includes a main screen application and a secondary screen application;

    presenting the split-screen application combination list on the display;

    In response to the first split-screen application combination selection instruction, presenting the main-screen application in the selected split-screen application combination on the main screen area of the display, and presenting the secondary-screen application in the selected split-screen application combination in the display secondary-screen area, wherein the selected split-screen application combination is one of the candidate split-screen application combinations, and the main screen area does not overlap with the secondary screen area.
11. The display device according to claim 10, the controller is further configured to:

    Before responding to the first instruction and obtaining the combination list of split-screen applications, obtain all applications that support split-screen, and obtain the package name and startup page of each application that supports split-screen;

    Combine all split-screen applications in pairs to obtain multiple candidate split-screen application combinations with package names and startup pages; the two package names in each candidate split-screen application combination are used as the unique identification of the combination;

    The multiple candidate split-screen application combinations combined in pairs are integrated into the split-screen application combination list.
12. The display device according to claim 11, the controller is further configured to:

    Record the package names corresponding to the main screen application and the secondary screen application, the corresponding startup page, screenshots, and split screen ratios in the split screen application combination list; wherein the candidate split screen application combinations in the split screen application combination list are sorted according to the length of use and generation time, and the priority of the length of use time is higher than the generation time.
13. The display device according to claim 11, the controller is further configured to:

    According to the preset white list supporting split-screen applications in the controller and the configuration items in the configuration file of the split-screen application itself, filter to obtain applications that support split-screen and their corresponding package names;

    Obtain the startup page of the corresponding application that supports split-screen through PackageManager, and obtain the package name and startup page of each application that supports split-screen.
14. The display device according to claim 10, the controller is further configured to:

    Judging whether the main screen application and the secondary screen application in the selected split-screen application combination are started;

    If both the main screen application and the secondary screen application have been started, start the main screen application in the main screen area and start the secondary screen application in the secondary screen area, adjust the occupied space of the main screen and the secondary screen in the split screen according to the split screen ratio in the split screen application combination list, and present the main screen and the secondary screen on the display in the form of a split screen;

    If the main screen application and/or the secondary screen application have been started, then according to the package name and startup page corresponding to the main screen application and/or the secondary screen application, the main screen application is transferred back to the foreground display, and the display space of the main screen application is obtained;

    If the main screen application and/or the secondary screen application are not started, the main screen application and/or the secondary screen application are cold-started and displayed in the foreground through the ActivityManager, and the display space of the main screen application and/or the secondary screen application is obtained.
15. The display device according to claim 10, the controller is further configured to:

    Monitoring whether there is page switching or jumping in the main screen application and/or the secondary screen application of the display interface;

    When there is page switching or jumping in the main screen application and/or the secondary screen application, it is judged whether the new page of the switching or jumping supports split screen;

    If the new page application of the switch or jump supports split screen, then take a screenshot of the display screen after the page change, generate a screenshot picture, obtain the first split-screen application combination according to the package name of the main-screen application and/or the secondary-screen application after the page change; compare the first split-screen application combination with all alternative split-screen application combinations in the split-screen application list; The screen picture is updated to the split-screen application combination list; if the comparison between the first split-screen application combination and all alternative split-screen application combinations in the split-screen application combination list is inconsistent, the first split-screen application combination is saved in the split-screen application combination list;

    If the switching or jumping new page does not support split-screen, then close the split-screen mode, use the whole screen as the display space of the switching or jumping page through the ActivityManager, and retreat another split-screen application to the background.
16. The display device according to claim 10, the controller is further configured to:

    Responding to the second instruction, and obtaining a split-screen application combination list; wherein, the second instruction is an instruction for selecting a split-screen application received by the display device under full-screen display of the display, the split-screen application combination list includes all multiple candidate split-screen application combinations, and each candidate split-screen application combination includes a main screen application and a secondary screen application;

    presenting the split-screen application combination list on the display;

    Responding to a second split-screen application combination selection instruction, presenting a main-screen application in the selected split-screen application combination on the main screen area of the display, and presenting a secondary-screen application in the selected split-screen application combination in the display secondary-screen area, wherein the selected split-screen application combination is one of the candidate split-screen application combinations, and the main screen area does not overlap with the secondary screen area.
17. A split-screen display method for a display device, comprising:

    In response to the start input for the first application, draw the interface of the first application according to the full-screen window size when the display of the display device is displayed in full screen, and display the interface of the first application in full screen;

    Displaying a split-screen control on an upper layer of the interface of the first application, wherein the first application supports split-screen display;

    In response to the first input for the split-screen control, determine the size of the first split-screen window corresponding to the first split-screen area, redraw the interface of the first application according to the size of the first split-screen window, and determine the size of the second split-screen window corresponding to the second split-screen area, draw an application selection interface according to the size of the second split-screen window, display the interface of the first application in the first split-screen area, and display the application selection interface in the second split-screen area;

    Wherein, the application selection interface includes at least one identifier, and the at least one identifier is used to identify at least one application that supports split-screen display.

Images